Server maintenance this weekend (1 Viewer)

[rettucs]

nope - i use AWS S3 for backup storage and SES for mail delivery, and i use cloudflare R2 for object storage and caching and the like. i'll probably consolidate it all on cloudflare at some point. but the server the site is hosted on is itself is a VM on an ESXi server in OVH

I see

 

[chris d]

god speed

c:\>robocopy

 

[pete]

god speed

c:\>robocopy

robocopy is the best

this weekend could be more rm -rf

 

[rettucs]

or like, just use network attached storage

 

[magicbastarder]

nope - i use AWS S3 for backup storage and SES for mail delivery, and i use cloudflare R2 for object storage and caching and the like. i'll probably consolidate it all on cloudflare at some point. but the server the site is hosted on is itself is a VM on an ESXi server in OVH

even though i have been working with computers since i first got a full time job, there's still a real retro encabulator vibe for me off this.

 

[magicbastarder]

god speed

c:\>robocopy

when i discovered the MT switch on robocopy it was like the second coming of christ to me.

 

[ann post]

Is this a good thread to ask noob questions about backups on

 

[pete]

Is this a good thread to ask noob questions about backups on

NO

 

[magicbastarder]

you'll get his back up with a response like that.

 

[pete]

looks like i need to do this tonight, not saturday night....

 

[Deadmanposting]

Quick question - what do we do if someone dies or gets cancelled during this brown out?

Candle lit vigil at the @thumped Twitter account

 

[Denny Oubidoux]

I'd love to offer an extra pair of hands to shift the data over to the new site but its friday, I don't feel like it

 

[pete]

Quick question - what do we do if someone dies or gets cancelled during this brown out?

Well as of right now I plan on seeing out the weekend at least

 

[pete]

Candle lit vigil at the @thumped Twitter account

I’ll be keeping my public informed at

thumped dot com (@pete@mst.thumped.com)

288 Posts, 223 Following, 106 Followers · I made this.

mst.thumped.com

 

[Deadmanposting]

I racked up many, many posts there and did my penance moderating some of the music forums for a while. I have no desire to go back there.

Aren't boards moderators kinda like if the Stanford Prison Experiment never ended?

Not you, I mean. Just all the other guys.

 

[magicbastarder]

I'm a mod on boards. It's not well known that all Irish discussion forums collaborate, which means I get to see all your details on thumped too.

 

[Kermit McDermott]

Good band server maintenance.

 

[pete]

ok wish me luck

 

[pete]

Urrrgg what a mare. For the benefit of future me -

When I set up the new server it turned out it couldn’t establish an ssh connection with the old server (and viceversa) as the version running on the old server was so out of date. Upgrading it wasn't really an option due to the risk of making shit worse, and i really didn't want to lose the ability to connect from here as well... So, while i was connected i made some changes to the config (added some newer cipher settings and the like) so that the new server could establish a connection and restarted the SSH process. That worked, and I was able to transfer the mastodon server overnight.

In the meantime, the SSH connection to the old server from here dropped and I discovered yesterday morning that i couldn't reconnect... or rather it would reconnect and then immediately drop the connection. I thought maybe a reboot would help (it didn't)… ssh -v still indicated key exchange problems and the like. Not a problem - all i needed to do was undo the cipher changes that I'd made and...… yeah, now I'd no access to do that.

Normally at this point you'd just walk to the actual server and sort it out, but that's not really an option since the server in question is sitting in a datacentre in Roubaix, which I'm sure is lovely at this time of year but not very practical for getting to in a hurry. To get access back I had to put the server into rescue mode, which is the equivalent of booting a broken machine up from a live CD or whatever. Did this, got SSH access back and... where are my files?

Long story short, I had to figure out what filesystem had to be mounted (/dev/sda5 as it happens) to get access to the hypervisor OS files which for some reason are stored in tar files within tar files (took me about an hour to figure that one out), extracted /etc/ssh/ folder, undid the change i'd made the night before, replaced the tar file, almost modified the wrong files a couple of times in the process, then crossed my fingers and rebooted.

I can now SSH from the old to the new server again which means we're still on for 10pm Saturday night for the big move.

it me

Corey Quinn (@Quinnypig@awscommunity.social)

Attached: 1 image @isis@mastodon.social

awscommunity.social

 

[Cornu Ammonis]

so did it work?