So what on earth did I do?

Dav

OK folks, here's a breakdown of what happened today.

There was some maintenance to be done - the Airsoft forums are getting a bit of a tidy up, so I started on that.

I was not as careful with the vBulletin tools that manage this as I should have been and I accidentally copied every post from the site into one of the Airsoft forums instead of just the posts from one of the forums that was getting merged.

As you might imagine, moving 40+ million posts caused something of a catastrophic problem for the site.

So, to repair the problem, the site was taken offline and Colm and Chris on our sys admin team as well as Rónán from Tech spent the afternoon restoring from a backup. The time on that backup was about 6:30am this morning, so we have lost all posts created between then and now.

I can only apologise to you all for making this mistake and taking us offline. It was bloody stupid and I'm mortified that I made such a balls of something that should have been reasonably straight forward.

I hope your afternoon wasn't too badly upset by the outage.

UPDATE @ 19:50: The site will be slow for a while as the database caches build back up. There's unfortunately no way to speed this up other than to keep using the site. It's an unfortunate side effect of doing a total restoration of the database servers.

Skill Magill

Would deleting the Airsoft Forum ensure that it wouldn't happen again?
Bloody Airsoft

Dav

Ah here, let's be fair! This was all on me, Airsoft did nothing wrong at all

Lyssa

No worries Dav, the dinner is cooked and the house is clean, my family salutes you!

TheBody

P45 is in the post Dav.

Regards,

Distilled Media CEO

Sully

Did you try clicking 'Undo'?! :P

Mistakes happen, its no big deal at the end of the day. Its the internet.

Welcome Back Boards, and well done to all for the work done getting the site back up and running.

Gwan the Boards Team!

Orion

sure it could happen to anyone ... well anyone with access to the big red button

Pacing Mule

Fair play Dav for the honest hands up on this. It's not the end of the world at all and anyone who acts like it was should get a banning.

Stella Virgo

Skill Magill wrote: »

Would deleting the Airsoft Forum ensure that it wouldn't happen again?
Bloody Airsoft

True....wannabe soldiers with their little plastic pea shooters:rolleyes:,running thru the woods shouting"gotcha"
has to be the gayest game ever .....;)

Gordon

Hehe, good to see it's not just me that can make big f*ckups! Fair play to Colm, Chris and Rónán for getting us back up and running.

40 million new posts in one of the airsoft forums, that would have been great craic for anyone following that forum with instant email notifications set up.

Oryx

Still slow as an octogenarian here.

To err is human, Dav. To forgive is divine. Just don't do it again or it's fire and brimstone for you!

LeinsterDub

Where are the sticks gone?

Toto Wolfcastle

Bring me cake and all will be forgiven.

Mistakes happen. Hope you're all having a large drink right now.

Nodin

Skill Magill wrote: »

Would deleting the Airsoft Forum ensure that it wouldn't happen again?
Bloody Airsoft

Never would have happened if they used real guns and bullets.

fred funk }{

Things are running very slow for me. Anyone else?

Backfire

Everyone makes mistakes Dav

at least its back up and running now so its only idiots that will complain from now on

YuM

Managers with admin rights keeping techs in jobs for years.
Its rare they admit it though.

rizzodun

I never did understand a lot of that airsoft lingo, moving 40 million posts from everywhere else would've showed them just how I feel. I say do it again!

jobeenfitz

I'm old school and I grew up in a time when fcuk ups were punishable offences. There must be punishment! Any suggestions?

Chucken

Even when they said it was the hamsters, I knew it was the tortoise all the time!

No harm to give us all a day off. I got loads of work done

Oryx

Oryx wrote: »

Still slow as an octogenarian here.

To err is human, Dav. To forgive is divine. Just don't do it again or it's fire and brimstone for you!

Just be thankful that the backups weren't on audio cassette tapes like it was in the last century, errr I mean in the early 1980s

fred funk }{

Things are running very slow for me. Anyone else?

antodeco

Aw man. And I posted the euromillins results for next week

Chucken

Even when they said it was the hamsters, I knew it was the tortoise all the time!

No harm to give us all a day off. I got loads of work done

Darkglasses

So what your saying is..Boards has gone back in time?

woodyg

miss takes happen i've made some whoppers in IT over the years
it's the admitting and rectifying that highlight a true man\teams decency

what i've found over the years is the use of CRM helps to reduce the miss takes but more importantly helps recover faster from them

Nerd interest here
how big was the oracle database restore?
im guessing TB's

fred funk }{

Things are running very slow for me. Anyone else?

Super-Rush

Which ones the any key?

hoodwinked

For what its worth Dav, i was absolutely deathly nervous going back to comp sci in college tomorrow, i always feel like i have the power in me to **** up so royally and bring the whole uni it system down.


you now have not only re-assured me, that it can happen to anyone even the greats, so now if i don't knock out a system or two, ill feel like a failure!

Fluorescence

I thought I'd accidentally ballsed up R&R when I clicked onto the forum and all the threads had the redirected symbol I'm just kinda ecstatic that it was nothing to do with me :pac: :pac:


Fair play for the hands up, though! Shit happens

Pushtrak

Next time move all the posts in to one thread, and then the next time, all the posts in to one comment.

tinkerbell

Woohoo! It's back! Don't worry, Dav - mistakes happen. You'll be forgiven, eventually

ctrl-alt-delete

Mistakes happen, funny one all the same

A hell of a lot of duplicate and quadruplicate posts about at the moment,

If anyone plans on deleting them, don't delete everything!

Quazzie

Will someone please answer fred? :eek:




Seriously though, everything is running slow.

Professey Chin

Not gonna lie. Im impressed at that :pac:

tinkerbell

Woohoo! It's back! Don't worry, Dav - mistakes happen. You'll be forgiven, eventually

Well done to the guys for getting it back up and running again.

christophicus

No probs Dav, I only feel sorry for the folks having to work on Sunday. Still, keep up what's normally good work :P!

Dav

UPDATE @ 19:50: The site will be slow for a while as the database caches build back up. There's unfortunately no way to speed this up other than to keep using the site. It's an unfortunate side effect of doing a total restoration of the database servers.

bnt

Nice to know such PICNIC errors happen to people other than myself. Move the server(s) in to the "cloud", that's apparently the solution to every computer problem, innit?

Creamy Goodness

seems to be an echo since coming back up? anyone else?

jobeenfitz

Darkglasses wrote: »

So what your saying is..Boards has gone back in time?

Twice?

gifted

Not good enough...I want a head on a platter...with fruit..:D

wnolan1992

Dav, I'd say you need to replace your Tagline with Danny's old "Hamster Killer" one as a punishment. :pac:

Sarky

Pop Dav in the wheel with hamsters, speed the site up a bit until she's back to normal.

I have visions of the database engine being a bit like this one! :pac:

https://www.youtube.com/watch?v=TchbiZJlkBw

KevIRL

lol if yer gonna fukk up, may as well do it spectacularly, wp Dav:pac:

So, were all private fora posts viewable for a short time in Airsoft? Even the super sekrit Admin, Moderator and Reported Post forum?

Ruu

Can we bring a back boards.tv or something to get our fix if things go pear shaped again? Thanks to Dav and the team, apologies for the whingy bastids on Twitter complaining.

Ginny

Sure it was national take down the Christmas tree today, house clean and looking ginormous now!

Alannah Gallagher

Dav, I respect you.

We all make a donkey's shyte of something once in a while, 99% of people would have blamed technical issues or something "outside of our control".

You were honest, that's priceless.

Spear

Dav's confession is now at 147 thanks and rising. This was just one convoluted attempt at thanks-whoring wasn't it?