Quantcast

What works and what is paused · Email is limited to account activation and password resets.

Jump to content


Photo

Major Downtime


  • Please log in to reply
39 replies to this topic

#1 Hydrogen

Hydrogen
  • Neocodex Co-Founder

  • 22213 posts


Users Awards

Posted 22 January 2011 - 10:30 AM

Neocodex has just recovered from a major downtime of about nine hours last night. Something went horribly wrong with php on our server and the communication from the server to all of our machines was getting interrupted. The problem has now been fixed and the site and all of our services should be back up and running again. Please let us know in this thread if there is anything that is still broken and I'll take a look at the problem.

Due to the downtime, we're going to be extending everyone's subscription expiry dates by a day. That should take place some time soon after this post :).

Advertisement

    #2 Icey Defeat

    Icey Defeat
    • 8298 posts


    Users Awards

    Posted 22 January 2011 - 10:34 AM

    Great job Hydro. We appreciate all you do for us!

    #3 Jesii

    Jesii
    • 25 posts

    Posted 22 January 2011 - 10:35 AM

    Oh yay! I was worrying that my phone was broken because I couldn't get on! Glad you're back (:

    #4 Neoquest

    Neoquest
    • 1760 posts


    Users Awards

    Posted 22 January 2011 - 10:43 AM

    Good thing you guys got back on!

    #5 olivertwist1989

    olivertwist1989
    • 2 posts

    Posted 22 January 2011 - 10:46 AM

    I thought something was wrong with my phone as well. Thank you.

    #6 Ziz

    Ziz
    • 936 posts

    Posted 22 January 2011 - 10:52 AM

    Thanks for fixing it Hydro. Good thing codex is working again :)

    Oh yay! I was worrying that my phone was broken because I couldn't get on! Glad you're back (:

    I thought something was wrong with my phone as well. Thank you.

    Luckily we have tools to help us know if a site is down for everyone.

    #7 ShadowLink64

    ShadowLink64
    • 16735 posts


    Users Awards

    Posted 22 January 2011 - 11:43 AM

    Thanks Hydro for getting us back up.

    Right now the admins are trying to diagnose the problem. I think I know what happened, and we're probably going to program a monitoring daemon that makes sure that this never happens again. Sorry about that. :(

    #8 Dolly

    Dolly
    • 71 posts

    Posted 22 January 2011 - 12:01 PM

    Haha ive never checked to see if a site was back up and running so many times, my interest in this forum has been proven yet again :p

    #9 iargue

    iargue
    • 10048 posts


    Users Awards

    Posted 22 January 2011 - 12:10 PM

    This reminds me of the fact that I got up at 6 to fix a downed server at work.

    Servers like to crash together it seems.

    #10 Islane

    Islane
    • 510 posts

    Posted 22 January 2011 - 12:12 PM

    Admins and everyone don't be sorry about that. It can happens for every websites major issues like that. Thanks for putting it back on and it's working good again :)

    #11 Tigerzz

    Tigerzz
    • 160 posts

    Posted 22 January 2011 - 12:30 PM

    I agree with Islane... at least you fixed it, it wasn't your fault and your giving everyone an extension :D

    #12 iargue

    iargue
    • 10048 posts


    Users Awards

    Posted 22 January 2011 - 12:32 PM

    I agree with Islane... at least you fixed it, it wasn't your fault and your giving everyone an extension :D



    If you get any errors right now. SL is trying to break the server :|

    #13 ShadowLink64

    ShadowLink64
    • 16735 posts


    Users Awards

    Posted 22 January 2011 - 12:37 PM

    Alright guys, I have a monitoring daemon to keep the web server in check. Anytime a major crash like this happens, it will just restart the web server. Instead of 9 hours of downtime, we should see more like 5 seconds of downtime. :p

    If you get any errors right now. SL is trying to break the server :|

    Nah, it worked. The downtime lasted all of 5 seconds.

    #14 Islane

    Islane
    • 510 posts

    Posted 22 January 2011 - 12:44 PM

    Thanks guys. I was missing you all day long (it was daytime for me ;) )
    This forum is pretty addicting :D

    #15 esilim

    esilim
    • 508 posts

    Posted 22 January 2011 - 12:55 PM

    Excellent plan. Maybe you could also build something into the codex checker that automatically sends a note somewhere if it can't communicate as well.

    #16 jcrdude

    jcrdude
    • Oh shit there's a thing here

    • 7001 posts


    Users Awards

    Posted 22 January 2011 - 01:40 PM

    When in doubt, jump in IRC.

    It may not have the same feel as the forums, but the people are just as awesome.

    I'm glad I wasn't in charge of that bullsh ;)

    #17 ShadowLink64

    ShadowLink64
    • 16735 posts


    Users Awards

    Posted 22 January 2011 - 01:44 PM

    Excellent plan. Maybe you could also build something into the codex checker that automatically sends a note somewhere if it can't communicate as well.

    Like we've mentioned lately, we're redoing the entire system, so the Codex Checker will soon not exist in the way you remember it. :p

    #18 ArticTheTiger

    ArticTheTiger
    • 1318 posts

    Posted 22 January 2011 - 01:46 PM

    Like we've mentioned lately, we're redoing the entire system, so the Codex Checker will soon not exist in the way you remember it. :p


    `Thank freaking god.

    If you need UI graphics you know how to contact me :p

    #19 ShadowLink64

    ShadowLink64
    • 16735 posts


    Users Awards

    Posted 22 January 2011 - 01:48 PM

    `Thank freaking god.

    If you need UI graphics you know how to contact me :p

    Well, now that you mention it... we need some icons. Both for the *secret thing* that I will PM you about (if you are willing), and for some programs, though I think the *secret thing* is more critical right now. :p

    #20 ArticTheTiger

    ArticTheTiger
    • 1318 posts

    Posted 22 January 2011 - 01:58 PM

    Well, now that you mention it... we need some icons. Both for the *secret thing* that I will PM you about (if you are willing), and for some programs, though I think the *secret thing* is more critical right now. :p


    Check the Icon thread in graphics I JUST posted in :p, I can design different designs too :p

    #21 Seren

    Seren
    • 45 posts

    Posted 22 January 2011 - 02:10 PM

    When in doubt, jump in IRC.

    It may not have the same feel as the forums, but the people are just as awesome.

    I'm glad I wasn't in charge of that bullsh ;)


    Yeah, I found out through IRC that soul_stealer listens to Beyonce!

    Thanks for fixing the server everyone. :)

    #22 Daywalker88

    Daywalker88
    • 62 posts

    Posted 22 January 2011 - 02:13 PM

    scarred the shit outta me man, so glad you guys got everything worked out :)

    #23 Kat

    Kat
    • KatDog 5ever

    • 2098 posts


    Users Awards

    Posted 22 January 2011 - 02:20 PM

    Thanks for fixing! I was worried about it all day at work! :p

    #24 artificial

    artificial
    • 186 posts


    Users Awards

    Posted 22 January 2011 - 02:38 PM

    I cried for hours because I thought I had been banned.

    #25 Icey Defeat

    Icey Defeat
    • 8298 posts


    Users Awards

    Posted 22 January 2011 - 03:22 PM

    I cried for hours because I thought I had been banned.


    Same.

    Btw, as a reward for us all being so patient I think the Abrosia update is in order.


    1 user(s) are reading this topic

    0 members, 1 guests, 0 anonymous users