# Outage since last night was my fault, derp **URL:** \ **Category:** meta\ **Created:** [November 29, 2018, 1:35pm UTC](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583 "2018-11-29T13:35:03Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![Lee\_Ars](https://sea1.discourse-cdn.com/flex001/user_avatar/cog.discourse.group/lee_ars/32/2338_2.png) [@Lee\_Ars](https://cog.discourse.group/u/Lee_Ars)\ **Post date:** [November 29, 2018, 1:35pm UTC](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583/1 "2018-11-29T13:35:03Z")
If you encountered a 502 error getting to the forums over the past 12-ish hours, that was me. I had the hosting company doing a BIOS upgrade on the web server last night, which required a reboot, and it appears that someone hit the CoG forum URL at exactly the right instance at the tail end of the reboot, just before the Discourse docker container was fully back online. The 502 bad gateway response was cached, and Varnish has been serving that since last night. It would have eventually fixed itself as the cache expired, but I’ve killed & restarted Varnish and that appears to have fixed the problem. Thanks to @nabiki for the heads-up! tl;dr - Caching. It’s always caching. ---
**Author:** ![Ook](https://sea1.discourse-cdn.com/flex001/user_avatar/cog.discourse.group/ook/32/72_2.png) [@Ook](https://cog.discourse.group/u/Ook)\ **Post date:** [November 29, 2018, 6:59pm UTC](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583/2 "2018-11-29T18:59:14Z")
Oops, that probably was me Muhuhahahaha /runs away ---
**Author:** ![Road\_Rash](https://sea1.discourse-cdn.com/flex001/user_avatar/cog.discourse.group/road_rash/32/147_2.png) [@Road\_Rash](https://cog.discourse.group/u/Road_Rash)\ **Post date:** [November 29, 2018, 7:59pm UTC](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583/3 "2018-11-29T19:59:51Z")
Who do I contact for a refund? ---
**Author:** ![Johtoguy](https://sea1.discourse-cdn.com/flex001/user_avatar/cog.discourse.group/johtoguy/32/917_2.png) [@Johtoguy](https://cog.discourse.group/u/Johtoguy)\ **Post date:** [December 4, 2018, 1:42am UTC](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583/4 "2018-12-04T01:42:13Z")
Wait you pay for BigDino?? ---
**Author:** ![Road\_Rash](https://sea1.discourse-cdn.com/flex001/user_avatar/cog.discourse.group/road_rash/32/147_2.png) [@Road\_Rash](https://cog.discourse.group/u/Road_Rash)\ **Post date:** [December 4, 2018, 2:12am UTC](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583/5 "2018-12-04T02:12:35Z")
I’m on the premium plan. ---
**Author:** ![Ook](https://sea1.discourse-cdn.com/flex001/user_avatar/cog.discourse.group/ook/32/72_2.png) [@Ook](https://cog.discourse.group/u/Ook)\ **Post date:** [December 4, 2018, 4:51am UTC](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583/6 "2018-12-04T04:51:18Z")
Premium plan eh? You have Lee’s personal mobile number? 🤣 ---
**Author:** ![MSUAlexis](https://sea1.discourse-cdn.com/flex001/user_avatar/cog.discourse.group/msualexis/32/7_2.png) [@MSUAlexis](https://cog.discourse.group/u/MSUAlexis)\ **Post date:** [December 4, 2018, 12:49pm UTC](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583/7 "2018-12-04T12:49:06Z")
Well, shicks, that may have been me… I was uploading pics and it was giving me weird error messages but I figured I was just doing it wrong so continued on my way. Then the forums were gone. Sorry! ---
**Author:** ![Lee\_Ars](https://sea1.discourse-cdn.com/flex001/user_avatar/cog.discourse.group/lee_ars/32/2338_2.png) [@Lee\_Ars](https://cog.discourse.group/u/Lee_Ars)\ **Post date:** [December 6, 2018, 12:49pm UTC](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583/8 "2018-12-06T12:49:15Z")
It’s no problem! Didn’t mean to make it sound like someone was to blame or anything like that—it’s just a consequence of upgrading in the middle of production rather than doing things the “right” way. The “right” way would be to pick an off-hours outage window, alert everybody about the outage at intervals starting 48 hrs prior to the picked time, switch the site over to a maintenance/outage “we’ll be right back” page, do the upgrade, and then cut back live. ![1-8xraf6eyaXh-myNXOXkqLA](https://us1.discourse-cdn.com/flex001/uploads/cog/original/2X/3/32c7f04f1793cd81d128a09e326f647254118128.jpeg) ---
**Author:** ![MikeP](https://avatars.discourse-cdn.com/v4/letter/m/a4c791/32.png) [@MikeP](https://cog.discourse.group/u/MikeP)\ **Post date:** [December 6, 2018, 5:58pm UTC](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583/9 "2018-12-06T17:58:56Z")
I am Spartacus ---
**Author:** ![Ook](https://sea1.discourse-cdn.com/flex001/user_avatar/cog.discourse.group/ook/32/72_2.png) [@Ook](https://cog.discourse.group/u/Ook)\ **Post date:** [December 6, 2018, 6:07pm UTC](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583/10 "2018-12-06T18:07:39Z")
> [@MikeP](#): > > I am Spartacus 😂 lol hehe But I’m also guilty of doing such things like rebooting a DC during the day… ---
**Author:** ![Lee\_Ars](https://sea1.discourse-cdn.com/flex001/user_avatar/cog.discourse.group/lee_ars/32/2338_2.png) [@Lee\_Ars](https://cog.discourse.group/u/Lee_Ars)\ **Post date:** [December 24, 2018, 1:00am UTC](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583/11 "2018-12-24T01:00:55Z")
Heyyyyyyyyyyyyy I did it again. Apologies for anyone who saw a weird-ass error for a bit this evening. The good news, though, is that now everything in the entire web stack now uses unix sockets instead of loopback ports! Which…okay, yeah, that sounds a lot less impressive because it’s just kind of an under-the-hood change but it was neat figuring out how to make it work! ---
**Author:** ![Road\_Rash](https://sea1.discourse-cdn.com/flex001/user_avatar/cog.discourse.group/road_rash/32/147_2.png) [@Road\_Rash](https://cog.discourse.group/u/Road_Rash)\ **Post date:** [December 24, 2018, 2:43pm UTC](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583/12 "2018-12-24T14:43:39Z")
I’d be worried if you weren’t tinkering under the hood around here… ---
**Author:** ![Nabiki](https://sea1.discourse-cdn.com/flex001/user_avatar/cog.discourse.group/nabiki/32/935_2.png) [@Nabiki](https://cog.discourse.group/u/Nabiki)\ **Post date:** [December 25, 2018, 12:41am UTC](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583/13 "2018-12-25T00:41:55Z")
All of today I’ve noticed that CoG is slow to load, loads a blank page, then works normally after refreshing. Anyone else seeing that? ---
**Author:** ![Ook](https://sea1.discourse-cdn.com/flex001/user_avatar/cog.discourse.group/ook/32/72_2.png) [@Ook](https://cog.discourse.group/u/Ook)\ **Post date:** [December 25, 2018, 9:56am UTC](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583/14 "2018-12-25T09:56:16Z")
Works fine on mobile here in Ookville ---
**Author:** ![Lee\_Ars](https://sea1.discourse-cdn.com/flex001/user_avatar/cog.discourse.group/lee_ars/32/2338_2.png) [@Lee\_Ars](https://cog.discourse.group/u/Lee_Ars)\ **Post date:** [December 25, 2018, 4:45pm UTC](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583/15 "2018-12-25T16:45:48Z")
> [@Nabiki](#): > > All of today I’ve noticed that CoG is slow to load, loads a blank page, then works normally after refreshing. Anyone else seeing that? Yes, I left something out of the config and it was causing a lot of really weird unintended redirects. Should be OK as of yesterday evening. @Nabiki, if you’re still seeing oddness, please do let me know. ---
**Author:** ![Nabiki](https://sea1.discourse-cdn.com/flex001/user_avatar/cog.discourse.group/nabiki/32/935_2.png) [@Nabiki](https://cog.discourse.group/u/Nabiki)\ **Post date:** [December 26, 2018, 3:18am UTC](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583/16 "2018-12-26T03:18:07Z")
It loaded fine just now. It didn’t this morning. I’ll let you know if I experience that issue again. 🙂 ---
**Author:** ![Nabiki](https://sea1.discourse-cdn.com/flex001/user_avatar/cog.discourse.group/nabiki/32/935_2.png) [@Nabiki](https://cog.discourse.group/u/Nabiki)\ **Post date:** [December 26, 2018, 1:27pm UTC](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583/17 "2018-12-26T13:27:11Z")
Yep. Still happening. Going to see if it happens at work or just here at home and update there. ---
**Author:** ![balance](https://sea1.discourse-cdn.com/flex001/user_avatar/cog.discourse.group/balance/32/1888_2.png) [@balance](https://cog.discourse.group/u/balance)\ **Post date:** [December 26, 2018, 2:08pm UTC](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583/18 "2018-12-26T14:08:25Z")
I get a lot of load errors with the site when I’m at home, but it seems fine at work. ---
**Author:** ![Johtoguy](https://sea1.discourse-cdn.com/flex001/user_avatar/cog.discourse.group/johtoguy/32/917_2.png) [@Johtoguy](https://cog.discourse.group/u/Johtoguy)\ **Post date:** [December 26, 2018, 4:03pm UTC](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583/19 "2018-12-26T16:03:37Z")
Im seeing it too. ---
**Author:** ![Nabiki](https://sea1.discourse-cdn.com/flex001/user_avatar/cog.discourse.group/nabiki/32/935_2.png) [@Nabiki](https://cog.discourse.group/u/Nabiki)\ **Post date:** [December 26, 2018, 4:16pm UTC](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583/20 "2018-12-26T16:16:52Z")
It’s fine at work. I’ll clear my cache at home. [Next page](https://cog.discourse.group/t/outage-since-last-night-was-my-fault-derp/1583.md?page=2)