Techcrunch says it’s a widespread outage.
…On Friday at 5:30 PM PT, we had a planned maintenance scheduled to upgrade the OS on some of our machines.
…In this case, a bug in the script caused the upgrade to run on a handful of machines serving production traffic.
…some master-slave pairs were impacted which resulted in the site going down.
…We were able to restore most functionality within 3 hours, but the large size of some of our databases slowed recovery, and it took until 4:40 PM PT today for core service to fully return.
According to a report today in Information Age:
“US-based cloud storage provider Nirvanix tells employees it has “gone to the wall”, gives customers until the end of the month to move their data elsewhere .”
The company was founded in 2007 after an online storage company called StreamLoad split into consumer and business units. Not longer after, the consumer arm – MediaMax – gave customers one month to relocate their data following a botched migration onto the Nirvanix platform.
GitHub was essentially down for about an hour today, starting at around 11 am Eastern (1500 UTC) due to a reported DDoS attack. From their status page:
15:05 UTC We’re currently experiencing a large DDoS attack. The site is experiencing major packet loss and is mostly unavailable. We’re working to further mitigate the attack.
Network Solutions is in trouble today. Rumor has it DNS issues are the root cause, but it’s unclear. What is clear is if your site is hosted by NetSol it is unreachable.
If you dig really hard you can get links to their blog which might offer more detail. But… it’s unreachable (duh).
I picture NetSol personnel happily posting critical updates to a blog only they can reach.
New Rule: If your servers/dns/routers/network is experiencing problems, use your Twitter and Facebook accounts to communicate with customers. Don’t want your dirty laundry messing up your marketing? Set up Twitter/FB Support accounts.
Reports are widespread that Network Solutions DNS server issues and website hosting issues are leaving many of their customers sites unreachable.
From the Apps Status Dashboard:
7/10/13 10:40 AM
The problem with Gmail should be resolved. We apologize for the inconvenience and thank you for your patience and continued support. Please rest assured that system reliability is a top priority at Google, and we are making continuous improvements to make our systems better.
The affected users were located in West Virginia, North Carolina, Nebraska & Georgia
Same message repeated for basically all services.
It’s a little vague and incomplete. Was it Comcast (other services were also down and they ALL came back at once here in Florida)? Or was it actually Google?
As of 10:39 am today (Eastern Time) Comcast has apparently fixed a problem and we can get to all sorts of sites we couldn’t for the last several hours.
Comcast the preferred villain of course (over Google, God forbid!)
How about you?
Many reporting Google down but using an online proxy to originate the web request elsewhere works fine.
This reporter is in Florida on Comcast. Might be a regional Comcast issue.