Outages

Amazon EC2-Related Issues Took Down Reddit, Imgur and Other Sites [Updated]

Everybody panic!
screen shot 2012 10 22 at 1 57 19 pm Amazon EC2 Related Issues Took Down Reddit, Imgur and Other Sites [Updated]

(Photo: Reddit)

Update 4:35 p.m.: Reddit appears to be slowly coming back up; Betabeat can access the front page but still gets a “Reddit is Down” alert when we click over to specific subreddits.

Update 4:15 p.m.: Sites using Amazon Web Service’s EC2 are experiencing major network issues. After an issue with Amazon’s Elastic Compute Cloud cropped up around 2 p.m. this afternoon, other services such as Amazon’s Relational Database Service and ElastiCache began reporting problems. Amazon claims it is working on a fix, but major sites such as Reddit, Foursquare and Imgur are still being affected by these issues.

Office drones and journalists hungering for a web-friendly scoop are out of luck right now: Reddit, the massive link-aggregator site responsible for the vast majority of content on sites like BuzzFeed, is down. @RedditStatus tweeted the following: “The site is down right now. It appears to be a network-related issue. We are investigating.” It was inaccessible when Betabeat tried to log on, serving us only that coyly smiling alien and the note “Reddit is down.”

Upon further investigation, it appears that Amazon’s cloud hosting service, EC2, is experiencing issues. A slew of startups began tweeting that they were experiencing network issues, including GitHub, Heroku, GameFAQsImgurTurntable, CourseraAirbnb, FlipboardBranch, Foursquare, NakedApartments and MongoLab. Minecraft is also down, so people on the Internet officially have no idea what to do with themselves.

Maybe we should all like, go outside or something?

Amazon Web Service’s health dashboard indicates that the Amazon Elastic Compute Cloud has “degraded DBS performance in a single Availability Zone:”

Amazon Elastic Compute Cloud (N. Virginia):
11:11 AM PDT We can confirm degraded performance for a small number of EBS volumes in a single Availability Zone in the US-EAST-1 Region. Instances using affected EBS volumes will also experience degraded performance.

11:26 AM PDT We are currently experiencing degraded performance for EBS volumes in a single Availability Zone in the US-EAST-1 Region. New launches for EBS backed instances are failing and instances using affected EBS volumes will experience degraded performance.

Amazon Relational Database Service (N. Virginia):

Small number of RDS database instances are experiencing connectivity issues in a single Availability Zone less
11:03 AM PDT We are currently experiencing connectivity issues and degraded performance for a small number of RDS DB Instances in a single Availability Zone in the US-EAST-1 Region.
11:45 AM PDT A number of Amazon RDS DB Instances in a single Availability Zone in the US-EAST-1 Region are experiencing connectivity issues or degraded performance. New instance create requests in the affected Availability Zone are experiencing elevated latencies. We are investigating the root cause.

Amazon ElastiCache (N. Virginia):

11:39 AM PDT We are currently experiencing connectivity issues for ElastiCache Cache Nodes in a single Availability Zone in the US-EAST-1 Region.

AWS Elastic Beanstalk (N. Virginia):

11:06 AM PDT We are currently experiencing elevated API failures and delays launching, updating and deleting Elastic Beanstalk environments in the US-East-1 Region.
11:45 AM PDT We are continuing to see delays launching, updating and deleting Elastic Beanstalk environments in the US-East-1 Region.

As one Twitter user put it, “Learning that ‘degraded performance for a small number of EBS volumes’ means, in AWS speak, ‘sorry, the Internet is broken.'”

TechCrunch notes that the AWS outage may be affecting Heroku, which in turn is affecting other sites: “All services hosted on Heroku’s virtual private servers are still down at the time of writing. GitHub, imgur, Pocket, HipChat, Coursera and others are affected.”

We’ve reached out to Amazon and will update when we know more.

Amazon’s dashboard says, “We are working on recovering the impacted EBS volumes in a single Availability Zone in the US-EAST-1 Region.”

Is your site experiencing an outage? Let us know in the comments.

Update:

Amazon dashboard says:

“We continue to work to resolve the issue affecting EBS volumes in a single availability zone in the US-EAST-1 region. The AWS Management Console for EC2 indicates which availability zone is impaired.

EC2 instances and EBS volumes outside of this availability zone are operating normally. Customers can launch replacement instances in the unaffected availability zones but may experience elevated launch latencies or receive ResourceLimitExceeded errors on their API calls, which are being issued to manage load on the system during recovery. Customers receiving this error can retry failed requests.”

This is a developing story. You can refresh for updates.

Follow Jessica Roy on Twitter or via RSS. jroy@observer.com

Comments

  1. hosting says:

    You already know therefore considerably on the subject of this topic, produced me personally imagine it from so many varied angles. Its like women and men don’t seem to be fascinated except it is one thing to accomplish with Lady gaga! Your own stuffs excellent. At all times deal with it up!