aws-s3 woes

Andrew — Fri, 08 Jun 2007 17:30:00 -0400

At OML we use Amazon’s S3 for profile pics storage, we switched from local disk to S3 for scalability reasons when we need to move to multiple app servers or Amazon EC2. To implement S3 with attachment_fu was fairly straight-forward. However, we ran into a lot of problems with the aws-s3 gem. Basically the S3 backend, which uses aws-s3, failed with a broken pipe.

I did a bit of googling on this and found out the author of aws-s3 attempted to fix this in the latest subversion snapshot (# attempts changed to 10 by yours truly):

rescue Errno::EPIPE, Timeout::Error, Errno::EPIPE, Errno::EINVAL
    @http = create_connection
    attempts == 10 ? raise : (attempts += 1; retry)
end

So I checked out the latest SVN snapshot as a plugin, but it didn’t quite fix it, from time to time I still got the same error. So I ended up retrying it a couple more time in my own rescue block, if it still fails, then catch the exception and fail gracefully.

It seems to work for me, feel free to post comments if you are still having problems with profile pics… It would be great if you would also email the pics you tried to upload to feedback@onmylist.com

Thanks! Now go list your pants off!

"aws-s3 woes" by Jerusalem Real Estate

Mon, 07 Apr 2008 03:24:15 -0400

It also kept crashing for me. But it seems that the latest version fixed that issue, so right now it's working like magic.

"aws-s3 woes" by celpjefscycle

Fri, 11 Jan 2008 18:14:13 -0500

Thanks for information. many interesting things Celpjefscylc

"aws-s3 woes" by papyromancer

Tue, 04 Dec 2007 13:47:15 -0500

Great tip!

OnMyList Blog: aws-s3 woes

aws-s3 woes

"aws-s3 woes" by Jerusalem Real Estate

"aws-s3 woes" by celpjefscycle

"aws-s3 woes" by papyromancer