Amazon S3 FUSE
Isn’t it great accessing your S3 storage using native file system tools in Linux? Using FUSE (Filesystem in Userspace) based solution it should be possible to mount S3 bucket like any other local resource.
After a small research I’ve found s3fs – FUSE-based file system backed by Amazon S3. Looks that it’s only one opensource working fuse solution for S3 to the date. Unfortunately latest version of s3fs (atm it’s r177) doesn’t work very well, in my case directory listing was not working at all. It’s worth to read FAQ section on project site to be aware about limitations it has.
Though there are commercial version of s3fs called SubCloud. I’ve tried evaluation version and it worked good enough especially with caching enabled. But it’s price, it is $360 worth
Sounds like we had similar similar challenges and I too ended up stumbling across SubCloud. For what I’m using it for, the price seemed fair and it works.
Hi Alexandr- I’m the author of s3fs; just out of curiosity, in what way did the directory listings not work? what were the errors? anything in /var/log/messages?
Hi Randy!
I’ve mounted my bucket on s3fsmount/, after executing “ls -l s3fsmount/” i could not get back to my shell cause “ls” were unable to finish it’s job, nothing were printed on screen, nothing in /var/log/messages related to s3fs, CTRL+C also was not working. In /var/log/messages there were just “s3fs: init $Rev: 177 $” and “s3fs: destroy” after killing s3fs process from another terminal session.
ah, I bet it was a EU bucket? s3fs uses the US style bucket url scheme, e.g., http://s3.amazonaws.com/mybucket/myobject
Yep, it was EU bucket.