Home > Technology > S3FS with Eucalyptus Walrus

S3FS with Eucalyptus Walrus

Cloud Computung !!! A hot cake in today’s technology trend. As everyone is talking about it, I thought, let me give a try too. But the apathy to buy an account with Amazon led me to go for free, open source alternative as Amazon clones. I was more interested in cloud storage, so looked for an Amazon S3 clone. And ya, its Eucalyptus  Walrus. Eucalyptus, or more precisely Open Eucalyptus is free open source solution for forming your own provate cloud. There is a community cloud hosted in University of California at Santa Barbara, and is a Eucalyptus based cloud. Even Ubuntu One, the free cloud with Ubuntu 10.04 (Lucid Lynx) is also hosted on Eucalyptus. There is an enterprise version where you pay for the support and is being used by many organizations including NASA for having its own origanizational provate cloud.
The best part of Eucalyptus is that its fully Amazon AWS compatible. So, whatever applications you developed for Amazon is supposed to work with Eucalyptus too. Its supports both SOAP and REST APIs.

Some of the common apps of Amazon S3 like S3CMD, S3FS and S3Curl also works with Eucalyptus. I hosted my private cloud is a DELL 64bit machine with a CentOS 5.4 and Eucalyptus 1.6.2. Installation and configuration was quite easy, and in no time I could have my buckets in the cloud with my files. All commands of S3CMD worked perfectly well. But when I tried to mount my Walrus buckets in my local filesystem of my desktop using FUSE and S3FS, I encountered some problems. While I was able to mount the buckets, cd into the mount points and even touch, cp and create/save files with vi in it, the most basic commands like ls, ll, du etc were not working. Finally, hacked into the code of S3FS and with few changes in it, I could make it work. Thanks to Randy Rizun, the developer of S3FS for writing such a fantastic software and relasing the code in open.

I am attaching my unofficial changes here, with which I could made S3FS r188 work with Eucalyptus 1.6.2. I haven’t tested it extensively, so don’t really know if the changes I made breaks s3fs anywhere else. Just an advice, don’t use my changes in production.

Change the extension of the attached file from .odt to .patch and patch the source of S3FS r188 by doing patch -p1 -i s3fs_r188.patch and then do a make.

S3FS_r188_Eucalyptus_Walrus_patch

Some Links:

http://open.eucalyptus.com/
http://fuse.sourceforge.net/
http://code.google.com/p/s3fs/wiki/FuseOverAmazon
http://sourceforge.net/projects/s3tools/

Advertisements
Categories: Technology
  1. mymq0206
    May 30, 2010 at 7:21 PM

    did you try to change the ACL of bucket or files?

    • May 30, 2010 at 7:30 PM

      Ya I tried… but I believe it was more a tree traversal problem as the xml response from Walrus was correct.

  2. John
    August 4, 2010 at 9:45 AM

    Hi, googling about s3fs I found this interesting experience, I’m doing my undergraduation project with cloud computing making it work with IPTV in Colombia but I haven’t found how I install the s3fs in my eucalyptus (installed the UEC 10.04).
    I’ve created a bucket to use it with the s3fs, but I’m stuck there, if you can help me I’d so appreciate it, and of course, will give you credits on my final work xD.

    tyvm anyway,
    John.

  3. August 4, 2010 at 10:36 AM

    @John:

    I have dropped you a mail. Let me know the problems you encountered in some detail and a little info about your setup. I’ll be glad to help you.

  1. No trackbacks yet.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: