{"id":37,"date":"2017-11-07T13:31:11","date_gmt":"2017-11-07T13:31:11","guid":{"rendered":"https:\/\/nillsf.wordpress.com\/?p=37"},"modified":"2017-11-07T13:31:11","modified_gmt":"2017-11-07T13:31:11","slug":"fuse-adapter-for-blob-storage","status":"publish","type":"post","link":"https:\/\/blog.nillsf.com\/index.php\/2017\/11\/07\/fuse-adapter-for-blob-storage\/","title":{"rendered":"FUSE adapter for blob storage"},"content":{"rendered":"

Earlier this week, Microsoft launched a new Linux driver into public preview<\/a>: the FUSE adapter for blob storage. Obviously this is an open source driver (hosted on github). The driver allows you to mount blob storage into your VMs and read\/write from blob directly.
\nWhat does this mean? It is a very easy way to interact with blob storage. The downside of blob storage is that is an object storage platform, which doesn’t work like your regular file system or network drive. With the FUSE driver, you can use your Linux command line to interact with the blob storage platform.
\nOne use case this can unlock, is an easy way to load your data into a storage account to use with a HDinsight cluster. HDinsight can natively interact with blob already via another open source driver called WASB<\/a>.\u00a0With the FUSE driver, you can get data into your storage account, so Hdinsight can start number crunching on your data.
\nLet’s dive into the FUSE driver and how you get it up and running:<\/p>\n

Setting it up<\/h2>\n

To do this small demo, I created a small new Ubuntu VM.
\n\"2017-11-07
\nAfter logging in (SSH), we need to update apt-get and install the FUSE dependencies:<\/p>\n

sudo apt-get update && sudo apt-get install pkg-config libfuse-dev cmake libcurl4-gnutls-dev libgnutls28-dev git -y<\/p><\/blockquote>\n

Next step is to clone the source code from github and build the driver.<\/p>\n

git clone https:\/\/github.com\/Azure\/azure-storage-fuse\/<\/a>
\ncd azure-storage-fuse
\n.\/build.sh<\/p><\/blockquote>\n

\"2017-11-07
\nI used the default diagnostics storage account (lazy me) for my demo here and created a specific container for this demo.
\n\"2017-11-07
\nEnter in the right credentials info the connection.cfg file, so FUSE can access your storage account.<\/p>\n

accountName fusetestdiag453
\naccountKey <account key goes here>
\ncontainerName fusecontainer<\/p><\/blockquote>\n

Create the mount point, create and give the user access to the temp directory (I had issues with this up front) and mount the blob container.<\/p>\n

Sudo mkdir -p ~\/blob
\nmkdir -p \/mnt\/blobfusetmp
\nsudo chown nilfranadmin \/mnt\/blobfusetmp\/<\/p><\/blockquote>\n

It should run now, but it didn’t for me…\u00a0This was linked to access rights on the blobfusetmp directory, where I needed to give my user ownership rights on the root directory in the blobfusetmp directory. And following that, I was able to start the mount.<\/p>\n

Cd \/mnt\/blobfusetmp
\nSudo chown nilfranadmin blob\/
\ncd ~\/azure-storage-fuse
\n.\/mount.sh ~\/blob<\/p><\/blockquote>\n

And here we are: blob is mounted into your VM!<\/p>\n

Testing it out<\/h2>\n

Let’s now test this out, by e.g. downloading an Ubuntu ISO (simple WGET). What do we see? Well:<\/p>\n

    \n
  1. Download speed varies between 10MB\/s and 60MB\/s, as expected with a file download.<\/li>\n
  2. After the download, it took about a minute and a half for the WGET ‘task’ to fully complete, and for the ISO to show up in my blob storage account.<\/li>\n<\/ol>\n

    Below, you can see some screenshots of the download process itself, with the blob view from the azure portal next to it.
    \n\"2017-11-07
    \n\"2017-11-07\"2017-11-07<\/p>\n

    Summary<\/h2>\n

    The FUSE adapter for blob storage is a cool nifty driver that allows you to mount blob storage into your Linux file system. It\u2019s easy to install (only took me 30 minutes to try it out). The driver itself is quiet performant on my first look, so I recommend you to try it out. Just be careful: it is still in preview and still has its limitations.<\/p>\n","protected":false},"excerpt":{"rendered":"

    Earlier this week, Microsoft launched a new Linux driver into public preview: the FUSE adapter for blob storage. Obviously this is an open source driver (hosted on github). The driver allows you to mount blob storage into your VMs and read\/write from blob directly. What does this mean? It is a very easy way to […]<\/p>\n","protected":false},"author":1,"featured_media":67,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-37","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"jetpack_featured_media_url":"https:\/\/nillsfblog.blob.core.windows.net\/media\/2017\/11\/2017-11-07-13_38_40-blob-service-microsoft-azure.png","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/blog.nillsf.com\/index.php\/wp-json\/wp\/v2\/posts\/37","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.nillsf.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.nillsf.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.nillsf.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.nillsf.com\/index.php\/wp-json\/wp\/v2\/comments?post=37"}],"version-history":[{"count":0,"href":"https:\/\/blog.nillsf.com\/index.php\/wp-json\/wp\/v2\/posts\/37\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.nillsf.com\/index.php\/wp-json\/wp\/v2\/media\/67"}],"wp:attachment":[{"href":"https:\/\/blog.nillsf.com\/index.php\/wp-json\/wp\/v2\/media?parent=37"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.nillsf.com\/index.php\/wp-json\/wp\/v2\/categories?post=37"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.nillsf.com\/index.php\/wp-json\/wp\/v2\/tags?post=37"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}