How do I connect my Spark based HDInsight cluster to my blob storage

Question

I have created a blob storage earlier and HDInsight cluster earlier. Now I have requirements to connect and access blob storage from the HDinsight cluster. I haven’t done it before and I am not getting any tutorial which could help  to do that.

I have just created a Spark based HDInsight cluster. I have selected a blob storage that I created before, while creating the cluster. However, I have no idea how to access that blob storage from within the VM created there. I have read many different tutorials, but couldn't get a proper answer.

Can I add and access blob storage just like HDFS?

Answer 1

Go through this blog:

https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-use-blob-storage#access-blobs

I went through this official HDInsight Hadoop blog where I found how to access blobs in it.  It provides commands for using PowerShell to access data stored in blobs.

To know more I would recommend you to browse through this Github link:

https://github.com/Blackmist/hdinsight-tools