Spark Hive connectivity

Question

Hello Team,
I want to load data from hive into spark data frame. I have specified the hive.metastore.uris
thrift://192.168.1.30:9083
but now during starting spark sheel I am getting below error.

ERROR:
at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1521)
... 91 more
Caused by: org.apache.hadoop.hive.metastore.api.MetaException: Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused (Connection refused)
at org.apache.thrift.transport.TSocket.open(TSocket.java:226)

Answer 1

The problem is probably with the command. It would've been better if you had mentioned the command that you are using. Anyways, here's a working code:

Use the following commands to connect to hive.

importorg.apache.spark.sql.hive.HiveContext
val hiveContext = new org.apache.spark.sql.hive.HiveContext(sc)
import hiveContext._


val hive_tables=hiveContext.sql("show tables")
val first = hiveContext.sql("select * from olympics limit 5")
first.show()