Question

How we can run spark SQL over hive tables in our cluster

Answer 1

Open spark-shell.

scala> import org.apache.spark.sql.hive._
scala> val hc = new HiveContext(sc)
hc.sql("your query").show()

Comments

Open Spark-shell

scala>val sqlContext = new org.apache.spark.sql.hive.HiveContext(sc)

scala>sqlContext.sql("CREATE TABLE IF NOT EXISTS employee(id INT, name STRING, age INT) ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' LINES TERMINATED BY '\n'")

scala>sqlContext.sql("LOAD DATA LOCAL INPATH 'employee.txt' INTO TABLE employee")

scala>val result = sqlContext.sql("FROM employee SELECT id, name, age")

scala>result.show()