Load data from HDFS to hive

Question

I have a file available in HDFS with below columns. Need to know how to load this file data into hive table, also the metastore file should be in parquet with snappy compression. 

Can you please help?

Answer 1

You can't directly create a parquet table. You will have to do it with Hive. Get in Hive console and load data. Refer the below example:

load data inpath '/user/edureka_212418/hive_emp/emp_details.txt'  into table emp_hive;

Next, set Hive properties as follows:

SET hive.exec.compress.output=true;
SET mapred.output.compression.codec=org.apache.hadoop.io.compress.SnappyCodec;
SET mapred.output.compression.type=BLOCK;

Now you create Parquet table:

CREATE TABLE tablename STORED AS PARQUET AS SELECT * FROM emp_hive;

To know more, It's recommended to join Big Data Online Course today.