Hive partitioning: Dynamic and static

0 votes

When to use dynamic and when to use static partitioning?

Jan 31, 2019 in Big Data Hadoop by Aishwarya
899 views

1 answer to this question.

0 votes

Partitions are created depending on the end table or requirements for data and in what form data is produced at source.

Partitions are created when data is inserted into table and how it is partitioned depends on how you load it. Static partitions are preferred when loading big data in Hive table and it saves your time in loading data compared to dynamic partition. 

In static partitioning, we need to specify the partition column value in each and every LOAD statement.

Dynamic partition is useful when you load a huge file into a Table X and then you run an insert query into a Table Y. In case of dynamic partition, every row of the data is read and data is partitioned through an MapReduce job.

answered Jan 31, 2019 by Omkar
• 68,880 points

Related Questions In Big Data Hadoop

0 votes
2 answers

How are Partitioning and Bucketing different from each other in Apache Hive?

Let us consider a student database table ...READ MORE

answered Apr 15, 2019 in Big Data Hadoop by nitinrawat895
• 10,840 points
647 views
0 votes
1 answer

Hive: Dynamic partition without using static partition

Hive asks for a static partition as ...READ MORE

answered May 21, 2019 in Big Data Hadoop by Suman
115 views
0 votes
1 answer
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,840 points
3,939 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,840 points
544 views
+1 vote
11 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyFr ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Aditya
21,024 views
0 votes
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,290 points
1,486 views
0 votes
1 answer

How to save Spark dataframe as dynamic partitioned table in Hive?

Hey, you can try something like this: df.write.partitionBy('year', ...READ MORE

answered Nov 6, 2018 in Big Data Hadoop by Omkar
• 68,880 points
2,583 views
0 votes
1 answer

Hadoop Hive partitioning

Partitioning: Hive has been one of the preferred ...READ MORE

answered Dec 13, 2018 in Big Data Hadoop by Omkar
• 68,880 points
200 views