Hive partitioning Dynamic and static

0 votes

When to use dynamic and when to use static partitioning?

Feb 1, 2019 in Big Data Hadoop by Aishwarya
5,919 views

1 answer to this question.

0 votes

Partitions are created depending on the end table or requirements for data and in what form data is produced at source.

Partitions are created when data is inserted into table and how it is partitioned depends on how you load it. Static partitions are preferred when loading big data in Hive table and it saves your time in loading data compared to dynamic partition. 

In static partitioning, we need to specify the partition column value in each and every LOAD statement.

Dynamic partition is useful when you load a huge file into a Table X and then you run an insert query into a Table Y. In case of dynamic partition, every row of the data is read and data is partitioned through an MapReduce job.

answered Feb 1, 2019 by Omkar
• 69,230 points

Related Questions In Big Data Hadoop

0 votes
2 answers

How are Partitioning and Bucketing different from each other in Apache Hive?

Let us consider a student database table ...READ MORE

answered Apr 15, 2019 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,893 views
0 votes
1 answer

Hive: Dynamic partition without using static partition

Hive asks for a static partition as ...READ MORE

answered May 21, 2019 in Big Data Hadoop by Suman
1,101 views
0 votes
0 answers

What is the difference between partitioning and bucketing a table in Hive ?

Hi Team, I am new to Hive. I ...READ MORE

Dec 20, 2020 in Big Data Hadoop by akhtar
• 38,260 points
1,448 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
10,916 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
2,447 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
108,257 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
4,539 views
0 votes
1 answer

How to save Spark dataframe as dynamic partitioned table in Hive?

Hey, you can try something like this: df.write.partitionBy('year', ...READ MORE

answered Nov 6, 2018 in Big Data Hadoop by Omkar
• 69,230 points
8,421 views
0 votes
1 answer

Hadoop Hive partitioning

Partitioning: Hive has been one of the preferred ...READ MORE

answered Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,094 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP