Is data sent to some other location to be processed in pig

0 votes
We load the data from HDFS, process the data in Pig and store the result back to HDFS. The basic principle of Hadoop is - bringing processing to data rather than taking data to process. So is this high-level implementation is just to make us understand - not the actual way how it works?
Jul 10, 2019 in Big Data Hadoop by Rishi
202 views

1 answer to this question.

0 votes
With pig, we are not taking data anywhere. The data that we have is in hdfs, the processing that is taking place is happening across the hadoop cluster itself with the help of map reduce. Pig is not a processing place. It is just doing the work of semantics that is the pig compiler's duty is to transform a pig latin program into a series of Java Map Reduce task. Pig helps by just allowing the user to focus on semantics.
answered Jul 10, 2019 by Adi

Related Questions In Big Data Hadoop

0 votes
1 answer

Syntax to mention that the data is enclosed in double quotes in pig

So, we will execute the below command, new_A_2 ...READ MORE

answered Jul 10, 2019 in Big Data Hadoop by Esha
644 views
0 votes
1 answer

What is Modeling data in Hadoop and how to do it?

I suggest spending some time with Apache ...READ MORE

answered Sep 19, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,171 views
+1 vote
1 answer

What is the process to perform an incremental data load in Sqoop?

The process to perform incremental data load ...READ MORE

answered Dec 17, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,870 views
–1 vote
1 answer

Pig code in Eclipse shows error :LongWritable cannot be resolved to a type

To rectify this errors, you need to ...READ MORE

answered Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,190 points
923 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
9,099 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
1,642 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
83,039 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
3,481 views
+1 vote
2 answers

How to find previous records from a data set in Pig??

Hi, You can use ToDate() and SubtractDuration() function ...READ MORE

answered Jan 23, 2020 in Big Data Hadoop by MD
• 95,360 points
439 views
0 votes
11 answers
webinar REGISTER FOR FREE WEBINAR X
Send OTP
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP