Is data sent to some other location to be processed in pig?

0 votes
We load the data from HDFS, process the data in Pig and store the result back to HDFS. The basic principle of Hadoop is - bringing processing to data rather than taking data to process. So is this high-level implementation is just to make us understand - not the actual way how it works?
Jul 10 in Big Data Hadoop by Rishi
33 views

1 answer to this question.

0 votes
With pig, we are not taking data anywhere. The data that we have is in hdfs, the processing that is taking place is happening across the hadoop cluster itself with the help of map reduce. Pig is not a processing place. It is just doing the work of semantics that is the pig compiler's duty is to transform a pig latin program into a series of Java Map Reduce task. Pig helps by just allowing the user to focus on semantics.
answered Jul 10 by Adi

Related Questions In Big Data Hadoop

0 votes
1 answer

Syntax to mention that the data is enclosed in double quotes in pig

So, we will execute the below command, new_A_2 ...READ MORE

answered Jul 10 in Big Data Hadoop by Esha
40 views
0 votes
1 answer

What is Modeling data in Hadoop and how to do it?

I suggest spending some time with Apache ...READ MORE

answered Sep 19, 2018 in Big Data Hadoop by Frankie
• 9,810 points
130 views
+1 vote
1 answer

What is the process to perform an incremental data load in Sqoop?

The process to perform incremental data load ...READ MORE

answered Dec 17, 2018 in Big Data Hadoop by Frankie
• 9,810 points
554 views
–1 vote
1 answer

Pig code in Eclipse shows error :LongWritable cannot be resolved to a type

To rectify this errors, you need to ...READ MORE

answered Jan 2 in Big Data Hadoop by Omkar
• 68,480 points
118 views
0 votes
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,800 points
3,583 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,800 points
457 views
+1 vote
11 answers

hadoop fs -put command?

put syntax: put <localSrc> <dest> copy syntax: copyFr ...READ MORE

answered Dec 7, 2018 in Big Data Hadoop by Aditya
18,461 views
0 votes
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,280 points
1,335 views
0 votes
11 answers
+2 votes
5 answers

How to transpose/pivot data in hive?

Below is also a way for Pivot SELECT ...READ MORE

answered Oct 12, 2018 in Big Data Hadoop by Rahul
6,391 views