How can we ignore header line while loading data into Pig

Question

Suppose we have a dataset like below

"id","name","sal"

"1","jimmy","1000"

"2","hendrix","5000" 

How can we ignore header line while loading data into Pig?

Answer 1

You can use the following code:

A = load 'pigtest.txt' using PigStorage(',') as (id: chararray, name: chararray, sal: chararray);
ranked = rank A;
no_header = filter ranked by (rank_A > 1);
ordered = order no_header by rank_A;
new_A = foreach ordered generate id, name, sal;

Now, let's dump the new data,

dump new_A;

To know more, It's recommended to join Big Data Hadoop Course today.