Latest questions in Big Data Hadoop

+1 vote
1 answer

Unable to load data in Hbase table from dataset

Try these steps (make necessary changes): First upload ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,903 views
+1 vote
1 answer

How to print data without brackets using PIG Dump?

Please refer to the below commands: student = ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,062 views
0 votes
1 answer

How to change file format using Sqoop?

For change in the file format, you ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,762 views
0 votes
3 answers

How to change the delimiter in Sqoop?

--fields-terminated-by <char> READ MORE

Jun 25, 2019 in Big Data Hadoop by anonymous
10,079 views
0 votes
1 answer

How to create a Hive table from sequence file stored in HDFS?

There are two SerDe for SequenceFile as ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
• 69,230 points
4,579 views
0 votes
1 answer

How to create a Hive table with a sequence file?

In Hive we can create a sequence ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,230 points
3,344 views
0 votes
1 answer

Command to partition table in Hive

Yes, You need to mention the below ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,230 points
752 views
+1 vote
1 answer

What is the process to perform an incremental data load in Sqoop?

The process to perform incremental data load ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Frankie
• 9,830 points
5,099 views
0 votes
1 answer

Sqoop import gives error: org.apache.hadoop.security.AccessControlException: Permission denied

Seems like you are not passing the ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,816 views
0 votes
1 answer

What are the different types of tombstone markers in HBase for deletion?

1)Family Delete Marker- This markers marks all ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,238 views
+1 vote
1 answer

Hadoop Map Reduce: java.lang.reflect.InvocationTargetException

I executed the same code and it ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,502 views
+1 vote
1 answer

How to switch off Cloudera Manager Service?

First list the running services: chkconfig --list And then ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,230 points
384 views
0 votes
1 answer

How to check Cloudera Manager Service status?

There surely is a command to check ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,825 views
0 votes
1 answer

Junit test for Map Reduce Hadoop

Hi. This is the code I used ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,422 views
0 votes
1 answer

Hadoop mapreduce java: NullPoint Exception

Try this: String cords = it.next().toString(); lattitude = Double.toString((inst.decode(cords))[0]); longitude ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
614 views
0 votes
1 answer

How to open MySql console in Ubuntu?

sudo service mysqld restart mysql -u <username> root ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,303 views
0 votes
1 answer

How to export file from sqoop to sql table?

For SQOOP export please try below command: bin/sqoop ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
849 views
0 votes
1 answer

How to use sqoop import?

Here is an example of import command. ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
624 views
0 votes
1 answer

Not able to insert in hive partition table

You have to add the partition before ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,972 views
0 votes
1 answer

Not able to insert data into hive table

Seems like a hive version problem.​ insert operation is ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,693 views
0 votes
1 answer

Using HBase jar files. Where to download and set classpath

There are many sites you can get ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,765 views
0 votes
1 answer

Getting some warning/error while loading java file using Hbase commands

In your code, you have set some ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
601 views
0 votes
1 answer

How to create external Hive table?

It's simple. You just have to add external ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
679 views
0 votes
1 answer

How to create a managed table in Hive?

You can use this command: create table employee(Name ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
5,145 views
0 votes
1 answer

What are the different relational operations in “Pig Latin” you worked with?

Different relational operators are: for each order by fil ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Frankie
• 9,830 points
631 views
0 votes
1 answer

Can you build “Spark” with any particular Hadoop version?

Yes, one can build “Spark” for a specific ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,122 views
0 votes
1 answer

Why does one remove or add nodes in a Hadoop cluster frequently?

One of the most attractive features of ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,010 views
0 votes
1 answer

What are active and passive “NameNodes” in Hadoop?

In HA (High Availability) architecture, we have ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,782 views
0 votes
1 answer

Managed Table vs External Table

External table is created for external use ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
12,566 views
0 votes
1 answer

Hadoop Hive Bucketing

Partition helps in increasing the efficiency when ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
509 views
0 votes
1 answer

Hadoop Hive partitioning

Partitioning: Hive has been one of the preferred ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
979 views
0 votes
1 answer

How do I join 2 tables in PIG using 2 fields?

Here, we have two tables: Tab1 having columns ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,002 views
0 votes
1 answer

Not able to list sqoop jobs

It seems like you are missing a ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,230 points
945 views
0 votes
1 answer

Hadoop Hive query to filter employees

select * from tablename where DOJ> '2018-01-01' ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,230 points
3,368 views
0 votes
1 answer

How to connect impala to cloud lab?

impala-shell -i <domain_name>: <port > READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,230 points
910 views
0 votes
1 answer

Hadoop PIG extraction shows no output

To see whether the extraction was done ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,230 points
473 views
0 votes
1 answer

What is the difference between Map-side join and Reduce-side join?

Join is a clause that combines the records ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,230 points
5,063 views
0 votes
1 answer

Which side join is taken by default by hive? Map-side or Reduce-side?

The syntax for Map-side join and Reduce-side ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,230 points
968 views
0 votes
1 answer

Can not list/access files of local system from hadoop

You can not directory use files from ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,230 points
600 views
0 votes
1 answer

How to unzip a zipped file stored in Hadoop hdfs?

hadoop fs -text /hdfs-path-to-zipped-file.gz | hadoop fs ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 69,230 points
11,947 views
0 votes
1 answer

How to run Java file in Hadoop?

Try this: hadoop fs -cat hdfs:///user/hadoop/values.txt READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 69,230 points
3,441 views
0 votes
1 answer

How to read Spark elements having multiple lines each?

Try this: val new_records = sc.newAPIHadoopRDD(hadoopConf,classOf[ ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,202 views
0 votes
1 answer

Hadoop: java.lang.IllegalArgumentException: Wrong FS: expected: file:///

Try this: Configuration configuration = new Configuration(); FileSystem fs ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 69,230 points
7,377 views
+1 vote
1 answer

Not able to start datanode in Hadoop

Follow these steps: Stop namenode Delete the datanode directory ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,510 views
0 votes
1 answer

How do I install cloudera Hadoop without internet connection?

You can do that by selecting the ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Neha
• 6,300 points
1,409 views
0 votes
1 answer

What is the difference between Hadoop API and Streaming?

Usually we have Map/Reduce pair written in ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Neha
• 6,300 points
722 views
0 votes
0 answers

Number of tasks submitted and executed within the day in hadoop

Tasks Write a software application, service, daemon or ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Irfan
• 120 points
554 views
0 votes
1 answer

Hadoop Hive: ClassNotFoundException: org.apache.hive.jdbc.HiveDriver

You have to use the right dependency <dependency> ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
• 69,230 points
5,551 views
0 votes
1 answer

How to copy files in hdfs with wildcards?

You can use the hdfs command: hdfs fs ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,288 views
0 votes
1 answer

How to read more than one files in Apache Spark?

Try this: val text = sc.wholeTextFiles("student/*") text.collect() ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,415 views