Most voted questions in Big Data Hadoop

0 votes
1 answer

Junit test for Map Reduce Hadoop

Hi. This is the code I used ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,419 views
0 votes
1 answer

Hadoop mapreduce java: NullPoint Exception

Try this: String cords = it.next().toString(); lattitude = Double.toString((inst.decode(cords))[0]); longitude ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
607 views
0 votes
1 answer

How to open MySql console in Ubuntu?

sudo service mysqld restart mysql -u <username> root ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,300 views
0 votes
1 answer

How to export file from sqoop to sql table?

For SQOOP export please try below command: bin/sqoop ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
848 views
0 votes
1 answer

How to use sqoop import?

Here is an example of import command. ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
624 views
0 votes
1 answer

Not able to insert in hive partition table

You have to add the partition before ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,962 views
0 votes
1 answer

Not able to insert data into hive table

Seems like a hive version problem.​ insert operation is ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,687 views
0 votes
1 answer

Using HBase jar files. Where to download and set classpath

There are many sites you can get ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,757 views
0 votes
1 answer

Getting some warning/error while loading java file using Hbase commands

In your code, you have set some ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
596 views
0 votes
1 answer

How to create external Hive table?

It's simple. You just have to add external ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
678 views
0 votes
1 answer

How to create a managed table in Hive?

You can use this command: create table employee(Name ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
5,139 views
0 votes
1 answer

What are the different relational operations in “Pig Latin” you worked with?

Different relational operators are: for each order by fil ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Frankie
• 9,830 points
628 views
0 votes
1 answer

Can you build “Spark” with any particular Hadoop version?

Yes, one can build “Spark” for a specific ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,119 views
0 votes
1 answer

Why does one remove or add nodes in a Hadoop cluster frequently?

One of the most attractive features of ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,006 views
0 votes
1 answer

What are active and passive “NameNodes” in Hadoop?

In HA (High Availability) architecture, we have ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,777 views
0 votes
1 answer

Managed Table vs External Table

External table is created for external use ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
12,551 views
0 votes
1 answer

Hadoop Hive Bucketing

Partition helps in increasing the efficiency when ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
502 views
0 votes
1 answer

Hadoop Hive partitioning

Partitioning: Hive has been one of the preferred ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,230 points
976 views
0 votes
1 answer

How do I join 2 tables in PIG using 2 fields?

Here, we have two tables: Tab1 having columns ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,997 views
0 votes
1 answer

Not able to list sqoop jobs

It seems like you are missing a ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,230 points
941 views
0 votes
1 answer

Hadoop Hive query to filter employees

select * from tablename where DOJ> '2018-01-01' ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,230 points
3,358 views
0 votes
1 answer

How to connect impala to cloud lab?

impala-shell -i <domain_name>: <port > READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,230 points
907 views
0 votes
1 answer

Hadoop PIG extraction shows no output

To see whether the extraction was done ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,230 points
467 views
0 votes
1 answer

What is the difference between Map-side join and Reduce-side join?

Join is a clause that combines the records ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,230 points
5,059 views
0 votes
1 answer

Which side join is taken by default by hive? Map-side or Reduce-side?

The syntax for Map-side join and Reduce-side ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,230 points
966 views
0 votes
1 answer

Can not list/access files of local system from hadoop

You can not directory use files from ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,230 points
593 views
0 votes
1 answer

How to unzip a zipped file stored in Hadoop hdfs?

hadoop fs -text /hdfs-path-to-zipped-file.gz | hadoop fs ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 69,230 points
11,933 views
0 votes
1 answer

How to run Java file in Hadoop?

Try this: hadoop fs -cat hdfs:///user/hadoop/values.txt READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 69,230 points
3,433 views
0 votes
1 answer

How to read Spark elements having multiple lines each?

Try this: val new_records = sc.newAPIHadoopRDD(hadoopConf,classOf[ ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,198 views
0 votes
1 answer

Hadoop: java.lang.IllegalArgumentException: Wrong FS: expected: file:///

Try this: Configuration configuration = new Configuration(); FileSystem fs ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 69,230 points
7,369 views
0 votes
1 answer

How do I install cloudera Hadoop without internet connection?

You can do that by selecting the ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Neha
• 6,300 points
1,406 views
0 votes
1 answer

What is the difference between Hadoop API and Streaming?

Usually we have Map/Reduce pair written in ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Neha
• 6,300 points
712 views
0 votes
0 answers

Number of tasks submitted and executed within the day in hadoop

Tasks Write a software application, service, daemon or ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Irfan
• 120 points
552 views
0 votes
1 answer

Hadoop Hive: ClassNotFoundException: org.apache.hive.jdbc.HiveDriver

You have to use the right dependency <dependency> ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
• 69,230 points
5,539 views
0 votes
1 answer

How to copy files in hdfs with wildcards?

You can use the hdfs command: hdfs fs ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,280 views
0 votes
1 answer

How to read more than one files in Apache Spark?

Try this: val text = sc.wholeTextFiles("student/*") text.collect() ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,408 views
0 votes
1 answer

Not able to start jobtracker in hadoop

There is no jobtracker in hadoop 2.2.0 YARN framework. ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,160 views
0 votes
1 answer

What is local file System?

LocalFS means it may be your LinuxFS ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,150 views
0 votes
1 answer

I want to install snappy on Hadoop 1.2.1. How do I do that?

As per Cloudera, if you install hadoop ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Frankie
• 9,830 points
835 views
0 votes
1 answer

Do worker hosts need access to the Cloudera public repositories for an install with Cloudera Manager?

You can perform an installation or upgrade ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Frankie
• 9,830 points
549 views
0 votes
1 answer

Does Cloudera Manager Support an API?

Yes. A comprehensive set of APIs for ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Frankie
• 9,830 points
388 views
0 votes
1 answer

What is distributed Cache in MapReduce Framework ?

Distributed Cache is an important feature provided ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,393 views
0 votes
1 answer

Which is helpful SVN or Git for Hadoop Development?

The official location for Hadoop is the ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Frankie
• 9,830 points
941 views
0 votes
1 answer

How to create new directory in hdfs using java code?

Try this: { Configuration config ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,230 points
3,504 views
0 votes
1 answer

Not able to install hadoop using maven

First make sure you have ant installed ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,269 views
0 votes
1 answer

How to use jar file without putting it in hdfs?

If by "using", you mean distributing it, ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,230 points
567 views
0 votes
1 answer

How to concatenate hdfs files and store in output file?

You can use a combination of cat and put command. Something ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,230 points
3,581 views
0 votes
1 answer

Start-dfs.sh daemons not starting. localhost: mkdir: cannot create directory `/user': Permission denied

Make the following changes to the hadoop-env.sh ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,787 views
0 votes
1 answer

Hadoop sqoop import not working. Error: ERROR manager.SqlManager: Error reading from database

In the command, try mentioning the driver ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,230 points
1,899 views
0 votes
1 answer

Not able to create Hive table from HDFS file

You dont have to specify the file name ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
• 69,230 points
2,307 views