Most voted questions in Big Data Hadoop

0 votes
1 answer

Can't access hadoop job logs

The error which you are getting can ...READ MORE

Jan 28, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 706 views
0 votes
1 answer

How to list files in hdfs that contains a specific string?

Yes, you can do this. You can ...READ MORE

Jan 27, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 10,986 views
0 votes
1 answer

Update hdfs data before stroring in MySql

Yes, you can update the data before ...READ MORE

Jan 27, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 578 views
0 votes
1 answer

Browse HDFS & Job Logs

You can browse the hdfs and see the ...READ MORE

Jan 26, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 1,275 views
0 votes
1 answer

expected org.apache.hadoop.io.IntWritable, received org.apache.hadoop.io.LongWritable

Hey George!  This error comes whenever you use ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 967 views
0 votes
1 answer

Unable to instantiate org.apache.hadoop.hive

You might not have set the connector. ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 1,500 views
0 votes
1 answer

Permission denied while uploading files to hdfs

It is not the problem about permission ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 1,472 views
0 votes
1 answer

How to send curl downloaded data in hdfs?

Try using put command with stdin as ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 1,492 views
0 votes
1 answer

How to copy file to multiple hdfs directory?

You can use loop to copy the ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 3,280 views
0 votes
1 answer

How to create files in hdfs?

You can create a file directly in ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 1,235 views
0 votes
1 answer

How to find the port on which hdfs is running?

If you are using hadoop 2.7 or ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 3,165 views
0 votes
0 answers

I have a file uploaded through ftp. Next I want to upload it to local file system in hadoop

Jan 24, 2019 in Big Data Hadoop by Mohan
 • 140 points
edited Jan 24, 2019 by Omkar • 944 views
0 votes
1 answer

How to run Nutch in Hadoop installed in pseudo-distributed mode

Make sure you have built Nutch from ...READ MORE

Jan 24, 2019 in Big Data Hadoop by Frankie
 • 9,830 points • 772 views
0 votes
1 answer

Hadoop installation issue on fedora 24

type jps and check whether namenode and datanode is ...READ MORE

Jan 24, 2019 in Big Data Hadoop by Frankie
 • 9,830 points • 611 views
0 votes
1 answer

[edureka_159609@ip-20-0-41-190 bin]$ hdfs dfs -mkdir ://localhost:9000/Pig_Data -mkdir: java.net.URISyntaxException: Expected scheme name at index 0: ://localhost:9000/Pig_Data

Hey @Mohan! Could you try the following ...READ MORE

Jan 23, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 1,031 views
0 votes
1 answer

Why is using Combiner function not preferred in shuffling?

Combiner function is not preferred because when ...READ MORE

Jan 23, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 597 views
0 votes
1 answer

How to reduce shuffling cost in map reduce?

You can define a Combiner function, which does the ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 1,729 views
0 votes
1 answer

How to perform a word count on a dataframe column?

You can use the below code to ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 2,068 views
0 votes
1 answer

Error while creating avrodatafile?

The error you are getting is AvroWrapper class not ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 545 views
0 votes
1 answer

How does the number of groups affect the cost of the shuffling phase?

Shuffle happens with key-value pairs. So, when ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 513 views
0 votes
1 answer

Spark.read.csv to create RDD into Dataframe

You can use a case class and ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 5,575 views
0 votes
1 answer

How to handle exceptions in Spark and Scala?

There is no particular format to handle ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 4,657 views
0 votes
1 answer

Creating a Parquet or Avro file

In hadoop, we do not create different ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 926 views
0 votes
1 answer

ReduceByKey Avereage

You can try the code mentioned below ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 462 views
0 votes
1 answer

UnsupportedClassVersionError while running Mapreduce program.

Seems like the jar file was not ...READ MORE

Jan 18, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 561 views
0 votes
1 answer

Class not found exception when I am running my Word Count Program jar file

You have forgotten to include the package name ...READ MORE

Jan 18, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 936 views
0 votes
2 answers

Do we need to format datanode to store data

That was not important. If you can ...READ MORE

Jan 16, 2019 in Big Data Hadoop by Sam
 • 160 points • 3,356 views
0 votes
1 answer

Failed to start namenode in hadoop

Change your following properties in hdfs-site.xml <property> ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 12,584 views
0 votes
1 answer

Error while starting hadoop daemons

First, format the namenode and then try ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 1,269 views
0 votes
1 answer

Error connecting hive using python pyhs2

Seems like the host IP is not ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 2,000 views
0 votes
1 answer

Sqoop creating new file for import evertime

No, you are not doing anything wrong ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 909 views
0 votes
1 answer

Connect to Hive using Pyhive

Here's how we can connect to Hive ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 5,115 views
0 votes
1 answer

mongo-hadoop connector:how to query data?

You can add more parameters in the ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Frankie
 • 9,830 points • 1,044 views
0 votes
1 answer

In Hue, how to to download the script?

You can download the script to your ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 1,048 views
0 votes
1 answer

Script storage in Hue

You can follow these steps to find ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 750 views
0 votes
1 answer

Extracting pig log messages

You can use the following commands in ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 553 views
0 votes
1 answer

SQOOP Export command failing

First create a table, which should have ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 5,520 views
0 votes
1 answer

Issue in hdfs dfs command

Hadoop has a special file system called ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 956 views
0 votes
2 answers

Hive update and delete limitations

Vinyl-like crackle sounds. And what is my ...READ MORE

May 3, 2020 in Big Data Hadoop by Carter
 • 140 points • 5,630 views
0 votes
1 answer

Hive ACID semantics

ACID stands for Atomicity, Consistency, Isolation, and Durability.  Until ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 428 views
0 votes
1 answer

Pig CLI mode

Pig can be used in two modes: 1) ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 378 views
0 votes
1 answer

Pig mapreduce mode vs local mode?

Both MapReduce mode and local mode seem ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 2,777 views
0 votes
1 answer

What is the Path of hdfs.site.xml?

Here's where you can find the file: /etc/hadoop/[service ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 2,031 views
0 votes
1 answer

Hadoop backup and recovery tool and guidance

There are a few options for backup ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Frankie
 • 9,830 points • 671 views
0 votes
1 answer

Value for HADOOP_CONF_DIR from Cluster

Install Hadoop as well. In my case ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Frankie
 • 9,830 points • 2,955 views
0 votes
1 answer

Issue While Running Oozie Sample Project

Hey @supriya.  Seems like you have not set ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 681 views
0 votes
1 answer

Not able to start namenode with ./start-all.sh

Try this: stop all the daemons: ./stop-all.sh format the namenode: cd ...READ MORE

Jan 3, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 1,970 views
0 votes
1 answer

Not able to run hdfs commands

Because you said it ran yesterday and ...READ MORE

Jan 3, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 2,936 views
0 votes
1 answer

Spark : java.lang.ClassNotFoundException: org.apache.hadoop.fs.FSDataInputStream

Create a spark-env.cmd file looking like this @echo off set ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
 • 69,210 points • 11,434 views
0 votes
1 answer

Hive table not able to use row format serde

Try this: create table books(isbn string, book_title string, ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 1,181 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.