Most voted questions in Big Data Hadoop

0 votes
1 answer

Hadoop: Adding multiple inputs with a different mapper using python

hadoop jar hadoop-multiple-streaming.jar \ ...READ MORE

Nov 19, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 2,160 views
0 votes
1 answer

Hadoop HDFS: Java API to move files to hdfs

You can use the FileUtil api to do this. Example: Configuration ...READ MORE

Nov 19, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 3,764 views
0 votes
1 answer

Hadoop Apache: Could not fully initialize service [org.apache.oozie.service.ShareLibService]

As mentioned in the error, the problem ...READ MORE

Nov 19, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 892 views
0 votes
1 answer

What is the difference between Hive internal tables and external tables?

Hive has a relational database on the ...READ MORE

Nov 19, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 2,647 views
0 votes
1 answer

How to use Sqoop in Java Program?

You can run sqoop from inside your ...READ MORE

Nov 19, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 1,496 views
0 votes
1 answer

Hadoop MapReduce intermediate output

keep.task.files.pattern parameter can be used to keep the ...READ MORE

Nov 16, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 561 views
0 votes
1 answer

Small files and HDFS blocks

Multiple files are not stored in a ...READ MORE

Nov 16, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,544 views
0 votes
1 answer

Hadoop: Error: Could not find or load main class org.apache.hadoop.util.VersionInfo

This seems like a path issue. Add the ...READ MORE

Nov 16, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 11,925 views
0 votes
1 answer

Hadoop with Python: How to use python to stop Hadoop tasktracker?

Here you go os.system('sudo -u hadoop bin/hadoop-daemon.sh stop ...READ MORE

Nov 16, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 365 views
0 votes
1 answer

Hadoop Pig: java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/filter/Filter

This seems like a problem with the ...READ MORE

Nov 16, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 1,856 views
0 votes
1 answer

Hadoop Pig: How to include external jar file in PIG?

You can do this: register /local/path/to/Jar_name.jar READ MORE

Nov 16, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 835 views
0 votes
1 answer

Hadoop Spark Derby: Caused by: ERROR XSDB6: Another instance of Derby may have already booted the database

As mentioned in the error, there's another ...READ MORE

Nov 16, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 4,347 views
0 votes
1 answer

Can someone tell me how apache sqoop works?

This blog would give you answers to ...READ MORE

Nov 16, 2018 in Big Data Hadoop by brat_1
 • 7,200 points • 400 views
0 votes
1 answer

how is apache sqoop different from flume? Can someone explain?

Apache Sqoop lets you import and export ...READ MORE

Nov 15, 2018 in Big Data Hadoop by brat_1
 • 7,200 points • 345 views
0 votes
1 answer

Hadoop Hive Hbase: How to insert data into Hbase using Hive (JSON file)?

You can use the get_json_object function to parse the ...READ MORE

Nov 15, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 2,652 views
0 votes
1 answer

Hadoop HDFS: How to delete old files from HDFS?

You can use commands like this: hdfs dfs ...READ MORE

Nov 15, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 13,509 views
0 votes
1 answer

Hadoop Spark: __spark_lib.zip does not exist

To find this file, your HADOOP_CONF_DIR env ...READ MORE

Nov 15, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 2,422 views
0 votes
1 answer

Hadoop Hive: recursively descending into subdirectories without partitions or editing hive-site.xml

 I set the following properties before I ...READ MORE

Nov 15, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 5,184 views
0 votes
1 answer

Hadoop: How to copy directory from local system to hdfs using Java code?

Just use the FileSystem's copyFromLocalFile method. If the source Path ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 5,292 views
0 votes
1 answer

Hadoop Hive: How to drop a table?

You cannot drop column directly from a ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 1,797 views
0 votes
1 answer

Hadoop Hive: How to split a single row into multiple rows?

Try this SELECT ID1, Sub FROM tableName lateral view ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 8,628 views
0 votes
1 answer

Hadoop Hive: How to convert multiple rows into comma separated values?

You can use the aggregator function collect_set to do ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 4,959 views
0 votes
1 answer

Hadoop: RHadoop: packages ‘rmr’, ‘rJava‘, ‘RJSONIO‘, ‘rhdfs’, ‘rhbase’, ‘plyrmr’ are not available

You need to first download the packages ...READ MORE

Nov 14, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 818 views
0 votes
1 answer

Hadoop MacOS: formatting namenode: Could not find or load main class

You need to point the HADOOP_PREFIX to ...READ MORE

Nov 13, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 999 views
0 votes
1 answer

Hadoop Spark: What is version to find SparkSession in library Spark?

you need both core and SQL artifacts <repositories> ...READ MORE

Nov 13, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 1,774 views
0 votes
1 answer

Hadoop: method to send output to multiple directories

setup: MultipleOutputs.addNamedOutput(job, "Output", TextOutputFormat.class, Text.class, Text.class); setup of reducer: mout ...READ MORE

Nov 13, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 742 views
0 votes
1 answer

Hadoop Sqoop: How to change sqoop metastore?

In sqoop-site.xml I configured it with, the ...READ MORE

Nov 13, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 1,507 views
0 votes
1 answer

Hadoop: Format namenode gives error: Shutting down NameNode at java.net.UnknownHostException

UnknownHostException is thrown when hadoop tries to resolve ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 5,330 views
0 votes
1 answer

Hadoop Hive: message:Version information not found in metastore. Unable to instantiate

These are the necessary tables required for metastore that are ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 3,311 views
0 votes
1 answer

Hadoop Oozie: E0902: Exception occured: [User: oozie is not allowed to impersonate oozie]

Seems like your version of Hadoop does ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 914 views
0 votes
1 answer

Hadoop Hive: How to insert data in Hive table?

First, copy data into HDFS. Then create ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 9,471 views
0 votes
1 answer

Where can I find AMI for Hadoop on EC2?

To find that, please try with below ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 856 views
0 votes
1 answer

How to control logging functionality in Hadoop?

 Logs are distributed across your cluster, but ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,183 views
0 votes
1 answer

Hadoop: How to use Jps command with Sun JDK installed?

You can put JPS into your path ...READ MORE

Nov 9, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 1,675 views
0 votes
1 answer

Hadoop: Reading and Writing Sequencefile using Apis?

public class SequenceFilesTest { @Test ...READ MORE

Nov 9, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 348 views
0 votes
1 answer

What skills do I need to become Hadoop Admin?

You have heard it right. There is ...READ MORE

Nov 8, 2018 in Big Data Hadoop by anonymous
 • 358 views
0 votes
1 answer

Hadoop: Not able to start Namenode

Stop all running server 1) stop-all.sh Edit the ...READ MORE

Nov 8, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 2,102 views
0 votes
1 answer

Hbase: Client not able to connect with remote Hbase server

You have to remove the localhost entry from hbase server's ...READ MORE

Nov 8, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 5,116 views
0 votes
1 answer

Hadoop Hive: How to skip the first line of csv while loading in hive table?

You can try this: CREATE TABLE temp ...READ MORE

Nov 8, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 8,463 views
0 votes
1 answer

Where can I find logs in Spark on YARN?

You can access logs through the command yarn ...READ MORE

Nov 8, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 857 views
0 votes
1 answer

Hadoop: “Unhealthy Node local-dirs and log-dirs are bad”

You can increase the threshold in yarn-site.xml <property> ...READ MORE

Nov 8, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 3,843 views
0 votes
1 answer

What does a Hadoop tester do?

Hadoop tester, like any other tester, has ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 380 views
0 votes
1 answer

Is Linux Skills mandatory to become Hadoop developer?

Hello. Knowing basics of Linux is mandatory ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 870 views
0 votes
1 answer

Hadoop: java.io.IOException: File could only be replicated to 0 nodes instead of minReplication (=1)

Try this, first stop all the daemons, ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 3,220 views
0 votes
1 answer

Hadoop Hive: How to split string in Hive?

You can use the split function along ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 11,309 views
0 votes
1 answer

How to save Spark dataframe as dynamic partitioned table in Hive?

Hey, you can try something like this: df.write.partitionBy('year', ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 8,211 views
0 votes
1 answer

Hadoop: localhost: Error: JAVA_HOME is not set.

Seems like PATH problem in hadoop-env.sh file. Try ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 4,747 views
0 votes
1 answer

Hadoop: What is the difference between `hadoop dfs` and `hadoop fs`?

You can find the definition here: $HADOOP_HOME/bin/hadoop ... elif [ ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 1,575 views
0 votes
1 answer

Hadoop: Datanode not starting correctly

You can do the following method, copy to ...READ MORE

Nov 5, 2018 in Big Data Hadoop by Omkar
 • 69,210 points • 2,317 views
0 votes
1 answer

What is Streaming data and Hadoop?

The hack you describe is more or ...READ MORE

Nov 2, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,579 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.