Trending questions in Big Data Hadoop

0 votes
1 answer

Where are Hadoop's task log files stored?

For each MapReduce job, Hadoop stores the ...READ MORE

Sep 18, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 714 views
0 votes
1 answer

Why Hadoop is not implemented using Message Passing Interface (MPI)?

One of the big features of Hadoop/map-reduce ...READ MORE

Sep 21, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 601 views
0 votes
1 answer

ISR out of Replica

If the replica stays out of the ...READ MORE

Sep 24, 2018 in Big Data Hadoop by kurt_cobain
 • 9,390 points • 433 views
0 votes
1 answer

Hadoop: intervals and JOIN

Hey, a solution was given on Biostar: http://biostar.stackexchange.com/questions/8821. Hope ...READ MORE

Sep 24, 2018 in Big Data Hadoop by slayer
 • 29,350 points • 430 views
0 votes
1 answer

What are the hardware requirements for installing Hadoop on my Laptop?

You can either install Apache Hadoop on ...READ MORE

Apr 10, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 7,638 views
0 votes
1 answer

How to choose between Cassandra, Membase, Hadoop, MongoDB and RDBMS?

Actually it comes in two ways: One ...READ MORE

Sep 18, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 650 views
0 votes
1 answer

What is the difference between local file system commands touch and touchz?

Actually they both do the same except touchz is ...READ MORE

Aug 14, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,158 views
0 votes
1 answer

How to access different directories in a Hadoop cluster?

You need to configure the client to ...READ MORE

Sep 18, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 615 views
0 votes
1 answer

Hive with JSON: getting EOF exception while querying

You are missing the commas in your ...READ MORE

Aug 30, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 1,411 views
0 votes
1 answer

submitJob method in JobClient of Hadoop throws null pointer

I had this problem as well. But when ...READ MORE

Sep 18, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 591 views
0 votes
1 answer

Hbase REST API: Timerange scan

Looking at the XSD, it seems that ...READ MORE

Aug 30, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 1,405 views
0 votes
1 answer

Determining how many mappers will run?

Here what happens is, each file would ...READ MORE

Aug 9, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,272 views
0 votes
2 answers

Which framework allows random, realtime read/write access to hundreds of terabytes of data?

For this type of case you can ...READ MORE

Aug 14, 2018 in Big Data Hadoop by anonymous
 • 2,081 views
0 votes
1 answer

How to achieve maximum memory to disk I/O ratio?

You need to tune io.sort.mb value until ...READ MORE

Sep 18, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 508 views
0 votes
1 answer

Not able to find HDFS directory on my system?

I guess you didn't understand it correctly dfs.datanode.data.dir, ...READ MORE

Apr 17, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 7,141 views
0 votes
1 answer

Which is the Real Time Monitoring tool/API for Hadoop?

If you're using Yarn, there's a rest ...READ MORE

Sep 4, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,064 views
0 votes
1 answer

Difference between a failed task attempt and a killed task attempt

Let me explain you the difference between ...READ MORE

Jul 24, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,875 views
0 votes
1 answer

Backup and Checkpoint Node

Checkpoint Node keeps track of the latest ...READ MORE

Jul 31, 2018 in Big Data Hadoop by kurt_cobain
 • 9,390 points • 2,537 views
0 votes
1 answer

Hadoop Documentation for Eclipse.

Few considerations to be taken are here: If ...READ MORE

Sep 11, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 697 views
0 votes
1 answer

What metadata is stored on a DataNode when a block is written to it?

Let me explain you step by step.  Each ...READ MORE

Jul 23, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,769 views
0 votes
1 answer

Can we integrate Hadoop with Python?

Use Hadoop streaming for using python,php etc ...READ MORE

Aug 23, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,403 views
0 votes
1 answer

How a client reads a file from HDFS?

Let me explain you it briefly. So, ...READ MORE

Jul 31, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,357 views
0 votes
1 answer

different schedulers in Hadoop

COSHH – It schedules decisions by considering ...READ MORE

Aug 28, 2018 in Big Data Hadoop by kurt_cobain
 • 9,390 points • 1,086 views
0 votes
1 answer

How do I get connected to Hadoop and Geo Spatial connector?

There are a number of free and ...READ MORE

Aug 14, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,683 views
0 votes
1 answer

What is the Data format and database choices in Hadoop and Spark?

Use Parquet. I'm not sure about CSV ...READ MORE

Sep 4, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 732 views
0 votes
1 answer

Block Scanner HDFS

Block scanner runs periodically on every DataNode ...READ MORE

Jul 31, 2018 in Big Data Hadoop by kurt_cobain
 • 9,390 points • 2,221 views
0 votes
1 answer

Which Windows client is used for Cloudera Hadoop Cluster?

You can very well use VM linux ...READ MORE

Sep 4, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 698 views
0 votes
1 answer

What is the best functional language to do Hadoop Map-Reduce?

down voteacceptedBoth Clojure and Haskell are definitely ...READ MORE

Sep 4, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 674 views
0 votes
1 answer

Hadoop Pipe: shared libraries, No such file or directory error

Add -rpath my.zip/lib to LDFLAGS_HDP. For compilation to work, you ...READ MORE

Aug 30, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 849 views
0 votes
1 answer

Where are Hadoop's task log files stored?

You can easily find these log files ...READ MORE

Aug 16, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 1,446 views
0 votes
1 answer

How to upgrade Apache Hadoop from 2.4.1 to 2.6.0?

If the downtime is not an issue, ...READ MORE

Sep 7, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 460 views
0 votes
1 answer

How to move data from Oracle database to Hadoop?

Yes, you heard it correctly. Apache Sqoop is ...READ MORE

Apr 12, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 6,853 views
0 votes
1 answer

What are the basic concepts for video data structure and processing?

1.  Make use of hadoop storm framework. ( ...READ MORE

Sep 7, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 417 views
0 votes
1 answer

How to write examples to test whether the installation is validated or not?

You have some example jars in your ...READ MORE

Sep 5, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 506 views
0 votes
1 answer

Which Operating system is more preferable for data node?

In a real installation (1 active namenode, ...READ MORE

Sep 4, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 522 views
0 votes
1 answer

What is the difference between hadoop-1.2.1.bin.tar.gz and hadoop-1.2.1.tar.gz files?

As the name of the file in ...READ MORE

Aug 17, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,304 views
0 votes
1 answer

Passing keys and values to the reducers during a standard sort and shuffle phase of MapReduce

Let me explain you the whole scenario Reducer ...READ MORE

Jul 27, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,164 views
0 votes
1 answer

How to Install Cloudera Manager into my Virtual Machine ?

Before you start anything, First make sure ...READ MORE

Aug 9, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 1,569 views
0 votes
1 answer

How should I connect Hadoop in C#?

The Uri should be your Cluster Name, ...READ MORE

Aug 7, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 1,643 views
0 votes
1 answer

Clarification of some Hadoop Concepts.

Please go through : http://bytepadding.com/big-data/map-reduce/understanding-map-reduce-the-missing-guide/ Lets try to understand ...READ MORE

Sep 5, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 344 views
0 votes
1 answer

What happens in a MapReduce job when you set the number of reducers to one?

If you set number of reducers as ...READ MORE

Jul 31, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 1,845 views
0 votes
1 answer

What is the prerequisite for BigQuery other than SQL?

If you know your SQL, you should ...READ MORE

Aug 23, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 823 views
0 votes
1 answer

What are the problems in creating volume in mapr hadoop?

It sounds like the user you are ...READ MORE

Aug 22, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 823 views
0 votes
1 answer

How to calculate number of slave nodes?

Total number of slave nodes in your ...READ MORE

Aug 16, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 1,028 views
0 votes
1 answer

Use of MapReduce in PIG

Apache Pig programs are written in a ...READ MORE

Jul 25, 2018 in Big Data Hadoop by shams
 • 3,670 points • 1,986 views
0 votes
1 answer

How does Hadoop's block replacement policy work?

In your case, One copy of the ...READ MORE

Aug 16, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 1,026 views
0 votes
1 answer

Want to have an idea on Hadoop Machine Learning and Data Mining project.

You haven't written anything about your interest. ...READ MORE

Aug 14, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,094 views
0 votes
1 answer

How compression works in Hadoop?

It basically depends on the file type ...READ MORE

Jul 27, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,805 views
0 votes
1 answer

How to programmatically access hadoop cluster where kerberos is enable?

Okay,here's the code snippet to work in the ...READ MORE

Mar 27, 2018 in Big Data Hadoop by coldcode
 • 2,080 points • 7,034 views
0 votes
1 answer

What is the difference between a Big Data Warehouse and a traditional Data Warehouse?

Hadoop is similar in architecture to MPP data ...READ MORE

Aug 10, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,183 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.