Trending questions in Big Data Hadoop

0 votes
1 answer

Why Hadoop is not implemented using Message Passing Interface (MPI)?

One of the big features of Hadoop/map-reduce ...READ MORE

Sep 21, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 588 views
0 votes
1 answer

Where are Hadoop's task log files stored?

For each MapReduce job, Hadoop stores the ...READ MORE

Sep 18, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 684 views
0 votes
1 answer

ISR out of Replica

If the replica stays out of the ...READ MORE

Sep 24, 2018 in Big Data Hadoop by kurt_cobain
 • 9,390 points • 422 views
0 votes
1 answer

Hadoop: intervals and JOIN

Hey, a solution was given on Biostar: http://biostar.stackexchange.com/questions/8821. Hope ...READ MORE

Sep 24, 2018 in Big Data Hadoop by slayer
 • 29,350 points • 417 views
0 votes
1 answer

What are the hardware requirements for installing Hadoop on my Laptop?

You can either install Apache Hadoop on ...READ MORE

Apr 10, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 7,607 views
0 votes
1 answer

How to choose between Cassandra, Membase, Hadoop, MongoDB and RDBMS?

Actually it comes in two ways: One ...READ MORE

Sep 18, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 638 views
0 votes
1 answer

What is the difference between local file system commands touch and touchz?

Actually they both do the same except touchz is ...READ MORE

Aug 14, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,142 views
0 votes
1 answer

How to access different directories in a Hadoop cluster?

You need to configure the client to ...READ MORE

Sep 18, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 604 views
0 votes
1 answer

Hive with JSON: getting EOF exception while querying

You are missing the commas in your ...READ MORE

Aug 30, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 1,397 views
0 votes
1 answer

submitJob method in JobClient of Hadoop throws null pointer

I had this problem as well. But when ...READ MORE

Sep 18, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 580 views
0 votes
1 answer

Hbase REST API: Timerange scan

Looking at the XSD, it seems that ...READ MORE

Aug 30, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 1,381 views
0 votes
1 answer

How to achieve maximum memory to disk I/O ratio?

You need to tune io.sort.mb value until ...READ MORE

Sep 18, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 496 views
0 votes
1 answer

Determining how many mappers will run?

Here what happens is, each file would ...READ MORE

Aug 9, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,248 views
0 votes
2 answers

Which framework allows random, realtime read/write access to hundreds of terabytes of data?

For this type of case you can ...READ MORE

Aug 14, 2018 in Big Data Hadoop by anonymous
 • 2,053 views
0 votes
1 answer

Not able to find HDFS directory on my system?

I guess you didn't understand it correctly dfs.datanode.data.dir, ...READ MORE

Apr 17, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 7,103 views
0 votes
1 answer

Which is the Real Time Monitoring tool/API for Hadoop?

If you're using Yarn, there's a rest ...READ MORE

Sep 4, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,058 views
0 votes
1 answer

Difference between a failed task attempt and a killed task attempt

Let me explain you the difference between ...READ MORE

Jul 24, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,855 views
0 votes
1 answer

Hadoop Documentation for Eclipse.

Few considerations to be taken are here: If ...READ MORE

Sep 11, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 684 views
0 votes
1 answer

Backup and Checkpoint Node

Checkpoint Node keeps track of the latest ...READ MORE

Jul 31, 2018 in Big Data Hadoop by kurt_cobain
 • 9,390 points • 2,444 views
0 votes
1 answer

What metadata is stored on a DataNode when a block is written to it?

Let me explain you step by step.  Each ...READ MORE

Jul 23, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,746 views
0 votes
1 answer

Can we integrate Hadoop with Python?

Use Hadoop streaming for using python,php etc ...READ MORE

Aug 23, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,382 views
0 votes
1 answer

How a client reads a file from HDFS?

Let me explain you it briefly. So, ...READ MORE

Jul 31, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,346 views
0 votes
1 answer

different schedulers in Hadoop

COSHH – It schedules decisions by considering ...READ MORE

Aug 28, 2018 in Big Data Hadoop by kurt_cobain
 • 9,390 points • 1,079 views
0 votes
1 answer

How do I get connected to Hadoop and Geo Spatial connector?

There are a number of free and ...READ MORE

Aug 14, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,673 views
0 votes
1 answer

What is the Data format and database choices in Hadoop and Spark?

Use Parquet. I'm not sure about CSV ...READ MORE

Sep 4, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 722 views
0 votes
1 answer

Which Windows client is used for Cloudera Hadoop Cluster?

You can very well use VM linux ...READ MORE

Sep 4, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 689 views
0 votes
1 answer

Block Scanner HDFS

Block scanner runs periodically on every DataNode ...READ MORE

Jul 31, 2018 in Big Data Hadoop by kurt_cobain
 • 9,390 points • 2,187 views
0 votes
1 answer

What is the best functional language to do Hadoop Map-Reduce?

down voteacceptedBoth Clojure and Haskell are definitely ...READ MORE

Sep 4, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 660 views
0 votes
1 answer

Hadoop Pipe: shared libraries, No such file or directory error

Add -rpath my.zip/lib to LDFLAGS_HDP. For compilation to work, you ...READ MORE

Aug 30, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 833 views
0 votes
1 answer

Where are Hadoop's task log files stored?

You can easily find these log files ...READ MORE

Aug 16, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 1,433 views
0 votes
1 answer

How to upgrade Apache Hadoop from 2.4.1 to 2.6.0?

If the downtime is not an issue, ...READ MORE

Sep 7, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 446 views
0 votes
1 answer

What are the basic concepts for video data structure and processing?

1.  Make use of hadoop storm framework. ( ...READ MORE

Sep 7, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 412 views
0 votes
1 answer

How to move data from Oracle database to Hadoop?

Yes, you heard it correctly. Apache Sqoop is ...READ MORE

Apr 12, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 6,826 views
0 votes
1 answer

How to write examples to test whether the installation is validated or not?

You have some example jars in your ...READ MORE

Sep 5, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 492 views
0 votes
1 answer

Which Operating system is more preferable for data node?

In a real installation (1 active namenode, ...READ MORE

Sep 4, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 513 views
0 votes
1 answer

What is the difference between hadoop-1.2.1.bin.tar.gz and hadoop-1.2.1.tar.gz files?

As the name of the file in ...READ MORE

Aug 17, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,289 views
0 votes
1 answer

Passing keys and values to the reducers during a standard sort and shuffle phase of MapReduce

Let me explain you the whole scenario Reducer ...READ MORE

Jul 27, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,121 views
0 votes
1 answer

How to Install Cloudera Manager into my Virtual Machine ?

Before you start anything, First make sure ...READ MORE

Aug 9, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 1,560 views
0 votes
1 answer

How should I connect Hadoop in C#?

The Uri should be your Cluster Name, ...READ MORE

Aug 7, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 1,596 views
0 votes
1 answer

Clarification of some Hadoop Concepts.

Please go through : http://bytepadding.com/big-data/map-reduce/understanding-map-reduce-the-missing-guide/ Lets try to understand ...READ MORE

Sep 5, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 334 views
0 votes
1 answer

What happens in a MapReduce job when you set the number of reducers to one?

If you set number of reducers as ...READ MORE

Jul 31, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 1,825 views
0 votes
1 answer

What is the prerequisite for BigQuery other than SQL?

If you know your SQL, you should ...READ MORE

Aug 23, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 810 views
0 votes
1 answer

What are the problems in creating volume in mapr hadoop?

It sounds like the user you are ...READ MORE

Aug 22, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 811 views
0 votes
1 answer

How to calculate number of slave nodes?

Total number of slave nodes in your ...READ MORE

Aug 16, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 1,010 views
0 votes
1 answer

Use of MapReduce in PIG

Apache Pig programs are written in a ...READ MORE

Jul 25, 2018 in Big Data Hadoop by shams
 • 3,670 points • 1,965 views
0 votes
1 answer

How does Hadoop's block replacement policy work?

In your case, One copy of the ...READ MORE

Aug 16, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 1,003 views
0 votes
1 answer

Want to have an idea on Hadoop Machine Learning and Data Mining project.

You haven't written anything about your interest. ...READ MORE

Aug 14, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,085 views
0 votes
1 answer

How compression works in Hadoop?

It basically depends on the file type ...READ MORE

Jul 27, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,787 views
0 votes
1 answer

How to programmatically access hadoop cluster where kerberos is enable?

Okay,here's the code snippet to work in the ...READ MORE

Mar 27, 2018 in Big Data Hadoop by coldcode
 • 2,080 points • 7,019 views
0 votes
1 answer

What is the difference between a Big Data Warehouse and a traditional Data Warehouse?

Hadoop is similar in architecture to MPP data ...READ MORE

Aug 10, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,165 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.