Recent questions tagged developer

0 votes
1 answer

Difference between a failed task attempt and a killed task attempt

Jul 24, 2018 in Big Data Hadoop by Meci Matt
 • 9,460 points • 3,499 views
0 votes
1 answer

What metadata is stored on a DataNode when a block is written to it?

Jul 23, 2018 in Big Data Hadoop by Meci Matt
 • 9,460 points • 3,527 views
0 votes
1 answer

Importing a portion of Relational Database to HDFS

Jul 20, 2018 in Big Data Hadoop by Meci Matt
 • 9,460 points • 2,207 views
0 votes
1 answer

How can Hadoop discover missing or corrupt HDFS data?

Jul 19, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 1,701 views
0 votes
1 answer

How the FIFO Scheduler arbitrates the cluster resources for a job and its tasks?

Jul 19, 2018 in Big Data Hadoop by Meci Matt
 • 9,460 points • 1,279 views
0 votes
1 answer

Sqoop Metastore ?

Jul 19, 2018 in Big Data Hadoop by shams
 • 3,670 points • 1,561 views
0 votes
1 answer

How does HDFS Federation help HDFS Scale horizontally?

Jul 12, 2018 in Big Data Hadoop by Meci Matt
 • 9,460 points • 1,647 views
0 votes
1 answer

How to avoid a “split-brain” scenario with NameNodes?

Jul 11, 2018 in Big Data Hadoop by Meci Matt
 • 9,460 points • 5,099 views
0 votes
1 answer

How Namenode handles data node failures?

Jul 11, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 6,867 views
0 votes
1 answer

Kafka topic not being deleted

Jul 9, 2018 in Apache Kafka by Shubham
 • 13,490 points • 3,384 views
+1 vote
8 answers

How to print the contents of RDD in Apache Spark?

Jul 6, 2018 in Apache Spark by Shubham
 • 13,490 points • 62,927 views
0 votes
2 answers

How to use RDD filter with other function?

Jul 5, 2018 in Apache Spark by Shubham
 • 13,490 points • 10,234 views
0 votes
1 answer

How to add third party java jars for use in PySpark?

Jul 4, 2018 in Apache Spark by Shubham
 • 13,490 points • 9,111 views
0 votes
1 answer

Difference between sparkContext, JavaSparkContext, SQLContext, & SparkSession?

Jul 4, 2018 in Apache Spark by Shubham
 • 13,490 points • 5,678 views
0 votes
1 answer

Hadoop Nodes for Multiple Disks

Jul 3, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 2,267 views
+1 vote
1 answer

map vs mapValues in Spark

Jun 29, 2018 in Apache Spark by Shubham
 • 13,490 points • 16,656 views
+1 vote
3 answers

Which cluster type should I choose for Spark?

Jun 27, 2018 in Apache Spark by Shubham
 • 13,490 points • 2,071 views
+2 votes
14 answers

How to create new column with function in Spark Dataframe?

Jun 26, 2018 in Apache Spark by coldcode
 • 2,090 points • 90,564 views
0 votes
1 answer

Which is better in term of speed, Shark or Spark?

Jun 26, 2018 in Apache Spark by Shubham
 • 13,490 points • 1,194 views
0 votes
1 answer

How to analyze block placement on datanodes and rebalancing data across Hadoop nodes?

Jun 21, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 1,256 views
0 votes
1 answer

Spark Driver roles

Jun 21, 2018 in Apache Spark by shams
 • 3,670 points • 1,316 views
0 votes
1 answer

Is there any way to setup Hadoop nodes (data nodes/namenodes) to use multiple volumes/disks?

Jun 20, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 1,239 views
0 votes
1 answer

Spark standalone client mode

Jun 20, 2018 in Apache Spark by shams
 • 3,670 points • 1,434 views
0 votes
1 answer

Ways to create RDD in Apache Spark

Jun 19, 2018 in Apache Spark by Shubham
 • 13,490 points • 4,387 views
0 votes
3 answers

Lineage Graph in Spark

Jun 19, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 12,580 views
0 votes
1 answer

Minimizing Data Transfers in Spark

Jun 19, 2018 in Apache Spark by shams
 • 3,670 points • 1,703 views
0 votes
1 answer

How RDD persist the data in Spark?

Jun 18, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 1,717 views
0 votes
1 answer

What do we mean by an RDD in Spark?

Jun 18, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 4,374 views
0 votes
1 answer

When running Spark on Yarn, do I need to install Spark on all nodes of Yarn Cluster?

Jun 14, 2018 in Apache Spark by Shubham
 • 13,490 points • 6,810 views
0 votes
1 answer

Different Hadoop Modes

Jun 13, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 13,477 views
0 votes
1 answer

SQLInterpreter in Spark

Jun 7, 2018 in Apache Spark by shams
 • 3,670 points • 1,027 views
0 votes
1 answer

Different Spark Ecosystem

Jun 4, 2018 in Apache Spark by shams
 • 3,670 points • 1,162 views
0 votes
1 answer

InputSplit vs HDFS Block

Jun 1, 2018 in Big Data Hadoop by shams
 • 3,670 points • 4,748 views
0 votes
1 answer

How does partitioning work in Spark?

May 31, 2018 in Apache Spark by coldcode
 • 2,090 points • 1,517 views
+1 vote
8 answers

How to replace null values in Spark DataFrame?

May 31, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 76,699 views
0 votes
1 answer

How to convert rdd object to dataframe in spark

May 30, 2018 in Apache Spark by Shubham
 • 13,490 points • 4,297 views
0 votes
1 answer

Is there any way to uncache RDD?

May 30, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 1,970 views
0 votes
1 answer

Sqoop vs distCP

May 30, 2018 in Big Data Hadoop by shams
 • 3,670 points • 1,575 views
0 votes
1 answer

NameNode without any data

May 29, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 1,574 views
0 votes
1 answer

What is the difference between Apache Spark SQLContext vs HiveContext?

May 26, 2018 in Apache Spark by Shubham
 • 13,490 points • 4,963 views
0 votes
1 answer

How to find max value in pair RDD?

May 26, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 8,339 views
0 votes
1 answer

Is it better to have one large parquet file or lots of smaller parquet files?

May 23, 2018 in Apache Spark by Shubham
 • 13,490 points • 14,125 views
0 votes
1 answer

What's the difference between 'filter' and 'where' in Spark SQL?

May 23, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 35,119 views
0 votes
1 answer

out of Memory Error in Hadoop

May 22, 2018 in Big Data Hadoop by coldcode
 • 2,090 points • 2,089 views
0 votes
1 answer

When is the reduce tasks start in Hadoop?

May 22, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 4,093 views
0 votes
1 answer

Is a HDFS block sequential ?

May 21, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 1,936 views
0 votes
1 answer

Is there any way to pull data from Mainframe to Hadoop?

May 21, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 2,841 views
0 votes
1 answer

Sqoop vs Oracle Hadoop Connectors

May 18, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 1,222 views
0 votes
1 answer

Can we use Apache Mahout without Hadoop dependency?

May 17, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 1,366 views
0 votes
1 answer

How to install Hadoop in Ubuntu?

May 17, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 927 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.