Recent questions tagged spark

0 votes
1 answer

Hadoop mandatory for Spark?

Jun 1, 2018 in Apache Spark by shams
 • 3,670 points • 951 views
0 votes
1 answer

How does partitioning work in Spark?

May 31, 2018 in Apache Spark by coldcode
 • 2,090 points • 1,674 views
+1 vote
8 answers

How to replace null values in Spark DataFrame?

May 31, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 78,170 views
0 votes
1 answer

How to import the dependencies of Spark MLlib into eclipse project?

May 31, 2018 in Apache Spark by hack236
 • 2,455 views
0 votes
1 answer

Spark Machine Learning pipeline works fine in Spark 1.6, but it gives error when executed on Spark 2.x?

May 31, 2018 in Apache Spark by hack236
 • 1,442 views
0 votes
1 answer

What is Spark Piping?

May 31, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 2,612 views
0 votes
1 answer

Akka in Spark

May 31, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 2,510 views
0 votes
1 answer

How to convert rdd object to dataframe in spark

May 30, 2018 in Apache Spark by Shubham
 • 13,490 points • 4,591 views
0 votes
1 answer

Is there any way to uncache RDD?

May 30, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 2,125 views
+1 vote
1 answer

How can I write a text file in HDFS not from an RDD, in Spark program?

May 29, 2018 in Apache Spark by code799
 • 9,171 views
0 votes
5 answers

How to change the spark Session configuration in Pyspark?

May 29, 2018 in Apache Spark by code799
 • 128,774 views
0 votes
1 answer

What are the parameters in local[a,b,c] explains?

May 29, 2018 in Apache Spark by code799
 • 1,105 views
0 votes
1 answer

How to save and retrieve the Spark RDD from HDFS?

May 29, 2018 in Apache Spark by code799
 • 14,535 views
0 votes
1 answer

Is it possible to run Spark and Mesos along with Hadoop?

May 29, 2018 in Apache Spark by shams
 • 3,670 points • 1,336 views
0 votes
1 answer

What is Sliding Window?

May 28, 2018 in Apache Spark by shams
 • 3,670 points • 2,933 views
0 votes
1 answer

Spark 2.3? What is new in it?

May 28, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 1,256 views
0 votes
1 answer

What is the difference between Apache Spark SQLContext vs HiveContext?

May 26, 2018 in Apache Spark by Shubham
 • 13,490 points • 5,230 views
0 votes
1 answer

How to find max value in pair RDD?

May 26, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 8,545 views
0 votes
1 answer

How can I compare the elements of the RDD using MapReduce?

May 24, 2018 in Apache Spark by code799
 • 3,959 views
0 votes
3 answers

How to transpose Spark DataFrame?

May 24, 2018 in Apache Spark by anonymous
 • 21,093 views
0 votes
1 answer

Getting error while connecting zookeeper in Kafka - Spark Streaming integration

May 24, 2018 in Apache Spark by user-code
 • 3,303 views
+1 vote
1 answer

Can anyone explain what is RDD in Spark?

May 24, 2018 in Apache Spark by coder_jazz
 • 3,282 views
0 votes
1 answer

How to set keys & access tokens for Twitter Spark streaming?

May 24, 2018 in Apache Spark by coder_jazz
 • 2,333 views
0 votes
2 answers

In a Spark DataFrame how can I flatten the struct?

May 24, 2018 in Apache Spark by code799
 • 6,938 views
0 votes
1 answer

Is it better to have one large parquet file or lots of smaller parquet files?

May 23, 2018 in Apache Spark by Shubham
 • 13,490 points • 14,332 views
0 votes
1 answer

What's the difference between 'filter' and 'where' in Spark SQL?

May 23, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 35,530 views
0 votes
3 answers

How to connect Spark to a remote Hive server?

May 17, 2018 in Big Data Hadoop by code799
 • 13,845 views
0 votes
1 answer

What is the command to check the number of cores in Spark?

May 17, 2018 in Big Data Hadoop by code799
 • 7,838 views
0 votes
1 answer

Why does sortBy transformation trigger a Spark job?

May 8, 2018 in Apache Spark by shams
 • 3,670 points • 2,678 views
0 votes
1 answer

How to get the number of elements in partition?

May 8, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 2,810 views
0 votes
1 answer

How is Apache Spark different from the Hadoop approach?

May 7, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 1,677 views
0 votes
1 answer

start-master and start-all?

May 7, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 2,765 views
0 votes
1 answer

cache tables in apache spark sql

May 4, 2018 in Apache Spark by shams
 • 3,670 points • 3,927 views
0 votes
1 answer

Spark Monitoring with Ganglia

May 4, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 1,641 views
0 votes
1 answer

Spark cannot access local file anymore?

May 3, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 2,020 views
0 votes
1 answer

Can I read a CSV represented as a string into Apache Spark?

May 3, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 3,064 views
0 votes
1 answer

Why is collect in SparkR slow?

May 3, 2018 in Apache Spark by shams
 • 3,670 points • 3,518 views
0 votes
1 answer

When not to use foreachPartition and mapPartition?

Apr 30, 2018 in Apache Spark by shams
 • 3,670 points • 7,972 views
0 votes
1 answer

Why is Spark faster than Hadoop Map Reduce

Apr 30, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 1,967 views
+5 votes
11 answers

Concatenate columns in apache spark dataframe

Apr 26, 2018 in Apache Spark by Shubham
 • 13,490 points • 74,786 views
0 votes
1 answer

How to get Spark dataset metadata?

Apr 26, 2018 in Apache Spark by Ashish
 • 2,650 points • 5,492 views
0 votes
2 answers

Difference between createOrReplaceTempView and registerTempTable

Apr 25, 2018 in Apache Spark by Ashish
 • 2,650 points • 14,490 views
0 votes
1 answer

Spark Kill Running Application

Apr 25, 2018 in Apache Spark by Ashish
 • 2,650 points • 2,348 views
+1 vote
2 answers

Apache Spark vs Apache Spark 2

Apr 24, 2018 in Apache Spark by Ashish
 • 2,650 points • 10,210 views
0 votes
1 answer

How to stop messages from being displayed on spark console?

Apr 24, 2018 in Apache Spark by Ashish
 • 2,650 points • 6,230 views
0 votes
1 answer

Efficient way to read specific columns from parquet file in spark

Apr 20, 2018 in Apache Spark by Ashish
 • 2,650 points • 8,707 views
0 votes
1 answer

reduceByKey or reduceByKeyLocally , which should be preferred ?

Apr 20, 2018 in Apache Spark by Ashish
 • 2,650 points • 3,114 views
+1 vote
2 answers

Hadoop 3 compatibility with older versions of Hive, Pig, Sqoop and Spark

Apr 20, 2018 in Apache Spark by Shubham
 • 13,490 points • 7,079 views
0 votes
1 answer

Which query to use for better performance, join in SQL or using Dataset API?

Apr 19, 2018 in Apache Spark by Ashish
 • 2,650 points • 2,569 views
0 votes
1 answer

Is there any way to check the Spark version?

Apr 19, 2018 in Apache Spark by Shubham
 • 13,490 points • 9,679 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.