Recent questions tagged spark

+1 vote
1 answer

When to use Hadoop, HBase, Hive and Pig?

Nov 20, 2020 in Big Data Hadoop by anonymous
• 10,520 points
728 views
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer

ImportError: No module named 'pyspark'

May 6, 2020 in Apache Spark by akhtar
• 38,230 points
14,872 views
0 votes
1 answer
0 votes
0 answers

One Hot Encoding in Apache Spark

Feb 11, 2020 in Apache Spark by Manish
• 120 points
2,498 views
0 votes
1 answer
0 votes
0 answers
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer

env : R : No such file or directory

Jan 31, 2020 in Apache Spark by Hasid
• 370 points
1,517 views
0 votes
1 answer
0 votes
1 answer

Primary keys in Apache Spark

Sep 11, 2019 in Apache Spark by nitinrawat895
• 11,380 points
1,081 views
+1 vote
1 answer

Primary keys in Apache Spark

Aug 9, 2019 in Apache Spark by nitinrawat895
• 11,380 points
5,619 views
0 votes
1 answer

How do I access the Map Task ID in Spark?

Jul 23, 2019 in Apache Spark by nitinrawat895
• 11,380 points
1,195 views
0 votes
1 answer

Spark Null Pointer Exception.

Jul 19, 2019 in Apache Spark by nitinrawat895
• 11,380 points
5,629 views
0 votes
1 answer

Primary keys in apache Spark

Jul 11, 2019 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,065 views
0 votes
1 answer
0 votes
1 answer

Spark SQL in databricks

Feb 24, 2019 in Apache Spark by Sunny
2,047 views
+1 vote
1 answer
0 votes
1 answer

ReduceByKey Avereage

Jan 22, 2019 in Big Data Hadoop by slayer
• 29,350 points
434 views
0 votes
1 answer

What is Executor Memory in a Spark application?

Jan 5, 2019 in Apache Spark by Neha
• 6,300 points
6,158 views
–1 vote
1 answer

How to start pyspark?

Jan 3, 2019 in Big Data Hadoop by digger
• 26,740 points
360 views
–1 vote
1 answer
0 votes
1 answer

Apache Spark vs MapReduce

Dec 19, 2018 in Big Data Hadoop by slayer
• 29,350 points
485 views
0 votes
1 answer
0 votes
1 answer

How to get ID of a map task in Spark?

Nov 20, 2018 in Apache Spark by Neha
• 6,300 points
3,038 views
0 votes
1 answer

How to open/stream .zip files through Spark?

Nov 20, 2018 in Apache Spark by Neha
• 6,300 points
2,216 views
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer

Is 'sparkline' a method?

Nov 9, 2018 in Apache Spark by Neha
• 6,300 points
980 views
0 votes
1 answer

Filter, Option or FlatMap in spark

Nov 9, 2018 in Apache Spark by Neha
• 6,300 points
2,451 views
0 votes
3 answers

Hadoop Spark: How to iterate hdfs directories?

Oct 29, 2018 in Big Data Hadoop by digger
• 26,740 points
10,514 views
0 votes
1 answer

Does Hadoop and Spark support iPv6 now?

Oct 15, 2018 in Big Data Hadoop by Neha
• 6,300 points
1,708 views
0 votes
1 answer

Internal work of Spark

Oct 11, 2018 in Apache Spark by Meci Matt
• 9,460 points
728 views
0 votes
1 answer

Spark - repartition() vs coalesce()

Oct 11, 2018 in Apache Spark by Meci Matt
• 9,460 points
7,798 views