Recent questions tagged spark

+1 vote
1 answer

When to use Hadoop, HBase, Hive and Pig?

Nov 20, 2020 in Big Data Hadoop by anonymous
• 10,520 points
785 views
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer

ImportError: No module named 'pyspark'

May 6, 2020 in Apache Spark by akhtar
• 38,230 points
15,040 views
0 votes
1 answer
0 votes
0 answers

One Hot Encoding in Apache Spark

Feb 11, 2020 in Apache Spark by Manish
• 120 points
2,542 views
0 votes
1 answer
0 votes
0 answers
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer

env : R : No such file or directory

Jan 31, 2020 in Apache Spark by Hasid
• 370 points
1,567 views
0 votes
1 answer
0 votes
1 answer

Primary keys in Apache Spark

Sep 11, 2019 in Apache Spark by nitinrawat895
• 11,380 points
1,174 views
+1 vote
1 answer

Primary keys in Apache Spark

Aug 9, 2019 in Apache Spark by nitinrawat895
• 11,380 points
5,740 views
0 votes
1 answer

How do I access the Map Task ID in Spark?

Jul 23, 2019 in Apache Spark by nitinrawat895
• 11,380 points
1,284 views
0 votes
1 answer

Spark Null Pointer Exception.

Jul 19, 2019 in Apache Spark by nitinrawat895
• 11,380 points
5,800 views
0 votes
1 answer

Primary keys in apache Spark

Jul 11, 2019 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,103 views
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer

Spark SQL in databricks

Feb 24, 2019 in Apache Spark by Sunny
2,113 views
+1 vote
1 answer
0 votes
1 answer

ReduceByKey Avereage

Jan 22, 2019 in Big Data Hadoop by slayer
• 29,350 points
476 views
0 votes
1 answer

What is Executor Memory in a Spark application?

Jan 5, 2019 in Apache Spark by Neha
• 6,300 points
6,268 views
–1 vote
1 answer

How to start pyspark?

Jan 3, 2019 in Big Data Hadoop by digger
• 26,740 points
390 views
–1 vote
1 answer
0 votes
1 answer

Apache Spark vs MapReduce

Dec 19, 2018 in Big Data Hadoop by slayer
• 29,350 points
567 views
0 votes
1 answer
0 votes
1 answer

How to get ID of a map task in Spark?

Nov 20, 2018 in Apache Spark by Neha
• 6,300 points
3,149 views
0 votes
1 answer

How to open/stream .zip files through Spark?

Nov 20, 2018 in Apache Spark by Neha
• 6,300 points
2,286 views
0 votes
1 answer
0 votes
1 answer
0 votes
1 answer

Is 'sparkline' a method?

Nov 9, 2018 in Apache Spark by Neha
• 6,300 points
1,034 views
0 votes
1 answer

Filter, Option or FlatMap in spark

Nov 9, 2018 in Apache Spark by Neha
• 6,300 points
2,490 views
0 votes
3 answers

Hadoop Spark: How to iterate hdfs directories?

Oct 29, 2018 in Big Data Hadoop by digger
• 26,740 points
10,631 views
0 votes
1 answer

Does Hadoop and Spark support iPv6 now?

Oct 15, 2018 in Big Data Hadoop by Neha
• 6,300 points
1,791 views
0 votes
1 answer

Internal work of Spark

Oct 11, 2018 in Apache Spark by Meci Matt
• 9,460 points
780 views
0 votes
1 answer

Spark - repartition() vs coalesce()

Oct 11, 2018 in Apache Spark by Meci Matt
• 9,460 points
7,853 views