Recent questions tagged apache-spark

0 votes
0 answers

WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

May 5, 2019 in Apache Spark by Vishal
 • 6,289 views
0 votes
1 answer

How to find the number of null contain in dataframe?

May 3, 2019 in Apache Spark by anonymous
 • 120 points • 6,184 views
0 votes
1 answer

Is it possible to run Apache Spark without Hadoop?

May 3, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,168 views
0 votes
1 answer

Explain to me to run Spark without Hadoop

Apr 12, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 3,344 views
0 votes
1 answer

Spark comparing two big data files using scala

Mar 29, 2019 in Apache Spark by Swaroop
 • 8,280 views
0 votes
1 answer

Spark Yarn: Changing maximum number of time to submit application

Mar 28, 2019 in Apache Spark by Karuna
 • 2,965 views
0 votes
1 answer

Set Library to launch Yarn master

Mar 28, 2019 in Apache Spark by Krishna
 • 1,215 views
0 votes
1 answer

How to set extra JVM options for Spark application?

Mar 28, 2019 in Apache Spark by Kapil
 • 4,639 views
0 votes
1 answer

Thread to use Yarn application master is limited

Mar 28, 2019 in Apache Spark by Naresh
 • 1,715 views
0 votes
1 answer

How to use Spark jars for Yarn distribution?

Mar 28, 2019 in Apache Spark by Siri
 • 2,258 views
0 votes
1 answer

Changing Yarn queue in Spark application

Mar 28, 2019 in Apache Spark by Tina
 • 6,509 views
0 votes
1 answer

How to set executors for static allocation in Spark Yarn?

Mar 28, 2019 in Apache Spark by Shri
 • 2,159 views
0 votes
1 answer

How to use ftp scheme using Yarn in Spark application?

Mar 28, 2019 in Apache Spark by Rishi
 • 1,797 views
0 votes
1 answer

How to store files in executor's working directory?

Mar 28, 2019 in Apache Spark by Simran
 • 5,125 views
0 votes
1 answer

Set archives to be extracted in executor directory

Mar 28, 2019 in Apache Spark by Judy
 • 2,644 views
0 votes
1 answer

Need help setting Spark yarn history server address

Mar 27, 2019 in Apache Spark by Brunda
 • 2,774 views
0 votes
1 answer

How to retain Spark jar and app jar after staging?

Mar 27, 2019 in Apache Spark by Jimmy
 • 1,681 views
0 votes
1 answer

How to increase HDFS replication level in Spark?

Mar 27, 2019 in Apache Spark by Raunak
 • 2,150 views
0 votes
1 answer

Increase Yarn wait time for Sparkcontext

Mar 27, 2019 in Apache Spark by Karan
 • 3,959 views
0 votes
1 answer

Increase cores for yarn in Spark application

Mar 26, 2019 in Apache Spark by John
 • 2,002 views
0 votes
1 answer

Increasing memory to use for Yarn application master?

Mar 26, 2019 in Apache Spark by Krish
 • 2,054 views
0 votes
1 answer

How to cleanup application work directories faster?

Mar 26, 2019 in Apache Spark by Joshi
 • 1,396 views
0 votes
1 answer

How to change worker cleanup interval?

Mar 25, 2019 in Apache Spark by Naina
 • 1,528 views
0 votes
1 answer

How to enable worker cleanup in Spark?

Mar 25, 2019 in Apache Spark by Dinesh
 • 3,725 views
0 votes
1 answer

How to increase worker timeout in Spark application?

Mar 25, 2019 in Apache Spark by Suri
 • 10,248 views
0 votes
1 answer

How to disable automatic remove of application of failures?

Mar 25, 2019 in Apache Spark by Ganesh
 • 1,840 views
0 votes
1 answer

How to spread applications to less nodes?

Mar 25, 2019 in Apache Spark by Jugnu
 • 1,122 views
0 votes
1 answer

Change number of completed drivers displayed

Mar 25, 2019 in Apache Spark by Tina
 • 1,062 views
0 votes
1 answer

Limit displaying completed applications

Mar 25, 2019 in Apache Spark by Giri
 • 1,072 views
0 votes
1 answer

Setting directory for Spark recovery

Mar 25, 2019 in Apache Spark by Rahul
 • 1,604 views
0 votes
1 answer

How to connect to Zookeeper after setting Spark recovery mode?

Mar 25, 2019 in Apache Spark by Snehal
 • 2,208 views
0 votes
1 answer

How to set Spark recovery to Zookeeper?

Mar 25, 2019 in Apache Spark by Hanuman
 • 1,457 views
0 votes
1 answer

Change heart beat time to R process

Mar 19, 2019 in Apache Spark by Kishan
 • 1,303 views
0 votes
1 answer

Set Spark executable for R scripts

Mar 19, 2019 in Apache Spark by Rohit
 • 1,661 views
0 votes
1 answer

Change number of threads use by R back end

Mar 19, 2019 in Apache Spark by Sagar
 • 1,209 views
0 votes
1 answer

Close file after writing write-ahead on driver

Mar 19, 2019 in Apache Spark by Rishi
 • 1,731 views
0 votes
1 answer

Retaining the batch by status APIs before Garbage Collection

Mar 19, 2019 in Apache Spark by Jim
 • 1,298 views
0 votes
1 answer

How to change minimum rate per kafka partition?

Mar 19, 2019 in Apache Spark by Richard
 • 1,916 views
0 votes
1 answer

Set maximum reading rate from Kafka partition

Mar 19, 2019 in Apache Spark by Suri
 • 1,184 views
0 votes
1 answer

Prevent immediate shutdown of Streaming context after JVM shutdown

Mar 19, 2019 in Apache Spark by Dinesh
 • 1,652 views
0 votes
1 answer

Need to disable unpersist in Spark

Mar 19, 2019 in Apache Spark by Guru
 • 1,532 views
0 votes
1 answer

How to enable write ahead logs for receivers?

Mar 19, 2019 in Apache Spark by Roshan
 • 1,595 views
0 votes
1 answer

Using R to display configuration of Spark SQL

Mar 18, 2019 in Apache Spark by Krutika
 • 1,449 views
0 votes
1 answer

How to get SQL configuration in Spark using Python?

Mar 18, 2019 in Apache Spark by Ganesh
 • 2,022 views
0 votes
1 answer

Get Spark SQL configuration in Java

Mar 18, 2019 in Apache Spark by Ranjith
 • 1,496 views
0 votes
1 answer

SQLInterpreter in Spark

Jun 7, 2018 in Apache Spark by shams
 • 3,670 points • 1,459 views
0 votes
1 answer

Unable to spawn executor on remote worker node using multinode spark cluster in spark-shell

Jun 4, 2018 in DevOps Tools by ffdfd
 • 5,550 points • 2,834 views
0 votes
5 answers

How to change the spark Session configuration in Pyspark?

May 29, 2018 in Apache Spark by code799
 • 130,515 views
0 votes
1 answer

Locating Scala installation for Spark

May 25, 2018 in AWS by Flying geek
 • 3,280 points • 1,797 views
0 votes
1 answer

What is the command to check the number of cores in Spark?

May 17, 2018 in Big Data Hadoop by code799
 • 8,219 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.