questions/apache-spark
You cans set extra JVM options that ...READ MORE
This is because the maximum number of ...READ MORE
First, store upload this archive to hdfs and ...READ MORE
To change the default queue to which ...READ MORE
Open Spark shell and run the following ...READ MORE
In case Yarn does not support schemes ...READ MORE
You have to specify a comma-separated list ...READ MORE
I don't think you can copy and ...READ MORE
If you are running history server and ...READ MORE
By default, Spark jar, app jar, and ...READ MORE
Hi @Raunak. You can change the replication ...READ MORE
The default time that the Yarn application waits ...READ MORE
By default, only one core is used for ...READ MORE
You can increase the memory dynamically by ...READ MORE
By default, the cleanup time is set ...READ MORE
The default interval time is 1800 seconds ...READ MORE
To enable cleanup, open the spark shell ...READ MORE
By default, the timeout is set to ...READ MORE
Yes, you have read it right. The ...READ MORE
You can limit the spread out by ...READ MORE
You can change the number of completed ...READ MORE
By default, the number of completed applications ...READ MORE
You can set the directory to store ...READ MORE
You have set Zookeeper as the recovery ...READ MORE
There is a property of Spark which ...READ MORE
The heartbeat interval is assigned to the ...READ MORE
To change the default executable, assign the ...READ MORE
Refer to the below commands to know ...READ MORE
You can change the property to close ...READ MORE
By default, 1000 batches are retained by ...READ MORE
Open spark shell using this command: $ spark-shell Then ...READ MORE
You can do it by using the ...READ MORE
In technical terms, you want to gracefully shut down the ...READ MORE
You can dynamically change this function by ...READ MORE
To enable write-ahead logs, run the following ...READ MORE
Try the below-mentioned code. sparkR.session() properties <- sql("SET -v") showDF(properties, ...READ MORE
You can get the configuration details through ...READ MORE
You will need to use Spark session ...READ MORE
You can set the maximum receiving rate ...READ MORE
First create a Spark session like this: val ...READ MORE
There are different methods to achieve optimization ...READ MORE
In a Spark application, when you invoke ...READ MORE
Some of the issues I have faced ...READ MORE
Disabling this feature will compromise the security ...READ MORE
Spark has a built-in prevention system against XSS. ...READ MORE
To configure the location of the credential ...READ MORE
Spark allows you to retrieve the key ...READ MORE
By default, this feature is disabled. To ...READ MORE
There is no protocol set by default. ...READ MORE
OR
At least 1 upper-case and 1 lower-case letter
Minimum 8 characters and Maximum 50 characters
Already have an account? Sign in.