questions/apache-spark
Speculation is enabled when a fraction of ...READ MORE
In technical terms, you want to gracefully shut down the ...READ MORE
Hey, We have four kinds of identifiers in ...READ MORE
What does the below code print? val AgeDs ...READ MORE
You can change it dynamically while using ...READ MORE
When a task results in too many ...READ MORE
Hi@ritu, The most appropriate step according to me ...READ MORE
Yes, it is possible to change the ...READ MORE
Source tags are different: { x : [ { ...READ MORE
Disabling this feature will compromise the security ...READ MORE
I can list some but there can ...READ MORE
There is no protocol set by default. ...READ MORE
Hey, You can use below code to access variables ...READ MORE
Spark thinks that it is a good ...READ MORE
Hi, An anonymous function in Scala is a ...READ MORE
Yes, you can but it has to ...READ MORE
Hey, There is one main difference. This statement ...READ MORE
Hi, This reverses the order of elements in ...READ MORE
Refer to the below command: val input_df = ...READ MORE
You can do this by setting the ...READ MORE
Hi@abdul, Hadoop 3.0.1 has lots of new features. ...READ MORE
If you are trying to load file ...READ MORE
Parquet is a columnar format file supported ...READ MORE
Hey, The Map.contains() method will tell you if ...READ MORE
Hi, A lens is an abstraction from functional ...READ MORE
You can create a DataFrame from the ...READ MORE
I'm trying to load data to mysql ...READ MORE
map(): Return a new distributed dataset formed by ...READ MORE
You have to use sqoop to export data ...READ MORE
Option c) Run time error - A READ MORE
Spark-submit jobs are also run from client/edge ...READ MORE
If you set the node wait time ...READ MORE
Spark does not allow you to overwrite ...READ MORE
You can change the property to close ...READ MORE
By default, Spark jar, app jar, and ...READ MORE
Hey, Scala case classes let us model immutable data. ...READ MORE
Run below commands spark-class org.apache.spark.deploy.master.Master spark-class org.apache.spark.deploy.worker.Worker spark://192.168.254.1:7077 NOTE: The ...READ MORE
Yes, you have read it right. The ...READ MORE
To change the default executable, assign the ...READ MORE
Hey, @Ritu, I am getting error in your ...READ MORE
You need to change the following: val pipeline ...READ MORE
You can set the directory to store ...READ MORE
You can do it as follows. Use ...READ MORE
Hey, With Scala, we can define a Scala ...READ MORE
You can implement this as follows: First, add ...READ MORE
A Spark driver (aka an application’s driver ...READ MORE
Hi, Scala library has purely functional data structures ...READ MORE
Run the following command in Spark shell ...READ MORE
You can dynamically change this function by ...READ MORE
OR
At least 1 upper-case and 1 lower-case letter
Minimum 8 characters and Maximum 50 characters
Already have an account? Sign in.