questions/apache-spark/page/5
Hi, persist () allows the user to specify ...READ MORE
Hi, If you have a file with id ...READ MORE
Try this code: val rdd= sc.textFile (“file.txt”, 5) rdd.partitions.size Output ...READ MORE
df = spark.createDataFrame([("A", 2000), ("A", 2002), ("A", ...READ MORE
The error message you have shared with ...READ MORE
Yes, we can work with Avro files ...READ MORE
The problem is probably with the command. ...READ MORE
Try this code, it worked for me: val ...READ MORE
After downloading Spark, you need to set ...READ MORE
All prefix operators' symbols are predefined: +, -, ...READ MORE
Hi, SparkSQL is a special component on the ...READ MORE
Refer to the below command used: val df ...READ MORE
Try executing the below code, def readExcel(file: String): ...READ MORE
Hey, Scala introduces a new object keyword, which is used ...READ MORE
Hi, You can do it using map partition ...READ MORE
Hey, You can launch spark application in four ...READ MORE
Hey, The method List.fill() creates a list and ...READ MORE
You can select the column and apply ...READ MORE
You can do it using a code ...READ MORE
Hey, I guess the only problem with the ...READ MORE
Spark-submit jobs are also run from client/edge ...READ MORE
Hi, This happens in Scala whenever you won't ...READ MORE
You can use the following to print ...READ MORE
Hey, To install SBT on Ubuntu first you need ...READ MORE
The address you are using in the ...READ MORE
Hey, You can see this following code to ...READ MORE
Check the reference code mentioned below: def main(args: ...READ MORE
There's an easier way to achieve your ...READ MORE
Refer to the following code: val sqlContext = ...READ MORE
Hey, Lineage is an RDD process to reconstruct ...READ MORE
Hey, Java’s “If. Else”: In Java, “If. Else” is a statement, ...READ MORE
Though there is nothing wrong with the ...READ MORE
Hi, You can either declare an empty Scala ...READ MORE
You can try this: object printarray { ...READ MORE
How can I import zip files and ...READ MORE
Refer to the below command: val input_df = ...READ MORE
You can perform this task in two ...READ MORE
In the command, you have mentioned the ...READ MORE
Hi, You can use this command to start ...READ MORE
Hey, Scala executes a val when we define ...READ MORE
Hi, This reverses the order of elements in ...READ MORE
Hey, There are two ways to find the ...READ MORE
By default, the timeout is set to ...READ MORE
Hi All I am running Scala program on ...READ MORE
Hey, You can use below code to access variables ...READ MORE
Hey, Yes, there are two ways of doing ...READ MORE
Spark uses a master/slave architecture. As you ...READ MORE
Hey, When we try to compare two instances ...READ MORE
You can access task information using TaskContext: import org.apache.spark.TaskContext sc.parallelize(Seq[Int](), ...READ MORE
Hey, Scala case classes let us model immutable data. ...READ MORE
OR
At least 1 upper-case and 1 lower-case letter
Minimum 8 characters and Maximum 50 characters
Already have an account? Sign in.