questions/apache-spark
Hi All I am running Scala program on ...READ MORE
Hi, You can try this remove brackets from ...READ MORE
In your log4j.properties file you need to ...READ MORE
Hi@akhtar, Regrading to this error, I think the ...READ MORE
what is the benefit of repartition(1) and ...READ MORE
Instead of spliting on '\n'. You should ...READ MORE
To change the default queue to which ...READ MORE
Some of the issues I have faced ...READ MORE
Yes, there is a difference between the ...READ MORE
14)The number of stages in a job ...READ MORE
Hi, To launch spark application in cluster mode, ...READ MORE
Hey, You can try this: from pyspark import SparkContext SparkContext.stop(sc) sc ...READ MORE
Hey there! You can use the select method of the ...READ MORE
Hi@Deepak, In your test class you passed empid ...READ MORE
To generate the output file, you can ...READ MORE
Hey, Use SparkContext.union(...) instead to union many RDDs at once You ...READ MORE
> In order to reduce the processing ...READ MORE
First, reboot the system. And after reboot, ...READ MORE
There are a bunch of functions that ...READ MORE
Yes we can add columns to the ...READ MORE
You need to declare the variable which ...READ MORE
Spark 2.0+ Spark 2.0 provides native window functions ...READ MORE
Hey, You can try this code to get ...READ MORE
You can try this: object printarray { ...READ MORE
Hi@akhtar, As we know text files are in ...READ MORE
Hey, ofDim() is a method in Scala that ...READ MORE
You can try the below code: df.registerTempTable(“airports”) sqlContext.sql(" create ...READ MORE
By default, each task is allocated with ...READ MORE
Seems like Spark hadoop daemons are not ...READ MORE
Hey, It already has SparkContent.union and it does know how to ...READ MORE
Hi@Ganendra, I am not sure what's the issue, ...READ MORE
After downloading Spark, you need to set ...READ MORE
In spark 2.0.+ it should look something ...READ MORE
This should work: def readExcel(file: String): DataFrame = ...READ MORE
Hey, Lineage is an RDD process to reconstruct ...READ MORE
You can change the location where you ...READ MORE
Hi@dani, You can find the euclidean distance using ...READ MORE
Hi@ritu, You can create a data frame from ...READ MORE
You can do this by turning off ...READ MORE
Hi, Regarding this error, you just need to change ...READ MORE
Hey, Here is the example of which will return ...READ MORE
There are two popular ways using which ...READ MORE
The full form of RDD is a ...READ MORE
Hey, You can use the subtractByKey () function to ...READ MORE
Please try the following Scala code: import org.apache.hadoop.conf.Configuration import ...READ MORE
Hi@akhtar, I think you got this error due to version mismatch ...READ MORE
You cans set extra JVM options that ...READ MORE
You have to specify a comma-separated list ...READ MORE
SqlContext has a number of createDataFrame methods ...READ MORE
Hi, Use this below given code, it will ...READ MORE
OR
At least 1 upper-case and 1 lower-case letter
Minimum 8 characters and Maximum 50 characters
Already have an account? Sign in.