questions/apache-spark
The following code that I wrote for ...READ MORE
Yes, we can work with Avro files ...READ MORE
The error message you have shared with ...READ MORE
The sliding function is used when you ...READ MORE
Below is an example of reading data ...READ MORE
If, for option 2, you mean have ...READ MORE
Hey, You can concatenate/join two Maps in more than ...READ MORE
Check if you are able to access ...READ MORE
RDD is a fundamental data structure of ...READ MORE
If you need a single output file ...READ MORE
Sliding Window controls transmission of data packets ...READ MORE
Hi@akhtar, Currently, you are running with the default ...READ MORE
Hi, @Amey, You can go through this regarding ...READ MORE
Hi@ritu, Spark DStream (Discretized Stream) is the basic ...READ MORE
Hi, If you have a file with id ...READ MORE
df = spark.createDataFrame([("A", 2000), ("A", 2002), ("A", ...READ MORE
Try df.where($"cola".isNotNull && $"cola" =!= "" && !$"colb".isin(2,3)) your ...READ MORE
As is widely used, and has different ...READ MORE
To enable cleanup, open the spark shell ...READ MORE
Hi@ritu, Spark's internal scheduler may truncate the lineage of the RDD graph if ...READ MORE
Hi@Manas, You can read your dataset from CSV ...READ MORE
Hi, Spark Driver is the program that runs ...READ MORE
You can try and check this below ...READ MORE
Please have a look below for your ...READ MORE
Variable declaration can be done in two ...READ MORE
You can do it dynamically like this: val ...READ MORE
Hi, You can see this example to see ...READ MORE
Hi@Amey, It depends on your use case. Both ...READ MORE
Hi, You can follow the below-given steps to ...READ MORE
You can use the following command. This ...READ MORE
Hi@akhtar, In your error, it shows that you ...READ MORE
Hey, you can use "contains" filter to extract ...READ MORE
Hey, I guess the only problem with the ...READ MORE
You can perform this task in two ...READ MORE
Use the following command to increase the ...READ MORE
Please refer to the below code as ...READ MORE
Yes, they both merge the values using ...READ MORE
Just do the following: Edit your conf/log4j.properties file ...READ MORE
Can you share the screenshots for the ...READ MORE
Hi@ritu, Fault tolerance is the property that enables ...READ MORE
You can change the scheduling mode as ...READ MORE
The address you are using in the ...READ MORE
Hi, Spark provides a high-level API in Java, ...READ MORE
When a Spark application is running, the ...READ MORE
I appreciate that you want to try ...READ MORE
Hi@khyati, You are getting this type of output ...READ MORE
In sparkSql, we can use CASE when ...READ MORE
Option D) runtime error READ MORE
You have to install Intellij with scala plugin. ...READ MORE
sbin/start-master.sh : Starts a master instance on ...READ MORE
OR
At least 1 upper-case and 1 lower-case letter
Minimum 8 characters and Maximum 50 characters
Already have an account? Sign in.