questions/apache-spark
Hi, You can follow the below-given steps to ...READ MORE
Hi@Rishi, Yes, number of spark tasks can be ...READ MORE
Hi@Rishi, Yes, it is possible. If executor no. ...READ MORE
Hi@abdul, Hadoop 3.0.1 has lots of new features. ...READ MORE
Hi, @Amey, You can go through this regarding ...READ MORE
Hey, @KK, You can fix this issue may be ...READ MORE
Hi@akhtar There are lots of online courses available ...READ MORE
Hi@Deepak, In your test class you passed empid ...READ MORE
looking for a platform where we can ...READ MORE
Hi@Amey, You can enable WebHDFS to do this ...READ MORE
Hi@Amey, It depends on your use case. Both ...READ MORE
Hi@akhtar, I think your HDFS cluster is not ...READ MORE
Hi@akhtar, In your error, it shows that you ...READ MORE
Hi@akhtar, To convert pyspark dataframe into pandas dataframe, ...READ MORE
Hi@akhtar, To import this module in your program, ...READ MORE
Hi@akhtar, By default pyspark in not present in ...READ MORE
Hi@akhtar, You may resolve this exception, by increasing the ...READ MORE
This type of error tends to occur ...READ MORE
Hi@akhtar, In /etc/spark/conf/spark-defaults.conf, append the path of your custom ...READ MORE
Hi@akhtar, I think you got this error due to version mismatch ...READ MORE
Hi, Use this below given code, it will ...READ MORE
Using findspark is expected to solve the ...READ MORE
Hi@akhtar, This error occurs because your python version ...READ MORE
from pyspark.sql.types import FloatType fname = [1.0,2.4,3.6,4.2,45.4] df=spark.createDataFrame(fname, ...READ MORE
How can one parse an S3 XML ...READ MORE
The following code that I wrote for ...READ MORE
Hi@akhtar, To create multiple producer you have to ...READ MORE
Hi@akhtar, Yes, Spark streaming uses checkpoint. Checkpoint is ...READ MORE
Hi everyone, I tried to count individual words ...READ MORE
Hi@akhtar, There is no concept of indexing in ...READ MORE
Hi@akhtar Generally, Spark streaming is used for real time ...READ MORE
Hi@akhtar, Dstreams are the basic abstraction that is ...READ MORE
Hi@akhtar, Regrading to this error, I think the ...READ MORE
Hi@akhtar, Here you are trying to save csv ...READ MORE
Hi@akhtar, Here you are trying to read a ...READ MORE
Hi@akhtar, The PageRank algorithm outputs a probability distribution ...READ MORE
Hi@akhtar, I also got this error. I am able to ...READ MORE
Hi, I am getting this error when try ...READ MORE
When using the Java substring() method, a ...READ MORE
Hi@akhtar, Currently, you are running with the default ...READ MORE
Hi@akhtar, As we know text files are in ...READ MORE
Hi@ akhtar, Both map() and mapPartitions() are the ...READ MORE
Hi, I have the input RDD as a ...READ MORE
spark do not have any concept of ...READ MORE
Hi @asif, Share with us please the application ...READ MORE
We do not have access to hive ...READ MORE
Try to put the kafka client for ...READ MORE
Hey @c.kothamasu You should copy your file to ...READ MORE
When you concatenate any string with a ...READ MORE
Source tags are different: { x : [ { ...READ MORE
OR
At least 1 upper-case and 1 lower-case letter
Minimum 8 characters and Maximum 50 characters
Already have an account? Sign in.