tag/pyspark
Toggle navigation
Back
Ask a question
Blogs
Browse Categories
Browse Categories
Apache Kafka
Apache Spark
Big Data Hadoop
Blockchain
Career Counselling
Cloud Computing
Cyber Security & Ethical Hacking
Data Analytics
Database
DevOps & Agile
Events & Trending Topics
IoT (Internet of Things)
Java
Linux Administration
Machine Learning
MicroStrategy
PMP
Power BI
Python
RPA
Selenium
Software Testing
Tableau
Talend
Web Development
Ask us Anything!
Others
Log In
Sign Up
Home
Community
Tag
Pyspark
Recent questions tagged pyspark
0
votes
1
answer
How to read a dataframe based on an avro schema?
Oct 29, 2020
in
Apache Spark
by
anonymous
•
120
points
•
211
views
apache-spark
big-data
spark-dataframe
spark-sql
pyspark
0
votes
1
answer
How to implement my clustering algorithm in pyspark (without using the ready library for example k-means)?
Oct 14, 2020
in
Apache Spark
by
dani
•
160
points
•
165
views
pyspark
k-means
apache-spark
big-data
0
votes
1
answer
I want to read .csv file from S3 and load/write the same data to cassandra.
Sep 4, 2020
in
AWS
by
Raj
•
120
points
•
816
views
aws
devops-tools
devops
aws-services
amazon-web-services
aws-s3
cassandra
pyspark
0
votes
1
answer
how to run spark job from EC2 to EMR?
Jun 24, 2020
in
Apache Spark
by
Edureka
•
120
points
•
800
views
pyspark
spark
amazon-emr
aws-analytics
amazon-web-services
0
votes
1
answer
Can number of Spark task be greater than the executor core?
Jun 16, 2020
in
Apache Spark
by
Rishi
•
160
points
•
186
views
hadoop
big-data
apache-spark
pyspark
0
votes
1
answer
Where can I get best spark tutorials for beginners?
May 14, 2020
in
Apache Spark
by
akhtar
•
38,120
points
•
189
views
apache-spark
big-data
hadoop
pyspark
spark
hadoop-admin
0
votes
1
answer
Py4JJavaError: An error occurred while calling o310.csv. : java.net.ConnectException: Call From master/192.168.56.101 to master:9000
May 7, 2020
in
Apache Spark
by
akhtar
•
38,120
points
•
1,233
views
apache-spark
big-data
spark-sql
pyspark
0
votes
1
answer
TypeError: Invalid param value given for param "inputCols". Could not convert DataFrame[R&D Spend: double, Administration: double, Marketing Spend: double]to list of strings
May 7, 2020
in
Apache Spark
by
akhtar
•
38,120
points
•
312
views
spark
pyspark
machine-learning
0
votes
1
answer
Error: No module named 'findspark'
May 6, 2020
in
Apache Spark
by
akhtar
•
38,120
points
•
2,863
views
python
python-programming
spark
pyspark
findspark
0
votes
1
answer
ImportError: No module named 'pyspark'
May 6, 2020
in
Apache Spark
by
akhtar
•
38,120
points
•
3,235
views
python
python-programming
pyspark
spark
+1
vote
2
answers
py4j.protocol.Py4JError: org.apache.spark.api.python.PythonUtils.getEncryptionEnabled does not exist in the JVM
Apr 7, 2020
in
Apache Spark
by
akhtar
•
38,120
points
•
5,738
views
big-data
hadoop
apache-spark
pyspark
0
votes
1
answer
env: ‘python’: No such file or directory in pyspark.
Apr 7, 2020
in
Apache Spark
by
akhtar
•
38,120
points
•
1,686
views
big-data
apache-spark
spark
pyspark
+1
vote
1
answer
How to assign a column in Spark Dataframe (PySpark) as a Primary Key?
Jan 8, 2020
in
Apache Spark
by
anonymous
•
150
points
•
2,310
views
pyspark
spark-dataframe
spark-sql
apache-spark
big-data
python
+1
vote
1
answer
Is there any efficient way of dealing null values during concat functionality of pyspark.sql version 2.3.4?
Nov 5, 2019
in
Apache Spark
by
aizhar
•
130
points
•
9,042
views
apache-spark
big-data
spark
spark-sql
spark-dataframe
pyspark
+1
vote
0
answers
How to combine a nested json file, which is being partitioned on the basis of source tags, and has varying internal structure, into a single json file; ( differently sourced Tag and varying structure)
Oct 11, 2019
in
Apache Spark
by
anonymous
•
160
points
•
308
views
json
aws
devops-tools
devops
pyspark
+1
vote
1
answer
How to convert a json file structure with values in single quotes to quoteless ?
Oct 4, 2019
in
Apache Spark
by
anonymous
•
160
points
•
1,495
views
json
aws
devops-tools
devops
pyspark
0
votes
1
answer
How to sort json file ascending in pymongo?
Aug 14, 2019
in
Python
by
Ahmed
•
310
points
•
207
views
json
python
mongodb
pyspark
pymongo
sort
ascending
descending
+2
votes
1
answer
Import zip files and process the excel files ( inside the zip files ) by using pyspark connecting with pymongo
Aug 10, 2019
in
Python
by
Ahmed
•
310
points
•
410
views
python
pymongo
pyspark
mongodb
csv
import
python-programming
0
votes
1
answer
Pyspark dataframe with random values
Aug 1, 2019
in
Apache Spark
by
Esha
•
4,450
views
python-programming
python
pyspark
apache-spark
big-data
0
votes
1
answer
PySpark not starting: No active sparkcontext
Jul 30, 2019
in
Apache Spark
by
Karan
•
1,356
views
apache-spark
big-data
pyspark
0
votes
1
answer
Unable to use ml library in pyspark
Jul 30, 2019
in
Apache Spark
by
Yashita
•
578
views
apache-spark
big-data
pyspark
0
votes
1
answer
RDD word count with line numbers
Jul 25, 2019
in
Apache Spark
by
Rishi
•
561
views
pyspark
apache-spark
big-data
0
votes
1
answer
Pyspark is taking default path
Jul 16, 2019
in
Apache Spark
by
Will
•
379
views
pyspark
apache-spark
big-data
0
votes
1
answer
How can I remove headers from dataframe?
Feb 14, 2019
in
Apache Spark
by
Dinesh
•
11,956
views
apache-spark
big-data
hadoop
pyspark
0
votes
1
answer
How to perform a word count on a dataframe column?
Jan 22, 2019
in
Big Data Hadoop
by
Karan
•
677
views
hadoop
big-data
mapreduce
pyspark
0
votes
1
answer
PySpark Config ?
Jul 26, 2018
in
Apache Spark
by
shams
•
3,660
points
•
152
views
spark
pyspark
config
developer
Most popular tags
devops
devops-tools
python
big-data
amazon-web-services
hadoop
python-programming
selenium
blockchain
html
All categories
Apache Kafka
(83)
Apache Spark
(598)
Big Data Hadoop
(1,860)
Blockchain
(1,513)
Career Counselling
(1,058)
Cloud Computing
(3,096)
Cyber Security & Ethical Hacking
(90)
Data Analytics
(1,196)
Database
(270)
DevOps & Agile
(3,094)
Events & Trending Topics
(27)
IoT (Internet of Things)
(361)
Java
(968)
Linux Administration
(234)
Machine Learning
(173)
MicroStrategy
(5)
PMP
(367)
Power BI
(460)
Python
(2,948)
RPA
(648)
Selenium
(1,550)
Software Testing
(54)
Tableau
(474)
Talend
(73)
Web Development
(1,457)
Ask us Anything!
(62)
Others
(302)
×
Join the world's most active Tech Community!
Welcome back to the World's most active Tech Community!
Sign up with Gmail
Sign up with Facebook
OR
Please provide a valid input
SIGN UP
Already have an Edureka Account?
Login
Please enter a valid emailid
Forgot Password?
LOGIN
Don’t have edureka account?
Sign Up
resend ?
reset password
Don’t have edureka account?
Sign Up
reset password
Don’t have edureka account?
Sign Up
Send Code
Don’t have edureka account?
Sign Up
Subscribe to our Newsletter, and get personalized recommendations.
Sign up with Google
Signup with Facebook
Already have an account?
Sign in
.
×