env python No such file or directory in pyspark

0 votes

I am getting this below error when trying to run pyspark shell in my Linux system.

How can I solve this error.

Thank You

Apr 7, 2020 in Apache Spark by akhtar
• 38,260 points
6,424 views

1 answer to this question.

+1 vote

Hi@akhtar,

This error occurs because your python version is not compatible with pyspark version. So check your python version and update accordingly using the below given command.

$ sudo  ln -s  /usr/bin/python3 /usr/bin/python

After that it will work.

To know more about it, get your PySpark Certification today and become expert.

Thanks.

answered Apr 7, 2020 by MD
• 95,460 points

Related Questions In Apache Spark

0 votes
1 answer

if i want to see my public key after running cat <path> command in gitbash but saying no such file or directory.

Hey, @KK, You can fix this issue may be ...READ MORE

answered May 26, 2020 in Apache Spark by Gitika
• 65,770 points
889 views
0 votes
1 answer

Facing issue while reading tsv file in pyspark

Hi@khyati, You are getting this type of output ...READ MORE

answered Sep 28, 2020 in Apache Spark by MD
• 95,460 points
2,515 views
0 votes
1 answer

Which query to use for better performance, join in SQL or using Dataset API?

DataFrames and SparkSQL performed almost about the ...READ MORE

answered Apr 19, 2018 in Apache Spark by kurt_cobain
• 9,350 points
1,855 views
0 votes
1 answer

Efficient way to read specific columns from parquet file in spark

As parquet is a column based storage ...READ MORE

answered Apr 20, 2018 in Apache Spark by kurt_cobain
• 9,350 points
7,886 views
+1 vote
2 answers
0 votes
1 answer

Is it possible to run Apache Spark without Hadoop?

Though Spark and Hadoop were the frameworks designed ...READ MORE

answered May 3, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
1,288 views
0 votes
1 answer

Where can I get best spark tutorials for beginners?

Hi@akhtar There are lots of online courses available ...READ MORE

answered May 14, 2020 in Apache Spark by MD
• 95,460 points
753 views
0 votes
1 answer

env : R : No such file or directory

Hi@akhtar, I also got this error. I am able to ...READ MORE

answered Jul 22, 2020 in Apache Spark by MD
• 95,460 points
1,809 views
0 votes
1 answer
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP