after installing hadoop 3 0 1 I can s access spark shell or hive shell

0 votes
Initially, I have used Hadoop 2.4 now I upgrade it to 3.0.1 then now I cannot use the same commands.
Jun 16, 2020 in Apache Spark by abdul
• 120 points

edited Jun 16, 2020 by MD 814 views

1 answer to this question.

0 votes

Hi@abdul,

Hadoop 3.0.1 has lots of new features. As you are using the previous version of Hive, there may be a chance of a mismatch between the versions. So try to check which version is compatible with which version.

answered Jun 16, 2020 by MD
• 95,440 points
hello , but in previous version  all things like spark,hive,hdfs,sqoop etc is presinstalled in it ,we just have to type the relevent commands for the specific shell i.e to launch spark, i write spark-shell and this was active
so, would you mean  i have to install the things like spark,hive etc  seprately?
Every version has its own configuration way. If I am not wrong you are trying to use Hadoop 3.0.1 but previously you used Hadoop 2.4. So once again you have to configure your tools in your Hadoop 3.0.1
So , you mean i have to install sepratelly then configure , am i right
Yes, you can do that.

Related Questions In Apache Spark

+1 vote
2 answers

Hadoop 3 compatibility with older versions of Hive, Pig, Sqoop and Spark

Hadoop 3 is not widely used in ...READ MORE

answered Apr 20, 2018 in Apache Spark by kurt_cobain
• 9,390 points
5,439 views
0 votes
1 answer

How do I access the Map Task ID in Spark?

You can access task information using TaskContext: import org.apache.spark.TaskContext sc.parallelize(Seq[Int](), ...READ MORE

answered Jul 23, 2019 in Apache Spark by ravikiran
• 4,620 points
1,195 views
0 votes
1 answer

if i want to see my public key after running cat <path> command in gitbash but saying no such file or directory.

Hey, @KK, You can fix this issue may be ...READ MORE

answered May 26, 2020 in Apache Spark by Gitika
• 65,910 points
595 views
0 votes
1 answer

Why is Spark faster than Hadoop Map Reduce

Firstly, it's the In-memory computation, if the file ...READ MORE

answered Apr 30, 2018 in Apache Spark by shams
• 3,670 points
1,102 views
0 votes
1 answer

Bucketing vs Partitioning in HIve

Partition divides large amount of data into ...READ MORE

answered Jul 9, 2018 in Big Data Hadoop by Data_Nerd
• 2,390 points
26,473 views
+1 vote
2 answers
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
10,523 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
2,166 views
0 votes
1 answer

Cannot create directory /hive/xzxz/_temporary/0. Name node is in safe mode.

Hi@akhtar, Here you are trying to save csv ...READ MORE

answered Feb 3, 2020 in Apache Spark by MD
• 95,440 points
597 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP