after installing hadoop 3.0.1 I can's access spark shell or hive shell.

0 votes
Initially, I have used Hadoop 2.4 now I upgrade it to 3.0.1 then now I cannot use the same commands.
Jun 16 in Apache Spark by abdul
• 120 points

edited Jun 16 by MD 75 views

1 answer to this question.

0 votes

Hi@abdul,

Hadoop 3.0.1 has lots of new features. As you are using the previous version of Hive, there may be a chance of a mismatch between the versions. So try to check which version is compatible with which version.

answered Jun 16 by MD
• 40,740 points
hello , but in previous version  all things like spark,hive,hdfs,sqoop etc is presinstalled in it ,we just have to type the relevent commands for the specific shell i.e to launch spark, i write spark-shell and this was active
so, would you mean  i have to install the things like spark,hive etc  seprately?
Every version has its own configuration way. If I am not wrong you are trying to use Hadoop 3.0.1 but previously you used Hadoop 2.4. So once again you have to configure your tools in your Hadoop 3.0.1
So , you mean i have to install sepratelly then configure , am i right
Yes, you can do that.

Related Questions In Apache Spark

+1 vote
2 answers

Hadoop 3 compatibility with older versions of Hive, Pig, Sqoop and Spark

Hadoop 3 is not widely used in ...READ MORE

answered Apr 20, 2018 in Apache Spark by kurt_cobain
• 9,310 points
3,080 views
0 votes
1 answer

How do I access the Map Task ID in Spark?

You can access task information using TaskContext: import org.apache.spark.TaskContext sc.parallelize(Seq[Int](), ...READ MORE

answered Jul 23, 2019 in Apache Spark by ravikiran
• 4,600 points
186 views
0 votes
1 answer
0 votes
1 answer

Why is Spark faster than Hadoop Map Reduce

Firstly, it's the In-memory computation, if the file ...READ MORE

answered Apr 30, 2018 in Apache Spark by shams
• 3,600 points
332 views
0 votes
1 answer

Bucketing vs Partitioning in HIve

Partition divides large amount of data into ...READ MORE

answered Jul 9, 2018 in Big Data Hadoop by Data_Nerd
• 2,370 points
9,346 views
+1 vote
2 answers
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,920 points
5,441 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 10,920 points
800 views
0 votes
1 answer

Cannot create directory /hive/xzxz/_temporary/0. Name node is in safe mode.

Hi@akhtar, Here you are trying to save csv ...READ MORE

answered Feb 3 in Apache Spark by MD
• 40,740 points
71 views