How do I include all the Hadoop dependencies using Maven

0 votes
  • I have installed Hadoop on my CentOS VM
  • I am using eclipse IDE and my hadoop project has listed hadoop*.jar as dependency
  • My mvn install command fails:

(master) $ mvn clean install

[INFO] Scanning for projects...

[ERROR] The build could not read 1 project -> [Help 1]

[ERROR]  

[ERROR]   The project groupId:hadoop:master-SNAPSHOT (/home/edureka/hadoop-programs/test/pom.xml)

I changed my pom.xml to following

POM.XML

<?xml version="1.0" encoding="UTF-8"?>

<project xmlns="http://maven.apache.org/POM/4.0.0"

         xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"

         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">

    <modelVersion>4.0.0</modelVersion>


    <groupId>groupId</groupId>

    <artifactId>hadoop</artifactId>

    <version>master-SNAPSHOT</version>

    <packaging>jar</packaging>


    <dependencies>

        <dependency>

            <groupId>org.apache.hadoop</groupId>

            <artifactId>hadoop-core</artifactId>

            <version>1.0.3</version>

            <type>jar</type>

            <systemPath>/usr/lib/hadoop/1.0.3/libexec/hadoop-core-1.0.3.jar</systemPath>

        </dependency>

    </dependencies>

</project>

Still getting the same error.

Apr 10, 2018 in Big Data Hadoop by coldcode
• 2,080 points
5,960 views

1 answer to this question.

0 votes

This is a dependency mismatch error. I would recommend you to use the following hadoop-core dependency.

<dependency>
    <groupId>org.apache.hadoop</groupId>
    <artifactId>hadoop-core</artifactId>
    <version>0.20.2</version>
</dependency>
answered Apr 10, 2018 by Shubham
• 13,490 points

Related Questions In Big Data Hadoop

0 votes
0 answers

How I can kill the jobs using jobID running in local mode with Hadoop

I am Running hadoop jobs in local ...READ MORE

Aug 26, 2020 in Big Data Hadoop by kamboj
• 140 points
1,951 views
0 votes
1 answer

How can I get the respective Bitcoin value for an input in USD when using c#

Simply make call to server and parse ...READ MORE

answered Mar 25, 2018 in Big Data Hadoop by charlie_brown
• 7,720 points
752 views
0 votes
1 answer

How to get started with Hadoop and do some development using Eclipse IDE?

Alright, there are couple of things that ...READ MORE

answered Apr 4, 2018 in Big Data Hadoop by Ashish
• 2,650 points
1,738 views
0 votes
1 answer

How do I print hadoop properties in command line?

You can use the following command to get ...READ MORE

answered Apr 6, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
1,443 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
10,558 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
104,209 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,390 points
4,260 views
0 votes
1 answer
0 votes
1 answer

How do I parse pdf file using MapReduce?

If you have your own custom InputFormat(WholeFileInputFormat). ...READ MORE

answered Apr 11, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,252 views
0 votes
1 answer
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP