Recent questions tagged hdfs

0 votes
1 answer

What is HDFS?

Dec 22, 2021 in Big Data Hadoop by CoderGirl
 • 500 points • 3,187 views
0 votes
1 answer

What was Hadoop named after?

Dec 2, 2021 in Big Data Hadoop by Kavya
 • 700 points • 6,944 views
0 votes
1 answer

Where does hive stores its table?

Dec 7, 2020 in Big Data Hadoop by Rajiv
 • 8,870 points • 2,072 views
+1 vote
1 answer

How to copy file from Local file system to HDFS?

Oct 20, 2020 in Big Data Hadoop by akhtar
 • 38,260 points • 4,764 views
0 votes
1 answer

How to write a HDF file from a DataFrame?

Oct 18, 2020 in Python by akhtar
 • 38,260 points • 2,486 views
0 votes
1 answer

How to remove the directory from HDFS?

Oct 13, 2020 in Big Data Hadoop by akhtar
 • 38,260 points • 6,525 views
0 votes
1 answer

org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://localhost:54310/user/hduser/input.

Oct 13, 2020 in Big Data Hadoop by akhtar
 • 38,260 points • 3,993 views
0 votes
1 answer

I was installing Hadoop for windows everything went smoothly but when I tried to format NameNode it displayed an error of failing to start NameNode. What should I do?

Oct 10, 2020 in Big Data Hadoop by alex
 • 120 points • 2,425 views
0 votes
1 answer

HI i was trying to install hadoop but i get these error....Format HDFS Namenode Error: Could not find or load main class ”-Djava.library.path=.home.hadoop.hadoop-3.2.1.lib"

Oct 7, 2020 in Big Data Hadoop by bezz
 • 120 points • 3,822 views
0 votes
1 answer

How to find HDFS free space from command line?

Oct 5, 2020 in Big Data Hadoop by akhtar
 • 38,260 points • 2,197 views
0 votes
1 answer

Where does Hive store files in HDFS?

Oct 5, 2020 in Big Data Hadoop by akhtar
 • 38,260 points • 2,304 views
+1 vote
1 answer

How to check a HDFS directory size?

Oct 5, 2020 in Big Data Hadoop by akhtar
 • 38,260 points • 2,340 views
0 votes
1 answer

How to change the default replication factor in Hadoop?

Oct 3, 2020 in Big Data Hadoop by akhtar
 • 38,260 points • 3,506 views
0 votes
1 answer

Change the owner and group of a file in Hadoop.

Oct 1, 2020 in Big Data Hadoop by akhtar
 • 38,260 points • 10,408 views
0 votes
1 answer

Change permissions of a file in HDFS.

Oct 1, 2020 in Big Data Hadoop by akhtar
 • 38,260 points • 3,837 views
0 votes
1 answer

How to create a group in Hadoop?

Oct 1, 2020 in Big Data Hadoop by akhtar
 • 38,260 points • 2,451 views
0 votes
1 answer

How to append files from local system to HDFS?

Oct 1, 2020 in Big Data Hadoop by akhtar
 • 38,260 points • 10,247 views
0 votes
1 answer

Copy files in different folders in Hadoop.

Oct 1, 2020 in Big Data Hadoop by akhtar
 • 38,260 points • 36,967 views
0 votes
1 answer

How to copy files from HDFS to local system?

Oct 1, 2020 in Big Data Hadoop by akhtar
 • 38,260 points • 5,967 views
0 votes
2 answers

While typing 'hdfs fs -mkdir/prem' command I'm getting below error. Could not find or load main class fs and caused by java.lang.ClassNotFoundException:fs

Aug 7, 2020 in Big Data Hadoop by anonymous
 • 140 points • 7,765 views
0 votes
1 answer

Format HDFS Namenode Error: Could not find or load main class ”-Djava.library.path=.home.hadoop.hadoop-3.2.1.lib.native”

Jun 12, 2020 in Big Data Hadoop by fwood
 • 120 points • 16,978 views
0 votes
1 answer

error:org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:456)] HDFS IO error java.io.IOException

Apr 23, 2020 in Big Data Hadoop by akhtar
 • 38,260 points • 2,993 views
0 votes
1 answer

How do you find an HDFS path URL?

Feb 28, 2020 in Big Data Hadoop by akhtar
 • 38,260 points • 23,379 views
0 votes
1 answer

apache.spark.sql.AnalysisException: Text data source does not support int data type.;

Feb 13, 2020 in Big Data Hadoop by akhtar
 • 38,260 points • 7,788 views
0 votes
1 answer

how to make an existing hadoop cluster self adaptive?

Feb 10, 2020 in Big Data Hadoop by Sanjana
 • 140 points • 1,985 views
0 votes
1 answer

Caused by: ERROR XJ040: Failed to start database 'metastore_db' with class loader org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@2c7bde26

Feb 3, 2020 in Apache Spark by akhtar
 • 38,260 points • 7,559 views
0 votes
1 answer

What is ETL tool in Hadoop?

Jan 31, 2020 in Big Data Hadoop by akhtar
 • 38,260 points • 4,486 views
+1 vote
1 answer

About Available Space Block Placement Policy

Jan 21, 2020 in Big Data Hadoop by anonymous
 • 130 points • 2,403 views
+1 vote
2 answers

Hadoop Learning Path

Nov 26, 2019 in Big Data Hadoop by anonymous
 • 130 points • 2,805 views
+1 vote
1 answer

datanode decomissioning

Nov 25, 2019 in Big Data Hadoop by Saif
 • 130 points • 2,093 views
+1 vote
0 answers

hdfs namenode -format not working, not showing anything.

Sep 6, 2019 in Big Data Hadoop by nar
 • 2,669 views
+1 vote
0 answers

i tried to run hdfs namenode -format but i got this instead, -classpath and D:\Hadoop isn't recognized. Anyone can help? Thank you.

Sep 3, 2019 in Big Data Hadoop by Fuad
 • 3,124 views
0 votes
1 answer

Can't seem to read files: "Invalid container ID"

Aug 2, 2019 in Big Data Hadoop by Esha
 • 2,772 views
0 votes
1 answer

Unzip files in hdfs

Jul 31, 2019 in Big Data Hadoop by Judy
 • 7,920 views
0 votes
1 answer

Cannot load file to spark: "org.apache.spark.sql.AnalysisException: Path does not exist"

Jul 31, 2019 in Apache Spark by Ritu
 • 13,859 views
+1 vote
3 answers

What is the best way to merge multi-part HDFS files into single file?

Jul 29, 2019 in Big Data Hadoop by Karan
 • 35,960 views
0 votes
1 answer

Difference between put and copyFromLocal

Jul 29, 2019 in Big Data Hadoop by Karan
 • 14,965 views
0 votes
1 answer

Spark: Read from Hive, store in HDFS

Jul 26, 2019 in Apache Spark by Kiran
 • 4,061 views
0 votes
2 answers

Load data into the hive table

Jul 26, 2019 in Big Data Hadoop by Jai
 • 3,902 views
0 votes
1 answer

How can I append data to an existing file in HDFS?

Jul 25, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 11,476 views
0 votes
1 answer

Copy file from local to hdfs from the spark job in yarn mode

Jul 24, 2019 in Apache Spark by Rishi
 • 5,477 views
0 votes
1 answer

How to restart failed Namenode?

Jul 23, 2019 in Big Data Hadoop by Karan
 • 5,215 views
0 votes
2 answers

Namenode is not getting started

Jul 22, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,921 views
0 votes
1 answer

How to fix corrupt files on HDFS

Jul 18, 2019 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 2,558 views
0 votes
1 answer

Copy file from local to hdfs from the spark job in yarn mode

Jul 16, 2019 in Big Data Hadoop by Kriti
 • 13,397 views
0 votes
2 answers

Error in running hdfs commands

Jul 15, 2019 in Big Data Hadoop by Suman
 • 3,518 views
0 votes
1 answer

How to Import the complete directory into HDFS?

Jul 15, 2019 in Big Data Hadoop by Naruto
 • 1,963 views
0 votes
1 answer

Not able to upload files to hdfs: No such file or directory

Jul 11, 2019 in Big Data Hadoop by Punit
 • 6,335 views
0 votes
1 answer

HDFS: Upload file from local file system to Edureka cloud lab

Jul 11, 2019 in Big Data Hadoop by Rehan
 • 2,860 views
0 votes
1 answer

Command to copy file from desktop to hdfs

Jul 11, 2019 in Big Data Hadoop by Quill
 • 5,316 views