I want to know who to read multiple files using cat command in hdfs. For a single file I use
hdfs dfs cat file.csv
What should I do for reading more than one file?
If you want to read files with same extension, try this:
hdfs dfs -cat /*.csv
If you want to read all the files, try this:
hdfs dfs -cat /*
"*" will match any file name.
val text = sc.wholeTextFiles("student/*")
text.collect() READ MORE
You can use the hdfs command:
hdfs fs ...READ MORE
You can create a file directly in ...READ MORE
Yes, you can do this. You can ...READ MORE
Firstly you need to understand the concept ...READ MORE
org.apache.hadoop.mapred is the Old API
org.apache.hadoop.mapreduce is the ...READ MORE
put <localSrc> <dest>
copyFr ...READ MORE
In your case there is no difference ...READ MORE
You can try something like this:
You can use a combination of cat and put command. Something ...READ MORE
Already have an account? Sign in.