How to create dataframe for the comma delimited file?

0 votes
Hi team,

I have a file like (a.txt)
1,2,3,4
5,6,7,8
9,10,11,12

How to create dataframe for the comma delimited file?
Jul 5, 2019 in Apache Spark by Yogi
85 views

1 answer to this question.

0 votes

 Refer to the below command used:

val df = sqlContext.read.format("csv").option("header", "false").option("delimiter", ",").option("inferschema", "true").load("si ri1.txt")

This should work

answered Jul 5, 2019 by karan

Related Questions In Apache Spark

0 votes
1 answer

How to create RDD from an external file source in scala?

Hi, To create an RDD from external file ...READ MORE

answered Jul 3, 2019 in Apache Spark by Gitika
• 26,270 points
187 views
0 votes
0 answers

How to create RDD as string file?

Can anyone suggest how to create RDD ...READ MORE

Jul 4, 2019 in Apache Spark by anand
72 views
0 votes
1 answer

Create dataframe for Avro file

Yes, we can work with Avro files ...READ MORE

answered Jul 22, 2019 in Apache Spark by Rishi
523 views
+1 vote
1 answer
+2 votes
4 answers

use length function in substring in spark

You can use the function expr val data ...READ MORE

answered May 3, 2018 in Apache Spark by kurt_cobain
• 9,310 points
22,184 views
0 votes
3 answers

How to connect Spark to a remote Hive server?

JDBC is not required here. Create a hive ...READ MORE

answered Mar 8, 2019 in Big Data Hadoop by Vijay Dixon
• 190 points
2,248 views
0 votes
3 answers

How to transpose Spark DataFrame?

Please check the below mentioned links for ...READ MORE

answered Dec 31, 2018 in Apache Spark by anonymous
9,395 views
0 votes
11 answers

How to create new column with function in Spark Dataframe?

val coder: (Int => String) = v ...READ MORE

answered Apr 4, 2019 in Apache Spark by anonymous

edited Apr 5, 2019 by Omkar 41,733 views
0 votes
1 answer

How to find the number of null contain in dataframe?

Hey there! You can use the select method of the ...READ MORE

answered May 3, 2019 in Apache Spark by Omkar
• 69,000 points
471 views