Scala join comma delimited file as tables

0 votes
I have two data set both are csv format and I want to join both the tables using comma delimited. Can u give any examples for the above scenario?
Jul 9 in Apache Spark by Lohit
15 views

1 answer to this question.

0 votes

Dataframe creation commands:​

image

Now we will register them as tempTables and will do sparksql:

image

imageFor loading file in comma delimited csv to a dataframe, please refer to the below command:

val df1 = sqlContext.read.format("csv").option("header", "true").option("delimiter", ",").option("inferschema", "false").load("stud.csv");
answered Jul 9 by Suraj

Related Questions In Apache Spark

0 votes
1 answer
0 votes
1 answer

Scala pass input data as arguments

Please refer to the below code as ...READ MORE

answered Jun 19 in Apache Spark by Lisa
22 views
0 votes
1 answer

How to create RDD from an external file source in scala?

Hi, To create an RDD from external file ...READ MORE

answered Jul 3 in Apache Spark by Gitika
• 19,720 points
20 views
0 votes
0 answers

How to create RDD as string file?

Can anyone suggest how to create RDD ...READ MORE

Jul 4 in Apache Spark by anand
10 views
0 votes
0 answers
0 votes
1 answer

How to find the number of null contain in dataframe?

Hey there! You can use the select method of the ...READ MORE

answered May 3 in Apache Spark by Omkar
• 67,120 points
93 views
+2 votes
4 answers

use length function in substring in spark

You can use the function expr val data ...READ MORE

answered May 3, 2018 in Apache Spark by kurt_cobain
• 9,240 points
9,722 views
0 votes
2 answers

How to connect Spark to a remote Hive server?

JDBC is not required here. Create a hive ...READ MORE

answered Mar 8 in Big Data Hadoop by Vijay Dixon
• 180 points
1,033 views
0 votes
1 answer

How to create dataframe for the comma delimited file?

 Refer to the below command used: val df ...READ MORE

answered Jul 5 in Apache Spark by karan
16 views
0 votes
1 answer

Spark, Scala: Load custom delimited file

You can load a DAT file into ...READ MORE

answered 3 days ago in Apache Spark by Shri
16 views