tag/spark-sql
Toggle navigation
Back
Ask a question
Blogs
Browse Categories
Browse Categories
Apache Kafka
Apache Spark
Big Data Hadoop
Blockchain
Career Counselling
Cloud Computing
Cyber Security & Ethical Hacking
Data Analytics
Database
DevOps & Agile
Events & Trending Topics
IoT (Internet of Things)
Java
Linux Administration
Machine Learning
MicroStrategy
PMP
Power BI
Python
RPA
Selenium
Software Testing
Tableau
Talend
Web Development
Ask us Anything!
Others
Log In
Sign Up
Home
Community
Tag
Spark-sql
Recent questions tagged spark-sql
+1
vote
1
answer
How to write Spark DataFrame to Avro Data File?
Nov 4, 2020
in
Apache Spark
by
akhtar
•
38,120
points
•
174
views
big-data
apache-spark
spark-dataframe
spark-sql
0
votes
1
answer
How to read a dataframe based on an avro schema?
Oct 29, 2020
in
Apache Spark
by
anonymous
•
120
points
•
215
views
apache-spark
big-data
spark-dataframe
spark-sql
pyspark
0
votes
1
answer
How to insert data into Cassandra table using Spark DataFrame?
Sep 21, 2020
in
Apache Spark
by
akhtar
•
38,120
points
•
448
views
hadoop
big-data
apache-spark
spark-dataframe
spark-sql
cassandra
0
votes
1
answer
Py4JJavaError: An error occurred while calling o310.csv. : java.net.ConnectException: Call From master/192.168.56.101 to master:9000
May 7, 2020
in
Apache Spark
by
akhtar
•
38,120
points
•
1,236
views
apache-spark
big-data
spark-sql
pyspark
+1
vote
1
answer
How to convert pyspark Dataframe to pandas Dataframe?
May 7, 2020
in
Apache Spark
by
akhtar
•
38,120
points
•
4,186
views
machine-learning
apache-spark
big-data
spark-dataframe
spark-sql
pandas
0
votes
1
answer
Exception in thread "main" java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: ${system:java.io.tmpdir%7D/$%7Bsystem:user.name%7D
Feb 5, 2020
in
Big Data Hadoop
by
akhtar
•
38,120
points
•
2,153
views
big-data
hadoop
apache-hive
hive-metastore
spark
spark-sql
apache-spark
0
votes
1
answer
What are Dstreams?
Feb 4, 2020
in
Apache Spark
by
akhtar
•
38,120
points
•
116
views
apache-spark
big-data
spark-dataframe
spark-sql
dstreams
spark
streaming
+1
vote
1
answer
How to assign a column in Spark Dataframe (PySpark) as a Primary Key?
Jan 8, 2020
in
Apache Spark
by
anonymous
•
150
points
•
2,315
views
pyspark
spark-dataframe
spark-sql
apache-spark
big-data
python
+1
vote
1
answer
Is there any efficient way of dealing null values during concat functionality of pyspark.sql version 2.3.4?
Nov 5, 2019
in
Apache Spark
by
aizhar
•
130
points
•
9,051
views
apache-spark
big-data
spark
spark-sql
spark-dataframe
pyspark
+1
vote
1
answer
Cannot resolve Error In Spark when filter records with two where condition
Sep 30, 2019
in
Apache Spark
by
anonymous
•
130
points
•
907
views
apache-spark
big-data
spark-sql
spark-dataframe
+1
vote
2
answers
Spark: Can we add column to dataframe?
Aug 9, 2019
in
Apache Spark
by
Chirag
•
2,407
views
spark-dataframe
spark-sql
apache-spark
big-data
+1
vote
1
answer
Reading a text file through spark data frame
Jul 24, 2019
in
Apache Spark
by
Kiran
•
18,181
views
apache-spark
big-data
spark-dataframe
spark-sql
0
votes
1
answer
Spark Vs Hive LLAP Question
Jul 16, 2019
in
Big Data Hadoop
by
Vishnu
•
2,053
views
big-data
apache-spark
hadoop
spark-sql
llap
0
votes
1
answer
Scala join comma delimited file as tables
Jul 9, 2019
in
Apache Spark
by
Lohit
•
184
views
apache-spark
big-data
spark-dataframe
spark-sql
apache-scala
0
votes
1
answer
How to create dataframe for the comma delimited file?
Jul 5, 2019
in
Apache Spark
by
Yogi
•
938
views
spark-dataframe
spark-sql
apache-spark
big-data
0
votes
1
answer
How to find the number of null contain in dataframe?
May 3, 2019
in
Apache Spark
by
anonymous
•
120
points
•
1,183
views
apache-spark
big-data
spark-dataframe
spark-sql
+1
vote
2
answers
How do I get number of columns in each line from a delimited file??
Mar 8, 2019
in
Apache Spark
by
Vijay Dixon
•
190
points
•
2,243
views
apache-spark
big-data
spark
spark-dataframe
spark-sql
scala
hadoop
0
votes
1
answer
How to convert Spark data into CSV?
Nov 21, 2018
in
Big Data Hadoop
by
digger
•
26,700
points
•
1,760
views
big-data
hadoop
spark-dataframe
spark-sql
apache-spark
csv-file
+1
vote
2
answers
How can I convert Spark Dataframe to Spark RDD?
Jul 4, 2018
in
Apache Spark
by
code799
•
10,858
views
spark
spark-dataframe
spark-sql
apache-spark
big-data
rdd
bigdata
0
votes
3
answers
Sorting rows in descending order in Spark SQL
Jul 4, 2018
in
Apache Spark
by
code799
•
13,987
views
spark
bigdata
spark-dataframe
spark-sql
apache-spark
big-data
+2
votes
13
answers
How to create new column with function in Spark Dataframe?
Jun 26, 2018
in
Apache Spark
by
coldcode
•
2,080
points
•
63,189
views
spark
developer
spark-dataframe
spark-sql
apache-spark
big-data
0
votes
1
answer
Minimizing Data Transfers in Spark
Jun 19, 2018
in
Apache Spark
by
shams
•
3,660
points
•
362
views
spark
developer
bigdata
spark-dataframe
spark-sql
apache-spark
big-data
0
votes
1
answer
How to find the number of elements present in the array in a Spark DataFame column?
Jun 5, 2018
in
Apache Spark
by
code799
•
13,108
views
bigdata
spark
spark-dataframe
spark-sql
apache-spark
big-data
0
votes
3
answers
Filtering a row in Spark DataFrame based on matching values from a list
Jun 5, 2018
in
Apache Spark
by
code799
•
71,688
views
spark
bigdata
spark-dataframe
spark-sql
apache-spark
big-data
0
votes
1
answer
Convert the given Spar rdd object to Spark DataFrame.
Jun 5, 2018
in
Apache Spark
by
code799
•
298
views
spark
bigdata
spark-dataframe
spark-sql
apache-spark
big-data
rdd
0
votes
1
answer
Different Spark Ecosystem
Jun 4, 2018
in
Apache Spark
by
shams
•
3,660
points
•
196
views
spark
bigdata
spark-dataframe
spark-sql
apache-spark
big-data
developer
ecosystem
+1
vote
8
answers
How to replace null values in Spark DataFrame?
May 31, 2018
in
Apache Spark
by
kurt_cobain
•
9,390
points
•
52,753
views
spark
spark-dataframe
spark-sql
apache-spark
big-data
developer
0
votes
1
answer
What is Spark Piping?
May 31, 2018
in
Apache Spark
by
Data_Nerd
•
2,390
points
•
1,088
views
spark
spark-dataframe
spark-sql
apache-spark
big-data
0
votes
1
answer
How to convert rdd object to dataframe in spark
May 30, 2018
in
Apache Spark
by
Shubham
•
13,460
points
•
2,739
views
spark
spark-dataframe
spark-sql
apache-spark
big-data
developer
0
votes
3
answers
How to transpose Spark DataFrame?
May 24, 2018
in
Apache Spark
by
anonymous
•
13,964
views
spark
bigdata
scala
transpose
spark-dataframe
spark-sql
apache-spark
big-data
0
votes
2
answers
In a Spark DataFrame how can I flatten the struct?
May 24, 2018
in
Apache Spark
by
code799
•
3,351
views
spark
big-data
spark-dataframe
spark-sql
apache-spark
flatten
0
votes
3
answers
How to connect Spark to a remote Hive server?
May 16, 2018
in
Big Data Hadoop
by
code799
•
4,762
views
spark
hive
bigdata
spark-dataframe
spark-sql
apache-spark
big-data
+2
votes
4
answers
use length function in substring in spark
May 3, 2018
in
Apache Spark
by
Data_Nerd
•
2,390
points
•
31,217
views
spark-dataframe
spark-sql
apache-spark
big-data
Most popular tags
devops
devops-tools
python
big-data
amazon-web-services
hadoop
python-programming
selenium
blockchain
html
All categories
Apache Kafka
(83)
Apache Spark
(598)
Big Data Hadoop
(1,860)
Blockchain
(1,513)
Career Counselling
(1,058)
Cloud Computing
(3,096)
Cyber Security & Ethical Hacking
(90)
Data Analytics
(1,196)
Database
(270)
DevOps & Agile
(3,094)
Events & Trending Topics
(27)
IoT (Internet of Things)
(361)
Java
(968)
Linux Administration
(234)
Machine Learning
(173)
MicroStrategy
(5)
PMP
(367)
Power BI
(460)
Python
(2,948)
RPA
(648)
Selenium
(1,550)
Software Testing
(54)
Tableau
(474)
Talend
(73)
Web Development
(1,457)
Ask us Anything!
(62)
Others
(302)
×
Join the world's most active Tech Community!
Welcome back to the World's most active Tech Community!
Sign up with Gmail
Sign up with Facebook
OR
Please provide a valid input
SIGN UP
Already have an Edureka Account?
Login
Please enter a valid emailid
Forgot Password?
LOGIN
Don’t have edureka account?
Sign Up
resend ?
reset password
Don’t have edureka account?
Sign Up
reset password
Don’t have edureka account?
Sign Up
Send Code
Don’t have edureka account?
Sign Up
Subscribe to our Newsletter, and get personalized recommendations.
Sign up with Google
Signup with Facebook
Already have an account?
Sign in
.
×