|
About the Spark SQL, DataFrames and Datasets category
|
|
0
|
1002
|
May 17, 2017
|
|
Cannot resolve column name in given input columns in pyspark dataframe error
|
|
3
|
33411
|
March 17, 2022
|
|
Unable to load mysql table to spark Dataframe
|
|
1
|
1774
|
April 8, 2021
|
|
java.lang.ClassNotFoundException: Failed to find data source: textFile
|
|
1
|
2327
|
April 7, 2021
|
|
COALESCE, REPARTITION, and REPARTITION_BY_RANGE
|
|
3
|
1689
|
November 5, 2020
|
|
Unable to set ORC stripe size, small file issue
|
|
0
|
868
|
June 21, 2020
|
|
Load two CSV files and join them and load into hive table
|
|
0
|
753
|
June 13, 2020
|
|
Broadcast variable in spark
|
|
2
|
1308
|
June 11, 2020
|
|
Spark context vs Spark session
|
|
1
|
1028
|
March 25, 2020
|
|
Learning Dataframes using pyspark in Jupyter
|
|
0
|
1201
|
August 26, 2019
|
|
How to read avro file in linux
|
|
0
|
954
|
July 11, 2019
|
|
Spark SQL command error
|
|
0
|
970
|
June 27, 2019
|
|
Getting Issue - Caused by: java.net.ConnectException
|
|
1
|
1186
|
July 12, 2018
|
|
How to create the Dataframe for MYsql table
|
|
2
|
4977
|
May 30, 2018
|
|
Spark SQL ODBC Driver Setup
|
|
1
|
1572
|
March 10, 2018
|
|
Com.databricks.spark.avro package is unavailable
|
|
2
|
1857
|
March 7, 2018
|
|
org.apache.spark.SparkException: Job aborted due to stage failure: Task 1 in stage 53.0 failed 4 times,
|
|
2
|
3854
|
February 19, 2018
|
|
Failed to save data to CSV
|
|
2
|
3423
|
October 9, 2017
|
|
PySpark - Running on Yarn mode in Jupyter
|
|
2
|
2252
|
November 12, 2017
|
|
Change of DF column type of string to date
|
|
3
|
9505
|
September 22, 2017
|
