Spark Temp Table from CSV

Technical Discussions Apache Spark
#1

Create an spark temp table with spark session from CSV file with no headers

#2

Hi @krishnakanth_Boyina

Just curious if you have tried creating it on your own? If yes then please let me know if you are facing any issue.

Thanks

#3

StructType schema = new StructType().add("name", StringType)add("starttstamp", StringType).add("endtstamp", StringType);
Dataset<Row> df = sparkSession.read().schema(schema).option("delimiter", "|").option("inferSchema", "true").csv("sample.csv");

How do i convert the **starttstamp** column to date of format of yyyyMMdd

Boyina|201709050000|201709060000 > csv