Spark sql creating dataframe

Rupesh_Kumar · June 14, 2018, 10:12am

Hi ,
I am not bale to create dataframe from AVRO file, In spark shell, I used ("com.databricks.spark.avro)

command:-
val Datafile=spark.read.format(“com.databricks.spark.avro”).load("/user/kumarrupesh2389619/problem5/avro/part-m-00000.avro")

abhinav · June 17, 2018, 5:54pm

What error are you getting?

Rupesh_Kumar · June 25, 2018, 12:28pm

i was not bale to create VARO dataframe in spark 1.6 but when i used same in SPARK 2.0 it workd.

abhinavsingh · July 13, 2018, 3:19am

May be Avro JAR is not present in Spark 1.6. What error did you get when you ran above code?

While launching Spark 1.6 shell, you can pass appropriate JARs required for your work.