Hi Team,
As I want to practice on Avro data file but I am unable to add below package, it seems there is no Spark Avro Databricks library was added into spark.
If you know another way to work with Avro please guide me.
Thank you
Are you using it via spark-shell or jupyter?
try this.
spark-shell --packages com.databricks:spark-avro_2.10:2.0.1 --master yarn --conf spark.ui.port=11111
1 Like
Yeah i am using spark-shell
Kranthi’s answer above is right.