how to resolve this error

[saisasank_gadiparthi]

org.apache.spark.sql.AnalysisException: Failed to find data source: com.databricks.spark.avro. Please find an Avro package at http://spark.apache.org/third-party-projects
.html;

[sgiri]

Please see this discussion on how to use various formats in spark dataframes using pyspark.

Learning Dataframes using pyspark in Jupyter

Hi Friends, i have put together a jupyter notebook to learn the DataFrames in pyspark in our git repository inside the folder spark/python. Please follow these steps to get started with it. Login to console using either WebConsole, Jupyter terminal (New -> Terminal) or ssh/putty. Clone the repository: https://github.com/cloudxlab/bigdata.git If you had already cloned, update it using: cd bigdata; git pull Now, go to Jupyter and navigate to spark/python Open the notebook with name: pyspark_d…