Com.databricks.spark.avro package is unavailable

Technical Discussions Spark SQL, DataFrames and Datasets
#1

I’m trying to save the Data frame results as avro file, but noticed that com.databricks.spark.avro package is unavailable.
Trying to run the below commands, that requires spark avro packages

import com.databricks.spark.avro._;
sqlContext.setConf(“spark.sql.avro.compression.codec”,“snappy”)
dataFrameResult.write.avro("/user/cloudera/problem2/products/result-df");
sqlResult.write.avro("/user/cloudera/problem2/products/result-sql");
rddResult.toDF().write.avro("/user/cloudera/problem2/products/result-rdd");;

#2

Hi @SEKHAR_CHERUKUPALLI,

Can you please let me know which Spark version are you using and what error are you getting?

Thanks

#3

Hi,
I am using spark 1.5.2
Getting this error

scala> import com.databricks.spark.avro.;
:19: error: object databricks is not a member of package com
import com.databricks.spark.avro.;