Technical Discussions Apache Spark

Unable to write data into Hive using Structured Streaming (4)

Unable to reach spark history server UI (3)

Spark version number for sbt file (2)

Unable to run jobs through spark-submit (3)

Nested JSON file (3)

Confusion regarding SparkContext and Sparksession (1)

reduceByKey is not a member of Array[(String, Int)] (1)

Scala IDE -simple saprk application (1)

Pyspark through jupyter (2)

Remove unicode characters in pyspark rdd and dataframes (1)

PySpark - Installing Python libraries in Cluster (10)

Spark-shell getting error during login (1)

Accessing Spark 2.2.1 web UI (2)

Spark2 Upgrade of the cluster (3)

Error while using scalax chart in scala spark shell ver 2.0.1 (2)

Unable to add libraries under Spark /usr/spark2.2.1/jars/ due to permissions restrictions (2)

Spark and Cassandra, and Spark with kafka Integration (1)

Default Classes in Apache Spark V 1.6 (2)

How to access a file in my hdfs from spark shell? (3)

How to split a dataframe of multiple files into smaller dataframes (by checking data row wise)? (2)

Eclipse for spark code (2)

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/spark/sql/SparkSessi (4)

Resource and cluster managers (2)

Port 4040 already in use (3)

Could not find or load main class org.apache.spark.deploy.yarn.ExecutorLauncher (1)

Pyspark SQL Error (1)

Spark - Project - Apache log parsing - Top 10 requested URLs (3)

Spark DAG creation (1)

Spark 2.2.1 error when running the commands from spark API documentation (2)

Spark process not able to create write file on HDFS , getting permission denied (1)