score:3
Earlier I specified dependency for spark-streaming_2.10 ( Spark compiled with Scala 2.10). I did not specify dependency for Scala compiler itself. It seems Maven automatically pulled 2.11 (Maybe due to some other dependency). When trying to debug this issue, I added a dependency on Scala compiler 2.11. Now after Paul's comment I changed that Scala dependency version to 2.10 and it is working.
Source: stackoverflow.com
Related Query
- NoSuchMethodError while running Spark Streaming job on HDP 2.2
- 'Connection Refused' error while running Spark Streaming on local machine
- Serialization issue when running Spark Streaming job
- why Tasks idle for sometime while running Spark job
- Why does running Spark job fail to find classes inside uberjar on EMR while it works locally fine?
- Exceptions while running Spark job on EMR cluster "java.io.IOException: All datanodes are bad"
- GC error while running spark job
- "sparkContext was shut down" while running spark on a large dataset
- Running a Job on Spark 0.9.0 throws error
- Error in running job on Spark 1.4.0 with Jackson module with ScalaObjectMapper
- How can I obtain the DAG of an Apache Spark job without running it?
- NoSuchMethodError while running Scalatest
- Spark job running out of heap memory on takeSample
- Spark job SBT Assembly merge conflict when including Spark Streaming Kinesis ASL library
- Spark job fails while filtering kafka messages
- Spark Structured Streaming writestream doesn't write file until I stop the job
- Am getting error in scala programming while integrating spark streaming with kafka
- Kafka + spark streaming : Multi topic processing in single job
- Getting NullPointerException when running Spark job with naive Bayes implementation
- NoClassDefFoundError: org/apache/spark/sql/SparkSession$ while running spark source code locally
- How can I set alert of spark streaming job if no records are being pushed in last 1 hour?
- Invoking a utility(external) inside Spark streaming job
- SBT : Running Spark job on remote cluster from sbt
- Running in "deadlock" while doing streaming aggregations from Kafka
- IllegalAccessError when running spark job in EMR
- Running spark job on yarn using remote SparkContext: Yarn application has already ended
- Running spark job in parallel
- How to build a fat jar for running a spark job on EMR?
- Getting Hadoop OutputFormat RunTimeException while running Apache Spark Kafka Stream
- In a scala spark job, running in yarn, how can I fail the job so that yarn shows a Failed status
More Query from same tag
- Unable to stub a Class with overloaded constructors - Scalamock
- spray-cache: cache only when not None
- Error while posting data from angular js form
- How can I stream/chunk database results asynchronously?
- Scala case class, can't override constructor parameter
- How to create variables with macros in Scala
- sbt: How to run integration test
- Stream Html to the browser when Future completes
- What's the advantage of using Macros (instead of functions) is Scala?
- Using cors across two independently running local apps
- IntelliJ IDEA consuming lots of CPU
- lg g3 doesn't use image from yyyhdpi if there are alternatives — as a result, image is blurred
- Why does an implicit with a map yield a Range statement error?
- Logging within Akka TestKit outside Actors
- Akka Actor Setup: In Main method or in 'Manager' class?
- String formatting with maximum number of digits
- Http4s circe can not decode children
- Scala Spark creating a new column in the dataframe based on the aggregate count of values in another column
- How to embed Play 2.6 using Akka HTTP Server?
- How do I create mock if my trait uses self-type restriction?
- RandomForestClassifier was given input with invalid label column error in Apache Spark
- How to map shapeless HList after zipWithIndex?
- Scala's collection's sliding() is inconsistent when the window size is greater than step
- Flattening Future[EitherT[Future, A, B]]
- Case classes in Scala Swing
- Why can't the first parameter list of a class be implicit?
- String diffs as List
- `then` on Kleisli's of Different Input Types?
- Play 2 scala route controller bytecode is not the same as all the other bytecode
- How do you set the column width of a Scala Swing Table
