score:3
Accepted answer
i can only make an assumption as the code listed is missing pieces, but my guess is that bartistalias
is supposed to be a map
that should be broadcast, but isnt.
i went and found the piece of code in sandy's book and it corroborates my guess. so, you seem to be missing this piece:
val bartistalias = sc.broadcast(artistalias)
i am not even sure what you did without the code, but it looks like you broadcast an rdd[string], thus the error.....this would not even work anyway as you cannot work with another rdd inside of an rdd
Source: stackoverflow.com
Related Query
- getOrElse method not being found in Scala Spark
- reduceByKey method not being found in Scala Spark
- Spark Scala Error - Error: Main method not found in class
- reduceByKey method not being found in IntelliJ
- Spark Scala getting class not found scala.Any
- Scala IDE Error: Main method not found in class 'hello'
- Apache Spark method not found sun.nio.ch.DirectBuffer.cleaner()Lsun/misc/Cleaner;
- @Test method in Scala trait not found
- MongoDBObject not being added to inside of an rrd foreach loop casbah scala apache spark
- scala spark - do not throw exception in retry method
- Error in running Scala Program: Main method not found in class main, please define the main method
- Spark Scala year/month function error: not found
- Scala method not being invoked
- error: not enough arguments for method withColumn: Scala spark
- Error not found value in Spark Scala
- main class not found in spark scala program
- spark scala : jnibasedunixgroupsmapping: error getting groups for yyy: the user name could not be found
- Spark Scala Flumeutill not found
- I'm not able to call classes from scala AST. The classes are not being found
- ubuntu scala ide - spark - toDF Method error value toDF is not a member of org.apache.spark.rdd.RDD[String]
- scala slick method I can not understand so far
- IntelliJ Bug: Scala 145, Error:scalac: Scala compiler JARs not found
- Scala Compiler not found in Intellij IDEA 11 with Play 2.0 project
- Scala unexpectedly not being able to ascertain type for expanded function
- Spark - "sbt package" - "value $ is not a member of StringContext" - Missing Scala plugin?
- After installing Scala using MacPorts, scala command is not found
- spark error RDD type not found when creating RDD
- Scala Spark contains vs. does not contain
- java.lang.NoClassDefFoundError: Could not initialize class when launching spark job via spark-submit in scala code
- object scala in compiler mirror not found - running Scala compiler programmatically
More Query from same tag
- What are the mandatory options for loading Excel file?
- ScalaCheck: Gen.choose outputting values beyond a specified range
- load csv file in sql table using scala
- Gatling feeder through the iteration over a map
- How to write a symmetric Play Json formatter for a case class with one field in scala?
- PartialFunction accepting Unit
- Strange compiler error: found Unit, where I try to return a Double
- Creating and array from a txt file using spark shell, scala in particular
- How to externally populate play! model
- Extend case class with typeclass
- not enough arguments for method toArray
- Initialize data in Mem (Chisel)
- How to dynamically return objects based on conditions in Scala?
- How to pass results from one source stream to another
- Play-Framework: Cannot parse parameter companyId as BSONObjectID: wrong ObjectId
- On replacing JavaConversions with JavaConverters
- What's the *right* way to handle a POST in FP?
- Filtering Flink datastream to optional sub-object in Scala
- Scala Spark IntelliJ Idea development process
- Path Dependent Types example doesn't work
- Spark performs task with not enough parallelism
- How to load data into hive external table using spark?
- Play/Scala: use orElse to compose with ActionBuilder?
- External table from current date directory
- filter on data which are numeric
- Scala + Android IDE
- writing script in scala to join two mysql tables and create one object (quill)
- Apache Spark SQL get_json_object java.lang.String cannot be cast to org.apache.spark.unsafe.types.UTF8String
- List[EitherT[Future, A, B]] to EitherT[Future, A, List[B]] with cats
- Is it possible in Play 2.1 to convert a JsValue to a case class instance if you only know the name of the case class at the runtime?