score:1
the most recent version of the emr at this time (may 2019) is 5.23.0 and it still uses spark 2.4.0 (https://docs.aws.amazon.com/emr/latest/releaseguide/emr-release-5x.html#emr-5200-release)
https://spark.apache.org/docs/2.4.0/ :
spark runs on java 8+, python 2.7+/3.4+ and r 3.1+. for the scala api, spark 2.4.0 uses scala 2.11. you will need to use a compatible scala version (2.11.x).
i believe non-experimental support for scala 2.12.x is only added in spark 2.4.3, which is not yet available on emr: https://spark.apache.org/docs/2.4.3/ :
spark runs on java 8+, python 2.7+/3.4+ and r 3.1+. for the scala api, spark 2.4.3 uses scala 2.12. you will need to use a compatible scala version (2.12.x).
score:3
Source: stackoverflow.com
Related Query
- EMR always gives me Class Not Found for Scala app
- Playframework [Scala]: Class not found in classpath in Play for Scala
- scala Duration: "This class is not meant as a general purpose representation of time, it is optimized for the needs of scala.concurrent."
- Scala deserialization: class not found
- Spark Scala getting class not found scala.Any
- Scala IDE Error: Main method not found in class 'hello'
- Existing data for tests is not found Scala Specs2
- Compiler Error : com.sun.tools.javac.code.Symbol$CompletionFailure: class file for akka.actor.SupervisorStrategy$1 not found
- Scala Main Class not found in Eclipse ide
- Data Structures and Algorithms book in Java 5 or 6 or Scala for programmers and not a CS class textbook
- Alternate constructor on Scala case class not defined: not enough arguments for method
- Class file for android.support.v4.widget.DrawerLayout not found - Intellij (UI 14.141.1192.2)
- Write an Arbitrary Value Not Found in a Case Class Using Play's (2.2) Scala JSON Combinators
- Playframework, scala case class and property not found
- Test Class Not Found when Unit Testing on Scala
- How to iterate on scala class members for found null value
- Config key not found : Where does typesafe ConfigFactory.load look for config files in a scala multi-project?
- Can't find ScalaSig for class - json4s with scala + proguard for an android app
- Value not found error when trying to use type aliasing for Set in scala
- Scala is not creating private constructor for companion class
- Installing Ensime for Scala Development on emacs: sbt.ResolveException: unresolved dependency: org.ensime#ensime-sbtt-cmd;0.12: not found
- Provided implicit reader/writer for case class not found
- Implicit type class defined for Map not found for a SortedMap
- Scala class not found on classpath when specifying jar in classpath
- Scala:No suitable constructor found for type [simple type, class Thing]: can not instantiate from JSON object
- Scala macro expansion of class with companion: type not found
- When using the gson library for converting a Scala class to a string, UTF-8 characters are not escaped
- 404 Resource Not Found for Static Assets in Play App
- class not found error - scala
- Error in running Scala Program: Main method not found in class main, please define the main method
More Query from same tag
- for comprehension fails when using an intermediate variable
- Spark Scala Method Signature in DataFrame API
- substituting xml values programmatically with scala
- From Java multithreading to Scala Akka actors
- play 2: "reference to form is ambiguous" error message in template
- `++` - Operator on two Arrays returns ArraySeq when using type parameters
- What does $( ) mean in Scala?
- How to find the largest element in a list of integers recursively?
- Do all futures need to be waited on to guarantee their execution?
- Scala function definition vs application
- Combining multiple structs into single struct in Spark SQL
- SBT jsDependency file name trouble
- akka system - best practice to execute common logic between actors
- Getting a Scala interpreter to work
- metastore_db doesn't get created with apache spark 2.2.1 in windows 7
- Play Framework 2.1.2 internationalization doesn't work with Finnish characters
- How i get Boolean From a Future[Settings]
- How to group top item from a JavaRDD without using Spark SQL?
- How to compare a dataframe with List of Lists in scala
- Build Shapeless implicit in the function
- Joining RDD leftOuterJoin - error: type mismatch
- Scala-Chart histrogram with multiple bars per bin
- F-Bound Polymorphism with Abstract Types instead of Parameter Types?
- Basic new dotty project instructions fail with "invalid privatekey", how to fix?
- Akka actor infinite loop
- Matching groups with lookahead expression
- Spark dataframe last object in a group
- Left join of columns with different datatypes in Slick
- Scala - object X is not member of package Y
- Extract ClassSymbols for method's parameter bounds