score:0

Accepted answer

i have finally been able to figure this one out. the root cause was that an older version of hadoop-core was being pulled in (1.2.1 instead of 2.6.5), which does in fact not have the configuration.getpassword() method. i found this out after setting up a test project where the sparkcontext was initialized correctly and then checking the source jars of the two configuration classes in the two projects (using configuration.class.getprotectiondomain().getcodesource().getlocation().getpath()).

after forcing version 2.6.5 using maven's dependency management and after manually deleting the older 1.2.1 jar from the local maven repo, it work fine.

the only thing that i still don't understand is why the hadoop-core was not showing up in the maven dependency tree. otherwise, i would have found sooner (probably).


Related Query

More Query from same tag