Skip to main content

All Questions

0 votes
1 answer
152 views

Why spark-shell throws NoSuchMethodException while calling newInstance via reflection

spark-shell throws NoSuchMethodException if I define a class in REPL and then call newInstance via reflection. Spark context available as 'sc' (master = yarn, app id = application_1656488084960_0162). ...
核心力量's user avatar
1 vote
1 answer
527 views

Spark adds hidden parameter to constructor of a Scala class

I do not know how to explain this, but Spark seems to add a hidden (implicit?) parameter to constructor. Here is code I tried in spark-shell (in regular Scala shell parameters list would be empty): ...
abufct's user avatar
  • 71