Re: JSON lib works differently in spark-shell and IDE like intellij

It will work with spark-submit, if putting the configuration, which is addressed below, under the maven-shade-plugin. net.minidev shaded.net.minidev Still, need a way to make it work with spark-shell for testing purpose. Any idea will be grate. Thank you. On Wed,

JSON lib works differently in spark-shell and IDE like intellij

Hello, I am using "minidev" which is a JSON lib to remove duplicated keys in JSON object. minidev net.minidev json-smart 2.3 Test Code import net.minidev.json.parser.JSONParser val badJson =