you basically have to keep your versions of dependencies in line with sparks or shade your own dependencies.
you cannot just replace the jars in sparks jars folder. if you wan to update them you have to build spark yourself with updated dependencies and confirm it compiles, passes tests etc. On Tue, Jan 31, 2017 at 3:40 AM, Sidney Feiner <sidney.fei...@startapp.com> wrote: > Hey, > > While migrating to Spark 2.X from 1.6, I've had many issues with jars that > come preloaded with Spark in the "jars/" directory and I had to shade most > of my packages. > > Can I replace the jars in this folder to more up to date versions? Are > those jar used for anything internal in Spark which means I can't blindly > replace them? > > > > Thanks J > > > > > > *Sidney Feiner* */* SW Developer > > M: +972.528197720 <+972%2052-819-7720> */* Skype: sidney.feiner.startapp > > > > [image: StartApp] <http://www.startapp.com/> > > > [image: Meet Us at] <http://www.startapp.com/press/#events_press> >
