Hi, I was talking about the "jars" folder under a local spark installation. We can chat more on the PR you opened.
>I have one more doubt, why does this issue come up in only TestHoodieDeltaStreamer class? For tests, it should not. I am able to run from IntelliJ fine.. we should explore if you can reproduce this easily On Wed, Dec 4, 2019 at 6:13 AM Pratyaksh Sharma <[email protected]> wrote: > https://jira.apache.org/jira/browse/HUDI-380 tracks this. > > On Tue, Dec 3, 2019 at 12:11 PM Pratyaksh Sharma <[email protected]> > wrote: > > > @Vinoth Chandar <[email protected]> > > > > Just to ensure we are on the same page, which spark jars are you > referring > > to exactly (which you add to the class path in Intellij like you > mentioned > > in GitHub issue 894)? > > > > I have one more doubt, why does this issue come up in only > > TestHoodieDeltaStreamer class? We are running spark job in other test > cases > > also. > > > > Regarding the usability jira and documentation changes, I will take care > > of that. :) > > > > On Tue, Dec 3, 2019 at 1:08 AM Vinoth Chandar <[email protected]> wrote: > > > >> https://github.com/apache/incubator-hudi/issues/894. is also a IDE > >> related > >> issue.. May be worth opening a usability JIRA ? > >> > >> On Mon, Dec 2, 2019 at 10:53 AM Vinoth Chandar <[email protected]> > wrote: > >> > >> > FWIW I add spark jars as dependency to the hudi module, I am running > and > >> > move it to the top of the list (so it resolves first). > >> > Then I don't see the netty issue anymore.. > >> > > >> > This is something worth documenting here? > >> > https://hudi.apache.org/contributing.html#ide-setup > >> > > >> > On Sat, Nov 30, 2019 at 4:05 AM Pratyaksh Sharma < > [email protected] > >> > > >> > wrote: > >> > > >> >> I am using Intellij IDE for the same. > >> >> > >> >> On Sat, Nov 30, 2019, 10:06 AM lamberken <[email protected]> wrote: > >> >> > >> >> > > >> >> > Right, I think your analysis is right. BTW, how do you run the > >> >> > TestHoodieDeltaStreamer tests? in IDE or other ways. > >> >> > > >> >> > > >> >> > At 2019-11-29 23:38:54, "Pratyaksh Sharma" <[email protected]> > >> >> wrote: > >> >> > >Looks like jetty version was causing an issue for me. Fixed the > >> same by > >> >> > >excluding jetty-util artifact from hudi-client dependency in > >> >> > hudi-utilities > >> >> > >pom. > >> >> > > > >> >> > >In version 9.4.15, Container class is an interface while in lower > >> >> version > >> >> > >7.6.0, it is a class. This conflict of versions was causing > >> mentioned > >> >> > >exception for me. > >> >> > > > >> >> > >On Fri, Nov 29, 2019 at 5:37 PM Pratyaksh Sharma < > >> >> [email protected]> > >> >> > >wrote: > >> >> > > > >> >> > >> Hi Lamberken, > >> >> > >> > >> >> > >> Here are the details - > >> >> > >> > >> >> > >> MacOS Mojave version 10.14.6 > >> >> > >> Java version - 1.8.0_212 > >> >> > >> Docker version - 19.03.5 > >> >> > >> > >> >> > >> Please let me know if anything else is needed. > >> >> > >> > >> >> > >> On Fri, Nov 29, 2019 at 5:21 PM lamberken <[email protected]> > >> wrote: > >> >> > >> > >> >> > >>> > >> >> > >>> > >> >> > >>> Hi, Pratyaksh Sharma > >> >> > >>> > >> >> > >>> > >> >> > >>> In order to solve the problem better, please provides the > running > >> >> > >>> environment. > >> >> > >>> For example, what is your operating system or the java version > >> and > >> >> so > >> >> > on. > >> >> > >>> thanks > >> >> > >>> > >> >> > >>> > >> >> > >>> > >> >> > >>> > >> >> > >>> > >> >> > >>> > >> >> > >>> > >> >> > >>> > >> >> > >>> > >> >> > >>> > >> >> > >>> > >> >> > >>> At 2019-11-29 18:15:45, "Pratyaksh Sharma" < > >> [email protected]> > >> >> > wrote: > >> >> > >>> >Hi, > >> >> > >>> > > >> >> > >>> >Every time I try to run test cases of TestHoodieDeltaStreamer > >> class > >> >> > >>> >individually, I get the following error - > >> >> > >>> > > >> >> > >>> >java.lang.InstantiationError: > >> >> > org.eclipse.jetty.util.component.Container > >> >> > >>> > > >> >> > >>> >at org.eclipse.jetty.server.Server.<init>(Server.java:66) > >> >> > >>> >at org.apache.hive.http.HttpServer.<init>(HttpServer.java:98) > >> >> > >>> >at org.apache.hive.http.HttpServer.<init>(HttpServer.java:80) > >> >> > >>> >at > >> >> org.apache.hive.http.HttpServer$Builder.build(HttpServer.java:133) > >> >> > >>> >at > >> >> > > org.apache.hive.service.server.HiveServer2.init(HiveServer2.java:227) > >> >> > >>> >at > >> >> > >>> > >> >> > >>> > >> >> > > >> >> > >> > >org.apache.hudi.hive.util.HiveTestService.startHiveServer(HiveTestService.java:214) > >> >> > >>> >at > >> >> > >>> > >> >> > > >> >> > >> > org.apache.hudi.hive.util.HiveTestService.start(HiveTestService.java:106) > >> >> > >>> >at > >> >> > >>> > >> >> > >>> > >> >> > > >> >> > >> > >org.apache.hudi.utilities.UtilitiesTestBase.initClass(UtilitiesTestBase.java:88) > >> >> > >>> >at > >> >> > >>> > >> >> > >>> > >> >> > > >> >> > >> > >org.apache.hudi.utilities.TestHoodieDeltaStreamer.initClass(TestHoodieDeltaStreamer.java:91) > >> >> > >>> > > >> >> > >>> >All other test cases run fine. If I try to run using the > command > >> >> man > >> >> > >>> clean > >> >> > >>> >install -DskipITs, everything seems to be fine. > >> >> > >>> > > >> >> > >>> >Has anyone faced a similar issue? > >> >> > >>> > >> >> > >> > >> >> > > >> >> > >> > > >> > > >
