Re: Re: Error when running TestHoodieDeltaStreamer

2019-12-02 Thread Pratyaksh Sharma
@Vinoth Chandar Just to ensure we are on the same page, which spark jars are you referring to exactly (which you add to the class path in Intellij like you mentioned in GitHub issue 894)? I have one more doubt, why does this issue come up in only TestHoodieDeltaStreamer class? We are running

Re: [DISCUSS] Introduce stricter comment and code style validation rules

2019-12-02 Thread Vinoth Chandar
Hi Nicholas, Sorry for the late reply. Thanksgiving :) >>Now Hudi's design, in order to highlight its core components, is a patchwork of the Spark RDD API mixed with business logic scattered in multiple modules and various types of methods. Agree that the hudi-client module needs to be

Re: Re: Error when running TestHoodieDeltaStreamer

2019-12-02 Thread Vinoth Chandar
https://github.com/apache/incubator-hudi/issues/894. is also a IDE related issue.. May be worth opening a usability JIRA ? On Mon, Dec 2, 2019 at 10:53 AM Vinoth Chandar wrote: > FWIW I add spark jars as dependency to the hudi module, I am running and > move it to the top of the list (so it

Re: Re: Error when running TestHoodieDeltaStreamer

2019-12-02 Thread Vinoth Chandar
FWIW I add spark jars as dependency to the hudi module, I am running and move it to the top of the list (so it resolves first). Then I don't see the netty issue anymore.. This is something worth documenting here? https://hudi.apache.org/contributing.html#ide-setup On Sat, Nov 30, 2019 at 4:05 AM