Re: [Question] Can't start Spark Connect
Additionally, try deleting the `.idea` in the spark home directory and restarting IntelliJ if it does not work properly after re-building during development. The .idea stores IntelliJ's project configuration and settings, and is automatically generated when IntelliJ is launched. >
Re: [Question] Can't start Spark Connect
Yeah, after executing `./build/mvn -DskipTests clean package ` on the command line, you may need to manually reload maven projects in intellij, otherwise intellij will not immediately respond to the command line behavior. Yang Jie 发件人: Lucifer Tyrant 日期: 2023年3月9日 星期四 00:11 收件人: Jia Fan 抄送: Herman van Hovell , Hyukjin Kwon , "dev@spark.apache.org" 主题: Re: [Question] Can't start Spark Connect It worked. Thank you for your guidance. Jia Fan mailto:fan...@apache.org>> 于2023年3月8日周三 22:38写道： Hi Herman, I just use ./build/mvn -DskipTests clean package, also had try to use ./build/mvn -DskipTests clean install. Herman van Hovell 于2023年3月8日周三 21:17写道： Hi Jia, How are you building connect? Kind regards, Herman On Wed, Mar 8, 2023 at 8:48 AM Jia Fan mailto:fan...@apache.org>> wrote: Thanks for reply, I had done clean build with maven few times. But always report /Users/xxx/Code/spark/core/target/generated-sources/org/apache/spark/status/protobuf/StoreTypes.java:658:9 java: symbol not found Symbol: class UnusedPrivateParameter Location: class org.apache.spark.status.protobuf.StoreTypes.JobData I think maybe it's protobuf version conflict? https://user-images.githubusercontent.com/32387433/223716946-85761a34-f86c-4ba1-9557-a59d0d5b9958.png<https://mailshield.baidu.com/check?q=SidJoMcixvn95yt28ggG9Um36qdwq6Y%2flT0198ypCSRr6UYhgHmOUEq5pcoKAkttDuBnvSSPJ6%2bp%2b0%2bUGja7oFKqKzySW0D%2fBV2mcG0%2fEozF7G%2fSJEz9p7BfNXiYQFvRgoOV1VxiKmNU%2bv1x>"> Hyukjin Kwon mailto:gurwls...@gmail.com>> 于2023年3月8日周三 19:09写道： Just doing a clean build with Maven, and running a test case like `SparkConnectServiceSuite` in IntelliJ should work. On Wed, 8 Mar 2023 at 15:02, Jia Fan mailto:fan...@apache.org>> wrote: Hi developers, I want to contribute some code for Spark Connect. Any doc for starters? I want to debug SimpleSparkConnectService but I can't start it with IDEA. I would appreciate any help. Thanks Jia Fan
Re: [Question] Can't start Spark Connect
It worked. Thank you for your guidance. Jia Fan 于2023年3月8日周三 22:38写道： > Hi Herman, > I just use ./build/mvn -DskipTests clean package, also had try to > use ./build/mvn -DskipTests clean install. > > Herman van Hovell 于2023年3月8日周三 21:17写道： > >> Hi Jia, >> >> How are you building connect? >> >> Kind regards, >> Herman >> >> On Wed, Mar 8, 2023 at 8:48 AM Jia Fan wrote: >> >>> Thanks for reply, >>> I had done clean build with maven few times. But always report >>> >>> /Users/xxx/Code/spark/core/target/generated-sources/org/apache/spark/status/protobuf/StoreTypes.java:658:9 >>> java: symbol not found >>>Symbol: class UnusedPrivateParameter >>>Location: class org.apache.spark.status.protobuf.StoreTypes.JobData >>>I think maybe it's protobuf version conflict? >>> https://user-images.githubusercontent.com/32387433/223716946-85761a34-f86c-4ba1-9557-a59d0d5b9958.png >>> "> >>> >>> >>> Hyukjin Kwon 于2023年3月8日周三 19:09写道： >>> Just doing a clean build with Maven, and running a test case like `SparkConnectServiceSuite` in IntelliJ should work. On Wed, 8 Mar 2023 at 15:02, Jia Fan wrote: > Hi developers, >I want to contribute some code for Spark Connect. Any doc for > starters? I want to debug SimpleSparkConnectService but I can't start it > with IDEA. I would appreciate any help. > > Thanks > > > > > Jia Fan >
Re: [Question] Can't start Spark Connect
Hi Herman, I just use ./build/mvn -DskipTests clean package, also had try to use ./build/mvn -DskipTests clean install. Herman van Hovell 于2023年3月8日周三 21:17写道： > Hi Jia, > > How are you building connect? > > Kind regards, > Herman > > On Wed, Mar 8, 2023 at 8:48 AM Jia Fan wrote: > >> Thanks for reply, >> I had done clean build with maven few times. But always report >> >> /Users/xxx/Code/spark/core/target/generated-sources/org/apache/spark/status/protobuf/StoreTypes.java:658:9 >> java: symbol not found >>Symbol: class UnusedPrivateParameter >>Location: class org.apache.spark.status.protobuf.StoreTypes.JobData >>I think maybe it's protobuf version conflict? >> https://user-images.githubusercontent.com/32387433/223716946-85761a34-f86c-4ba1-9557-a59d0d5b9958.png >> "> >> >> >> Hyukjin Kwon 于2023年3月8日周三 19:09写道： >> >>> Just doing a clean build with Maven, and running a test case like >>> `SparkConnectServiceSuite` in IntelliJ should work. >>> >>> On Wed, 8 Mar 2023 at 15:02, Jia Fan wrote: >>> Hi developers, I want to contribute some code for Spark Connect. Any doc for starters? I want to debug SimpleSparkConnectService but I can't start it with IDEA. I would appreciate any help. Thanks Jia Fan >>>
Re: [Question] Can't start Spark Connect
Hi Jia, How are you building connect? Kind regards, Herman On Wed, Mar 8, 2023 at 8:48 AM Jia Fan wrote: > Thanks for reply, > I had done clean build with maven few times. But always report > > /Users/xxx/Code/spark/core/target/generated-sources/org/apache/spark/status/protobuf/StoreTypes.java:658:9 > java: symbol not found >Symbol: class UnusedPrivateParameter >Location: class org.apache.spark.status.protobuf.StoreTypes.JobData >I think maybe it's protobuf version conflict? > https://user-images.githubusercontent.com/32387433/223716946-85761a34-f86c-4ba1-9557-a59d0d5b9958.png > "> > > > Hyukjin Kwon 于2023年3月8日周三 19:09写道： > >> Just doing a clean build with Maven, and running a test case like >> `SparkConnectServiceSuite` in IntelliJ should work. >> >> On Wed, 8 Mar 2023 at 15:02, Jia Fan wrote: >> >>> Hi developers, >>>I want to contribute some code for Spark Connect. Any doc for >>> starters? I want to debug SimpleSparkConnectService but I can't start it >>> with IDEA. I would appreciate any help. >>> >>> Thanks >>> >>> >>> >>> >>> Jia Fan >>> >>
Re: [Question] Can't start Spark Connect
Thanks for reply, I had done clean build with maven few times. But always report /Users/xxx/Code/spark/core/target/generated-sources/org/apache/spark/status/protobuf/StoreTypes.java:658:9 java: symbol not found Symbol: class UnusedPrivateParameter Location: class org.apache.spark.status.protobuf.StoreTypes.JobData I think maybe it's protobuf version conflict? https://user-images.githubusercontent.com/32387433/223716946-85761a34-f86c-4ba1-9557-a59d0d5b9958.png "> Hyukjin Kwon 于2023年3月8日周三 19:09写道： > Just doing a clean build with Maven, and running a test case like > `SparkConnectServiceSuite` in IntelliJ should work. > > On Wed, 8 Mar 2023 at 15:02, Jia Fan wrote: > >> Hi developers, >>I want to contribute some code for Spark Connect. Any doc for >> starters? I want to debug SimpleSparkConnectService but I can't start it >> with IDEA. I would appreciate any help. >> >> Thanks >> >> >> >> >> Jia Fan >> >
Re: [Question] Can't start Spark Connect
Just doing a clean build with Maven, and running a test case like `SparkConnectServiceSuite` in IntelliJ should work. On Wed, 8 Mar 2023 at 15:02, Jia Fan wrote: > Hi developers, >I want to contribute some code for Spark Connect. Any doc for starters? > I want to debug SimpleSparkConnectService but I can't start it with IDEA. I > would appreciate any help. > > Thanks > > > > > Jia Fan >
