> On Jan. 16, 2015, 7:14 p.m., Xuefu Zhang wrote: > > One additional question for my understanding: > > > > Originally Hive has to poll to get job ID after submitting a spark job, in > > RemoteSparkJobStatus.getSparkJobInfo(). With this patch, do we still need > > to do this.
Yeah, that's still needed. I thought about adding a `onSparkJobStarted` callback or something. If there's interest in that I can add it, should be easy. > On Jan. 16, 2015, 7:14 p.m., Xuefu Zhang wrote: > > spark-client/src/main/java/org/apache/hive/spark/client/SparkClientImpl.java, > > line 442 > > <https://reviews.apache.org/r/29954/diff/1/?file=823288#file823288line442> > > > > This method, together with other existing handl() methods, are invoked > > using reflection, which makes the code hard to understand. I'm wondering if > > this can be improved. The alternative is having cascading `if..else if..else` blocks with a bunch of `instanceof` checks, as was done in the akka-based code before. I think that's much uglier and harder to read. - Marcelo ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29954/#review68430 ----------------------------------------------------------- On Jan. 16, 2015, 1:05 a.m., Marcelo Vanzin wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/29954/ > ----------------------------------------------------------- > > (Updated Jan. 16, 2015, 1:05 a.m.) > > > Review request for hive, Brock Noland, chengxiang li, and Xuefu Zhang. > > > Bugs: HIVE-9179 > https://issues.apache.org/jira/browse/HIVE-9179 > > > Repository: hive-git > > > Description > ------- > > HIVE-9179. Add listener API to JobHandle. > > > Diffs > ----- > > spark-client/pom.xml 77016df61a0bcbd94058bcbd2825c6c210a70e14 > spark-client/src/main/java/org/apache/hive/spark/client/BaseProtocol.java > f9c10b196ab47b5b4f4c0126ad455869ab68f0ca > spark-client/src/main/java/org/apache/hive/spark/client/JobHandle.java > e760ce35d92bedf4d301b08ec57d1c2dc37a39f0 > spark-client/src/main/java/org/apache/hive/spark/client/JobHandleImpl.java > 1b8feedb0b23aa7897dc6ac37ea5c0209e71d573 > spark-client/src/main/java/org/apache/hive/spark/client/RemoteDriver.java > 0d49ed3d9e33ca08d6a7526c1c434a0dd0a06a67 > > spark-client/src/main/java/org/apache/hive/spark/client/SparkClientImpl.java > a30d8cbbaae9d25b1cffdc286b546f549e439545 > spark-client/src/test/java/org/apache/hive/spark/client/TestJobHandle.java > PRE-CREATION > > spark-client/src/test/java/org/apache/hive/spark/client/TestSparkClient.java > 795d62c776cec5e9da2a24b7d40bc749a03186ab > > Diff: https://reviews.apache.org/r/29954/diff/ > > > Testing > ------- > > > Thanks, > > Marcelo Vanzin > >
