[GitHub] spark issue #20383: [SPARK-23200] Reset Kubernetes-specific config on Checkp...

Github user ssaavedra commented on the issue: https://github.com/apache/spark/pull/20383 Sorry, I hadn't answered yet because it seems my patch does not work cleanly on 2.3. Many names were rewritten as part of the merge and some logic on how the executor pods look up the configMap

[GitHub] spark issue #20422: [SPARK-23253][Core][Shuffle]Only write shuffle temporary...

Github user squito commented on the issue: https://github.com/apache/spark/pull/20422 @jerryshao are you ok with making this change? I think our original comments corssed paths as I was taking a closer look --- -

[GitHub] spark issue #20421: [SPARK-23112][DOC] Update ML migration guide with breaki...

Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/20421 ah, yes, it backport to 2.2 😳 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20457: [SPARK-23110][MINOR] Make linearRegressionModel c...

Github user WeichenXu123 closed the pull request at: https://github.com/apache/spark/pull/20457 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20457: [SPARK-23110][MINOR] Make linearRegressionModel construc...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20457 **[Test build #86888 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86888/testReport)** for PR 20457 at commit

[GitHub] spark issue #20457: [SPARK-23110][MINOR] Make linearRegressionModel construc...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20457 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/441/

[GitHub] spark issue #20457: [SPARK-23110][MINOR] Make linearRegressionModel construc...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20457 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20457: [SPARK-23110][MINOR] Make linearRegressionModel c...

GitHub user WeichenXu123 opened a pull request: https://github.com/apache/spark/pull/20457 [SPARK-23110][MINOR] Make linearRegressionModel constructor private ## What changes were proposed in this pull request? make linearRegressionModel constructor private[ml] ##

[GitHub] spark issue #20387: [SPARK-23203][SPARK-23204][SQL]: DataSourceV2: Use immut...

Github user rdblue commented on the issue: https://github.com/apache/spark/pull/20387 @dongjoon-hyun, @gatorsmile, could you guys weigh in on some this discussion? I'd like to get additional perspectives on the changes I'm proposing. ---

[GitHub] spark issue #20385: [SPARK-21396][SQL] Fixes MatchError when UDTs are passed...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20385 **[Test build #86887 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86887/testReport)** for PR 20385 at commit

[GitHub] spark issue #20385: [SPARK-21396][SQL] Fixes MatchError when UDTs are passed...

Github user liufengdb commented on the issue: https://github.com/apache/spark/pull/20385 Actually, one more thing, do you need to consider the UDT as one attribute of a structured type? https://github.com/apache/spark/pull/20385/files#diff-842e3447fc453de26c706db1cac8f2c4L467 ---

[GitHub] spark issue #20450: [SPARK-23280][SQL] add map type support to ColumnVector

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20450 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86883/ Test FAILed. ---

[GitHub] spark issue #20450: [SPARK-23280][SQL] add map type support to ColumnVector

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20450 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20450: [SPARK-23280][SQL] add map type support to ColumnVector

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20450 **[Test build #86883 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86883/testReport)** for PR 20450 at commit

[GitHub] spark issue #20387: [SPARK-23203][SPARK-23204][SQL]: DataSourceV2: Use immut...

Github user rdblue commented on the issue: https://github.com/apache/spark/pull/20387 > Let's keep it general and let the data source to interprete it. I think this is the wrong approach. The reason why we are using a special `DataSourceOptions` object is to ensure that data

[GitHub] spark issue #20385: [SPARK-21396][SQL] Fixes MatchError when UDTs are passed...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20385 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20387: [SPARK-23203][SPARK-23204][SQL]: DataSourceV2: Use immut...

Github user rdblue commented on the issue: https://github.com/apache/spark/pull/20387 @cloud-fan, to your point about push-down order, I'm not saying that order doesn't matter at all, I'm saying that the push-down can run more than once and it should push the closest operators. That

[GitHub] spark issue #20442: [SPARK-23265][SQL]Update multi-column error handling log...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20442 **[Test build #86886 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86886/testReport)** for PR 20442 at commit

[GitHub] spark issue #20442: [SPARK-23265][SQL]Update multi-column error handling log...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20442 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/440/

[GitHub] spark issue #20385: [SPARK-21396][SQL] Fixes MatchError when UDTs are passed...

Github user liufengdb commented on the issue: https://github.com/apache/spark/pull/20385 LGTM! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20442: [SPARK-23265][SQL]Update multi-column error handling log...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20442 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20387: [SPARK-23203][SPARK-23204][SQL]: DataSourceV2: Use immut...

Github user rdblue commented on the issue: https://github.com/apache/spark/pull/20387 > `spark.read.format("iceberg").table("db.table").load()` I'm fine with this if you think it is confusing to parse the path as a table name in load. I think it is reasonable. I'd

[GitHub] spark issue #20421: [SPARK-23112][DOC] Update ML migration guide with breaki...

Github user MLnick commented on the issue: https://github.com/apache/spark/pull/20421 Didn't this go into 2.2.1? On Wed, 31 Jan 2018 at 20:37 WeichenXu wrote: > @MLnick > Forget one fix: #18797

[GitHub] spark issue #20421: [SPARK-23112][DOC] Update ML migration guide with breaki...

Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/20421 @MLnick Forget one fix: https://github.com/apache/spark/pull/18797 I doubt whether this fix should go into "behavior change". It influences iteration number for algos use LBFGS,

[GitHub] spark issue #20387: [SPARK-23203][SPARK-23204][SQL]: DataSourceV2: Use immut...

Github user rdblue commented on the issue: https://github.com/apache/spark/pull/20387 @felixcheung, yes, we do already have a `table` option. That creates an `UnresolvedRelation` with the parsed table name as a `TableIdentifier`, which is not currently compatible with `DataSourceV2`

[GitHub] spark issue #20454: [SPARK-23202][SQL] Add new API in DataSourceWriter: onDa...

Github user rdblue commented on the issue: https://github.com/apache/spark/pull/20454 +1 I'd rather not add features without a known use case, but this implementation looks good to me. --- - To

[GitHub] spark pull request #20454: [SPARK-23202][SQL] Add new API in DataSourceWrite...

Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/20454#discussion_r165141464 --- Diff: sql/core/src/main/java/org/apache/spark/sql/sources/v2/writer/DataSourceWriter.java --- @@ -62,6 +62,15 @@ */ DataWriterFactory

[GitHub] spark issue #20373: [SPARK-23159][PYTHON] Update cloudpickle to v0.4.2 plus ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20373 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86885/ Test PASSed. ---

[GitHub] spark issue #20373: [SPARK-23159][PYTHON] Update cloudpickle to v0.4.2 plus ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20373 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20373: [SPARK-23159][PYTHON] Update cloudpickle to v0.4.2 plus ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20373 **[Test build #86885 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86885/testReport)** for PR 20373 at commit

[GitHub] spark issue #20419: [SPARK-23032][SQL][FOLLOW-UP]Add codegenStageId in comme...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20419 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86882/ Test PASSed. ---

[GitHub] spark issue #20419: [SPARK-23032][SQL][FOLLOW-UP]Add codegenStageId in comme...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20419 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20386: [SPARK-23202][SQL] Break down DataSourceV2Writer....

Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/20386#discussion_r165138574 --- Diff: sql/core/src/main/java/org/apache/spark/sql/sources/v2/streaming/writer/StreamWriter.java --- @@ -32,40 +32,44 @@

[GitHub] spark issue #20419: [SPARK-23032][SQL][FOLLOW-UP]Add codegenStageId in comme...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20419 **[Test build #86882 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86882/testReport)** for PR 20419 at commit

[GitHub] spark issue #20448: [SPARK-23203][SQL] make DataSourceV2Relation immutable

Github user rdblue commented on the issue: https://github.com/apache/spark/pull/20448 @cloud-fan, **please close this PR**. There is already a pull request for these changes, #20387, and ongoing discussion there. If you want the proposed implementation to change, please ask

[GitHub] spark pull request #20386: [SPARK-23202][SQL] Break down DataSourceV2Writer....

Github user jose-torres commented on a diff in the pull request: https://github.com/apache/spark/pull/20386#discussion_r165137514 --- Diff: sql/core/src/main/java/org/apache/spark/sql/sources/v2/streaming/writer/StreamWriter.java --- @@ -32,40 +32,44 @@

[GitHub] spark issue #20373: [SPARK-23159][PYTHON] Update cloudpickle to v0.4.2 plus ...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/20373 I also ran the cloudpickle_tests again after adding cloudpickle#140 (and test) and it is still passing --- - To

[GitHub] spark pull request #20448: [SPARK-23203][SQL] make DataSourceV2Relation immu...

Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/20448#discussion_r165132718 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Relation.scala --- @@ -17,36 +17,84 @@ package

[GitHub] spark pull request #20442: [SPARK-23265][SQL]Update multi-column error handl...

Github user huaxingao commented on a diff in the pull request: https://github.com/apache/spark/pull/20442#discussion_r165131413 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/QuantileDiscretizer.scala --- @@ -167,25 +167,36 @@ final class QuantileDiscretizer

[GitHub] spark pull request #20386: [SPARK-23202][SQL] Break down DataSourceV2Writer....

Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/20386#discussion_r165131292 --- Diff: sql/core/src/main/java/org/apache/spark/sql/sources/v2/streaming/writer/StreamWriter.java --- @@ -32,40 +32,44 @@

[GitHub] spark issue #20373: [SPARK-23159][PYTHON] Update cloudpickle to v0.4.2 plus ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20373 **[Test build #86885 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86885/testReport)** for PR 20373 at commit

[GitHub] spark issue #20373: [SPARK-23159][PYTHON] Update cloudpickle to v0.4.2 plus ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20373 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/439/

[GitHub] spark issue #20373: [SPARK-23159][PYTHON] Update cloudpickle to v0.4.2 plus ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20373 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20452: revert [SPARK-22785][SQL] remove ColumnVector.anyNullsSe...

Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20452 thanks @dongjoon-hyun ! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20386: [SPARK-23202][SQL] Break down DataSourceV2Writer.commit ...

Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20386 There is a lesson I learned from streaming data source v1: even it's totally internal, there are people already using it and ask us to not remove the API. I think it's also true for the

[GitHub] spark issue #20455: [SPARK-23284][SQL] Document the behavior of several Colu...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20455 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20455: [SPARK-23284][SQL] Document the behavior of several Colu...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20455 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86878/ Test PASSed. ---

[GitHub] spark issue #20435: [SPARK-23268][SQL]Reorganize packages in data source V2

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20435 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20435: [SPARK-23268][SQL]Reorganize packages in data source V2

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20435 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86879/ Test PASSed. ---

[GitHub] spark issue #20455: [SPARK-23284][SQL] Document the behavior of several Colu...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20455 **[Test build #86878 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86878/testReport)** for PR 20455 at commit

[GitHub] spark issue #20435: [SPARK-23268][SQL]Reorganize packages in data source V2

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20435 **[Test build #86879 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86879/testReport)** for PR 20435 at commit

[GitHub] spark issue #20454: [SPARK-23202][SQL] Add new API in DataSourceWriter: onDa...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20454 **[Test build #86884 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86884/testReport)** for PR 20454 at commit

[GitHub] spark issue #20454: [SPARK-23202][SQL] Add new API in DataSourceWriter: onDa...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20454 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20452: revert [SPARK-22785][SQL] remove ColumnVector.anyNullsSe...

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20452 Hi, @cloud-fan . I reopen the JIRA since it's technically reverted. You can resolve that back with a new title like `Renaming anyNullsSet to hasNull` or something. ---

[GitHub] spark issue #20373: [SPARK-23159][PYTHON] Update cloudpickle to v0.4.2 plus ...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/20373 Yeah the formatting changes will just make it more complicated for the next update, so they should probably not be included now. cloudpickle#140 looks pretty clean so I'll put that in. ---

[GitHub] spark issue #20454: [SPARK-23202][SQL] Add new API in DataSourceWriter: onDa...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20454 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/438/

[GitHub] spark pull request #20386: [SPARK-23202][SQL] Break down DataSourceV2Writer....

Github user jose-torres commented on a diff in the pull request: https://github.com/apache/spark/pull/20386#discussion_r165126065 --- Diff: sql/core/src/main/java/org/apache/spark/sql/sources/v2/streaming/writer/StreamWriter.java --- @@ -32,40 +32,44 @@

[GitHub] spark issue #20454: [SPARK-23202][SQL] Add new API in DataSourceWriter: onDa...

Github user gengliangwang commented on the issue: https://github.com/apache/spark/pull/20454 retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20386: [SPARK-23202][SQL] Break down DataSourceV2Writer....

Github user jose-torres commented on a diff in the pull request: https://github.com/apache/spark/pull/20386#discussion_r165124614 --- Diff: sql/core/src/main/java/org/apache/spark/sql/sources/v2/streaming/writer/StreamWriter.java --- @@ -32,40 +32,44 @@

[GitHub] spark pull request #20372: [SPARK-23249] [SQL] Improved block merging logic ...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20372 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #20372: [SPARK-23249] [SQL] Improved block merging logic for par...

Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20372 thanks, merging to master/2.3! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark pull request #20386: [SPARK-23202][SQL] Break down DataSourceV2Writer....

Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/20386#discussion_r165121965 --- Diff: sql/core/src/main/java/org/apache/spark/sql/sources/v2/streaming/writer/StreamWriter.java --- @@ -32,40 +32,44 @@

[GitHub] spark pull request #20386: [SPARK-23202][SQL] Break down DataSourceV2Writer....

Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/20386#discussion_r165119560 --- Diff: sql/core/src/main/java/org/apache/spark/sql/sources/v2/writer/DataSourceWriter.java --- @@ -63,32 +68,42 @@ DataWriterFactory

[GitHub] spark pull request #20386: [SPARK-23202][SQL] Break down DataSourceV2Writer....

Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/20386#discussion_r165119427 --- Diff: sql/core/src/main/java/org/apache/spark/sql/sources/v2/streaming/writer/StreamWriter.java --- @@ -32,40 +32,44 @@

[GitHub] spark pull request #20386: [SPARK-23202][SQL] Break down DataSourceV2Writer....

Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/20386#discussion_r165117779 --- Diff: sql/core/src/main/java/org/apache/spark/sql/sources/v2/streaming/writer/StreamWriter.java --- @@ -32,40 +32,44 @@

[GitHub] spark pull request #19984: [SPARK-22789] Map-only continuous processing exec...

Github user jose-torres commented on a diff in the pull request: https://github.com/apache/spark/pull/19984#discussion_r165117379 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamingRelation.scala --- @@ -75,6 +76,52 @@ case class

[GitHub] spark pull request #20424: [Spark-23240][python] Better error message when e...

Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/20424#discussion_r165116866 --- Diff: core/src/main/scala/org/apache/spark/api/python/PythonWorkerFactory.scala --- @@ -191,7 +191,20 @@ private[spark] class

[GitHub] spark issue #20451: [SPARK-23146][WIP] Support client mode for Kubernetes cl...

Github user liyinan926 commented on the issue: https://github.com/apache/spark/pull/20451 /cc --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20386: [SPARK-23202][SQL] Break down DataSourceV2Writer.commit ...

Github user rdblue commented on the issue: https://github.com/apache/spark/pull/20386 > I assume this API is necessary . . . it sounds reasonable to provide a callback for task commit. I agree it sounds reasonable, but we shouldn't add methods to a new API blindly and

[GitHub] spark issue #20454: [SPARK-23202][SQL] Add new API in DataSourceWriter: onDa...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20454 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20454: [SPARK-23202][SQL] Add new API in DataSourceWriter: onDa...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20454 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86877/ Test FAILed. ---

[GitHub] spark issue #20454: [SPARK-23202][SQL] Add new API in DataSourceWriter: onDa...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20454 **[Test build #86877 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86877/testReport)** for PR 20454 at commit

[GitHub] spark issue #20450: [SPARK-23280][SQL] add map type support to ColumnVector

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20450 **[Test build #86883 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86883/testReport)** for PR 20450 at commit

[GitHub] spark issue #20435: [SPARK-23268][SQL]Reorganize packages in data source V2

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20435 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86873/ Test PASSed. ---

[GitHub] spark issue #20450: [SPARK-23280][SQL] add map type support to ColumnVector

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20450 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/437/

[GitHub] spark issue #20450: [SPARK-23280][SQL] add map type support to ColumnVector

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20450 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20435: [SPARK-23268][SQL]Reorganize packages in data source V2

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20435 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20435: [SPARK-23268][SQL]Reorganize packages in data source V2

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20435 **[Test build #86873 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86873/testReport)** for PR 20435 at commit

[GitHub] spark pull request #20452: revert [SPARK-22785][SQL] remove ColumnVector.any...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20452 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #20452: revert [SPARK-22785][SQL] remove ColumnVector.anyNullsSe...

Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20452 thanks, merging to master/2.3! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #20452: revert [SPARK-22785][SQL] remove ColumnVector.anyNullsSe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20452 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86874/ Test PASSed. ---

[GitHub] spark issue #20452: revert [SPARK-22785][SQL] remove ColumnVector.anyNullsSe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20452 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20452: revert [SPARK-22785][SQL] remove ColumnVector.anyNullsSe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20452 **[Test build #86874 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86874/testReport)** for PR 20452 at commit

[GitHub] spark issue #20450: [SPARK-23280][SQL] add map type support to ColumnVector

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20450 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86872/ Test PASSed. ---

[GitHub] spark issue #20450: [SPARK-23280][SQL] add map type support to ColumnVector

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20450 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20450: [SPARK-23280][SQL] add map type support to ColumnVector

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20450 **[Test build #86872 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86872/testReport)** for PR 20450 at commit

[GitHub] spark pull request #20450: [SPARK-23280][SQL] add map type support to Column...

Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/20450#discussion_r165098764 --- Diff: sql/core/src/main/java/org/apache/spark/sql/vectorized/ColumnVector.java --- @@ -215,10 +215,18 @@ public final ColumnarRow getStruct(int rowId) {

[GitHub] spark issue #20378: [SPARK-11222][Build][Python] Python document style check...

Github user icexelloss commented on the issue: https://github.com/apache/spark/pull/20378 I share the same concern of backporting. If we decide to do large amounts of format changes. Should we consider backporting the format changes in one batch so future backporting can be easier?

[GitHub] spark issue #20448: [SPARK-23203][SQL] make DataSourceV2Relation immutable

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20448 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86876/ Test FAILed. ---

[GitHub] spark issue #20448: [SPARK-23203][SQL] make DataSourceV2Relation immutable

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20448 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20448: [SPARK-23203][SQL] make DataSourceV2Relation immutable

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20448 **[Test build #86876 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86876/testReport)** for PR 20448 at commit

[GitHub] spark issue #20372: [SPARK-23249] [SQL] Improved block merging logic for par...

Github user glentakahashi commented on the issue: https://github.com/apache/spark/pull/20372 What are the remaining steps to get this merged? Just checking that I don't need to do anything else from my end. --- -

[GitHub] spark issue #20295: [SPARK-23011] Support alternative function form with gro...

Github user icexelloss commented on the issue: https://github.com/apache/spark/pull/20295 Hey @HyukjinKwon @ueshin could you please take a look at this? Thanks! --- - To unsubscribe, e-mail:

[GitHub] spark issue #20452: revert [SPARK-22785][SQL] remove ColumnVector.anyNullsSe...

Github user kiszk commented on the issue: https://github.com/apache/spark/pull/20452 LGTM. It is fine with me for `hasNull`, to. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20456: [SPARK-22624][PYSPARK] Expose range partitioning shuffle...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20456 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86881/ Test PASSed. ---

[GitHub] spark issue #20456: [SPARK-22624][PYSPARK] Expose range partitioning shuffle...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20456 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20456: [SPARK-22624][PYSPARK] Expose range partitioning shuffle...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20456 **[Test build #86881 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86881/testReport)** for PR 20456 at commit

[GitHub] spark issue #19802: [SPARK-22594][CORE] Handling spark-submit and master ver...

Github user srowen commented on the issue: https://github.com/apache/spark/pull/19802 @vanzin do you have thoughts on this one? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20456: [SPARK-22624][PYSPARK] Expose range partitioning shuffle...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20456 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86880/ Test PASSed. ---

[GitHub] spark issue #20456: [SPARK-22624][PYSPARK] Expose range partitioning shuffle...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20456 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

<    1   2   3   4   5   6   7   >