Github user attilapiros commented on the issue:
https://github.com/apache/spark/pull/20686
@dongjoon-hyun The jira is SPARK-23728 and the PR is
https://github.com/apache/spark/pull/20852. Could you please enable Jenkins on
that?
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20852
**[Test build #88345 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88345/testReport)**
for PR 20852 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20852
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user attilapiros opened a pull request:
https://github.com/apache/spark/pull/20852
[SPARK-23728][BRANCH-2.3] Fix ML tests with expected exceptions running
streaming tests
## What changes were proposed in this pull request?
The testTransformerByInterceptingException
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/20686
Thanks, @attilapiros . You can test your PR if you put `[BRANCH-2.3]` into
your title.
---
-
To unsubscribe, e-mail:
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/20851#discussion_r175276718
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilters.scala
---
@@ -148,6 +193,15 @@ private[parquet]
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/20851#discussion_r175276713
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilterSuite.scala
---
@@ -313,6 +314,36 @@ class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20851
**[Test build #88344 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88344/testReport)**
for PR 20851 at commit
Github user attilapiros commented on the issue:
https://github.com/apache/spark/pull/20686
@dongjoon-hyun it seams to me on 2.3 during streaming if an exception
happens within an ml feature then the feature generated message is not at the
direct caused by exception but even one level
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20851
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/20851
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20851
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user yucai opened a pull request:
https://github.com/apache/spark/pull/20851
[SPARK-23727][SQL] Support DATE predict push down in parquet
## What changes were proposed in this pull request?
DATE predict push down is missing in parquet, it should be supported.
Github user attilapiros commented on the issue:
https://github.com/apache/spark/pull/20686
I am checking.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/20846
Definitely, +1 for your idea. Since that is different from this PR. Could
you try to make a PR instead of this PR?
> We should prevent user to change table's column type
---
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/20686
Hi, @jkbradley , @WeichenXu123 , @attilapiros .
This seems to break branch-2.3 for three days. Could you take a look please?
-
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/20850
cc @hvanhovell
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/20850
I think the failure of `org.apache.spark.ml.r.RWrapperUtilsSuite.avoid
libsvm data column name conflicting` may not be related to this PR. However, I
am investigating the reason for this failure.
Github user caneGuy commented on the issue:
https://github.com/apache/spark/pull/20845
cc @cloud-fan @jerryshao
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user liutang123 commented on the issue:
https://github.com/apache/spark/pull/20846
The exception is not thrown in `ALTER TABLE`.
We should prevent user to change table's column type. But, for historical
data, should we do some compatible measures?
---
Github user liutang123 commented on a diff in the pull request:
https://github.com/apache/spark/pull/20846#discussion_r175274916
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala
---
@@ -99,7 +99,8 @@ case class CatalogTablePartition(
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/20848
Thanks! Merging to branch-2.3.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20850
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20850
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88343/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20850
**[Test build #88343 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88343/testReport)**
for PR 20850 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20850
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88342/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20850
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20850
**[Test build #88342 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88342/testReport)**
for PR 20850 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20850
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1583/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20850
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20850
**[Test build #88343 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88343/testReport)**
for PR 20850 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20850
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20850
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1582/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20850
**[Test build #88342 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88342/testReport)**
for PR 20850 at commit
GitHub user kiszk opened a pull request:
https://github.com/apache/spark/pull/20850
[SPARK-23713][SQL] Cleanup UnsafeWriter and BufferHolder classes
## What changes were proposed in this pull request?
This PR implemented the following cleanups related to `UnsafeWriter`
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20669#discussion_r175268465
--- Diff:
resource-managers/kubernetes/docker/src/main/dockerfiles/spark/entrypoint.sh ---
@@ -53,14 +53,10 @@ fi
case "$SPARK_K8S_CMD" in
Github user nafshartous closed the pull request at:
https://github.com/apache/spark/pull/17275
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user nafshartous commented on the issue:
https://github.com/apache/spark/pull/17275
Doc link is going to be changed to 0.10 artifact rather than 0.8 in a new
PR to address this issue.
---
-
To unsubscribe,
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/20849
Shall we add non-ascii compatible characters in the test resource files?
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20849
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20849
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88341/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20849
**[Test build #88341 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88341/testReport)**
for PR 20849 at commit
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20849#discussion_r175263696
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala
---
@@ -2063,4 +2063,178 @@ class JsonSuite extends
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20849#discussion_r175263062
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala ---
@@ -366,6 +366,9 @@ class DataFrameReader private[sql](sparkSession:
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20849#discussion_r175262708
--- Diff: python/pyspark/sql/readwriter.py ---
@@ -237,6 +237,8 @@ def json(self, path, schema=None,
primitivesAsString=None, prefersDecimal=None,
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20849#discussion_r175262443
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala
---
@@ -2063,4 +2063,178 @@ class JsonSuite extends
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20849#discussion_r175262426
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala
---
@@ -85,6 +85,12 @@ private[sql] class JSONOptions(
Github user ifilonenko commented on a diff in the pull request:
https://github.com/apache/spark/pull/20669#discussion_r175262319
--- Diff:
resource-managers/kubernetes/docker/src/main/dockerfiles/spark/entrypoint.sh ---
@@ -53,14 +53,10 @@ fi
case "$SPARK_K8S_CMD" in
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/20796
@HyukjinKwon @maropu @cloud-fan @gatorsmile Please, review it.
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20796
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88340/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20796
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20796
**[Test build #88340 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88340/testReport)**
for PR 20796 at commit
Github user sidps commented on the issue:
https://github.com/apache/spark/pull/506
I've been curious about underlying implementations of such operations, has
the ring all-reduce technique been considered?
http://research.baidu.com/bringing-hpc-techniques-deep-learning/
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20849
**[Test build #88341 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88341/testReport)**
for PR 20849 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20849
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user MaxGekk opened a pull request:
https://github.com/apache/spark/pull/20849
[SPARK-23723] New charset option for json datasource
## What changes were proposed in this pull request?
I propose new option for JSON datasource which allows to specify charset of
input
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20659
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88338/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20659
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20659
**[Test build #88338 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88338/testReport)**
for PR 20659 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20796
**[Test build #88340 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88340/testReport)**
for PR 20796 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20841
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20841
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88339/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20841
**[Test build #88339 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88339/testReport)**
for PR 20841 at commit
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/20847
most of the UTs are failing consistently and of course UTs failures are
unrelated. Since this is on branch 2.3, shall we open a JIRA for tracking this?
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20841
**[Test build #88339 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88339/testReport)**
for PR 20841 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20841
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1581/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20841
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/20841
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20659
**[Test build #88338 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88338/testReport)**
for PR 20659 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20659
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20659
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1580/
Github user wangyum commented on the issue:
https://github.com/apache/spark/pull/20659
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20659
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88337/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20659
**[Test build #88337 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88337/testReport)**
for PR 20659 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20659
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20659
**[Test build #88337 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88337/testReport)**
for PR 20659 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20659
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20659
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1579/
78 matches
Mail list logo
