Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20601
**[Test build #87487 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87487/testReport)**
for PR 20601 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20511
**[Test build #87483 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87483/testReport)**
for PR 20511 at commit
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/20623
@squito The k8s test passed message is misleading :( The test is still
running. Hope we don't break 2.3 build :)
---
-
To
Github user squito closed the pull request at:
https://github.com/apache/spark/pull/20623
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20620
**[Test build #87494 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87494/testReport)**
for PR 20620 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20619
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20619
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87482/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20619
**[Test build #87482 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87482/testReport)**
for PR 20619 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20057
**[Test build #87493 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87493/testReport)**
for PR 20057 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20623
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/925/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20623
**[Test build #87492 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87492/testReport)**
for PR 20623 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20623
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user danielvdende commented on the issue:
https://github.com/apache/spark/pull/20057
Tests are failing on a spark streaming test. I think it's probably because
of the age of this PR, will rebase to get the changes into the PR that were
merged into master since I opened the PR
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20601
ack I merged to master but screwed up on 2.3 -- fixing that here:
https://github.com/apache/spark/pull/20623
---
-
To
GitHub user squito opened a pull request:
https://github.com/apache/spark/pull/20623
[SPARK-23413][UI] Fix sorting tasks by Host / Executor ID at the Stagâ¦
â¦e page
## What changes were proposed in this pull request?
Fixing exception got at sorting tasks by Host
Github user jose-torres commented on a diff in the pull request:
https://github.com/apache/spark/pull/20554#discussion_r168558972
--- Diff:
external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaMicroBatchSourceSuite.scala
---
@@ -112,14 +112,18 @@ abstract
Github user jose-torres commented on a diff in the pull request:
https://github.com/apache/spark/pull/20554#discussion_r168559060
--- Diff:
external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaSourceSuite.scala
---
@@ -303,94 +302,75 @@ class
Github user jose-torres commented on a diff in the pull request:
https://github.com/apache/spark/pull/20554#discussion_r168591005
--- Diff:
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaMicroBatchReader.scala
---
@@ -0,0 +1,410 @@
+/*
+ *
Github user jose-torres commented on a diff in the pull request:
https://github.com/apache/spark/pull/20554#discussion_r168558562
--- Diff:
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala
---
@@ -306,7 +307,7 @@ private[kafka010] class
Github user jose-torres commented on a diff in the pull request:
https://github.com/apache/spark/pull/20554#discussion_r167127585
--- Diff:
external/kafka-0-10-sql/src/test/resources/kafka-source-initial-offset-version-2.1.0.bin
---
@@ -1 +1 @@
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/20601
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #87491 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87491/testReport)**
for PR 20622 at commit
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20601
Everything that might have changed from this has passed, the failures are
known flaky tests:
https://issues.apache.org/jira/browse/SPARK-23369
Github user jose-torres commented on the issue:
https://github.com/apache/spark/pull/20622
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user jose-torres commented on the issue:
https://github.com/apache/spark/pull/20622
StreamingOuterJoinSuite failure is a known flakiness issue.
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20622
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87486/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20622
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #87486 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87486/testReport)**
for PR 20622 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20057
**[Test build #87484 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87484/testReport)**
for PR 20057 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20620
**[Test build #87489 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87489/testReport)**
for PR 20620 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20620
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87489/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20620
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20057
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20057
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87484/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20601
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20601
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87481/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20601
**[Test build #87481 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87481/testReport)**
for PR 20601 at commit
Github user jkbradley commented on the issue:
https://github.com/apache/spark/pull/20594
Success! Merged to branch-2.3 too.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20295
**[Test build #87490 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87490/testReport)**
for PR 20295 at commit
Github user icexelloss commented on a diff in the pull request:
https://github.com/apache/spark/pull/20567#discussion_r168579785
--- Diff: python/pyspark/sql/dataframe.py ---
@@ -1941,12 +1941,24 @@ def toPandas(self):
timezone = None
if
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20295
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20295
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/924/
Github user icexelloss commented on the issue:
https://github.com/apache/spark/pull/20295
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user misutoth commented on a diff in the pull request:
https://github.com/apache/spark/pull/20618#discussion_r168578156
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala ---
@@ -1313,131 +1313,178 @@ object functions {
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/20622
thanks for pinging me @jose-torres! Unfortunately I don't know yet
structured streaming codebase well enough to give a feedback. Thanks anyway for
looking at it!
---
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/20601
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/20615
Great! Closing my PR.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user zsxwing closed the pull request at:
https://github.com/apache/spark/pull/20615
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20424
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87479/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20424
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20424
**[Test build #87479 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87479/testReport)**
for PR 20424 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20620
**[Test build #87489 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87489/testReport)**
for PR 20620 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20621
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/923/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20621
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20621
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/922/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20621
**[Test build #87488 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87488/testReport)**
for PR 20621 at commit
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/20620
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20621
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user rednaxelafx commented on the issue:
https://github.com/apache/spark/pull/20612
LGTM. Let's wait for one more LGTM from @gatorsmile / @cloud-fan .
---
-
To unsubscribe, e-mail:
Github user oliviertoupin commented on the issue:
https://github.com/apache/spark/pull/18672
My PR predate #19431, but essentially fix the same issue. Since #19431 have
more traction and is more thorough, I'll close this one, and comment on the new
one if necessary.
---
Github user oliviertoupin closed the pull request at:
https://github.com/apache/spark/pull/18672
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20295
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20295
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87480/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20295
**[Test build #87480 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87480/testReport)**
for PR 20295 at commit
Github user jkbradley commented on the issue:
https://github.com/apache/spark/pull/20594
Well I succeeded in merging this with master, but the merge script isn't
working for branch-2.3. I wait to see if the read-only repo syncs and fixes
the issue.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20601
**[Test build #87487 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87487/testReport)**
for PR 20601 at commit
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/20594
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/20617
Thank you always guys, @gatorsmile , @HyukjinKwon , and @mgaido91 .
---
-
To unsubscribe, e-mail:
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/20619#discussion_r168557092
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala
---
@@ -414,16 +417,16 @@ class
Github user gaborgsomogyi commented on the issue:
https://github.com/apache/spark/pull/20620
@jose-torres @tdas @zsxwing could you take a look at this please?
---
-
To unsubscribe, e-mail:
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/20619#discussion_r168556797
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala
---
@@ -414,16 +417,16 @@ class
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/20601
ah, flaky tests. retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20601
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87478/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20601
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20601
**[Test build #87478 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87478/testReport)**
for PR 20601 at commit
Github user gaborgsomogyi commented on the issue:
https://github.com/apache/spark/pull/18672
Looks like a shortcut to me as well.
There is already a PR for backpressure:
https://github.com/apache/spark/pull/19431
Could you explain what exactly would like to achieve
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/20396
I think you can just add a follow-up
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/20619
cc @ala @michal-databricks @cloud-fan
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/20617
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user jkbradley commented on the issue:
https://github.com/apache/spark/pull/20594
Merging with master and branch-2.3
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/20396
@srowen sorry, this needs also to add the parameter to the python API;
given our discussion on JIRA, what should I do? Create a follow-up PR or a new
ticket on JIRA?
Thanks.
---
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/20617
Thanks! Merged to master/2.3
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/20619#discussion_r168552292
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala
---
@@ -414,16 +417,16 @@ class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20622
**[Test build #87486 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87486/testReport)**
for PR 20622 at commit
Github user jose-torres commented on the issue:
https://github.com/apache/spark/pull/20622
cc @mgaido91 - this should completely resolve the other symptom you posted
in SPARK-23416
cc @zsxwing @tdas
---
-
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20622
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user jose-torres opened a pull request:
https://github.com/apache/spark/pull/20622
[SPARK-23441][SS] Remove queryExecutionThread.interrupt() from
ContinuousExecution
## What changes were proposed in this pull request?
Remove queryExecutionThread.interrupt() from
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/20617
Thank you for review, @mgaido91 .
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/20057
@danielvdende @Fokko We definitely want to help the community replace Sqoop
by Spark SQL. However, `truncate` is only used when users use
SaveMode.Overwrite to write the external JDBC tables. In
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20621
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87485/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20621
**[Test build #87485 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87485/testReport)**
for PR 20621 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20621
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20621
**[Test build #87485 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87485/testReport)**
for PR 20621 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20621
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/921/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20621
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/20617
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/20621
cc @cloud-fan @HyukjinKwon @viirya
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
GitHub user mgaido91 opened a pull request:
https://github.com/apache/spark/pull/20621
[SPARK-23436][SQL] Infer partition as Date only if it can be casted to Date
## What changes were proposed in this pull request?
Before the patch, Spark could infer as Date a partition
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20057
**[Test build #87484 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87484/testReport)**
for PR 20057 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20511
**[Test build #87483 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87483/testReport)**
for PR 20511 at commit
101 - 200 of 323 matches
Mail list logo