Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21972
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/21948#discussion_r207295461
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/ContinuousRateStreamSource.scala
---
@@ -89,8 +89,7 @@ class
Github user jiangxb1987 closed the pull request at:
https://github.com/apache/spark/pull/21918
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21927
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user mengxr commented on the issue:
https://github.com/apache/spark/pull/21918
@jiangxb1987 This should be addressed by #21927 . Could you close this PR?
---
-
To unsubscribe, e-mail:
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21966#discussion_r207289175
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -4077,81 +4078,84 @@ case class
Github user mengxr commented on the issue:
https://github.com/apache/spark/pull/21972
LGTM pending Jenkins.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user mengxr commented on the issue:
https://github.com/apache/spark/pull/21972
test this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/21948#discussion_r207294283
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/writer/DataWriterFactory.java
---
@@ -50,4 +50,15 @@
*this ID will
Github user mengxr commented on the issue:
https://github.com/apache/spark/pull/21927
LGTM. Merged into master. Thanks!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/21948#discussion_r207293465
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/writer/DataWriterFactory.java
---
@@ -50,4 +50,15 @@
*this ID will
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21941
**[Test build #94028 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94028/testReport)**
for PR 21941 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21969
**[Test build #94027 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94027/testReport)**
for PR 21969 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21941
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21967
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21941
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21941
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21969
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21936
**[Test build #94026 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94026/testReport)**
for PR 21936 at commit
Github user jose-torres commented on the issue:
https://github.com/apache/spark/pull/21919
I don't think so. The offsets for the file source need to be consumer
owned, because they need to work with files that were generated outside of
Spark.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21969
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21969
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93997/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21969
**[Test build #93997 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93997/testReport)**
for PR 21969 at commit
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/21911
I'd like to fix the AnalysisError message and I noted one small nit in the
tests.
+1 when the AnalysisError message is fixed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21943
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21943
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93996/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21943
**[Test build #93996 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93996/testReport)**
for PR 21943 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21970
**[Test build #94025 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94025/testReport)**
for PR 21970 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21970
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21970
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21199
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94011/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21199
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21199
**[Test build #94011 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94011/testReport)**
for PR 21199 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21970
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/20838
> I still count 10 undefined names in this repo.
Do you mean you found more instance to fix, right?
---
-
To
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/21911#discussion_r207285870
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/ResolveHintsSuite.scala
---
@@ -17,15 +17,25 @@
package
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21941
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21941
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94003/
Test FAILed.
---
Github user rdblue commented on a diff in the pull request:
https://github.com/apache/spark/pull/21911#discussion_r207285266
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveHints.scala
---
@@ -102,6 +104,35 @@ object ResolveHints {
}
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/21930
Sure @lrytz can have a second look on this, also it needs to be battle
tested.
---
-
To unsubscribe, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21941
**[Test build #94003 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94003/testReport)**
for PR 21941 at commit
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/21305
@cloud-fan, I'll fix the conflicts and re-run tests. Yesterday's tests
passed after I updated for your feedback. I'd like to try to get this in soon
because it is taking so much time to resolve
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21754
**[Test build #94024 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94024/testReport)**
for PR 21754 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21923
**[Test build #94023 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94023/testReport)**
for PR 21923 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21972
**[Test build #94022 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94022/testReport)**
for PR 21972 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21754
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21754
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21923
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21972
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21923
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21972
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21970
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94013/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21970
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21970
**[Test build #94013 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94013/testReport)**
for PR 21970 at commit
Github user squito commented on the issue:
https://github.com/apache/spark/pull/21923
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21754
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user ifilonenko commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r207281949
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/KubernetesClientApplication.scala
---
@@ -107,7 +109,14
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21754
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94000/
Test FAILed.
---
Github user hthuynh2 commented on the issue:
https://github.com/apache/spark/pull/21953
@tgravescs I updated it. Thanks.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21754
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user vackosar commented on the issue:
https://github.com/apache/spark/pull/21919
Yes, I was hoping to improve that eg using filename as offset or other non
consumer-owned approach, but that would be rather long term. Do you think it is
solvable?
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21754
**[Test build #94000 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94000/testReport)**
for PR 21754 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21936
**[Test build #94021 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94021/testReport)**
for PR 21936 at commit
Github user hthuynh2 commented on the issue:
https://github.com/apache/spark/pull/21936
@tgravescs I updated. Thanks.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user ajacques commented on the issue:
https://github.com/apache/spark/pull/21889
These test failures are in Spark streaming. Is this just an intermittent
test failure or actually caused by this PR?
---
-
To
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21935
**[Test build #94020 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94020/testReport)**
for PR 21935 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21972
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21972
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94018/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21972
**[Test build #94018 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94018/testReport)**
for PR 21972 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21935
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21935
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AlbertPlaPlanas commented on the issue:
https://github.com/apache/spark/pull/16486
Was this ever implemented?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user zecevicp commented on the issue:
https://github.com/apache/spark/pull/21109
Implementing spilling over seems a lot of work because this is a queue. If
data is spilled over to disk and you need to pop from the queue, it is not
clear to me what is the best way to do that.
Github user cclauss closed the pull request at:
https://github.com/apache/spark/pull/21960
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21954
**[Test build #94019 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94019/testReport)**
for PR 21954 at commit
Github user cclauss closed the pull request at:
https://github.com/apache/spark/pull/21959
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21954
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21954
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21954
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21403
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21403
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93999/
Test FAILed.
---
Github user jose-torres commented on the issue:
https://github.com/apache/spark/pull/21919
For file streams, the offsets are just indices into a log the source keeps
of which files it's seen. So a file sink doesn't have any access to those
offsets.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21403
**[Test build #93999 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93999/testReport)**
for PR 21403 at commit
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/21936#discussion_r207269915
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -571,7 +571,12 @@ class SparkContext(config: SparkConf) extends Logging {
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21972
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21972
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21972
**[Test build #94018 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94018/testReport)**
for PR 21972 at commit
GitHub user jiangxb1987 opened a pull request:
https://github.com/apache/spark/pull/21972
[SPARK-24795][CORE][FOLLOWUP] Combine BarrierTaskContext with
BarrierTaskContextImpl
## What changes were proposed in this pull request?
According to
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21403
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94001/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21403
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21403
**[Test build #94001 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94001/testReport)**
for PR 21403 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21950
**[Test build #94017 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94017/testReport)**
for PR 21950 at commit
Github user vincent-grosbois commented on the issue:
https://github.com/apache/spark/pull/21933
Hello, I updated the description and title
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user vackosar commented on the issue:
https://github.com/apache/spark/pull/21919
@jose-torres why it wouldnt make sense? According to the documentation all
SS sources have offsets, but not all sinks can also be SS sources e.g. ForEach
doesnt have offsets in general. So usually
Github user bersprockets commented on the issue:
https://github.com/apache/spark/pull/21950
retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user carsonwang commented on the issue:
https://github.com/apache/spark/pull/21754
This LGTM as a fix. However, ideally we should also support reusing an
exchange used in different joins. There is no need to shuffle write the same
table twice, we just need read it differently.
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/21895
retest this pelase
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/20611#discussion_r207258477
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala ---
@@ -303,94 +303,44 @@ case class LoadDataCommand(
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21935
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21935
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94004/
Test FAILed.
---
601 - 700 of 1238 matches
Mail list logo
