Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21199
**[Test build #90603 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90603/testReport)**
for PR 21199 at commit
Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/21312
@viirya I looked into it a bit more and calling `clear()` won't cause any
problems but it does trigger a reallocation of the vector buffers the next time
writing. What do you think about
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21323
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21323
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3208/
Github user jose-torres commented on the issue:
https://github.com/apache/spark/pull/21199
I think that's unavoidable if we want to have a socket source. The
microbatch socket source has the same thing going on. I'd expect most people
looking into implementation details of data
Github user koeninger commented on the issue:
https://github.com/apache/spark/pull/21300
@gatorsmile this is identical to the original PR which was reviewed by
@srowen and discussion on the jira to backport it had not raised any objections
since April
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21299
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90590/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21299
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21299
**[Test build #90590 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90590/testReport)**
for PR 21299 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21323
**[Test build #90602 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90602/testReport)**
for PR 21323 at commit
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21314
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user henryr commented on a diff in the pull request:
https://github.com/apache/spark/pull/21302#discussion_r188042296
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilterSuite.scala
---
@@ -602,6 +602,16 @@ class
GitHub user henryr opened a pull request:
https://github.com/apache/spark/pull/21323
[SPARK-23582][SQL] Add withSQLConf(...) to test case
## What changes were proposed in this pull request?
Add a `withSQLConf(...)` wrapper to force Parquet filter pushdown for a
test that
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21313
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90601/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21313
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21313
**[Test build #90601 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90601/testReport)**
for PR 21313 at commit
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/21314
Merging to master / 2.3.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user dharmeshkakadia commented on the issue:
https://github.com/apache/spark/pull/21317
This is great ð
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user shivaram commented on the issue:
https://github.com/apache/spark/pull/21314
Yes @felixcheung or @vanzin can you merge this ?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21028
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21028
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90592/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21028
**[Test build #90592 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90592/testReport)**
for PR 21028 at commit
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21267#discussion_r188037259
--- Diff: python/pyspark/context.py ---
@@ -211,9 +211,23 @@ def _do_init(self, master, appName, sparkHome,
pyFiles, environment, batchSize,
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/21267
Looks good aside from the log message.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21257
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90593/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21106
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90594/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21257
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21106
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21106
**[Test build #90594 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90594/testReport)**
for PR 21106 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21257
**[Test build #90593 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90593/testReport)**
for PR 21257 at commit
Github user dbtsai commented on a diff in the pull request:
https://github.com/apache/spark/pull/21322#discussion_r188033806
--- Diff:
core/src/test/scala/org/apache/spark/storage/MemoryStoreSuite.scala ---
@@ -526,4 +526,84 @@ class MemoryStoreSuite
}
}
Github user dbtsai commented on a diff in the pull request:
https://github.com/apache/spark/pull/21322#discussion_r188034118
--- Diff:
core/src/test/scala/org/apache/spark/storage/MemoryStoreSuite.scala ---
@@ -526,4 +526,84 @@ class MemoryStoreSuite
}
}
Github user dbtsai commented on a diff in the pull request:
https://github.com/apache/spark/pull/21322#discussion_r188035443
--- Diff:
core/src/test/scala/org/apache/spark/storage/MemoryStoreSuite.scala ---
@@ -526,4 +526,84 @@ class MemoryStoreSuite
}
}
Github user dbtsai commented on a diff in the pull request:
https://github.com/apache/spark/pull/21322#discussion_r188032854
--- Diff:
core/src/main/scala/org/apache/spark/storage/memory/MemoryStore.scala ---
@@ -384,15 +385,36 @@ private[spark] class MemoryStore(
}
Github user dbtsai commented on a diff in the pull request:
https://github.com/apache/spark/pull/21322#discussion_r188032698
--- Diff:
core/src/main/scala/org/apache/spark/storage/memory/MemoryStore.scala ---
@@ -384,15 +385,36 @@ private[spark] class MemoryStore(
}
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/21193
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21299
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90587/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21299
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21299
**[Test build #90587 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90587/testReport)**
for PR 21299 at commit
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/21302
Any remaining feedback here? Otherwise I'd like to get this in before
soon-ish.
---
-
To unsubscribe, e-mail:
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/21314
Looks like this is good to go?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/21295
My understanding is that this doesn't affect 2.3 at all?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21313
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3207/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21313
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21313
**[Test build #90601 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90601/testReport)**
for PR 21313 at commit
Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/21286
...this makes me think that the FileOutputCommitter actually has an
assumption that nobody has called out before, specifically "only one
application will be writing data to the target FS with
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21300
@koeninger We need a peer review before merging such a PR.
---
-
To unsubscribe, e-mail:
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21300
cc @zsxwing
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21108
**[Test build #90600 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90600/testReport)**
for PR 21108 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21322
**[Test build #90599 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90599/testReport)**
for PR 21322 at commit
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21322
cc @jiangxb1987 @cloud-fan
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/21322
test this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/21322
Jenkins, add to whitelist.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/21322
Could you change the title to `[SPARK-24225][CORE] Support closing
AutoClosable objects...`? Thanks.
---
-
To unsubscribe,
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21302#discussion_r188022670
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilterSuite.scala
---
@@ -602,6 +602,16 @@ class
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21108
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21246
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21246
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90588/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21246
**[Test build #90588 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90588/testReport)**
for PR 21246 at commit
Github user goungoun commented on a diff in the pull request:
https://github.com/apache/spark/pull/20800#discussion_r188019259
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ---
@@ -511,6 +511,14 @@ class Dataset[T] private[sql](
*/
def isLocal:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19293
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19293
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90580/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19293
**[Test build #90580 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90580/testReport)**
for PR 19293 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21291
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90591/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21291
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21322
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21291
**[Test build #90591 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90591/testReport)**
for PR 21291 at commit
Github user JeetKunDoug commented on the issue:
https://github.com/apache/spark/pull/21322
@dbtsai Here's the PR we discussed earlier.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21322
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21320
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90582/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21320
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user JeetKunDoug opened a pull request:
https://github.com/apache/spark/pull/21322
[SPARK-24225] Support closing AutoClosable objects in MemoryStore
This allows Broadcast Variables can be released properly
## What changes were proposed in this pull request?
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21320
**[Test build #90582 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90582/testReport)**
for PR 21320 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21311
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90574/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21311
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21311
**[Test build #90574 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90574/testReport)**
for PR 21311 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21311
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90575/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21311
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21311
**[Test build #90575 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90575/testReport)**
for PR 21311 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21114
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21114
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90577/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21114
**[Test build #90577 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90577/testReport)**
for PR 21114 at commit
Github user huaxingao commented on the issue:
https://github.com/apache/spark/pull/21307
Thanks a lot!! @HyukjinKwon @viirya @felixcheung
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20894
**[Test build #90598 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90598/testReport)**
for PR 20894 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/20894
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/20894
jenkins, retest this, please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20894
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90589/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20894
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20894
**[Test build #90589 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90589/testReport)**
for PR 20894 at commit
Github user advancedxy commented on a diff in the pull request:
https://github.com/apache/spark/pull/21165#discussion_r188005420
--- Diff: core/src/main/scala/org/apache/spark/executor/Executor.scala ---
@@ -287,6 +287,28 @@ private[spark] class Executor(
notifyAll()
Github user advancedxy commented on the issue:
https://github.com/apache/spark/pull/21165
Looks like that simply add fields with default values into case class will
break binary compatibility.
How should we deal with that? Add to MimaExcludes or add missing methods?
@cloud-fan
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21291
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90583/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21291
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user steveloughran commented on the issue:
https://github.com/apache/spark/pull/21286
that would work. Like you say, no need to worry about job attempt IDs, just
uniqueness. If you put the timestamp first, you could still sort the listing by
time, which might be good for
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21291
**[Test build #90583 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90583/testReport)**
for PR 21291 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/20894
Documentation does solve the problem in a way because we are going to claim
what Spark supports and does. How about adding a script or something to find
out by reading ahead or another way?
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21290
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3206/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21290
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/21321
thanks @maropu I missed that one. I'll update it shortly, thanks.
---
-
To unsubscribe, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21290
**[Test build #90597 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90597/testReport)**
for PR 21290 at commit
201 - 300 of 534 matches
Mail list logo
