[GitHub] [spark] AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL
AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-501991151 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/106502/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL
AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-501991144 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL
SparkQA removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-501956922 **[Test build #106502 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106502/testReport)** for PR 24706 at commit [`eb8fe75`](https://github.com/apache/spark/commit/eb8fe757722a818a82ed0f92d2e7b8cbda1a606d). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL
AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-501991151 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/106502/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL
AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-501991144 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] ueshin commented on issue #24761: [SPARK-27905] [SQL] Add higher order function 'forall'
ueshin commented on issue #24761: [SPARK-27905] [SQL] Add higher order function 'forall' URL: https://github.com/apache/spark/pull/24761#issuecomment-501991189 @nvander1 I'm sorry for the delay. Actually I had an offline discussion about this, and during the discussion we found that `ArrayExists` (also `ArrayForAll` if we provide) should follow the three-valued boolean logic. After the discussion, I became okay to provide this since, even if the rewrite under the three-valued boolean logic works, it's easier and more confident for users. Let me fix it first, then, although I'm not sure whether we can still share an implementation between the two, could you follow the fix here as well? Thanks. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL
SparkQA commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-501990688 **[Test build #106502 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106502/testReport)** for PR 24706 at commit [`eb8fe75`](https://github.com/apache/spark/commit/eb8fe757722a818a82ed0f92d2e7b8cbda1a606d). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
AmplabJenkins commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501988693 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/106505/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
AmplabJenkins removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501988690 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
AmplabJenkins removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501988693 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/106505/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
SparkQA removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501974247 **[Test build #106505 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106505/testReport)** for PR 24869 at commit [`9f505c0`](https://github.com/apache/spark/commit/9f505c08d07288bddbc1f2864aa88e6ea4727e04). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
AmplabJenkins commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501988690 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
SparkQA commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501988440 **[Test build #106505 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106505/testReport)** for PR 24869 at commit [`9f505c0`](https://github.com/apache/spark/commit/9f505c08d07288bddbc1f2864aa88e6ea4727e04). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] mengxr commented on a change in pull request #24830: [SPARK-27990][SQL][ML][WIP] Provide a way to recursively load data from datasource
mengxr commented on a change in pull request #24830:
[SPARK-27990][SQL][ML][WIP] Provide a way to recursively load data from
datasource
URL: https://github.com/apache/spark/pull/24830#discussion_r293613641
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/PartitioningAwareFileIndex.scala
##
@@ -96,30 +102,36 @@ abstract class PartitioningAwareFileIndex(
def allFiles(): Seq[FileStatus] = {
val files = if (partitionSpec().partitionColumns.isEmpty) {
- // For each of the root input paths, get the list of files inside them
- rootPaths.flatMap { path =>
-// Make the path qualified (consistent with listLeafFiles and
bulkListLeafFiles).
-val fs = path.getFileSystem(hadoopConf)
-val qualifiedPathPre = fs.makeQualified(path)
-val qualifiedPath: Path = if (qualifiedPathPre.isRoot &&
!qualifiedPathPre.isAbsolute) {
- // SPARK-17613: Always append `Path.SEPARATOR` to the end of parent
directories,
- // because the `leafFile.getParent` would have returned an absolute
path with the
- // separator at the end.
- new Path(qualifiedPathPre, Path.SEPARATOR)
-} else {
- qualifiedPathPre
-}
-
-// There are three cases possible with each path
-// 1. The path is a directory and has children files in it. Then it
must be present in
-//leafDirToChildrenFiles as those children files will have been
found as leaf files.
-//Find its children files from leafDirToChildrenFiles and include
them.
-// 2. The path is a file, then it will be present in leafFiles.
Include this path.
-// 3. The path is a directory, but has no children files. Do not
include this path.
+ if (recursive) {
+leafFiles.values.toSeq
Review comment:
I'm not sure if we can trust that `leafFiles` contains all files. The doc
doesn't say anything ...
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] mengxr commented on a change in pull request #24830: [SPARK-27990][SQL][ML][WIP] Provide a way to recursively load data from datasource
mengxr commented on a change in pull request #24830:
[SPARK-27990][SQL][ML][WIP] Provide a way to recursively load data from
datasource
URL: https://github.com/apache/spark/pull/24830#discussion_r292212772
##
File path:
mllib/src/test/scala/org/apache/spark/ml/source/image/ImageFileFormatSuite.scala
##
@@ -104,6 +105,30 @@ class ImageFileFormatSuite extends SparkFunSuite with
MLlibTestSparkContext {
assert(firstBytes20Set === expectedFirstBytes20Set)
}
+ test("recursive loading") {
+val imagesPath = spark.read.format("image")
+ .option("dropInvalid", true)
+ .option("recursive", true)
Review comment:
It is okay to test here. But we should also add a more generic test for the
new option, not specific to a data source in MLlib.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] mengxr commented on a change in pull request #24830: [SPARK-27990][SQL][ML][WIP] Provide a way to recursively load data from datasource
mengxr commented on a change in pull request #24830:
[SPARK-27990][SQL][ML][WIP] Provide a way to recursively load data from
datasource
URL: https://github.com/apache/spark/pull/24830#discussion_r292213091
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/PartitioningAwareFileIndex.scala
##
@@ -58,6 +58,8 @@ abstract class PartitioningAwareFileIndex(
protected lazy val pathGlobFilter = parameters.get("pathGlobFilter").map(new
GlobFilter(_))
+ protected lazy val recursive = parameters.getOrElse("recursive",
"false").toBoolean
Review comment:
* Could you rename it to `recursiveFileLooup`? I'm worried about `recursive`
being too general and already used by some 3rd-party data sources.
* Maybe better to define it below `matchGlobPattern`
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] mengxr commented on a change in pull request #24830: [SPARK-27990][SQL][ML][WIP] Provide a way to recursively load data from datasource
mengxr commented on a change in pull request #24830:
[SPARK-27990][SQL][ML][WIP] Provide a way to recursively load data from
datasource
URL: https://github.com/apache/spark/pull/24830#discussion_r292077612
##
File path:
mllib/src/test/scala/org/apache/spark/ml/source/image/ImageFileFormatSuite.scala
##
@@ -104,6 +105,30 @@ class ImageFileFormatSuite extends SparkFunSuite with
MLlibTestSparkContext {
assert(firstBytes20Set === expectedFirstBytes20Set)
}
+ test("recursive loading") {
+val imagesPath = spark.read.format("image")
+ .option("dropInvalid", true)
+ .option("recursive", true)
+ .load(recursiveImagePath)
+ .select(col("image.origin"))
+ .collect()
+ .map { row =>
+val path = row.getString(0)
+val keyStr = "images/recursive/"
+path.substring(path.indexOf(keyStr) + keyStr.length)
+ }
+assert(Set(imagesPath: _*) === Set(
+ "multi-channel/chr30.4.184.jpg",
Review comment:
Could you use existing files or create new files from the test? Checking in
binary files is generally not good.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] beliefer commented on issue #24858: [MINOR][SQL] Avoid wildcard import Network in KafkaRDD.
beliefer commented on issue #24858: [MINOR][SQL] Avoid wildcard import Network in KafkaRDD. URL: https://github.com/apache/spark/pull/24858#issuecomment-501981206 @jerryshao @HyukjinKwon OK. I get it. I will close this PR. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] beliefer closed pull request #24858: [MINOR][SQL] Avoid wildcard import Network in KafkaRDD.
beliefer closed pull request #24858: [MINOR][SQL] Avoid wildcard import Network in KafkaRDD. URL: https://github.com/apache/spark/pull/24858 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] ketank-new commented on a change in pull request #24861: [SPARK-26985][CORE] Fix "access only some column of the all of columns " for big endian architecture BUG
ketank-new commented on a change in pull request #24861: [SPARK-26985][CORE]
Fix "access only some column of the all of columns " for big endian
architecture BUG
URL: https://github.com/apache/spark/pull/24861#discussion_r293668130
##
File path: common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java
##
@@ -304,7 +304,7 @@ public static void throwException(Throwable t) {
static {
boolean _unaligned;
String arch = System.getProperty("os.arch", "");
-if (arch.equals("ppc64le") || arch.equals("ppc64")) {
+if (arch.equals("ppc64le") || arch.equals("ppc64") ||
arch.matches("s390x")) {
Review comment:
@srowen : I had used "arch.equals("s390x") initially and by reading ur
earlier comments i understood you asking me to use "matches", that's what i did
in this new PR
Do you stilll suggest to change it to some thing else?
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer
AmplabJenkins removed a comment on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer URL: https://github.com/apache/spark/pull/24870#issuecomment-501975124 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC
AmplabJenkins removed a comment on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#issuecomment-501975301 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/106496/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC
AmplabJenkins removed a comment on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#issuecomment-501975296 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer
AmplabJenkins removed a comment on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer URL: https://github.com/apache/spark/pull/24870#issuecomment-501975127 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/106501/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer
AmplabJenkins commented on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer URL: https://github.com/apache/spark/pull/24870#issuecomment-501975127 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/106501/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC
AmplabJenkins commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#issuecomment-501975296 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC
AmplabJenkins commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#issuecomment-501975301 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/106496/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer
AmplabJenkins commented on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer URL: https://github.com/apache/spark/pull/24870#issuecomment-501975124 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC
SparkQA commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#issuecomment-501974971 **[Test build #106496 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106496/testReport)** for PR 24043 at commit [`b8d216f`](https://github.com/apache/spark/commit/b8d216fc8fb6954579f08762b60737abb8d39d29). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer
SparkQA removed a comment on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer URL: https://github.com/apache/spark/pull/24870#issuecomment-501956903 **[Test build #106501 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106501/testReport)** for PR 24870 at commit [`02f7142`](https://github.com/apache/spark/commit/02f7142d3a7cb31e53c5ce57192161ca676b408d). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC
SparkQA removed a comment on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#issuecomment-501945386 **[Test build #106496 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106496/testReport)** for PR 24043 at commit [`b8d216f`](https://github.com/apache/spark/commit/b8d216fc8fb6954579f08762b60737abb8d39d29). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer
SparkQA commented on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer URL: https://github.com/apache/spark/pull/24870#issuecomment-501974774 **[Test build #106501 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106501/testReport)** for PR 24870 at commit [`02f7142`](https://github.com/apache/spark/commit/02f7142d3a7cb31e53c5ce57192161ca676b408d). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
SparkQA commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501974247 **[Test build #106505 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106505/testReport)** for PR 24869 at commit [`9f505c0`](https://github.com/apache/spark/commit/9f505c08d07288bddbc1f2864aa88e6ea4727e04). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
AmplabJenkins commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501973890 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/11748/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
AmplabJenkins removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501973883 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
AmplabJenkins commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501973883 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
AmplabJenkins removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501973890 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/11748/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics
AmplabJenkins removed a comment on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#issuecomment-501970534 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics
AmplabJenkins removed a comment on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#issuecomment-501970541 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/106504/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics
AmplabJenkins commented on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#issuecomment-501970534 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics
SparkQA removed a comment on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#issuecomment-501960297 **[Test build #106504 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106504/testReport)** for PR 24868 at commit [`b77a435`](https://github.com/apache/spark/commit/b77a435b5e62f78de239dc4846215bb8e415ad8b). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics
AmplabJenkins commented on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#issuecomment-501970541 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/106504/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics
SparkQA commented on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#issuecomment-501970366 **[Test build #106504 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106504/testReport)** for PR 24868 at commit [`b77a435`](https://github.com/apache/spark/commit/b77a435b5e62f78de239dc4846215bb8e415ad8b). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode
AmplabJenkins removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-501969637 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode
AmplabJenkins removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-501969642 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/106494/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode
AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-501969642 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/106494/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode
AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-501969637 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode
SparkQA commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-501969342 **[Test build #106494 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106494/testReport)** for PR 24637 at commit [`ef97ffc`](https://github.com/apache/spark/commit/ef97ffc781c477e7e86936e78a9d10f0704fe954). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode
SparkQA removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-501940029 **[Test build #106494 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106494/testReport)** for PR 24637 at commit [`ef97ffc`](https://github.com/apache/spark/commit/ef97ffc781c477e7e86936e78a9d10f0704fe954). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on issue #24858: [MINOR][SQL] Avoid wildcard import Network in KafkaRDD.
HyukjinKwon commented on issue #24858: [MINOR][SQL] Avoid wildcard import Network in KafkaRDD. URL: https://github.com/apache/spark/pull/24858#issuecomment-501968104 e.g, https://github.com/apache/spark/pull/24857. Also, causing conflicts itself is a problem because we need to manually fix the conflicts in files. This is an overhead comparing to just `git cherry-pick` and `git push`. Also, think about multiple conflicts like this. Those changes are usually rejected for those reasons because fixing style is virtually nothing real but it causes a real problem. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on issue #24858: [MINOR][SQL] Avoid wildcard import Network in KafkaRDD.
HyukjinKwon commented on issue #24858: [MINOR][SQL] Avoid wildcard import Network in KafkaRDD. URL: https://github.com/apache/spark/pull/24858#issuecomment-501967712 Where was the consensus made? They have been usually rejected. Since we're going ahead for Spark 3, some changes like this are being merged when they fix multiple cleanups but the changes like this are not encouraged. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] hehuiyuan commented on issue #24839: [SPARK-27258][K8S]Deal with the k8s resource names that don't match their own regular expression
hehuiyuan commented on issue #24839: [SPARK-27258][K8S]Deal with the k8s resource names that don't match their own regular expression URL: https://github.com/apache/spark/pull/24839#issuecomment-501967563 > LGTM wrt validation part. Hi , how is progress now? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
AmplabJenkins removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501964281 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/106503/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
AmplabJenkins removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501964278 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
SparkQA commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501964250 **[Test build #106503 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106503/testReport)** for PR 24869 at commit [`94e3de6`](https://github.com/apache/spark/commit/94e3de66e2d386d64a3dc5fbf7012d0c73e08267). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
AmplabJenkins commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501964281 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/106503/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
AmplabJenkins commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501964278 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
SparkQA removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501959169 **[Test build #106503 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106503/testReport)** for PR 24869 at commit [`94e3de6`](https://github.com/apache/spark/commit/94e3de66e2d386d64a3dc5fbf7012d0c73e08267). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics
AmplabJenkins removed a comment on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#issuecomment-501961063 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics
AmplabJenkins removed a comment on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#issuecomment-501961069 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/11747/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics
AmplabJenkins commented on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#issuecomment-501961063 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics
AmplabJenkins commented on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#issuecomment-501961069 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/11747/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics
SparkQA commented on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#issuecomment-501960297 **[Test build #106504 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106504/testReport)** for PR 24868 at commit [`b77a435`](https://github.com/apache/spark/commit/b77a435b5e62f78de239dc4846215bb8e415ad8b). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics
AmplabJenkins removed a comment on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#issuecomment-501959104 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/106499/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24553: [SPARK-27604][SQL] Enhance constant propagation
AmplabJenkins removed a comment on issue #24553: [SPARK-27604][SQL] Enhance constant propagation URL: https://github.com/apache/spark/pull/24553#issuecomment-501959188 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/106493/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics
SparkQA removed a comment on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#issuecomment-501953153 **[Test build #106499 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106499/testReport)** for PR 24868 at commit [`0ec40a4`](https://github.com/apache/spark/commit/0ec40a481482a7fe824335e377590a9a7cc91e75). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
AmplabJenkins removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501958880 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/11746/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24553: [SPARK-27604][SQL] Enhance constant propagation
AmplabJenkins removed a comment on issue #24553: [SPARK-27604][SQL] Enhance constant propagation URL: https://github.com/apache/spark/pull/24553#issuecomment-501959187 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics
AmplabJenkins removed a comment on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#issuecomment-501959098 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24553: [SPARK-27604][SQL] Enhance constant propagation
SparkQA removed a comment on issue #24553: [SPARK-27604][SQL] Enhance constant propagation URL: https://github.com/apache/spark/pull/24553#issuecomment-501929632 **[Test build #106493 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106493/testReport)** for PR 24553 at commit [`827cfe5`](https://github.com/apache/spark/commit/827cfe5ff2f674e54064440524dbfb65e88d49e1). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
AmplabJenkins removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501958877 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
SparkQA commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501959169 **[Test build #106503 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106503/testReport)** for PR 24869 at commit [`94e3de6`](https://github.com/apache/spark/commit/94e3de66e2d386d64a3dc5fbf7012d0c73e08267). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24553: [SPARK-27604][SQL] Enhance constant propagation
AmplabJenkins commented on issue #24553: [SPARK-27604][SQL] Enhance constant propagation URL: https://github.com/apache/spark/pull/24553#issuecomment-501959187 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24553: [SPARK-27604][SQL] Enhance constant propagation
AmplabJenkins commented on issue #24553: [SPARK-27604][SQL] Enhance constant propagation URL: https://github.com/apache/spark/pull/24553#issuecomment-501959188 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/106493/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics
AmplabJenkins commented on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#issuecomment-501959104 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/106499/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics
SparkQA commented on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#issuecomment-501958998 **[Test build #106499 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106499/testReport)** for PR 24868 at commit [`0ec40a4`](https://github.com/apache/spark/commit/0ec40a481482a7fe824335e377590a9a7cc91e75). * This patch **fails PySpark unit tests**. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics
AmplabJenkins commented on issue #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#issuecomment-501959098 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
AmplabJenkins commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501958880 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/11746/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24553: [SPARK-27604][SQL] Enhance constant propagation
SparkQA commented on issue #24553: [SPARK-27604][SQL] Enhance constant propagation URL: https://github.com/apache/spark/pull/24553#issuecomment-501958919 **[Test build #106493 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106493/testReport)** for PR 24553 at commit [`827cfe5`](https://github.com/apache/spark/commit/827cfe5ff2f674e54064440524dbfb65e88d49e1). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
AmplabJenkins commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501958877 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] beliefer commented on issue #24858: [MINOR][SQL] Avoid wildcard import Network in KafkaRDD.
beliefer commented on issue #24858: [MINOR][SQL] Avoid wildcard import Network in KafkaRDD. URL: https://github.com/apache/spark/pull/24858#issuecomment-501958247 > The changes will introduce lots of conflicts to other PRs, I would suggest to not fix it unless we have a consensus on this style change. Thanks for your review first! I think these conflicts is easy to solve. We have a consensus on this style change is the important thing. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer
AmplabJenkins removed a comment on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer URL: https://github.com/apache/spark/pull/24870#issuecomment-501956629 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/11744/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer
AmplabJenkins removed a comment on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer URL: https://github.com/apache/spark/pull/24870#issuecomment-501956625 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL
SparkQA commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-501956922 **[Test build #106502 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106502/testReport)** for PR 24706 at commit [`eb8fe75`](https://github.com/apache/spark/commit/eb8fe757722a818a82ed0f92d2e7b8cbda1a606d). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer
SparkQA commented on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer URL: https://github.com/apache/spark/pull/24870#issuecomment-501956903 **[Test build #106501 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106501/testReport)** for PR 24870 at commit [`02f7142`](https://github.com/apache/spark/commit/02f7142d3a7cb31e53c5ce57192161ca676b408d). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL
AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-501956639 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/11745/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer
AmplabJenkins commented on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer URL: https://github.com/apache/spark/pull/24870#issuecomment-501956625 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer
AmplabJenkins commented on issue #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer URL: https://github.com/apache/spark/pull/24870#issuecomment-501956629 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/11744/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL
AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-501956633 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL
AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-501956639 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/11745/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL
AmplabJenkins removed a comment on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-501956633 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] zhengruifeng opened a new pull request #24870: [SPARK-27018][Core] Fix incorrect removal of checkpointed file in PeriodicCheckpointer
zhengruifeng opened a new pull request #24870: [SPARK-27018][Core] Fix
incorrect removal of checkpointed file in PeriodicCheckpointer
URL: https://github.com/apache/spark/pull/24870
## What changes were proposed in this pull request?
remove the oldest checkpointed file only if next checkpoint exists.
I think this patch needs back-porting.
## How was this patch tested?
existing test
local check in spark-shell with following suite:
```
import org.apache.spark.ml.linalg.Vectors
import org.apache.spark.ml.classification.GBTClassifier
case class Row(features: org.apache.spark.ml.linalg.Vector, label: Int)
sc.setCheckpointDir("/checkpoints")
val trainingData = sc.parallelize(1 to 2426874, 256).map(x =>
Row(Vectors.dense(x, x + 1, x * 2 % 10), if (x % 5 == 0) 1 else 0)).toDF
val classifier = new GBTClassifier()
.setLabelCol("label")
.setFeaturesCol("features")
.setProbabilityCol("probability")
.setMaxIter(100)
.setMaxDepth(10)
.setCheckpointInterval(2)
classifier.fit(trainingData)
```
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] jerryshao commented on issue #24858: [MINOR][SQL] Avoid wildcard import Network in KafkaRDD.
jerryshao commented on issue #24858: [MINOR][SQL] Avoid wildcard import Network in KafkaRDD. URL: https://github.com/apache/spark/pull/24858#issuecomment-501956131 The changes will introduce lots of conflicts to other PRs, I would suggest to not fix it unless we have a consensus on this style change. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] viirya edited a comment on issue #24867: [SPARK-28041][PYTHON] Increase minimum supported Pandas to 0.23.2
viirya edited a comment on issue #24867: [SPARK-28041][PYTHON] Increase minimum supported Pandas to 0.23.2 URL: https://github.com/apache/spark/pull/24867#issuecomment-501951928 Agreed. 0.23.2 sounds good. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
AmplabJenkins removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501955004 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/106500/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
AmplabJenkins commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501955000 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
AmplabJenkins commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501955004 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/106500/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
SparkQA removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501954454 **[Test build #106500 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106500/testReport)** for PR 24869 at commit [`28b1c57`](https://github.com/apache/spark/commit/28b1c571e1d2365f418b4c0df14e99de6ab313b0). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
AmplabJenkins removed a comment on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501955000 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator
SparkQA commented on issue #24869: [SPARK-28045][ML][PYTHON] add missing RankingEvaluator URL: https://github.com/apache/spark/pull/24869#issuecomment-501954992 **[Test build #106500 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106500/testReport)** for PR 24869 at commit [`28b1c57`](https://github.com/apache/spark/commit/28b1c571e1d2365f418b4c0df14e99de6ab313b0). * This patch **fails Python style tests**. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
