[GitHub] spark issue #19538: [SPARK-20393][WEBU UI][BACKPORT-2.0] Strengthen Spark to...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19538 **[Test build #93054 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93054/consoleFull)** for PR 19538 at commit [`a599d91`](https://github.com/apache/spark/commit/a599d9165fcbf50855feb617255fcaf2bed85e4d). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20235: [Spark-22887][ML][TESTS][WIP] ML test for StructuredStre...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20235 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21779: [SPARK-24813][TESTS][HIVE][HOTFIX][BRANCH-2.2] HiveExter...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21779 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/980/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19633: [SPARK-22411][SQL] Disable the heuristic to calculate ma...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19633 **[Test build #93053 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93053/testReport)** for PR 19633 at commit [`d3aff40`](https://github.com/apache/spark/commit/d3aff40637da077f4f9cee655d6fb24b0b204a5d). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19691: [SPARK-14922][SPARK-17732][SQL]ALTER TABLE DROP PARTITIO...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19691 **[Test build #93052 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93052/testReport)** for PR 19691 at commit [`6b18939`](https://github.com/apache/spark/commit/6b189398c138e2fb17085ece1bd36d30cbc0aa44). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20045: [Spark-22360][SQL][TEST] Add unit tests for Window Speci...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20045 **[Test build #93049 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93049/testReport)** for PR 20045 at commit [`5feb4f7`](https://github.com/apache/spark/commit/5feb4f7d75eaba759eec6d84cfc23d8c1a347f2f). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19955: [SPARK-21867][CORE] Support async spilling in UnsafeShuf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19955 **[Test build #93051 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93051/testReport)** for PR 19955 at commit [`59e7720`](https://github.com/apache/spark/commit/59e7720cf0895d4359decdee57eec6fc11bc2fe0). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19616: [SPARK-22404][YARN] Provide an option to use unmanaged A...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19616 **[Test build #93055 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93055/testReport)** for PR 19616 at commit [`ce94235`](https://github.com/apache/spark/commit/ce94235d4c7407f3add17885ccacc607e96f6068). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19999: JDBC support date/timestamp type as partitionColumn
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/1 **[Test build #93050 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93050/testReport)** for PR 1 at commit [`d1d310c`](https://github.com/apache/spark/commit/d1d310c6df782830378083d4bd80762591ba867e). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20304: [SPARK-23139]Read eventLog file with mixed encodings
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20304 ping @hellodengfei --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20045: [Spark-22360][SQL][TEST] Add unit tests for Window Speci...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20045 gentle ping @smurakozi --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20045: [Spark-22360][SQL][TEST] Add unit tests for Window Speci...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20045 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19999: JDBC support date/timestamp type as partitionColumn
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/1 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20090: [SPARK-22907]Clean broadcast garbage when IOException oc...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20090 ping @liupc --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19955: [SPARK-21867][CORE] Support async spilling in UnsafeShuf...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19955 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19691: [SPARK-14922][SPARK-17732][SQL]ALTER TABLE DROP PARTITIO...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19691 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19538: [SPARK-20393][WEBU UI][BACKPORT-2.0] Strengthen Spark to...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19538 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19633: [SPARK-22411][SQL] Disable the heuristic to calculate ma...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19633 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19420: [SPARK-22191] [SQL] Add hive serde example with serde pr...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19420 ping @crlalam for @holdenk's comment. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19616: [SPARK-22404][YARN] Provide an option to use unmanaged A...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19616 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #18903: [SPARK-21590][SS]Window start time should support negati...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18903 **[Test build #93048 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93048/testReport)** for PR 18903 at commit [`07e98e7`](https://github.com/apache/spark/commit/07e98e7d0903d72e66d0688dde11d481b41a63df). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19175: [SPARK-21964][SQL]Enable splitting the Aggregate (on Exp...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19175 **[Test build #93047 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93047/testReport)** for PR 19175 at commit [`d1133ca`](https://github.com/apache/spark/commit/d1133caf92fee9201f9637b828c1e6a52d715eff). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19510: [SPARK-22292][Mesos] Added spark.mem.max support for Mes...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19510 gentle ping @windkit --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21779: [SPARK-24813][TESTS][HIVE][HOTFIX][BRANCH-2.2] HiveExter...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21779 **[Test build #93046 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93046/testReport)** for PR 21779 at commit [`c9bcdbf`](https://github.com/apache/spark/commit/c9bcdbf75638365f48819aada51161a3b3fb7ae2). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19456: [SPARK] [Scheduler] Configurable default scheduling mode
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19456 ping @blyncsy-david-lewis for @varuvish 's comment. Otherwise let me propose to close it for now. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request #21779: [SPARK-24813][TESTS][HIVE][HOTFIX][BRANCH-2.2] Hi...
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/21779 [SPARK-24813][TESTS][HIVE][HOTFIX][BRANCH-2.2] HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive ## What changes were proposed in this pull request? Try only unique ASF mirrors to download Spark release; fall back to Apache archive if no mirrors available or release is not mirrored ## How was this patch tested? Existing HiveExternalCatalogVersionsSuite You can merge this pull request into a Git repository by running: $ git pull https://github.com/srowen/spark SPARK-24813.2 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/21779.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #21779 commit c9bcdbf75638365f48819aada51161a3b3fb7ae2 Author: Sean Owen Date: 2018-07-16T02:14:50Z Try only unique ASF mirrors; fall back to Apache archive if no mirrors available or release is not mirrored --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request #21770: [SPARK-24806][SQL] Brush up generated code so tha...
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21770#discussion_r202563865 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala --- @@ -1588,6 +1588,15 @@ object CodeGenerator extends Logging { def primitiveTypeName(dt: DataType): String = primitiveTypeName(javaType(dt)) + def getClassName(cls: Class[_]): String = { +try { + return Option(cls.getCanonicalName).getOrElse(cls.getName) +} catch { + case err: InternalError => --- End diff -- Anyway, `return` removed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request #21770: [SPARK-24806][SQL] Brush up generated code so tha...
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21770#discussion_r202563817 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala --- @@ -1588,6 +1588,15 @@ object CodeGenerator extends Logging { def primitiveTypeName(dt: DataType): String = primitiveTypeName(javaType(dt)) + def getClassName(cls: Class[_]): String = { +try { + return Option(cls.getCanonicalName).getOrElse(cls.getName) +} catch { + case err: InternalError => --- End diff -- Please see the commit https://github.com/apache/spark/commit/cc88d7fad16e8b5cbf7b6b9bfe412908782b4a45 and this is the same fix with [Utils.getSimpleName](https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/util/Utils.scala#L2732). Yea, I see and I think this is workaround now. Yea, in some cases, the doc says that `getCanonicalName` could return null; ``` /** * Returns the canonical name of the underlying class as * defined by the Java Language Specification. Returns null if * the underlying class does not have a canonical name (i.e., if * it is a local or anonymous class or an array whose component * type does not have a canonical name). * @return the canonical name of the underlying class if it exists, and * {@code null} otherwise. * @since 1.5 */ public String getCanonicalName() { ``` --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19175: [SPARK-21964][SQL]Enable splitting the Aggregate (on Exp...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19175 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21184: [WIP][SPARK-24051][SQL] Replace Aliases with the same ex...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21184 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93037/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21184: [WIP][SPARK-24051][SQL] Replace Aliases with the same ex...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21184 Build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #18903: [SPARK-21590][SS]Window start time should support negati...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18903 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19274: [SPARK-22056][Streaming] Add subconcurrency for KafkaRDD...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19274 ping @lonelytrooper for @koeninger's comment. Otherwise, let me propose to close this for now. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21770 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/979/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21184: [WIP][SPARK-24051][SQL] Replace Aliases with the same ex...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21184 **[Test build #93037 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93037/testReport)** for PR 21184 at commit [`d676b62`](https://github.com/apache/spark/commit/d676b6277a682894d409e314e64ece7857a97841). * This patch **fails Spark unit tests**. * This patch **does not merge cleanly**. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21770 **[Test build #93045 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93045/testReport)** for PR 21770 at commit [`9880f26`](https://github.com/apache/spark/commit/9880f26a8b763565b02b29b0be7e3597f54ff3de). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21770 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #18457: [SPARK-21241][MLlib]- Add setIntercept to StreamingLinea...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18457 ping @SoulGuedria. Seems we should fix the python style. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #18812: [SPARK-21606][SQL]HiveThriftServer2 catches OOMs on requ...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18812 gentle ping @zuotingbing --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #18918: [SPARK-21707][SQL]Improvement a special case for non-det...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18918 gentle ping @heary-cao --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21778: [SPARK-20220[DOCS] Documentation Add thrift scheduling p...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21778 **[Test build #93043 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93043/testReport)** for PR 21778 at commit [`2864a1b`](https://github.com/apache/spark/commit/2864a1b64fca7980bab4f2e42fc8cbf6522adb37). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17648: [SPARK-19851] Add support for EVERY and ANY (SOME) aggre...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17648 **[Test build #93044 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93044/testReport)** for PR 17648 at commit [`e0b5cc6`](https://github.com/apache/spark/commit/e0b5cc68297f15625c9dc36414f6c7787ad36b52). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21778: [SPARK-20220[DOCS] Documentation Add thrift scheduling p...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21778 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/978/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #18229: [SPARK-20691][CORE] Difference between Storage Memory as...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18229 gentle ping @mkesselaers --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21778: [SPARK-20220[DOCS] Documentation Add thrift scheduling p...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21778 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #18034: [SPARK-20797][MLLIB]fix LocalLDAModel.save() bug.
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18034 Any update? seems the author looks inactive. Please let me know if I am not mistaken. Let me leave this closed if so. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21776: [SPARK-24813][TESTS][HIVE][HOTFIX] HiveExternalCatalogVe...
Github user srowen commented on the issue: https://github.com/apache/spark/pull/21776 OK will see if the older branches need this or not; I forget when this test suite was introduced. Thanks! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21778: [SPARK-20220[DOCS] Documentation Add thrift scheduling p...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21778 cc @gatorsmile and @srowen --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17648: [SPARK-19851] Add support for EVERY and ANY (SOME) aggre...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17648 @ptkool mind updating the PR please? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17648: [SPARK-19851] Add support for EVERY and ANY (SOME) aggre...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17648 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #17536: SPARK-20220 Documentation Add thrift scheduling pool con...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17536 I submitted https://github.com/apache/spark/pull/21778 to take this over. Will close this manually since the author looks inactive. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request #21778: [SPARK-20220[DOCS] Documentation Add thrift sched...
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/21778 [SPARK-20220[DOCS] Documentation Add thrift scheduling pool config to scheduling docs ## What changes were proposed in this pull request? This PR takes over #17536 and handle some comments here. ## How was this patch tested? Manually. Closes #17536 You can merge this pull request into a Git repository by running: $ git pull https://github.com/HyukjinKwon/spark SPARK-20220 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/21778.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #21778 commit 2864a1b64fca7980bab4f2e42fc8cbf6522adb37 Author: hyukjinkwon Date: 2018-07-16T02:01:27Z Documentation Add thrift scheduling pool config to scheduling docs --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request #21770: [SPARK-24806][SQL] Brush up generated code so tha...
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21770#discussion_r202562989 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala --- @@ -890,7 +890,7 @@ case class Cast(child: Expression, dataType: DataType, timeZoneId: Option[String case StringType => val intOpt = ctx.freshName("intOpt") (c, evPrim, evNull) => s""" -scala.Option $intOpt = +scala.Option $intOpt = --- End diff -- I don't look into the bytecode that JDK compilers generate though, the type of the return value seems to be erased in the bytecode; ``` ... /* 045 */ scala.Option intOpt_0 = /* 046 */ org.apache.spark.sql.catalyst.util.DateTimeUtils.stringToDate(((UTF8String) references[0] /* literal */)); /* 047 */ if (intOpt_0.isDefined()) { /* 048 */ value_1 = ((Integer) intOpt_0.get()).intValue(); /* 049 */ } else { /* 050 */ isNull_1 = true; /* 051 */ } /* 052 */ ... - Day / DayOfMonth *** FAILED *** Code generation of dayofmonth(cast(2000-02-29 as date)) failed: java.util.concurrent.ExecutionException: org.codehaus.commons.compiler.CompileException: failed to compile: (Line 67, Column 62) incompatible types: scala.Option cannot be converted to scala.Option java.util.concurrent.ExecutionException: org.codehaus.commons.compiler.CompileException: failed to compile: (Line 67, Column 62) incompatible types: scala.Option cannot be converted to scala.Option at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:306) at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:293) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116) ``` --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21770 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21770 **[Test build #93042 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93042/testReport)** for PR 21770 at commit [`9fdbefd`](https://github.com/apache/spark/commit/9fdbefd4eeb41a0633cc165d5fb7970060f129b0). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21770 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/977/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...
Github user maropu commented on the issue: https://github.com/apache/spark/pull/21770 @srowen Thx for the comment. aha, I see, It looks reasonable to me. We should try to fix so. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...
Github user maropu commented on the issue: https://github.com/apache/spark/pull/21770 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21589: [SPARK-24591][CORE] Number of cores and executors in the...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21589 **[Test build #93041 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93041/testReport)** for PR 21589 at commit [`128f6f0`](https://github.com/apache/spark/commit/128f6f0c3fc3b89b32554bdd40dddf784d274079). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21707: Update for spark 2.2.2 release
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21707 **[Test build #93040 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93040/testReport)** for PR 21707 at commit [`c0c2613`](https://github.com/apache/spark/commit/c0c26136b2b19f651f2d430d0b331a5eda0ed5bb). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21773: [SPARK-24810][SQL] Fix paths to test files in AvroSuite
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21773 **[Test build #93039 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93039/testReport)** for PR 21773 at commit [`98354ec`](https://github.com/apache/spark/commit/98354ecb716f2578bb699c03869b0344e46f960a). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21707: Update for spark 2.2.2 release
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21707 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/976/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21707: Update for spark 2.2.2 release
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21707 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request #21776: [SPARK-24813][TESTS][HIVE][HOTFIX] HiveExternalCa...
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/21776 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21589: [SPARK-24591][CORE] Number of cores and executors in the...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21589 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21773: [SPARK-24810][SQL] Fix paths to test files in AvroSuite
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21773 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21707: Update for spark 2.2.2 release
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21707 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21776: [SPARK-24813][TESTS][HIVE][HOTFIX] HiveExternalCatalogVe...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21776 Merged to master and branch-2.3. Seems it has conflicts to other branches. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21731: Update example to work locally
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21731 ping @ets, mind closing this? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21777: [WIP][SPARK-24498][SQL] Add JDK compiler for runtime cod...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21777 **[Test build #93038 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93038/testReport)** for PR 21777 at commit [`523bf3d`](https://github.com/apache/spark/commit/523bf3d96d21ebf07aa87b1842ea58a840d2c33b). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21777: [WIP][SPARK-24498][SQL] Add JDK compiler for runtime cod...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21777 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21777: [WIP][SPARK-24498][SQL] Add JDK compiler for runtime cod...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21777 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/975/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request #21777: [WIP][SPARK-24498][SQL] Add JDK compiler for runt...
GitHub user kiszk opened a pull request: https://github.com/apache/spark/pull/21777 [WIP][SPARK-24498][SQL] Add JDK compiler for runtime codegen ## What changes were proposed in this pull request? This PR allow a user to select Javac bytecode compiler to compile a DataFrame/Dataset program. Details will be filled later. This PR is based on @maropu's implementation. ## How was this patch tested? Added `CompilerSuite` You can merge this pull request into a Git repository by running: $ git pull https://github.com/kiszk/spark SPARK-24498 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/21777.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #21777 commit 669e8737af8bc2e383aeb7a25b3687c882fdaf10 Author: Takeshi Yamamuro Date: 2018-06-18T12:33:43Z Add a compiler option for JDK commit fbac0899203963aa99331d2c6f82e657409e2d9b Author: Kazuaki Ishizaki Date: 2018-06-25T02:04:13Z refactoring commit 84d71da785361a46eb9c731f8aa1e09b173bdcde Author: Kazuaki Ishizaki Date: 2018-07-16T00:40:22Z add test cases rebase master commit 523bf3d96d21ebf07aa87b1842ea58a840d2c33b Author: Kazuaki Ishizaki Date: 2018-07-16T00:45:39Z shorten import --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21776: [SPARK-24813][TESTS][HIVE][HOTFIX] HiveExternalCatalogVe...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21776 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21776: [SPARK-24813][TESTS][HIVE][HOTFIX] HiveExternalCatalogVe...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21776 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93036/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21776: [SPARK-24813][TESTS][HIVE][HOTFIX] HiveExternalCatalogVe...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21776 **[Test build #93036 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93036/testReport)** for PR 21776 at commit [`a4641e8`](https://github.com/apache/spark/commit/a4641e855245961f046707f7d784d53840fd9a14). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21652: [SPARK-24551][K8S] Add integration tests for secrets
Github user skonto commented on the issue: https://github.com/apache/spark/pull/21652 ok will do :+1: --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21773: [SPARK-24810][SQL] Fix paths to test files in AvroSuite
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21773 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93035/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21773: [SPARK-24810][SQL] Fix paths to test files in AvroSuite
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21773 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21773: [SPARK-24810][SQL] Fix paths to test files in AvroSuite
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21773 **[Test build #93035 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93035/testReport)** for PR 21773 at commit [`98354ec`](https://github.com/apache/spark/commit/98354ecb716f2578bb699c03869b0344e46f960a). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_: * `class AvroDeserializer(rootAvroType: Schema, rootCatalystType: DataType) ` * ` sealed trait CatalystDataUpdater ` * ` final class RowUpdater(row: InternalRow) extends CatalystDataUpdater ` * ` final class ArrayDataUpdater(array: ArrayData) extends CatalystDataUpdater ` * `class AvroSerializer(rootCatalystType: DataType, rootAvroType: Schema, nullable: Boolean) ` * `class IncompatibleSchemaException(msg: String, ex: Throwable = null) extends Exception(msg, ex)` * `class SerializableSchema(@transient var value: Schema)` --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21184: [WIP][SPARK-24051][SQL] Replace Aliases with the same ex...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21184 **[Test build #93037 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93037/testReport)** for PR 21184 at commit [`d676b62`](https://github.com/apache/spark/commit/d676b6277a682894d409e314e64ece7857a97841). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request #21755: Doc fix: The Imputer is an Estimator
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/21755 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request #21764: [SPARK-24802] Optimization Rule Exclusion
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/21764#discussion_r202556147 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -127,6 +127,14 @@ object SQLConf { } } + val OPTIMIZER_EXCLUDED_RULES = buildConf("spark.sql.optimizer.excludedRules") --- End diff -- If we allow this here, this will affect Spark's caching/uncaching plans and tables inconsistently. For the purpose of this PR, `StaticSQLConf.scala` would be a perfect place for this. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21755: Doc fix: The Imputer is an Estimator
Github user srowen commented on the issue: https://github.com/apache/spark/pull/21755 I'm sure the failure is spurious, so merged to master. PS see https://spark.apache.org/contributing.html --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21776: [SPARK-24813][TESTS][HIVE][HOTFIX] HiveExternalCatalogVe...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21776 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/974/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21776: [SPARK-24813][TESTS][HIVE][HOTFIX] HiveExternalCatalogVe...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21776 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21776: [SPARK-24813][TESTS][HIVE][HOTFIX] HiveExternalCatalogVe...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21776 **[Test build #93036 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93036/testReport)** for PR 21776 at commit [`a4641e8`](https://github.com/apache/spark/commit/a4641e855245961f046707f7d784d53840fd9a14). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request #21776: [SPARK-24813][TESTS][HIVE][HOTFIX] HiveExternalCa...
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/21776 [SPARK-24813][TESTS][HIVE][HOTFIX] HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive ## What changes were proposed in this pull request? Try only unique ASF mirrors to download Spark release; fall back to Apache archive if no mirrors available or release is not mirrored ## How was this patch tested? Existing HiveExternalCatalogVersionsSuite You can merge this pull request into a Git repository by running: $ git pull https://github.com/srowen/spark SPARK-24813 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/21776.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #21776 commit a4641e855245961f046707f7d784d53840fd9a14 Author: Sean Owen Date: 2018-07-15T21:55:09Z Try only unique ASF mirrors; fall back to Apache archive if no mirrors available or release is not mirrored --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21773: [SPARK-24810][SQL] Fix paths to test files in AvroSuite
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21773 **[Test build #93035 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93035/testReport)** for PR 21773 at commit [`98354ec`](https://github.com/apache/spark/commit/98354ecb716f2578bb699c03869b0344e46f960a). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21589: [SPARK-24591][CORE] Number of cores and executors in the...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21589 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21589: [SPARK-24591][CORE] Number of cores and executors in the...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21589 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93031/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21589: [SPARK-24591][CORE] Number of cores and executors in the...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21589 **[Test build #93031 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93031/testReport)** for PR 21589 at commit [`128f6f0`](https://github.com/apache/spark/commit/128f6f0c3fc3b89b32554bdd40dddf784d274079). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21755: Doc fix: The Imputer is an Estimator
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21755 **[Test build #4214 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4214/testReport)** for PR 21755 at commit [`19cd33b`](https://github.com/apache/spark/commit/19cd33bccc86e4ec8c33a29fda04c5e9eb84925e). * This patch **fails Spark unit tests**. * This patch **does not merge cleanly**. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21765: [MINOR][CORE] Add test cases for RDD.cartesian
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21765 **[Test build #4213 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4213/testReport)** for PR 21765 at commit [`9df4c3b`](https://github.com/apache/spark/commit/9df4c3b4a71082181aa979c3bddf2c3d99db256e). * This patch **fails Spark unit tests**. * This patch **does not merge cleanly**. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21773: [SPARK-24810][SQL] Fix paths to test files in AvroSuite
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21773 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93033/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21773: [SPARK-24810][SQL] Fix paths to test files in AvroSuite
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21773 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21773: [SPARK-24810][SQL] Fix paths to test files in AvroSuite
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21773 **[Test build #93033 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93033/testReport)** for PR 21773 at commit [`09f0372`](https://github.com/apache/spark/commit/09f0372e2d4213a6d5d99a3e42e669352949a242). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21769: [SPARK-24805][SQL] Do not ignore avro files without exte...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21769 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21769: [SPARK-24805][SQL] Do not ignore avro files without exte...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21769 **[Test build #93034 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93034/testReport)** for PR 21769 at commit [`91e40e7`](https://github.com/apache/spark/commit/91e40e7686b82aae1b34329e961a0a9eb20bec47). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21769: [SPARK-24805][SQL] Do not ignore avro files without exte...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21769 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93034/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org