[GitHub] spark issue #20837: [SPARK-23686][ML][WIP] Better instrumentation

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20837 **[Test build #88274 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88274/testReport)** for PR 20837 at commit

[GitHub] spark pull request #20669: [SPARK-22839][K8S] Remove the use of init-contain...

Github user liyinan926 commented on a diff in the pull request: https://github.com/apache/spark/pull/20669#discussion_r174902939 --- Diff: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/KubernetesClientApplication.scala --- @@ -110,30 +109,29

[GitHub] spark pull request #20669: [SPARK-22839][K8S] Remove the use of init-contain...

Github user ifilonenko commented on a diff in the pull request: https://github.com/apache/spark/pull/20669#discussion_r174902563 --- Diff: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/KubernetesClientApplication.scala --- @@ -110,30 +109,29

[GitHub] spark issue #20835: [HOT-FIX] Fix SparkOutOfMemoryError: Unable to acquire 2...

Github user kiszk commented on the issue: https://github.com/apache/spark/pull/20835 @hvanhovell @wangyum Thank you very much. LGTM for now. I thought the same immediate fix. Is it better to create a standalone test case like

[GitHub] spark issue #20659: [DO-NOT-MERGE] Try to update Hive to 2.3.2

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20659 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20659: [DO-NOT-MERGE] Try to update Hive to 2.3.2

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20659 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88269/ Test FAILed. ---

[GitHub] spark issue #20659: [DO-NOT-MERGE] Try to update Hive to 2.3.2

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20659 **[Test build #88269 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88269/testReport)** for PR 20659 at commit

[GitHub] spark pull request #20835: [HOT-FIX] Fix SparkOutOfMemoryError: Unable to ac...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20835 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #20835: [HOT-FIX] Fix SparkOutOfMemoryError: Unable to acquire 2...

Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/20835 Merging to master. Thanks! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #20835: [HOT-FIX] Fix SparkOutOfMemoryError: Unable to acquire 2...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20835 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88268/ Test PASSed. ---

[GitHub] spark issue #20835: [HOT-FIX] Fix SparkOutOfMemoryError: Unable to acquire 2...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20835 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20835: [HOT-FIX] Fix SparkOutOfMemoryError: Unable to acquire 2...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20835 **[Test build #88268 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88268/testReport)** for PR 20835 at commit

[GitHub] spark issue #20824: [SPARK-23683][SQL][FOLLOW-UP] FileCommitProtocol.instant...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20824 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88267/ Test PASSed. ---

[GitHub] spark issue #20824: [SPARK-23683][SQL][FOLLOW-UP] FileCommitProtocol.instant...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20824 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20750: [SPARK-23581][SQL] Add interpreted unsafe project...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20750#discussion_r174892728 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/InterpretedUnsafeProjection.scala --- @@ -0,0 +1,366 @@ +/* + *

[GitHub] spark issue #20824: [SPARK-23683][SQL][FOLLOW-UP] FileCommitProtocol.instant...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20824 **[Test build #88267 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88267/testReport)** for PR 20824 at commit

[GitHub] spark pull request #20750: [SPARK-23581][SQL] Add interpreted unsafe project...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20750#discussion_r174892448 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/InterpretedUnsafeProjection.scala --- @@ -0,0 +1,366 @@ +/* + *

[GitHub] spark pull request #20750: [SPARK-23581][SQL] Add interpreted unsafe project...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20750#discussion_r174890611 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/InterpretedUnsafeProjection.scala --- @@ -0,0 +1,366 @@ +/* + *

[GitHub] spark issue #20579: [SPARK-23372][SQL] Writing empty struct in parquet fails...

Github user dilipbiswal commented on the issue: https://github.com/apache/spark/pull/20579 @cloud-fan @rdblue Thank you for clarification. I am sorry, i hadn't seen your comments before i pushed the last change which targets only parquet. I will adjust the fix to target all formats

[GitHub] spark issue #20837: [SPARK-23686][ML][WIP] Better instrumentation

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20837 **[Test build #88274 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88274/testReport)** for PR 20837 at commit

[GitHub] spark issue #20837: [SPARK-23686][ML][WIP] Better instrumentation

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20837 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20837: [SPARK-23686][ML][WIP] Better instrumentation

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20837 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1538/

[GitHub] spark pull request #20837: [SPARK-23686][ML][WIP] Better instrumentation

GitHub user MrBago opened a pull request: https://github.com/apache/spark/pull/20837 [SPARK-23686][ML][WIP] Better instrumentation ## What changes were proposed in this pull request? This PR is meant to show how we could better utilize the Instrumentation class in

[GitHub] spark issue #20579: [SPARK-23372][SQL] Writing empty struct in parquet fails...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20579 **[Test build #88273 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88273/testReport)** for PR 20579 at commit

[GitHub] spark issue #20579: [SPARK-23372][SQL] Writing empty struct in parquet fails...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20579 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1537/

[GitHub] spark issue #20579: [SPARK-23372][SQL] Writing empty struct in parquet fails...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20579 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20834: [SPARK-23695][PYTHON] Fix the error message for K...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20834 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #20834: [SPARK-23695][PYTHON] Fix the error message for Kinesis ...

Github user ueshin commented on the issue: https://github.com/apache/spark/pull/20834 Thanks! merging to master/2.3. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark pull request #20750: [SPARK-23581][SQL] Add interpreted unsafe project...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20750#discussion_r174873582 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/InterpretedUnsafeProjection.scala --- @@ -0,0 +1,366 @@ +/* + *

[GitHub] spark pull request #20750: [SPARK-23581][SQL] Add interpreted unsafe project...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20750#discussion_r174871585 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Expression.scala --- @@ -328,6 +328,32 @@ trait Nondeterministic extends

[GitHub] spark issue #20835: [HOT-FIX] Fix SparkOutOfMemoryError: Unable to acquire 2...

Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/20835 @kiszk do we have a more reasonable way to test this? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #20835: [HOT-FIX] Fix SparkOutOfMemoryError: Unable to acquire 2...

Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/20835 LGTM --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20830: [SPARK-23691][PYTHON] Use sql_conf util in PySpar...

Github user BryanCutler commented on a diff in the pull request: https://github.com/apache/spark/pull/20830#discussion_r174868549 --- Diff: python/pyspark/sql/tests.py --- @@ -2461,17 +2461,13 @@ def test_join_without_on(self): df1 = self.spark.range(1).toDF("a")

[GitHub] spark issue #20611: [SPARK-23425][SQL]Support wildcard in HDFS path for load...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20611 **[Test build #88272 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88272/testReport)** for PR 20611 at commit

[GitHub] spark pull request #20611: [SPARK-23425][SQL]Support wildcard in HDFS path f...

Github user sujith71955 commented on a diff in the pull request: https://github.com/apache/spark/pull/20611#discussion_r174868215 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -385,8 +385,12 @@ case class LoadDataCommand(

[GitHub] spark issue #20834: [SPARK-23695][PYTHON] Fix the error message for Kinesis ...

Github user ueshin commented on the issue: https://github.com/apache/spark/pull/20834 LGTM. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20831: [SPARK-23614][SQL] Fix incorrect reuse exchange when cac...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20831 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20831: [SPARK-23614][SQL] Fix incorrect reuse exchange when cac...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20831 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88266/ Test PASSed. ---

[GitHub] spark pull request #20777: [SPARK-23615][ML][PYSPARK]Add maxDF Parameter to ...

Github user BryanCutler commented on a diff in the pull request: https://github.com/apache/spark/pull/20777#discussion_r174864748 --- Diff: python/pyspark/ml/feature.py --- @@ -465,26 +473,26 @@ class CountVectorizer(JavaEstimator, HasInputCol, HasOutputCol, JavaMLReadable,

[GitHub] spark issue #20831: [SPARK-23614][SQL] Fix incorrect reuse exchange when cac...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20831 **[Test build #88266 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88266/testReport)** for PR 20831 at commit

[GitHub] spark issue #20828: [SPARK-23687][SS] Add a memory source for continuous pro...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20828 **[Test build #88271 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88271/testReport)** for PR 20828 at commit

[GitHub] spark pull request #20777: [SPARK-23615][ML][PYSPARK]Add maxDF Parameter to ...

Github user BryanCutler commented on a diff in the pull request: https://github.com/apache/spark/pull/20777#discussion_r174863155 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/CountVectorizer.scala --- @@ -70,19 +70,21 @@ private[feature] trait CountVectorizerParams

[GitHub] spark issue #20836: SPARK-23685 : Fix for the Spark Structured Streaming Kaf...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20836 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #19381: [SPARK-10884][ML] Support prediction on single in...

Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/19381#discussion_r174862550 --- Diff: mllib/src/test/scala/org/apache/spark/ml/util/MLTest.scala --- @@ -109,4 +110,14 @@ trait MLTest extends StreamTest with TempDirectory { self:

[GitHub] spark issue #20836: SPARK-23685 : Fix for the Spark Structured Streaming Kaf...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20836 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20830: [SPARK-23691][PYTHON] Use sql_conf util in PySpar...

Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/20830#discussion_r174857693 --- Diff: python/pyspark/sql/tests.py --- @@ -3551,12 +3544,12 @@ def test_null_conversion(self): self.assertTrue(all([c == 1 for c in

[GitHub] spark pull request #20836: SPARK-23685 : Fix for the Spark Structured Stream...

GitHub user sirishaSindri opened a pull request: https://github.com/apache/spark/pull/20836 SPARK-23685 : Fix for the Spark Structured Streaming Kafka 0.10 Consu… …mer Can't Handle Non-consecutive Offsets ## What changes were proposed in this pull request? In

[GitHub] spark issue #20750: [SPARK-23581][SQL] Add interpreted unsafe projection

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20750 **[Test build #88270 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88270/testReport)** for PR 20750 at commit

[GitHub] spark issue #20750: [SPARK-23581][SQL] Add interpreted unsafe projection

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20750 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1536/

[GitHub] spark issue #20750: [SPARK-23581][SQL] Add interpreted unsafe projection

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20750 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20659: [DO-NOT-MERGE] Try to update Hive to 2.3.2

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20659 **[Test build #88269 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88269/testReport)** for PR 20659 at commit

[GitHub] spark issue #20659: [DO-NOT-MERGE] Try to update Hive to 2.3.2

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20659 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1535/

[GitHub] spark issue #20659: [DO-NOT-MERGE] Try to update Hive to 2.3.2

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20659 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20835: [HOT-FIX] Fix SparkOutOfMemoryError: Unable to acquire 2...

Github user wangyum commented on the issue: https://github.com/apache/spark/pull/20835 cc @kiszk @hvanhovell --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #19041: [SPARK-21097][CORE] Add option to recover cached ...

Github user brad-kaiser commented on a diff in the pull request: https://github.com/apache/spark/pull/19041#discussion_r174831270 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala --- @@ -246,6 +251,38 @@ class BlockManagerMasterEndpoint(

[GitHub] spark pull request #20824: [SPARK-23683][SQL][FOLLOW-UP] FileCommitProtocol....

Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/20824#discussion_r174829859 --- Diff: core/src/main/scala/org/apache/spark/internal/io/FileCommitProtocol.scala --- @@ -145,15 +146,23 @@ object FileCommitProtocol {

[GitHub] spark pull request #20727: [SPARK-23577][SQL] Supports custom line separator...

Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/20727#discussion_r174828198 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/text/TextOptions.scala --- @@ -39,9 +39,12 @@ private[text] class

[GitHub] spark issue #20835: [HOT-FIX] Fix SparkOutOfMemoryError: Unable to acquire 2...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20835 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20835: [HOT-FIX] Fix SparkOutOfMemoryError: Unable to acquire 2...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20835 **[Test build #88268 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88268/testReport)** for PR 20835 at commit

[GitHub] spark issue #20835: [HOT-FIX] Fix SparkOutOfMemoryError: Unable to acquire 2...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20835 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1534/

[GitHub] spark issue #20833: [SPARK-23692][SQL]Print metadata of files when infer sch...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20833 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88264/ Test PASSed. ---

[GitHub] spark issue #20833: [SPARK-23692][SQL]Print metadata of files when infer sch...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20833 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20833: [SPARK-23692][SQL]Print metadata of files when infer sch...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20833 **[Test build #88264 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88264/testReport)** for PR 20833 at commit

[GitHub] spark pull request #20835: [HOT-FIX] Fix SparkOutOfMemoryError: Unable to ac...

GitHub user wangyum opened a pull request: https://github.com/apache/spark/pull/20835 [HOT-FIX] Fix SparkOutOfMemoryError: Unable to acquire 262144 bytes of memory, got 224631 ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix)

[GitHub] spark pull request #20727: [SPARK-23577][SQL] Supports custom line separator...

Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/20727#discussion_r174821385 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/text/TextOptions.scala --- @@ -39,9 +39,12 @@ private[text] class

[GitHub] spark pull request #20826: [Spark-2489][SQL] Unsupported parquet datatype op...

Github user aws-awinstan commented on a diff in the pull request: https://github.com/apache/spark/pull/20826#discussion_r174817518 --- Diff: sql/core/src/test/gen-java/org/apache/spark/sql/execution/datasources/parquet/test/avro/AvroArrayOfArray.java --- @@ -1,39 +1,45 @@

[GitHub] spark pull request #20817: [SPARK-23599][SQL] Add a UUID generator from Pseu...

Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/20817#discussion_r174811371 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/RandomUUIDGenerator.scala --- @@ -0,0 +1,39 @@ +/* + * Licensed to the

[GitHub] spark issue #20824: [SPARK-23683][SQL][FOLLOW-UP] FileCommitProtocol.instant...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20824 **[Test build #88267 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88267/testReport)** for PR 20824 at commit

[GitHub] spark issue #20824: [SPARK-23683][SQL][FOLLOW-UP] FileCommitProtocol.instant...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20824 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1533/

[GitHub] spark issue #20824: [SPARK-23683][SQL][FOLLOW-UP] FileCommitProtocol.instant...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20824 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20824: [SPARK-23683][SQL][FOLLOW-UP] FileCommitProtocol.instant...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20824 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20824: [SPARK-23683][SQL][FOLLOW-UP] FileCommitProtocol.instant...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20824 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20824: [SPARK-23683][SQL][FOLLOW-UP] FileCommitProtocol....

Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/20824#discussion_r174801694 --- Diff: core/src/main/scala/org/apache/spark/internal/io/FileCommitProtocol.scala --- @@ -145,15 +146,23 @@ object FileCommitProtocol {

[GitHub] spark issue #20787: Documenting months_between direction

Github user aditkumar commented on the issue: https://github.com/apache/spark/pull/20787 @HyukjinKwon I think these address your comments. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #20803: [SPARK-23653][SQL] Show sql statement in spark SQL UI

Github user LantaoJin commented on the issue: https://github.com/apache/spark/pull/20803 @cloud-fan @jerryshao In the last commit, seems I faced a Scala bug. :-( > [error] /Users/lajin/git/my/spark/sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala:63: in object

[GitHub] spark issue #20831: [SPARK-23614][SQL] Fix incorrect reuse exchange when cac...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20831 **[Test build #88266 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88266/testReport)** for PR 20831 at commit

[GitHub] spark issue #20831: [SPARK-23614][SQL] Fix incorrect reuse exchange when cac...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20831 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1532/

[GitHub] spark issue #20831: [SPARK-23614][SQL] Fix incorrect reuse exchange when cac...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20831 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20611: [SPARK-23425][SQL]Support wildcard in HDFS path f...

Github user sujith71955 commented on a diff in the pull request: https://github.com/apache/spark/pull/20611#discussion_r174791662 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -385,8 +385,12 @@ case class LoadDataCommand(

[GitHub] spark issue #20824: [SPARK-23683][SQL][FOLLOW-UP] FileCommitProtocol.instant...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20824 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20824: [SPARK-23683][SQL][FOLLOW-UP] FileCommitProtocol.instant...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20824 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88263/ Test FAILed. ---

[GitHub] spark issue #20611: [SPARK-23425][SQL]Support wildcard in HDFS path for load...

Github user sujith71955 commented on the issue: https://github.com/apache/spark/pull/20611 Yeah there is a bit confusing, i updated the snapshot, data validation and consistency i verified --- - To unsubscribe,

[GitHub] spark issue #20824: [SPARK-23683][SQL][FOLLOW-UP] FileCommitProtocol.instant...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20824 **[Test build #88263 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88263/testReport)** for PR 20824 at commit

[GitHub] spark issue #20787: Documenting months_between direction

Github user aditkumar commented on the issue: https://github.com/apache/spark/pull/20787 This makes sense, I can make the changes this morning. On Thu, Mar 15, 2018 at 8:55 AM Hyukjin Kwon wrote: > gentle ping @aditkumar

[GitHub] spark issue #20834: [SPARK-23695][PYTHON] Fix the error message for Kinesis ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20834 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20834: [SPARK-23695][PYTHON] Fix the error message for Kinesis ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20834 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88265/ Test PASSed. ---

[GitHub] spark issue #20834: [SPARK-23695][PYTHON] Fix the error message for Kinesis ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20834 **[Test build #88265 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88265/testReport)** for PR 20834 at commit

[GitHub] spark pull request #20611: [SPARK-23425][SQL]Support wildcard in HDFS path f...

Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/20611#discussion_r174771588 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -385,8 +385,12 @@ case class LoadDataCommand( val

[GitHub] spark pull request #20611: [SPARK-23425][SQL]Support wildcard in HDFS path f...

Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/20611#discussion_r174773206 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -385,8 +385,12 @@ case class LoadDataCommand( val

[GitHub] spark issue #20787: Documenting months_between direction

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20787 gentle ping @aditkumar --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20798: [SPARK-23645][PYTHON] Allow python udfs to be called wit...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20798 @mstewart141, how about we start this by documenting that? --- - To unsubscribe, e-mail:

[GitHub] spark issue #20611: [SPARK-23425][SQL]Support wildcard in HDFS path for load...

Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/20611 @sujith71955 In the tests, why case2 has less data than case1? '/tmp/hive/dat*/*' has more files than '/tmp/hive/dat1/type*', right? ---

[GitHub] spark pull request #20831: [SPARK-23614][SQL] Fix incorrect reuse exchange w...

Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20831#discussion_r174768746 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryRelation.scala --- @@ -68,6 +69,15 @@ case class InMemoryRelation(

[GitHub] spark issue #20834: [SPARK-23695][PYTHON] Fix the error message for Kinesis ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20834 **[Test build #88265 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88265/testReport)** for PR 20834 at commit

[GitHub] spark issue #20834: [SPARK-23695][PYTHON] Fix the error message for Kinesis ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20834 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20834: [SPARK-23695][PYTHON] Fix the error message for Kinesis ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20834 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1531/

[GitHub] spark issue #20834: [SPARK-23695][PYTHON] Fix the error message for Kinesis ...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20834 cc @ueshin --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20834: [SPARK-23695][PYTHON] Fix the error message for K...

GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/20834 [SPARK-23695][PYTHON] Fix the error message for Kinesis streaming tests ## What changes were proposed in this pull request? ```bash ENABLE_KINESIS_TESTS=1 SPARK_TESTING=1

[GitHub] spark pull request #20831: [SPARK-23614][SQL] Fix incorrect reuse exchange w...

Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/20831#discussion_r174764688 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryRelation.scala --- @@ -68,6 +69,15 @@ case class InMemoryRelation(

[GitHub] spark issue #20659: [DO-NOT-MERGE] Try to update Hive to 2.3.2

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20659 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

<    1   2   3   4   >