[GitHub] BryanCutler commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
BryanCutler commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445886897 Hey @holdenk , yeah we could do that but I'm ok with the current way which

[GitHub] BryanCutler commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
BryanCutler commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445887027 retest this please

[GitHub] SparkQA commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
SparkQA commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445887183 **[Test build #99924 has

[GitHub] AmplabJenkins commented on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance URL: https://github.com/apache/spark/pull/23262#issuecomment-445891152 Test PASSed. Refer to this link for build results (access rights to

[GitHub] AmplabJenkins removed a comment on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-445894461 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-445894461 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] hvanhovell commented on a change in pull request #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

2018-12-10 Thread GitBox
hvanhovell commented on a change in pull request #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#discussion_r240300150 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23277: [SPARK-26327][SQL] Metrics in FileSourceScanExec not update correctly

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #23277: [SPARK-26327][SQL] Metrics in FileSourceScanExec not update correctly URL: https://github.com/apache/spark/pull/23277#issuecomment-445893199 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-445894455 Merged build finished. Test PASSed. This is an

[GitHub] SparkQA removed a comment on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance

2018-12-10 Thread GitBox
SparkQA removed a comment on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance URL: https://github.com/apache/spark/pull/23262#issuecomment-445815532 **[Test build #99913 has

[GitHub] squito commented on issue #22612: [SPARK-24958][CORE] Add memory from procfs to executor metrics.

2018-12-10 Thread GitBox
squito commented on issue #22612: [SPARK-24958][CORE] Add memory from procfs to executor metrics. URL: https://github.com/apache/spark/pull/22612#issuecomment-445895902 merged to master, thanks @rezasafi This is an

[GitHub] AmplabJenkins commented on issue #21881: [SPARK-24930][SQL] Improve exception information when using LOAD DATA LOCAL INPATH

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #21881: [SPARK-24930][SQL] Improve exception information when using LOAD DATA LOCAL INPATH URL: https://github.com/apache/spark/pull/21881#issuecomment-445898969 Can one of the admins verify this patch?

[GitHub] vanzin commented on a change in pull request #22904: [SPARK-25887][K8S] Configurable K8S context support

2018-12-10 Thread GitBox
vanzin commented on a change in pull request #22904: [SPARK-25887][K8S] Configurable K8S context support URL: https://github.com/apache/spark/pull/22904#discussion_r240308164 ## File path:

[GitHub] AmplabJenkins commented on issue #23279: [SPARK-26328][SQL] Use GenerateOrdering for group key comparision in WindowExec

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #23279: [SPARK-26328][SQL] Use GenerateOrdering for group key comparision in WindowExec URL: https://github.com/apache/spark/pull/23279#issuecomment-445924303 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23279: [SPARK-26328][SQL] Use GenerateOrdering for group key comparision in WindowExec

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #23279: [SPARK-26328][SQL] Use GenerateOrdering for group key comparision in WindowExec URL: https://github.com/apache/spark/pull/23279#issuecomment-445924296 Merged build finished. Test PASSed.

[GitHub] SparkQA commented on issue #23279: [SPARK-26328][SQL] Use GenerateOrdering for group key comparision in WindowExec

2018-12-10 Thread GitBox
SparkQA commented on issue #23279: [SPARK-26328][SQL] Use GenerateOrdering for group key comparision in WindowExec URL: https://github.com/apache/spark/pull/23279#issuecomment-445924518 **[Test build #99929 has

[GitHub] icexelloss commented on a change in pull request #23279: [SPARK-26328][SQL] Use GenerateOrdering for group key comparision in WindowExec

2018-12-10 Thread GitBox
icexelloss commented on a change in pull request #23279: [SPARK-26328][SQL] Use GenerateOrdering for group key comparision in WindowExec URL: https://github.com/apache/spark/pull/23279#discussion_r240331510 ## File path:

[GitHub] SparkQA commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal.

2018-12-10 Thread GitBox
SparkQA commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal. URL: https://github.com/apache/spark/pull/22911#issuecomment-445939970 **[Test build #99932 has

[GitHub] dilipbiswal commented on issue #23211: [SPARK-19712][SQL] Move PullupCorrelatedPredicates and RewritePredicateSubquery after OptimizeSubqueries

2018-12-10 Thread GitBox
dilipbiswal commented on issue #23211: [SPARK-19712][SQL] Move PullupCorrelatedPredicates and RewritePredicateSubquery after OptimizeSubqueries URL: https://github.com/apache/spark/pull/23211#issuecomment-445945148 @cloud-fan Just to make sure, so we want this new rule and associated tests

[GitHub] SparkQA commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal.

2018-12-10 Thread GitBox
SparkQA commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal. URL: https://github.com/apache/spark/pull/22911#issuecomment-445945103 Kubernetes integration test starting URL:

[GitHub] SparkQA commented on issue #23213: [SPARK-26262][SQL] Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and CODEGEN_FACTORY_MODE

2018-12-10 Thread GitBox
SparkQA commented on issue #23213: [SPARK-26262][SQL] Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and CODEGEN_FACTORY_MODE URL: https://github.com/apache/spark/pull/23213#issuecomment-445956879 **[Test build #99933 has

[GitHub] AmplabJenkins removed a comment on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445889234 Test PASSed. Refer to this link for build results (access

[GitHub] SparkQA removed a comment on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance

2018-12-10 Thread GitBox
SparkQA removed a comment on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance URL: https://github.com/apache/spark/pull/23262#issuecomment-445815524 **[Test build #99910 has

[GitHub] SparkQA commented on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance

2018-12-10 Thread GitBox
SparkQA commented on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance URL: https://github.com/apache/spark/pull/23262#issuecomment-445890454 **[Test build #99910 has

[GitHub] hvanhovell commented on a change in pull request #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

2018-12-10 Thread GitBox
hvanhovell commented on a change in pull request #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#discussion_r240299365 ## File path:

[GitHub] srowen closed pull request #22723: [SPARK-25729][CORE]It is better to replace `minPartitions` with `defaultParallelism` , when `minPartitions` is less than `defaultParallelism`

2018-12-10 Thread GitBox
srowen closed pull request #22723: [SPARK-25729][CORE]It is better to replace `minPartitions` with `defaultParallelism` , when `minPartitions` is less than `defaultParallelism` URL: https://github.com/apache/spark/pull/22723 This is a PR merged from a forked repository. As GitHub hides

[GitHub] SparkQA removed a comment on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

2018-12-10 Thread GitBox
SparkQA removed a comment on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-445815528 **[Test build #99912 has

[GitHub] AmplabJenkins removed a comment on issue #23277: [SPARK-26327][SQL] Metrics in FileSourceScanExec not update correctly

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #23277: [SPARK-26327][SQL] Metrics in FileSourceScanExec not update correctly URL: https://github.com/apache/spark/pull/23277#issuecomment-445893192 Merged build finished. Test FAILed.

[GitHub] AmplabJenkins commented on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance URL: https://github.com/apache/spark/pull/23262#issuecomment-445896751 Merged build finished. Test PASSed.

[GitHub] gatorsmile commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-10 Thread GitBox
gatorsmile commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-445899184 retest this please This is an automated message from the

[GitHub] attilapiros opened a new pull request #23278: [SPARK-24920][Core] Allow sharing Netty's memory pool allocators

2018-12-10 Thread GitBox
attilapiros opened a new pull request #23278: [SPARK-24920][Core] Allow sharing Netty's memory pool allocators URL: https://github.com/apache/spark/pull/23278 ## What changes were proposed in this pull request? Introducing shared polled ByteBuf allocators. This feature can be

[GitHub] AmplabJenkins commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-445901351 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-445901351 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-445901339 Merged build finished. Test PASSed. This is an

[GitHub] AmplabJenkins removed a comment on issue #23278: [SPARK-24920][Core] Allow sharing Netty's memory pool allocators

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #23278: [SPARK-24920][Core] Allow sharing Netty's memory pool allocators URL: https://github.com/apache/spark/pull/23278#issuecomment-445905073 Merged build finished. Test PASSed.

[GitHub] SparkQA commented on issue #23278: [SPARK-24920][Core] Allow sharing Netty's memory pool allocators

2018-12-10 Thread GitBox
SparkQA commented on issue #23278: [SPARK-24920][Core] Allow sharing Netty's memory pool allocators URL: https://github.com/apache/spark/pull/23278#issuecomment-445905307 **[Test build #99928 has

[GitHub] AmplabJenkins commented on issue #23278: [SPARK-24920][Core] Allow sharing Netty's memory pool allocators

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #23278: [SPARK-24920][Core] Allow sharing Netty's memory pool allocators URL: https://github.com/apache/spark/pull/23278#issuecomment-445905073 Merged build finished. Test PASSed. This is an

[GitHub] AmplabJenkins commented on issue #23278: [SPARK-24920][Core] Allow sharing Netty's memory pool allocators

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #23278: [SPARK-24920][Core] Allow sharing Netty's memory pool allocators URL: https://github.com/apache/spark/pull/23278#issuecomment-445905081 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23272: [SPARK-26265][Core] Fix deadlock in BytesToBytesMap.MapIterator when locking both BytesToBytesMap.MapIterator and TaskMemoryManager

2018-12-10 Thread GitBox
SparkQA commented on issue #23272: [SPARK-26265][Core] Fix deadlock in BytesToBytesMap.MapIterator when locking both BytesToBytesMap.MapIterator and TaskMemoryManager URL: https://github.com/apache/spark/pull/23272#issuecomment-445905638 **[Test build #99914 has

[GitHub] AmplabJenkins removed a comment on issue #23278: [SPARK-24920][Core] Allow sharing Netty's memory pool allocators

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #23278: [SPARK-24920][Core] Allow sharing Netty's memory pool allocators URL: https://github.com/apache/spark/pull/23278#issuecomment-445905081 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23274: [SPARK-26322][SS] Add spark.kafka.token.sasl.mechanism to ease delegation token configuration.

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #23274: [SPARK-26322][SS] Add spark.kafka.token.sasl.mechanism to ease delegation token configuration. URL: https://github.com/apache/spark/pull/23274#issuecomment-445913564 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23274: [SPARK-26322][SS] Add spark.kafka.token.sasl.mechanism to ease delegation token configuration.

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #23274: [SPARK-26322][SS] Add spark.kafka.token.sasl.mechanism to ease delegation token configuration. URL: https://github.com/apache/spark/pull/23274#issuecomment-445913564 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23274: [SPARK-26322][SS] Add spark.kafka.token.sasl.mechanism to ease delegation token configuration.

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #23274: [SPARK-26322][SS] Add spark.kafka.token.sasl.mechanism to ease delegation token configuration. URL: https://github.com/apache/spark/pull/23274#issuecomment-445913571 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] vanzin commented on a change in pull request #23252: [SPARK-26239] File-based secret key loading for SASL.

2018-12-10 Thread GitBox
vanzin commented on a change in pull request #23252: [SPARK-26239] File-based secret key loading for SASL. URL: https://github.com/apache/spark/pull/23252#discussion_r240319958 ## File path: core/src/test/scala/org/apache/spark/SecurityManagerSuite.scala ## @@ -395,9

[GitHub] vanzin commented on a change in pull request #23252: [SPARK-26239] File-based secret key loading for SASL.

2018-12-10 Thread GitBox
vanzin commented on a change in pull request #23252: [SPARK-26239] File-based secret key loading for SASL. URL: https://github.com/apache/spark/pull/23252#discussion_r240320071 ## File path: core/src/test/scala/org/apache/spark/SecurityManagerSuite.scala ## @@ -395,9

[GitHub] SparkQA commented on issue #23270: [SPARK-26317][BUILD] Upgrade SBT to 0.13.18

2018-12-10 Thread GitBox
SparkQA commented on issue #23270: [SPARK-26317][BUILD] Upgrade SBT to 0.13.18 URL: https://github.com/apache/spark/pull/23270#issuecomment-445918152 **[Test build #99918 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99918/testReport)** for PR 23270 at

[GitHub] SparkQA removed a comment on issue #23270: [SPARK-26317][BUILD] Upgrade SBT to 0.13.18

2018-12-10 Thread GitBox
SparkQA removed a comment on issue #23270: [SPARK-26317][BUILD] Upgrade SBT to 0.13.18 URL: https://github.com/apache/spark/pull/23270#issuecomment-445826720 **[Test build #99918 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99918/testReport)** for PR

[GitHub] ifilonenko commented on a change in pull request #23252: [SPARK-26239] File-based secret key loading for SASL.

2018-12-10 Thread GitBox
ifilonenko commented on a change in pull request #23252: [SPARK-26239] File-based secret key loading for SASL. URL: https://github.com/apache/spark/pull/23252#discussion_r240327773 ## File path:

[GitHub] AmplabJenkins commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445933871 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] AmplabJenkins commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445933866 Merged build finished. Test PASSed.

[GitHub] SparkQA commented on issue #23276: [SPARK-26321][SQL] Split a SQL in correct way

2018-12-10 Thread GitBox
SparkQA commented on issue #23276: [SPARK-26321][SQL] Split a SQL in correct way URL: https://github.com/apache/spark/pull/23276#issuecomment-445942572 **[Test build #99923 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99923/testReport)** for PR 23276 at

[GitHub] SparkQA commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal.

2018-12-10 Thread GitBox
SparkQA commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal. URL: https://github.com/apache/spark/pull/22911#issuecomment-445949218 Kubernetes integration test status success URL:

[GitHub] AmplabJenkins commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal.

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal. URL: https://github.com/apache/spark/pull/22911#issuecomment-445949239 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal.

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal. URL: https://github.com/apache/spark/pull/22911#issuecomment-445949247 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
SparkQA commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445889277 **[Test build #99925 has

[GitHub] AmplabJenkins commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445889234 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] AmplabJenkins commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445889224 Merged build finished. Test PASSed.

[GitHub] srowen closed pull request #23048: transform DenseVector x DenseVector sqdist from imperativ to function…

2018-12-10 Thread GitBox
srowen closed pull request #23048: transform DenseVector x DenseVector sqdist from imperativ to function… URL: https://github.com/apache/spark/pull/23048 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[GitHub] AmplabJenkins commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445898081 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] AmplabJenkins commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445898071 Merged build finished. Test FAILed.

[GitHub] SparkQA commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
SparkQA commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445897833 **[Test build #99925 has

[GitHub] AmplabJenkins commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445897948 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445897956 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] AmplabJenkins removed a comment on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445898071 Merged build finished. Test FAILed.

[GitHub] SparkQA commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-10 Thread GitBox
SparkQA commented on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-445899666 **[Test build #99926 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99926/testReport)**

[GitHub] gatorsmile commented on a change in pull request #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-10 Thread GitBox
gatorsmile commented on a change in pull request #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#discussion_r240305749 ## File path: core/src/main/scala/org/apache/spark/ui/jobs/JobPage.scala ## @@ -189,14

[GitHub] vanzin commented on a change in pull request #22904: [SPARK-25887][K8S] Configurable K8S context support

2018-12-10 Thread GitBox
vanzin commented on a change in pull request #22904: [SPARK-25887][K8S] Configurable K8S context support URL: https://github.com/apache/spark/pull/22904#discussion_r240308164 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#issuecomment-445901339 Merged build finished. Test PASSed. This is

[GitHub] AmplabJenkins removed a comment on issue #23252: [SPARK-26239] File-based secret key loading for SASL.

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #23252: [SPARK-26239] File-based secret key loading for SASL. URL: https://github.com/apache/spark/pull/23252#issuecomment-445926064 Merged build finished. Test PASSed. This is an

[GitHub] AmplabJenkins removed a comment on issue #23252: [SPARK-26239] File-based secret key loading for SASL.

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #23252: [SPARK-26239] File-based secret key loading for SASL. URL: https://github.com/apache/spark/pull/23252#issuecomment-445926067 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23252: [SPARK-26239] File-based secret key loading for SASL.

2018-12-10 Thread GitBox
SparkQA commented on issue #23252: [SPARK-26239] File-based secret key loading for SASL. URL: https://github.com/apache/spark/pull/23252#issuecomment-445926413 **[Test build #99930 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99930/testReport)** for PR

[GitHub] gatorsmile commented on a change in pull request #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

2018-12-10 Thread GitBox
gatorsmile commented on a change in pull request #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#discussion_r240347775 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445944253 Test PASSed. Refer to this link for build results (access

[GitHub] AmplabJenkins commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445944253 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] AmplabJenkins removed a comment on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445944249 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445944249 Merged build finished. Test PASSed.

[GitHub] dilipbiswal commented on a change in pull request #23211: [SPARK-19712][SQL] Move PullupCorrelatedPredicates and RewritePredicateSubquery after OptimizeSubqueries

2018-12-10 Thread GitBox
dilipbiswal commented on a change in pull request #23211: [SPARK-19712][SQL] Move PullupCorrelatedPredicates and RewritePredicateSubquery after OptimizeSubqueries URL: https://github.com/apache/spark/pull/23211#discussion_r240353357 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance URL: https://github.com/apache/spark/pull/23262#issuecomment-445896763 Test PASSed. Refer to this link for build results (access

[GitHub] AmplabJenkins removed a comment on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance URL: https://github.com/apache/spark/pull/23262#issuecomment-445896751 Merged build finished. Test PASSed.

[GitHub] gatorsmile commented on a change in pull request #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page

2018-12-10 Thread GitBox
gatorsmile commented on a change in pull request #23068: [SPARK-26098][WebUI] Show associated SQL query in Job page URL: https://github.com/apache/spark/pull/23068#discussion_r240306597 ## File path: core/src/main/scala/org/apache/spark/status/AppStatusStore.scala ## @@

[GitHub] dongjoon-hyun closed pull request #23204: Revert "[SPARK-21052][SQL] Add hash map metrics to join"

2018-12-10 Thread GitBox
dongjoon-hyun closed pull request #23204: Revert "[SPARK-21052][SQL] Add hash map metrics to join" URL: https://github.com/apache/spark/pull/23204 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance:

[GitHub] dongjoon-hyun commented on issue #23204: Revert "[SPARK-21052][SQL] Add hash map metrics to join"

2018-12-10 Thread GitBox
dongjoon-hyun commented on issue #23204: Revert "[SPARK-21052][SQL] Add hash map metrics to join" URL: https://github.com/apache/spark/pull/23204#issuecomment-445910365 I'll close this in order to collect the reviews into new PR, #23269 .

[GitHub] icexelloss commented on issue #23279: [SPARK-26328][SQL] Use GenerateOrdering for group key comparision in WindowExec

2018-12-10 Thread GitBox
icexelloss commented on issue #23279: [SPARK-26328][SQL] Use GenerateOrdering for group key comparision in WindowExec URL: https://github.com/apache/spark/pull/23279#issuecomment-445925069 cc @ueshin This is an automated

[GitHub] icexelloss commented on a change in pull request #22305: [SPARK-24561][SQL][Python] User-defined window aggregation functions with Pandas UDF (bounded window)

2018-12-10 Thread GitBox
icexelloss commented on a change in pull request #22305: [SPARK-24561][SQL][Python] User-defined window aggregation functions with Pandas UDF (bounded window) URL: https://github.com/apache/spark/pull/22305#discussion_r240331939 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23279: [SPARK-26328][SQL] Use GenerateOrdering for group key comparision in WindowExec

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #23279: [SPARK-26328][SQL] Use GenerateOrdering for group key comparision in WindowExec URL: https://github.com/apache/spark/pull/23279#issuecomment-445924303 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23279: [SPARK-26328][SQL] Use GenerateOrdering for group key comparision in WindowExec

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #23279: [SPARK-26328][SQL] Use GenerateOrdering for group key comparision in WindowExec URL: https://github.com/apache/spark/pull/23279#issuecomment-445924296 Merged build finished. Test PASSed.

[GitHub] gaborgsomogyi commented on a change in pull request #23274: [SPARK-26322][SS] Add spark.kafka.token.sasl.mechanism to ease delegation token configuration.

2018-12-10 Thread GitBox
gaborgsomogyi commented on a change in pull request #23274: [SPARK-26322][SS] Add spark.kafka.token.sasl.mechanism to ease delegation token configuration. URL: https://github.com/apache/spark/pull/23274#discussion_r240346688 ## File path:

[GitHub] vanzin commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal.

2018-12-10 Thread GitBox
vanzin commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal. URL: https://github.com/apache/spark/pull/22911#issuecomment-445939565 retest this please This is an automated

[GitHub] SparkQA commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
SparkQA commented on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445943888 **[Test build #99931 has

[GitHub] AmplabJenkins removed a comment on issue #23276: [SPARK-26321][SQL] Split a SQL in correct way

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #23276: [SPARK-26321][SQL] Split a SQL in correct way URL: https://github.com/apache/spark/pull/23276#issuecomment-445942912 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] tgravescs commented on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource

2018-12-10 Thread GitBox
tgravescs commented on issue #23223: [SPARK-26269][YARN]Yarnallocator should have same blacklist behaviour with yarn to maxmize use of cluster resource URL: https://github.com/apache/spark/pull/23223#issuecomment-445943499 ok thanks for trying. if I get a chance I can try later in the

[GitHub] SparkQA removed a comment on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
SparkQA removed a comment on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445934205 **[Test build #99931 has

[GitHub] dongjoon-hyun commented on issue #23270: [SPARK-26317][BUILD] Upgrade SBT to 0.13.18

2018-12-10 Thread GitBox
dongjoon-hyun commented on issue #23270: [SPARK-26317][BUILD] Upgrade SBT to 0.13.18 URL: https://github.com/apache/spark/pull/23270#issuecomment-445951570 Thank you, @srowen and @dbtsai and @HyukjinKwon . Merged to master.

[GitHub] AmplabJenkins removed a comment on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #22273: [SPARK-25272][PYTHON][TEST] Add test to better indicate pyarrow is installed and related tests will run URL: https://github.com/apache/spark/pull/22273#issuecomment-445889224 Merged build finished. Test PASSed.

[GitHub] SparkQA commented on issue #23277: [SPARK-26327][SQL] Metrics in FileSourceScanExec not update correctly

2018-12-10 Thread GitBox
SparkQA commented on issue #23277: [SPARK-26327][SQL] Metrics in FileSourceScanExec not update correctly URL: https://github.com/apache/spark/pull/23277#issuecomment-445892950 **[Test build #99922 has

[GitHub] SparkQA commented on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance

2018-12-10 Thread GitBox
SparkQA commented on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance URL: https://github.com/apache/spark/pull/23262#issuecomment-445895749 **[Test build #99913 has

[GitHub] AmplabJenkins commented on issue #23278: [SPARK-24920][Core] Allow sharing Netty's memory pool allocators

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #23278: [SPARK-24920][Core] Allow sharing Netty's memory pool allocators URL: https://github.com/apache/spark/pull/23278#issuecomment-445902818 Can one of the admins verify this patch? This

[GitHub] AmplabJenkins removed a comment on issue #23278: [SPARK-24920][Core] Allow sharing Netty's memory pool allocators

2018-12-10 Thread GitBox
AmplabJenkins removed a comment on issue #23278: [SPARK-24920][Core] Allow sharing Netty's memory pool allocators URL: https://github.com/apache/spark/pull/23278#issuecomment-445902681 Can one of the admins verify this patch?

[GitHub] AmplabJenkins commented on issue #23278: [SPARK-24920][Core] Allow sharing Netty's memory pool allocators

2018-12-10 Thread GitBox
AmplabJenkins commented on issue #23278: [SPARK-24920][Core] Allow sharing Netty's memory pool allocators URL: https://github.com/apache/spark/pull/23278#issuecomment-445902681 Can one of the admins verify this patch? This

[GitHub] SparkQA removed a comment on issue #23272: [SPARK-26265][Core] Fix deadlock in BytesToBytesMap.MapIterator when locking both BytesToBytesMap.MapIterator and TaskMemoryManager

2018-12-10 Thread GitBox
SparkQA removed a comment on issue #23272: [SPARK-26265][Core] Fix deadlock in BytesToBytesMap.MapIterator when locking both BytesToBytesMap.MapIterator and TaskMemoryManager URL: https://github.com/apache/spark/pull/23272#issuecomment-445815525 **[Test build #99915 has

  1   2   3   4   5   6   7   8   9   >