[GitHub] AmplabJenkins removed a comment on issue #23281: [MINOR][DOC]update the condition description of BypassMergeSortShuffl…

AmplabJenkins removed a comment on issue #23281: [MINOR][DOC]update the condition description of BypassMergeSortShuffl… URL: https://github.com/apache/spark/pull/23281#issuecomment-446053958 Can one of the admins verify this patch?

[GitHub] AmplabJenkins commented on issue #23281: [MINOR][DOC]update the condition description of BypassMergeSortShuffl…

AmplabJenkins commented on issue #23281: [MINOR][DOC]update the condition description of BypassMergeSortShuffl… URL: https://github.com/apache/spark/pull/23281#issuecomment-446053958 Can one of the admins verify this patch?

[GitHub] AmplabJenkins commented on issue #23281: [MINOR][DOC]update the condition description of BypassMergeSortShuffl…

AmplabJenkins commented on issue #23281: [MINOR][DOC]update the condition description of BypassMergeSortShuffl… URL: https://github.com/apache/spark/pull/23281#issuecomment-446054026 Can one of the admins verify this patch?

[GitHub] lcqzte10192193 opened a new pull request #23281: [MINOR][DOC]update the condition description of BypassMergeSortShuffl…

lcqzte10192193 opened a new pull request #23281: [MINOR][DOC]update the condition description of BypassMergeSortShuffl… URL: https://github.com/apache/spark/pull/23281 …eWriter ## What changes were proposed in this pull request? These three condition description should update,

[GitHub] mccheah commented on a change in pull request #23220: [SPARK-25877][k8s] Move all feature logic to feature classes.

mccheah commented on a change in pull request #23220: [SPARK-25877][k8s] Move all feature logic to feature classes. URL: https://github.com/apache/spark/pull/23220#discussion_r240456173 ## File path:

[GitHub] mccheah commented on a change in pull request #23220: [SPARK-25877][k8s] Move all feature logic to feature classes.

mccheah commented on a change in pull request #23220: [SPARK-25877][k8s] Move all feature logic to feature classes. URL: https://github.com/apache/spark/pull/23220#discussion_r240454265 ## File path:

[GitHub] mccheah commented on a change in pull request #23220: [SPARK-25877][k8s] Move all feature logic to feature classes.

mccheah commented on a change in pull request #23220: [SPARK-25877][k8s] Move all feature logic to feature classes. URL: https://github.com/apache/spark/pull/23220#discussion_r240454417 ## File path:

[GitHub] mccheah commented on a change in pull request #23220: [SPARK-25877][k8s] Move all feature logic to feature classes.

mccheah commented on a change in pull request #23220: [SPARK-25877][k8s] Move all feature logic to feature classes. URL: https://github.com/apache/spark/pull/23220#discussion_r240454863 ## File path:

[GitHub] mccheah commented on a change in pull request #23220: [SPARK-25877][k8s] Move all feature logic to feature classes.

mccheah commented on a change in pull request #23220: [SPARK-25877][k8s] Move all feature logic to feature classes. URL: https://github.com/apache/spark/pull/23220#discussion_r240454265 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23280: [MINOR][SQL] Some errors in the notes.

AmplabJenkins removed a comment on issue #23280: [MINOR][SQL] Some errors in the notes. URL: https://github.com/apache/spark/pull/23280#issuecomment-446051121 Can one of the admins verify this patch? This is an automated

[GitHub] AmplabJenkins commented on issue #23280: [MINOR][SQL] Some errors in the notes.

AmplabJenkins commented on issue #23280: [MINOR][SQL] Some errors in the notes. URL: https://github.com/apache/spark/pull/23280#issuecomment-446051398 Can one of the admins verify this patch? This is an automated message from

[GitHub] AmplabJenkins commented on issue #23280: [MINOR][SQL] Some errors in the notes.

AmplabJenkins commented on issue #23280: [MINOR][SQL] Some errors in the notes. URL: https://github.com/apache/spark/pull/23280#issuecomment-446051121 Can one of the admins verify this patch? This is an automated message from

[GitHub] AmplabJenkins removed a comment on issue #23280: [MINOR][SQL] Some errors in the notes.

AmplabJenkins removed a comment on issue #23280: [MINOR][SQL] Some errors in the notes. URL: https://github.com/apache/spark/pull/23280#issuecomment-446051038 Can one of the admins verify this patch? This is an automated

[GitHub] AmplabJenkins commented on issue #23280: [MINOR][SQL] Some errors in the notes.

AmplabJenkins commented on issue #23280: [MINOR][SQL] Some errors in the notes. URL: https://github.com/apache/spark/pull/23280#issuecomment-446051038 Can one of the admins verify this patch? This is an automated message from

[GitHub] HyukjinKwon commented on a change in pull request #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

HyukjinKwon commented on a change in pull request #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#discussion_r240455039 ## File path:

[GitHub] CarolinePeng opened a new pull request #23280: [MINOR][SQL] Some errors in the notes.

CarolinePeng opened a new pull request #23280: [MINOR][SQL] Some errors in the notes. URL: https://github.com/apache/spark/pull/23280 ## What changes were proposed in this pull request? When using ordinals to access linked list, the time cost is O(n). ## How was this patch

[GitHub] HyukjinKwon commented on a change in pull request #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

HyukjinKwon commented on a change in pull request #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#discussion_r240455039 ## File path:

[GitHub] SparkQA commented on issue #23213: [SPARK-26262][SQL] Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and CODEGEN_FACTORY_MODE

SparkQA commented on issue #23213: [SPARK-26262][SQL] Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and CODEGEN_FACTORY_MODE URL: https://github.com/apache/spark/pull/23213#issuecomment-446048530 **[Test build #99942 has

[GitHub] AmplabJenkins removed a comment on issue #23213: [SPARK-26262][SQL] Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and CODEGEN_FACTORY_MODE

AmplabJenkins removed a comment on issue #23213: [SPARK-26262][SQL] Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and CODEGEN_FACTORY_MODE URL: https://github.com/apache/spark/pull/23213#issuecomment-446048394 Test PASSed. Refer to this link for build results

[GitHub] cloud-fan commented on a change in pull request #23272: [SPARK-26265][Core] Fix deadlock in BytesToBytesMap.MapIterator when locking both BytesToBytesMap.MapIterator and TaskMemoryManager

cloud-fan commented on a change in pull request #23272: [SPARK-26265][Core] Fix deadlock in BytesToBytesMap.MapIterator when locking both BytesToBytesMap.MapIterator and TaskMemoryManager URL: https://github.com/apache/spark/pull/23272#discussion_r240453178 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23213: [SPARK-26262][SQL] Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and CODEGEN_FACTORY_MODE

AmplabJenkins removed a comment on issue #23213: [SPARK-26262][SQL] Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and CODEGEN_FACTORY_MODE URL: https://github.com/apache/spark/pull/23213#issuecomment-446048389 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23213: [SPARK-26262][SQL] Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and CODEGEN_FACTORY_MODE

AmplabJenkins commented on issue #23213: [SPARK-26262][SQL] Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and CODEGEN_FACTORY_MODE URL: https://github.com/apache/spark/pull/23213#issuecomment-446048394 Test PASSed. Refer to this link for build results (access

[GitHub] AmplabJenkins commented on issue #23213: [SPARK-26262][SQL] Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and CODEGEN_FACTORY_MODE

AmplabJenkins commented on issue #23213: [SPARK-26262][SQL] Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and CODEGEN_FACTORY_MODE URL: https://github.com/apache/spark/pull/23213#issuecomment-446048389 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23252: [SPARK-26239] File-based secret key loading for SASL.

AmplabJenkins removed a comment on issue #23252: [SPARK-26239] File-based secret key loading for SASL. URL: https://github.com/apache/spark/pull/23252#issuecomment-446047256 Merged build finished. Test PASSed. This is an

[GitHub] cloud-fan commented on issue #23213: [SPARK-26262][SQL] Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and CODEGEN_FACTORY_MODE

cloud-fan commented on issue #23213: [SPARK-26262][SQL] Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and CODEGEN_FACTORY_MODE URL: https://github.com/apache/spark/pull/23213#issuecomment-446047462 retest this please

[GitHub] AmplabJenkins commented on issue #23252: [SPARK-26239] File-based secret key loading for SASL.

AmplabJenkins commented on issue #23252: [SPARK-26239] File-based secret key loading for SASL. URL: https://github.com/apache/spark/pull/23252#issuecomment-446047258 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23252: [SPARK-26239] File-based secret key loading for SASL.

AmplabJenkins removed a comment on issue #23252: [SPARK-26239] File-based secret key loading for SASL. URL: https://github.com/apache/spark/pull/23252#issuecomment-446047258 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23252: [SPARK-26239] File-based secret key loading for SASL.

AmplabJenkins commented on issue #23252: [SPARK-26239] File-based secret key loading for SASL. URL: https://github.com/apache/spark/pull/23252#issuecomment-446047256 Merged build finished. Test PASSed. This is an automated

[GitHub] SparkQA removed a comment on issue #23252: [SPARK-26239] File-based secret key loading for SASL.

SparkQA removed a comment on issue #23252: [SPARK-26239] File-based secret key loading for SASL. URL: https://github.com/apache/spark/pull/23252#issuecomment-445985434 **[Test build #99935 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99935/testReport)**

[GitHub] SparkQA commented on issue #23252: [SPARK-26239] File-based secret key loading for SASL.

SparkQA commented on issue #23252: [SPARK-26239] File-based secret key loading for SASL. URL: https://github.com/apache/spark/pull/23252#issuecomment-446046903 **[Test build #99935 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99935/testReport)** for PR

[GitHub] cloud-fan commented on a change in pull request #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

cloud-fan commented on a change in pull request #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#discussion_r240451835 ## File path:

[GitHub] yaooqinn closed pull request #19840: [SPARK-22640][PYSPARK][YARN]switch python exec on executor side

yaooqinn closed pull request #19840: [SPARK-22640][PYSPARK][YARN]switch python exec on executor side URL: https://github.com/apache/spark/pull/19840 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance:

[GitHub] cloud-fan commented on a change in pull request #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any

cloud-fan commented on a change in pull request #23275: [SPARK-26323][SQL] Scala UDF should still check input types even if some inputs are of type Any URL: https://github.com/apache/spark/pull/23275#discussion_r240449840 ## File path:

[GitHub] asfgit closed pull request #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance

asfgit closed pull request #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance URL: https://github.com/apache/spark/pull/23262 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is

[GitHub] HyukjinKwon commented on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance

HyukjinKwon commented on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance URL: https://github.com/apache/spark/pull/23262#issuecomment-446042871 Weird. My remote is as below FWIW. ``` $ git remote -v

[GitHub] cloud-fan commented on issue #23211: [SPARK-19712][SQL] Move PullupCorrelatedPredicates and RewritePredicateSubquery after OptimizeSubqueries

cloud-fan commented on issue #23211: [SPARK-19712][SQL] Move PullupCorrelatedPredicates and RewritePredicateSubquery after OptimizeSubqueries URL: https://github.com/apache/spark/pull/23211#issuecomment-446042787 Yes, since `PushdownLeftSemiOrAntiJoin` rule is useful without subquery.

[GitHub] HyukjinKwon commented on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance

HyukjinKwon commented on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance URL: https://github.com/apache/spark/pull/23262#issuecomment-446042637 Oops, looks working fine after switching to gitbox to me.

[GitHub] cloud-fan commented on a change in pull request #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write)

cloud-fan commented on a change in pull request #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write) URL: https://github.com/apache/spark/pull/23208#discussion_r240448233 ## File path: sql/core/src/main/java/org/apache/spark/sql/sources/v2/TableProvider.java

[GitHub] cloud-fan commented on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance

cloud-fan commented on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance URL: https://github.com/apache/spark/pull/23262#issuecomment-446041476 yea it didn't work. The PR is not merged. I'll try it later. cc @srowen do

[GitHub] cloud-fan commented on a change in pull request #23266: [SPARK-26313][SQL] move read related methods from Table to read related mix-in traits

cloud-fan commented on a change in pull request #23266: [SPARK-26313][SQL] move read related methods from Table to read related mix-in traits URL: https://github.com/apache/spark/pull/23266#discussion_r240447269 ## File path:

[GitHub] cloud-fan commented on a change in pull request #23266: [SPARK-26313][SQL] move read related methods from Table to read related mix-in traits

cloud-fan commented on a change in pull request #23266: [SPARK-26313][SQL] move read related methods from Table to read related mix-in traits URL: https://github.com/apache/spark/pull/23266#discussion_r240447132 ## File path:

[GitHub] HeartSaVioR commented on a change in pull request #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

HeartSaVioR commented on a change in pull request #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#discussion_r240446659 ## File path:

[GitHub] HeartSaVioR commented on a change in pull request #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

HeartSaVioR commented on a change in pull request #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#discussion_r240446659 ## File path:

[GitHub] HyukjinKwon commented on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance

HyukjinKwon commented on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance URL: https://github.com/apache/spark/pull/23262#issuecomment-446040157 It doesn't work right now .. right? haha. I tried to merge but failed.

[GitHub] cloud-fan commented on issue #23271: [SPARK-26318][SQL] Enhance function merge performance in Row

cloud-fan commented on issue #23271: [SPARK-26318][SQL] Enhance function merge performance in Row URL: https://github.com/apache/spark/pull/23271#issuecomment-446040156 I have the same question. If it's not used by anyone, maybe we can deprecate it and remove it in the next release

[GitHub] cloud-fan commented on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance

cloud-fan commented on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance URL: https://github.com/apache/spark/pull/23262#issuecomment-446038519 thanks, merging to master!

[GitHub] AmplabJenkins removed a comment on issue #23252: [SPARK-26239] File-based secret key loading for SASL.

AmplabJenkins removed a comment on issue #23252: [SPARK-26239] File-based secret key loading for SASL. URL: https://github.com/apache/spark/pull/23252#issuecomment-446038018 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] HeartSaVioR commented on a change in pull request #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

HeartSaVioR commented on a change in pull request #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#discussion_r240444758 ## File path: docs/running-on-yarn.md ## @@ -430,6 +430,21 @@ To use a custom

[GitHub] AmplabJenkins removed a comment on issue #23252: [SPARK-26239] File-based secret key loading for SASL.

AmplabJenkins removed a comment on issue #23252: [SPARK-26239] File-based secret key loading for SASL. URL: https://github.com/apache/spark/pull/23252#issuecomment-446038016 Merged build finished. Test FAILed. This is an

[GitHub] AmplabJenkins commented on issue #23252: [SPARK-26239] File-based secret key loading for SASL.

AmplabJenkins commented on issue #23252: [SPARK-26239] File-based secret key loading for SASL. URL: https://github.com/apache/spark/pull/23252#issuecomment-446038018 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23252: [SPARK-26239] File-based secret key loading for SASL.

AmplabJenkins commented on issue #23252: [SPARK-26239] File-based secret key loading for SASL. URL: https://github.com/apache/spark/pull/23252#issuecomment-446038016 Merged build finished. Test FAILed. This is an automated

[GitHub] SparkQA removed a comment on issue #23252: [SPARK-26239] File-based secret key loading for SASL.

SparkQA removed a comment on issue #23252: [SPARK-26239] File-based secret key loading for SASL. URL: https://github.com/apache/spark/pull/23252#issuecomment-445983502 **[Test build #99934 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99934/testReport)**

[GitHub] SparkQA commented on issue #23252: [SPARK-26239] File-based secret key loading for SASL.

SparkQA commented on issue #23252: [SPARK-26239] File-based secret key loading for SASL. URL: https://github.com/apache/spark/pull/23252#issuecomment-446037823 **[Test build #99934 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99934/testReport)** for PR

[GitHub] HeartSaVioR commented on a change in pull request #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

HeartSaVioR commented on a change in pull request #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#discussion_r240444139 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

AmplabJenkins removed a comment on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-446037380 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

SparkQA commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-446037548 **[Test build #99941 has

[GitHub] AmplabJenkins removed a comment on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

AmplabJenkins removed a comment on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-446037378 Merged build finished. Test PASSed. This

[GitHub] AmplabJenkins commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

AmplabJenkins commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-446037380 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

AmplabJenkins commented on issue #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#issuecomment-446037378 Merged build finished. Test PASSed. This is an

[GitHub] cloud-fan commented on a change in pull request #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

cloud-fan commented on a change in pull request #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#discussion_r240431621 ## File path:

[GitHub] cloud-fan commented on issue #23232: [SPARK-26233][SQL][BACKPORT-2.4] CheckOverflow when encoding a decimal value

cloud-fan commented on issue #23232: [SPARK-26233][SQL][BACKPORT-2.4] CheckOverflow when encoding a decimal value URL: https://github.com/apache/spark/pull/23232#issuecomment-446036494 Hi @mgaido91 , just one more question. Without this patch, does Spark always return wrong result if the

[GitHub] HyukjinKwon removed a comment on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance

HyukjinKwon removed a comment on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance URL: https://github.com/apache/spark/pull/23262#issuecomment-446030243 Merged to master.

[GitHub] HyukjinKwon commented on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance

HyukjinKwon commented on issue #23262: [SPARK-26312][SQL]Replace RDDConversions.rowToRowRdd with RowEncoder to improve its conversion performance URL: https://github.com/apache/spark/pull/23262#issuecomment-446030243 Merged to master.

[GitHub] HeartSaVioR commented on a change in pull request #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

HeartSaVioR commented on a change in pull request #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#discussion_r240436930 ## File path:

[GitHub] devaraj-kavali commented on issue #19616: [SPARK-22404][YARN] Provide an option to use unmanaged AM in yarn-client mode

devaraj-kavali commented on issue #19616: [SPARK-22404][YARN] Provide an option to use unmanaged AM in yarn-client mode URL: https://github.com/apache/spark/pull/19616#issuecomment-446029794 Thanks @vanzin for taking time to look into this, will update it with the changes.

[GitHub] AmplabJenkins removed a comment on issue #23277: [SPARK-26327][SQL] Metrics in FileSourceScanExec not update correctly

AmplabJenkins removed a comment on issue #23277: [SPARK-26327][SQL] Metrics in FileSourceScanExec not update correctly URL: https://github.com/apache/spark/pull/23277#issuecomment-446028068 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23277: [SPARK-26327][SQL] Metrics in FileSourceScanExec not update correctly

AmplabJenkins commented on issue #23277: [SPARK-26327][SQL] Metrics in FileSourceScanExec not update correctly URL: https://github.com/apache/spark/pull/23277#issuecomment-446028069 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23277: [SPARK-26327][SQL] Metrics in FileSourceScanExec not update correctly

SparkQA commented on issue #23277: [SPARK-26327][SQL] Metrics in FileSourceScanExec not update correctly URL: https://github.com/apache/spark/pull/23277#issuecomment-446028080 **[Test build #99940 has

[GitHub] AmplabJenkins removed a comment on issue #23277: [SPARK-26327][SQL] Metrics in FileSourceScanExec not update correctly

AmplabJenkins removed a comment on issue #23277: [SPARK-26327][SQL] Metrics in FileSourceScanExec not update correctly URL: https://github.com/apache/spark/pull/23277#issuecomment-446028069 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23277: [SPARK-26327][SQL] Metrics in FileSourceScanExec not update correctly

AmplabJenkins commented on issue #23277: [SPARK-26327][SQL] Metrics in FileSourceScanExec not update correctly URL: https://github.com/apache/spark/pull/23277#issuecomment-446028068 Merged build finished. Test PASSed. This

[GitHub] srowen closed pull request #23168: [SPARK-26207][doc]add PowerIterationClustering (PIC) doc in 2.4 branch

srowen closed pull request #23168: [SPARK-26207][doc]add PowerIterationClustering (PIC) doc in 2.4 branch URL: https://github.com/apache/spark/pull/23168 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[GitHub] srowen commented on issue #23168: [SPARK-26207][doc]add PowerIterationClustering (PIC) doc in 2.4 branch

srowen commented on issue #23168: [SPARK-26207][doc]add PowerIterationClustering (PIC) doc in 2.4 branch URL: https://github.com/apache/spark/pull/23168#issuecomment-446027874 Merged to 2.4 This is an automated message from

[GitHub] icexelloss commented on a change in pull request #22305: [SPARK-24561][SQL][Python] User-defined window aggregation functions with Pandas UDF (bounded window)

icexelloss commented on a change in pull request #22305: [SPARK-24561][SQL][Python] User-defined window aggregation functions with Pandas UDF (bounded window) URL: https://github.com/apache/spark/pull/22305#discussion_r240434370 ## File path:

[GitHub] srowen closed pull request #23072: [SPARK-19827][R]spark.ml R API for PIC

srowen closed pull request #23072: [SPARK-19827][R]spark.ml R API for PIC URL: https://github.com/apache/spark/pull/23072 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign pull

[GitHub] srowen closed pull request #22683: [SPARK-25696] The storage memory displayed on spark Application UI is…

srowen closed pull request #22683: [SPARK-25696] The storage memory displayed on spark Application UI is… URL: https://github.com/apache/spark/pull/22683 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[GitHub] cloud-fan commented on issue #23277: [SPARK-26327][SQL] Metrics in FileSourceScanExec not update correctly

cloud-fan commented on issue #23277: [SPARK-26327][SQL] Metrics in FileSourceScanExec not update correctly URL: https://github.com/apache/spark/pull/23277#issuecomment-446027024 good catch! This is an automated message from

[GitHub] cloud-fan commented on issue #23277: [SPARK-26327][SQL] Metrics in FileSourceScanExec not update correctly

cloud-fan commented on issue #23277: [SPARK-26327][SQL] Metrics in FileSourceScanExec not update correctly URL: https://github.com/apache/spark/pull/23277#issuecomment-446027053 retest this please This is an automated

[GitHub] srowen commented on issue #23072: [SPARK-19827][R]spark.ml R API for PIC

srowen commented on issue #23072: [SPARK-19827][R]spark.ml R API for PIC URL: https://github.com/apache/spark/pull/23072#issuecomment-446026964 Merged to master This is an automated message from the Apache Git Service. To

[GitHub] srowen commented on issue #22683: [SPARK-25696] The storage memory displayed on spark Application UI is…

srowen commented on issue #22683: [SPARK-25696] The storage memory displayed on spark Application UI is… URL: https://github.com/apache/spark/pull/22683#issuecomment-446026600 Merged to master This is an automated message

[GitHub] cloud-fan commented on a change in pull request #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

cloud-fan commented on a change in pull request #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#discussion_r240431799 ## File path:

[GitHub] cloud-fan commented on a change in pull request #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning

cloud-fan commented on a change in pull request #23249: [SPARK-26297][SQL] improve the doc of Distribution/Partitioning URL: https://github.com/apache/spark/pull/23249#discussion_r240431621 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal.

AmplabJenkins removed a comment on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal. URL: https://github.com/apache/spark/pull/22911#issuecomment-446022247 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal.

AmplabJenkins removed a comment on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal. URL: https://github.com/apache/spark/pull/22911#issuecomment-446022248 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal.

AmplabJenkins commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal. URL: https://github.com/apache/spark/pull/22911#issuecomment-446022247 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal.

AmplabJenkins commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal. URL: https://github.com/apache/spark/pull/22911#issuecomment-446022248 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] vanzin commented on issue #23220: [SPARK-25877][k8s] Move all feature logic to feature classes.

vanzin commented on issue #23220: [SPARK-25877][k8s] Move all feature logic to feature classes. URL: https://github.com/apache/spark/pull/23220#issuecomment-446022089 So, anybody interested in reviewing this? This is an

[GitHub] SparkQA removed a comment on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal.

SparkQA removed a comment on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal. URL: https://github.com/apache/spark/pull/22911#issuecomment-445939970 **[Test build #99932 has

[GitHub] AmplabJenkins removed a comment on issue #22279: [SPARK-25277][YARN] YARN applicationMaster metrics should not register static metrics

AmplabJenkins removed a comment on issue #22279: [SPARK-25277][YARN] YARN applicationMaster metrics should not register static metrics URL: https://github.com/apache/spark/pull/22279#issuecomment-446021735 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] AmplabJenkins removed a comment on issue #22279: [SPARK-25277][YARN] YARN applicationMaster metrics should not register static metrics

AmplabJenkins removed a comment on issue #22279: [SPARK-25277][YARN] YARN applicationMaster metrics should not register static metrics URL: https://github.com/apache/spark/pull/22279#issuecomment-446021727 Merged build finished. Test PASSed.

[GitHub] SparkQA commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal.

SparkQA commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal. URL: https://github.com/apache/spark/pull/22911#issuecomment-446021887 **[Test build #99932 has

[GitHub] AmplabJenkins commented on issue #22279: [SPARK-25277][YARN] YARN applicationMaster metrics should not register static metrics

AmplabJenkins commented on issue #22279: [SPARK-25277][YARN] YARN applicationMaster metrics should not register static metrics URL: https://github.com/apache/spark/pull/22279#issuecomment-446021727 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #22279: [SPARK-25277][YARN] YARN applicationMaster metrics should not register static metrics

AmplabJenkins commented on issue #22279: [SPARK-25277][YARN] YARN applicationMaster metrics should not register static metrics URL: https://github.com/apache/spark/pull/22279#issuecomment-446021735 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #22279: [SPARK-25277][YARN] YARN applicationMaster metrics should not register static metrics

SparkQA commented on issue #22279: [SPARK-25277][YARN] YARN applicationMaster metrics should not register static metrics URL: https://github.com/apache/spark/pull/22279#issuecomment-446021730 **[Test build #99939 has

[GitHub] vanzin closed pull request #21279: [SPARK-24219][k8s] Improve the docker building script to avoid copying everything under examples to docker image

vanzin closed pull request #21279: [SPARK-24219][k8s] Improve the docker building script to avoid copying everything under examples to docker image URL: https://github.com/apache/spark/pull/21279 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it

[GitHub] vanzin commented on issue #21279: [SPARK-24219][k8s] Improve the docker building script to avoid copying everything under examples to docker image

vanzin commented on issue #21279: [SPARK-24219][k8s] Improve the docker building script to avoid copying everything under examples to docker image URL: https://github.com/apache/spark/pull/21279#issuecomment-446021270 This was fixed in SPARK-26025.

[GitHub] AmplabJenkins removed a comment on issue #22279: [SPARK-25277][YARN] YARN applicationMaster metrics should not register static metrics

AmplabJenkins removed a comment on issue #22279: [SPARK-25277][YARN] YARN applicationMaster metrics should not register static metrics URL: https://github.com/apache/spark/pull/22279#issuecomment-417219160 Can one of the admins verify this patch?

[GitHub] vanzin commented on issue #22279: [SPARK-25277][YARN] YARN applicationMaster metrics should not register static metrics

vanzin commented on issue #22279: [SPARK-25277][YARN] YARN applicationMaster metrics should not register static metrics URL: https://github.com/apache/spark/pull/22279#issuecomment-446020969 ok to test This is an automated

[GitHub] aokolnychyi commented on issue #21320: [SPARK-4502][SQL] Parquet nested column pruning - foundation

aokolnychyi commented on issue #21320: [SPARK-4502][SQL] Parquet nested column pruning - foundation URL: https://github.com/apache/spark/pull/21320#issuecomment-446020655 @mallman @dbtsai @gatorsmile One question on non-deterministic expressions. For example, let's consider a

[GitHub] vanzin commented on issue #19840: [SPARK-22640][PYSPARK][YARN]switch python exec on executor side

vanzin commented on issue #19840: [SPARK-22640][PYSPARK][YARN]switch python exec on executor side URL: https://github.com/apache/spark/pull/19840#issuecomment-446020608 @yaooqinn we should probably close this if you're not planning to look at the root of the problem, which seems to be on

[GitHub] vanzin commented on a change in pull request #19616: [SPARK-22404][YARN] Provide an option to use unmanaged AM in yarn-client mode

vanzin commented on a change in pull request #19616: [SPARK-22404][YARN] Provide an option to use unmanaged AM in yarn-client mode URL: https://github.com/apache/spark/pull/19616#discussion_r240421106 ## File path:

<    1   2   3   4   5   6   7   8   9   >