[GitHub] [spark] HeartSaVioR commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

HeartSaVioR commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505293839 FYI: Just think out loud since I'm being cc-ed first, I'm just a one of contributors, not committers or PMC members of

[GitHub] [spark] HyukjinKwon removed a comment on issue #24957: [SPARK-27100][SQL][2.4] Use `Array` instead of `Seq` in `FilePartition` to…

HyukjinKwon removed a comment on issue #24957: [SPARK-27100][SQL][2.4] Use `Array` instead of `Seq` in `FilePartition` to… URL: https://github.com/apache/spark/pull/24957#issuecomment-505292669 oops. +1 This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted

AmplabJenkins removed a comment on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted URL: https://github.com/apache/spark/pull/24186#issuecomment-505293280 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins removed a comment on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted

AmplabJenkins removed a comment on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted URL: https://github.com/apache/spark/pull/24186#issuecomment-505293277 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

SparkQA commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-505293137 **[Test build #106868 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106868/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

AmplabJenkins removed a comment on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-505292650 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

AmplabJenkins removed a comment on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-505292655 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24957: [SPARK-27100][SQL][2.4] Use `Array` instead of `Seq` in `FilePartition` to…

dongjoon-hyun commented on a change in pull request #24957: [SPARK-27100][SQL][2.4] Use `Array` instead of `Seq` in `FilePartition` to… URL: https://github.com/apache/spark/pull/24957#discussion_r297015054 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted

AmplabJenkins commented on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted URL: https://github.com/apache/spark/pull/24186#issuecomment-505293280 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins commented on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted

AmplabJenkins commented on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted URL: https://github.com/apache/spark/pull/24186#issuecomment-505293277 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

SparkQA commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505293121 **[Test build #106869 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106869/testReport)** for

[GitHub] [spark] itsvikramagr commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

itsvikramagr commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505292778 Thanks, @HeartSaVioR. I understand it a very big change. As suggested let me create a stress test suite and paste some

[GitHub] [spark] AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505292682 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted

SparkQA removed a comment on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted URL: https://github.com/apache/spark/pull/24186#issuecomment-505257156 **[Test build #106855 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505292685 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes

AmplabJenkins removed a comment on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes URL: https://github.com/apache/spark/pull/24959#issuecomment-505292640 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes

AmplabJenkins removed a comment on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes URL: https://github.com/apache/spark/pull/24959#issuecomment-505292639 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

AmplabJenkins commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-505292655 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes

AmplabJenkins commented on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes URL: https://github.com/apache/spark/pull/24959#issuecomment-505292639 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

AmplabJenkins commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-505292650 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505292685 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HyukjinKwon commented on issue #24957: [SPARK-27100][SQL][2.4] Use `Array` instead of `Seq` in `FilePartition` to…

HyukjinKwon commented on issue #24957: [SPARK-27100][SQL][2.4] Use `Array` instead of `Seq` in `FilePartition` to… URL: https://github.com/apache/spark/pull/24957#issuecomment-505292669 oops. +1 This is an automated message

[GitHub] [spark] SparkQA commented on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted

SparkQA commented on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted URL: https://github.com/apache/spark/pull/24186#issuecomment-505292700 **[Test build #106855 has

[GitHub] [spark] AmplabJenkins commented on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes

AmplabJenkins commented on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes URL: https://github.com/apache/spark/pull/24959#issuecomment-505292640 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505292682 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] viirya opened a new pull request #24960: [SPARK-28156][SQL] Self-join should not miss cached view

viirya opened a new pull request #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960 ## What changes were proposed in this pull request? The issue is when self-join a cached view, only one side of join uses cached

[GitHub] [spark] dongjoon-hyun edited a comment on issue #24957: [SPARK-27100][SQL] Use `Array` instead of `Seq` in `FilePartition` to…

dongjoon-hyun edited a comment on issue #24957: [SPARK-27100][SQL] Use `Array` instead of `Seq` in `FilePartition` to… URL: https://github.com/apache/spark/pull/24957#issuecomment-505291686 This is a backport of 5a7aa6f4df . :)

[GitHub] [spark] dongjoon-hyun commented on issue #24957: [SPARK-27100][SQL] Use `Array` instead of `Seq` in `FilePartition` to…

dongjoon-hyun commented on issue #24957: [SPARK-27100][SQL] Use `Array` instead of `Seq` in `FilePartition` to… URL: https://github.com/apache/spark/pull/24957#issuecomment-505291686 This is a backport of 5a7aa6f4df . This

[GitHub] [spark] SparkQA commented on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes

SparkQA commented on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes URL: https://github.com/apache/spark/pull/24959#issuecomment-505291416 **[Test build #106867 has

[GitHub] [spark] dongjoon-hyun opened a new pull request #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes

dongjoon-hyun opened a new pull request #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes URL: https://github.com/apache/spark/pull/24959 ## What changes were proposed in this pull request? At Spark 2.4.0/2.3.2/2.2.3,

[GitHub] [spark] dongjoon-hyun commented on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes

dongjoon-hyun commented on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes URL: https://github.com/apache/spark/pull/24959#issuecomment-505291329 cc @dbtsai This is an automated

[GitHub] [spark] HeartSaVioR commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

HeartSaVioR commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505291092 And please take a deep look at build result if it fails, and try to fix if build failure is related to your patch. In some

[GitHub] [spark] AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-505290938 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-505290943 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-505290943 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-505290938 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

SparkQA commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-505290475 **[Test build #106854 has

[GitHub] [spark] SparkQA removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

SparkQA removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-505251808 **[Test build #106854 has

[GitHub] [spark] HeartSaVioR commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

HeartSaVioR commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505290444 Thanks for the hard work, @itsvikramagr ! I agree keeping state in memory is not scalable, and the result looks

[GitHub] [spark] SparkQA commented on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception

SparkQA commented on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception URL: https://github.com/apache/spark/pull/24947#issuecomment-505289667 **[Test build #106866 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception

AmplabJenkins removed a comment on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception URL: https://github.com/apache/spark/pull/24947#issuecomment-505289144 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception

AmplabJenkins removed a comment on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception URL: https://github.com/apache/spark/pull/24947#issuecomment-505289140 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception

AmplabJenkins commented on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception URL: https://github.com/apache/spark/pull/24947#issuecomment-505289140 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception

AmplabJenkins commented on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception URL: https://github.com/apache/spark/pull/24947#issuecomment-505289144 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r297010198 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r297009804 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up

AmplabJenkins commented on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up URL: https://github.com/apache/spark/pull/24841#issuecomment-505286937 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up

AmplabJenkins removed a comment on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up URL: https://github.com/apache/spark/pull/24841#issuecomment-505286937 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up

AmplabJenkins commented on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up URL: https://github.com/apache/spark/pull/24841#issuecomment-505286942 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up

AmplabJenkins removed a comment on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up URL: https://github.com/apache/spark/pull/24841#issuecomment-505286942 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up

SparkQA removed a comment on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up URL: https://github.com/apache/spark/pull/24841#issuecomment-505262327 **[Test build #106858 has

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r297009308 ## File path:

[GitHub] [spark] SparkQA commented on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up

SparkQA commented on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up URL: https://github.com/apache/spark/pull/24841#issuecomment-505286519 **[Test build #106858 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505285970 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505285966 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505285970 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505285966 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505285485 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

SparkQA removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505285010 **[Test build #106865 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505285482 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

SparkQA commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505285475 **[Test build #106865 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106865/testReport)**

[GitHub] [spark] AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505285482 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505285485 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] itsvikramagr commented on a change in pull request #24922: [SPARK-28120][SS] Rocksdb state storage implementation

itsvikramagr commented on a change in pull request #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#discussion_r297007963 ## File path:

[GitHub] [spark] SparkQA commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

SparkQA commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505285010 **[Test build #106865 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106865/testReport)** for

[GitHub] [spark] AngersZhuuuu commented on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first.

AngersZh commented on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first. URL: https://github.com/apache/spark/pull/24909#issuecomment-505283141 @GregOwen How about add a condition in SparkContext#addJar, if it's

[GitHub] [spark] AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505282636 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

SparkQA commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505282628 **[Test build #106864 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106864/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3

AmplabJenkins removed a comment on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3 URL: https://github.com/apache/spark/pull/24888#issuecomment-505282110 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505282636 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

SparkQA removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505282087 **[Test build #106864 has

[GitHub] [spark] AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505282632 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505282632 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3

SparkQA removed a comment on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3 URL: https://github.com/apache/spark/pull/24888#issuecomment-505276606 **[Test build #106861 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106861/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3

AmplabJenkins removed a comment on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3 URL: https://github.com/apache/spark/pull/24888#issuecomment-505282107 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3

AmplabJenkins commented on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3 URL: https://github.com/apache/spark/pull/24888#issuecomment-505282107 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] SparkQA commented on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3

SparkQA commented on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3 URL: https://github.com/apache/spark/pull/24888#issuecomment-505282086 **[Test build #106861 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106861/testReport)** for PR

[GitHub] [spark] AmplabJenkins commented on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3

AmplabJenkins commented on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3 URL: https://github.com/apache/spark/pull/24888#issuecomment-505282110 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AngersZhuuuu commented on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first.

AngersZh commented on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first. URL: https://github.com/apache/spark/pull/24909#issuecomment-505281996 @srowen About ' JAR might not yet exist at the time the driver is

[GitHub] [spark] SparkQA commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

SparkQA commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505282087 **[Test build #106864 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106864/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

AmplabJenkins removed a comment on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#issuecomment-505281752 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

AmplabJenkins removed a comment on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#issuecomment-505281755 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505281724 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505281717 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

AmplabJenkins commented on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#issuecomment-505281755 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

AmplabJenkins commented on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#issuecomment-505281752 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505281724 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505281717 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] HyukjinKwon closed pull request #24954: [SPARK-27823][CORE][DOC][FOLLOWUP] Update doc of config `spark.driver.resourcesFile`

HyukjinKwon closed pull request #24954: [SPARK-27823][CORE][DOC][FOLLOWUP] Update doc of config `spark.driver.resourcesFile` URL: https://github.com/apache/spark/pull/24954 This is an automated message from the Apache Git

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first.

AngersZh commented on a change in pull request #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first. URL: https://github.com/apache/spark/pull/24909#discussion_r297004428 ## File path:

[GitHub] [spark] AngersZhuuuu removed a comment on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first.

AngersZh removed a comment on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first. URL: https://github.com/apache/spark/pull/24909#issuecomment-505242651 @GregOwen Our analyst accidentally misspelled the path

[GitHub] [spark] itsvikramagr commented on a change in pull request #24922: [SPARK-28120][SS] Rocksdb state storage implementation

itsvikramagr commented on a change in pull request #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#discussion_r297004509 ## File path:

[GitHub] [spark] itsvikramagr commented on a change in pull request #24922: [SPARK-28120][SS] Rocksdb state storage implementation

itsvikramagr commented on a change in pull request #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#discussion_r297004509 ## File path:

[GitHub] [spark] HyukjinKwon commented on issue #24957: [SPARK-27100][SQL] Use `Array` instead of `Seq` in `FilePartition` to…

HyukjinKwon commented on issue #24957: [SPARK-27100][SQL] Use `Array` instead of `Seq` in `FilePartition` to… URL: https://github.com/apache/spark/pull/24957#issuecomment-505281141 @parthchandra can you open a PR against the current master?

[GitHub] [spark] itsvikramagr commented on a change in pull request #24922: [SPARK-28120][SS] Rocksdb state storage implementation

itsvikramagr commented on a change in pull request #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#discussion_r297004377 ## File path:

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first.

AngersZh commented on a change in pull request #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first. URL: https://github.com/apache/spark/pull/24909#discussion_r297004428 ## File path:

[GitHub] [spark] HyukjinKwon commented on issue #24954: [SPARK-27823][CORE][DOC][FOLLOWUP] Update doc of config `spark.driver.resourcesFile`

HyukjinKwon commented on issue #24954: [SPARK-27823][CORE][DOC][FOLLOWUP] Update doc of config `spark.driver.resourcesFile` URL: https://github.com/apache/spark/pull/24954#issuecomment-505280869 Merged to master. This is an

[GitHub] [spark] itsvikramagr commented on a change in pull request #24922: [SPARK-28120][SS] Rocksdb state storage implementation

itsvikramagr commented on a change in pull request #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#discussion_r297004281 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF)

AmplabJenkins removed a comment on issue #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF) URL: https://github.com/apache/spark/pull/24958#issuecomment-505280223 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins removed a comment on issue #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF)

AmplabJenkins removed a comment on issue #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF) URL: https://github.com/apache/spark/pull/24958#issuecomment-505280216 Merged build finished. Test PASSed.

  1   2   3   4   5   6   7   8   9   >