[GitHub] spark issue #17742: [Spark-11968][ML][MLLIB]Optimize MLLIB ALS recommendForA...

2017-07-13 Thread mpjlu
Github user mpjlu commented on the issue: https://github.com/apache/spark/pull/17742 I have submitted PR for ALS optimization with GEMM. and it is ready for review. The performance is about 50% improvement comparing with the master method.

[GitHub] spark issue #18624: [SPARK-21389][ML][MLLIB] Optimize ALS recommendForAll by...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18624 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18624: [SPARK-21389][ML][MLLIB] Optimize ALS recommendForAll by...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18624 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79597/ Test PASSed. ---

[GitHub] spark issue #18624: [SPARK-21389][ML][MLLIB] Optimize ALS recommendForAll by...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18624 **[Test build #79597 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79597/testReport)** for PR 18624 at commit

[GitHub] spark issue #18620: [SPARK-21401][ML][MLLIB] add poll function for BoundedPr...

2017-07-13 Thread mpjlu
Github user mpjlu commented on the issue: https://github.com/apache/spark/pull/18620 Hi @srowen , I have added Test Suite for BoundedPriorityQueue. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #18620: [SPARK-21401][ML][MLLIB] add poll function for BoundedPr...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18620 **[Test build #79604 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79604/testReport)** for PR 18620 at commit

[GitHub] spark issue #18620: [SPARK-21401][ML][MLLIB] add poll function for BoundedPr...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18620 **[Test build #79603 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79603/testReport)** for PR 18620 at commit

[GitHub] spark issue #18555: [SPARK-21353][CORE]add checkValue in spark.internal.conf...

2017-07-13 Thread heary-cao
Github user heary-cao commented on the issue: https://github.com/apache/spark/pull/18555 @gatorsmile supplementary test case to (v => v == 0 || (1024 <= v && v < 65536). please review it again. thank you. --- If your project is set up for it, you can reply to this

[GitHub] spark issue #18555: [SPARK-21353][CORE]add checkValue in spark.internal.conf...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18555 **[Test build #79602 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79602/testReport)** for PR 18555 at commit

[GitHub] spark issue #18633: [SPARK-21411][YARN] Lazily create FS within kerberized U...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18633 **[Test build #79601 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79601/testReport)** for PR 18633 at commit

[GitHub] spark pull request #18633: [SPARK-21411][YARN] Lazily create FS within kerbe...

2017-07-13 Thread jerryshao
GitHub user jerryshao opened a pull request: https://github.com/apache/spark/pull/18633 [SPARK-21411][YARN] Lazily create FS within kerberized UGI to avoid token acquiring failure ## What changes were proposed in this pull request? In the current

[GitHub] spark issue #18629: [SPARK-21409][SS] Expose state store memory usage in SQL...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18629 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79595/ Test FAILed. ---

[GitHub] spark issue #18629: [SPARK-21409][SS] Expose state store memory usage in SQL...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18629 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18629: [SPARK-21409][SS] Expose state store memory usage in SQL...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18629 **[Test build #79595 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79595/testReport)** for PR 18629 at commit

[GitHub] spark issue #18613: [SPARK-20307][ML][SPARKR][FOLLOW-UP] RFormula should han...

2017-07-13 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/18613 @felixcheung We don't silently drop features, we use ```handleInvalid``` to let users decide how to handle invalid features or label. The behavior is consistent with Scala which supports to

[GitHub] spark issue #18388: [SPARK-21175][WIP] Reject OpenBlocks when memory shortag...

2017-07-13 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/18388 @tgravescs Thanks a lot for advice. > the flow control part should allow everyone to start fetching without rejecting a bunch, especially if the network can't push it out that fast

[GitHub] spark issue #18503: [SPARK-21271][SQL] Ensure Unsafe.sizeInBytes is a multip...

2017-07-13 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18503 @tdas @marmbrus @zsxwing could you please let us know any impacts by change of `FixedLengthRowBasedKeyValueBatch`? Can we change this structure? --- If your project is set up for it, you can reply

[GitHub] spark issue #18571: [SPARK-21344][SQL] BinaryType comparison does signed byt...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18571 **[Test build #79600 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79600/testReport)** for PR 18571 at commit

[GitHub] spark issue #18632: Reset BufferHolder while initialize an UnsafeRowWriter

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18632 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #18632: Reset BufferHolder while initialize an UnsafeRowW...

2017-07-13 Thread gczsjdy
GitHub user gczsjdy opened a pull request: https://github.com/apache/spark/pull/18632 Reset BufferHolder while initialize an UnsafeRowWriter ## What changes were proposed in this pull request? `UnsafeRowWriter`'s construtor should contain `BufferHolder.reset` to make the

[GitHub] spark issue #18428: [Spark-21221][ML] CrossValidator and TrainValidationSpli...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18428 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18428: [Spark-21221][ML] CrossValidator and TrainValidationSpli...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18428 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79596/ Test PASSed. ---

[GitHub] spark issue #18428: [Spark-21221][ML] CrossValidator and TrainValidationSpli...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18428 **[Test build #79596 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79596/testReport)** for PR 18428 at commit

[GitHub] spark issue #18631: [SPARK-SPARK-21410][CORE] RangePartitioner.numPartitions...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18631 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #18631: [SPARK-SPARK-21410][CORE] RangePartitioner.numPar...

2017-07-13 Thread apapi
GitHub user apapi opened a pull request: https://github.com/apache/spark/pull/18631 [SPARK-SPARK-21410][CORE] RangePartitioner.numPartitions is wrong if … …the number of elements in RDD is less than number of partitions ## What changes were proposed in this pull

[GitHub] spark issue #18630: [SPARK-12559][SPARK SUBMIT] fix --packages for stand-alo...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18630 **[Test build #79599 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79599/testReport)** for PR 18630 at commit

[GitHub] spark issue #18630: [SPARK-12559][SPARK SUBMIT] fix --packages for stand-alo...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18630 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79599/ Test FAILed. ---

[GitHub] spark issue #18630: [SPARK-12559][SPARK SUBMIT] fix --packages for stand-alo...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18630 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18630: [SPARK-12559][SPARK SUBMIT] fix --packages for stand-alo...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18630 **[Test build #79599 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79599/testReport)** for PR 18630 at commit

[GitHub] spark issue #18555: [SPARK-21353][CORE]add checkValue in spark.internal.conf...

2017-07-13 Thread heary-cao
Github user heary-cao commented on the issue: https://github.com/apache/spark/pull/18555 @gatorsmile sorry, Do you means ` > 0 or >= 0` also needs to be added? I just added a test case to `(v => v == 0 || (1024 <= v && v < 65536)` test case: `test("blockManager port

[GitHub] spark issue #18630: [SPARK-12559][SPARK SUBMIT] fix --packages for stand-alo...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18630 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18630: [SPARK-12559][SPARK SUBMIT] fix --packages for stand-alo...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18630 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79598/ Test FAILed. ---

[GitHub] spark issue #18630: [SPARK-12559][SPARK SUBMIT] fix --packages for stand-alo...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18630 **[Test build #79598 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79598/testReport)** for PR 18630 at commit

[GitHub] spark issue #18468: [SPARK-20873][SQL] Enhance ColumnVector to support compr...

2017-07-13 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18468 ping @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #18630: [SPARK-12559][SPARK SUBMIT] fix --packages for stand-alo...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18630 **[Test build #79598 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79598/testReport)** for PR 18630 at commit

[GitHub] spark issue #18630: [SPARK-12559][SPARK SUBMIT] fix --packages for standalon...

2017-07-13 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/18630 @vanzin pls review. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18503: [SPARK-21271][SQL] Ensure Unsafe.sizeInBytes is a multip...

2017-07-13 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18503 This PR we changed `FixedLengthRowBasedKeyValueBatch`, I want to know if it has some external impacts, like checkpoint data, or it's just used internally? --- If your project is set up for it,

[GitHub] spark pull request #18630: [SPARK-12559][SPARK SUBMIT] fix --packages for st...

2017-07-13 Thread skonto
GitHub user skonto opened a pull request: https://github.com/apache/spark/pull/18630 [SPARK-12559][SPARK SUBMIT] fix --packages for standalone ## What changes were proposed in this pull request? Fixes --packages flag for the standalone mode. ## How was this patch

[GitHub] spark issue #18624: [SPARK-21389][ML][MLLIB] Optimize ALS recommendForAll by...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18624 **[Test build #79597 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79597/testReport)** for PR 18624 at commit

[GitHub] spark issue #18619: [SPARK-21397][BUILD]Maven shade plugin adding dependency...

2017-07-13 Thread zuotingbing
Github user zuotingbing commented on the issue: https://github.com/apache/spark/pull/18619 Yes this PR is a trivial Improvement for me. i will closed it if this has side-effects exactly. Thanks. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #18428: [Spark-21221][ML] CrossValidator and TrainValidationSpli...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18428 **[Test build #79596 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79596/testReport)** for PR 18428 at commit

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

2017-07-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18444 BTW, I guess it'd be nicer if we get a sign-off from @davies if you have some bandwidth to deal with this meanwhile. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #18619: [SPARK-21397][BUILD]Maven shade plugin adding dependency...

2017-07-13 Thread zuotingbing
Github user zuotingbing commented on the issue: https://github.com/apache/spark/pull/18619 I just use `mvn checkstyle:check` ,which contains output files with `basedir`, to check whether the `basedir` is correct with this PR. Could you please specify the affect exactly as you

[GitHub] spark issue #18629: [SPARK-21409][SS] Expose state store memory usage in SQL...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18629 **[Test build #79595 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79595/testReport)** for PR 18629 at commit

[GitHub] spark issue #17150: [SPARK-19810][BUILD][CORE] Remove support for Scala 2.10

2017-07-13 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17150 @srowen @JoshRosen After thinking more about it, will this PR make it harder to backport bug fixes PRs to the previous branch? I did a little search and seems we broke scala 2.10 a little

[GitHub] spark pull request #18629: [SPARK-21409][SS] Expose state store memory usage...

2017-07-13 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/18629#discussion_r127367136 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQueryStatusAndProgressSuite.scala --- @@ -33,16 +33,10 @@ import

[GitHub] spark issue #17848: [SPARK-20586] [SQL] Add deterministic and distinctLike t...

2017-07-13 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17848 cc @cloud-fan @sameeragarwal --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #18629: [SPARK-21409][SS] Expose state store memory usage...

2017-07-13 Thread tdas
GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/18629 [SPARK-21409][SS] Expose state store memory usage in SQL metrics and progress updates ## What changes were proposed in this pull request? Currently, there is no tracking of memory usage of

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

2017-07-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18444 BTW, I wouldn't mind if we go merge this meanwhile. I trust @ueshin's judgement. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

2017-07-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18444 I will help double check within coming three or four days (for me it takes a quite while to debug and double check this case ...) --- If your project is set up for it, you can reply to this

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

2017-07-13 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/18444 @HyukjinKwon, @holdenk, Could you double-check the way to handle an array of typecode `'c'` please? I'm not exactly sure this can cover all cases. --- If your project is set up for it, you can

[GitHub] spark issue #17848: [SPARK-20586] [SQL] Add deterministic and distinctLike t...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17848 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17848: [SPARK-20586] [SQL] Add deterministic and distinctLike t...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17848 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79594/ Test PASSed. ---

[GitHub] spark issue #17848: [SPARK-20586] [SQL] Add deterministic and distinctLike t...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17848 **[Test build #79594 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79594/testReport)** for PR 17848 at commit

[GitHub] spark issue #18617: [SPARK-21376][YARN] Fix yarn client token expire issue w...

2017-07-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/18617 Hi, All. Can we have this on `branch-2.2`, too? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #18571: [SPARK-21344][SQL] BinaryType comparison does signed byt...

2017-07-13 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18571 ```SQL SELECT x'00' < x'0f' SELECT x'00' < x'ff' ``` Could you add the above queries to a new `comparator.sql` file? --- If your project is set up for it, you can reply to

[GitHub] spark issue #18547: [SPARK-21321][Spark Core] Spark very verbose on shutdown

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18547 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18547: [SPARK-21321][Spark Core] Spark very verbose on shutdown

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18547 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79591/ Test PASSed. ---

[GitHub] spark issue #18547: [SPARK-21321][Spark Core] Spark very verbose on shutdown

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18547 **[Test build #79591 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79591/testReport)** for PR 18547 at commit

[GitHub] spark pull request #18617: [SPARK-21376][YARN] Fix yarn client token expire ...

2017-07-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18617 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18617: [SPARK-21376][YARN] Fix yarn client token expire issue w...

2017-07-13 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/18617 Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #17848: [SPARK-20586] [SQL] Add deterministic and distinctLike t...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17848 **[Test build #79594 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79594/testReport)** for PR 17848 at commit

[GitHub] spark issue #18617: [SPARK-21376][YARN] Fix yarn client token expire issue w...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18617 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79593/ Test PASSed. ---

[GitHub] spark issue #18617: [SPARK-21376][YARN] Fix yarn client token expire issue w...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18617 **[Test build #79593 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79593/testReport)** for PR 18617 at commit

[GitHub] spark issue #18617: [SPARK-21376][YARN] Fix yarn client token expire issue w...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18617 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18617: [SPARK-21376][YARN] Fix yarn client token expire issue w...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18617 **[Test build #79593 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79593/testReport)** for PR 18617 at commit

[GitHub] spark issue #18628: [SPARK-21407][ThriftServer] Add spnego auth support for ...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18628 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79592/ Test PASSed. ---

[GitHub] spark issue #18628: [SPARK-21407][ThriftServer] Add spnego auth support for ...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18628 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18628: [SPARK-21407][ThriftServer] Add spnego auth support for ...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18628 **[Test build #79592 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79592/testReport)** for PR 18628 at commit

[GitHub] spark issue #18628: [SPARK-21407][ThriftServer] Add spnego auth support for ...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18628 **[Test build #79592 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79592/testReport)** for PR 18628 at commit

[GitHub] spark pull request #18628: [SPARK-21407][ThriftServer] Add spnego auth suppo...

2017-07-13 Thread jerryshao
GitHub user jerryshao opened a pull request: https://github.com/apache/spark/pull/18628 [SPARK-21407][ThriftServer] Add spnego auth support for ThriftServer thrift/http protocol ## What changes were proposed in this pull request? Spark ThriftServer doesn't support spnego

[GitHub] spark issue #18555: [SPARK-21353][CORE]add checkValue in spark.internal.conf...

2017-07-13 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18555 @heary-cao Sorry, I did not find the test cases. Not comfortable to merge the PR without the test cases. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #18587: [SPARK-21403][Mesos] fix --packages for mesos

2017-07-13 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/18587 thnx @vanzin I am working on some code for the standalone case. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #18515: [SPARK-21287][SQL] Ability to use Integer.MIN_VALUE as a...

2017-07-13 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18515 @maver1ck Any update? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18627: [BACKPORT-2.1][SPARK-19104][SQL] Lambda variables in Ext...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18627 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79590/ Test PASSed. ---

[GitHub] spark issue #18627: [BACKPORT-2.1][SPARK-19104][SQL] Lambda variables in Ext...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18627 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18627: [BACKPORT-2.1][SPARK-19104][SQL] Lambda variables in Ext...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18627 **[Test build #79590 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79590/testReport)** for PR 18627 at commit

[GitHub] spark pull request #18616: [SPARK-21377][YARN] Make jars specify with --jars...

2017-07-13 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/18616#discussion_r127321876 --- Diff: core/src/main/scala/org/apache/spark/deploy/security/HadoopDelegationTokenManager.scala --- @@ -42,7 +42,7 @@ import

[GitHub] spark pull request #18616: [SPARK-21377][YARN] Make jars specify with --jars...

2017-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/18616#discussion_r127321136 --- Diff: core/src/main/scala/org/apache/spark/deploy/security/HadoopDelegationTokenManager.scala --- @@ -42,7 +42,7 @@ import

[GitHub] spark pull request #18616: [SPARK-21377][YARN] Make jars specify with --jars...

2017-07-13 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/18616#discussion_r127319048 --- Diff: core/src/main/scala/org/apache/spark/deploy/security/HadoopDelegationTokenManager.scala --- @@ -42,7 +42,7 @@ import

[GitHub] spark pull request #18616: [SPARK-21377][YARN] Make jars specify with --jars...

2017-07-13 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/18616#discussion_r127317541 --- Diff: core/src/main/scala/org/apache/spark/deploy/security/HadoopDelegationTokenManager.scala --- @@ -42,7 +42,7 @@ import

[GitHub] spark issue #18547: [SPARK-21321][Spark Core] Spark very verbose on shutdown

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18547 **[Test build #79591 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79591/testReport)** for PR 18547 at commit

[GitHub] spark issue #18547: [SPARK-21321][Spark Core] Spark very verbose on shutdown

2017-07-13 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/18547 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #18616: [SPARK-21377][YARN] Make jars specify with --jars...

2017-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/18616#discussion_r127314530 --- Diff: core/src/main/scala/org/apache/spark/deploy/security/HadoopDelegationTokenManager.scala --- @@ -42,7 +42,7 @@ import

[GitHub] spark pull request #18617: [SPARK-21376][YARN] Fix yarn client token expire ...

2017-07-13 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/18617#discussion_r127309324 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -192,16 +193,29 @@ private[spark] class Client(

[GitHub] spark issue #18547: [SPARK-21321][Spark Core] Spark very verbose on shutdown

2017-07-13 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/18547 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #18617: [SPARK-21376][YARN] Fix yarn client token expire ...

2017-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/18617#discussion_r127299428 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -192,16 +193,29 @@ private[spark] class Client( *

[GitHub] spark issue #18626: [BACKPORT-2.1][SPARK-19104][SQL] Lambda variables in Ext...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18626 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18626: [BACKPORT-2.1][SPARK-19104][SQL] Lambda variables in Ext...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18626 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79589/ Test PASSed. ---

[GitHub] spark pull request #18616: [SPARK-21377][YARN] Make jars specify with --jars...

2017-07-13 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/18616#discussion_r127298989 --- Diff: core/src/main/scala/org/apache/spark/deploy/security/HadoopDelegationTokenManager.scala --- @@ -42,7 +42,7 @@ import

[GitHub] spark issue #18626: [BACKPORT-2.1][SPARK-19104][SQL] Lambda variables in Ext...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18626 **[Test build #79589 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79589/testReport)** for PR 18626 at commit

[GitHub] spark issue #18621: [SPARK-21400][SQL] Don't overwrite output committers on ...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18621 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79588/ Test PASSed. ---

[GitHub] spark issue #18621: [SPARK-21400][SQL] Don't overwrite output committers on ...

2017-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18621 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18621: [SPARK-21400][SQL] Don't overwrite output committers on ...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18621 **[Test build #79588 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79588/testReport)** for PR 18621 at commit

[GitHub] spark pull request #18616: [SPARK-21377][YARN] Make jars specify with --jars...

2017-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/18616#discussion_r127293947 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala --- @@ -674,6 +671,43 @@ private[spark] class

[GitHub] spark pull request #18616: [SPARK-21377][YARN] Make jars specify with --jars...

2017-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/18616#discussion_r127293531 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala --- @@ -90,6 +90,18 @@ private[spark] class

[GitHub] spark pull request #18616: [SPARK-21377][YARN] Make jars specify with --jars...

2017-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/18616#discussion_r127294479 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala --- @@ -674,6 +671,43 @@ private[spark] class

[GitHub] spark pull request #18616: [SPARK-21377][YARN] Make jars specify with --jars...

2017-07-13 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/18616#discussion_r127295807 --- Diff: core/src/main/scala/org/apache/spark/deploy/security/HadoopDelegationTokenManager.scala --- @@ -42,7 +42,7 @@ import

[GitHub] spark issue #18627: [BACKPORT-2.1][SPARK-19104][SQL] Lambda variables in Ext...

2017-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18627 **[Test build #79590 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79590/testReport)** for PR 18627 at commit

[GitHub] spark pull request #18627: [BACKPORT-2.1][SPARK-19104][SQL] Lambda variables...

2017-07-13 Thread kiszk
GitHub user kiszk opened a pull request: https://github.com/apache/spark/pull/18627 [BACKPORT-2.1][SPARK-19104][SQL] Lambda variables in ExternalMapToCatalyst should be global ## What changes were proposed in this pull request? This PR is backport of #18418 to Spark 2.1.

  1   2   3   >