[GitHub] spark pull request #18483: [SPARK-17528][SQL] data should be copied properly...

2017-06-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/18483#discussion_r125034337 --- Diff: common/unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java --- @@ -1088,6 +1088,12 @@ public UTF8String clone() { retur

[GitHub] spark issue #18483: [SPARK-17528][SQL] data should be copied properly before...

2017-06-30 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/18483 LGTM - pending jenkins --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark issue #16028: [SPARK-18518][ML] HasSolver supports override

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16028 **[Test build #78983 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78983/testReport)** for PR 16028 at commit [`d15ea65`](https://github.com/apache/spark/commit/d1

[GitHub] spark pull request #18487: [SPARK-21243][Core] Limit no. of map outputs in a...

2017-06-30 Thread dhruve
GitHub user dhruve opened a pull request: https://github.com/apache/spark/pull/18487 [SPARK-21243][Core] Limit no. of map outputs in a shuffle fetch ## What changes were proposed in this pull request? For configurations with external shuffle enabled, we have observed that if a v

[GitHub] spark pull request #18471: [SPARK-21259] More rules for scalastyle

2017-06-30 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18471#discussion_r125032760 --- Diff: core/src/main/scala/org/apache/spark/broadcast/BroadcastManager.scala --- @@ -52,8 +52,8 @@ private[spark] class BroadcastManager(

[GitHub] spark pull request #18471: [SPARK-21259] More rules for scalastyle

2017-06-30 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18471#discussion_r125032238 --- Diff: core/src/main/scala/org/apache/spark/broadcast/BroadcastManager.scala --- @@ -52,8 +52,8 @@ private[spark] class BroadcastManager(

[GitHub] spark issue #18471: [SPARK-21259] More rules for scalastyle

2017-06-30 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18471 My only concern is `[K : ClassTag]`. This is conventional in scala but the new style check rule rejects it. If it's hard to make a corrected rule for this case, we can drop it. --- If your proje

[GitHub] spark pull request #18471: [SPARK-21259] More rules for scalastyle

2017-06-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18471#discussion_r125029078 --- Diff: core/src/main/scala/org/apache/spark/broadcast/BroadcastManager.scala --- @@ -52,8 +52,8 @@ private[spark] class BroadcastManager(

[GitHub] spark issue #18485: [SPARK-21267][SS][DOCS] Update Structured Streaming Docu...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18485 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18485: [SPARK-21267][SS][DOCS] Update Structured Streaming Docu...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18485 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78977/ Test PASSed. ---

[GitHub] spark issue #18485: [SPARK-21267][SS][DOCS] Update Structured Streaming Docu...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18485 **[Test build #78977 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78977/testReport)** for PR 18485 at commit [`109cca9`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #18430: [SPARK-21223] Change fileToAppInfo in FsHistoryProvider ...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18430 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18430: [SPARK-21223] Change fileToAppInfo in FsHistoryProvider ...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18430 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78974/ Test PASSed. ---

[GitHub] spark pull request #18438: [SPARK-18294][CORE] Implement commit protocol to ...

2017-06-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18438 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #18430: [SPARK-21223] Change fileToAppInfo in FsHistoryProvider ...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18430 **[Test build #78974 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78974/testReport)** for PR 18430 at commit [`a4f8054`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #18485: [SPARK-21267][SS][DOCS] Update Structured Streaming Docu...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18485 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18485: [SPARK-21267][SS][DOCS] Update Structured Streaming Docu...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18485 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78976/ Test PASSed. ---

[GitHub] spark issue #18438: [SPARK-18294][CORE] Implement commit protocol to support...

2017-06-30 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18438 thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark issue #18485: [SPARK-21267][SS][DOCS] Update Structured Streaming Docu...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18485 **[Test build #78976 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78976/testReport)** for PR 18485 at commit [`a77bca5`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #16699: [SPARK-18710][ML] Add offset in GLM

2017-06-30 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/16699 @yanboliang @actuaryzhang this PR breaks the scala-2.10 build: ``` [error] /home/jenkins/workspace/spark-master-compile-maven-scala-2.10/mllib/src/test/scala/org/apache/spark/ml/regression

[GitHub] spark pull request #18471: [SPARK-21259] More rules for scalastyle

2017-06-30 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18471#discussion_r125027002 --- Diff: core/src/main/scala/org/apache/spark/Accumulable.scala --- @@ -68,7 +68,9 @@ class Accumulable[R, T] private ( } private[sp

[GitHub] spark issue #18483: [SPARK-17528][SQL] data should be copied properly before...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18483 **[Test build #78982 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78982/testReport)** for PR 18483 at commit [`cac8dc6`](https://github.com/apache/spark/commit/ca

[GitHub] spark pull request #18471: [SPARK-21259] More rules for scalastyle

2017-06-30 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18471#discussion_r125026821 --- Diff: core/src/main/scala/org/apache/spark/Accumulable.scala --- @@ -68,7 +68,9 @@ class Accumulable[R, T] private ( } private[sp

[GitHub] spark pull request #18305: [SPARK-20988][ML] Logistic regression uses aggreg...

2017-06-30 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/18305#discussion_r125026593 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/loss/RDDLossFunction.scala --- @@ -62,8 +62,8 @@ private[ml] class RDDLossFunction[ val new

[GitHub] spark pull request #18483: [SPARK-17528][SQL] data should be copied properly...

2017-06-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18483#discussion_r125026257 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/InternalRow.scala --- @@ -94,4 +108,21 @@ object InternalRow { /** Return

[GitHub] spark issue #18174: [SPARK-20950][CORE]add a new config to diskWriteBufferSi...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18174 **[Test build #78981 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78981/testReport)** for PR 18174 at commit [`62ccd4e`](https://github.com/apache/spark/commit/62

[GitHub] spark issue #18464: [SPARK-21250][WEB-UI]Add a url in the table of 'Running ...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18464 **[Test build #78980 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78980/testReport)** for PR 18464 at commit [`aa269a6`](https://github.com/apache/spark/commit/aa

[GitHub] spark issue #18174: [SPARK-20950][CORE]add a new config to diskWriteBufferSi...

2017-06-30 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18174 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #18483: [SPARK-17528][SQL] data should be copied properly...

2017-06-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/18483#discussion_r125025743 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/InternalRow.scala --- @@ -94,4 +108,21 @@ object InternalRow { /** Retur

[GitHub] spark pull request #18483: [SPARK-17528][SQL] data should be copied properly...

2017-06-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/18483#discussion_r125025770 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/InternalRow.scala --- @@ -94,4 +108,21 @@ object InternalRow { /** Retur

[GitHub] spark issue #18464: [SPARK-21250][WEB-UI]Add a url in the table of 'Running ...

2017-06-30 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18464 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if t

[GitHub] spark pull request #18483: [SPARK-17528][SQL] data should be copied properly...

2017-06-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18483#discussion_r125025642 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/codegen/GeneratedProjectionSuite.scala --- @@ -172,4 +172,40 @@ class Gen

[GitHub] spark pull request #18483: [SPARK-17528][SQL] data should be copied properly...

2017-06-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18483#discussion_r125025561 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/InternalRow.scala --- @@ -94,4 +108,21 @@ object InternalRow { /** Return

[GitHub] spark pull request #18483: [SPARK-17528][SQL] data should be copied properly...

2017-06-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18483#discussion_r125025362 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/InternalRow.scala --- @@ -94,4 +108,21 @@ object InternalRow { /** Return

[GitHub] spark issue #18485: [SPARK-21267][SS][DOCS] Update Structured Streaming Docu...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18485 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78975/ Test PASSed. ---

[GitHub] spark issue #18485: [SPARK-21267][SS][DOCS] Update Structured Streaming Docu...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18485 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18485: [SPARK-21267][SS][DOCS] Update Structured Streaming Docu...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18485 **[Test build #78975 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78975/testReport)** for PR 18485 at commit [`d3998f8`](https://github.com/apache/spark/commit/d

[GitHub] spark pull request #18483: [SPARK-17528][SQL] data should be copied properly...

2017-06-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18483#discussion_r125025226 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/InternalRow.scala --- @@ -94,4 +108,21 @@ object InternalRow { /** Return

[GitHub] spark pull request #18305: [SPARK-20988][ML] Logistic regression uses aggreg...

2017-06-30 Thread MLnick
Github user MLnick commented on a diff in the pull request: https://github.com/apache/spark/pull/18305#discussion_r125024716 --- Diff: mllib/src/test/scala/org/apache/spark/ml/optim/aggregator/LogisticAggregatorSuite.scala --- @@ -0,0 +1,254 @@ +/* + * Licensed to the Apac

[GitHub] spark issue #18483: [SPARK-17528][SQL] data should be copied properly before...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18483 **[Test build #78979 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78979/testReport)** for PR 18483 at commit [`f630cbd`](https://github.com/apache/spark/commit/f6

[GitHub] spark pull request #16699: [SPARK-18710][ML] Add offset in GLM

2017-06-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16699 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #18483: [SPARK-17528][SQL] data should be copied properly before...

2017-06-30 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18483 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #18483: [SPARK-17528][SQL] data should be copied properly...

2017-06-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18483#discussion_r125023237 --- Diff: common/unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java --- @@ -1088,6 +1088,12 @@ public UTF8String clone() { return

[GitHub] spark issue #16699: [SPARK-18710][ML] Add offset in GLM

2017-06-30 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/16699 Merged into master. Thanks for contribution and all reviews! This great feature will benefit lots of users. @actuaryzhang Could you send follow-up PRs to address the two inline comments? Than

[GitHub] spark pull request #18471: [SPARK-21259] More rules for scalastyle

2017-06-30 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/18471#discussion_r125022780 --- Diff: core/src/main/scala/org/apache/spark/broadcast/BroadcastManager.scala --- @@ -52,8 +52,8 @@ private[spark] class BroadcastManager(

[GitHub] spark issue #18445: [Spark-19726][SQL] Faild to insert null timestamp value ...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18445 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18445: [Spark-19726][SQL] Faild to insert null timestamp value ...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18445 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78978/ Test FAILed. ---

[GitHub] spark issue #18445: [Spark-19726][SQL] Faild to insert null timestamp value ...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18445 **[Test build #78978 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78978/testReport)** for PR 18445 at commit [`637ca0e`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #17681: [SPARK-20383][SQL] Supporting Create [temporary] Functio...

2017-06-30 Thread ouyangxiaochen
Github user ouyangxiaochen commented on the issue: https://github.com/apache/spark/pull/17681 @gatorsmile @cloud-fan @HyukjinKwon Could you review this PR when you have sometime? Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear o

[GitHub] spark issue #16856: [SPARK-19516][DOC] update public doc to use SparkSession...

2017-06-30 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/16856 My PR to fix them https://github.com/apache/spark/pull/18485 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark issue #18334: [SPARK-21127] [SQL] Update statistics after data changin...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18334 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78972/ Test PASSed. ---

[GitHub] spark issue #18334: [SPARK-21127] [SQL] Update statistics after data changin...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18334 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18334: [SPARK-21127] [SQL] Update statistics after data changin...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18334 **[Test build #78972 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78972/testReport)** for PR 18334 at commit [`db8a640`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #18308: [SPARK-21099][Spark Core] INFO Log Message Using Incorre...

2017-06-30 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18308 Ping @ihazem to update or close --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18471: [SPARK-21259] More rules for scalastyle

2017-06-30 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18471 I tend to agree with the style change, but, am concerned about what a huge diff this creates for little gain. I personally am not sure I'd bother with the colon change; some instances of space before

[GitHub] spark pull request #18477: [SPARK-21261][DOCS]SQL Regex document fix

2017-06-30 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/18477#discussion_r125014855 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/regexpExpressions.scala --- @@ -268,7 +268,7 @@ case class StringSplit(str:

[GitHub] spark issue #18486: [SPARK-21265][SQL] Cache method could specified name

2017-06-30 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18486 This was a duplicate JIRA. See the original and its PR for more discussion. I'm not sure this works. --- If your project is set up for it, you can reply to this email and have your reply appear on G

[GitHub] spark pull request #17899: [SPARK-20636] Add new optimization rule to transp...

2017-06-30 Thread ptkool
Github user ptkool commented on a diff in the pull request: https://github.com/apache/spark/pull/17899#discussion_r125013340 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -610,6 +611,25 @@ object CollapseWindow extends Rule[Lo

[GitHub] spark pull request #17899: [SPARK-20636] Add new optimization rule to transp...

2017-06-30 Thread ptkool
Github user ptkool commented on a diff in the pull request: https://github.com/apache/spark/pull/17899#discussion_r125013283 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -610,6 +611,25 @@ object CollapseWindow extends Rule[Lo

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78969/ Test PASSed. ---

[GitHub] spark issue #18445: [Spark-19726][SQL] Faild to insert null timestamp value ...

2017-06-30 Thread shuangshuangwang
Github user shuangshuangwang commented on the issue: https://github.com/apache/spark/pull/18445 Hi @gatorsmile , I have just pushed code changes as you suggested. Need i to add this value as a property to class JDBCOptions? --- If your project is set up for it, you can reply to t

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18159 **[Test build #78969 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78969/testReport)** for PR 18159 at commit [`32f4abf`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #18445: [Spark-19726][SQL] Faild to insert null timestamp value ...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18445 **[Test build #78978 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78978/testReport)** for PR 18445 at commit [`637ca0e`](https://github.com/apache/spark/commit/63

[GitHub] spark issue #18486: [SPARK-21265][SQL] Cache method could specified name

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18486 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #18485: [SPARK-21267][SS][DOCS] Update Structured Streami...

2017-06-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/18485#discussion_r125009568 --- Diff: docs/_layouts/global.html --- @@ -69,14 +69,14 @@ Programming Guides

[GitHub] spark pull request #18486: [SPARK-21265][SQL] Cache method could specified n...

2017-06-30 Thread darionyaphet
GitHub user darionyaphet opened a pull request: https://github.com/apache/spark/pull/18486 [SPARK-21265][SQL] Cache method could specified name ## What changes were proposed in this pull request? Currently when I cache dataset in my cluster I found the RDD Name is the RDD S

[GitHub] spark issue #18485: [SPARK-21267][SS][DOCS] Update Structured Streaming Docu...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18485 **[Test build #78977 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78977/testReport)** for PR 18485 at commit [`109cca9`](https://github.com/apache/spark/commit/10

[GitHub] spark issue #18485: [SPARK-21267][SS][DOCS] Update Structured Streaming Docu...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18485 **[Test build #78976 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78976/testReport)** for PR 18485 at commit [`a77bca5`](https://github.com/apache/spark/commit/a7

[GitHub] spark pull request #18485: [SPARK-21267][SS][DOCS] Update Structured Streami...

2017-06-30 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/18485#discussion_r125007301 --- Diff: docs/structured-streaming-programming-guide.md --- @@ -1043,7 +1060,7 @@ streamingDf \ ### Arbitrary Stateful Operations -Many us

[GitHub] spark issue #18485: [SPARK-21267][SS][DOCS] Update Structured Streaming Docu...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18485 **[Test build #78975 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78975/testReport)** for PR 18485 at commit [`d3998f8`](https://github.com/apache/spark/commit/d3

[GitHub] spark pull request #18485: [SPARK-21267][SS][DOCS] Update Structured Streami...

2017-06-30 Thread tdas
GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/18485 [SPARK-21267][SS][DOCS] Update Structured Streaming Documentation ## What changes were proposed in this pull request? Few changes to the Structured Streaming documentation - Clarify that t

[GitHub] spark issue #18480: [SPARK-21052][SQL][Follow-up] Add hash map metrics to jo...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18480 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18480: [SPARK-21052][SQL][Follow-up] Add hash map metrics to jo...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18480 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78962/ Test PASSed. ---

[GitHub] spark issue #18480: [SPARK-21052][SQL][Follow-up] Add hash map metrics to jo...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18480 **[Test build #78962 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78962/testReport)** for PR 18480 at commit [`d8df5e0`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #18482: [SPARK-21262][WIP] Stop sending 'stream request' when sh...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18482 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18482: [SPARK-21262][WIP] Stop sending 'stream request' when sh...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18482 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78961/ Test PASSed. ---

[GitHub] spark issue #18482: [SPARK-21262][WIP] Stop sending 'stream request' when sh...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18482 **[Test build #78961 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78961/testReport)** for PR 18482 at commit [`9802b85`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78968/ Test FAILed. ---

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18159 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18159: [SPARK-20703][SQL] Associate metrics with data writes on...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18159 **[Test build #78968 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78968/testReport)** for PR 18159 at commit [`1defb3a`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #18174: [SPARK-20950][CORE]add a new config to diskWriteBufferSi...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18174 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78967/ Test FAILed. ---

[GitHub] spark issue #18174: [SPARK-20950][CORE]add a new config to diskWriteBufferSi...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18174 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18174: [SPARK-20950][CORE]add a new config to diskWriteBufferSi...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18174 **[Test build #78967 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78967/testReport)** for PR 18174 at commit [`62ccd4e`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #18430: [SPARK-21223] Change fileToAppInfo in FsHistoryProvider ...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18430 **[Test build #78974 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78974/testReport)** for PR 18430 at commit [`a4f8054`](https://github.com/apache/spark/commit/a4

[GitHub] spark issue #18430: [SPARK-21223] Change fileToAppInfo in FsHistoryProvider ...

2017-06-30 Thread zenglinxi0615
Github user zenglinxi0615 commented on the issue: https://github.com/apache/spark/pull/18430 test please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #18483: [SPARK-17528][SQL] data should be copied properly before...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18483 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18483: [SPARK-17528][SQL] data should be copied properly before...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18483 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78964/ Test FAILed. ---

[GitHub] spark issue #18483: [SPARK-17528][SQL] data should be copied properly before...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18483 **[Test build #78964 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78964/testReport)** for PR 18483 at commit [`f630cbd`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #18479: WIP - logical plan stat propagation using mixin and visi...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18479 **[Test build #3821 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3821/testReport)** for PR 18479 at commit [`9c32d25`](https://github.com/apache/spark/commit/

[GitHub] spark issue #17899: [SPARK-20636] Add new optimization rule to transpose adj...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17899 **[Test build #78973 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78973/testReport)** for PR 17899 at commit [`e2f24c2`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #17899: [SPARK-20636] Add new optimization rule to transpose adj...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17899 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78973/ Test FAILed. ---

[GitHub] spark issue #17899: [SPARK-20636] Add new optimization rule to transpose adj...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17899 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17899: [SPARK-20636] Add new optimization rule to transpose adj...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17899 **[Test build #78973 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78973/testReport)** for PR 17899 at commit [`e2f24c2`](https://github.com/apache/spark/commit/e2

[GitHub] spark issue #18436: [SPARK-20073][SQL] Prints an explicit warning message in...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18436 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18436: [SPARK-20073][SQL] Prints an explicit warning message in...

2017-06-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18436 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78963/ Test PASSed. ---

[GitHub] spark issue #18436: [SPARK-20073][SQL] Prints an explicit warning message in...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18436 **[Test build #78963 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78963/testReport)** for PR 18436 at commit [`12347e6`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #18334: [SPARK-21127] [SQL] Update statistics after data changin...

2017-06-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18334 **[Test build #78972 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78972/testReport)** for PR 18334 at commit [`db8a640`](https://github.com/apache/spark/commit/db

[GitHub] spark pull request #18483: [SPARK-17528][SQL] data should be copied properly...

2017-06-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/18483#discussion_r124995524 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/InternalRow.scala --- @@ -94,4 +108,21 @@ object InternalRow { /** Retur

[GitHub] spark pull request #18483: [SPARK-17528][SQL] data should be copied properly...

2017-06-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/18483#discussion_r124995580 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/InternalRow.scala --- @@ -94,4 +108,21 @@ object InternalRow { /** Retur

<    1   2   3   4   5   >