[GitHub] spark issue #13514: [SPARK-15770][ML] Annotation audit for Experimental and ...

2016-06-04 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/13514 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60002/ Test PASSed. ---

[GitHub] spark issue #13514: [SPARK-15770][ML] Annotation audit for Experimental and ...

2016-06-04 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/13514 **[Test build #60002 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60002/consoleFull)** for PR 13514 at commit

[GitHub] spark issue #13514: [SPARK-15770][ML] Annotation audit for Experimental and ...

2016-06-04 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/13514 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #13505: [SPARK-15764][SQL] Replace N^2 loop in BindRefere...

2016-06-04 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13505#discussion_r65811458 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/package.scala --- @@ -86,11 +86,31 @@ package object expressions {

[GitHub] spark issue #13508: [SPARK-15766][SparkR]:R should export is.nan

2016-06-04 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/13508 @felixcheung As we discussed, I opened a JIRA on exporting the is.nan. Can you review it? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #13476: [SPARK-15684][SparkR]Not mask startsWith and endsWith in...

2016-06-04 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/13476 @felixcheung Any more comments? The version check is needed otherwise it can't pass unit tests. All other review comments are done. --- If your project is set up for it, you can reply to this

[GitHub] spark issue #13513: [SPARK-15698][SQL][Streaming] Add the ability to remove ...

2016-06-04 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/13513 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13513: [SPARK-15698][SQL][Streaming] Add the ability to remove ...

2016-06-04 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/13513 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/6/ Test FAILed. --- If

[GitHub] spark issue #13513: [SPARK-15698][SQL][Streaming] Add the ability to remove ...

2016-06-04 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/13513 **[Test build #6 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/6/consoleFull)** for PR 13513 at commit

[GitHub] spark issue #13514: [SPARK-15770][ML] Annotation audit for Experimental and ...

2016-06-04 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/13514 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60001/ Test PASSed. ---

[GitHub] spark issue #13514: [SPARK-15770][ML] Annotation audit for Experimental and ...

2016-06-04 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/13514 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13514: [SPARK-15770][ML] Annotation audit for Experimental and ...

2016-06-04 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/13514 **[Test build #60001 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60001/consoleFull)** for PR 13514 at commit

[GitHub] spark issue #13514: [SPARK-15770][ML] Annotation audit for Experimental and ...

2016-06-04 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/13514 **[Test build #60002 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60002/consoleFull)** for PR 13514 at commit

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-04 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-04 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59998/ Test FAILed. --- If

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-04 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 **[Test build #59998 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59998/consoleFull)** for PR 12836 at commit

[GitHub] spark issue #13514: [SPARK-15770][ML] 'Experimental' annotation audit

2016-06-04 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/13514 **[Test build #60001 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60001/consoleFull)** for PR 13514 at commit

[GitHub] spark pull request #13514: [SPARK-15770][ML] 'Experimental' annotation audit

2016-06-04 Thread zhengruifeng
GitHub user zhengruifeng opened a pull request: https://github.com/apache/spark/pull/13514 [SPARK-15770][ML] 'Experimental' annotation audit ## What changes were proposed in this pull request? 1, remove comments `:: Experimental ::` for non-experimental API 2, add comments

[GitHub] spark issue #13505: [SPARK-15764][SQL] Replace N^2 loop in BindReferences

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13505 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13505: [SPARK-15764][SQL] Replace N^2 loop in BindReferences

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13505 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59994/ Test FAILed. --- If

[GitHub] spark issue #13505: [SPARK-15764][SQL] Replace N^2 loop in BindReferences

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13505 **[Test build #59994 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59994/consoleFull)** for PR 13505 at commit

[GitHub] spark issue #13513: [SPARK-15698][SQL][Streaming] Add the ability to remove ...

2016-06-04 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/13513 **[Test build #6 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/6/consoleFull)** for PR 13513 at commit

[GitHub] spark pull request #13513: [SPARK-15698][SQL][Streaming] Add the ability to ...

2016-06-04 Thread jerryshao
GitHub user jerryshao opened a pull request: https://github.com/apache/spark/pull/13513 [SPARK-15698][SQL][Streaming] Add the ability to remove the old MetadataLog in FileStreamSource ## What changes were proposed in this pull request? Current `metadataLog` in

[GitHub] spark issue #13512: [SPARK-15769][SQL] Add Encoder for input type to Aggrega...

2016-06-04 Thread koertkuipers
Github user koertkuipers commented on the issue: https://github.com/apache/spark/pull/13512 **[Test build #5 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/5/consoleFull)** for PR 13512 at commit

[GitHub] spark issue #13512: [SPARK-15769][SQL] Add Encoder for input type to Aggrega...

2016-06-04 Thread koertkuipers
Github user koertkuipers commented on the issue: https://github.com/apache/spark/pull/13512 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/5/ Test FAILed. ---

[GitHub] spark issue #13512: [SPARK-15769][SQL] Add Encoder for input type to Aggrega...

2016-06-04 Thread koertkuipers
Github user koertkuipers commented on the issue: https://github.com/apache/spark/pull/13512 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #13512: [SPARK-15769][SQL] Add Encoder for input type to Aggrega...

2016-06-04 Thread koertkuipers
Github user koertkuipers commented on the issue: https://github.com/apache/spark/pull/13512 **[Test build #5 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/5/consoleFull)** for PR 13512 at commit

[GitHub] spark pull request #13512: [SPARK-15769][SQL] Add Encoder for input type to ...

2016-06-04 Thread koertkuipers
GitHub user koertkuipers opened a pull request: https://github.com/apache/spark/pull/13512 [SPARK-15769][SQL] Add Encoder for input type to Aggregator ## What changes were proposed in this pull request? Aggregator also has an Encoder for the input type ## How was this

[GitHub] spark issue #9113: [SPARK-11100][SQL]HiveThriftServer HA issue,HiveThriftSer...

2016-06-04 Thread xiaowangyu
Github user xiaowangyu commented on the issue: https://github.com/apache/spark/pull/9113 @rxin Thanks! I get it. BTW,any component will take the place of the thrift server? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #10232: [SPARK-12248][CORE] Adds limits per cpu for mesos coarse...

2016-06-04 Thread drcrallen
Github user drcrallen commented on the issue: https://github.com/apache/spark/pull/10232 @drcrallen Did https://github.com/apache/spark/pull/4027 covered the memory constraints you were adding as part of this issue? I can't find another open or closed issue that addresses the issue

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-04 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 **[Test build #59998 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59998/consoleFull)** for PR 12836 at commit

[GitHub] spark issue #13511: [SPARK-14900][ML][PySpark] Add accuracy and deprecate pr...

2016-06-04 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/13511 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13511: [SPARK-14900][ML][PySpark] Add accuracy and deprecate pr...

2016-06-04 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/13511 **[Test build #59997 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59997/consoleFull)** for PR 13511 at commit

[GitHub] spark issue #13511: [SPARK-14900][ML][PySpark] Add accuracy and deprecate pr...

2016-06-04 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/13511 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59997/ Test PASSed. ---

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-04 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59996/ Test FAILed. --- If

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-04 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 **[Test build #59996 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59996/consoleFull)** for PR 12836 at commit

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-04 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13511: [SPARK-14900][ML][PySpark] Add accuracy and deprecate pr...

2016-06-04 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/13511 @srowen It is just the local test code, please ignore it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #13511: [SPARK-14900][ML][PySpark] Add accuracy and deprecate pr...

2016-06-04 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/13511 Looks correct, what are you pointing out? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #13511: [SPARK-14900][ML][PySpark] Add accuracy and deprecate pr...

2016-06-04 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/13511 **[Test build #59997 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59997/consoleFull)** for PR 13511 at commit

[GitHub] spark issue #13511: [SPARK-14900][ML][PySpark] Add accuracy and deprecate pr...

2016-06-04 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/13511 cc @srowen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #13511: [SPARK-14900][ML][PySpark] Add accuracy and deprecate pr...

2016-06-04 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/13511 ``` >>> from pyspark.mllib.evaluation import * >>> predictionAndLabels = sc.parallelize([(0.0, 0.0), (0.0, 1.0), (0.0, 0.0), (1.0, 0.0), (1.0, 1.0), (1.0, 1.0), (1.0, 1.0), (2.0, 2.0),

[GitHub] spark pull request #13511: [SPARK-14900][ML][PySpark] Add accuracy and depre...

2016-06-04 Thread zhengruifeng
GitHub user zhengruifeng opened a pull request: https://github.com/apache/spark/pull/13511 [SPARK-14900][ML][PySpark] Add accuracy and deprecate precison,recall,f1 ## What changes were proposed in this pull request? 1, add accuracy for MulticlassMetrics 2, deprecate overall

[GitHub] spark issue #13491: [SPARK-15748][SQL] Replace inefficient foldLeft() call w...

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13491 **[Test build #3065 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3065/consoleFull)** for PR 13491 at commit

[GitHub] spark issue #13491: [SPARK-15748][SQL] Replace inefficient foldLeft() call w...

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13491 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13491: [SPARK-15748][SQL] Replace inefficient foldLeft() call w...

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13491 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59995/ Test PASSed. --- If

[GitHub] spark issue #13491: [SPARK-15748][SQL] Replace inefficient foldLeft() call w...

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13491 **[Test build #59995 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59995/consoleFull)** for PR 13491 at commit

[GitHub] spark issue #9113: [SPARK-11100][SQL]HiveThriftServer HA issue,HiveThriftSer...

2016-06-04 Thread xiaowangyu
Github user xiaowangyu commented on the issue: https://github.com/apache/spark/pull/9113 @xiaowangyu the thrift server has gone through a lot of changes lately, and we are not sure whether we'd want to keep the existing thrift server at all because it has a huge amount of technical

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-04 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 **[Test build #59996 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59996/consoleFull)** for PR 12836 at commit

[GitHub] spark issue #13439: [SPARK-15701][SQL] Constant ColumnVector only needs to p...

2016-06-04 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/13439 Sorry I don't understand what this is trying to accomplish from your pr description. Are you trying to save space for the partition column? This adds the number of concrete implementations

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-04 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-04 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59993/ Test FAILed. --- If

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-04 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 **[Test build #59993 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59993/consoleFull)** for PR 12836 at commit

[GitHub] spark issue #13503: [SPARK-15761] [MLlib] [PySpark] Load ipython when defaul...

2016-06-04 Thread MechCoder
Github user MechCoder commented on the issue: https://github.com/apache/spark/pull/13503 cc @JoshRosen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #13505: [SPARK-15764][SQL] Replace N^2 loop in BindReferences

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13505 lgtm - I didn't look too closely though. Would be great @ericl to look at this in detail. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #13505: [SPARK-15764][SQL] Replace N^2 loop in BindReferences

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13505 **[Test build #3066 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3066/consoleFull)** for PR 13505 at commit

[GitHub] spark issue #13491: [SPARK-15748][SQL] Replace inefficient foldLeft() call w...

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13491 **[Test build #3065 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3065/consoleFull)** for PR 13491 at commit

[GitHub] spark issue #13491: [SPARK-15748][SQL] Replace inefficient foldLeft() call w...

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13491 **[Test build #59995 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59995/consoleFull)** for PR 13491 at commit

[GitHub] spark issue #13491: [SPARK-15748][SQL] Replace inefficient foldLeft() call w...

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13491 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #13505: [SPARK-15764][SQL] Replace N^2 loop in BindReferences

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13505 **[Test build #59994 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59994/consoleFull)** for PR 13505 at commit

[GitHub] spark issue #13505: [SPARK-15764][SQL] Replace N^2 loop in BindReferences

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13505 Alright, updated to address comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #13505: [SPARK-15764][SQL] Replace N^2 loop in BindRefere...

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/13505#discussion_r65809321 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/AttributeMap.scala --- @@ -26,13 +26,6 @@ object AttributeMap {

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-04 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 **[Test build #59993 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59993/consoleFull)** for PR 12836 at commit

[GitHub] spark pull request #13505: [SPARK-15764][SQL] Replace N^2 loop in BindRefere...

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/13505#discussion_r65808923 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/package.scala --- @@ -86,11 +86,31 @@ package object expressions {

[GitHub] spark issue #13505: [SPARK-15764][SQL] Replace N^2 loop in BindReferences

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13505 @rxin, I think that it might make sense to use AttributeSeq more widely. Right now there's an implicit conversion so we can gradually and naively migrate APIs to accept AttributeSeq. --- If

[GitHub] spark pull request #13505: [SPARK-15764][SQL] Replace N^2 loop in BindRefere...

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/13505#discussion_r65808887 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/package.scala --- @@ -86,11 +86,31 @@ package object expressions {

[GitHub] spark pull request #13505: [SPARK-15764][SQL] Replace N^2 loop in BindRefere...

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/13505#discussion_r65808880 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/package.scala --- @@ -86,11 +86,31 @@ package object expressions {

[GitHub] spark pull request #13505: [SPARK-15764][SQL] Replace N^2 loop in BindRefere...

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/13505#discussion_r65808854 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/package.scala --- @@ -86,11 +86,31 @@ package object expressions {

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-04 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-04 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 **[Test build #59992 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59992/consoleFull)** for PR 12836 at commit

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-04 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59992/ Test FAILed. --- If

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-04 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 **[Test build #59992 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59992/consoleFull)** for PR 12836 at commit

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-04 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-04 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59991/ Test FAILed. --- If

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-04 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 **[Test build #59991 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59991/consoleFull)** for PR 12836 at commit

[GitHub] spark issue #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on DataFra...

2016-06-04 Thread NarineK
Github user NarineK commented on the issue: https://github.com/apache/spark/pull/12836 **[Test build #59991 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59991/consoleFull)** for PR 12836 at commit

[GitHub] spark pull request #13448: [SPARK-15707][SQL] Make Code Neat - Use map inste...

2016-06-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13448 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13448: [SPARK-15707][SQL] Make Code Neat - Use map instead of i...

2016-06-04 Thread Sherry302
Github user Sherry302 commented on the issue: https://github.com/apache/spark/pull/13448 Merged to master/2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #13462: SPARK-15723: Fixed local-timezone-brittle test where sho...

2016-06-04 Thread javabrett
Github user javabrett commented on the issue: https://github.com/apache/spark/pull/13462 @javabrett have a look at my comment on the JIRA, what do you think? this might be more fix-able. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request #12836: [SPARK-12922][SparkR][WIP] Implement gapply() on ...

2016-06-04 Thread NarineK
Github user NarineK commented on a diff in the pull request: https://github.com/apache/spark/pull/12836#discussion_r65807864 --- Diff: R/pkg/inst/worker/worker.R --- @@ -27,6 +27,58 @@ elapsedSecs <- function() { proc.time()[3] } +computeHelper <-

[GitHub] spark pull request #13504: [SPARK-15762][SQL] Cache Metadata & StructType ha...

2016-06-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13504 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #13504: [SPARK-15762][SQL] Cache Metadata & StructType ha...

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/13504#discussion_r65807744 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/types/Metadata.scala --- @@ -104,7 +104,8 @@ sealed class Metadata private[types]

[GitHub] spark issue #13504: [SPARK-15762][SQL] Cache Metadata & StructType hashCodes...

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13504 Merging to master and 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #13504: [SPARK-15762][SQL] Cache Metadata & StructType ha...

2016-06-04 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/13504#discussion_r65807740 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/types/Metadata.scala --- @@ -104,7 +104,8 @@ sealed class Metadata private[types]

[GitHub] spark pull request #13510: [MINOR] [BUILD] Add modernizr MIT license; specif...

2016-06-04 Thread srowen
Github user srowen closed the pull request at: https://github.com/apache/spark/pull/13510 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13510: [MINOR] [BUILD] Add modernizr MIT license; specify "2014...

2016-06-04 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13510 Merged to master/2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #13510: [MINOR] [BUILD] Add modernizr MIT license; specify "2014...

2016-06-04 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13510 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #13510: [MINOR] [BUILD] Add modernizr MIT license; specify "2014...

2016-06-04 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13510 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59990/ Test PASSed. --- If

[GitHub] spark issue #13510: [MINOR] [BUILD] Add modernizr MIT license; specify "2014...

2016-06-04 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13510 **[Test build #59990 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59990/consoleFull)** for PR 13510 at commit

[GitHub] spark pull request #13506: [SPARK-15763][SQL] Support DELETE FILE command na...

2016-06-04 Thread kevinyu98
Github user kevinyu98 commented on a diff in the pull request: https://github.com/apache/spark/pull/13506#discussion_r65805306 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -1441,6 +1441,32 @@ class SparkContext(config: SparkConf) extends Logging with

[GitHub] spark issue #13510: [MINOR] [BUILD] Add modernizr MIT license; specify "2014...

2016-06-04 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13510 **[Test build #59990 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59990/consoleFull)** for PR 13510 at commit

[GitHub] spark issue #13482: SPARK-15725: Ensure ApplicationMaster sleeps for the min...

2016-06-04 Thread rdblue
Github user rdblue commented on the issue: https://github.com/apache/spark/pull/13482 cc @vanzin @tgravescs --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #13472: [SPARK-15735] Allow specifying min time to run in...

2016-06-04 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13472#discussion_r65804521 --- Diff: core/src/main/scala/org/apache/spark/util/Benchmark.scala --- @@ -33,18 +38,37 @@ import org.apache.commons.lang3.SystemUtils * * The

[GitHub] spark pull request #13472: [SPARK-15735] Allow specifying min time to run in...

2016-06-04 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13472#discussion_r65804523 --- Diff: core/src/main/scala/org/apache/spark/util/Benchmark.scala --- @@ -33,18 +38,37 @@ import org.apache.commons.lang3.SystemUtils * * The

[GitHub] spark pull request #13505: [SPARK-15764][SQL] Replace N^2 loop in BindRefere...

2016-06-04 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13505#discussion_r65804344 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/package.scala --- @@ -86,11 +86,31 @@ package object expressions {

[GitHub] spark pull request #13505: [SPARK-15764][SQL] Replace N^2 loop in BindRefere...

2016-06-04 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13505#discussion_r65804276 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/package.scala --- @@ -86,11 +86,31 @@ package object expressions {

[GitHub] spark issue #13326: [SPARK-15560] [Mesos] Queued/Supervise drivers waiting f...

2016-06-04 Thread devaraj-kavali
Github user devaraj-kavali commented on the issue: https://github.com/apache/spark/pull/13326 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59989/ Test FAILed.

[GitHub] spark issue #13326: [SPARK-15560] [Mesos] Queued/Supervise drivers waiting f...

2016-06-04 Thread devaraj-kavali
Github user devaraj-kavali commented on the issue: https://github.com/apache/spark/pull/13326 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13326: [SPARK-15560] [Mesos] Queued/Supervise drivers waiting f...

2016-06-04 Thread devaraj-kavali
Github user devaraj-kavali commented on the issue: https://github.com/apache/spark/pull/13326 **[Test build #59989 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59989/consoleFull)** for PR 13326 at commit

[GitHub] spark issue #13483: [SPARK-15688][SQL] RelationalGroupedDataset.toDF should ...

2016-06-04 Thread dilipbiswal
Github user dilipbiswal commented on the issue: https://github.com/apache/spark/pull/13483 @viirya You know, as I said above, both ways are not perfect. My inputs are just based on my previous design experiences. All the design decisions I made are based on usage scenarios.

  1   2   >