[GitHub] spark pull request #14427: [SPARK-16818] Exchange reuse incorrectly reuses s...

2016-07-30 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/14427#discussion_r72898521 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategySuite.scala --- @@ -407,6 +407,39 @@ class

[GitHub] spark issue #14427: [SPARK-16818] Exchange reuse incorrectly reuses scans ov...

2016-07-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14427 **[Test build #63053 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63053/consoleFull)** for PR 14427 at commit

[GitHub] spark issue #14427: [SPARK-16818] Exchange reuse incorrectly reuses scans ov...

2016-07-30 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14427 LGTM pending Jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #14425: [SPARK-16818] Exchange reuse incorrectly reuses scans ov...

2016-07-30 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/14425 Done, see https://github.com/apache/spark/pull/14427 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #14427: [SPARK-16818] Exchange reuse incorrectly reuses s...

2016-07-30 Thread ericl
GitHub user ericl opened a pull request: https://github.com/apache/spark/pull/14427 [SPARK-16818] Exchange reuse incorrectly reuses scans over different sets of partitions https://github.com/apache/spark/pull/14425 rebased for branch-2.0 You can merge this pull request into a Git

[GitHub] spark pull request #14425: [SPARK-16818] Exchange reuse incorrectly reuses s...

2016-07-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14425 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14425: [SPARK-16818] Exchange reuse incorrectly reuses scans ov...

2016-07-30 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14425 @ericl there is a conflict with branch-2.0. Can you create a pull request for branch-2.0? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #14425: [SPARK-16818] Exchange reuse incorrectly reuses scans ov...

2016-07-30 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14425 Merging in master/2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-30 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14426 Why creating a new pull request? All the discussions were in the other pull request. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #14400: [Spark-16791] [SQL] cast struct with timestamp field fai...

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14400 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63052/ Test PASSed. ---

[GitHub] spark issue #14400: [Spark-16791] [SQL] cast struct with timestamp field fai...

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14400 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14400: [Spark-16791] [SQL] cast struct with timestamp field fai...

2016-07-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14400 **[Test build #63052 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63052/consoleFull)** for PR 14400 at commit

[GitHub] spark issue #9860: SPARK-5106 - Add refresh checkbox on the UI

2016-07-30 Thread sylvinus
Github user sylvinus commented on the issue: https://github.com/apache/spark/pull/9860 Might I suggest we have another look at this, to save users from breaking their cmd-R keys? :-) This JS snippet (which you can paste in the Chrome console to test) solves 2 of the issues

[GitHub] spark issue #14419: [SPARK-16814][SQL][WIP] Fix deprecated parquet construct...

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14419 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63051/ Test PASSed. ---

[GitHub] spark issue #14419: [SPARK-16814][SQL][WIP] Fix deprecated parquet construct...

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14419 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14419: [SPARK-16814][SQL][WIP] Fix deprecated parquet construct...

2016-07-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14419 **[Test build #63051 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63051/consoleFull)** for PR 14419 at commit

[GitHub] spark issue #14402: Update JavaSparkContextVarargsWorkaround.java

2016-07-30 Thread sakky11
Github user sakky11 commented on the issue: https://github.com/apache/spark/pull/14402 I know its trivial but it still avoids duplication of code and make it more readable. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #14400: [Spark-16791] [SQL] cast struct with timestamp field fai...

2016-07-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14400 **[Test build #63052 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63052/consoleFull)** for PR 14400 at commit

[GitHub] spark pull request #14400: [Spark-16791] [SQL] cast struct with timestamp fi...

2016-07-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14400#discussion_r72897142 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CastSuite.scala --- @@ -727,6 +727,16 @@ class CastSuite extends

[GitHub] spark issue #14400: [Spark-16791] [SQL] cast struct with timestamp field fai...

2016-07-30 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14400 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #11209: [SPARK-13325][SQL] Create a 64-bit hashcode expre...

2016-07-30 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/11209#discussion_r72897064 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/HashBenchmark.scala --- @@ -119,11 +146,12 @@ object HashBenchmark { .add("map",

[GitHub] spark issue #14398: [SPARK-16774][SQL][WIP] Fix use of deprecated timestamp ...

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14398 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63050/ Test PASSed. ---

[GitHub] spark issue #14398: [SPARK-16774][SQL][WIP] Fix use of deprecated timestamp ...

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14398 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14422: Add rand(numRows: Int, numCols: Int) functions

2016-07-30 Thread xubo245
Github user xubo245 commented on the issue: https://github.com/apache/spark/pull/14422 @HyukjinKwon Thank you. This is my first time to push request to spark, Sorrry, I will follow the https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark later. --- If your

[GitHub] spark issue #14419: [SPARK-16814][SQL][WIP] Fix deprecated parquet construct...

2016-07-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14419 **[Test build #63051 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63051/consoleFull)** for PR 14419 at commit

[GitHub] spark issue #14406: [SPARK-16778][SQL][TRIVIAL] Fix deprecation warning with...

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14406 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63049/ Test PASSed. ---

[GitHub] spark issue #14406: [SPARK-16778][SQL][TRIVIAL] Fix deprecation warning with...

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14406 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #11209: [SPARK-13325][SQL] Create a 64-bit hashcode expre...

2016-07-30 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/11209#discussion_r72896977 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/HashBenchmark.scala --- @@ -119,11 +146,12 @@ object HashBenchmark { .add("map",

[GitHub] spark issue #14406: [SPARK-16778][SQL][TRIVIAL] Fix deprecation warning with...

2016-07-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14406 **[Test build #63049 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63049/consoleFull)** for PR 14406 at commit

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-07-30 Thread deanchen
Github user deanchen commented on the issue: https://github.com/apache/spark/pull/14279 Would be great to get this in too. Currently using a hack where we iterate through all the date columns at the end of our run and manually converting the values to the string values formatted as

[GitHub] spark issue #14118: [SPARK-16462][SPARK-16460][SPARK-15144][SQL] Make CSV ca...

2016-07-30 Thread deanchen
Github user deanchen commented on the issue: https://github.com/apache/spark/pull/14118 Would be great to get a resolution to this. We're running into issues in production attempting to parse csv's with nullable dates. Personally prefer option b for our use case. --- If your

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14426 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14426 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63048/ Test PASSed. ---

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14426 **[Test build #63048 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63048/consoleFull)** for PR 14426 at commit

[GitHub] spark issue #14398: [SPARK-16774][SQL][WIP] Fix use of deprecated timestamp ...

2016-07-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14398 **[Test build #63050 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63050/consoleFull)** for PR 14398 at commit

[GitHub] spark pull request #14419: [SPARK-16814][SQL][WIP] Fix deprecated parquet co...

2016-07-30 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/14419#discussion_r72896264 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetCompatibilityTest.scala --- @@ -119,8 +119,19 @@ private[sql]

[GitHub] spark issue #14406: [SPARK-16778][SQL][TRIVIAL] Fix deprecation warning with...

2016-07-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14406 **[Test build #63049 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63049/consoleFull)** for PR 14406 at commit

[GitHub] spark issue #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14426 **[Test build #63048 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63048/consoleFull)** for PR 14426 at commit

[GitHub] spark pull request #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-30 Thread dongjoon-hyun
Github user dongjoon-hyun closed the pull request at: https://github.com/apache/spark/pull/14132 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-30 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14132 This PR grows too much. Sometime, scrolling is lack. I close this and open a new one https://github.com/apache/spark/pull/14426 . --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #14426: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-30 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/14426 [SPARK-16475][SQL] Broadcast Hint for SQL Queries ## What changes were proposed in this pull request? This PR aims to achieve the following two goals in Spark SQL. **1. Generic

[GitHub] spark issue #14425: [SPARK-16818] Exchange reuse incorrectly reuses scans ov...

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14425 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63047/ Test PASSed. ---

[GitHub] spark issue #14425: [SPARK-16818] Exchange reuse incorrectly reuses scans ov...

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14425 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14425: [SPARK-16818] Exchange reuse incorrectly reuses scans ov...

2016-07-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14425 **[Test build #63047 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63047/consoleFull)** for PR 14425 at commit

[GitHub] spark pull request #14425: [SPARK-16818] Exchange reuse incorrectly reuses s...

2016-07-30 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/14425#discussion_r72895545 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategy.scala --- @@ -130,7 +130,9 @@ private[sql] object

[GitHub] spark issue #14425: [SPARK-16818] Exchange reuse incorrectly reuses scans ov...

2016-07-30 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/14425 Yep, both fail prior to the fix. On Sat, Jul 30, 2016, 3:32 PM Reynold Xin wrote: > LGTM (assuming the test case would fail without the fix) > > —

[GitHub] spark pull request #14425: [SPARK-16818] Exchange reuse incorrectly reuses s...

2016-07-30 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/14425#discussion_r72895137 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategy.scala --- @@ -130,7 +130,9 @@ private[sql] object

[GitHub] spark issue #14425: [SPARK-16818] Exchange reuse incorrectly reuses scans ov...

2016-07-30 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14425 LGTM (assuming the test case would fail without the fix) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #14425: [SPARK-16818] Exchange reuse incorrectly reuses s...

2016-07-30 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/14425#discussion_r72895124 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategySuite.scala --- @@ -408,6 +408,39 @@ class

[GitHub] spark issue #14425: [SPARK-16818] Exchange reuse incorrectly reuses scans ov...

2016-07-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14425 **[Test build #63047 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63047/consoleFull)** for PR 14425 at commit

[GitHub] spark pull request #14425: [SPARK-16818] Exchange reuse incorrectly reuses s...

2016-07-30 Thread ericl
GitHub user ericl opened a pull request: https://github.com/apache/spark/pull/14425 [SPARK-16818] Exchange reuse incorrectly reuses scans over different sets of partitions ## What changes were proposed in this pull request? This fixes a bug wherethe file scan operator does

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] [WIP] Proactive block replic...

2016-07-30 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r72894823 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerId.scala --- @@ -37,10 +37,11 @@ import org.apache.spark.util.Utils class

[GitHub] spark issue #14415: [SPARK-16810] Refactor registerSinks with multiple const...

2016-07-30 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14415 DId you add a test? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #14419: [SPARK-16814][SQL][WIP] Fix deprecated parquet co...

2016-07-30 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/14419#discussion_r72894773 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetCompatibilityTest.scala --- @@ -119,8 +119,19 @@ private[sql]

[GitHub] spark issue #14421: [SPARK-16816] Add api to get JavaSparkContext from Spark...

2016-07-30 Thread petermaxlee
Github user petermaxlee commented on the issue: https://github.com/apache/spark/pull/14421 Isn't this just ``` new JavaSparkContext(session.sparkContext) ``` ? Perhaps we should just update the documentation to say that. --- If your project is set up

[GitHub] spark issue #14422: Add rand(numRows: Int, numCols: Int) functions

2016-07-30 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14422 I guess it might be ncer if the contributions you make follow https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark.just like other contributions. --- If your project is set

[GitHub] spark issue #14419: [SPARK-16814][SQL][WIP] Fix deprecated parquet construct...

2016-07-30 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14419 No, I don't :). I just meant I wanted to say that this fix is reasonable and the reason I didn't submit a PR has not been because there is potential incompatability. It was because just I was

[GitHub] spark issue #14417: [SPARK-16812] Open up SparkILoop.getAddedJars

2016-07-30 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/14417 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #14402: Update JavaSparkContextVarargsWorkaround.java

2016-07-30 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/14402 This patch is only a one-line reduction of code and touches a file which hasn't needed to be modified in ages; is this change really necessary / worth spending review time on? --- If your

[GitHub] spark issue #14402: Update JavaSparkContextVarargsWorkaround.java

2016-07-30 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14402 Did you compile this locally before pushing? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #14406: [SPARK-16778][SQL][TRIVIAL] Fix deprecation warni...

2016-07-30 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/14406#discussion_r72892893 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/internal/SQLConfSuite.scala --- @@ -28,7 +28,7 @@ class SQLConfSuite extends QueryTest with

[GitHub] spark issue #14419: [SPARK-16814][SQL][WIP] Fix deprecated parquet construct...

2016-07-30 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/14419 @HyukjinKwon do you have a PR for this? If so I can go ahead and close this one (and lets maybe sync some on the deprecation stuff we are both cleaning up :)) --- If your project is set up for

[GitHub] spark issue #14419: [SPARK-16814][SQL][WIP] Fix deprecated parquet construct...

2016-07-30 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/14419 So yes as @HyukjinKwon says its just in the tests. I figured this would be ok across the hadoop versions we target because I looked at the build deps files and they all listed

[GitHub] spark issue #14424: Add test:DenseMatrix.rand with no rng

2016-07-30 Thread xubo245
Github user xubo245 commented on the issue: https://github.com/apache/spark/pull/14424 It add for https://github.com/apache/spark/pull/14422 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #14424: Add test:DenseMatrix.rand with no rng

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14424 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14422: Add rand(numRows: Int, numCols: Int) functions

2016-07-30 Thread xubo245
Github user xubo245 commented on the issue: https://github.com/apache/spark/pull/14422 I add test : https://github.com/apache/spark/pull/14424 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #14424: Add test:DenseMatrix.rand with no rng

2016-07-30 Thread xubo245
GitHub user xubo245 opened a pull request: https://github.com/apache/spark/pull/14424 Add test:DenseMatrix.rand with no rng ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested?

[GitHub] spark issue #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch cache i...

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13713 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch cache i...

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13713 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63046/ Test PASSed. ---

[GitHub] spark issue #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch cache i...

2016-07-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13713 **[Test build #63046 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63046/consoleFull)** for PR 13713 at commit

[GitHub] spark issue #14402: Update JavaSparkContextVarargsWorkaround.java

2016-07-30 Thread sakky11
Github user sakky11 commented on the issue: https://github.com/apache/spark/pull/14402 I think the issue should be fixed now.Sorry for trouble. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #14363: [SPARK-16731][SQL] use StructType in CatalogTable and re...

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14363 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14363: [SPARK-16731][SQL] use StructType in CatalogTable and re...

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14363 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63045/ Test PASSed. ---

[GitHub] spark issue #14363: [SPARK-16731][SQL] use StructType in CatalogTable and re...

2016-07-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14363 **[Test build #63045 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63045/consoleFull)** for PR 14363 at commit

[GitHub] spark issue #14422: Add rand(numRows: Int, numCols: Int) functions

2016-07-30 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14422 Doesn't that need a JIRA, test and PR descriptio maybe? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #14380: [SPARK-16485][DOC][ML] Remove useless latex in scaladoc ...

2016-07-30 Thread lins05
Github user lins05 commented on the issue: https://github.com/apache/spark/pull/14380 @srowen I have looked about those files, but for complex equations, (e.g. [this

[GitHub] spark pull request #14422: Add rand(numRows: Int, numCols: Int) functions

2016-07-30 Thread xubo245
Github user xubo245 commented on a diff in the pull request: https://github.com/apache/spark/pull/14422#discussion_r72890434 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Matrices.scala --- @@ -497,6 +497,20 @@ object DenseMatrix { } /** +

[GitHub] spark issue #14423: Add zeros(size: Int) function

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14423 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #14423: Add zeros(size: Int) function

2016-07-30 Thread xubo245
GitHub user xubo245 opened a pull request: https://github.com/apache/spark/pull/14423 Add zeros(size: Int) function ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested? (Please

[GitHub] spark issue #14402: Update JavaSparkContextVarargsWorkaround.java

2016-07-30 Thread sakky11
Github user sakky11 commented on the issue: https://github.com/apache/spark/pull/14402 Hey sorry @srowen ,Actually I have fixed the compilation error but missed it in adding in a pull request.Sorry. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #14402: Update JavaSparkContextVarargsWorkaround.java

2016-07-30 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14402 @sakky11 you have not even addressed the compilation error. This is wasting everyone's time. Please _compile_ this locally and fix it before pinging again. --- If your project is set up for it, you

[GitHub] spark issue #14416: [SPARK-16776][STREAMING] Replace deprecated API in Kafka...

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14416 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63044/ Test PASSed. ---

[GitHub] spark issue #14416: [SPARK-16776][STREAMING] Replace deprecated API in Kafka...

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14416 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14416: [SPARK-16776][STREAMING] Replace deprecated API in Kafka...

2016-07-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14416 **[Test build #63044 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63044/consoleFull)** for PR 14416 at commit

[GitHub] spark issue #14419: [SPARK-16814][SQL][WIP] Fix deprecated parquet construct...

2016-07-30 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14419 Could cc @liancheng who has more insight about thie please? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #14402: Update JavaSparkContextVarargsWorkaround.java

2016-07-30 Thread sakky11
Github user sakky11 commented on the issue: https://github.com/apache/spark/pull/14402 Added the required fix.Can you please start the build ?? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #14422: Add rand(numRows: Int, numCols: Int) functions

2016-07-30 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14422#discussion_r72889871 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Matrices.scala --- @@ -497,6 +497,20 @@ object DenseMatrix { } /** +

[GitHub] spark issue #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch cache i...

2016-07-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13713 **[Test build #63046 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63046/consoleFull)** for PR 13713 at commit

[GitHub] spark issue #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch cache i...

2016-07-30 Thread drcrallen
Github user drcrallen commented on the issue: https://github.com/apache/spark/pull/13713 @tnachen this test is a little larger than I originally anticipated. Let me see if I can add some unit tests --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch cache i...

2016-07-30 Thread drcrallen
Github user drcrallen commented on the issue: https://github.com/apache/spark/pull/13713 OoooOOO master updated to 1.0.0 Fixed merge conflicts --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #14231: [SPARK-16586] Change the way the exit code of launcher i...

2016-07-30 Thread zasdfgbnm
Github user zasdfgbnm commented on the issue: https://github.com/apache/spark/pull/14231 Yes this patch looks clearer --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14422: Add rand(numRows: Int, numCols: Int) functions

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14422 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14422: Add rand(numRows: Int, numCols: Int) functions

2016-07-30 Thread xubo245
Github user xubo245 commented on the issue: https://github.com/apache/spark/pull/14422 we can use it to replacebreeze.linalg.DenseMatrix.rand(numRows: Int, numCols: Int) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request #14422: Add rand(numRows: Int, numCols: Int) functions

2016-07-30 Thread xubo245
GitHub user xubo245 opened a pull request: https://github.com/apache/spark/pull/14422 Add rand(numRows: Int, numCols: Int) functions ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested?

[GitHub] spark issue #14363: [SPARK-16731][SQL] use StructType in CatalogTable and re...

2016-07-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14363 **[Test build #63045 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63045/consoleFull)** for PR 14363 at commit

[GitHub] spark issue #14420: [SPARK-14204] [SQL] register driverClass rather than use...

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14420 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63043/ Test PASSed. ---

[GitHub] spark issue #14420: [SPARK-14204] [SQL] register driverClass rather than use...

2016-07-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14420 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #14400: [Spark-16791] [SQL] cast struct with timestamp fi...

2016-07-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14400#discussion_r72889243 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CastSuite.scala --- @@ -727,6 +727,16 @@ class CastSuite extends

[GitHub] spark issue #14420: [SPARK-14204] [SQL] register driverClass rather than use...

2016-07-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14420 **[Test build #63043 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63043/consoleFull)** for PR 14420 at commit

[GitHub] spark pull request #14405: [SPARK-16800][EXAMPLES][ML] Fix Java examples tha...

2016-07-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14405 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

  1   2   >