[GitHub] spark issue #18413: [SPARK-21205][SQL] pmod(number, 0) should be null.

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18413 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18413: [SPARK-21205][SQL] pmod(number, 0) should be null.

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18413 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78587/ Test FAILed. ---

[GitHub] spark issue #18413: [SPARK-21205][SQL] pmod(number, 0) should be null.

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18413 **[Test build #78587 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78587/testReport)** for PR 18413 at commit

[GitHub] spark issue #18334: [SPARK-21127] [SQL] Update statistics after data changin...

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18334 **[Test build #78592 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78592/testReport)** for PR 18334 at commit

[GitHub] spark issue #17451: [SPARK-19866][ML][PySpark] Add local version of Word2Vec...

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17451 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17451: [SPARK-19866][ML][PySpark] Add local version of Word2Vec...

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17451 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78591/ Test PASSed. ---

[GitHub] spark issue #17451: [SPARK-19866][ML][PySpark] Add local version of Word2Vec...

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17451 **[Test build #78591 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78591/testReport)** for PR 17451 at commit

[GitHub] spark issue #17865: [SPARK-20456][Docs] Add examples for functions collectio...

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17865 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78586/ Test FAILed. ---

[GitHub] spark issue #17865: [SPARK-20456][Docs] Add examples for functions collectio...

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17865 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17865: [SPARK-20456][Docs] Add examples for functions collectio...

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17865 **[Test build #78586 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78586/testReport)** for PR 17865 at commit

[GitHub] spark issue #17451: [SPARK-19866][ML][PySpark] Add local version of Word2Vec...

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17451 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78589/ Test FAILed. ---

[GitHub] spark issue #17451: [SPARK-19866][ML][PySpark] Add local version of Word2Vec...

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17451 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17451: [SPARK-19866][ML][PySpark] Add local version of Word2Vec...

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17451 **[Test build #78589 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78589/testReport)** for PR 17451 at commit

[GitHub] spark issue #18400: [SPARK-21188][CORE] releaseAllLocksForTask should synchr...

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18400 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78585/ Test FAILed. ---

[GitHub] spark issue #18400: [SPARK-21188][CORE] releaseAllLocksForTask should synchr...

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18400 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18400: [SPARK-21188][CORE] releaseAllLocksForTask should synchr...

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18400 **[Test build #78585 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78585/testReport)** for PR 18400 at commit

[GitHub] spark issue #17451: [SPARK-19866][ML][PySpark] Add local version of Word2Vec...

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17451 **[Test build #78591 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78591/testReport)** for PR 17451 at commit

[GitHub] spark issue #18405: [SPARK-21194][SQL] Fail the putNullmethod when containsN...

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18405 **[Test build #78590 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78590/testReport)** for PR 18405 at commit

[GitHub] spark issue #13506: [SPARK-15763][SQL] Support DELETE FILE command natively

2017-06-25 Thread kevinyu98
Github user kevinyu98 commented on the issue: https://github.com/apache/spark/pull/13506 sure --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #17451: [SPARK-19866][ML][PySpark] Add local version of Word2Vec...

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17451 **[Test build #78589 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78589/testReport)** for PR 17451 at commit

[GitHub] spark issue #9518: [SPARK-11574][Core] Add metrics StatsD sink

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9518 **[Test build #78588 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78588/testReport)** for PR 9518 at commit

[GitHub] spark issue #18413: [SPARK-21205][SQL] pmod(number, 0) should be null.

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18413 **[Test build #78587 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78587/testReport)** for PR 18413 at commit

[GitHub] spark issue #17865: [SPARK-20456][Docs] Add examples for functions collectio...

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17865 **[Test build #78586 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78586/testReport)** for PR 17865 at commit

[GitHub] spark pull request #17865: [SPARK-20456][Docs] Add examples for functions co...

2017-06-25 Thread map222
Github user map222 commented on a diff in the pull request: https://github.com/apache/spark/pull/17865#discussion_r123912061 --- Diff: python/pyspark/sql/functions.py --- @@ -969,8 +1005,8 @@ def months_between(date1, date2): """ Returns the number of months

[GitHub] spark issue #17865: [SPARK-20456][Docs] Add examples for functions collectio...

2017-06-25 Thread map222
Github user map222 commented on the issue: https://github.com/apache/spark/pull/17865 @HyukjinKwon I think I addressed all of your comments. Thank you for your detailed review! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #18320: [SPARK-21093][R] Terminate R's worker processes in the p...

2017-06-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18320 I think I am used to the symtoms here as I have tested many cases here. Let me try to organise and send a post to dev mailing list. --- If your project is set up for it, you can reply to this

[GitHub] spark issue #18400: [SPARK-21188][CORE] releaseAllLocksForTask should synchr...

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18400 **[Test build #78585 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78585/testReport)** for PR 18400 at commit

[GitHub] spark issue #18400: [SPARK-21188][CORE] releaseAllLocksForTask should synchr...

2017-06-25 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/18400 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18413: [SPARK-21205][SQL] pmod(number, 0) should be null.

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18413 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78584/ Test FAILed. ---

[GitHub] spark issue #18413: [SPARK-21205][SQL] pmod(number, 0) should be null.

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18413 **[Test build #78584 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78584/testReport)** for PR 18413 at commit

[GitHub] spark issue #18413: [SPARK-21205][SQL] pmod(number, 0) should be null.

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18413 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18413: [SPARK-21205][SQL] pmod(number, 0) should be null.

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18413 **[Test build #78584 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78584/testReport)** for PR 18413 at commit

[GitHub] spark issue #17435: [SPARK-20098][PYSPARK] dataType's typeName fix

2017-06-25 Thread szalai1
Github user szalai1 commented on the issue: https://github.com/apache/spark/pull/17435 @holdenk Thanks for reviewing it. I fixed the style issues. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #18411: [SPARK-18004][SQL] Make sure the date or timestamp relat...

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18411 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78583/ Test PASSed. ---

[GitHub] spark issue #18411: [SPARK-18004][SQL] Make sure the date or timestamp relat...

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18411 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18411: [SPARK-18004][SQL] Make sure the date or timestamp relat...

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18411 **[Test build #78583 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78583/testReport)** for PR 18411 at commit

[GitHub] spark pull request #18320: [SPARK-21093][R] Terminate R's worker processes i...

2017-06-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18320 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18320: [SPARK-21093][R] Terminate R's worker processes in the p...

2017-06-25 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18320 merged to master, thanks!! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18366: [SPARK-20889][SparkR] Grouped documentation for STRING c...

2017-06-25 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18366 hmm, comment not showing up: https://github.com/apache/spark/pull/18366/files#r123891161 --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #18411: [SPARK-18004][SQL] Make sure the date or timestamp relat...

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18411 **[Test build #78583 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78583/testReport)** for PR 18411 at commit

[GitHub] spark issue #18411: [SPARK-18004][SQL] Make sure the date or timestamp relat...

2017-06-25 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18411 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18414: Update status of application to RUNNING if executors are...

2017-06-25 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18414 please fix up the PR title: http://spark.apache.org/contributing.html --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15821: [SPARK-13534][PySpark] Using Apache Arrow to increase pe...

2017-06-25 Thread wesm
Github user wesm commented on the issue: https://github.com/apache/spark/pull/15821 Is your conda up to date? It's a best practice to always update to the latest conda --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #18320: [SPARK-21093][R] Terminate R's worker processes in the p...

2017-06-25 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/18320 LGTM. The update looks good. Thanks for the thorough testing. We could also post a note on the dev list about this change and especially ask people who use `dapply` or `gapply` or the old `RDD`

[GitHub] spark issue #15821: [SPARK-13534][PySpark] Using Apache Arrow to increase pe...

2017-06-25 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15821 it's because of this ``` .SSL verification error: hostname 'conda.binstar.org' doesn't match either of 'anaconda.com', 'anacondacloud.com', 'anacondacloud.org', 'binstar.org',

[GitHub] spark issue #18270: [SPARK-21055][SQL] replace grouping__id with grouping_id...

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18270 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78582/ Test FAILed. ---

[GitHub] spark issue #18270: [SPARK-21055][SQL] replace grouping__id with grouping_id...

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18270 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18270: [SPARK-21055][SQL] replace grouping__id with grouping_id...

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18270 **[Test build #78582 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78582/testReport)** for PR 18270 at commit

[GitHub] spark issue #18416: [SPARK-21204][SQL][WIP] Add support for Scala Set collec...

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18416 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78581/ Test PASSed. ---

[GitHub] spark issue #18416: [SPARK-21204][SQL][WIP] Add support for Scala Set collec...

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18416 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18416: [SPARK-21204][SQL][WIP] Add support for Scala Set collec...

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18416 **[Test build #78581 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78581/testReport)** for PR 18416 at commit

[GitHub] spark pull request #18193: [SPARK-15616] [SQL] CatalogRelation should fallba...

2017-06-25 Thread cenyuhai
Github user cenyuhai commented on a diff in the pull request: https://github.com/apache/spark/pull/18193#discussion_r123903846 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala --- @@ -139,6 +138,54 @@ class DetermineTableStats(session: SparkSession)

[GitHub] spark issue #17864: [SPARK-20604][ML] Allow imputer to handle numeric types

2017-06-25 Thread hhbyyh
Github user hhbyyh commented on the issue: https://github.com/apache/spark/pull/17864 Shall we pay extra attention to the Int case? E.g. input column contains Double.Nan, 1, 2. The current implementation will return surrogate as 1.5. I'm not sure if it's the

[GitHub] spark issue #18270: [SPARK-21055][SQL] replace grouping__id with grouping_id...

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18270 **[Test build #78582 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78582/testReport)** for PR 18270 at commit

[GitHub] spark issue #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-06-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18023 Could you please add another case when no column is matched into `query_regex_column.sql`? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request #18405: [SPARK-21194][SQL] Fail the putNullmethod when co...

2017-06-25 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/18405#discussion_r123901486 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/OffHeapColumnVector.java --- @@ -85,6 +85,9 @@ public void putNotNull(int rowId)

[GitHub] spark pull request #18405: [SPARK-21194][SQL] Fail the putNullmethod when co...

2017-06-25 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/18405#discussion_r123901481 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/OnHeapColumnVector.java --- @@ -81,6 +81,9 @@ public void putNotNull(int rowId) {

[GitHub] spark pull request #18405: [SPARK-21194][SQL] Fail the putNullmethod when co...

2017-06-25 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/18405#discussion_r123901460 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/ColumnVector.java --- @@ -993,22 +1006,25 @@ public ColumnVector

[GitHub] spark issue #15821: [SPARK-13534][PySpark] Using Apache Arrow to increase pe...

2017-06-25 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15821 Seems it already asks to search in the conda-forge channel? https://github.com/apache/spark/blob/e44697606f429b01808c1a22cb44cb5b89585c5c/dev/run-pip-tests#L86 --- If your project is set

[GitHub] spark pull request #18405: [SPARK-21194][SQL] Fail the putNullmethod when co...

2017-06-25 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/18405#discussion_r123901471 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/OnHeapColumnVector.java --- @@ -51,8 +51,8 @@ private int[] arrayLengths;

[GitHub] spark pull request #18405: [SPARK-21194][SQL] Fail the putNullmethod when co...

2017-06-25 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/18405#discussion_r123901467 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/OffHeapColumnVector.java --- @@ -40,8 +40,8 @@ private long lengthData;

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-06-25 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18023#discussion_r123901447 --- Diff: sql/core/src/test/resources/sql-tests/results/query_regex_column.sql.out --- @@ -0,0 +1,113 @@ +-- Automatically generated by

[GitHub] spark pull request #18405: [SPARK-21194][SQL] Fail the putNullmethod when co...

2017-06-25 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/18405#discussion_r123901448 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/ColumnVector.java --- @@ -62,10 +62,18 @@ * in number of elements, not

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-06-25 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18023#discussion_r123901251 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -795,6 +795,11 @@ object SQLConf { .intConf

[GitHub] spark issue #18410: [SPARK-20971][SS] purge metadata log in FileStreamSource

2017-06-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18410 (I believe the discussion here might be helpful for pip packaging failure - `https://github.com/apache/spark/pull/15821#issuecomment-310894657`) --- If your project is set up for it, you can

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-06-25 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18023#discussion_r123901234 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -1191,6 +1191,12 @@ class Dataset[T] private[sql]( def col(colName:

[GitHub] spark issue #15821: [SPARK-13534][PySpark] Using Apache Arrow to increase pe...

2017-06-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15821 I believe the pointer is the right place up to my knowledge, via ... https://github.com/apache/spark/blob/e44697606f429b01808c1a22cb44cb5b89585c5c/dev/run-tests#L23 ->

[GitHub] spark issue #18417: [INFRA] Close stale PRs

2017-06-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18417 I added all suggested one and took out 15405 and 17401 per requested. I guess the author should be responsive and I took out 17716 before. I think it is unfair to take out this again. --- If

[GitHub] spark issue #18417: [INFRA] Close stale PRs

2017-06-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18417 I added all suggested one and took out 15405 and 17716 per requested. I guess the author should be responsive and I took out 17716 before. I think it is unfair to take out this again. --- If

[GitHub] spark issue #18416: [SPARK-21204][SQL][WIP] Add support for Scala Set collec...

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18416 **[Test build #78581 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78581/testReport)** for PR 18416 at commit

[GitHub] spark issue #18416: [SPARK-21204][SQL][WIP] Add support for Scala Set collec...

2017-06-25 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/18416 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #15821: [SPARK-13534][PySpark] Using Apache Arrow to increase pe...

2017-06-25 Thread wesm
Github user wesm commented on the issue: https://github.com/apache/spark/pull/15821 I only see the package referenced here https://github.com/apache/spark/blob/e44697606f429b01808c1a22cb44cb5b89585c5c/dev/run-pip-tests#L86 -- where is the packaging build that @srowen is referencing

[GitHub] spark issue #18417: [INFRA] Close stale PRs

2017-06-25 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/18417 Let's keep the following PRs open, because I believe they're good to have and the authors will soon be responding: #15405 #17401 #17716 Also, I'd suggest we add the

[GitHub] spark issue #17716: [SPARK-19952][SQL] Remove various analysis exceptions

2017-06-25 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/17716 ping @hvanhovell Are you still working on this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #15821: [SPARK-13534][PySpark] Using Apache Arrow to increase pe...

2017-06-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15821 Would you mind opening a PR for this? I guess updating it would probably be done by a followup but this one sounds rather a semi-hotfix. If both timeout and adding chennel are all we need, I

[GitHub] spark issue #15405: [SPARK-15917][CORE] Added support for number of executor...

2017-06-25 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/15405 ping @JonathanTaws Please let me know once this PR is ready for review, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #18417: [INFRA] Close stale PRs

2017-06-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18417 Suggest adding: https://github.com/apache/spark/pull/14739 https://github.com/apache/spark/pull/17139 https://github.com/apache/spark/pull/17445

[GitHub] spark issue #15821: [SPARK-13534][PySpark] Using Apache Arrow to increase pe...

2017-06-25 Thread wesm
Github user wesm commented on the issue: https://github.com/apache/spark/pull/15821 You must add the conda-forge channel; I also recommend increasing the timeout for conda which helps make builds more stable, see:

[GitHub] spark pull request #18415: [HOT FIX] fix stats functions in the recent patch

2017-06-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18415 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18415: [HOT FIX] fix stats functions in the recent patch

2017-06-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18415 merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #18415: [HOT FIX] fix stats functions in the recent patch

2017-06-25 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/18415 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pyspark

2017-06-25 Thread JinsYin
Github user JinsYin commented on the issue: https://github.com/apache/spark/pull/13599 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #18415: [HOT FIX] fix stats functions in the recent patch

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18415 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78577/ Test PASSed. ---

[GitHub] spark issue #18415: [HOT FIX] fix stats functions in the recent patch

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18415 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18415: [HOT FIX] fix stats functions in the recent patch

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18415 **[Test build #78577 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78577/testReport)** for PR 18415 at commit

[GitHub] spark issue #18417: [INFRA] Close stale PRs

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18417 **[Test build #78580 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78580/testReport)** for PR 18417 at commit

[GitHub] spark issue #18417: [INFRA] Close stale PRs

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18417 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78580/ Test FAILed. ---

[GitHub] spark issue #18417: [INFRA] Close stale PRs

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18417 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18417: [INFRA] Close stale PRs

2017-06-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18417 cc @srowen, @vanzin, @gatorsmile and @jiangxb1987 who I believe are interested in this PR. Could you take a look please? --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #18417: [INFRA] Close stale PRs

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18417 **[Test build #78580 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78580/testReport)** for PR 18417 at commit

[GitHub] spark issue #18417: [INFRA] Close stale PRs

2017-06-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18417 Please let me know if any author is active on any PR. Let me take them out. I picked up inclusively. My point here is to close inactive PRs and leave PRs that wait for a review. Leave any

[GitHub] spark issue #18417: [INFRA] Close stale PRs

2017-06-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18417 Please let me know if any author is active on any PR. Let me take them out. I picked up inclusively. My point here is to close inactive PRs and leave PRs that wait for a review. Leave any

[GitHub] spark issue #18417: [INFRA] Close stale PRs

2017-06-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18417 Please let me know if any author is active on any PR. Let me take them out. I picked up inclusively. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request #18417: [INFRA] Close stale PRs

2017-06-25 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/18417 [INFRA] Close stale PRs ## What changes were proposed in this pull request? This PR proposes to close stale PRs, mostly the same instances with

[GitHub] spark issue #18253: [SPARK-18838][CORE] Introduce multiple queues in LiveLis...

2017-06-25 Thread bOOm-X
Github user bOOm-X commented on the issue: https://github.com/apache/spark/pull/18253 please test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #18416: [SPARK-21204][SQL][WIP] Add support for Scala Set collec...

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18416 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18268: [SPARK-21054] [SQL] Reset Command support reset specific...

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18268 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78579/ Test FAILed. ---

[GitHub] spark issue #18268: [SPARK-21054] [SQL] Reset Command support reset specific...

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18268 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18416: [SPARK-21204][SQL][WIP] Add support for Scala Set collec...

2017-06-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18416 **[Test build #78578 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78578/testReport)** for PR 18416 at commit

[GitHub] spark issue #18416: [SPARK-21204][SQL][WIP] Add support for Scala Set collec...

2017-06-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18416 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78578/ Test FAILed. ---

<    1   2   3   >