[jira] [Assigned] (SPARK-16813) Remove private[sql] and private[spark] from catalyst package

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16813: Assignee: Reynold Xin (was: Apache Spark) > Remove private[sql] and private[spark] from

[jira] [Commented] (SPARK-16813) Remove private[sql] and private[spark] from catalyst package

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400468#comment-15400468 ] Apache Spark commented on SPARK-16813: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16813) Remove private[sql] and private[spark] from catalyst package

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16813: Assignee: Apache Spark (was: Reynold Xin) > Remove private[sql] and private[spark] from

[jira] [Created] (SPARK-16813) Remove private[sql] and private[spark] from catalyst package

2016-07-29 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-16813: --- Summary: Remove private[sql] and private[spark] from catalyst package Key: SPARK-16813 URL: https://issues.apache.org/jira/browse/SPARK-16813 Project: Spark

[jira] [Assigned] (SPARK-16812) Open up SparkILoop.getAddedJars

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16812: Assignee: Reynold Xin (was: Apache Spark) > Open up SparkILoop.getAddedJars >

[jira] [Assigned] (SPARK-16812) Open up SparkILoop.getAddedJars

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16812: Assignee: Apache Spark (was: Reynold Xin) > Open up SparkILoop.getAddedJars >

[jira] [Commented] (SPARK-16812) Open up SparkILoop.getAddedJars

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400442#comment-15400442 ] Apache Spark commented on SPARK-16812: -- User 'rxin' has created a pull request for this issue:

[jira] [Created] (SPARK-16812) Open up SparkILoop.getAddedJars

2016-07-29 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-16812: --- Summary: Open up SparkILoop.getAddedJars Key: SPARK-16812 URL: https://issues.apache.org/jira/browse/SPARK-16812 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-16776) Fix Kafka deprecation warnings

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16776: Assignee: Apache Spark > Fix Kafka deprecation warnings > --

[jira] [Assigned] (SPARK-16776) Fix Kafka deprecation warnings

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16776: Assignee: (was: Apache Spark) > Fix Kafka deprecation warnings >

[jira] [Commented] (SPARK-16776) Fix Kafka deprecation warnings

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400439#comment-15400439 ] Apache Spark commented on SPARK-16776: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Updated] (SPARK-16732) Remove unused codes in subexpressionEliminationForWholeStageCodegen

2016-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16732: Assignee: yucai > Remove unused codes in subexpressionEliminationForWholeStageCodegen >

[jira] [Resolved] (SPARK-16732) Remove unused codes in subexpressionEliminationForWholeStageCodegen

2016-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16732. - Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > Remove unused codes in

[jira] [Commented] (SPARK-16776) Fix Kafka deprecation warnings

2016-07-29 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400433#comment-15400433 ] Hyukjin Kwon commented on SPARK-16776: -- Oh, I meant to just leave the warnings but let me do this

[jira] [Resolved] (SPARK-16748) Errors thrown by UDFs cause TreeNodeException when the query has an ORDER BY clause

2016-07-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-16748. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull request

[jira] [Created] (SPARK-16811) spark streaming-Exception in thread “submit-job-thread-pool-40”

2016-07-29 Thread BinXu (JIRA)
BinXu created SPARK-16811: - Summary: spark streaming-Exception in thread “submit-job-thread-pool-40” Key: SPARK-16811 URL: https://issues.apache.org/jira/browse/SPARK-16811 Project: Spark Issue

[jira] [Resolved] (SPARK-16797) Repartiton call w/ 0 partitions drops data

2016-07-29 Thread Bryan Jeffrey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Jeffrey resolved SPARK-16797. --- Resolution: Fixed Resolved in Spark 2.0.0 > Repartiton call w/ 0 partitions drops data >

[jira] [Updated] (SPARK-16797) Repartiton call w/ 0 partitions drops data

2016-07-29 Thread Bryan Jeffrey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Jeffrey updated SPARK-16797: -- Affects Version/s: (was: 2.0.0) Fix Version/s: 2.0.0 > Repartiton call w/ 0

[jira] [Commented] (SPARK-16797) Repartiton call w/ 0 partitions drops data

2016-07-29 Thread Bryan Jeffrey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400362#comment-15400362 ] Bryan Jeffrey commented on SPARK-16797: --- I just ran the same thing on Spark 2.0.0 as released, and

[jira] [Comment Edited] (SPARK-16797) Repartiton call w/ 0 partitions drops data

2016-07-29 Thread Bryan Jeffrey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400356#comment-15400356 ] Bryan Jeffrey edited comment on SPARK-16797 at 7/30/16 1:37 AM: Hello.

[jira] [Comment Edited] (SPARK-16797) Repartiton call w/ 0 partitions drops data

2016-07-29 Thread Bryan Jeffrey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400356#comment-15400356 ] Bryan Jeffrey edited comment on SPARK-16797 at 7/30/16 1:36 AM: Hello.

[jira] [Commented] (SPARK-16797) Repartiton call w/ 0 partitions drops data

2016-07-29 Thread Bryan Jeffrey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400356#comment-15400356 ] Bryan Jeffrey commented on SPARK-16797: --- Hello. Here is a simple example using Spark 1.6.1:

[jira] [Updated] (SPARK-16802) joins.LongToUnsafeRowMap crashes with ArrayIndexOutOfBoundsException

2016-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16802: Affects Version/s: (was: 2.0.1) > joins.LongToUnsafeRowMap crashes with

[jira] [Updated] (SPARK-16802) joins.LongToUnsafeRowMap crashes with ArrayIndexOutOfBoundsException

2016-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16802: Priority: Blocker (was: Major) > joins.LongToUnsafeRowMap crashes with

[jira] [Updated] (SPARK-16802) joins.LongToUnsafeRowMap crashes with ArrayIndexOutOfBoundsException

2016-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16802: Priority: Critical (was: Blocker) > joins.LongToUnsafeRowMap crashes with

[jira] [Updated] (SPARK-16802) joins.LongToUnsafeRowMap crashes with ArrayIndexOutOfBoundsException

2016-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16802: Target Version/s: 2.0.1, 2.1.0 > joins.LongToUnsafeRowMap crashes with

[jira] [Updated] (SPARK-16804) Correlated subqueries containing LIMIT return incorrect results

2016-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16804: Target Version/s: 2.0.1, 2.1.0 (was: 2.0.1) > Correlated subqueries containing LIMIT return

[jira] [Commented] (SPARK-16810) Refactor registerSinks with multiple constructos

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400263#comment-15400263 ] Apache Spark commented on SPARK-16810: -- User 'lovexi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16810) Refactor registerSinks with multiple constructos

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16810: Assignee: (was: Apache Spark) > Refactor registerSinks with multiple constructos >

[jira] [Assigned] (SPARK-16810) Refactor registerSinks with multiple constructos

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16810: Assignee: Apache Spark > Refactor registerSinks with multiple constructos >

[jira] [Commented] (SPARK-16802) joins.LongToUnsafeRowMap crashes with ArrayIndexOutOfBoundsException

2016-07-29 Thread Sylvain Zimmer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400260#comment-15400260 ] Sylvain Zimmer commented on SPARK-16802: Maybe useful for others: an ugly workaround to avoid

[jira] [Created] (SPARK-16810) Refactor registerSinks with multiple constructos

2016-07-29 Thread YangyangLiu (JIRA)
YangyangLiu created SPARK-16810: --- Summary: Refactor registerSinks with multiple constructos Key: SPARK-16810 URL: https://issues.apache.org/jira/browse/SPARK-16810 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-16809) Link Mesos Dispatcher and History Server

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16809: Assignee: Apache Spark > Link Mesos Dispatcher and History Server >

[jira] [Commented] (SPARK-16809) Link Mesos Dispatcher and History Server

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400234#comment-15400234 ] Apache Spark commented on SPARK-16809: -- User 'mgummelt' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16809) Link Mesos Dispatcher and History Server

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16809: Assignee: (was: Apache Spark) > Link Mesos Dispatcher and History Server >

[jira] [Created] (SPARK-16809) Link Mesos Dispatcher and History Server

2016-07-29 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-16809: --- Summary: Link Mesos Dispatcher and History Server Key: SPARK-16809 URL: https://issues.apache.org/jira/browse/SPARK-16809 Project: Spark Issue Type:

[jira] [Created] (SPARK-16808) History Server main page does not honor APPLICATION_WEB_PROXY_BASE

2016-07-29 Thread Michael Gummelt (JIRA)
Michael Gummelt created SPARK-16808: --- Summary: History Server main page does not honor APPLICATION_WEB_PROXY_BASE Key: SPARK-16808 URL: https://issues.apache.org/jira/browse/SPARK-16808 Project:

[jira] [Updated] (SPARK-16807) Optimize some ABS() statements

2016-07-29 Thread Sylvain Zimmer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sylvain Zimmer updated SPARK-16807: --- Priority: Minor (was: Major) > Optimize some ABS() statements >

[jira] [Updated] (SPARK-16807) Optimize some ABS() statements

2016-07-29 Thread Sylvain Zimmer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sylvain Zimmer updated SPARK-16807: --- Description: I'm not a Catalyst expert, but I think some use cases for the ABS() function

[jira] [Created] (SPARK-16807) Optimize some ABS() statements

2016-07-29 Thread Sylvain Zimmer (JIRA)
Sylvain Zimmer created SPARK-16807: -- Summary: Optimize some ABS() statements Key: SPARK-16807 URL: https://issues.apache.org/jira/browse/SPARK-16807 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-1121) Only add avro if the build is for Hadoop 0.23.X and SPARK_YARN is set

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400167#comment-15400167 ] Apache Spark commented on SPARK-1121: - User 'pwendell' has created a pull request for this issue:

[jira] [Commented] (SPARK-16804) Correlated subqueries containing LIMIT return incorrect results

2016-07-29 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400150#comment-15400150 ] Nattavut Sutyanyong commented on SPARK-16804: - To demonstrate that this fix does not

[jira] [Resolved] (SPARK-16806) from_unixtime function gives wrong answer

2016-07-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16806. --- Resolution: Duplicate > from_unixtime function gives wrong answer >

[jira] [Resolved] (SPARK-16794) Spark 2.0.0. with Yarn

2016-07-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16794. --- Resolution: Not A Problem > Spark 2.0.0. with Yarn > --- > >

[jira] [Reopened] (SPARK-16794) Spark 2.0.0. with Yarn

2016-07-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-16794: --- This should not be resolved as Fixed because there was no Spark change associated to it > Spark 2.0.0.

[jira] [Closed] (SPARK-16794) Spark 2.0.0. with Yarn

2016-07-29 Thread Eliano Marques (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eliano Marques closed SPARK-16794. -- Resolution: Fixed > Spark 2.0.0. with Yarn > --- > > Key:

[jira] [Commented] (SPARK-16806) from_unixtime function gives wrong answer

2016-07-29 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400118#comment-15400118 ] Dongjoon Hyun commented on SPARK-16806: --- You can see SPARK-16384 , too. > from_unixtime function

[jira] [Comment Edited] (SPARK-16806) from_unixtime function gives wrong answer

2016-07-29 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400113#comment-15400113 ] Dongjoon Hyun edited comment on SPARK-16806 at 7/29/16 10:19 PM: - Yep.

[jira] [Comment Edited] (SPARK-16806) from_unixtime function gives wrong answer

2016-07-29 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400113#comment-15400113 ] Dongjoon Hyun edited comment on SPARK-16806 at 7/29/16 10:18 PM: - Yep.

[jira] [Commented] (SPARK-16806) from_unixtime function gives wrong answer

2016-07-29 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400113#comment-15400113 ] Dongjoon Hyun commented on SPARK-16806: --- Yep. Please use `` instead of ``. {code}

[jira] [Updated] (SPARK-16806) from_unixtime function gives wrong answer

2016-07-29 Thread Dong Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Jiang updated SPARK-16806: --- Description: The following is from 2.0, for the same epoch, the function with format argument

[jira] [Created] (SPARK-16806) from_unixtime function gives wrong answer

2016-07-29 Thread Dong Jiang (JIRA)
Dong Jiang created SPARK-16806: -- Summary: from_unixtime function gives wrong answer Key: SPARK-16806 URL: https://issues.apache.org/jira/browse/SPARK-16806 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-16804) Correlated subqueries containing LIMIT return incorrect results

2016-07-29 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400105#comment-15400105 ] Nattavut Sutyanyong commented on SPARK-16804: - This fix blocks any correlated subquery when

[jira] [Commented] (SPARK-16794) Spark 2.0.0. with Yarn

2016-07-29 Thread Eliano Marques (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400094#comment-15400094 ] Eliano Marques commented on SPARK-16794: So I investigated further the issue and turns out that

[jira] [Comment Edited] (SPARK-16798) java.lang.IllegalArgumentException: bound must be positive : Worked in 1.5.2

2016-07-29 Thread Charles Allen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400089#comment-15400089 ] Charles Allen edited comment on SPARK-16798 at 7/29/16 10:06 PM: - Adding

[jira] [Commented] (SPARK-16779) Fix unnecessary use of postfix operations

2016-07-29 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400092#comment-15400092 ] holdenk commented on SPARK-16779: - I've gone ahead and done a more full-scope version - leaving the XML

[jira] [Commented] (SPARK-16798) java.lang.IllegalArgumentException: bound must be positive : Worked in 1.5.2

2016-07-29 Thread Charles Allen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400089#comment-15400089 ] Charles Allen commented on SPARK-16798: --- Adding some more flavor, this is running in Mesos coarse

[jira] [Commented] (SPARK-16804) Correlated subqueries containing LIMIT return incorrect results

2016-07-29 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400090#comment-15400090 ] Nattavut Sutyanyong commented on SPARK-16804: - scala> sql("select c1 from t1 where exists

[jira] [Commented] (SPARK-16805) Log timezone when query result does not match

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400087#comment-15400087 ] Apache Spark commented on SPARK-16805: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16805) Log timezone when query result does not match

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16805: Assignee: Apache Spark (was: Reynold Xin) > Log timezone when query result does not

[jira] [Assigned] (SPARK-16805) Log timezone when query result does not match

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16805: Assignee: Reynold Xin (was: Apache Spark) > Log timezone when query result does not

[jira] [Updated] (SPARK-16804) Correlated subqueries containing LIMIT return incorrect results

2016-07-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16804: Description: Correlated subqueries with LIMIT could return incorrect results. The rule

[jira] [Created] (SPARK-16805) Log timezone when query result does not match

2016-07-29 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-16805: --- Summary: Log timezone when query result does not match Key: SPARK-16805 URL: https://issues.apache.org/jira/browse/SPARK-16805 Project: Spark Issue Type:

[jira] [Commented] (SPARK-16785) dapply doesn't return array or raw columns

2016-07-29 Thread Clark Fitzgerald (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400083#comment-15400083 ] Clark Fitzgerald commented on SPARK-16785: -- Yes I can do a PR for this. It may take me a little

[jira] [Assigned] (SPARK-15355) Pro-active block replenishment in case of node/executor failures

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15355: Assignee: (was: Apache Spark) > Pro-active block replenishment in case of

[jira] [Assigned] (SPARK-15355) Pro-active block replenishment in case of node/executor failures

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15355: Assignee: Apache Spark > Pro-active block replenishment in case of node/executor failures

[jira] [Commented] (SPARK-15355) Pro-active block replenishment in case of node/executor failures

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400078#comment-15400078 ] Apache Spark commented on SPARK-15355: -- User 'shubhamchopra' has created a pull request for this

[jira] [Commented] (SPARK-16804) Correlated subqueries containing LIMIT return incorrect results

2016-07-29 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400075#comment-15400075 ] Nattavut Sutyanyong commented on SPARK-16804: - I am working on a fix. Could you please assign

[jira] [Commented] (SPARK-16798) java.lang.IllegalArgumentException: bound must be positive : Worked in 1.5.2

2016-07-29 Thread Charles Allen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400070#comment-15400070 ] Charles Allen commented on SPARK-16798: --- I am definitely running a *modified* 2.0.0, but

[jira] [Commented] (SPARK-16798) java.lang.IllegalArgumentException: bound must be positive : Worked in 1.5.2

2016-07-29 Thread Charles Allen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400071#comment-15400071 ] Charles Allen commented on SPARK-16798: --- I'll run 2.0.0 stock as another test that will go out

[jira] [Commented] (SPARK-16804) Correlated subqueries containing LIMIT return incorrect results

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400068#comment-15400068 ] Apache Spark commented on SPARK-16804: -- User 'nsyca' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16804) Correlated subqueries containing LIMIT return incorrect results

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16804: Assignee: (was: Apache Spark) > Correlated subqueries containing LIMIT return

[jira] [Assigned] (SPARK-16804) Correlated subqueries containing LIMIT return incorrect results

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16804: Assignee: Apache Spark > Correlated subqueries containing LIMIT return incorrect results

[jira] [Commented] (SPARK-16802) joins.LongToUnsafeRowMap crashes with ArrayIndexOutOfBoundsException

2016-07-29 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400045#comment-15400045 ] Miao Wang commented on SPARK-16802: --- Very easy to reproduce. I am learning SQL code now. >

[jira] [Created] (SPARK-16804) Correlated subqueries containing LIMIT return incorrect results

2016-07-29 Thread Nattavut Sutyanyong (JIRA)
Nattavut Sutyanyong created SPARK-16804: --- Summary: Correlated subqueries containing LIMIT return incorrect results Key: SPARK-16804 URL: https://issues.apache.org/jira/browse/SPARK-16804

[jira] [Commented] (SPARK-16803) SaveAsTable does not work when source DataFrame is built on a Hive Table

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400029#comment-15400029 ] Apache Spark commented on SPARK-16803: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16803) SaveAsTable does not work when source DataFrame is built on a Hive Table

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16803: Assignee: Apache Spark > SaveAsTable does not work when source DataFrame is built on a

[jira] [Assigned] (SPARK-16803) SaveAsTable does not work when source DataFrame is built on a Hive Table

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16803: Assignee: (was: Apache Spark) > SaveAsTable does not work when source DataFrame is

[jira] [Commented] (SPARK-16789) Can't run saveAsTable with database name

2016-07-29 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400025#comment-15400025 ] Xiao Li commented on SPARK-16789: - Please check the description of the JIRA:

[jira] [Closed] (SPARK-16789) Can't run saveAsTable with database name

2016-07-29 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li closed SPARK-16789. --- Resolution: Duplicate > Can't run saveAsTable with database name >

[jira] [Updated] (SPARK-16803) SaveAsTable does not work when source DataFrame is built on a Hive Table

2016-07-29 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-16803: Description: {noformat} scala> sql("create table sample.sample stored as SEQUENCEFILE as select 1 as key,

[jira] [Updated] (SPARK-16803) SaveAsTable does not work when source DataFrame is built on a Hive Table

2016-07-29 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-16803: Description: {noformat} scala> sql("create table sample.sample stored as SEQUENCEFILE as select 1 as key,

[jira] [Created] (SPARK-16803) SaveAsTable does not work when source DataFrame is built on a Hive Table

2016-07-29 Thread Xiao Li (JIRA)
Xiao Li created SPARK-16803: --- Summary: SaveAsTable does not work when source DataFrame is built on a Hive Table Key: SPARK-16803 URL: https://issues.apache.org/jira/browse/SPARK-16803 Project: Spark

[jira] [Updated] (SPARK-16441) Spark application hang when dynamic allocation is enabled

2016-07-29 Thread Dhruve Ashar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dhruve Ashar updated SPARK-16441: - Affects Version/s: 2.0.0 > Spark application hang when dynamic allocation is enabled >

[jira] [Commented] (SPARK-16798) java.lang.IllegalArgumentException: bound must be positive : Worked in 1.5.2

2016-07-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400015#comment-15400015 ] Sean Owen commented on SPARK-16798: --- Yeah I noticed that too, and while the conclusion is probably the

[jira] [Commented] (SPARK-16798) java.lang.IllegalArgumentException: bound must be positive : Worked in 1.5.2

2016-07-29 Thread Charles Allen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400014#comment-15400014 ] Charles Allen commented on SPARK-16798: --- The super odd thing here is that RDD.scala:445 *SHOULD* be

[jira] [Commented] (SPARK-14818) Move sketch and mllibLocal out from mima exclusion

2016-07-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400010#comment-15400010 ] Sean Owen commented on SPARK-14818: --- [~yhuai] do you want to implement this now? > Move sketch and

[jira] [Resolved] (SPARK-16667) Spark driver executor dont release unused memory

2016-07-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16667. --- Resolution: Not A Problem > Spark driver executor dont release unused memory >

[jira] [Resolved] (SPARK-16725) Migrate Guava to 16+?

2016-07-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16725. --- Resolution: Won't Fix > Migrate Guava to 16+? > - > > Key:

[jira] [Resolved] (SPARK-16702) Driver hangs after executors are lost

2016-07-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16702. --- Resolution: Duplicate > Driver hangs after executors are lost >

[jira] [Resolved] (SPARK-16688) OpenHashSet.MAX_CAPACITY is always based on Int even when using Long

2016-07-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16688. --- Resolution: Won't Fix > OpenHashSet.MAX_CAPACITY is always based on Int even when using Long >

[jira] [Resolved] (SPARK-16705) Kafka Direct Stream is not experimental anymore

2016-07-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16705. --- Resolution: Duplicate > Kafka Direct Stream is not experimental anymore >

[jira] [Updated] (SPARK-16802) joins.LongToUnsafeRowMap crashes with ArrayIndexOutOfBoundsException

2016-07-29 Thread Sylvain Zimmer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sylvain Zimmer updated SPARK-16802: --- Description: Hello! This is a little similar to

[jira] [Updated] (SPARK-16802) joins.LongToUnsafeRowMap crashes with ArrayIndexOutOfBoundsException

2016-07-29 Thread Sylvain Zimmer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sylvain Zimmer updated SPARK-16802: --- Description: Hello! This is a little similar to

[jira] [Commented] (SPARK-16801) clearThreshold does not work for SparseVector

2016-07-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399953#comment-15399953 ] Sean Owen commented on SPARK-16801: --- {{clearThreshold}} is unrelated to vectors entirely. It's a

[jira] [Created] (SPARK-16802) joins.LongToUnsafeRowMap crashes with ArrayIndexOutOfBoundsException

2016-07-29 Thread Sylvain Zimmer (JIRA)
Sylvain Zimmer created SPARK-16802: -- Summary: joins.LongToUnsafeRowMap crashes with ArrayIndexOutOfBoundsException Key: SPARK-16802 URL: https://issues.apache.org/jira/browse/SPARK-16802 Project:

[jira] [Updated] (SPARK-16664) Spark 1.6.2 - Persist call on Data frames with more than 200 columns is wiping out the data.

2016-07-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16664: -- Fix Version/s: 1.6.3 > Spark 1.6.2 - Persist call on Data frames with more than 200 columns is >

[jira] [Commented] (SPARK-16797) Repartiton call w/ 0 partitions drops data

2016-07-29 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399948#comment-15399948 ] Dongjoon Hyun commented on SPARK-16797: --- Hi, [~bjeffrey]. Could you give me more information how to

[jira] [Assigned] (SPARK-16796) Visible passwords on Spark environment page

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16796: Assignee: Apache Spark > Visible passwords on Spark environment page >

[jira] [Commented] (SPARK-16796) Visible passwords on Spark environment page

2016-07-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399944#comment-15399944 ] Apache Spark commented on SPARK-16796: -- User 'Devian-ua' has created a pull request for this issue:

  1   2   3   >