[jira] [Assigned] (SPARK-18108) Partition discovery fails with explicitly written long partitions

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18108: Assignee: (was: Apache Spark) > Partition discovery fails with explicitly written long

[jira] [Commented] (SPARK-18108) Partition discovery fails with explicitly written long partitions

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701268#comment-15701268 ] Apache Spark commented on SPARK-18108: -- User 'maropu' has created a pull request for

[jira] [Assigned] (SPARK-18108) Partition discovery fails with explicitly written long partitions

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18108: Assignee: Apache Spark > Partition discovery fails with explicitly written long partitions

[jira] [Created] (SPARK-18606) [HISTORYSERVER]It will check html elems while searching HistoryServer

2016-11-28 Thread Tao Wang (JIRA)
Tao Wang created SPARK-18606: Summary: [HISTORYSERVER]It will check html elems while searching HistoryServer Key: SPARK-18606 URL: https://issues.apache.org/jira/browse/SPARK-18606 Project: Spark

[jira] [Created] (SPARK-18607) give a result on a percent of the tasks succeed

2016-11-28 Thread Ru Xiang (JIRA)
Ru Xiang created SPARK-18607: Summary: give a result on a percent of the tasks succeed Key: SPARK-18607 URL: https://issues.apache.org/jira/browse/SPARK-18607 Project: Spark Issue Type: New Feat

[jira] [Created] (SPARK-18608) Spark ML algorithms that check RDD cache level for internal caching double-cache data

2016-11-28 Thread Nick Pentreath (JIRA)
Nick Pentreath created SPARK-18608: -- Summary: Spark ML algorithms that check RDD cache level for internal caching double-cache data Key: SPARK-18608 URL: https://issues.apache.org/jira/browse/SPARK-18608

[jira] [Assigned] (SPARK-18606) [HISTORYSERVER]It will check html elems while searching HistoryServer

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18606: Assignee: (was: Apache Spark) > [HISTORYSERVER]It will check html elems while searchin

[jira] [Assigned] (SPARK-18606) [HISTORYSERVER]It will check html elems while searching HistoryServer

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18606: Assignee: Apache Spark > [HISTORYSERVER]It will check html elems while searching HistorySe

[jira] [Commented] (SPARK-18606) [HISTORYSERVER]It will check html elems while searching HistoryServer

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701444#comment-15701444 ] Apache Spark commented on SPARK-18606: -- User 'WangTaoTheTonic' has created a pull re

[jira] [Commented] (SPARK-18608) Spark ML algorithms that check RDD cache level for internal caching double-cache data

2016-11-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701447#comment-15701447 ] Sean Owen commented on SPARK-18608: --- Agree, I had long since meant to note this. This w

[jira] [Commented] (SPARK-18118) SpecificSafeProjection.apply of Java Object from Dataset to JavaRDD Grows Beyond 64 KB

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701463#comment-15701463 ] Apache Spark commented on SPARK-18118: -- User 'kiszk' has created a pull request for

[jira] [Assigned] (SPARK-18118) SpecificSafeProjection.apply of Java Object from Dataset to JavaRDD Grows Beyond 64 KB

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18118: Assignee: Apache Spark > SpecificSafeProjection.apply of Java Object from Dataset to JavaR

[jira] [Assigned] (SPARK-18118) SpecificSafeProjection.apply of Java Object from Dataset to JavaRDD Grows Beyond 64 KB

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18118: Assignee: (was: Apache Spark) > SpecificSafeProjection.apply of Java Object from Datas

[jira] [Commented] (SPARK-18558) spark-csv: infer data type for mixed integer/null columns causes exception

2016-11-28 Thread Jayadevan M (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701508#comment-15701508 ] Jayadevan M commented on SPARK-18558: - [~PeterRose] I tried to replicate this issue,

[jira] [Updated] (SPARK-18560) Receiver data can not be dataSerialized properly.

2016-11-28 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-18560: -- Component/s: (was: Structured Streaming) > Receiver data can not be dataSerialized properly

[jira] [Closed] (SPARK-18474) Add StreamingQuery.status in python

2016-11-28 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-18474. - Resolution: Duplicate > Add StreamingQuery.status in python > ---

[jira] [Resolved] (SPARK-18407) Inferred partition columns cause assertion error

2016-11-28 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-18407. --- Resolution: Fixed Assignee: Burak Yavuz Fix Version/s: 2.1.0 > Inferred parti

[jira] [Resolved] (SPARK-18577) Ambiguous reference with duplicate column names in aggregate

2016-11-28 Thread Yerui Sun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yerui Sun resolved SPARK-18577. --- Resolution: Won't Fix It's indeed not standard sql usage,only supported in Hive, but not MySQL, post

[jira] [Closed] (SPARK-18577) Ambiguous reference with duplicate column names in aggregate

2016-11-28 Thread Yerui Sun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yerui Sun closed SPARK-18577. - > Ambiguous reference with duplicate column names in aggregate >

[jira] [Commented] (SPARK-18568) vertex attributes in the edge triplet not getting updated in super steps for Pregel API

2016-11-28 Thread Rohit (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701622#comment-15701622 ] Rohit commented on SPARK-18568: --- Found the exact issue. If the vertex attribute is a comple

[jira] [Commented] (SPARK-18604) Collapse Window optimizer rule changes column order

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701627#comment-15701627 ] Apache Spark commented on SPARK-18604: -- User 'hvanhovell' has created a pull request

[jira] [Assigned] (SPARK-18604) Collapse Window optimizer rule changes column order

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18604: Assignee: Apache Spark > Collapse Window optimizer rule changes column order > ---

[jira] [Assigned] (SPARK-18604) Collapse Window optimizer rule changes column order

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18604: Assignee: (was: Apache Spark) > Collapse Window optimizer rule changes column order >

[jira] [Resolved] (SPARK-18604) Collapse Window optimizer rule changes column order

2016-11-28 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18604. --- Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.1.0 >

[jira] [Commented] (SPARK-18527) UDAFPercentile (bigint, array) needs explicity cast to double

2016-11-28 Thread Fabian Boehnlein (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701661#comment-15701661 ] Fabian Boehnlein commented on SPARK-18527: -- Interesting [~hvanhovell], good to s

[jira] [Assigned] (SPARK-18607) give a result on a percent of the tasks succeed

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18607: Assignee: Apache Spark > give a result on a percent of the tasks succeed > --

[jira] [Commented] (SPARK-18607) give a result on a percent of the tasks succeed

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701683#comment-15701683 ] Apache Spark commented on SPARK-18607: -- User 'Ru-Xiang' has created a pull request f

[jira] [Assigned] (SPARK-18607) give a result on a percent of the tasks succeed

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18607: Assignee: (was: Apache Spark) > give a result on a percent of the tasks succeed > ---

[jira] [Created] (SPARK-18609) [SQL] column mixup with CROSS JOIN

2016-11-28 Thread Furcy Pin (JIRA)
Furcy Pin created SPARK-18609: - Summary: [SQL] column mixup with CROSS JOIN Key: SPARK-18609 URL: https://issues.apache.org/jira/browse/SPARK-18609 Project: Spark Issue Type: Bug Affects Vers

[jira] [Commented] (SPARK-18527) UDAFPercentile (bigint, array) needs explicity cast to double

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701806#comment-15701806 ] Apache Spark commented on SPARK-18527: -- User 'hvanhovell' has created a pull request

[jira] [Assigned] (SPARK-18527) UDAFPercentile (bigint, array) needs explicity cast to double

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18527: Assignee: (was: Apache Spark) > UDAFPercentile (bigint, array) needs explicity cast to

[jira] [Assigned] (SPARK-18527) UDAFPercentile (bigint, array) needs explicity cast to double

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18527: Assignee: Apache Spark > UDAFPercentile (bigint, array) needs explicity cast to double > -

[jira] [Updated] (SPARK-18605) Spark Streaming ERROR TransportResponseHandler: Still have 1 requests outstanding when connection

2016-11-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18605: -- Target Version/s: (was: 1.6.2) Fix Version/s: (was: 1.6.2) > Spark Streaming ERROR Transpo

[jira] [Resolved] (SPARK-18118) SpecificSafeProjection.apply of Java Object from Dataset to JavaRDD Grows Beyond 64 KB

2016-11-28 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18118. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.1.0

[jira] [Updated] (SPARK-18609) [SQL] column mixup with CROSS JOIN

2016-11-28 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18609: -- Component/s: SQL > [SQL] column mixup with CROSS JOIN > ---

[jira] [Updated] (SPARK-18609) [SQL] column mixup with CROSS JOIN

2016-11-28 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-18609: -- Labels: (was: sql) > [SQL] column mixup with CROSS JOIN > ---

[jira] [Commented] (SPARK-18608) Spark ML algorithms that check RDD cache level for internal caching double-cache data

2016-11-28 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701839#comment-15701839 ] Nick Pentreath commented on SPARK-18608: I've also been meaning to log this for a

[jira] [Reopened] (SPARK-17732) ALTER TABLE DROP PARTITION should support comparators

2016-11-28 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-17732: - > ALTER TABLE DROP PARTITION should support comparators > ---

[jira] [Updated] (SPARK-17732) ALTER TABLE DROP PARTITION should support comparators

2016-11-28 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17732: Target Version/s: 2.2.0 > ALTER TABLE DROP PARTITION should support comparators > -

[jira] [Updated] (SPARK-17732) ALTER TABLE DROP PARTITION should support comparators

2016-11-28 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17732: Fix Version/s: (was: 2.2.0) > ALTER TABLE DROP PARTITION should support comparators > -

[jira] [Created] (SPARK-18610) greatest/leatest fails to run with string aginst date/timestamp

2016-11-28 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-18610: Summary: greatest/leatest fails to run with string aginst date/timestamp Key: SPARK-18610 URL: https://issues.apache.org/jira/browse/SPARK-18610 Project: Spark

[jira] [Assigned] (SPARK-17732) ALTER TABLE DROP PARTITION should support comparators

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17732: Assignee: Apache Spark (was: Dongjoon Hyun) > ALTER TABLE DROP PARTITION should support c

[jira] [Assigned] (SPARK-17732) ALTER TABLE DROP PARTITION should support comparators

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17732: Assignee: Dongjoon Hyun (was: Apache Spark) > ALTER TABLE DROP PARTITION should support c

[jira] [Commented] (SPARK-17732) ALTER TABLE DROP PARTITION should support comparators

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701984#comment-15701984 ] Apache Spark commented on SPARK-17732: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-18610) greatest/leatest fails to run with string aginst date/timestamp

2016-11-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702007#comment-15702007 ] Sean Owen commented on SPARK-18610: --- I know I should know this, and could test it, but

[jira] [Commented] (SPARK-18220) ClassCastException occurs when using select query on ORC file

2016-11-28 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702009#comment-15702009 ] Wenchen Fan commented on SPARK-18220: - > I created a separate table by querying an ex

[jira] [Commented] (SPARK-18610) greatest/leatest fails to run with string aginst date/timestamp

2016-11-28 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702032#comment-15702032 ] Hyukjin Kwon commented on SPARK-18610: -- Ah, I believe it is a bit complicated more t

[jira] [Commented] (SPARK-18610) greatest/leatest fails to run with string aginst date/timestamp

2016-11-28 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702047#comment-15702047 ] Hyukjin Kwon commented on SPARK-18610: -- So, I understood (by myself) that we might n

[jira] [Commented] (SPARK-18610) greatest/leatest fails to run with string aginst date/timestamp

2016-11-28 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702057#comment-15702057 ] Hyukjin Kwon commented on SPARK-18610: -- Actually, in case of MySQL, it seems convert

[jira] [Commented] (SPARK-18610) greatest/leatest fails to run with string aginst date/timestamp

2016-11-28 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702083#comment-15702083 ] Hyukjin Kwon commented on SPARK-18610: -- Hi [~hvanhovell] and [~cloud_fan], After ret

[jira] [Updated] (SPARK-18610) greatest/leatest fails to run with string aginst date/timestamp

2016-11-28 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-18610: - Description: It seems Spark SQL fails to implicitly cast (or detect widen type) from string with

[jira] [Commented] (SPARK-18220) ClassCastException occurs when using select query on ORC file

2016-11-28 Thread Jerryjung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702104#comment-15702104 ] Jerryjung commented on SPARK-18220: --- CREATE EXTERNAL TABLE `d_c`.`dcoc_ircs_op_brch`(`i

[jira] [Commented] (SPARK-18020) Kinesis receiver does not snapshot when shard completes

2016-11-28 Thread Basile Deustua (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702167#comment-15702167 ] Basile Deustua commented on SPARK-18020: Same here > Kinesis receiver does not s

[jira] [Issue Comment Deleted] (SPARK-18020) Kinesis receiver does not snapshot when shard completes

2016-11-28 Thread Basile Deustua (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Basile Deustua updated SPARK-18020: --- Comment: was deleted (was: Same here) > Kinesis receiver does not snapshot when shard comple

[jira] [Resolved] (SPARK-17783) Hide Credentials in CREATE and DESC FORMATTED/EXTENDED a PERSISTENT/TEMP Table for JDBC

2016-11-28 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17783. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.1.0 > Hide Crede

[jira] [Updated] (SPARK-18611) mesos shuffle service on v2 isn't compatible with spark v1

2016-11-28 Thread Adrian Bridgett (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Bridgett updated SPARK-18611: Affects Version/s: 1.6.3 > mesos shuffle service on v2 isn't compatible with spark v1 > ---

[jira] [Resolved] (SPARK-18597) Do not push down filters for LEFT ANTI JOIN

2016-11-28 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18597. --- Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.1.0 >

[jira] [Created] (SPARK-18611) mesos shuffle service on v2 isn't compatible with spark v1

2016-11-28 Thread Adrian Bridgett (JIRA)
Adrian Bridgett created SPARK-18611: --- Summary: mesos shuffle service on v2 isn't compatible with spark v1 Key: SPARK-18611 URL: https://issues.apache.org/jira/browse/SPARK-18611 Project: Spark

[jira] [Commented] (SPARK-18611) mesos shuffle service on v2 isn't compatible with spark v1

2016-11-28 Thread Adrian Bridgett (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702213#comment-15702213 ] Adrian Bridgett commented on SPARK-18611: - dragos spotted this problem in his com

[jira] [Commented] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

2016-11-28 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702258#comment-15702258 ] Jiang Xingbo commented on SPARK-18549: -- I'd suggest we store the view dependency in

[jira] [Commented] (SPARK-18471) In treeAggregate, generate (big) zeros instead of sending them.

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702262#comment-15702262 ] Apache Spark commented on SPARK-18471: -- User 'AnthonyTruchet' has created a pull req

[jira] [Commented] (SPARK-18471) In treeAggregate, generate (big) zeros instead of sending them.

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702296#comment-15702296 ] Apache Spark commented on SPARK-18471: -- User 'AnthonyTruchet' has created a pull req

[jira] [Commented] (SPARK-18597) Do not push down filters for LEFT ANTI JOIN

2016-11-28 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702328#comment-15702328 ] Herman van Hovell commented on SPARK-18597: --- [~nsyca] LEFT SEMI and LEFT ANTI a

[jira] [Commented] (SPARK-18262) JSON.org license is now CatX

2016-11-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702340#comment-15702340 ] Steve Loughran commented on SPARK-18262: ~tdunning has done a mostly-compatible o

[jira] [Commented] (SPARK-18597) Do not push down filters for LEFT ANTI JOIN

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702336#comment-15702336 ] Apache Spark commented on SPARK-18597: -- User 'hvanhovell' has created a pull request

[jira] [Commented] (SPARK-18512) FileNotFoundException on _temporary directory with Spark Streaming 2.0.1 and S3A

2016-11-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702368#comment-15702368 ] Steve Loughran commented on SPARK-18512: This looks like a consistency problem; s

[jira] [Commented] (SPARK-18512) FileNotFoundException on _temporary directory with Spark Streaming 2.0.1 and S3A

2016-11-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702373#comment-15702373 ] Steve Loughran commented on SPARK-18512: one question: what's the size of data be

[jira] [Created] (SPARK-18612) Leaked broadcasted variable Mllib

2016-11-28 Thread Anthony Truchet (JIRA)
Anthony Truchet created SPARK-18612: --- Summary: Leaked broadcasted variable Mllib Key: SPARK-18612 URL: https://issues.apache.org/jira/browse/SPARK-18612 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-18512) FileNotFoundException on _temporary directory with Spark Streaming 2.0.1 and S3A

2016-11-28 Thread Giuseppe Bonaccorso (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702394#comment-15702394 ] Giuseppe Bonaccorso commented on SPARK-18512: - It happens after about 1.000.0

[jira] [Assigned] (SPARK-18612) Leaked broadcasted variable Mllib

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18612: Assignee: Apache Spark > Leaked broadcasted variable Mllib > -

[jira] [Commented] (SPARK-18612) Leaked broadcasted variable Mllib

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702392#comment-15702392 ] Apache Spark commented on SPARK-18612: -- User 'AnthonyTruchet' has created a pull req

[jira] [Assigned] (SPARK-18612) Leaked broadcasted variable Mllib

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18612: Assignee: (was: Apache Spark) > Leaked broadcasted variable Mllib > --

[jira] [Updated] (SPARK-18612) Leaked broadcasted variable Mllib

2016-11-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18612: -- Priority: Trivial (was: Major) Issue Type: Improvement (was: Bug) > Leaked broadcasted variable

[jira] [Commented] (SPARK-18058) AnalysisException may be thrown when union two DFs whose struct fields have different nullability

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702431#comment-15702431 ] Apache Spark commented on SPARK-18058: -- User 'hvanhovell' has created a pull request

[jira] [Updated] (SPARK-18481) ML 2.1 QA: Remove deprecated methods for ML

2016-11-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18481: -- Description: Remove deprecated methods for ML. This task removed the following (deprec

[jira] [Commented] (SPARK-18612) Leaked broadcasted variable Mllib

2016-11-28 Thread Anthony Truchet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702446#comment-15702446 ] Anthony Truchet commented on SPARK-18612: - See related: * https://issues.apache.o

[jira] [Updated] (SPARK-18592) Move DT/RF/GBT Param setter methods to subclasses

2016-11-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18592: -- Target Version/s: 2.1.0, 2.2.0 > Move DT/RF/GBT Param setter methods to subclasses > --

[jira] [Commented] (SPARK-18324) ML, Graph 2.1 QA: Programming guide update and migration guide

2016-11-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702451#comment-15702451 ] Joseph K. Bradley commented on SPARK-18324: --- Note API changes from [SPARK-18481

[jira] [Commented] (SPARK-18597) Do not push down filters for LEFT ANTI JOIN

2016-11-28 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702454#comment-15702454 ] Nattavut Sutyanyong commented on SPARK-18597: - [~hvanhovell], @dongjoon, [~sm

[jira] [Updated] (SPARK-18597) Do not push down filters for LEFT ANTI JOIN

2016-11-28 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nattavut Sutyanyong updated SPARK-18597: Description: The optimizer pushes down filters for left anti joins. This unfortunat

[jira] [Comment Edited] (SPARK-18597) Do not push down filters for LEFT ANTI JOIN

2016-11-28 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702454#comment-15702454 ] Herman van Hovell edited comment on SPARK-18597 at 11/28/16 4:53 PM: --

[jira] [Commented] (SPARK-18597) Do not push down filters for LEFT ANTI JOIN

2016-11-28 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702474#comment-15702474 ] Herman van Hovell commented on SPARK-18597: --- Thanks! > Do not push down filter

[jira] [Comment Edited] (SPARK-18597) Do not push down filters for LEFT ANTI JOIN

2016-11-28 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702454#comment-15702454 ] Herman van Hovell edited comment on SPARK-18597 at 11/28/16 4:53 PM: --

[jira] [Resolved] (SPARK-18535) Redact sensitive information from Spark logs and UI

2016-11-28 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-18535. Resolution: Fixed Assignee: Mark Grover Fix Version/s: 2.2.0 > Redact sensi

[jira] [Commented] (SPARK-18597) Do not push down filters for LEFT ANTI JOIN

2016-11-28 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702505#comment-15702505 ] Nattavut Sutyanyong commented on SPARK-18597: - I also left another comment in

[jira] [Comment Edited] (SPARK-18597) Do not push down filters for LEFT ANTI JOIN

2016-11-28 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702505#comment-15702505 ] Nattavut Sutyanyong edited comment on SPARK-18597 at 11/28/16 5:09 PM:

[jira] [Comment Edited] (SPARK-18597) Do not push down filters for LEFT ANTI JOIN

2016-11-28 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702505#comment-15702505 ] Nattavut Sutyanyong edited comment on SPARK-18597 at 11/28/16 5:09 PM:

[jira] [Comment Edited] (SPARK-18597) Do not push down filters for LEFT ANTI JOIN

2016-11-28 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702505#comment-15702505 ] Nattavut Sutyanyong edited comment on SPARK-18597 at 11/28/16 5:11 PM:

[jira] [Comment Edited] (SPARK-18512) FileNotFoundException on _temporary directory with Spark Streaming 2.0.1 and S3A

2016-11-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702373#comment-15702373 ] Steve Loughran edited comment on SPARK-18512 at 11/28/16 5:54 PM: -

[jira] [Commented] (SPARK-18512) FileNotFoundException on _temporary directory with Spark Streaming 2.0.1 and S3A

2016-11-28 Thread Giuseppe Bonaccorso (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702656#comment-15702656 ] Giuseppe Bonaccorso commented on SPARK-18512: - Thanks! I've already set merge

[jira] [Assigned] (SPARK-18602) Dependency list still shows that the version of org.codehaus.janino:commons-compiler is 2.7.6

2016-11-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-18602: Assignee: Yin Huai > Dependency list still shows that the version of > org.codehaus.janino:common

[jira] [Resolved] (SPARK-18602) Dependency list still shows that the version of org.codehaus.janino:commons-compiler is 2.7.6

2016-11-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-18602. -- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 16025 [https://github.com/

[jira] [Commented] (SPARK-18582) Whitelist LogicalPlan operators allowed in correlated subqueries

2016-11-28 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702684#comment-15702684 ] Nattavut Sutyanyong commented on SPARK-18582: - We shall classify the operator

[jira] [Commented] (SPARK-18582) Whitelist LogicalPlan operators allowed in correlated subqueries

2016-11-28 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702690#comment-15702690 ] Nattavut Sutyanyong commented on SPARK-18582: - For {{Window}} operator, I pro

[jira] [Commented] (SPARK-18492) GeneratedIterator grows beyond 64 KB

2016-11-28 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702760#comment-15702760 ] Kazuaki Ishizaki commented on SPARK-18492: -- I realized that the following code

[jira] [Resolved] (SPARK-16282) Implement percentile SQL function

2016-11-28 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-16282. --- Resolution: Fixed Assignee: Jiang Xingbo Fix Version/s: 2.1.0 > Imple

[jira] [Resolved] (SPARK-17680) Unicode Character Support for Column Names and Comments

2016-11-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-17680. --- Resolution: Fixed Fix Version/s: 2.1.0 Target Version/s: 2.1.0 > Unicode Character S

[jira] [Updated] (SPARK-17680) Unicode Character Support for Column Names and Comments

2016-11-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-17680: -- Assignee: Kazuaki Ishizaki > Unicode Character Support for Column Names and Comments >

[jira] [Reopened] (SPARK-17680) Unicode Character Support for Column Names and Comments

2016-11-28 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-17680: --- > Unicode Character Support for Column Names and Comments > -

[jira] [Assigned] (SPARK-17680) Unicode Character Support for Column Names and Comments

2016-11-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17680: Assignee: Kazuaki Ishizaki (was: Apache Spark) > Unicode Character Support for Column Nam

  1   2   3   >