[jira] [Created] (SPARK-13704) TaskSchedulerImpl.createTaskSetManager can be expensive, and result in lost executors due to blocked heartbeats

2016-03-05 Thread Zhong Wang (JIRA)
Zhong Wang created SPARK-13704: -- Summary: TaskSchedulerImpl.createTaskSetManager can be expensive, and result in lost executors due to blocked heartbeats Key: SPARK-13704 URL:

[jira] [Commented] (SPARK-13699) Spark SQL drops the table in "overwrite" mode while writing into table

2016-03-05 Thread Dhaval Modi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182031#comment-15182031 ] Dhaval Modi commented on SPARK-13699: - TGT_TABLE DDL: CREATE TABLE IF NOT EXISTS tgt_table (col1

[jira] [Commented] (SPARK-13396) Stop using our internal deprecated .metrics on ExceptionFailure instead use accumUpdates

2016-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182029#comment-15182029 ] Apache Spark commented on SPARK-13396: -- User 'GayathriMurali' has created a pull request for this

[jira] [Assigned] (SPARK-13396) Stop using our internal deprecated .metrics on ExceptionFailure instead use accumUpdates

2016-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13396: Assignee: (was: Apache Spark) > Stop using our internal deprecated .metrics on

[jira] [Assigned] (SPARK-13396) Stop using our internal deprecated .metrics on ExceptionFailure instead use accumUpdates

2016-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13396: Assignee: Apache Spark > Stop using our internal deprecated .metrics on ExceptionFailure

[jira] [Comment Edited] (SPARK-12718) SQL generation support for window functions

2016-03-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181967#comment-15181967 ] Xiao Li edited comment on SPARK-12718 at 3/6/16 3:33 AM: - {code} select key,

[jira] [Comment Edited] (SPARK-12718) SQL generation support for window functions

2016-03-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181967#comment-15181967 ] Xiao Li edited comment on SPARK-12718 at 3/6/16 3:28 AM: - {code} select key,

[jira] [Commented] (SPARK-12718) SQL generation support for window functions

2016-03-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181973#comment-15181973 ] Xiao Li commented on SPARK-12718: - Just confirmed that no optimizer rule needs to be added. {code}

[jira] [Commented] (SPARK-12718) SQL generation support for window functions

2016-03-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181967#comment-15181967 ] Xiao Li commented on SPARK-12718: - select key, value, avg(c_int) over (partition by key), sum(c_float)

[jira] [Comment Edited] (SPARK-12718) SQL generation support for window functions

2016-03-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181967#comment-15181967 ] Xiao Li edited comment on SPARK-12718 at 3/6/16 2:59 AM: - {code} select key,

[jira] [Commented] (SPARK-10380) Confusing examples in pyspark SQL docs

2016-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181942#comment-15181942 ] Apache Spark commented on SPARK-10380: -- User 'GayathriMurali' has created a pull request for this

[jira] [Assigned] (SPARK-13703) Remove obsolete scala-2.10 source files

2016-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13703: Assignee: Apache Spark > Remove obsolete scala-2.10 source files >

[jira] [Assigned] (SPARK-13703) Remove obsolete scala-2.10 source files

2016-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13703: Assignee: (was: Apache Spark) > Remove obsolete scala-2.10 source files >

[jira] [Commented] (SPARK-13703) Remove obsolete scala-2.10 source files

2016-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181929#comment-15181929 ] Apache Spark commented on SPARK-13703: -- User 'lresende' has created a pull request for this issue:

[jira] [Created] (SPARK-13703) Remove obsolete scala-2.10 source files

2016-03-05 Thread Luciano Resende (JIRA)
Luciano Resende created SPARK-13703: --- Summary: Remove obsolete scala-2.10 source files Key: SPARK-13703 URL: https://issues.apache.org/jira/browse/SPARK-13703 Project: Spark Issue Type:

[jira] [Commented] (SPARK-13701) MLlib ALS fails on arm64 (java.lang.UnsatisfiedLinkError: org.jblas.NativeBlas.dgemm))

2016-03-05 Thread Santiago M. Mola (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181921#comment-15181921 ] Santiago M. Mola commented on SPARK-13701: -- This is probably just gfortran not being installed?

[jira] [Commented] (SPARK-13699) Spark SQL drops the table in "overwrite" mode while writing into table

2016-03-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181916#comment-15181916 ] Xiao Li commented on SPARK-13699: - [~mysti] Could you show the script how you create the original

[jira] [Assigned] (SPARK-13702) Use diamond operator for generic instance creation in Java code

2016-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13702: Assignee: Apache Spark > Use diamond operator for generic instance creation in Java code

[jira] [Commented] (SPARK-13702) Use diamond operator for generic instance creation in Java code

2016-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181913#comment-15181913 ] Apache Spark commented on SPARK-13702: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-13702) Use diamond operator for generic instance creation in Java code

2016-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13702: Assignee: (was: Apache Spark) > Use diamond operator for generic instance creation in

[jira] [Updated] (SPARK-13702) Use diamond operator for generic instance creation in Java code

2016-03-05 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-13702: -- Description: Java 7 or higher supports `diamond` operator which replaces the type arguments

[jira] [Created] (SPARK-13702) Use diamond operator for generic instance creation in Java code

2016-03-05 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-13702: - Summary: Use diamond operator for generic instance creation in Java code Key: SPARK-13702 URL: https://issues.apache.org/jira/browse/SPARK-13702 Project: Spark

[jira] [Created] (SPARK-13701) MLlib ALS fails on arm64 (java.lang.UnsatisfiedLinkError: org.jblas.NativeBlas.dgemm))

2016-03-05 Thread Santiago M. Mola (JIRA)
Santiago M. Mola created SPARK-13701: Summary: MLlib ALS fails on arm64 (java.lang.UnsatisfiedLinkError: org.jblas.NativeBlas.dgemm)) Key: SPARK-13701 URL: https://issues.apache.org/jira/browse/SPARK-13701

[jira] [Resolved] (SPARK-13693) Flaky test: o.a.s.streaming.MapWithStateSuite

2016-03-05 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-13693. -- Resolution: Fixed Fix Version/s: 2.0.0 > Flaky test: o.a.s.streaming.MapWithStateSuite

[jira] [Commented] (SPARK-13641) getModelFeatures of ml.api.r.SparkRWrapper cannot (always) reveal the original column names

2016-03-05 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181872#comment-15181872 ] Xusen Yin commented on SPARK-13641: --- You can checkout code from

[jira] [Updated] (SPARK-3151) DiskStore attempts to map any size BlockId without checking MappedByteBuffer limit

2016-03-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-3151: -- Component/s: Block Manager > DiskStore attempts to map any size BlockId without checking

[jira] [Updated] (SPARK-8790) BlockManager.reregister cause OOM

2016-03-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8790: -- Component/s: Block Manager > BlockManager.reregister cause OOM > - > >

[jira] [Updated] (SPARK-1762) Add functionality to pin RDDs in cache

2016-03-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-1762: -- Component/s: Block Manager > Add functionality to pin RDDs in cache >

[jira] [Updated] (SPARK-12076) countDistinct behaves inconsistently

2016-03-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-12076: --- Component/s: (was: Spark Core) SQL > countDistinct behaves inconsistently >

[jira] [Commented] (SPARK-13365) should coalesce do anything if coalescing to same number of partitions without shuffle

2016-03-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181827#comment-15181827 ] Josh Rosen commented on SPARK-13365: If coalesce is called with {{shuffle == true}} then we might

[jira] [Updated] (SPARK-13352) BlockFetch does not scale well on large block

2016-03-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-13352: --- Component/s: Block Manager > BlockFetch does not scale well on large block >

[jira] [Updated] (SPARK-13700) Rdd.mapAsync(): Easily mix Spark and asynchroneous transformation

2016-03-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-13700: --- Target Version/s: (was: 1.6.0) > Rdd.mapAsync(): Easily mix Spark and asynchroneous transformation

[jira] [Updated] (SPARK-13700) Rdd.mapAsync(): Easily mix Spark and asynchroneous transformation

2016-03-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-13700: --- Affects Version/s: (was: 1.6.0) > Rdd.mapAsync(): Easily mix Spark and asynchroneous

[jira] [Commented] (SPARK-13641) getModelFeatures of ml.api.r.SparkRWrapper cannot (always) reveal the original column names

2016-03-05 Thread Gayathri Murali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181819#comment-15181819 ] Gayathri Murali commented on SPARK-13641: - [~xusen] Can you list the steps to reproduce the bug?

[jira] [Updated] (SPARK-13700) Rdd.mapAsync(): Easily mix Spark and asynchroneous transformation

2016-03-05 Thread Paulo Costa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paulo Costa updated SPARK-13700: Description: Spark is great for synchronous operations. But sometimes I need to call a

[jira] [Created] (SPARK-13700) Rdd.mapAsync(): Easily mix Spark and asynchroneous transformation

2016-03-05 Thread Paulo Costa (JIRA)
Paulo Costa created SPARK-13700: --- Summary: Rdd.mapAsync(): Easily mix Spark and asynchroneous transformation Key: SPARK-13700 URL: https://issues.apache.org/jira/browse/SPARK-13700 Project: Spark

[jira] [Commented] (SPARK-13699) Spark SQL drops the table in "overwrite" mode while writing into table

2016-03-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181804#comment-15181804 ] Xiao Li commented on SPARK-13699: - After a research, we can NOT truncate the table if the table is

[jira] [Commented] (SPARK-13699) Spark SQL drops the table in "overwrite" mode while writing into table

2016-03-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181791#comment-15181791 ] Xiao Li commented on SPARK-13699: - Now, I see your points. Will take a look at it. Thanks! > Spark SQL

[jira] [Commented] (SPARK-13230) HashMap.merged not working properly with Spark

2016-03-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181790#comment-15181790 ] Łukasz Gieroń commented on SPARK-13230: --- A good workaround is to use Kryo serializer. I've checked

[jira] [Comment Edited] (SPARK-13699) Spark SQL drops the table in "overwrite" mode while writing into table

2016-03-05 Thread Dhaval Modi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181780#comment-15181780 ] Dhaval Modi edited comment on SPARK-13699 at 3/5/16 5:30 PM: -

[jira] [Comment Edited] (SPARK-13699) Spark SQL drops the table in "overwrite" mode while writing into table

2016-03-05 Thread Dhaval Modi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181780#comment-15181780 ] Dhaval Modi edited comment on SPARK-13699 at 3/5/16 5:30 PM: -

[jira] [Comment Edited] (SPARK-13699) Spark SQL drops the table in "overwrite" mode while writing into table

2016-03-05 Thread Dhaval Modi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181780#comment-15181780 ] Dhaval Modi edited comment on SPARK-13699 at 3/5/16 5:29 PM: -

[jira] [Commented] (SPARK-13699) Spark SQL drops the table in "overwrite" mode while writing into table

2016-03-05 Thread Dhaval Modi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181780#comment-15181780 ] Dhaval Modi commented on SPARK-13699: - == Code Snippet

[jira] [Commented] (SPARK-13699) Spark SQL drops the table in "overwrite" mode while writing into table

2016-03-05 Thread Dhaval Modi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181777#comment-15181777 ] Dhaval Modi commented on SPARK-13699: - This should be a bug, as it fails to overwrite the table,

[jira] [Updated] (SPARK-13699) Spark SQL drops the table in "overwrite" mode while writing into table

2016-03-05 Thread Dhaval Modi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dhaval Modi updated SPARK-13699: Attachment: stackTrace.txt > Spark SQL drops the table in "overwrite" mode while writing into

[jira] [Updated] (SPARK-13699) Spark SQL drops the table in "overwrite" mode while writing into table

2016-03-05 Thread Dhaval Modi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dhaval Modi updated SPARK-13699: Description: Hi, While writing the dataframe to HIVE table with "SaveMode.Overwrite" option.

[jira] [Commented] (SPARK-7505) Update PySpark DataFrame docs: encourage __getitem__, mark as experimental, etc.

2016-03-05 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181776#comment-15181776 ] Nicholas Chammas commented on SPARK-7505: - I believe items 1, 3, and 4 still apply. They're minor

[jira] [Updated] (SPARK-13699) Spark SQL drops the HIVE table in "overwrite" mode while writing into table

2016-03-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13699: Issue Type: Improvement (was: Bug) > Spark SQL drops the HIVE table in "overwrite" mode while writing

[jira] [Updated] (SPARK-13699) Spark SQL drops the table in "overwrite" mode while writing into table

2016-03-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13699: Summary: Spark SQL drops the table in "overwrite" mode while writing into table (was: Spark SQL drops the

[jira] [Updated] (SPARK-13699) Spark SQL drops the HIVE table in "overwrite" mode while writing into table

2016-03-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13699: Priority: Major (was: Blocker) > Spark SQL drops the HIVE table in "overwrite" mode while writing into

[jira] [Commented] (SPARK-13699) Spark SQL drops the HIVE table in "overwrite" mode while writing into table

2016-03-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181752#comment-15181752 ] Xiao Li commented on SPARK-13699: - So far, this is by design. Thus, it is hard to say it is a bug.

[jira] [Issue Comment Deleted] (SPARK-13699) Spark SQL drops the HIVE table in "overwrite" mode while writing into table

2016-03-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13699: Comment: was deleted (was: In RDBMS, I know truncate is much faster than drop-and-then-recreate due to

[jira] [Commented] (SPARK-13699) Spark SQL drops the HIVE table in "overwrite" mode while writing into table

2016-03-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181750#comment-15181750 ] Xiao Li commented on SPARK-13699: - In RDBMS, I know truncate is much faster than drop-and-then-recreate

[jira] [Updated] (SPARK-13699) Spark SQL drops the HIVE table in "overwrite" mode while writing into table

2016-03-05 Thread Dhaval Modi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dhaval Modi updated SPARK-13699: Summary: Spark SQL drops the HIVE table in "overwrite" mode while writing into table (was: Spark

[jira] [Created] (SPARK-13699) Spark SQL drop the table in "overwrite" mode while writing into table

2016-03-05 Thread Dhaval Modi (JIRA)
Dhaval Modi created SPARK-13699: --- Summary: Spark SQL drop the table in "overwrite" mode while writing into table Key: SPARK-13699 URL: https://issues.apache.org/jira/browse/SPARK-13699 Project: Spark

[jira] [Updated] (SPARK-13692) Fix trivial Coverity/Checkstyle defects

2016-03-05 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-13692: -- Description: This issue fixes the following potential bugs and Java coding style detected by

[jira] [Updated] (SPARK-12720) SQL generation support for cube, rollup, and grouping set

2016-03-05 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12720: --- Fix Version/s: 2.0.0 > SQL generation support for cube, rollup, and grouping set >

[jira] [Resolved] (SPARK-12720) SQL generation support for cube, rollup, and grouping set

2016-03-05 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-12720. Resolution: Fixed Resolved by https://github.com/apache/spark/pull/11283 > SQL generation support

[jira] [Commented] (SPARK-13616) Let SQLBuilder convert logical plan without a Project on top of it

2016-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181674#comment-15181674 ] Apache Spark commented on SPARK-13616: -- User 'liancheng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13698) Fix Analysis Exceptions when Using Backticks in Generate

2016-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13698: Assignee: Apache Spark > Fix Analysis Exceptions when Using Backticks in Generate >

[jira] [Commented] (SPARK-13698) Fix Analysis Exceptions when Using Backticks in Generate

2016-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181657#comment-15181657 ] Apache Spark commented on SPARK-13698: -- User 'dilipbiswal' has created a pull request for this

[jira] [Assigned] (SPARK-13698) Fix Analysis Exceptions when Using Backticks in Generate

2016-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13698: Assignee: (was: Apache Spark) > Fix Analysis Exceptions when Using Backticks in

[jira] [Created] (SPARK-13698) Fix Analysis Exceptions when Using Backticks in Generate

2016-03-05 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-13698: Summary: Fix Analysis Exceptions when Using Backticks in Generate Key: SPARK-13698 URL: https://issues.apache.org/jira/browse/SPARK-13698 Project: Spark

[jira] [Commented] (SPARK-13616) Let SQLBuilder convert logical plan without a Project on top of it

2016-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181651#comment-15181651 ] Apache Spark commented on SPARK-13616: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13629) Add binary toggle Param to CountVectorizer

2016-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13629: Assignee: (was: Apache Spark) > Add binary toggle Param to CountVectorizer >

[jira] [Commented] (SPARK-13629) Add binary toggle Param to CountVectorizer

2016-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181648#comment-15181648 ] Apache Spark commented on SPARK-13629: -- User 'hhbyyh' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13629) Add binary toggle Param to CountVectorizer

2016-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13629: Assignee: Apache Spark > Add binary toggle Param to CountVectorizer >

[jira] [Commented] (SPARK-13684) Possible unsafe bytesRead increment in StreamInterceptor

2016-03-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181647#comment-15181647 ] Sean Owen commented on SPARK-13684: --- Hm OK this turns out to be a non-issue. I guess I think it's worth

[jira] [Commented] (SPARK-13691) Scala and Python generate inconsistent results

2016-03-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181640#comment-15181640 ] Sean Owen commented on SPARK-13691: --- I think this is just a language difference? Although changing it

[jira] [Assigned] (SPARK-13697) TransformFunctionSerializer.loads doesn't restore the function's module name if it's '__main__'

2016-03-05 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reassigned SPARK-13697: Assignee: Shixiong Zhu > TransformFunctionSerializer.loads doesn't restore the function's

[jira] [Reopened] (SPARK-13523) Reuse the exchanges in a query

2016-03-05 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reopened SPARK-13523: SPARK-11838 is different than this, that is about cache fragment across queries. > Reuse the

[jira] [Assigned] (SPARK-13523) Reuse the exchanges in a query

2016-03-05 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-13523: -- Assignee: Davies Liu > Reuse the exchanges in a query > -- > >

[jira] [Assigned] (SPARK-13697) TransformFunctionSerializer.loads doesn't restore the function's module name if it's '__main__'

2016-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13697: Assignee: (was: Apache Spark) > TransformFunctionSerializer.loads doesn't restore the

[jira] [Assigned] (SPARK-13697) TransformFunctionSerializer.loads doesn't restore the function's module name if it's '__main__'

2016-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13697: Assignee: Apache Spark > TransformFunctionSerializer.loads doesn't restore the function's

[jira] [Commented] (SPARK-13697) TransformFunctionSerializer.loads doesn't restore the function's module name if it's '__main__'

2016-03-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181632#comment-15181632 ] Apache Spark commented on SPARK-13697: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Created] (SPARK-13697) TransformFunctionSerializer.loads doesn't restore the function's module name if it's '__main__'

2016-03-05 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-13697: Summary: TransformFunctionSerializer.loads doesn't restore the function's module name if it's '__main__' Key: SPARK-13697 URL: https://issues.apache.org/jira/browse/SPARK-13697