[jira] [Created] (SPARK-13537) Fix readBytes in VectorizedPlainValuesReader

2016-02-28 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-13537: --- Summary: Fix readBytes in VectorizedPlainValuesReader Key: SPARK-13537 URL: https://issues.apache.org/jira/browse/SPARK-13537 Project: Spark Issue Type

[jira] [Assigned] (SPARK-13537) Fix readBytes in VectorizedPlainValuesReader

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13537: Assignee: (was: Apache Spark) > Fix readBytes in VectorizedPlainValuesReader > ---

[jira] [Commented] (SPARK-13537) Fix readBytes in VectorizedPlainValuesReader

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15170966#comment-15170966 ] Apache Spark commented on SPARK-13537: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-13537) Fix readBytes in VectorizedPlainValuesReader

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13537: Assignee: Apache Spark > Fix readBytes in VectorizedPlainValuesReader > --

[jira] [Updated] (SPARK-13532) Spark yarn executor container fails if yarn.nodemanager.local-dirs starts with file://

2016-02-28 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated SPARK-13532: Description: Spark yarn executor container fails if yarn.nodemanager.local-dirs sta

[jira] [Commented] (SPARK-13532) Spark yarn executor container fails if yarn.nodemanager.local-dirs starts with file://

2016-02-28 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15170974#comment-15170974 ] Alexander Pivovarov commented on SPARK-13532: - added spark-shell stack trace

[jira] [Commented] (SPARK-13493) json to DataFrame to parquet does not respect case sensitiveness

2016-02-28 Thread Zuo Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171014#comment-15171014 ] Zuo Wang commented on SPARK-13493: -- The root cause is that InferSchema is not aware of c

[jira] [Created] (SPARK-13538) Add GaussianMixture to ML

2016-02-28 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-13538: Summary: Add GaussianMixture to ML Key: SPARK-13538 URL: https://issues.apache.org/jira/browse/SPARK-13538 Project: Spark Issue Type: Improvement C

[jira] [Commented] (SPARK-13538) Add GaussianMixture to ML

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171025#comment-15171025 ] Apache Spark commented on SPARK-13538: -- User 'zhengruifeng' has created a pull reque

[jira] [Assigned] (SPARK-13538) Add GaussianMixture to ML

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13538: Assignee: Apache Spark > Add GaussianMixture to ML > - > >

[jira] [Assigned] (SPARK-13538) Add GaussianMixture to ML

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13538: Assignee: (was: Apache Spark) > Add GaussianMixture to ML > -

[jira] [Commented] (SPARK-13534) Implement Apache Arrow serializer for Spark DataFrame for use in DataFrame.toPandas

2016-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171029#comment-15171029 ] Sean Owen commented on SPARK-13534: --- [~wesmckinn] there's already https://issues.apache

[jira] [Created] (SPARK-13539) Python in worker has different version 2.7 than that in driver 3.5, PySpark cannot run with different minor versions

2016-02-28 Thread Hossein Vatani (JIRA)
Hossein Vatani created SPARK-13539: -- Summary: Python in worker has different version 2.7 than that in driver 3.5, PySpark cannot run with different minor versions Key: SPARK-13539 URL: https://issues.apache.org/j

[jira] [Updated] (SPARK-13539) Python in worker has different version 2.7 than that in driver 3.5, PySpark cannot run with different minor versions

2016-02-28 Thread Hossein Vatani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hossein Vatani updated SPARK-13539: --- Description: Hi, I faced below exception when I tried to run http://spark.apache.org/docs/la

[jira] [Updated] (SPARK-13539) Python in worker has different version 2.7 than that in driver 3.5, PySpark cannot run with different minor versions

2016-02-28 Thread Hossein Vatani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hossein Vatani updated SPARK-13539: --- Description: Hi, I faced below exception when I tried to run http://spark.apache.org/docs/la

[jira] [Assigned] (SPARK-13493) json to DataFrame to parquet does not respect case sensitiveness

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13493: Assignee: Apache Spark > json to DataFrame to parquet does not respect case sensitiveness

[jira] [Commented] (SPARK-13493) json to DataFrame to parquet does not respect case sensitiveness

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171066#comment-15171066 ] Apache Spark commented on SPARK-13493: -- User 'zuowang' has created a pull request fo

[jira] [Assigned] (SPARK-13493) json to DataFrame to parquet does not respect case sensitiveness

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13493: Assignee: (was: Apache Spark) > json to DataFrame to parquet does not respect case sen

[jira] [Resolved] (SPARK-13539) Python in worker has different version 2.7 than that in driver 3.5, PySpark cannot run with different minor versions

2016-02-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13539. --- Resolution: Invalid Fix Version/s: (was: 1.6.0) Please ask questions on user@, and read h

[jira] [Created] (SPARK-13540) Scala object can't be added to OuterScopes

2016-02-28 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13540: -- Summary: Scala object can't be added to OuterScopes Key: SPARK-13540 URL: https://issues.apache.org/jira/browse/SPARK-13540 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-13540) Scala object can't be added to OuterScopes

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13540: Assignee: Apache Spark > Scala object can't be added to OuterScopes >

[jira] [Assigned] (SPARK-13540) Scala object can't be added to OuterScopes

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13540: Assignee: (was: Apache Spark) > Scala object can't be added to OuterScopes > -

[jira] [Commented] (SPARK-13540) Scala object can't be added to OuterScopes

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171090#comment-15171090 ] Apache Spark commented on SPARK-13540: -- User 'liancheng' has created a pull request

[jira] [Updated] (SPARK-13540) Scala object can't be added to OuterScopes

2016-02-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13540: --- Assignee: Cheng Lian Affects Version/s: 2.0.0 Target Version/s: 2.0.0 Comp

[jira] [Updated] (SPARK-13540) Scala object can't be added to OuterScopes

2016-02-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13540: --- Description: Add the following test case to {{DatasetSuite}} to reproduce this issue: {code} object O

[jira] [Updated] (SPARK-13540) Nested classes within Scala objects can't be used as Dataset element type

2016-02-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13540: --- Summary: Nested classes within Scala objects can't be used as Dataset element type (was: Scala objec

[jira] [Assigned] (SPARK-13415) Visualize subquery in SQL web UI

2016-02-28 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-13415: -- Assignee: Davies Liu > Visualize subquery in SQL web UI > > >

[jira] [Commented] (SPARK-13415) Visualize subquery in SQL web UI

2016-02-28 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171215#comment-15171215 ] Davies Liu commented on SPARK-13415: [~nongli] Since the test failed in vectorized

[jira] [Created] (SPARK-13541) Flaky test: ParquetHadoopFsRelationSuite.test all data types - ByteType

2016-02-28 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13541: -- Summary: Flaky test: ParquetHadoopFsRelationSuite.test all data types - ByteType Key: SPARK-13541 URL: https://issues.apache.org/jira/browse/SPARK-13541 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-13415) Visualize subquery in SQL web UI

2016-02-28 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13415: --- Comment: was deleted (was: [~nongli] Since the test failed in vectorized parquet reader, so I assig

[jira] [Commented] (SPARK-13541) Flaky test: ParquetHadoopFsRelationSuite.test all data types - ByteType

2016-02-28 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171216#comment-15171216 ] Davies Liu commented on SPARK-13541: [~nongli] Since the test failed in vectorized

[jira] [Created] (SPARK-13542) Fix HiveInspectors.unwrap (Hive suite failures)

2016-02-28 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created SPARK-13542: Summary: Fix HiveInspectors.unwrap (Hive suite failures) Key: SPARK-13542 URL: https://issues.apache.org/jira/browse/SPARK-13542 Project: Spark Issue

[jira] [Commented] (SPARK-13534) Implement Apache Arrow serializer for Spark DataFrame for use in DataFrame.toPandas

2016-02-28 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171273#comment-15171273 ] Wes McKinney commented on SPARK-13534: -- SPARK-13391 would need to have its scope mor

[jira] [Commented] (SPARK-13463) Support Column pruning for Dataset logical plan

2016-02-28 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171280#comment-15171280 ] Xiao Li commented on SPARK-13463: - When using the current external DataSet APIs, I am una

[jira] [Resolved] (SPARK-13529) Move network/* modules into common/network-*

2016-02-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13529. - Resolution: Fixed Fix Version/s: 2.0.0 > Move network/* modules into common/network-* > --

[jira] [Commented] (SPARK-13496) Optimizing count distinct changes the resulting column name

2016-02-28 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171289#comment-15171289 ] Xiao Li commented on SPARK-13496: - If you use the latest Spark 2.0 upstream, you will not

[jira] [Commented] (SPARK-13525) SparkR: java.net.SocketTimeoutException: Accept timed out when running any dataframe function

2016-02-28 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171294#comment-15171294 ] Sun Rui commented on SPARK-13525: - Is the path of your Rscript in $PATH? If not, you can

[jira] [Commented] (SPARK-13337) DataFrame join-on-columns function should support null-safe equal

2016-02-28 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171297#comment-15171297 ] Xiao Li commented on SPARK-13337: - df1.join(df2, $"df1Key" <=> $"df2Key", "outer").select

[jira] [Commented] (SPARK-13341) Casting Unix timestamp to SQL timestamp fails

2016-02-28 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171300#comment-15171300 ] Xiao Li commented on SPARK-13341: - Yeah. To get a correct answer, you just need to remove

[jira] [Commented] (SPARK-13510) Shuffle may throw FetchFailedException: Direct buffer memory

2016-02-28 Thread Hong Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171330#comment-15171330 ] Hong Shen commented on SPARK-13510: --- Add more log, fetch a block of 915.4 MB. 16/02/17

[jira] [Commented] (SPARK-13532) Spark yarn executor container fails if yarn.nodemanager.local-dirs starts with file://

2016-02-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171339#comment-15171339 ] Jeff Zhang commented on SPARK-13532: Could you attach the yarn logs, it may be the is

[jira] [Commented] (SPARK-13531) Some DataFrame joins stopped working with UnsupportedOperationException: No size estimation available for objects

2016-02-28 Thread Zuo Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171354#comment-15171354 ] Zuo Wang commented on SPARK-13531: -- Unable to reproduce, here is my steps in spark-shell

[jira] [Created] (SPARK-13543) Support for specifying compression codec for Parquet/ORC via option()

2016-02-28 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-13543: Summary: Support for specifying compression codec for Parquet/ORC via option() Key: SPARK-13543 URL: https://issues.apache.org/jira/browse/SPARK-13543 Project: Spark

[jira] [Commented] (SPARK-13543) Support for specifying compression codec for Parquet/ORC via option()

2016-02-28 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171365#comment-15171365 ] Hyukjin Kwon commented on SPARK-13543: -- I will work on this as soon as the PRs I sub

[jira] [Commented] (SPARK-13341) Casting Unix timestamp to SQL timestamp fails

2016-02-28 Thread Linbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171364#comment-15171364 ] Linbo commented on SPARK-13341: --- Inside org.apache.spark.sql.catalyst.expressions.Cast, the

[jira] [Comment Edited] (SPARK-13341) Casting Unix timestamp to SQL timestamp fails

2016-02-28 Thread Linbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171364#comment-15171364 ] Linbo edited comment on SPARK-13341 at 2/29/16 3:33 AM: Inside or

[jira] [Comment Edited] (SPARK-13341) Casting Unix timestamp to SQL timestamp fails

2016-02-28 Thread Linbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171364#comment-15171364 ] Linbo edited comment on SPARK-13341 at 2/29/16 3:33 AM: Inside or

[jira] [Commented] (SPARK-13543) Support for specifying compression codec for Parquet/ORC via option()

2016-02-28 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171370#comment-15171370 ] Hyukjin Kwon commented on SPARK-13543: -- I added this link (SPARK-12307) as a {{relat

[jira] [Comment Edited] (SPARK-13341) Casting Unix timestamp to SQL timestamp fails

2016-02-28 Thread Linbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171364#comment-15171364 ] Linbo edited comment on SPARK-13341 at 2/29/16 3:34 AM: Inside or

[jira] [Comment Edited] (SPARK-13341) Casting Unix timestamp to SQL timestamp fails

2016-02-28 Thread Linbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171364#comment-15171364 ] Linbo edited comment on SPARK-13341 at 2/29/16 3:37 AM: Inside or

[jira] [Created] (SPARK-13544) Rewrite/Propagate constraints for Aliases in Aggregate and Windows

2016-02-28 Thread Xiao Li (JIRA)
Xiao Li created SPARK-13544: --- Summary: Rewrite/Propagate constraints for Aliases in Aggregate and Windows Key: SPARK-13544 URL: https://issues.apache.org/jira/browse/SPARK-13544 Project: Spark Iss

[jira] [Assigned] (SPARK-13544) Rewrite/Propagate constraints for Aliases in Aggregate and Windows

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13544: Assignee: Apache Spark > Rewrite/Propagate constraints for Aliases in Aggregate and Window

[jira] [Commented] (SPARK-13544) Rewrite/Propagate constraints for Aliases in Aggregate and Windows

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171391#comment-15171391 ] Apache Spark commented on SPARK-13544: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-13544) Rewrite/Propagate constraints for Aliases in Aggregate and Windows

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13544: Assignee: (was: Apache Spark) > Rewrite/Propagate constraints for Aliases in Aggregate

[jira] [Updated] (SPARK-13542) Fix HiveInspectors.unwrap

2016-02-28 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated SPARK-13542: - Summary: Fix HiveInspectors.unwrap (was: Fix HiveInspectors.unwrap (Hive suite failures)

[jira] [Commented] (SPARK-13398) Move away from deprecated ThreadPoolTaskSupport

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171415#comment-15171415 ] Apache Spark commented on SPARK-13398: -- User 'holdenk' has created a pull request fo

[jira] [Resolved] (SPARK-13537) Fix readBytes in VectorizedPlainValuesReader

2016-02-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13537. - Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.0.0 > Fix readBytes

[jira] [Commented] (SPARK-13531) Some DataFrame joins stopped working with UnsupportedOperationException: No size estimation available for objects

2016-02-28 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171420#comment-15171420 ] koert kuipers commented on SPARK-13531: --- can you try this? {noformat} val df1 = sc.

[jira] [Created] (SPARK-13545) Make MLlib LR's default parameters consistent in Scala and Python

2016-02-28 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13545: --- Summary: Make MLlib LR's default parameters consistent in Scala and Python Key: SPARK-13545 URL: https://issues.apache.org/jira/browse/SPARK-13545 Project: Spark

[jira] [Assigned] (SPARK-13545) Make MLlib LR's default parameters consistent in Scala and Python

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13545: Assignee: Apache Spark > Make MLlib LR's default parameters consistent in Scala and Python

[jira] [Assigned] (SPARK-13545) Make MLlib LR's default parameters consistent in Scala and Python

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13545: Assignee: (was: Apache Spark) > Make MLlib LR's default parameters consistent in Scala

[jira] [Commented] (SPARK-13545) Make MLlib LR's default parameters consistent in Scala and Python

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171433#comment-15171433 ] Apache Spark commented on SPARK-13545: -- User 'yanboliang' has created a pull request

[jira] [Created] (SPARK-13546) GBT with many trees consistently giving java.lang.StackOverflowError

2016-02-28 Thread Glen Maisey (JIRA)
Glen Maisey created SPARK-13546: --- Summary: GBT with many trees consistently giving java.lang.StackOverflowError Key: SPARK-13546 URL: https://issues.apache.org/jira/browse/SPARK-13546 Project: Spark

[jira] [Updated] (SPARK-13545) Make MLlib LogisticRegressionWithLBFGS's default parameters consistent in Scala and Python

2016-02-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13545: Summary: Make MLlib LogisticRegressionWithLBFGS's default parameters consistent in Scala and Python

[jira] [Updated] (SPARK-13545) Make MLlib LogisticRegressionWithLBFGS's default parameters consistent in Scala and Python

2016-02-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13545: Description: * The default value of regParam of PySpark MLlib LogisticRegressionWithLBFGS should b

[jira] [Updated] (SPARK-13546) GBT with many trees consistently giving java.lang.StackOverflowError

2016-02-28 Thread Glen Maisey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Maisey updated SPARK-13546: Attachment: iris.csv Iris dataset used to reproduce. > GBT with many trees consistently giving jav

[jira] [Comment Edited] (SPARK-13546) GBT with many trees consistently giving java.lang.StackOverflowError

2016-02-28 Thread Glen Maisey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171467#comment-15171467 ] Glen Maisey edited comment on SPARK-13546 at 2/29/16 6:18 AM: -

[jira] [Created] (SPARK-13547) No sql query in sql tab in spark ui

2016-02-28 Thread Jeff Zhang (JIRA)
Jeff Zhang created SPARK-13547: -- Summary: No sql query in sql tab in spark ui Key: SPARK-13547 URL: https://issues.apache.org/jira/browse/SPARK-13547 Project: Spark Issue Type: Bug Com

[jira] [Updated] (SPARK-13547) No sql query in sql tab in spark ui

2016-02-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-13547: --- Priority: Minor (was: Major) > No sql query in sql tab in spark ui > ---

[jira] [Updated] (SPARK-13547) No sql query in sql tab in spark ui

2016-02-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-13547: --- Attachment: screenshot-1.png > No sql query in sql tab in spark ui >

[jira] [Updated] (SPARK-13448) Document MLlib behavior changes in Spark 2.0

2016-02-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13448: Description: This JIRA keeps a list of MLlib behavior changes in Spark 2.0. So we can remember to

[jira] [Updated] (SPARK-13544) Rewrite/Propagate constraints for Aliases in Aggregate

2016-02-28 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13544: Description: After plan analysis by Analyzer, two operators could have alias. They are Project and Aggregat

[jira] [Updated] (SPARK-13544) Rewrite/Propagate constraints for Aliases in Aggregate

2016-02-28 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13544: Summary: Rewrite/Propagate constraints for Aliases in Aggregate (was: Rewrite/Propagate constraints for Al

[jira] [Updated] (SPARK-13547) No sql query in sql tab in spark ui

2016-02-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-13547: --- Issue Type: Improvement (was: Bug) > No sql query in sql tab in spark ui > -

[jira] [Updated] (SPARK-13547) No sql query in sql tab in spark ui

2016-02-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-13547: --- Description: It would be nice to have the sql query in sql tab > No sql query in sql tab in spark ui

[jira] [Updated] (SPARK-13448) Document MLlib behavior changes in Spark 2.0

2016-02-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13448: Description: This JIRA keeps a list of MLlib behavior changes in Spark 2.0. So we can remember to

[jira] [Updated] (SPARK-13448) Document MLlib behavior changes in Spark 2.0

2016-02-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13448: Description: This JIRA keeps a list of MLlib behavior changes in Spark 2.0. So we can remember to

[jira] [Updated] (SPARK-13448) Document MLlib behavior changes in Spark 2.0

2016-02-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13448: Description: This JIRA keeps a list of MLlib behavior changes in Spark 2.0. So we can remember to

[jira] [Updated] (SPARK-13448) Document MLlib behavior changes in Spark 2.0

2016-02-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13448: Description: This JIRA keeps a list of MLlib behavior changes in Spark 2.0. So we can remember to

[jira] [Updated] (SPARK-13448) Document MLlib behavior changes in Spark 2.0

2016-02-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13448: Description: This JIRA keeps a list of MLlib behavior changes in Spark 2.0. So we can remember to

[jira] [Updated] (SPARK-13448) Document MLlib behavior changes in Spark 2.0

2016-02-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13448: Description: This JIRA keeps a list of MLlib behavior changes in Spark 2.0. So we can remember to

[jira] [Updated] (SPARK-13448) Document MLlib behavior changes in Spark 2.0

2016-02-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13448: Description: This JIRA keeps a list of MLlib behavior changes in Spark 2.0. So we can remember to

[jira] [Updated] (SPARK-13448) Document MLlib behavior changes in Spark 2.0

2016-02-28 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13448: Description: This JIRA keeps a list of MLlib behavior changes in Spark 2.0. So we can remember to

[jira] [Updated] (SPARK-12941) Spark-SQL JDBC Oracle dialect fails to map string datatypes to Oracle VARCHAR datatype

2016-02-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12941: - Fix Version/s: 1.6.2 > Spark-SQL JDBC Oracle dialect fails to map string datatypes to Oracle VARCHAR > d

[jira] [Created] (SPARK-13548) Move tags and unsafe modules into common

2016-02-28 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-13548: --- Summary: Move tags and unsafe modules into common Key: SPARK-13548 URL: https://issues.apache.org/jira/browse/SPARK-13548 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-13548) Move tags and unsafe modules into common

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13548: Assignee: Reynold Xin (was: Apache Spark) > Move tags and unsafe modules into common > --

[jira] [Commented] (SPARK-13548) Move tags and unsafe modules into common

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171512#comment-15171512 ] Apache Spark commented on SPARK-13548: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-13548) Move tags and unsafe modules into common

2016-02-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13548: Assignee: Apache Spark (was: Reynold Xin) > Move tags and unsafe modules into common > --

[jira] [Resolved] (SPARK-13309) Incorrect type inference for CSV data.

2016-02-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13309. - Resolution: Fixed Assignee: Rahul Tanwani Fix Version/s: 2.0.0 > Incorrect type i

[jira] [Created] (SPARK-13549) Refactor the Optimizer Rule CollapseProject

2016-02-28 Thread Xiao Li (JIRA)
Xiao Li created SPARK-13549: --- Summary: Refactor the Optimizer Rule CollapseProject Key: SPARK-13549 URL: https://issues.apache.org/jira/browse/SPARK-13549 Project: Spark Issue Type: Improvement