[jira] [Assigned] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15245: Assignee: Apache Spark > stream API throws an exception with an incorrect message when

[jira] [Commented] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277647#comment-15277647 ] Apache Spark commented on SPARK-15245: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15245: Assignee: (was: Apache Spark) > stream API throws an exception with an incorrect

[jira] [Created] (SPARK-15245) stream API throws an exception with an incorrect message when the path is not a direcotry

2016-05-09 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-15245: Summary: stream API throws an exception with an incorrect message when the path is not a direcotry Key: SPARK-15245 URL: https://issues.apache.org/jira/browse/SPARK-15245

[jira] [Updated] (SPARK-15207) Use Travis CI for Java Linter and JDK7/8 compilation test

2016-05-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15207: -- Description: Currently, Java Linter is disabled in Jenkins tests.

[jira] [Updated] (SPARK-15207) Use Travis CI for Java Linter and JDK7/8 compilation test

2016-05-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15207: -- Description: Currently, Java Linter is disabled in Jenkins tests.

[jira] [Commented] (SPARK-15218) Error: Could not find or load main class org.apache.spark.launcher.Main when run from a directory containing colon ':'

2016-05-09 Thread Adam Cecile (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277610#comment-15277610 ] Adam Cecile commented on SPARK-15218: - Hello, Good catch, this mesos bug should fix my issue. I'm

[jira] [Commented] (SPARK-15204) Improve nullability inference for Aggregator

2016-05-09 Thread Koert Kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277600#comment-15277600 ] Koert Kuipers commented on SPARK-15204: --- Makes sense > Improve nullability inference for

[jira] [Created] (SPARK-15244) Type of column name created with sqlContext.createDataFrame() is not consistent.

2016-05-09 Thread Kazuki Yokoishi (JIRA)
Kazuki Yokoishi created SPARK-15244: --- Summary: Type of column name created with sqlContext.createDataFrame() is not consistent. Key: SPARK-15244 URL: https://issues.apache.org/jira/browse/SPARK-15244

[jira] [Created] (SPARK-15243) Binarizer.explainParam(u"...") raises ValueError

2016-05-09 Thread Kazuki Yokoishi (JIRA)
Kazuki Yokoishi created SPARK-15243: --- Summary: Binarizer.explainParam(u"...") raises ValueError Key: SPARK-15243 URL: https://issues.apache.org/jira/browse/SPARK-15243 Project: Spark Issue

[jira] [Closed] (SPARK-15204) Improve nullability inference for Aggregator

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-15204. --- Resolution: Not A Bug > Improve nullability inference for Aggregator >

[jira] [Reopened] (SPARK-15204) Improve nullability inference for Aggregator

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reopened SPARK-15204: - > Improve nullability inference for Aggregator > > >

[jira] [Updated] (SPARK-15204) Improve nullability inference for Aggregator

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15204: Summary: Improve nullability inference for Aggregator (was: Nullable is not correct for

[jira] [Updated] (SPARK-15204) Nullable is not correct for Aggregator

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15204: Issue Type: Improvement (was: Bug) > Nullable is not correct for Aggregator >

[jira] [Commented] (SPARK-15204) Nullable is not correct for Aggregator

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277592#comment-15277592 ] Reynold Xin commented on SPARK-15204: - I'm going to change the title because it is always correct to

[jira] [Commented] (SPARK-4452) Shuffle data structures can starve others on the same thread for memory

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277583#comment-15277583 ] Apache Spark commented on SPARK-4452: - User 'lianhuiwang' has created a pull request for this issue:

[jira] [Updated] (SPARK-15187) Disallow Dropping Default Database

2016-05-09 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-15187: Assignee: Xiao Li > Disallow Dropping Default Database > -- > >

[jira] [Resolved] (SPARK-15187) Disallow Dropping Default Database

2016-05-09 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-15187. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12962

[jira] [Assigned] (SPARK-15241) support scala decimal in external row

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15241: Assignee: Apache Spark (was: Wenchen Fan) > support scala decimal in external row >

[jira] [Assigned] (SPARK-15242) keep decimal precision and scale when convert external decimal to catalyst decimal

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15242: Assignee: Wenchen Fan (was: Apache Spark) > keep decimal precision and scale when

[jira] [Commented] (SPARK-15241) support scala decimal in external row

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277565#comment-15277565 ] Apache Spark commented on SPARK-15241: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-15242) keep decimal precision and scale when convert external decimal to catalyst decimal

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277566#comment-15277566 ] Apache Spark commented on SPARK-15242: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15241) support scala decimal in external row

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15241: Assignee: Wenchen Fan (was: Apache Spark) > support scala decimal in external row >

[jira] [Assigned] (SPARK-15242) keep decimal precision and scale when convert external decimal to catalyst decimal

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15242: Assignee: Apache Spark (was: Wenchen Fan) > keep decimal precision and scale when

[jira] [Created] (SPARK-15242) keep decimal precision and scale when convert external decimal to catalyst decimal

2016-05-09 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-15242: --- Summary: keep decimal precision and scale when convert external decimal to catalyst decimal Key: SPARK-15242 URL: https://issues.apache.org/jira/browse/SPARK-15242

[jira] [Created] (SPARK-15241) support scala decimal in external row

2016-05-09 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-15241: --- Summary: support scala decimal in external row Key: SPARK-15241 URL: https://issues.apache.org/jira/browse/SPARK-15241 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-15240) Use buffer variables to improve buffer serialization/deserialization in TungstenAggregate

2016-05-09 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-15240: Summary: Use buffer variables to improve buffer serialization/deserialization in

[jira] [Assigned] (SPARK-15240) Use buffer variables for update/merge expressions instead duplicate serialization/deserialization

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15240: Assignee: (was: Apache Spark) > Use buffer variables for update/merge expressions

[jira] [Commented] (SPARK-15240) Use buffer variables for update/merge expressions instead duplicate serialization/deserialization

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277536#comment-15277536 ] Apache Spark commented on SPARK-15240: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15240) Use buffer variables for update/merge expressions instead duplicate serialization/deserialization

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15240: Assignee: Apache Spark > Use buffer variables for update/merge expressions instead

[jira] [Created] (SPARK-15240) Use buffer variables for update/merge expressions instead duplicate serialization/deserialization

2016-05-09 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-15240: --- Summary: Use buffer variables for update/merge expressions instead duplicate serialization/deserialization Key: SPARK-15240 URL:

[jira] [Resolved] (SPARK-15229) Make case sensitivity setting internal

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15229. - Resolution: Fixed Fix Version/s: 2.0.0 > Make case sensitivity setting internal >

[jira] [Resolved] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15234. - Resolution: Fixed Fix Version/s: 2.0.0 > spark.catalog.listDatabases.show() is not

[jira] [Commented] (SPARK-12661) Drop Python 2.6 support in PySpark

2016-05-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277473#comment-15277473 ] Shivaram Venkataraman commented on SPARK-12661: --- Yes - We will do a full round of AMI

[jira] [Assigned] (SPARK-15238) Clarify Python 3 support in docs

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15238: Assignee: Apache Spark > Clarify Python 3 support in docs >

[jira] [Assigned] (SPARK-15238) Clarify Python 3 support in docs

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15238: Assignee: (was: Apache Spark) > Clarify Python 3 support in docs >

[jira] [Commented] (SPARK-15238) Clarify Python 3 support in docs

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277468#comment-15277468 ] Apache Spark commented on SPARK-15238: -- User 'nchammas' has created a pull request for this issue:

[jira] [Created] (SPARK-15239) spark document conflict about mesos cluster

2016-05-09 Thread JasonChang (JIRA)
JasonChang created SPARK-15239: -- Summary: spark document conflict about mesos cluster Key: SPARK-15239 URL: https://issues.apache.org/jira/browse/SPARK-15239 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-15238) Clarify Python 3 support in docs

2016-05-09 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-15238: Summary: Clarify Python 3 support in docs Key: SPARK-15238 URL: https://issues.apache.org/jira/browse/SPARK-15238 Project: Spark Issue Type:

[jira] [Commented] (SPARK-15237) SparkR corr function documentation

2016-05-09 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277454#comment-15277454 ] Sun Rui commented on SPARK-15237: - SparkR supports two types of corr(), something like

[jira] [Commented] (SPARK-12661) Drop Python 2.6 support in PySpark

2016-05-09 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277450#comment-15277450 ] Nicholas Chammas commented on SPARK-12661: -- [~davies] / [~joshrosen] - Has this been settled on?

[jira] [Commented] (SPARK-12661) Drop Python 2.6 support in PySpark

2016-05-09 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277448#comment-15277448 ] Nicholas Chammas commented on SPARK-12661: -- [~shivaram] - Can you confirm that spark-ec2 will

[jira] [Commented] (SPARK-13634) Assigning spark context to variable results in serialization error

2016-05-09 Thread Kai Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277427#comment-15277427 ] Kai Chen commented on SPARK-13634: -- [~Rahul Palamuttam] and [~chrismattmann] Try {code} @transient val

[jira] [Updated] (SPARK-13485) (Dataset-oriented) API evolution in Spark 2.0

2016-05-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-13485: - Labels: releasenotes (was: ) > (Dataset-oriented) API evolution in Spark 2.0 >

[jira] [Updated] (SPARK-15025) creating datasource table with option (PATH) results in duplicate path key in serdeProperties

2016-05-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-15025: - Assignee: Xin Wu > creating datasource table with option (PATH) results in duplicate path key in >

[jira] [Resolved] (SPARK-15025) creating datasource table with option (PATH) results in duplicate path key in serdeProperties

2016-05-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-15025. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12804

[jira] [Created] (SPARK-15237) SparkR corr function documentation

2016-05-09 Thread Shaul (JIRA)
Shaul created SPARK-15237: - Summary: SparkR corr function documentation Key: SPARK-15237 URL: https://issues.apache.org/jira/browse/SPARK-15237 Project: Spark Issue Type: Documentation

[jira] [Updated] (SPARK-15236) No way to disable Hive support in REPL

2016-05-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15236: -- Component/s: Spark Shell > No way to disable Hive support in REPL >

[jira] [Updated] (SPARK-15019) Propagate all Spark Confs to HiveConf created in HiveClientImpl

2016-05-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-15019: - Labels: release_notes releasenotes (was: ) > Propagate all Spark Confs to HiveConf created in

[jira] [Commented] (SPARK-15019) Propagate all Spark Confs to HiveConf created in HiveClientImpl

2016-05-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277312#comment-15277312 ] Yin Huai commented on SPARK-15019: -- This change also drops the support of hive-site.xml. Users should

[jira] [Resolved] (SPARK-15209) Web UI's timeline visualizations fails to render if descriptions contain single quotes

2016-05-09 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-15209. Resolution: Fixed > Web UI's timeline visualizations fails to render if descriptions

[jira] [Updated] (SPARK-15209) Web UI's timeline visualizations fails to render if descriptions contain single quotes

2016-05-09 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-15209: --- Fix Version/s: 2.0.0 1.6.2 > Web UI's timeline visualizations fails to

[jira] [Updated] (SPARK-15236) No way to disable Hive support in REPL

2016-05-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15236: -- Assignee: (was: Andrew Or) > No way to disable Hive support in REPL >

[jira] [Created] (SPARK-15236) No way to disable Hive support in REPL

2016-05-09 Thread Andrew Or (JIRA)
Andrew Or created SPARK-15236: - Summary: No way to disable Hive support in REPL Key: SPARK-15236 URL: https://issues.apache.org/jira/browse/SPARK-15236 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-15235) Corresponding row cannot be highlighted even though cursor is on the job on Web UI's timeline

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15235: Assignee: (was: Apache Spark) > Corresponding row cannot be highlighted even though

[jira] [Commented] (SPARK-15186) Add user guide for Generalized Linear Regression.

2016-05-09 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277293#comment-15277293 ] Seth Hendrickson commented on SPARK-15186: -- I have a PR for this once

[jira] [Assigned] (SPARK-15235) Corresponding row cannot be highlighted even though cursor is on the job on Web UI's timeline

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15235: Assignee: Apache Spark > Corresponding row cannot be highlighted even though cursor is on

[jira] [Commented] (SPARK-15235) Corresponding row cannot be highlighted even though cursor is on the job on Web UI's timeline

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277295#comment-15277295 ] Apache Spark commented on SPARK-15235: -- User 'sarutak' has created a pull request for this issue:

[jira] [Created] (SPARK-15235) Corresponding row cannot be highlighted even though cursor is on the job on Web UI's timeline

2016-05-09 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-15235: -- Summary: Corresponding row cannot be highlighted even though cursor is on the job on Web UI's timeline Key: SPARK-15235 URL: https://issues.apache.org/jira/browse/SPARK-15235

[jira] [Commented] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277263#comment-15277263 ] Apache Spark commented on SPARK-15234: -- User 'techaddict' has created a pull request for this issue:

[jira] [Commented] (SPARK-14995) Add "since" tag in Roxygen documentation for SparkR API methods

2016-05-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277260#comment-15277260 ] Felix Cheung commented on SPARK-14995: -- should we have Experimental for new API like in Python?

[jira] [Commented] (SPARK-15228) pyspark.RDD.toLocalIterator Documentation

2016-05-09 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277243#comment-15277243 ] Sandeep Singh commented on SPARK-15228: --- The Code is formatted properly at the end. >

[jira] [Assigned] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

2016-05-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-15234: - Assignee: Andrew Or > spark.catalog.listDatabases.show() is not formatted correctly >

[jira] [Commented] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277237#comment-15277237 ] Apache Spark commented on SPARK-15234: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Commented] (SPARK-14983) Getting CompileException when feed an UDF with an array and another paramter

2016-05-09 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277221#comment-15277221 ] Shixiong Zhu commented on SPARK-14983: -- In addition, the Scala type for `ArrayType[String]` is

[jira] [Assigned] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15234: Assignee: (was: Apache Spark) > spark.catalog.listDatabases.show() is not formatted

[jira] [Assigned] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15234: Assignee: Apache Spark > spark.catalog.listDatabases.show() is not formatted correctly >

[jira] [Commented] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277205#comment-15277205 ] Apache Spark commented on SPARK-15234: -- User 'techaddict' has created a pull request for this issue:

[jira] [Resolved] (SPARK-14983) Getting CompileException when feed an UDF with an array and another paramter

2016-05-09 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-14983. -- Resolution: Duplicate This has been fixed in SPARK-10461 > Getting CompileException when feed

[jira] [Created] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

2016-05-09 Thread Andrew Or (JIRA)
Andrew Or created SPARK-15234: - Summary: spark.catalog.listDatabases.show() is not formatted correctly Key: SPARK-15234 URL: https://issues.apache.org/jira/browse/SPARK-15234 Project: Spark

[jira] [Updated] (SPARK-15234) spark.catalog.listDatabases.show() is not formatted correctly

2016-05-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15234: -- Description: {code} scala> spark.catalog.listDatabases.show()

[jira] [Updated] (SPARK-15233) Spark task metrics should include hdfs read write latency

2016-05-09 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sital Kedia updated SPARK-15233: Affects Version/s: 1.6.1 Priority: Minor (was: Major) Description:

[jira] [Created] (SPARK-15233) Spark UI should show metrics for hdfs read write latency

2016-05-09 Thread Sital Kedia (JIRA)
Sital Kedia created SPARK-15233: --- Summary: Spark UI should show metrics for hdfs read write latency Key: SPARK-15233 URL: https://issues.apache.org/jira/browse/SPARK-15233 Project: Spark Issue

[jira] [Updated] (SPARK-15229) Make case sensitivity setting internal

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15229: Description: Our case sensitivity support is different from what ANSI SQL standards support.

[jira] [Resolved] (SPARK-14898) MultivariateGaussian could use Cholesky in calculateCovarianceConstants

2016-05-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14898. --- Resolution: Not A Problem OK someone reopen this if we've misunderstood, but I think this isn't an

[jira] [Commented] (SPARK-15228) pyspark.RDD.toLocalIterator Documentation

2016-05-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277073#comment-15277073 ] Sean Owen commented on SPARK-15228: --- (What's the bug?) > pyspark.RDD.toLocalIterator Documentation >

[jira] [Commented] (SPARK-15231) Document the semantic of saveAsTable and insertInto and don't drop columns silently

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277003#comment-15277003 ] Apache Spark commented on SPARK-15231: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15231) Document the semantic of saveAsTable and insertInto and don't drop columns silently

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15231: Assignee: Shixiong Zhu (was: Apache Spark) > Document the semantic of saveAsTable and

[jira] [Created] (SPARK-15232) Add subquery SQL building tests to LogicalPlanToSQLSuite

2016-05-09 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-15232: - Summary: Add subquery SQL building tests to LogicalPlanToSQLSuite Key: SPARK-15232 URL: https://issues.apache.org/jira/browse/SPARK-15232 Project: Spark

[jira] [Assigned] (SPARK-15231) Document the semantic of saveAsTable and insertInto and don't drop columns silently

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15231: Assignee: Apache Spark (was: Shixiong Zhu) > Document the semantic of saveAsTable and

[jira] [Updated] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-05-09 Thread Trystan Leftwich (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Trystan Leftwich updated SPARK-14318: - Description: TPCDS Q14 parses successfully, and plans created successfully. Spark tries

[jira] [Created] (SPARK-15231) Document the semantic of saveAsTable and insertInto and don't drop columns silently

2016-05-09 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-15231: Summary: Document the semantic of saveAsTable and insertInto and don't drop columns silently Key: SPARK-15231 URL: https://issues.apache.org/jira/browse/SPARK-15231

[jira] [Resolved] (SPARK-14972) Improve performance of JSON schema inference's inferField step

2016-05-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-14972. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12750

[jira] [Resolved] (SPARK-15173) DataFrameWriter.insertInto should work with datasource table stored in hive

2016-05-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-15173. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12949

[jira] [Assigned] (SPARK-15204) Nullable is not correct for Aggregator

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15204: Assignee: Apache Spark > Nullable is not correct for Aggregator >

[jira] [Assigned] (SPARK-15204) Nullable is not correct for Aggregator

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15204: Assignee: (was: Apache Spark) > Nullable is not correct for Aggregator >

[jira] [Commented] (SPARK-15204) Nullable is not correct for Aggregator

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276903#comment-15276903 ] Apache Spark commented on SPARK-15204: -- User 'sbcd90' has created a pull request for this issue:

[jira] [Updated] (SPARK-15230) Back quoted column with dot in it fails when running distinct on dataframe

2016-05-09 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-15230: -- Description: When working with a dataframe columns with .'s in them must be backquoted

[jira] [Updated] (SPARK-15230) Back quoted column with dot in it fails when running distinct on dataframe

2016-05-09 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-15230: -- Description: When working with a dataframe columns with .'s in them must be backquoted

[jira] [Assigned] (SPARK-15229) Make case sensitivity setting internal

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15229: Assignee: Apache Spark (was: Reynold Xin) > Make case sensitivity setting internal >

[jira] [Closed] (SPARK-15217) Always Case Insensitive in HiveSessionState

2016-05-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-15217. --- Resolution: Won't Fix See https://issues.apache.org/jira/browse/SPARK-15229 > Always Case

[jira] [Commented] (SPARK-14021) Support custom context derived from HiveContext for SparkSQLEnv

2016-05-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276820#comment-15276820 ] Andrew Or commented on SPARK-14021: --- Closing as Won't Fix because the issue is outdated after

[jira] [Resolved] (SPARK-14021) Support custom context derived from HiveContext for SparkSQLEnv

2016-05-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14021. --- Resolution: Won't Fix > Support custom context derived from HiveContext for SparkSQLEnv >

[jira] [Created] (SPARK-15230) Back quoted column with dot in it fails when running distinct on dataframe

2016-05-09 Thread Barry Becker (JIRA)
Barry Becker created SPARK-15230: Summary: Back quoted column with dot in it fails when running distinct on dataframe Key: SPARK-15230 URL: https://issues.apache.org/jira/browse/SPARK-15230 Project:

[jira] [Commented] (SPARK-14420) keepLastCheckpoint Param for Python LDA with EM

2016-05-09 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276816#comment-15276816 ] Miao Wang commented on SPARK-14420: --- Yes, I checked the PR of 11940. The parameter has been added.

[jira] [Assigned] (SPARK-15229) Make case sensitivity setting internal

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15229: Assignee: Reynold Xin (was: Apache Spark) > Make case sensitivity setting internal >

[jira] [Commented] (SPARK-15229) Make case sensitivity setting internal

2016-05-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276815#comment-15276815 ] Apache Spark commented on SPARK-15229: -- User 'rxin' has created a pull request for this issue:

[jira] [Created] (SPARK-15229) Make case sensitivity setting internal

2016-05-09 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-15229: --- Summary: Make case sensitivity setting internal Key: SPARK-15229 URL: https://issues.apache.org/jira/browse/SPARK-15229 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-10653) Remove unnecessary things from SparkEnv

2016-05-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10653. --- Resolution: Fixed Assignee: Alex Bozarth Fix Version/s: 2.0.0 Target

[jira] [Created] (SPARK-15228) pyspark.RDD.toLocalIterator Documentation

2016-05-09 Thread Ignacio Tartavull (JIRA)
Ignacio Tartavull created SPARK-15228: - Summary: pyspark.RDD.toLocalIterator Documentation Key: SPARK-15228 URL: https://issues.apache.org/jira/browse/SPARK-15228 Project: Spark Issue

  1   2   >