[jira] [Commented] (SPARK-11788) Using java.sql.Timestamp and java.sql.Date in where clauses on JDBC dataframes causes SQLServerException

2015-11-23 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022775#comment-15022775 ] Huaxin Gao commented on SPARK-11788: I will change to timestampValue and dateValue. In the test case,

[jira] [Assigned] (SPARK-11836) Register a Python function creates a new SQLContext

2015-11-23 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-11836: -- Assignee: Davies Liu > Register a Python function creates a new SQLContext >

[jira] [Comment Edited] (SPARK-11788) Using java.sql.Timestamp and java.sql.Date in where clauses on JDBC dataframes causes SQLServerException

2015-11-23 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022845#comment-15022845 ] Huaxin Gao edited comment on SPARK-11788 at 11/23/15 7:49 PM: -- Sorry, I just

[jira] [Issue Comment Deleted] (SPARK-11788) Using java.sql.Timestamp and java.sql.Date in where clauses on JDBC dataframes causes SQLServerException

2015-11-23 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-11788: --- Comment: was deleted (was: Sorry, I just realized that actually I checked in the $"B" === date &&

[jira] [Updated] (SPARK-11920) ML LinearRegression should use correct dataset in examples and user guide doc

2015-11-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11920: -- Assignee: Yanbo Liang Target Version/s: 1.6.0 > ML LinearRegression should

[jira] [Commented] (SPARK-11886) R function name conflicts with base or stats package ones

2015-11-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022787#comment-15022787 ] Felix Cheung commented on SPARK-11886: -- We could also create a generic function to redirect the more

[jira] [Commented] (SPARK-11234) What's cooking classification

2015-11-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022830#comment-15022830 ] Joseph K. Bradley commented on SPARK-11234: --- [~yinxusen] Thank you for working through this

[jira] [Assigned] (SPARK-11836) Register a Python function creates a new SQLContext

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11836: Assignee: Davies Liu (was: Apache Spark) > Register a Python function creates a new

[jira] [Commented] (SPARK-11836) Register a Python function creates a new SQLContext

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022841#comment-15022841 ] Apache Spark commented on SPARK-11836: -- User 'davies' has created a pull request for this issue:

[jira] [Resolved] (SPARK-3215) Add remote interface for SparkContext

2015-11-23 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-3215. --- Resolution: Won't Fix I think there isn't enough interest in getting this into Spark itself,

[jira] [Assigned] (SPARK-11836) Register a Python function creates a new SQLContext

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11836: Assignee: Apache Spark (was: Davies Liu) > Register a Python function creates a new

[jira] [Assigned] (SPARK-7539) Perf tests for Python MLlib

2015-11-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-7539: Assignee: Joseph K. Bradley (was: Xiangrui Meng) > Perf tests for Python MLlib >

[jira] [Commented] (SPARK-11788) Using java.sql.Timestamp and java.sql.Date in where clauses on JDBC dataframes causes SQLServerException

2015-11-23 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022845#comment-15022845 ] Huaxin Gao commented on SPARK-11788: Sorry, I just realized that actually I checked in the $"B" ===

[jira] [Resolved] (SPARK-11920) ML LinearRegression should use correct dataset in examples and user guide doc

2015-11-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-11920. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9905

[jira] [Commented] (SPARK-9999) Dataset API on top of Catalyst/DataFrame

2015-11-23 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022634#comment-15022634 ] Sandy Ryza commented on SPARK-: --- [~nchammas] it's not clear that it makes sense to add a similar API

[jira] [Commented] (SPARK-6328) Python API for StreamingListener

2015-11-23 Thread Daniel Jalova (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022690#comment-15022690 ] Daniel Jalova commented on SPARK-6328: -- @tdas Could you change the assignee to me please? > Python

[jira] [Resolved] (SPARK-11913) support typed aggregate for complex buffer schema

2015-11-23 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11913. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9898

[jira] [Resolved] (SPARK-11894) Incorrect results are returned when using null

2015-11-23 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11894. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9904

[jira] [Resolved] (SPARK-11921) fix `nullable` of encoder schema

2015-11-23 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11921. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9906

[jira] [Resolved] (SPARK-7173) Support YARN node label expressions for the application master

2015-11-23 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-7173. --- Resolution: Fixed Assignee: Saisai Shao Fix Version/s: 1.6.0 > Support YARN

[jira] [Resolved] (SPARK-11837) spark_ec2.py breaks with python3 and m3 instances

2015-11-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11837. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9797

[jira] [Commented] (SPARK-11836) Register a Python function creates a new SQLContext

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022870#comment-15022870 ] Apache Spark commented on SPARK-11836: -- User 'davies' has created a pull request for this issue:

[jira] [Updated] (SPARK-11837) spark_ec2.py breaks with python3 and m3 instances

2015-11-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11837: --- Assignee: Mortada Mehyar > spark_ec2.py breaks with python3 and m3 instances >

[jira] [Comment Edited] (SPARK-9999) Dataset API on top of Catalyst/DataFrame

2015-11-23 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022735#comment-15022735 ] Nicholas Chammas edited comment on SPARK- at 11/23/15 8:06 PM: ---

[jira] [Commented] (SPARK-11329) Expand Star when creating a struct

2015-11-23 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022876#comment-15022876 ] Maciej Bryński commented on SPARK-11329: [~yhuai] How can I execute this query: ``` SELECT

[jira] [Commented] (SPARK-9999) Dataset API on top of Catalyst/DataFrame

2015-11-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022883#comment-15022883 ] Xiao Li commented on SPARK-: Agree. The major performance gain of Dataset should be from Catalyst

[jira] [Updated] (SPARK-11918) WLS can not resolve some kinds of equation

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11918: Description: Weighted Least Squares (WLS) is one of the optimization method for solve Linear

[jira] [Created] (SPARK-11918) WLS can not resolve some kinds of equation

2015-11-23 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-11918: --- Summary: WLS can not resolve some kinds of equation Key: SPARK-11918 URL: https://issues.apache.org/jira/browse/SPARK-11918 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11918) WLS can not resolve some kinds of equation

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11918: Description: Weighted Least Squares (WLS) is one of the optimization method for solve Linear

[jira] [Updated] (SPARK-11918) WLS can not resolve some kinds of equation

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11918: Description: Weighted Least Squares (WLS) is one of the optimization method for solve Linear

[jira] [Updated] (SPARK-11918) WLS can not resolve some kinds of equation

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11918: Description: Weighted Least Squares (WLS) is one of the optimization method for solve Linear

[jira] [Updated] (SPARK-11918) WLS can not resolve some kinds of equation

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11918: Description: Weighted Least Squares (WLS) is one of the optimization method for solve Linear

[jira] [Resolved] (SPARK-11919) graphx should be supported with java

2015-11-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11919. --- Resolution: Duplicate [~benedict jin] please search JIRA before opening one. This was easy to find.

[jira] [Commented] (SPARK-11918) WLS can not resolve some kinds of equation

2015-11-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021787#comment-15021787 ] Sean Owen commented on SPARK-11918: --- [~yanboliang] yes this is true in general of ill-conditioned

[jira] [Commented] (SPARK-11782) Master Web UI should link to correct Application UI in cluster mode

2015-11-23 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021811#comment-15021811 ] Jean-Baptiste Onofré commented on SPARK-11782: -- Ah ok, understood. Let me try to reproduce

[jira] [Assigned] (SPARK-11921) fix `nullable` of encoder schema

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11921: Assignee: (was: Apache Spark) > fix `nullable` of encoder schema >

[jira] [Assigned] (SPARK-11921) fix `nullable` of encoder schema

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11921: Assignee: Apache Spark > fix `nullable` of encoder schema >

[jira] [Commented] (SPARK-11921) fix `nullable` of encoder schema

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021833#comment-15021833 ] Apache Spark commented on SPARK-11921: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Resolved] (SPARK-6531) An Information Theoretic Feature Selection Framework

2015-11-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6531. -- Resolution: Won't Fix > An Information Theoretic Feature Selection Framework >

[jira] [Closed] (SPARK-11915) Fix flaky python test pyspark.sql.group

2015-11-23 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh closed SPARK-11915. --- Resolution: Not A Problem > Fix flaky python test pyspark.sql.group >

[jira] [Created] (SPARK-11925) Add PySpark missing methods for ml.feature

2015-11-23 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-11925: --- Summary: Add PySpark missing methods for ml.feature Key: SPARK-11925 URL: https://issues.apache.org/jira/browse/SPARK-11925 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-11925) Add PySpark missing methods for ml.feature during Spark 1.6 QA

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11925: Assignee: Apache Spark > Add PySpark missing methods for ml.feature during Spark 1.6 QA >

[jira] [Assigned] (SPARK-11925) Add PySpark missing methods for ml.feature during Spark 1.6 QA

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11925: Assignee: (was: Apache Spark) > Add PySpark missing methods for ml.feature during

[jira] [Commented] (SPARK-11925) Add PySpark missing methods for ml.feature during Spark 1.6 QA

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021955#comment-15021955 ] Apache Spark commented on SPARK-11925: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Updated] (SPARK-11604) ML 1.6 QA: API: Python API coverage

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11604: Description: For new public APIs added to MLlib, we need to check the generated HTML doc and

[jira] [Created] (SPARK-11924) SparkContext stop method does not close HiveContexts

2015-11-23 Thread Sylvain Lequeux (JIRA)
Sylvain Lequeux created SPARK-11924: --- Summary: SparkContext stop method does not close HiveContexts Key: SPARK-11924 URL: https://issues.apache.org/jira/browse/SPARK-11924 Project: Spark

[jira] [Updated] (SPARK-11925) Add PySpark missing methods for ml.feature during Spark 1.6 QA

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11925: Summary: Add PySpark missing methods for ml.feature during Spark 1.6 QA (was: Add PySpark missing

[jira] [Commented] (SPARK-11924) SparkContext stop method does not close HiveContexts

2015-11-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021953#comment-15021953 ] Sean Owen commented on SPARK-11924: --- I'm not sure this works in general outside tests, or is supposed

[jira] [Updated] (SPARK-11925) Add PySpark missing methods for ml.feature during 1.6 QA

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11925: Summary: Add PySpark missing methods for ml.feature during 1.6 QA (was: Add PySpark missing

[jira] [Updated] (SPARK-11925) Add PySpark missing methods for ml.feature during Spark 1.6 QA

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11925: Description: Add PySpark missing methods and params for ml.feature * RegexTokenizer should support

[jira] [Commented] (SPARK-11782) Master Web UI should link to correct Application UI in cluster mode

2015-11-23 Thread Matthias Niehoff (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021730#comment-15021730 ] Matthias Niehoff commented on SPARK-11782: -- I submit the App with deploy-mode cluster, then the

[jira] [Commented] (SPARK-11918) WLS can not resolve some kinds of equation

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021729#comment-15021729 ] Yanbo Liang commented on SPARK-11918: - Further more, I use the breeze library to train the model by

[jira] [Created] (SPARK-11919) graphx should be supported with java

2015-11-23 Thread benedict jin (JIRA)
benedict jin created SPARK-11919: Summary: graphx should be supported with java Key: SPARK-11919 URL: https://issues.apache.org/jira/browse/SPARK-11919 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-11920) ML LinearRegression should use correct dataset in examples and user guide doc

2015-11-23 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-11920: --- Summary: ML LinearRegression should use correct dataset in examples and user guide doc Key: SPARK-11920 URL: https://issues.apache.org/jira/browse/SPARK-11920 Project:

[jira] [Resolved] (SPARK-11909) Spark Standalone's master URL accepts URLs without port (assuming default 7077)

2015-11-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11909. --- Resolution: Won't Fix > Spark Standalone's master URL accepts URLs without port (assuming default >

[jira] [Commented] (SPARK-11520) RegressionMetrics should support instance weights

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021867#comment-15021867 ] Apache Spark commented on SPARK-11520: -- User 'Lewuathe' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11520) RegressionMetrics should support instance weights

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11520: Assignee: Apache Spark > RegressionMetrics should support instance weights >

[jira] [Updated] (SPARK-11922) Python API for ml.feature.QuantileDiscretizer

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11922: Labels: starter (was: ) > Python API for ml.feature.QuantileDiscretizer >

[jira] [Updated] (SPARK-11604) ML 1.6 QA: API: Python API coverage

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11604: Description: For new public APIs added to MLlib, we need to check the generated HTML doc and

[jira] [Created] (SPARK-11926) unify GetStructField and GetInternalRowField

2015-11-23 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-11926: --- Summary: unify GetStructField and GetInternalRowField Key: SPARK-11926 URL: https://issues.apache.org/jira/browse/SPARK-11926 Project: Spark Issue Type:

[jira] [Commented] (SPARK-11926) unify GetStructField and GetInternalRowField

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021984#comment-15021984 ] Apache Spark commented on SPARK-11926: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11926) unify GetStructField and GetInternalRowField

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11926: Assignee: Apache Spark > unify GetStructField and GetInternalRowField >

[jira] [Assigned] (SPARK-11926) unify GetStructField and GetInternalRowField

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11926: Assignee: (was: Apache Spark) > unify GetStructField and GetInternalRowField >

[jira] [Updated] (SPARK-3947) Support Scala/Java UDAF

2015-11-23 Thread Milad Bourhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milad Bourhani updated SPARK-3947: -- Attachment: logs.zip > Support Scala/Java UDAF > --- > >

[jira] [Commented] (SPARK-3947) Support Scala/Java UDAF

2015-11-23 Thread Milad Bourhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022051#comment-15022051 ] Milad Bourhani commented on SPARK-3947: --- Just for completeness, I'm attaching the [^logs.zip]. For

[jira] [Commented] (SPARK-939) Allow user jars to take precedence over Spark jars, if desired

2015-11-23 Thread Jayson Minard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022081#comment-15022081 ] Jayson Minard commented on SPARK-939: - Ok, but how does this actually work? Any time we add Jackson

[jira] [Commented] (SPARK-939) Allow user jars to take precedence over Spark jars, if desired

2015-11-23 Thread Jayson Minard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022084#comment-15022084 ] Jayson Minard commented on SPARK-939: - I see, this now reverses the problem. We can crash Spark, but

[jira] [Commented] (SPARK-11885) UDAF may nondeterministically generate wrong results

2015-11-23 Thread Milad Bourhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022053#comment-15022053 ] Milad Bourhani commented on SPARK-11885: I've attached the logs on SPARK-3947, just to keep all

[jira] [Created] (SPARK-11927) configure log4j properties with spark-submit

2015-11-23 Thread Alex Kazantsev (JIRA)
Alex Kazantsev created SPARK-11927: -- Summary: configure log4j properties with spark-submit Key: SPARK-11927 URL: https://issues.apache.org/jira/browse/SPARK-11927 Project: Spark Issue

[jira] [Commented] (SPARK-10872) Derby error (XSDB6) when creating new HiveContext after restarting SparkContext

2015-11-23 Thread Dmytro Bielievtsov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022061#comment-15022061 ] Dmytro Bielievtsov commented on SPARK-10872: Removing {{metastore_db/dbex.lck}} right before

[jira] [Updated] (SPARK-11918) WLS can not resolve some kinds of equation

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11918: Description: Weighted Least Squares (WLS) is one of the optimization method for solve Linear

[jira] [Updated] (SPARK-11918) WLS can not resolve some kinds of equation

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11918: Description: Weighted Least Squares (WLS) is one of the optimization method for solve Linear

[jira] [Updated] (SPARK-11919) graphx should be supported with java

2015-11-23 Thread benedict jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] benedict jin updated SPARK-11919: - Issue Type: New Feature (was: Bug) > graphx should be supported with java >

[jira] [Commented] (SPARK-11918) WLS can not resolve some kinds of equation

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021756#comment-15021756 ] Yanbo Liang commented on SPARK-11918: - Until now, I suspect this is not a bug of MLlib but may be

[jira] [Updated] (SPARK-11920) ML LinearRegression should use correct dataset in examples and user guide doc

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11920: Description: ML LinearRegression use data/mllib/sample_libsvm_data.txt as dataset in examples and

[jira] [Updated] (SPARK-11920) ML LinearRegression should use correct dataset in examples and user guide doc

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11920: Description: ML LinearRegression use data/mllib/sample_libsvm_data.txt as dataset in examples and

[jira] [Assigned] (SPARK-11920) ML LinearRegression should use correct dataset in examples and user guide doc

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11920: Assignee: (was: Apache Spark) > ML LinearRegression should use correct dataset in

[jira] [Assigned] (SPARK-11920) ML LinearRegression should use correct dataset in examples and user guide doc

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11920: Assignee: Apache Spark > ML LinearRegression should use correct dataset in examples and

[jira] [Commented] (SPARK-11919) graphx should be supported with java

2015-11-23 Thread benedict jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021807#comment-15021807 ] benedict jin commented on SPARK-11919: -- Thanks a lot, my bad. Please help me let this jira to be

[jira] [Commented] (SPARK-11920) ML LinearRegression should use correct dataset in examples and user guide doc

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021806#comment-15021806 ] Apache Spark commented on SPARK-11920: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Updated] (SPARK-11920) ML LinearRegression should use correct dataset in examples and user guide doc

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11920: Description: ML LinearRegression use data/mllib/sample_libsvm_data.txt as dataset in examples and

[jira] [Comment Edited] (SPARK-11919) graphx should be supported with java

2015-11-23 Thread benedict jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021807#comment-15021807 ] benedict jin edited comment on SPARK-11919 at 11/23/15 9:16 AM: Thanks a

[jira] [Closed] (SPARK-11919) graphx should be supported with java

2015-11-23 Thread benedict jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] benedict jin closed SPARK-11919. Closing... > graphx should be supported with java > > >

[jira] [Commented] (SPARK-11918) WLS can not resolve some kinds of equation

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021830#comment-15021830 ] Yanbo Liang commented on SPARK-11918: - [~sowen] Thanks for your comments. I think you have got part

[jira] [Created] (SPARK-11921) fix `nullable` of encoder schema

2015-11-23 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-11921: --- Summary: fix `nullable` of encoder schema Key: SPARK-11921 URL: https://issues.apache.org/jira/browse/SPARK-11921 Project: Spark Issue Type: Sub-task

[jira] [Comment Edited] (SPARK-11326) Support for authentication and encryption in standalone mode

2015-11-23 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021848#comment-15021848 ] Jacek Lewandowski edited comment on SPARK-11326 at 11/23/15 9:41 AM: -

[jira] [Commented] (SPARK-11326) Support for authentication and encryption in standalone mode

2015-11-23 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021848#comment-15021848 ] Jacek Lewandowski commented on SPARK-11326: --- [~pwendell] - are you interested in reviewing this

[jira] [Assigned] (SPARK-11520) RegressionMetrics should support instance weights

2015-11-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11520: Assignee: (was: Apache Spark) > RegressionMetrics should support instance weights >

[jira] [Updated] (SPARK-11604) ML 1.6 QA: API: Python API coverage

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11604: Description: For new public APIs added to MLlib, we need to check the generated HTML doc and

[jira] [Commented] (SPARK-11918) WLS can not resolve some kinds of equation

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021720#comment-15021720 ] Yanbo Liang commented on SPARK-11918: - I use the same

[jira] [Updated] (SPARK-11918) WLS can not resolve some kinds of equation

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11918: Attachment: R_GLM_output > WLS can not resolve some kinds of equation >

[jira] [Comment Edited] (SPARK-11918) WLS can not resolve some kinds of equation

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021729#comment-15021729 ] Yanbo Liang edited comment on SPARK-11918 at 11/23/15 8:31 AM: --- Further

[jira] [Updated] (SPARK-11918) WLS can not resolve some kinds of equation

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11918: Description: Weighted Least Squares (WLS) is one of the optimization method for solve Linear

[jira] [Updated] (SPARK-11919) graphx should be supported with java

2015-11-23 Thread benedict jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] benedict jin updated SPARK-11919: - Description: Please make the graphx component to be supported with java, hope appear demo and

[jira] [Comment Edited] (SPARK-11918) WLS can not resolve some kinds of equation

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021729#comment-15021729 ] Yanbo Liang edited comment on SPARK-11918 at 11/23/15 8:44 AM: --- Further

[jira] [Created] (SPARK-11922) Python API for ml.feature.QuantileDiscretizer

2015-11-23 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-11922: --- Summary: Python API for ml.feature.QuantileDiscretizer Key: SPARK-11922 URL: https://issues.apache.org/jira/browse/SPARK-11922 Project: Spark Issue Type:

[jira] [Created] (SPARK-11923) Python API for ml.feature.ChiSqSelector

2015-11-23 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-11923: --- Summary: Python API for ml.feature.ChiSqSelector Key: SPARK-11923 URL: https://issues.apache.org/jira/browse/SPARK-11923 Project: Spark Issue Type:

[jira] [Updated] (SPARK-11916) Expression TRIM/LTRIM/RTRIM to support specific trim word

2015-11-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11916: -- Component/s: SQL > Expression TRIM/LTRIM/RTRIM to support specific trim word >

[jira] [Updated] (SPARK-11918) WLS can not resolve some kinds of equation

2015-11-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11918: Description: Weighted Least Squares (WLS) is one of the optimization method for solve Linear

[jira] [Commented] (SPARK-11782) Master Web UI should link to correct Application UI in cluster mode

2015-11-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021793#comment-15021793 ] Sean Owen commented on SPARK-11782: --- Oh right I read right past that. I think that's the difference

  1   2   3   >