[jira] [Created] (SPARK-15670) Add deprecate annotation for acumulator V1 interface in JavaSparkContext class

2016-05-31 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-15670: -- Summary: Add deprecate annotation for acumulator V1 interface in JavaSparkContext class Key: SPARK-15670 URL: https://issues.apache.org/jira/browse/SPARK-15670 Project: S

[jira] [Commented] (SPARK-15640) Build mllib fail, asBreeze method not found

2016-05-28 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15305404#comment-15305404 ] Weichen Xu commented on SPARK-15640: OK, I got it, thanks! > Build mllib fail, asBre

[jira] [Closed] (SPARK-15640) Build mllib fail, asBreeze method not found

2016-05-28 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu closed SPARK-15640. -- Resolution: Workaround > Build mllib fail, asBreeze method not found >

[jira] [Comment Edited] (SPARK-15640) Build mllib fail, asBreeze method not found

2016-05-28 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15305318#comment-15305318 ] Weichen Xu edited comment on SPARK-15640 at 5/28/16 11:45 AM: -

[jira] [Commented] (SPARK-15640) Build mllib fail, asBreeze method not found

2016-05-28 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15305318#comment-15305318 ] Weichen Xu commented on SPARK-15640: yeah, that's right, the official mllib_local jar

[jira] [Created] (SPARK-15640) Build mllib fail, asBreeze method not found

2016-05-28 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-15640: -- Summary: Build mllib fail, asBreeze method not found Key: SPARK-15640 URL: https://issues.apache.org/jira/browse/SPARK-15640 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-15573) Backwards-compatible persistence for spark.ml

2016-05-27 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15303785#comment-15303785 ] Weichen Xu edited comment on SPARK-15573 at 5/27/16 9:24 AM: -

[jira] [Commented] (SPARK-15608) Add document for ML IsotonicRegression

2016-05-27 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15303792#comment-15303792 ] Weichen Xu commented on SPARK-15608: I will work on it and send a PR soon. Thanks! >

[jira] [Commented] (SPARK-15573) Backwards-compatible persistence for spark.ml

2016-05-27 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15303785#comment-15303785 ] Weichen Xu commented on SPARK-15573: I will work on it and send a PR soon. Thanks! >

[jira] [Commented] (SPARK-15533) Deprecate Dataset.explode

2016-05-25 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15301179#comment-15301179 ] Weichen Xu commented on SPARK-15533: I will work on it and send a PR soon. Thanks! >

[jira] [Commented] (SPARK-15533) Deprecate Dataset.explode

2016-05-25 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15301178#comment-15301178 ] Weichen Xu commented on SPARK-15533: I will work on it. Thanks! > Deprecate Dataset.

[jira] [Updated] (SPARK-15499) Add python testsuite with remote debug and single test parameter to help developer debug code easier.

2016-05-24 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-15499: --- Issue Type: New Feature (was: Improvement) > Add python testsuite with remote debug and single test

[jira] [Updated] (SPARK-15499) Add python testsuite with remote debug and single test parameter to help developer debug code easier.

2016-05-24 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-15499: --- Description: To python/run-tests.py script, I add the following parameters: --single-test=SINGLE_T

[jira] [Created] (SPARK-15499) Add python testsuite with remote debug and single test parameter to help developer debug code easier.

2016-05-24 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-15499: -- Summary: Add python testsuite with remote debug and single test parameter to help developer debug code easier. Key: SPARK-15499 URL: https://issues.apache.org/jira/browse/SPARK-15499

[jira] [Commented] (SPARK-15446) catalyst using BigInteger.longValueExact that not supporting java 7 and compile error

2016-05-21 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15295409#comment-15295409 ] Weichen Xu commented on SPARK-15446: OK. I got it, thanks. > catalyst using BigInteg

[jira] [Updated] (SPARK-15464) Replace SQLContext and SparkContext with SparkSession using builder pattern in python testsuites

2016-05-21 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-15464: --- Labels: test (was: ) > Replace SQLContext and SparkContext with SparkSession using builder pattern

[jira] [Updated] (SPARK-15464) Replace SQLContext and SparkContext with SparkSession using builder pattern in python testsuites

2016-05-21 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-15464: --- Summary: Replace SQLContext and SparkContext with SparkSession using builder pattern in python testsu

[jira] [Created] (SPARK-15464) Replace SQLContext and SparkContext with SparkSession using builder pattern in python test code

2016-05-21 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-15464: -- Summary: Replace SQLContext and SparkContext with SparkSession using builder pattern in python test code Key: SPARK-15464 URL: https://issues.apache.org/jira/browse/SPARK-15464

[jira] [Closed] (SPARK-15461) modify python test script using default version 2.7

2016-05-21 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu closed SPARK-15461. -- Resolution: Fixed install unittest2 then we can use python 2.6 run spark python tests. > modify python

[jira] [Commented] (SPARK-15461) modify python test script using default version 2.7

2016-05-21 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15295056#comment-15295056 ] Weichen Xu commented on SPARK-15461: Oh..it really still support python 2.6 but need

[jira] [Commented] (SPARK-15461) modify python test script using default version 2.7

2016-05-21 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15295057#comment-15295057 ] Weichen Xu commented on SPARK-15461: Oh..it really still support python 2.6 but need

[jira] [Updated] (SPARK-15461) modify python test script using default version 2.7

2016-05-20 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-15461: --- Priority: Major (was: Critical) > modify python test script using default version 2.7 >

[jira] [Updated] (SPARK-15461) modify python test script using default version 2.7

2016-05-20 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-15461: --- Description: To Spark 2.0, the python test script do not support python 2.6, so need to update the d

[jira] [Updated] (SPARK-15461) modify python test script using default version 2.7

2016-05-20 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-15461: --- Component/s: Tests PySpark > modify python test script using default version 2.7 > -

[jira] [Created] (SPARK-15461) modify python test script using default version 2.7

2016-05-20 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-15461: -- Summary: modify python test script using default version 2.7 Key: SPARK-15461 URL: https://issues.apache.org/jira/browse/SPARK-15461 Project: Spark Issue Type: B

[jira] [Commented] (SPARK-15446) catalyst using BigInteger.longValueExact that not supporting java 7 and compile error

2016-05-20 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15293599#comment-15293599 ] Weichen Xu commented on SPARK-15446: OK. I see. > catalyst using BigInteger.longValu

[jira] [Closed] (SPARK-15446) catalyst using BigInteger.longValueExact that not supporting java 7 and compile error

2016-05-20 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu closed SPARK-15446. -- Resolution: Fixed > catalyst using BigInteger.longValueExact that not supporting java 7 and > compile

[jira] [Created] (SPARK-15446) catalyst using BigInteger.longValueExact that not supporting java 7 and compile error

2016-05-20 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-15446: -- Summary: catalyst using BigInteger.longValueExact that not supporting java 7 and compile error Key: SPARK-15446 URL: https://issues.apache.org/jira/browse/SPARK-15446 Pro

[jira] [Updated] (SPARK-15350) Add unit test function for LogisticRegressionWithLBFGS in JavaLogisticRegressionSuite

2016-05-16 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-15350: --- Priority: Minor (was: Major) > Add unit test function for LogisticRegressionWithLBFGS in > JavaLogi

[jira] [Created] (SPARK-15350) Add unit test function for LogisticRegressionWithLBFGS in JavaLogisticRegressionSuite

2016-05-16 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-15350: -- Summary: Add unit test function for LogisticRegressionWithLBFGS in JavaLogisticRegressionSuite Key: SPARK-15350 URL: https://issues.apache.org/jira/browse/SPARK-15350 Pro

[jira] [Updated] (SPARK-15322) update deprecate accumulator usage into accumulatorV2 in mllib

2016-05-13 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-15322: --- Component/s: ML > update deprecate accumulator usage into accumulatorV2 in mllib > --

[jira] [Created] (SPARK-15322) update deprecate accumulator usage into accumulatorV2 in mllib

2016-05-13 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-15322: -- Summary: update deprecate accumulator usage into accumulatorV2 in mllib Key: SPARK-15322 URL: https://issues.apache.org/jira/browse/SPARK-15322 Project: Spark I

[jira] [Created] (SPARK-15226) CSV file data-line with newline at first line load error

2016-05-09 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-15226: -- Summary: CSV file data-line with newline at first line load error Key: SPARK-15226 URL: https://issues.apache.org/jira/browse/SPARK-15226 Project: Spark Issue Ty

[jira] [Commented] (SPARK-15212) CSV file reader when read file with first line schema do not filter blank in schema column name

2016-05-09 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276275#comment-15276275 ] Weichen Xu commented on SPARK-15212: en...but still may cause problem, for example, t

[jira] [Updated] (SPARK-15212) CSV file reader when read file with first line schema do not filter blank in schema column name

2016-05-08 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-15212: --- Summary: CSV file reader when read file with first line schema do not filter blank in schema column n

[jira] [Created] (SPARK-15212) CVS file reader when read file with first line schema do not filter blank in schema column name

2016-05-08 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-15212: -- Summary: CVS file reader when read file with first line schema do not filter blank in schema column name Key: SPARK-15212 URL: https://issues.apache.org/jira/browse/SPARK-15212

[jira] [Updated] (SPARK-15203) The spark daemon shell script error, daemon process start successfully but script output fail message.

2016-05-07 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-15203: --- Description: When using sbin/start-master.sh to start spark master daemon, sometimes the daemon serv

[jira] [Updated] (SPARK-15203) The spark daemon shell script error, daemon process start successfully but script output fail message.

2016-05-07 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-15203: --- Target Version/s: (was: 2.1.0) > The spark daemon shell script error, daemon process start successf

[jira] [Updated] (SPARK-15203) The spark daemon shell script error, daemon process start successfully but script output fail message.

2016-05-07 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-15203: --- Fix Version/s: (was: 2.1.0) (was: 1.6.2) (was: 1.6.1

[jira] [Created] (SPARK-15203) The spark daemon shell script error, daemon process start successfully but script output fail message.

2016-05-07 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-15203: -- Summary: The spark daemon shell script error, daemon process start successfully but script output fail message. Key: SPARK-15203 URL: https://issues.apache.org/jira/browse/SPARK-15203

<    2   3   4   5   6   7