[jira] [Commented] (SPARK-28555) Recover options and properties and pass them back into the v1 API

2019-07-29 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16895470#comment-16895470 ] Xin Ren commented on SPARK-28555: - I'm working on it :) > Recover options and properties and pass them

[jira] [Updated] (SPARK-28555) Recover options and properties and pass them back into the v1 API

2019-07-29 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-28555: Issue Type: Sub-task (was: Improvement) Parent: SPARK-22386 > Recover options and properties and

[jira] [Created] (SPARK-28555) Recover options and properties and pass them back into the v1 API

2019-07-29 Thread Xin Ren (JIRA)
Xin Ren created SPARK-28555: --- Summary: Recover options and properties and pass them back into the v1 API Key: SPARK-28555 URL: https://issues.apache.org/jira/browse/SPARK-28555 Project: Spark

[jira] [Closed] (SPARK-28139) DataSourceV2: Add AlterTable v2 implementation

2019-07-29 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren closed SPARK-28139. --- > DataSourceV2: Add AlterTable v2 implementation > -- > >

[jira] [Updated] (SPARK-20498) RandomForestRegressionModel should expose getMaxDepth in PySpark

2017-05-26 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-20498: Sure please go ahead On Fri, May 26, 2017 at 12:55 AM Yan Facai (颜发才) (JIRA) >

[jira] [Commented] (SPARK-19282) RandomForestRegressionModel summary should expose getMaxDepth

2017-04-19 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974188#comment-15974188 ] Xin Ren commented on SPARK-19282: - sorry [~bryanc] I'm just back from vacation... and sure I'd love to

[jira] [Commented] (SPARK-19282) RandomForestRegressionModel summary should expose getMaxDepth

2017-04-19 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974186#comment-15974186 ] Xin Ren commented on SPARK-19282: - yes, for R side, both parameters are exposed >

[jira] [Commented] (SPARK-19282) RandomForestRegressionModel summary should expose getMaxDepth

2017-03-14 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924728#comment-15924728 ] Xin Ren commented on SPARK-19282: - thanks Bryan, could you please create some sub tasks under

[jira] [Commented] (SPARK-19282) RandomForestRegressionModel summary should expose getMaxDepth

2017-03-14 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924374#comment-15924374 ] Xin Ren commented on SPARK-19282: - sure, I'm working on python part :) > RandomForestRegressionModel

[jira] [Commented] (SPARK-19282) RandomForestRegressionModel summary should expose getMaxDepth

2017-03-14 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923701#comment-15923701 ] Xin Ren commented on SPARK-19282: - Hi Nick, just double check I understand you correctly, you'd like to

[jira] [Commented] (SPARK-19866) Add local version of Word2Vec findSynonyms for spark.ml: Python API

2017-03-08 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902522#comment-15902522 ] Xin Ren commented on SPARK-19866: - I can try this one :) > Add local version of Word2Vec findSynonyms

[jira] [Commented] (SPARK-19282) RandomForestRegressionModel should expose getMaxDepth

2017-02-08 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15858744#comment-15858744 ] Xin Ren commented on SPARK-19282: - I just got approved by my company to work on this one resuming my

[jira] [Commented] (SPARK-19282) RandomForestRegressionModel should expose getMaxDepth

2017-01-22 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833973#comment-15833973 ] Xin Ren commented on SPARK-19282: - sorry Nick, now I cannot make it for this fix. anyone else please

[jira] [Commented] (SPARK-19282) RandomForestRegressionModel should expose getMaxDepth

2017-01-20 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832022#comment-15832022 ] Xin Ren commented on SPARK-19282: - Thank you Nick. I'll give it a try to fix it. :) >

[jira] [Commented] (SPARK-19282) RandomForestRegressionModel should expose getMaxDepth

2017-01-19 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15831342#comment-15831342 ] Xin Ren commented on SPARK-19282: - sorry being naive, I'm not familiar with random forest, but is "max

[jira] [Commented] (SPARK-18907) Fix flaky test: o.a.s.sql.streaming.FileStreamSourceSuite max files per trigger - incorrect values

2017-01-17 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826924#comment-15826924 ] Xin Ren commented on SPARK-18907: - thanks Shixiong :P > Fix flaky test:

[jira] [Commented] (SPARK-18907) Fix flaky test: o.a.s.sql.streaming.FileStreamSourceSuite max files per trigger - incorrect values

2017-01-17 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826909#comment-15826909 ] Xin Ren commented on SPARK-18907: - Hi Shixiong, what do you mean by flaky? to intercept these Exceptions?

[jira] [Commented] (SPARK-17724) Unevaluated new lines in tooltip in DAG Visualization of a job

2016-10-03 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543994#comment-15543994 ] Xin Ren commented on SPARK-17724: - I can give it a try > Unevaluated new lines in tooltip in DAG

[jira] [Created] (SPARK-17628) Name of "object StreamingExamples" should be more self-explanatory

2016-09-21 Thread Xin Ren (JIRA)
Xin Ren created SPARK-17628: --- Summary: Name of "object StreamingExamples" should be more self-explanatory Key: SPARK-17628 URL: https://issues.apache.org/jira/browse/SPARK-17628 Project: Spark

[jira] [Commented] (SPARK-17476) Proper handling for unseen labels in logistic regression training.

2016-09-09 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478517#comment-15478517 ] Xin Ren commented on SPARK-17476: - Hi I can try to work on this one, thanks :) > Proper handling for

[jira] [Updated] (SPARK-17276) Stop environment parameters flooding Jenkins build output

2016-08-26 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-17276: Attachment: Screen Shot 2016-08-26 at 10.52.07 PM.png > Stop environment parameters flooding Jenkins build

[jira] [Commented] (SPARK-17276) Stop environment parameters flooding Jenkins build output

2016-08-26 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15440782#comment-15440782 ] Xin Ren commented on SPARK-17276: - I'm working on it. > Stop environment parameters flooding Jenkins

[jira] [Created] (SPARK-17276) Stop environment parameters flooding Jenkins build output

2016-08-26 Thread Xin Ren (JIRA)
Xin Ren created SPARK-17276: --- Summary: Stop environment parameters flooding Jenkins build output Key: SPARK-17276 URL: https://issues.apache.org/jira/browse/SPARK-17276 Project: Spark Issue Type:

[jira] [Commented] (SPARK-17241) SparkR spark.glm should have configurable regularization parameter

2016-08-25 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15437588#comment-15437588 ] Xin Ren commented on SPARK-17241: - I can work on this one :) > SparkR spark.glm should have configurable

[jira] [Updated] (SPARK-17174) Provide support for Timestamp type Column in add_months function to return HH:mm:ss

2016-08-22 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-17174: Component/s: SQL > Provide support for Timestamp type Column in add_months function to return > HH:mm:ss

[jira] [Commented] (SPARK-17157) Add multiclass logistic regression SparkR Wrapper

2016-08-19 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15428751#comment-15428751 ] Xin Ren commented on SPARK-17157: - I guess a lot more ml algorithms are still missing R wrappers? > Add

[jira] [Commented] (SPARK-17133) Improvements to linear methods in Spark

2016-08-18 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427144#comment-15427144 ] Xin Ren commented on SPARK-17133: - hi [~sethah] I'd like to help on this, please count me in. Thanks a

[jira] [Commented] (SPARK-17038) StreamingSource reports metrics for lastCompletedBatch instead of lastReceivedBatch

2016-08-17 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15424017#comment-15424017 ] Xin Ren commented on SPARK-17038: - Hi [~ozzieba] I guess you too busy to respond or submit a PR, and I'm

[jira] [Issue Comment Deleted] (SPARK-17038) StreamingSource reports metrics for lastCompletedBatch instead of lastReceivedBatch

2016-08-17 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-17038: Comment: was deleted (was: Hi [~ozzieba] I guess you too busy to respond or submit a PR, and I'm now just

[jira] [Commented] (SPARK-17038) StreamingSource reports metrics for lastCompletedBatch instead of lastReceivedBatch

2016-08-17 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15424015#comment-15424015 ] Xin Ren commented on SPARK-17038: - Hi [~ozzieba] I guess you too busy to respond or submit a PR, and I'm

[jira] [Commented] (SPARK-17038) StreamingSource reports metrics for lastCompletedBatch instead of lastReceivedBatch

2016-08-15 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15421789#comment-15421789 ] Xin Ren commented on SPARK-17038: - hi [~ozzieba] if you don't have time, I can just submit a quick path

[jira] [Resolved] (SPARK-17026) warning msg in MulticlassMetricsSuite

2016-08-11 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren resolved SPARK-17026. - Resolution: Not A Problem > warning msg in MulticlassMetricsSuite >

[jira] [Created] (SPARK-17026) warning msg in MulticlassMetricsSuite

2016-08-11 Thread Xin Ren (JIRA)
Xin Ren created SPARK-17026: --- Summary: warning msg in MulticlassMetricsSuite Key: SPARK-17026 URL: https://issues.apache.org/jira/browse/SPARK-17026 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-17005) Fix warning "method tpe in trait AnnotationApi is deprecated"

2016-08-10 Thread Xin Ren (JIRA)
Xin Ren created SPARK-17005: --- Summary: Fix warning "method tpe in trait AnnotationApi is deprecated" Key: SPARK-17005 URL: https://issues.apache.org/jira/browse/SPARK-17005 Project: Spark Issue

[jira] [Created] (SPARK-17004) Fix warning "method declarations in class TypeApi is deprecated"

2016-08-10 Thread Xin Ren (JIRA)
Xin Ren created SPARK-17004: --- Summary: Fix warning "method declarations in class TypeApi is deprecated" Key: SPARK-17004 URL: https://issues.apache.org/jira/browse/SPARK-17004 Project: Spark

[jira] [Comment Edited] (SPARK-16445) Multilayer Perceptron Classifier wrapper in SparkR

2016-07-26 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15394654#comment-15394654 ] Xin Ren edited comment on SPARK-16445 at 7/26/16 10:17 PM: --- I'm still working

[jira] [Commented] (SPARK-16445) Multilayer Perceptron Classifier wrapper in SparkR

2016-07-26 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15394654#comment-15394654 ] Xin Ren commented on SPARK-16445: - I'm still working on it, hopefully by end of this weekend I can submit

[jira] [Commented] (SPARK-16580) [WARN] class Accumulator in package spark is deprecated: use AccumulatorV2

2016-07-15 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15380169#comment-15380169 ] Xin Ren commented on SPARK-16580: - You are right this one is hard, it's kindof all over the place. I'd

[jira] [Created] (SPARK-16580) [WARN] class Accumulator in package spark is deprecated: use AccumulatorV2

2016-07-15 Thread Xin Ren (JIRA)
Xin Ren created SPARK-16580: --- Summary: [WARN] class Accumulator in package spark is deprecated: use AccumulatorV2 Key: SPARK-16580 URL: https://issues.apache.org/jira/browse/SPARK-16580 Project: Spark

[jira] [Updated] (SPARK-16535) pom.xml warning: "Definition of groupId is redundant, because it's inherited from the parent"

2016-07-13 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-16535: Attachment: Screen Shot 2016-07-13 at 3.13.11 PM.png > pom.xml warning: "Definition of groupId is

[jira] [Created] (SPARK-16535) pom.xml warning: "Definition of groupId is redundant, because it's inherited from the parent"

2016-07-13 Thread Xin Ren (JIRA)
Xin Ren created SPARK-16535: --- Summary: pom.xml warning: "Definition of groupId is redundant, because it's inherited from the parent" Key: SPARK-16535 URL: https://issues.apache.org/jira/browse/SPARK-16535

[jira] [Closed] (SPARK-16437) SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder"

2016-07-12 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren closed SPARK-16437. --- > SparkR read.df() from parquet got error: SLF4J: Failed to load class > "org.slf4j.impl.StaticLoggerBinder" >

[jira] [Resolved] (SPARK-16437) SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder"

2016-07-12 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren resolved SPARK-16437. - Resolution: Not A Problem > SparkR read.df() from parquet got error: SLF4J: Failed to load class >

[jira] [Closed] (SPARK-16502) Update depreciated method "ParquetFileReader" from parquet

2016-07-12 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren closed SPARK-16502. --- Resolution: Invalid > Update depreciated method "ParquetFileReader" from parquet >

[jira] [Updated] (SPARK-16502) Update depreciated method "ParquetFileReader" from parquet

2016-07-12 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-16502: Description: During code compile, got below depreciation message. Need to update the method invocation.

[jira] [Updated] (SPARK-16502) Update depreciated method "ParquetFileReader" from parquet

2016-07-12 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-16502: Description: During code compile, got below depreciation message. Need to update the method invocation.

[jira] [Commented] (SPARK-16502) Update depreciated method "ParquetFileReader" from parquet

2016-07-12 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373494#comment-15373494 ] Xin Ren commented on SPARK-16502: - I'm working on it. > Update depreciated method "ParquetFileReader"

[jira] [Created] (SPARK-16502) Update depreciated method "ParquetFileReader" from parquet

2016-07-12 Thread Xin Ren (JIRA)
Xin Ren created SPARK-16502: --- Summary: Update depreciated method "ParquetFileReader" from parquet Key: SPARK-16502 URL: https://issues.apache.org/jira/browse/SPARK-16502 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-16437) SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder"

2016-07-12 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372210#comment-15372210 ] Xin Ren edited comment on SPARK-16437 at 7/12/16 6:04 PM: -- I worked on this for

[jira] [Commented] (SPARK-16437) SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder"

2016-07-12 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373338#comment-15373338 ] Xin Ren commented on SPARK-16437: - hi [~srowen], could you please have a look here? I think the SLF4J

[jira] [Commented] (SPARK-16437) SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder"

2016-07-11 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372211#comment-15372211 ] Xin Ren commented on SPARK-16437: - But I still find some minor improvements during my debugging, and will

[jira] [Commented] (SPARK-16437) SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder"

2016-07-11 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372210#comment-15372210 ] Xin Ren commented on SPARK-16437: - I worked on this for couple days, and I found it's not caused by

[jira] [Commented] (SPARK-16445) Multilayer Perceptron Classifier wrapper in SparkR

2016-07-11 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371385#comment-15371385 ] Xin Ren commented on SPARK-16445: - great to know, I'll start on it, thanks Xiangrui > Multilayer

[jira] [Commented] (SPARK-16437) SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder"

2016-07-08 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368548#comment-15368548 ] Xin Ren commented on SPARK-16437: - It's SQL's problem I think, I'll remove the SparkR tag > SparkR

[jira] [Updated] (SPARK-16437) SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder"

2016-07-08 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-16437: Component/s: (was: SparkR) > SparkR read.df() from parquet got error: SLF4J: Failed to load class >

[jira] [Updated] (SPARK-16437) SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder"

2016-07-08 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-16437: Description: build SparkR with command {code} build/mvn -DskipTests -Psparkr package {code} start SparkR

[jira] [Updated] (SPARK-16437) SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder"

2016-07-08 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-16437: Description: build SparkR with command {code} build/mvn -DskipTests -Psparkr package {code} start SparkR

[jira] [Commented] (SPARK-16445) Multilayer Perceptron Classifier wrapper in SparkR

2016-07-08 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368479#comment-15368479 ] Xin Ren commented on SPARK-16445: - Hi Xiangrui, may I have a try on this one? Is there a strict deadline

[jira] [Commented] (SPARK-16437) SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder"

2016-07-08 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15367310#comment-15367310 ] Xin Ren commented on SPARK-16437: - I'm working on it :) > SparkR read.df() from parquet got error:

[jira] [Created] (SPARK-16437) SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder"

2016-07-08 Thread Xin Ren (JIRA)
Xin Ren created SPARK-16437: --- Summary: SparkR read.df() from parquet got error: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder" Key: SPARK-16437 URL: https://issues.apache.org/jira/browse/SPARK-16437

[jira] [Commented] (SPARK-16381) Update SQL examples and programming guide for R language binding

2016-07-07 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15366261#comment-15366261 ] Xin Ren commented on SPARK-16381: - Oh I see, thank you so much :) > Update SQL examples and programming

[jira] [Commented] (SPARK-16381) Update SQL examples and programming guide for R language binding

2016-07-06 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365597#comment-15365597 ] Xin Ren commented on SPARK-16381: - Hi Cheng, do you mind tell me where to find the RC date, or release

[jira] [Commented] (SPARK-16381) Update SQL examples and programming guide for R language binding

2016-07-06 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364664#comment-15364664 ] Xin Ren commented on SPARK-16381: - I can work on this :) Is there a strict deadline to finish? like need

[jira] [Commented] (SPARK-16233) test_sparkSQL.R is failing

2016-07-02 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360058#comment-15360058 ] Xin Ren commented on SPARK-16233: - Oh sorry I thought you guys would take over so I stopped working on

[jira] [Comment Edited] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

2016-06-29 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15355648#comment-15355648 ] Xin Ren edited comment on SPARK-16144 at 6/29/16 6:57 PM: -- Sure, thanks Xiangrui

[jira] [Commented] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

2016-06-29 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15355648#comment-15355648 ] Xin Ren commented on SPARK-16144: - Sure, thank Xiangrui :) > Add a separate Rd for ML generic methods:

[jira] [Commented] (SPARK-16233) test_sparkSQL.R is failing

2016-06-28 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15353352#comment-15353352 ] Xin Ren commented on SPARK-16233: - Actually I was just following the docs here

[jira] [Commented] (SPARK-16233) test_sparkSQL.R is failing

2016-06-28 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15353340#comment-15353340 ] Xin Ren commented on SPARK-16233: - this is what I used to build sparkR, should I add "-Phive"? sorry I'm

[jira] [Commented] (SPARK-16144) Add a separate Rd for ML generic methods: read.ml, write.ml, summary, predict

2016-06-28 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352436#comment-15352436 ] Xin Ren commented on SPARK-16144: - sorry still trying to solve the merge conflicts should be close to

[jira] [Updated] (SPARK-16233) test_sparkSQL.R is failing

2016-06-27 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-16233: Description: By running {code} ./R/run-tests.sh {code} Getting error: {code} xin:spark xr$

[jira] [Commented] (SPARK-16233) test_sparkSQL.R is failing

2016-06-27 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351703#comment-15351703 ] Xin Ren commented on SPARK-16233: - I'm working on this > test_sparkSQL.R is failing >

[jira] [Created] (SPARK-16233) test_sparkSQL.R is failing

2016-06-27 Thread Xin Ren (JIRA)
Xin Ren created SPARK-16233: --- Summary: test_sparkSQL.R is failing Key: SPARK-16233 URL: https://issues.apache.org/jira/browse/SPARK-16233 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-16140) Group k-means method in generated doc

2016-06-23 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346776#comment-15346776 ] Xin Ren commented on SPARK-16140: - OK, I'll target to finish it this weekend. Thanks for the tips, I'll

[jira] [Commented] (SPARK-16140) Group k-means method in generated doc

2016-06-22 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345254#comment-15345254 ] Xin Ren commented on SPARK-16140: - Maybe I can take this one as a warm-up, thanks Xiangrui :) > Group

[jira] [Commented] (SPARK-16147) Add package docs to packages under spark.ml

2016-06-22 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345246#comment-15345246 ] Xin Ren commented on SPARK-16147: - hi Xiangrui, I can help on this if you need more hands. :) > Add

[jira] [Commented] (SPARK-15829) spark master webpage links to application UI broke when running in cluster mode

2016-06-10 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15325073#comment-15325073 ] Xin Ren commented on SPARK-15829: - sorry Andy, my bad. I'm running on port 7077 and client mode. > spark

[jira] [Commented] (SPARK-15829) spark master webpage links to application UI broke when running in cluster mode

2016-06-10 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15324789#comment-15324789 ] Xin Ren commented on SPARK-15829: - Hi Andy, maybe you want to check your port configuration to make sure

[jira] [Updated] (SPARK-15509) R MLlib algorithms should support input columns "features" and "label"

2016-05-30 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-15509: Description: Currently in SparkR, when you load a LibSVM dataset using the sqlContext and then pass it to

[jira] [Updated] (SPARK-15509) R MLlib algorithms should support input columns "features" and "label"

2016-05-30 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-15509: Description: Currently in SparkR, when you load a LibSVM dataset using the sqlContext and then pass it to

[jira] [Commented] (SPARK-15509) R MLlib algorithms should support input columns "features" and "label"

2016-05-30 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15306977#comment-15306977 ] Xin Ren commented on SPARK-15509: - I can reproduce the error here now, sorry for bothering Joseph > R

[jira] [Commented] (SPARK-15645) Fix some typos of Streaming module

2016-05-29 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15306092#comment-15306092 ] Xin Ren commented on SPARK-15645: - Thank you very much for this explanation Sean, I'll try to avoid this

[jira] [Comment Edited] (SPARK-15645) Fix some typos of Streaming module

2016-05-29 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305971#comment-15305971 ] Xin Ren edited comment on SPARK-15645 at 5/29/16 4:21 PM: -- sorry...in this case

[jira] [Commented] (SPARK-15645) Fix some typos of Streaming module

2016-05-29 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305971#comment-15305971 ] Xin Ren commented on SPARK-15645: - sorry...in this case what should be done for some very trivial things?

[jira] [Created] (SPARK-15645) Fix some typos of Streaming module

2016-05-28 Thread Xin Ren (JIRA)
Xin Ren created SPARK-15645: --- Summary: Fix some typos of Streaming module Key: SPARK-15645 URL: https://issues.apache.org/jira/browse/SPARK-15645 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-15509) R MLlib algorithms should support input columns "features" and "label"

2016-05-27 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304777#comment-15304777 ] Xin Ren commented on SPARK-15509: - Hi [~josephkb], I tried many times but cannot reproduce your error

[jira] [Commented] (SPARK-15509) R MLlib algorithms should support input columns "features" and "label"

2016-05-26 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15302932#comment-15302932 ] Xin Ren commented on SPARK-15509: - Sure I'll try to finish by end of this week, thanks Joseph > R MLlib

[jira] [Updated] (SPARK-15542) Make error message clear for script './R/install-dev.sh' when R is missing on Mac

2016-05-25 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-15542: Description: I followed instructions here https://github.com/apache/spark/tree/master/R to build sparkR

[jira] [Created] (SPARK-15542) Make error message clear for script './R/install-dev.sh' when R is missing on Mac

2016-05-25 Thread Xin Ren (JIRA)
Xin Ren created SPARK-15542: --- Summary: Make error message clear for script './R/install-dev.sh' when R is missing on Mac Key: SPARK-15542 URL: https://issues.apache.org/jira/browse/SPARK-15542 Project:

[jira] [Commented] (SPARK-15509) R MLlib algorithms should support input columns "features" and "label"

2016-05-24 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298787#comment-15298787 ] Xin Ren commented on SPARK-15509: - Hi Joseph, I'd like to try to fix this one. Thanks a lot :) > R MLlib

[jira] [Commented] (SPARK-15130) PySpark decision tree params should include default values to match Scala

2016-05-04 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271531#comment-15271531 ] Xin Ren commented on SPARK-15130: - Hi I just found in class DecisionTreeClassifier of pyspark, there is a

[jira] [Commented] (SPARK-14817) ML, Graph, R 2.0 QA: Programming guide update and migration guide

2016-05-03 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269775#comment-15269775 ] Xin Ren commented on SPARK-14817: - ok, I'll start looking for new APIs. So just create new tickets

[jira] [Commented] (SPARK-14936) FlumePollingStreamSuite is slow

2016-04-28 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263129#comment-15263129 ] Xin Ren commented on SPARK-14936: - I'm trying to fix this one now :) > FlumePollingStreamSuite is slow >

[jira] [Commented] (SPARK-14935) DistributedSuite "local-cluster format" shouldn't actually launch clusters

2016-04-27 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15260648#comment-15260648 ] Xin Ren commented on SPARK-14935: - I'd like to have a try on this one, thanks a lot :) >

[jira] [Commented] (SPARK-14817) ML 2.0 QA: Programming guide update and migration guide

2016-04-22 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15254371#comment-15254371 ] Xin Ren commented on SPARK-14817: - cout me too :) > ML 2.0 QA: Programming guide update and migration

[jira] [Commented] (SPARK-14569) Log instrumentation in KMeans

2016-04-15 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15243228#comment-15243228 ] Xin Ren commented on SPARK-14569: - Hi I'd like to have a try on this one, thanks a lot :) > Log

[jira] [Commented] (SPARK-14300) Scala MLlib examples code merge and clean up

2016-03-31 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220206#comment-15220206 ] Xin Ren commented on SPARK-14300: - ok > Scala MLlib examples code merge and clean up >

[jira] [Commented] (SPARK-14300) Scala MLlib examples code merge and clean up

2016-03-31 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220178#comment-15220178 ] Xin Ren commented on SPARK-14300: - Hi Xusen, I can work on this one, thanks a lot :) > Scala MLlib

[jira] [Closed] (SPARK-13765) method specialStateTransition(int, IntStream) is exceeding the 65535 bytes limit

2016-03-28 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren closed SPARK-13765. --- Resolution: Not A Problem It's caused by the way I import the whole project. This error is popping up when

[jira] [Reopened] (SPARK-13019) Replace example code in mllib-statistics.md using include_example

2016-03-22 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren reopened SPARK-13019: - need to fix scala-2.10 compile > Replace example code in mllib-statistics.md using include_example >

[jira] [Commented] (SPARK-13660) ContinuousQuerySuite floods the logs with garbage

2016-03-14 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194085#comment-15194085 ] Xin Ren commented on SPARK-13660: - Thank you Shixiong > ContinuousQuerySuite floods the logs with

  1   2   >