[jira] [Comment Edited] (SPARK-21483) Make org.apache.spark.ml.linalg.Vector bean-compliant so it can be used in Encoders.bean(Vector.class)

[ https://issues.apache.org/jira/browse/SPARK-21483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094607#comment-16094607 ] Aseem Bansal edited comment on SPARK-21483 at 7/20/17 12:29 PM: Some

[jira] [Commented] (SPARK-21483) Make org.apache.spark.ml.linalg.Vector bean-compliant so it can be used in Encoders.bean(Vector.class)

[ https://issues.apache.org/jira/browse/SPARK-21483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094607#comment-16094607 ] Aseem Bansal commented on SPARK-21483: -- Some pseudo code to show what I am trying to achieve

[jira] [Comment Edited] (SPARK-21483) Make org.apache.spark.ml.linalg.Vector bean-compliant so it can be used in Encoders.bean(Vector.class)

[ https://issues.apache.org/jira/browse/SPARK-21483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094314#comment-16094314 ] Aseem Bansal edited comment on SPARK-21483 at 7/20/17 9:11 AM: --- No it does

[jira] [Commented] (SPARK-21482) Make LabeledPoint bean-compliant so it can be used in Encoders.bean(LabeledPoint.class)

[ https://issues.apache.org/jira/browse/SPARK-21482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094315#comment-16094315 ] Aseem Bansal commented on SPARK-21482: -- There is a LabeledPoint in new ml api too

[jira] [Commented] (SPARK-21483) Make org.apache.spark.ml.linalg.Vector bean-compliant so it can be used in Encoders.bean(Vector.class)

[ https://issues.apache.org/jira/browse/SPARK-21483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094314#comment-16094314 ] Aseem Bansal commented on SPARK-21483: -- Now it does not. Can you give a link to what you are

[jira] [Commented] (SPARK-21483) Make org.apache.spark.ml.linalg.Vector bean-compliant so it can be used in Encoders.bean(Vector.class)

[ https://issues.apache.org/jira/browse/SPARK-21483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094297#comment-16094297 ] Aseem Bansal commented on SPARK-21483: -- How would you encode it otherwise? > Make

[jira] [Commented] (SPARK-21482) Make LabeledPoint bean-compliant so it can be used in Encoders.bean(LabeledPoint.class)

[ https://issues.apache.org/jira/browse/SPARK-21482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094295#comment-16094295 ] Aseem Bansal commented on SPARK-21482: -- I am using Java API. I tried a simple transformation with

[jira] [Created] (SPARK-21483) Make org.apache.spark.ml.linalg.Vector bean-compliant so it can be used in Encoders.bean(Vector.class)

Aseem Bansal created SPARK-21483: Summary: Make org.apache.spark.ml.linalg.Vector bean-compliant so it can be used in Encoders.bean(Vector.class) Key: SPARK-21483 URL:

[jira] [Created] (SPARK-21482) Make LabeledPoint bean-compliant so it can be used in Encoders.bean(LabeledPoint.class)

Aseem Bansal created SPARK-21482: Summary: Make LabeledPoint bean-compliant so it can be used in Encoders.bean(LabeledPoint.class) Key: SPARK-21482 URL: https://issues.apache.org/jira/browse/SPARK-21482

[jira] [Created] (SPARK-21481) Add indexOf method in ml.feature.HashingTF similar to mllib.feature.HashingTF

Aseem Bansal created SPARK-21481: Summary: Add indexOf method in ml.feature.HashingTF similar to mllib.feature.HashingTF Key: SPARK-21481 URL: https://issues.apache.org/jira/browse/SPARK-21481

[jira] [Updated] (SPARK-21473) Running Transform on a bean which has only setters gives NullPointerExcpetion

[ https://issues.apache.org/jira/browse/SPARK-21473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aseem Bansal updated SPARK-21473: - Description: If I run the following using the Java API {code:java}

[jira] [Created] (SPARK-21473) Running Transform on a bean which has only setters gives NullPointerExcpetion

Aseem Bansal created SPARK-21473: Summary: Running Transform on a bean which has only setters gives NullPointerExcpetion Key: SPARK-21473 URL: https://issues.apache.org/jira/browse/SPARK-21473

[jira] [Commented] (SPARK-17742) Spark Launcher does not get failed state in Listener

[ https://issues.apache.org/jira/browse/SPARK-17742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954714#comment-15954714 ] Aseem Bansal commented on SPARK-17742: -- [~daanvdn] We ended up using kafka messages to communicate

[jira] [Commented] (SPARK-10413) ML models should support prediction on single instances

[ https://issues.apache.org/jira/browse/SPARK-10413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15857888#comment-15857888 ] Aseem Bansal commented on SPARK-10413: -- Something to look at would be

[jira] [Commented] (SPARK-19449) Inconsistent results between ml package RandomForestClassificationModel and mllib package RandomForestModel

[ https://issues.apache.org/jira/browse/SPARK-19449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853629#comment-15853629 ] Aseem Bansal commented on SPARK-19449: -- [~sowen] My results are actually deterministic. No matter

[jira] [Commented] (SPARK-19444) Tokenizer example does not compile without extra imports

[ https://issues.apache.org/jira/browse/SPARK-19444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851588#comment-15851588 ] Aseem Bansal commented on SPARK-19444: -- https://github.com/apache/spark/pull/16789 > Tokenizer

[jira] [Commented] (SPARK-19449) Inconsistent results between ml package RandomForestClassificationModel and mllib package RandomForestModel

[ https://issues.apache.org/jira/browse/SPARK-19449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851576#comment-15851576 ] Aseem Bansal commented on SPARK-19449: -- Isn't the decision tree debug string print it as a series of

[jira] [Commented] (SPARK-19449) Inconsistent results between ml package RandomForestClassificationModel and mllib package RandomForestModel

[ https://issues.apache.org/jira/browse/SPARK-19449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851568#comment-15851568 ] Aseem Bansal commented on SPARK-19449: -- [~srowen] I removed some extra code. The part where I did

[jira] [Updated] (SPARK-19449) Inconsistent results between ml package RandomForestClassificationModel and mllib package RandomForestModel

[ https://issues.apache.org/jira/browse/SPARK-19449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aseem Bansal updated SPARK-19449: - Description: I worked on some code to convert ml package RandomForestClassificationModel to

[jira] [Updated] (SPARK-19449) Inconsistent results between ml package RandomForestClassificationModel and mllib package RandomForestModel

[ https://issues.apache.org/jira/browse/SPARK-19449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aseem Bansal updated SPARK-19449: - Description: I worked on some code to convert ml package RandomForestClassificationModel to

[jira] [Updated] (SPARK-19449) Inconsistent results between ml package RandomForestClassificationModel and mllib package RandomForestModel

[ https://issues.apache.org/jira/browse/SPARK-19449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aseem Bansal updated SPARK-19449: - Description: I worked on some code to convert ml package RandomForestClassificationModel to

[jira] [Created] (SPARK-19449) Inconsistent results between ml package RandomForestClassificationModel and mllib package RandomForestModel

Aseem Bansal created SPARK-19449: Summary: Inconsistent results between ml package RandomForestClassificationModel and mllib package RandomForestModel Key: SPARK-19449 URL:

[jira] [Created] (SPARK-19445) Please remove tylerchap...@yahoo-inc.com subscription from u...@spark.apache.org

Aseem Bansal created SPARK-19445: Summary: Please remove tylerchap...@yahoo-inc.com subscription from u...@spark.apache.org Key: SPARK-19445 URL: https://issues.apache.org/jira/browse/SPARK-19445

[jira] [Commented] (SPARK-19444) Tokenizer example does not compile without extra imports

[ https://issues.apache.org/jira/browse/SPARK-19444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851382#comment-15851382 ] Aseem Bansal commented on SPARK-19444: -- [~srowen] I can find the location at

[jira] [Updated] (SPARK-19444) Tokenizer example does not compile without extra imports

[ https://issues.apache.org/jira/browse/SPARK-19444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aseem Bansal updated SPARK-19444: - Priority: Minor (was: Major) > Tokenizer example does not compile without extra imports >

[jira] [Created] (SPARK-19444) Tokenizer example does not compile without extra imports

Aseem Bansal created SPARK-19444: Summary: Tokenizer example does not compile without extra imports Key: SPARK-19444 URL: https://issues.apache.org/jira/browse/SPARK-19444 Project: Spark

[jira] (SPARK-19410) Links to API documentation are broken

Title: Message Title Aseem Bansal created an issue

[jira] [Comment Edited] (SPARK-10413) Model should support prediction on single instance

[ https://issues.apache.org/jira/browse/SPARK-10413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734495#comment-15734495 ] Aseem Bansal edited comment on SPARK-10413 at 12/9/16 6:39 AM: --- Hi Is

[jira] [Commented] (SPARK-10413) Model should support prediction on single instance

[ https://issues.apache.org/jira/browse/SPARK-10413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734495#comment-15734495 ] Aseem Bansal commented on SPARK-10413: -- Hi Is anyone working on this? > Model should support

[jira] [Commented] (SPARK-18241) If Spark Launcher fails to startApplication then handle's state does not change

[ https://issues.apache.org/jira/browse/SPARK-18241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631898#comment-15631898 ] Aseem Bansal commented on SPARK-18241: -- Looking at the source code after mainClass =

[jira] [Created] (SPARK-18241) If Spark Launcher fails to startApplication then handle's state does not change

Aseem Bansal created SPARK-18241: Summary: If Spark Launcher fails to startApplication then handle's state does not change Key: SPARK-18241 URL: https://issues.apache.org/jira/browse/SPARK-18241

[jira] [Comment Edited] (SPARK-17742) Spark Launcher does not get failed state in Listener

[ https://issues.apache.org/jira/browse/SPARK-17742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535315#comment-15535315 ] Aseem Bansal edited comment on SPARK-17742 at 9/30/16 7:35 AM: --- I dug into

[jira] [Commented] (SPARK-17742) Spark Launcher does not get failed state in Listener

[ https://issues.apache.org/jira/browse/SPARK-17742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535315#comment-15535315 ] Aseem Bansal commented on SPARK-17742: -- I dug into the launcher code to see if I can figure out how

[jira] [Created] (SPARK-17742) Spark Launcher does not get failed state in Listener

Aseem Bansal created SPARK-17742: Summary: Spark Launcher does not get failed state in Listener Key: SPARK-17742 URL: https://issues.apache.org/jira/browse/SPARK-17742 Project: Spark Issue

[jira] [Commented] (SPARK-17560) SQLContext tables returns table names in lower case only

[ https://issues.apache.org/jira/browse/SPARK-17560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15495960#comment-15495960 ] Aseem Bansal commented on SPARK-17560: -- Can you share where this option needs to be set? Maybe I can

[jira] [Commented] (SPARK-17560) SQLContext tables returns table names in lower case only

[ https://issues.apache.org/jira/browse/SPARK-17560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15495906#comment-15495906 ] Aseem Bansal commented on SPARK-17560: -- Looked through

[jira] [Updated] (SPARK-17561) DataFrameWriter documentation formatting problems

[ https://issues.apache.org/jira/browse/SPARK-17561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aseem Bansal updated SPARK-17561: - Description: I visited this page

[jira] [Updated] (SPARK-17561) DataFrameWriter documentation formatting problems

[ https://issues.apache.org/jira/browse/SPARK-17561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aseem Bansal updated SPARK-17561: - Description: I visited this page

[jira] [Updated] (SPARK-17561) DataFrameWriter documentation formatting problems

[ https://issues.apache.org/jira/browse/SPARK-17561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aseem Bansal updated SPARK-17561: - Attachment: screenshot-1.png > DataFrameWriter documentation formatting problems >

[jira] [Created] (SPARK-17561) DataFrameWriter documentation formatting problems

Aseem Bansal created SPARK-17561: Summary: DataFrameWriter documentation formatting problems Key: SPARK-17561 URL: https://issues.apache.org/jira/browse/SPARK-17561 Project: Spark Issue

[jira] [Commented] (SPARK-17560) SQLContext tables returns table names in lower case only

[ https://issues.apache.org/jira/browse/SPARK-17560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15495862#comment-15495862 ] Aseem Bansal commented on SPARK-17560: -- No I did not. Where? > SQLContext tables returns table

[jira] [Comment Edited] (SPARK-17560) SQLContext tables returns table names in lower case only

[ https://issues.apache.org/jira/browse/SPARK-17560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15495862#comment-15495862 ] Aseem Bansal edited comment on SPARK-17560 at 9/16/16 9:38 AM: --- No I did

[jira] [Created] (SPARK-17560) SQLContext tables returns table names in lower case only

Aseem Bansal created SPARK-17560: Summary: SQLContext tables returns table names in lower case only Key: SPARK-17560 URL: https://issues.apache.org/jira/browse/SPARK-17560 Project: Spark

[jira] [Commented] (SPARK-17307) Document what all access is needed on S3 bucket when trying to save a model

[ https://issues.apache.org/jira/browse/SPARK-17307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1540#comment-1540 ] Aseem Bansal commented on SPARK-17307: -- Not adding it there would be fine. But there needs to be

[jira] [Commented] (SPARK-17307) Document what all access is needed on S3 bucket when trying to save a model

[ https://issues.apache.org/jira/browse/SPARK-17307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15454791#comment-15454791 ] Aseem Bansal commented on SPARK-17307: -- I would add that bit of information at

[jira] [Created] (SPARK-17307) Document what all access is needed on S3 bucket when trying to save a model

Aseem Bansal created SPARK-17307: Summary: Document what all access is needed on S3 bucket when trying to save a model Key: SPARK-17307 URL: https://issues.apache.org/jira/browse/SPARK-17307 Project:

[jira] [Updated] (SPARK-17012) Reading data frames via CSV - Allow to specify default value for integers

[ https://issues.apache.org/jira/browse/SPARK-17012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aseem Bansal updated SPARK-17012: - Description: Currently the option that we have in DataFrameReader is nullValue which allows us

[jira] [Created] (SPARK-17012) Reading data frames via CSV - Allow to specify default value for integers

Aseem Bansal created SPARK-17012: Summary: Reading data frames via CSV - Allow to specify default value for integers Key: SPARK-17012 URL: https://issues.apache.org/jira/browse/SPARK-17012 Project:

[jira] [Commented] (SPARK-16893) Spark CSV Provider option is not documented

[ https://issues.apache.org/jira/browse/SPARK-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15409260#comment-15409260 ] Aseem Bansal commented on SPARK-16893: -- Yes. I would expect it to work without the use of format

[jira] [Commented] (SPARK-16893) Spark CSV Provider option is not documented

[ https://issues.apache.org/jira/browse/SPARK-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15409183#comment-15409183 ] Aseem Bansal commented on SPARK-16893: -- Reading a CSV causes an exception. Code used and excpetion

[jira] [Comment Edited] (SPARK-16895) Reading empty string from csv has changed behaviour

[ https://issues.apache.org/jira/browse/SPARK-16895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15408892#comment-15408892 ] Aseem Bansal edited comment on SPARK-16895 at 8/5/16 5:19 AM: -- I see that

[jira] [Commented] (SPARK-16895) Reading empty string from csv has changed behaviour

[ https://issues.apache.org/jira/browse/SPARK-16895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15408892#comment-15408892 ] Aseem Bansal commented on SPARK-16895: -- I understand that it is duplicate. Regarding it being a bug

[jira] [Created] (SPARK-16896) Loading csv with duplicate column names

Aseem Bansal created SPARK-16896: Summary: Loading csv with duplicate column names Key: SPARK-16896 URL: https://issues.apache.org/jira/browse/SPARK-16896 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-16896) Loading csv with duplicate column names

[ https://issues.apache.org/jira/browse/SPARK-16896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15407604#comment-15407604 ] Aseem Bansal commented on SPARK-16896: -- [~hyukjin.kwon] cc > Loading csv with duplicate column

[jira] [Commented] (SPARK-16893) Spark CSV Provider option is not documented

[ https://issues.apache.org/jira/browse/SPARK-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15407601#comment-15407601 ] Aseem Bansal commented on SPARK-16893: -- [~hyukjin.kwon] cc > Spark CSV Provider option is not

[jira] [Commented] (SPARK-16895) Reading empty string from csv has changed behaviour

[ https://issues.apache.org/jira/browse/SPARK-16895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15407602#comment-15407602 ] Aseem Bansal commented on SPARK-16895: -- [~hyukjin.kwon] cc > Reading empty string from csv has

[jira] [Created] (SPARK-16895) Reading empty string from csv has changed behaviour

Aseem Bansal created SPARK-16895: Summary: Reading empty string from csv has changed behaviour Key: SPARK-16895 URL: https://issues.apache.org/jira/browse/SPARK-16895 Project: Spark Issue

[jira] [Updated] (SPARK-16893) Spark CSV Provider option is not documented

[ https://issues.apache.org/jira/browse/SPARK-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aseem Bansal updated SPARK-16893: - Description: I was working with databricks spark csv library and came across an error. I have

[jira] [Created] (SPARK-16893) Spark CSV Provider option is not documented

Aseem Bansal created SPARK-16893: Summary: Spark CSV Provider option is not documented Key: SPARK-16893 URL: https://issues.apache.org/jira/browse/SPARK-16893 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9678) HTTP request to BlockManager port yields exception

[ https://issues.apache.org/jira/browse/SPARK-9678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662321#comment-14662321 ] Aseem Bansal commented on SPARK-9678: - I understand. Just thought to mention that.

[jira] [Updated] (SPARK-9678) Exception while going through quick start

[ https://issues.apache.org/jira/browse/SPARK-9678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aseem Bansal updated SPARK-9678: Description: I was going through the quick start for spark 1.4.1 at

[jira] [Created] (SPARK-9678) Exception while going through quick start

Aseem Bansal created SPARK-9678: --- Summary: Exception while going through quick start Key: SPARK-9678 URL: https://issues.apache.org/jira/browse/SPARK-9678 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-9678) Exception while going through quick start

[ https://issues.apache.org/jira/browse/SPARK-9678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aseem Bansal updated SPARK-9678: Description: I was going through the quick start for spark 1.4.1 at