[jira] [Resolved] (SPARK-13612) Multiplication of BigDecimal columns not working as expected

2017-11-09 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varadharajan resolved SPARK-13612. -- Resolution: Workaround > Multiplication of BigDecimal columns not working as expected > ---

[jira] [Comment Edited] (SPARK-15156) String fields in Dataframe behaves weirdly when executor-memory >= 32GB

2016-05-05 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272277#comment-15272277 ] Varadharajan edited comment on SPARK-15156 at 5/5/16 1:09 PM: -

[jira] [Commented] (SPARK-15156) String fields in Dataframe behaves weirdly when executor-memory >= 32GB

2016-05-05 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272277#comment-15272277 ] Varadharajan commented on SPARK-15156: -- Thanks. This issue was tested on 1.5.0. May

[jira] [Closed] (SPARK-15157) String fields in Dataframe behaves weirdly when executor-memory >= 32GB

2016-05-05 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varadharajan closed SPARK-15157. Resolution: Fixed > String fields in Dataframe behaves weirdly when executor-memory >= 32GB > -

[jira] [Commented] (SPARK-15157) String fields in Dataframe behaves weirdly when executor-memory >= 32GB

2016-05-05 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272264#comment-15272264 ] Varadharajan commented on SPARK-15157: -- Duplicate of SPARK-15156. Sorry :( > String

[jira] [Created] (SPARK-15156) String fields in Dataframe behaves weirdly when executor-memory >= 32GB

2016-05-05 Thread Varadharajan (JIRA)
Varadharajan created SPARK-15156: Summary: String fields in Dataframe behaves weirdly when executor-memory >= 32GB Key: SPARK-15156 URL: https://issues.apache.org/jira/browse/SPARK-15156 Project: Spar

[jira] [Created] (SPARK-15157) String fields in Dataframe behaves weirdly when executor-memory >= 32GB

2016-05-05 Thread Varadharajan (JIRA)
Varadharajan created SPARK-15157: Summary: String fields in Dataframe behaves weirdly when executor-memory >= 32GB Key: SPARK-15157 URL: https://issues.apache.org/jira/browse/SPARK-15157 Project: Spar

[jira] [Commented] (SPARK-13393) Column mismatch issue in left_outer join using Spark DataFrame

2016-03-01 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15175052#comment-15175052 ] Varadharajan commented on SPARK-13393: -- [~adrian-wang] Thanks a lot :) > Column mis

[jira] [Created] (SPARK-13612) Multiplication of BigDecimal columns not working as expected

2016-03-01 Thread Varadharajan (JIRA)
Varadharajan created SPARK-13612: Summary: Multiplication of BigDecimal columns not working as expected Key: SPARK-13612 URL: https://issues.apache.org/jira/browse/SPARK-13612 Project: Spark

[jira] [Commented] (SPARK-13393) Column mismatch issue in left_outer join using Spark DataFrame

2016-03-01 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15175033#comment-15175033 ] Varadharajan commented on SPARK-13393: -- [~rxin] [~marmbrus] Can you share some input

[jira] [Commented] (SPARK-13393) Column mismatch issue in left_outer join using Spark DataFrame

2016-02-20 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15155645#comment-15155645 ] Varadharajan commented on SPARK-13393: -- Hi, Here is the plan for errorDF: {noform

[jira] [Commented] (SPARK-13393) Column mismatch issue in left_outer join using Spark DataFrame

2016-02-19 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15155263#comment-15155263 ] Varadharajan commented on SPARK-13393: -- Hi, I just tried the same scenario with preb

[jira] [Updated] (SPARK-13393) Column mismatch issue in left_outer join using Spark DataFrame

2016-02-19 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varadharajan updated SPARK-13393: - Description: Consider the below snippet: {code:title=test.scala|borderStyle=solid} case class Per

[jira] [Created] (SPARK-13393) Column mismatch issue in left_outer join using Spark DataFrame

2016-02-19 Thread Varadharajan (JIRA)
Varadharajan created SPARK-13393: Summary: Column mismatch issue in left_outer join using Spark DataFrame Key: SPARK-13393 URL: https://issues.apache.org/jira/browse/SPARK-13393 Project: Spark

[jira] [Commented] (SPARK-9555) Cannot use spark-csv in spark-shell

2015-08-03 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653109#comment-14653109 ] Varadharajan commented on SPARK-9555: - [~srowen] Thanks for your response. I tried de

[jira] [Created] (SPARK-9555) Cannot use spark-csv in spark-shell

2015-08-03 Thread Varadharajan (JIRA)
Varadharajan created SPARK-9555: --- Summary: Cannot use spark-csv in spark-shell Key: SPARK-9555 URL: https://issues.apache.org/jira/browse/SPARK-9555 Project: Spark Issue Type: Bug Com

[jira] [Commented] (SPARK-4306) LogisticRegressionWithLBFGS support for PySpark MLlib

2014-11-17 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14214415#comment-14214415 ] Varadharajan commented on SPARK-4306: - [~matei] I'm really sorry. I'm quite occupied t

[jira] [Updated] (SPARK-4306) LogisticRegressionWithLBFGS support for PySpark MLlib

2014-11-10 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varadharajan updated SPARK-4306: Description: Currently we are supporting LogisticRegressionWithSGD in the PySpark MLlib interfact. T

[jira] [Updated] (SPARK-4306) LogisticRegressionWithLBFGS support for PySpark MLlib

2014-11-08 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varadharajan updated SPARK-4306: Issue Type: New Feature (was: Task) > LogisticRegressionWithLBFGS support for PySpark MLlib >

[jira] [Commented] (SPARK-4306) LogisticRegressionWithLBFGS support for PySpark MLlib

2014-11-08 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14203480#comment-14203480 ] Varadharajan commented on SPARK-4306: - Please assign this task to me. > LogisticRegre

[jira] [Comment Edited] (SPARK-4306) LogisticRegressionWithLBFGS support for PySpark MLlib

2014-11-08 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14203480#comment-14203480 ] Varadharajan edited comment on SPARK-4306 at 11/8/14 4:01 PM: --

[jira] [Created] (SPARK-4306) LogisticRegressionWithLBFGS support for PySpark MLlib

2014-11-08 Thread Varadharajan (JIRA)
Varadharajan created SPARK-4306: --- Summary: LogisticRegressionWithLBFGS support for PySpark MLlib Key: SPARK-4306 URL: https://issues.apache.org/jira/browse/SPARK-4306 Project: Spark Issue Type

[jira] [Commented] (SPARK-2432) Apriori algorithm for frequent itemset mining

2014-11-04 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195879#comment-14195879 ] Varadharajan commented on SPARK-2432: - Do we have any updates on this? If its not bein

[jira] [Updated] (SPARK-4047) Generate runtime warning for naive implementation examples for algorithms implemented in MLlib/graphx

2014-10-24 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varadharajan updated SPARK-4047: Description: Based on SPARK-2434, we're generating runtime warnings to denote that the example impl

[jira] [Updated] (SPARK-4047) Generate runtime warning for naive implementation examples for algorithms implemented in MLlib/graphx

2014-10-24 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varadharajan updated SPARK-4047: Description: Based on SPARK-2434, we're generating runtime warnings to denote that the example impl

[jira] [Commented] (SPARK-4047) Generate runtime warning for naive implementation of PageRank example

2014-10-22 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180083#comment-14180083 ] Varadharajan commented on SPARK-4047: - I'm working on this issue. > Generate runtime

[jira] [Updated] (SPARK-4047) Generate runtime warning for naive implementation of PageRank example

2014-10-22 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varadharajan updated SPARK-4047: Description: Based on SPARK-2434, we're generating runtime warnings to denote that the exampl

[jira] [Created] (SPARK-4047) Generate runtime warning for naive implementation of PageRank example

2014-10-22 Thread Varadharajan (JIRA)
Varadharajan created SPARK-4047: --- Summary: Generate runtime warning for naive implementation of PageRank example Key: SPARK-4047 URL: https://issues.apache.org/jira/browse/SPARK-4047 Project: Spark