[jira] [Commented] (SPARK-17733) InferFiltersFromConstraints rule never terminates for query

2016-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537900#comment-15537900 ] Apache Spark commented on SPARK-17733: -- User 'jiangxb1987' has created a pull request for this

[jira] [Assigned] (SPARK-17733) InferFiltersFromConstraints rule never terminates for query

2016-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17733: Assignee: (was: Apache Spark) > InferFiltersFromConstraints rule never terminates for

[jira] [Assigned] (SPARK-17733) InferFiltersFromConstraints rule never terminates for query

2016-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17733: Assignee: Apache Spark > InferFiltersFromConstraints rule never terminates for query >

[jira] [Updated] (SPARK-17739) Collapse adjacent similar Window operators

2016-09-30 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17739: -- Issue Type: Improvement (was: Bug) > Collapse adjacent similar Window operators >

[jira] [Resolved] (SPARK-17739) Collapse adjacent similar Window operators

2016-09-30 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17739. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.1.0

[jira] [Commented] (SPARK-17733) InferFiltersFromConstraints rule never terminates for query

2016-09-30 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537815#comment-15537815 ] Jiang Xingbo commented on SPARK-17733: -- [~sameer]Thank you for your help! Since

[jira] [Assigned] (SPARK-17750) Cannot create view which includes interval arithmetic

2016-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17750: Assignee: Apache Spark > Cannot create view which includes interval arithmetic >

[jira] [Assigned] (SPARK-17750) Cannot create view which includes interval arithmetic

2016-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17750: Assignee: (was: Apache Spark) > Cannot create view which includes interval arithmetic

[jira] [Commented] (SPARK-17750) Cannot create view which includes interval arithmetic

2016-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537772#comment-15537772 ] Apache Spark commented on SPARK-17750: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-17709) spark 2.0 join - column resolution error

2016-09-30 Thread Ashish Shrowty (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537740#comment-15537740 ] Ashish Shrowty commented on SPARK-17709: Join keys are both companyid and loyaltycardnumber.

[jira] [Resolved] (SPARK-15353) Making peer selection for block replication pluggable

2016-09-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15353. - Resolution: Fixed Assignee: Shubham Chopra Fix Version/s: 2.1.0 > Making peer

[jira] [Commented] (SPARK-17556) Executor side broadcast for broadcast joins

2016-09-30 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537544#comment-15537544 ] Liang-Chi Hsieh commented on SPARK-17556: - Update the design document again to address some

[jira] [Updated] (SPARK-17556) Executor side broadcast for broadcast joins

2016-09-30 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-17556: Attachment: (was: executor-side-broadcast.pdf) > Executor side broadcast for broadcast

[jira] [Updated] (SPARK-17556) Executor side broadcast for broadcast joins

2016-09-30 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-17556: Attachment: executor-side-broadcast.pdf > Executor side broadcast for broadcast joins >

[jira] [Resolved] (SPARK-17703) Add unnamed version of addReferenceObj for minor objects.

2016-09-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17703. - Resolution: Fixed Assignee: Takuya Ueshin Fix Version/s: 2.1.0 > Add unnamed

[jira] [Commented] (SPARK-17707) Web UI prevents spark-submit application to be finished

2016-09-30 Thread Nick Orka (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537498#comment-15537498 ] Nick Orka commented on SPARK-17707: --- I noticed this a couple of days ago. We've just switched to Spark

[jira] [Commented] (SPARK-17669) Strange behavior using Datasets

2016-09-30 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537420#comment-15537420 ] Miles Crawford commented on SPARK-17669: Was not able to reproduce using a variety of

[jira] [Commented] (SPARK-17755) Master may ask a worker to launch an executor before

2016-09-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537411#comment-15537411 ] Yin Huai commented on SPARK-17755: -- cc [~joshrosen] > Master may ask a worker to launch an executor

[jira] [Updated] (SPARK-17755) Master may ask a worker to launch an executor before

2016-09-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-17755: - Description: I somehow saw a failed test {{org.apache.spark.DistributedSuite.caching in memory,

[jira] [Created] (SPARK-17755) Master may ask a worker to launch an executor before

2016-09-30 Thread Yin Huai (JIRA)
Yin Huai created SPARK-17755: Summary: Master may ask a worker to launch an executor before Key: SPARK-17755 URL: https://issues.apache.org/jira/browse/SPARK-17755 Project: Spark Issue Type:

[jira] [Commented] (SPARK-17750) Cannot create view which includes interval arithmetic

2016-09-30 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537389#comment-15537389 ] Dongjoon Hyun commented on SPARK-17750: --- Hi, [~andreasdamm]. It really does. I'll make a PR for

[jira] [Commented] (SPARK-17709) spark 2.0 join - column resolution error

2016-09-30 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537336#comment-15537336 ] Dilip Biswal commented on SPARK-17709: -- [~ashrowty] Hmmn.. and your join keys are companyid or

[jira] [Updated] (SPARK-17754) DataFrame reader and writer don't show Input/Output metrics in Spark UI

2016-09-30 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-17754: Component/s: Web UI SQL > DataFrame reader and writer don't show Input/Output

[jira] [Created] (SPARK-17754) DataFrame reader and writer don't show Input/Output metrics in Spark UI

2016-09-30 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-17754: --- Summary: DataFrame reader and writer don't show Input/Output metrics in Spark UI Key: SPARK-17754 URL: https://issues.apache.org/jira/browse/SPARK-17754 Project: Spark

[jira] [Commented] (SPARK-17074) generate histogram information for column

2016-09-30 Thread Timothy Hunter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537295#comment-15537295 ] Timothy Hunter commented on SPARK-17074: We have discussed this through email and either is fine.

[jira] [Commented] (SPARK-17709) spark 2.0 join - column resolution error

2016-09-30 Thread Ashish Shrowty (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537264#comment-15537264 ] Ashish Shrowty commented on SPARK-17709: [~dkbiswal] Attached are the explain() outputs -

[jira] [Updated] (SPARK-17753) Simple case in spark sql throws ParseException

2016-09-30 Thread kanika dhuria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanika dhuria updated SPARK-17753: -- Description: Simple case in sql throws parser exception in spark 2.0. The following query as

[jira] [Updated] (SPARK-17753) Simple case in spark sql throws ParseException

2016-09-30 Thread kanika dhuria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanika dhuria updated SPARK-17753: -- Description: Simple case in sql throws parser exception in spark 2.0. The following query

[jira] [Commented] (SPARK-17739) Collapse adjacent similar Window operators

2016-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537252#comment-15537252 ] Apache Spark commented on SPARK-17739: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-17739) Collapse adjacent similar Window operators

2016-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17739: Assignee: Apache Spark > Collapse adjacent similar Window operators >

[jira] [Assigned] (SPARK-17739) Collapse adjacent similar Window operators

2016-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17739: Assignee: (was: Apache Spark) > Collapse adjacent similar Window operators >

[jira] [Updated] (SPARK-17753) Simple case in spark sql throws ParseException

2016-09-30 Thread kanika dhuria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanika dhuria updated SPARK-17753: -- Description: Simple case in sql throws parser exception in spark 2.0. The following query

[jira] [Commented] (SPARK-17074) generate histogram information for column

2016-09-30 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537248#comment-15537248 ] Zhenhua Wang commented on SPARK-17074: -- Hi, there's something I want to discuss here. In order to

[jira] [Updated] (SPARK-17753) Simple case in spark sql throws ParseException

2016-09-30 Thread kanika dhuria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanika dhuria updated SPARK-17753: -- Summary: Simple case in spark sql throws ParseException (was: Simple case in spark sql throws

[jira] [Created] (SPARK-17753) Simple case in spark sql throws ParserException

2016-09-30 Thread kanika dhuria (JIRA)
kanika dhuria created SPARK-17753: - Summary: Simple case in spark sql throws ParserException Key: SPARK-17753 URL: https://issues.apache.org/jira/browse/SPARK-17753 Project: Spark Issue

[jira] [Updated] (SPARK-17752) Spark returns incorrect result when 'collect()'ing a cached Dataset with many columns

2016-09-30 Thread Kevin Ushey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Ushey updated SPARK-17752: Description: Run the following code (modify SPARK_HOME to point to a Spark 2.0.0 installation as

[jira] [Updated] (SPARK-17752) Spark returns incorrect result when 'collect()'ing a cached Dataset with many columns

2016-09-30 Thread Kevin Ushey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Ushey updated SPARK-17752: Description: Run the following code (modify SPARK_HOME to point to a Spark 2.0.0 installation as

[jira] [Updated] (SPARK-17752) Spark returns incorrect result when 'collect()'ing a cached Dataset with many columns

2016-09-30 Thread Kevin Ushey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Ushey updated SPARK-17752: Description: Run the following code (modify SPARK_HOME to point to a Spark 2.0.0 installation as

[jira] [Created] (SPARK-17752) Spark returns incorrect result when 'collect()'ing a cached Dataset with many columns

2016-09-30 Thread Kevin Ushey (JIRA)
Kevin Ushey created SPARK-17752: --- Summary: Spark returns incorrect result when 'collect()'ing a cached Dataset with many columns Key: SPARK-17752 URL: https://issues.apache.org/jira/browse/SPARK-17752

[jira] [Comment Edited] (SPARK-17709) spark 2.0 join - column resolution error

2016-09-30 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537205#comment-15537205 ] Dilip Biswal edited comment on SPARK-17709 at 9/30/16 10:07 PM: @ashrowty

[jira] [Commented] (SPARK-17709) spark 2.0 join - column resolution error

2016-09-30 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537205#comment-15537205 ] Dilip Biswal commented on SPARK-17709: -- @ashrowty Hi Ashish, is it possible for you to post explain

[jira] [Commented] (SPARK-17751) Remove spark.sql.eagerAnalysis

2016-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537197#comment-15537197 ] Apache Spark commented on SPARK-17751: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17751) Remove spark.sql.eagerAnalysis

2016-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17751: Assignee: Apache Spark > Remove spark.sql.eagerAnalysis > --

[jira] [Assigned] (SPARK-17751) Remove spark.sql.eagerAnalysis

2016-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17751: Assignee: (was: Apache Spark) > Remove spark.sql.eagerAnalysis >

[jira] [Created] (SPARK-17751) Remove spark.sql.eagerAnalysis

2016-09-30 Thread Xiao Li (JIRA)
Xiao Li created SPARK-17751: --- Summary: Remove spark.sql.eagerAnalysis Key: SPARK-17751 URL: https://issues.apache.org/jira/browse/SPARK-17751 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-17737) cannot import name accumulators error

2016-09-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17737. --- Resolution: Duplicate > cannot import name accumulators error >

[jira] [Commented] (SPARK-17746) Code duplication to compute the path to spark-defaults.conf

2016-09-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537130#comment-15537130 ] Sean Owen commented on SPARK-17746: --- I'm not sure it can, because core and launcher don't / can't

[jira] [Created] (SPARK-17750) Cannot create view which includes interval arithmetic

2016-09-30 Thread Andreas Damm (JIRA)
Andreas Damm created SPARK-17750: Summary: Cannot create view which includes interval arithmetic Key: SPARK-17750 URL: https://issues.apache.org/jira/browse/SPARK-17750 Project: Spark Issue

[jira] [Created] (SPARK-17749) Unresolved columns when nesting SQL join clauses

2016-09-30 Thread Andreas Damm (JIRA)
Andreas Damm created SPARK-17749: Summary: Unresolved columns when nesting SQL join clauses Key: SPARK-17749 URL: https://issues.apache.org/jira/browse/SPARK-17749 Project: Spark Issue Type:

[jira] [Commented] (SPARK-17739) Collapse adjacent similar Window operators

2016-09-30 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536993#comment-15536993 ] Dongjoon Hyun commented on SPARK-17739: --- Thank you! > Collapse adjacent similar Window operators >

[jira] [Commented] (SPARK-17739) Collapse adjacent similar Window operators

2016-09-30 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536957#comment-15536957 ] Herman van Hovell commented on SPARK-17739: --- Go ahead! > Collapse adjacent similar Window

[jira] [Commented] (SPARK-17739) Collapse adjacent similar Window operators

2016-09-30 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536936#comment-15536936 ] Dongjoon Hyun commented on SPARK-17739: --- Hi, [~hvanhovell]. This issue looks important and

[jira] [Updated] (SPARK-17716) Hidden Markov Model (HMM)

2016-09-30 Thread Runxin Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runxin Li updated SPARK-17716: -- Description: Had an offline chat with [~Lil'Rex], who implemented HMM on Spark at

[jira] [Updated] (SPARK-17748) One-pass algorithm for linear regression with L1 and elastic-net penalties

2016-09-30 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-17748: Assignee: Seth Hendrickson > One-pass algorithm for linear regression with L1 and elastic-net penalties >

[jira] [Updated] (SPARK-17748) One-pass algorithm for linear regression with L1 and elastic-net penalties

2016-09-30 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-17748: Issue Type: New Feature (was: Bug) > One-pass algorithm for linear regression with L1 and elastic-net

[jira] [Comment Edited] (SPARK-17748) One-pass algorithm for linear regression with L1 and elastic-net penalties

2016-09-30 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536781#comment-15536781 ] Seth Hendrickson edited comment on SPARK-17748 at 9/30/16 7:16 PM: --- I

[jira] [Comment Edited] (SPARK-17748) One-pass algorithm for linear regression with L1 and elastic-net penalties

2016-09-30 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536781#comment-15536781 ] Seth Hendrickson edited comment on SPARK-17748 at 9/30/16 7:16 PM: --- I

[jira] [Commented] (SPARK-17748) One-pass algorithm for linear regression with L1 and elastic-net penalties

2016-09-30 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536781#comment-15536781 ] Seth Hendrickson commented on SPARK-17748: -- I am working on this currently. The basic plan is to

[jira] [Created] (SPARK-17748) One-pass algorithm for linear regression with L1 and elastic-net penalties

2016-09-30 Thread Seth Hendrickson (JIRA)
Seth Hendrickson created SPARK-17748: Summary: One-pass algorithm for linear regression with L1 and elastic-net penalties Key: SPARK-17748 URL: https://issues.apache.org/jira/browse/SPARK-17748

[jira] [Commented] (SPARK-17709) spark 2.0 join - column resolution error

2016-09-30 Thread Ashish Shrowty (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536694#comment-15536694 ] Ashish Shrowty commented on SPARK-17709: Sorry ... its not really col1, its another column ..

[jira] [Comment Edited] (SPARK-17709) spark 2.0 join - column resolution error

2016-09-30 Thread Ashish Shrowty (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535957#comment-15535957 ] Ashish Shrowty edited comment on SPARK-17709 at 9/30/16 6:37 PM: - Sure ..

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-09-30 Thread Matthew Seal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536646#comment-15536646 ] Matthew Seal commented on SPARK-4105: - Backing off executor memory away from boundary of physical

[jira] [Commented] (SPARK-17733) InferFiltersFromConstraints rule never terminates for query

2016-09-30 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536636#comment-15536636 ] Sameer Agarwal commented on SPARK-17733: Thanks [~jiangxb], we came to the same conclusion

[jira] [Commented] (SPARK-17737) cannot import name accumulators error

2016-09-30 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536516#comment-15536516 ] Bryan Cutler commented on SPARK-17737: -- Ah, sorry I didn't ready your stacktrace properly. I've

[jira] [Commented] (SPARK-17709) spark 2.0 join - column resolution error

2016-09-30 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536464#comment-15536464 ] Dilip Biswal commented on SPARK-17709: -- [~ashrowty] Ashish, you have the same column name as regular

[jira] [Updated] (SPARK-17738) Flaky test: org.apache.spark.sql.execution.columnar.ColumnTypeSuite MAP append/extract

2016-09-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-17738: --- Fix Version/s: (was: 2.2.0) 2.1.0 > Flaky test:

[jira] [Resolved] (SPARK-17738) Flaky test: org.apache.spark.sql.execution.columnar.ColumnTypeSuite MAP append/extract

2016-09-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-17738. Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 15305

[jira] [Commented] (SPARK-17097) Pregel does not keep vertex state properly; fails to terminate

2016-09-30 Thread Seth Bromberger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536356#comment-15536356 ] Seth Bromberger commented on SPARK-17097: - Great explanation. Thank you very much! > Pregel does

[jira] [Commented] (SPARK-5575) Artificial neural networks for MLlib deep learning

2016-09-30 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536321#comment-15536321 ] Alexander Ulanov commented on SPARK-5575: - I recently released a package to handle new features

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-09-30 Thread Luca Menichetti (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535884#comment-15535884 ] Luca Menichetti edited comment on SPARK-4105 at 9/30/16 2:25 PM: - I have

[jira] [Commented] (SPARK-17747) WeightCol support non-double datetypes

2016-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536113#comment-15536113 ] Apache Spark commented on SPARK-17747: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-17747) WeightCol support non-double datetypes

2016-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17747: Assignee: (was: Apache Spark) > WeightCol support non-double datetypes >

[jira] [Assigned] (SPARK-17747) WeightCol support non-double datetypes

2016-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17747: Assignee: Apache Spark > WeightCol support non-double datetypes >

[jira] [Comment Edited] (SPARK-12334) Support read from multiple input paths for orc file in DataFrameReader.orc

2016-09-30 Thread Vishal Donderia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536110#comment-15536110 ] Vishal Donderia edited comment on SPARK-12334 at 9/30/16 2:15 PM: -- Is

[jira] [Commented] (SPARK-12334) Support read from multiple input paths for orc file in DataFrameReader.orc

2016-09-30 Thread Vishal Donderia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536110#comment-15536110 ] Vishal Donderia commented on SPARK-12334: - Is above patch is working fine ? > Support read

[jira] [Updated] (SPARK-17747) WeightCol support non-double datetypes

2016-09-30 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-17747: - Description: WeightCol only support double type now, which should fit with other numeric types,

[jira] [Created] (SPARK-17747) WeightCol support non-double datetypes

2016-09-30 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-17747: Summary: WeightCol support non-double datetypes Key: SPARK-17747 URL: https://issues.apache.org/jira/browse/SPARK-17747 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-09-30 Thread Luca Menichetti (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535884#comment-15535884 ] Luca Menichetti edited comment on SPARK-4105 at 9/30/16 2:04 PM: - I have

[jira] [Commented] (SPARK-14077) Support weighted instances in naive Bayes

2016-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536076#comment-15536076 ] Apache Spark commented on SPARK-14077: -- User 'zhengruifeng' has created a pull request for this

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-09-30 Thread Luca Menichetti (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535884#comment-15535884 ] Luca Menichetti edited comment on SPARK-4105 at 9/30/16 1:54 PM: - I have

[jira] [Created] (SPARK-17746) Code duplication to compute the path to spark-defaults.conf

2016-09-30 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-17746: --- Summary: Code duplication to compute the path to spark-defaults.conf Key: SPARK-17746 URL: https://issues.apache.org/jira/browse/SPARK-17746 Project: Spark

[jira] [Commented] (SPARK-17744) Parity check between the ml and mllib test suites for NB

2016-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536032#comment-15536032 ] Apache Spark commented on SPARK-17744: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-17744) Parity check between the ml and mllib test suites for NB

2016-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17744: Assignee: Apache Spark > Parity check between the ml and mllib test suites for NB >

[jira] [Assigned] (SPARK-17744) Parity check between the ml and mllib test suites for NB

2016-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17744: Assignee: (was: Apache Spark) > Parity check between the ml and mllib test suites for

[jira] [Commented] (SPARK-17745) Update Python API for NB to support weighted instances

2016-09-30 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535983#comment-15535983 ] zhengruifeng commented on SPARK-17745: -- GO ahead! > Update Python API for NB to support weighted

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-09-30 Thread Bezruchko Vadim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535979#comment-15535979 ] Bezruchko Vadim commented on SPARK-4105: we had gotten the same behavior but the problem was in

[jira] [Commented] (SPARK-17709) spark 2.0 join - column resolution error

2016-09-30 Thread Ashish Shrowty (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535957#comment-15535957 ] Ashish Shrowty commented on SPARK-17709: Sure .. the data is brought over into the EMR (5.0.0)

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-09-30 Thread Luca Menichetti (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535884#comment-15535884 ] Luca Menichetti edited comment on SPARK-4105 at 9/30/16 12:43 PM: -- I have

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-09-30 Thread Luca Menichetti (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535884#comment-15535884 ] Luca Menichetti commented on SPARK-4105: I have exactly the same problem. It occurs when I process

[jira] [Updated] (SPARK-17745) Update Python API for NB to support weighted instances

2016-09-30 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-17745: --- Component/s: PySpark > Update Python API for NB to support weighted instances >

[jira] [Updated] (SPARK-17744) Parity check between the ml and mllib test suites for NB

2016-09-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-17744: Description: We have moving {{NaiveBayes}} implementation from mllib to ml package in SPARK-14077.

[jira] [Updated] (SPARK-17744) Parity check between the ml and mllib test suites for NB

2016-09-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-17744: Description: We have moving {{NaiveBayes}} implementation from mllib to ml package in SPARK-14077.

[jira] [Updated] (SPARK-17744) Parity check between the ml and mllib test suites for NB

2016-09-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-17744: Description: We have moving {{NaiveBayes}} implementation from mllib to ml package in SPARK-14077.

[jira] [Updated] (SPARK-17744) Parity check between the ml and mllib test suites for NB

2016-09-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-17744: Priority: Minor (was: Major) > Parity check between the ml and mllib test suites for NB >

[jira] [Commented] (SPARK-17744) Parity check between the ml and mllib test suites for NB

2016-09-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535775#comment-15535775 ] Yanbo Liang commented on SPARK-17744: - [~srowen] We are working to copy algorithm implementations

[jira] [Commented] (SPARK-17745) Update Python API for NB to support weighted instances

2016-09-30 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535750#comment-15535750 ] Weichen Xu commented on SPARK-17745: I will work on it and create PR ASAP, thanks! > Update Python

[jira] [Updated] (SPARK-17745) Update Python API for NB to support weighted instances

2016-09-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-17745: Priority: Minor (was: Major) > Update Python API for NB to support weighted instances >

[jira] [Comment Edited] (SPARK-17733) InferFiltersFromConstraints rule never terminates for query

2016-09-30 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535727#comment-15535727 ] Jiang Xingbo edited comment on SPARK-17733 at 9/30/16 11:26 AM: The

[jira] [Comment Edited] (SPARK-17733) InferFiltersFromConstraints rule never terminates for query

2016-09-30 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535727#comment-15535727 ] Jiang Xingbo edited comment on SPARK-17733 at 9/30/16 11:21 AM: The

[jira] [Comment Edited] (SPARK-17733) InferFiltersFromConstraints rule never terminates for query

2016-09-30 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535727#comment-15535727 ] Jiang Xingbo edited comment on SPARK-17733 at 9/30/16 11:20 AM: The

  1   2   >