[jira] [Commented] (SPARK-7368) add QR decomposition for RowMatrix

[ https://issues.apache.org/jira/browse/SPARK-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529214#comment-14529214 ] Zongheng Yang commented on SPARK-7368: -- FYI, the ml-matrix package from AMPLab

[jira] [Commented] (SPARK-2865) Potential deadlock: tasks could hang forever waiting to fetch a remote block even though most tasks finish

[ https://issues.apache.org/jira/browse/SPARK-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088964#comment-14088964 ] Zongheng Yang commented on SPARK-2865: -- Just wanted to point out that I used the

[jira] [Commented] (SPARK-2865) Potential deadlock: tasks could hang forever waiting to fetch a remote block even though most tasks finish

[ https://issues.apache.org/jira/browse/SPARK-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089541#comment-14089541 ] Zongheng Yang commented on SPARK-2865: -- This might be related to the fact that the

[jira] [Created] (SPARK-2865) Potential deadlock: tasks could hang forever waiting to fetch a remote block even though most tasks finish

Zongheng Yang created SPARK-2865: Summary: Potential deadlock: tasks could hang forever waiting to fetch a remote block even though most tasks finish Key: SPARK-2865 URL:

[jira] [Updated] (SPARK-2865) Potential deadlock: tasks could hang forever waiting to fetch a remote block even though most tasks finish

[ https://issues.apache.org/jira/browse/SPARK-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zongheng Yang updated SPARK-2865: - Description: In the application I tested, most of the tasks out of 128 tasks could finish, but

[jira] [Updated] (SPARK-2865) Potential deadlock: tasks could hang forever waiting to fetch a remote block even though most tasks finish

[ https://issues.apache.org/jira/browse/SPARK-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zongheng Yang updated SPARK-2865: - Description: In the application I tested, most of the tasks out of 128 tasks could finish, but

[jira] [Closed] (SPARK-2676) CLONE - LiveListenerBus should set higher capacity for its event queue

[ https://issues.apache.org/jira/browse/SPARK-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zongheng Yang closed SPARK-2676. Resolution: Duplicate CLONE - LiveListenerBus should set higher capacity for its event queue

[jira] [Created] (SPARK-2562) Add Date datatype support to Spark SQL

Zongheng Yang created SPARK-2562: Summary: Add Date datatype support to Spark SQL Key: SPARK-2562 URL: https://issues.apache.org/jira/browse/SPARK-2562 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-2531) Make BroadcastNestedLoopJoin take into account a BuildSide

Zongheng Yang created SPARK-2531: Summary: Make BroadcastNestedLoopJoin take into account a BuildSide Key: SPARK-2531 URL: https://issues.apache.org/jira/browse/SPARK-2531 Project: Spark

[jira] [Commented] (SPARK-2531) Make BroadcastNestedLoopJoin take into account a BuildSide

[ https://issues.apache.org/jira/browse/SPARK-2531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064106#comment-14064106 ] Zongheng Yang commented on SPARK-2531: -- Github PR:

[jira] [Updated] (SPARK-2498) Concurrent initialization of various DataType objects causes exceptions

[ https://issues.apache.org/jira/browse/SPARK-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zongheng Yang updated SPARK-2498: - Priority: Critical (was: Major) Concurrent initialization of various DataType objects causes

[jira] [Created] (SPARK-2498) Concurrent initialization of various DataType objects causes exceptions

Zongheng Yang created SPARK-2498: Summary: Concurrent initialization of various DataType objects causes exceptions Key: SPARK-2498 URL: https://issues.apache.org/jira/browse/SPARK-2498 Project: Spark

[jira] [Commented] (SPARK-2498) Concurrent initialization of various DataType objects causes exceptions

[ https://issues.apache.org/jira/browse/SPARK-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062858#comment-14062858 ] Zongheng Yang commented on SPARK-2498: -- Github PR:

[jira] [Commented] (SPARK-2443) Reading from Partitioned Tables is Slow

[ https://issues.apache.org/jira/browse/SPARK-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059722#comment-14059722 ] Zongheng Yang commented on SPARK-2443: -- I am able to reproduce this behavior locally:

[jira] [Commented] (SPARK-2443) Reading from Partitioned Tables is Slow

[ https://issues.apache.org/jira/browse/SPARK-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059960#comment-14059960 ] Zongheng Yang commented on SPARK-2443: -- Pull request:

[jira] [Created] (SPARK-2436) Apply size-based optimization to planning BroadcastNestedLoopJoin

Zongheng Yang created SPARK-2436: Summary: Apply size-based optimization to planning BroadcastNestedLoopJoin Key: SPARK-2436 URL: https://issues.apache.org/jira/browse/SPARK-2436 Project: Spark

[jira] [Updated] (SPARK-2393) Simple cost estimation and auto selection of broadcast join

[ https://issues.apache.org/jira/browse/SPARK-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zongheng Yang updated SPARK-2393: - Description: Spark SQL should support the common optimization known as cost estimations. For

[jira] [Created] (SPARK-2357) HashFilteredJoin doesn't match some equi-join query

Zongheng Yang created SPARK-2357: Summary: HashFilteredJoin doesn't match some equi-join query Key: SPARK-2357 URL: https://issues.apache.org/jira/browse/SPARK-2357 Project: Spark Issue

[jira] [Resolved] (SPARK-2357) HashFilteredJoin doesn't match some equi-join query

[ https://issues.apache.org/jira/browse/SPARK-2357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zongheng Yang resolved SPARK-2357. -- Resolution: Not a Problem HashFilteredJoin doesn't match some equi-join query

[jira] [Created] (SPARK-2186) Spark SQL DSL support for simple aggregations such as SUM and AVG

Zongheng Yang created SPARK-2186: Summary: Spark SQL DSL support for simple aggregations such as SUM and AVG Key: SPARK-2186 URL: https://issues.apache.org/jira/browse/SPARK-2186 Project: Spark

[jira] [Updated] (SPARK-2186) Spark SQL DSL support for simple aggregations such as SUM and AVG

[ https://issues.apache.org/jira/browse/SPARK-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zongheng Yang updated SPARK-2186: - Affects Version/s: 1.0.0 Spark SQL DSL support for simple aggregations such as SUM and AVG

[jira] [Commented] (SPARK-2155) Support effectful / non-deterministic key expressions in CASE WHEN statements

[ https://issues.apache.org/jira/browse/SPARK-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14036999#comment-14036999 ] Zongheng Yang commented on SPARK-2155: -- Sure, here is the link I used:

[jira] [Updated] (SPARK-2155) Support effectful / non-deterministic key expressions in CASE WHEN statements

[ https://issues.apache.org/jira/browse/SPARK-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zongheng Yang updated SPARK-2155: - Description: Currently we translate CASE KEY WHEN to CASE WHEN, hence incurring redundant

[jira] [Updated] (SPARK-2155) Support effectful / non-deterministic key expressions in CASE WHEN statements

[ https://issues.apache.org/jira/browse/SPARK-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zongheng Yang updated SPARK-2155: - Description: Currently we translate CASE KEY WHEN to CASE WHEN, hence incurring redundant

[jira] [Commented] (SPARK-2053) Add Catalyst expression for CASE WHEN

[ https://issues.apache.org/jira/browse/SPARK-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14028541#comment-14028541 ] Zongheng Yang commented on SPARK-2053: -- Submitted pull request:

[jira] [Created] (SPARK-2081) Undefine output() from the abstract class Command and implement it in concrete subclasses

Zongheng Yang created SPARK-2081: Summary: Undefine output() from the abstract class Command and implement it in concrete subclasses Key: SPARK-2081 URL: https://issues.apache.org/jira/browse/SPARK-2081

[jira] [Commented] (SPARK-1704) java.lang.AssertionError: assertion failed: No plan for ExplainCommand (Project [*])

[ https://issues.apache.org/jira/browse/SPARK-1704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14020340#comment-14020340 ] Zongheng Yang commented on SPARK-1704: -- Just so I understand the desirable output for

[jira] [Created] (SPARK-2046) Support config properties that are changeable across tasks/stages within a job

Zongheng Yang created SPARK-2046: Summary: Support config properties that are changeable across tasks/stages within a job Key: SPARK-2046 URL: https://issues.apache.org/jira/browse/SPARK-2046

[jira] [Commented] (SPARK-2046) Support config properties that are changeable across tasks/stages within a job

[ https://issues.apache.org/jira/browse/SPARK-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14019457#comment-14019457 ] Zongheng Yang commented on SPARK-2046: -- [~shivaram] Support config properties that

[jira] [Commented] (SPARK-1508) Add support for reading from SparkConf

[ https://issues.apache.org/jira/browse/SPARK-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14018043#comment-14018043 ] Zongheng Yang commented on SPARK-1508: -- WIP PR: