[jira] [Commented] (SPARK-8119) HeartbeatReceiver should not adjust application executor resources

[ https://issues.apache.org/jira/browse/SPARK-8119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150055#comment-15150055 ] Zhen Peng commented on SPARK-8119: -- Hi [~srowen], I think it's really a serious bug, do you have any

[jira] [Commented] (SPARK-13333) DataFrame filter + randn + unionAll has bad interaction

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150053#comment-15150053 ] Xiao Li commented on SPARK-1: - Yeah, the same series of random number. > DataFrame filter + randn +

[jira] [Commented] (SPARK-13333) DataFrame filter + randn + unionAll has bad interaction

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150050#comment-15150050 ] Liang-Chi Hsieh commented on SPARK-1: - But when you set deterministic to true, your each data

[jira] [Commented] (SPARK-13333) DataFrame filter + randn + unionAll has bad interaction

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150042#comment-15150042 ] Xiao Li commented on SPARK-1: - Yeah. I realized it when fixing this problem. Thus, in the PR, I just

[jira] [Commented] (SPARK-13333) DataFrame filter + randn + unionAll has bad interaction

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150008#comment-15150008 ] Liang-Chi Hsieh commented on SPARK-1: - If you don't attach a partition id, wouldn't your each

[jira] [Commented] (SPARK-13249) Filter null keys for inner join

[ https://issues.apache.org/jira/browse/SPARK-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149986#comment-15149986 ] Apache Spark commented on SPARK-13249: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13249) Filter null keys for inner join

[ https://issues.apache.org/jira/browse/SPARK-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13249: Assignee: Apache Spark > Filter null keys for inner join >

[jira] [Assigned] (SPARK-13249) Filter null keys for inner join

[ https://issues.apache.org/jira/browse/SPARK-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13249: Assignee: (was: Apache Spark) > Filter null keys for inner join >

[jira] [Updated] (SPARK-13322) AFTSurvivalRegression should support feature standardization

[ https://issues.apache.org/jira/browse/SPARK-13322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13322: Description: This bug is reported by Stuti Awasthi.

[jira] [Updated] (SPARK-13322) AFTSurvivalRegression should support feature standardization

[ https://issues.apache.org/jira/browse/SPARK-13322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13322: Description: This bug is reported by Stuti Awasthi.

[jira] [Updated] (SPARK-13322) AFTSurvivalRegression should support feature standardization

[ https://issues.apache.org/jira/browse/SPARK-13322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13322: Description: This bug is reported by Stuti Awasthi.

[jira] [Updated] (SPARK-13322) AFTSurvivalRegression should support feature standardization

[ https://issues.apache.org/jira/browse/SPARK-13322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13322: Summary: AFTSurvivalRegression should support feature standardization (was: AFTSurvivalRegression

[jira] [Created] (SPARK-13359) ArrayType(_, true) should also accept ArrayType(_, false) fix for branch-1.6

Earthson Lu created SPARK-13359: --- Summary: ArrayType(_, true) should also accept ArrayType(_, false) fix for branch-1.6 Key: SPARK-13359 URL: https://issues.apache.org/jira/browse/SPARK-13359 Project:

[jira] [Commented] (SPARK-13275) With dynamic allocation, executors appear to be added before job starts

[ https://issues.apache.org/jira/browse/SPARK-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149939#comment-15149939 ] Saisai Shao commented on SPARK-13275: - would you please clarify the specific problem you mentioned,

[jira] [Assigned] (SPARK-13354) Push filter throughout outer join when the condition can filter out empty row

[ https://issues.apache.org/jira/browse/SPARK-13354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13354: Assignee: Apache Spark (was: Davies Liu) > Push filter throughout outer join when the

[jira] [Commented] (SPARK-13354) Push filter throughout outer join when the condition can filter out empty row

[ https://issues.apache.org/jira/browse/SPARK-13354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149923#comment-15149923 ] Apache Spark commented on SPARK-13354: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13354) Push filter throughout outer join when the condition can filter out empty row

[ https://issues.apache.org/jira/browse/SPARK-13354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13354: Assignee: Davies Liu (was: Apache Spark) > Push filter throughout outer join when the

[jira] [Assigned] (SPARK-13333) DataFrame filter + randn + unionAll has bad interaction

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1: Assignee: (was: Apache Spark) > DataFrame filter + randn + unionAll has bad

[jira] [Commented] (SPARK-13333) DataFrame filter + randn + unionAll has bad interaction

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149850#comment-15149850 ] Apache Spark commented on SPARK-1: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13333) DataFrame filter + randn + unionAll has bad interaction

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1: Assignee: Apache Spark > DataFrame filter + randn + unionAll has bad interaction >

[jira] [Assigned] (SPARK-13358) Retrieve grep path when doing Benchmark

[ https://issues.apache.org/jira/browse/SPARK-13358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13358: Assignee: (was: Apache Spark) > Retrieve grep path when doing Benchmark >

[jira] [Assigned] (SPARK-13358) Retrieve grep path when doing Benchmark

[ https://issues.apache.org/jira/browse/SPARK-13358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13358: Assignee: Apache Spark > Retrieve grep path when doing Benchmark >

[jira] [Created] (SPARK-13358) Retrieve grep path when doing Benchmark

Liang-Chi Hsieh created SPARK-13358: --- Summary: Retrieve grep path when doing Benchmark Key: SPARK-13358 URL: https://issues.apache.org/jira/browse/SPARK-13358 Project: Spark Issue Type:

[jira] [Commented] (SPARK-13358) Retrieve grep path when doing Benchmark

[ https://issues.apache.org/jira/browse/SPARK-13358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149837#comment-15149837 ] Apache Spark commented on SPARK-13358: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-12316) Stack overflow with endless call of `Delegation token thread` when application end.

[ https://issues.apache.org/jira/browse/SPARK-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149810#comment-15149810 ] SaintBacchus commented on SPARK-12316: -- [~tgraves] The function of listFilesSorted will not throw

[jira] [Assigned] (SPARK-13357) Use generated projection and ordering for TakeOrderedAndProjectNode

[ https://issues.apache.org/jira/browse/SPARK-13357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13357: Assignee: Apache Spark > Use generated projection and ordering for

[jira] [Commented] (SPARK-13357) Use generated projection and ordering for TakeOrderedAndProjectNode

[ https://issues.apache.org/jira/browse/SPARK-13357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149807#comment-15149807 ] Apache Spark commented on SPARK-13357: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13357) Use generated projection and ordering for TakeOrderedAndProjectNode

[ https://issues.apache.org/jira/browse/SPARK-13357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13357: Assignee: (was: Apache Spark) > Use generated projection and ordering for

[jira] [Created] (SPARK-13357) Use generated projection and ordering for TakeOrderedAndProjectNode

Takuya Ueshin created SPARK-13357: - Summary: Use generated projection and ordering for TakeOrderedAndProjectNode Key: SPARK-13357 URL: https://issues.apache.org/jira/browse/SPARK-13357 Project: Spark

[jira] [Commented] (SPARK-13220) Deprecate "yarn-client" and "yarn-cluster"

[ https://issues.apache.org/jira/browse/SPARK-13220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149795#comment-15149795 ] Apache Spark commented on SPARK-13220: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13220) Deprecate "yarn-client" and "yarn-cluster"

[ https://issues.apache.org/jira/browse/SPARK-13220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13220: Assignee: Apache Spark (was: Saisai Shao) > Deprecate "yarn-client" and "yarn-cluster" >

[jira] [Assigned] (SPARK-13220) Deprecate "yarn-client" and "yarn-cluster"

[ https://issues.apache.org/jira/browse/SPARK-13220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13220: Assignee: Saisai Shao (was: Apache Spark) > Deprecate "yarn-client" and "yarn-cluster" >

[jira] [Commented] (SPARK-9273) Add Convolutional Neural network to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149794#comment-15149794 ] Sateesh Babu G commented on SPARK-9273: --- Hi Alexander, Thank you very much for your help! Can I

[jira] [Updated] (SPARK-11627) Spark Streaming backpressure mechanism has no initial input rate limit,receivers receive data at the maximum speed , it might cause OOM exception

[ https://issues.apache.org/jira/browse/SPARK-11627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-11627: - Affects Version/s: 1.6.0 > Spark Streaming backpressure mechanism has no initial input rate >

[jira] [Resolved] (SPARK-11627) Spark Streaming backpressure mechanism has no initial input rate limit,receivers receive data at the maximum speed , it might cause OOM exception

[ https://issues.apache.org/jira/browse/SPARK-11627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-11627. -- Resolution: Fixed Assignee: junhaoMg Fix Version/s: 2.0.0 > Spark Streaming

[jira] [Assigned] (SPARK-13356) WebUI missing input informations when recovering from dirver failure

[ https://issues.apache.org/jira/browse/SPARK-13356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13356: Assignee: Apache Spark > WebUI missing input informations when recovering from dirver

[jira] [Assigned] (SPARK-13356) WebUI missing input informations when recovering from dirver failure

[ https://issues.apache.org/jira/browse/SPARK-13356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13356: Assignee: (was: Apache Spark) > WebUI missing input informations when recovering from

[jira] [Commented] (SPARK-13356) WebUI missing input informations when recovering from dirver failure

[ https://issues.apache.org/jira/browse/SPARK-13356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149727#comment-15149727 ] Apache Spark commented on SPARK-13356: -- User 'jeanlyn' has created a pull request for this issue:

[jira] [Created] (SPARK-13356) WebUI missing input informations when recovering from dirver failure

jeanlyn created SPARK-13356: --- Summary: WebUI missing input informations when recovering from dirver failure Key: SPARK-13356 URL: https://issues.apache.org/jira/browse/SPARK-13356 Project: Spark

[jira] [Updated] (SPARK-13356) WebUI missing input informations when recovering from dirver failure

[ https://issues.apache.org/jira/browse/SPARK-13356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jeanlyn updated SPARK-13356: Attachment: DirectKafkaScreenshot.jpg > WebUI missing input informations when recovering from dirver

[jira] [Updated] (SPARK-13349) adding a split and union to a streaming application cause big performance hit

[ https://issues.apache.org/jira/browse/SPARK-13349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] krishna ramachandran updated SPARK-13349: - Description: We have a streaming application containing approximately 12 jobs

[jira] [Assigned] (SPARK-13355) Replace GraphImpl.fromExistingRDDs by Graph

[ https://issues.apache.org/jira/browse/SPARK-13355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13355: Assignee: Xiangrui Meng (was: Apache Spark) > Replace GraphImpl.fromExistingRDDs by

[jira] [Commented] (SPARK-13355) Replace GraphImpl.fromExistingRDDs by Graph

[ https://issues.apache.org/jira/browse/SPARK-13355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149685#comment-15149685 ] Apache Spark commented on SPARK-13355: -- User 'mengxr' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13355) Replace GraphImpl.fromExistingRDDs by Graph

[ https://issues.apache.org/jira/browse/SPARK-13355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13355: Assignee: Apache Spark (was: Xiangrui Meng) > Replace GraphImpl.fromExistingRDDs by

[jira] [Created] (SPARK-13355) Replace GraphImpl.fromExistingRDDs by Graph

Xiangrui Meng created SPARK-13355: - Summary: Replace GraphImpl.fromExistingRDDs by Graph Key: SPARK-13355 URL: https://issues.apache.org/jira/browse/SPARK-13355 Project: Spark Issue Type:

[jira] [Commented] (SPARK-12776) Implement Python API for Datasets

[ https://issues.apache.org/jira/browse/SPARK-12776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149621#comment-15149621 ] Gustavo Salazar Torres commented on SPARK-12776: I will work on some code following what

[jira] [Created] (SPARK-13354) Push filter throughout outer join when the condition can filter out empty row

Davies Liu created SPARK-13354: -- Summary: Push filter throughout outer join when the condition can filter out empty row Key: SPARK-13354 URL: https://issues.apache.org/jira/browse/SPARK-13354 Project:

[jira] [Created] (SPARK-13353) Use UnsafeRowSerializer to collect DataFrame

Davies Liu created SPARK-13353: -- Summary: Use UnsafeRowSerializer to collect DataFrame Key: SPARK-13353 URL: https://issues.apache.org/jira/browse/SPARK-13353 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-13351) Column pruning fails on expand

[ https://issues.apache.org/jira/browse/SPARK-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13351: Assignee: Apache Spark (was: Davies Liu) > Column pruning fails on expand >

[jira] [Commented] (SPARK-13351) Column pruning fails on expand

[ https://issues.apache.org/jira/browse/SPARK-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149571#comment-15149571 ] Apache Spark commented on SPARK-13351: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13351) Column pruning fails on expand

[ https://issues.apache.org/jira/browse/SPARK-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13351: Assignee: Davies Liu (was: Apache Spark) > Column pruning fails on expand >

[jira] [Created] (SPARK-13352) BlockFetch does not scale well on large block

Davies Liu created SPARK-13352: -- Summary: BlockFetch does not scale well on large block Key: SPARK-13352 URL: https://issues.apache.org/jira/browse/SPARK-13352 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-13351) Column pruning fails on expand

Davies Liu created SPARK-13351: -- Summary: Column pruning fails on expand Key: SPARK-13351 URL: https://issues.apache.org/jira/browse/SPARK-13351 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12776) Implement Python API for Datasets

[ https://issues.apache.org/jira/browse/SPARK-12776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149525#comment-15149525 ] Gustavo Salazar Torres commented on SPARK-12776: I can work on this, any pointers? >

[jira] [Updated] (SPARK-13349) adding a split and union to a streaming application cause big performance hit

[ https://issues.apache.org/jira/browse/SPARK-13349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] krishna ramachandran updated SPARK-13349: - Summary: adding a split and union to a streaming application cause big

[jira] [Updated] (SPARK-13349) adding a split and union to a streaming application causes big performance hit

[ https://issues.apache.org/jira/browse/SPARK-13349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] krishna ramachandran updated SPARK-13349: - Summary: adding a split and union to a streaming application causes big

[jira] [Created] (SPARK-13350) Configuration documentation incorrectly states that PYSPARK_PYTHON's default is "python"

Christopher Aycock created SPARK-13350: -- Summary: Configuration documentation incorrectly states that PYSPARK_PYTHON's default is "python" Key: SPARK-13350 URL:

[jira] [Commented] (SPARK-13333) DataFrame filter + randn + unionAll has bad interaction

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149507#comment-15149507 ] Xiao Li commented on SPARK-1: - Will try to submit a PR tonight. When users specify a seed, I am

[jira] [Created] (SPARK-13349) enabling cache causes out of memory error. Caching DStream helps reduce processing time in a streaming application but get out of memory errors

krishna ramachandran created SPARK-13349: Summary: enabling cache causes out of memory error. Caching DStream helps reduce processing time in a streaming application but get out of memory errors Key: SPARK-13349

[jira] [Commented] (SPARK-13298) DAG visualization does not render correctly for jobs

[ https://issues.apache.org/jira/browse/SPARK-13298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149457#comment-15149457 ] Shixiong Zhu commented on SPARK-13298: -- Do you have a reproducer? > DAG visualization does not

[jira] [Issue Comment Deleted] (SPARK-10759) Missing Python code example in ML Programming guide

[ https://issues.apache.org/jira/browse/SPARK-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy updated SPARK-10759: --- Comment: was deleted (was: Cannot add example for code that doesn't exist.) > Missing Python code example

[jira] [Updated] (SPARK-13346) Using DataFrames iteratively leads to massive query plans, which slows execution

[ https://issues.apache.org/jira/browse/SPARK-13346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13346: -- Summary: Using DataFrames iteratively leads to massive query plans, which slows execution (was:

[jira] [Assigned] (SPARK-13283) Spark doesn't escape column names when creating table on JDBC

[ https://issues.apache.org/jira/browse/SPARK-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13283: Assignee: Apache Spark > Spark doesn't escape column names when creating table on JDBC >

[jira] [Assigned] (SPARK-13283) Spark doesn't escape column names when creating table on JDBC

[ https://issues.apache.org/jira/browse/SPARK-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13283: Assignee: (was: Apache Spark) > Spark doesn't escape column names when creating table

[jira] [Commented] (SPARK-13283) Spark doesn't escape column names when creating table on JDBC

[ https://issues.apache.org/jira/browse/SPARK-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149396#comment-15149396 ] Apache Spark commented on SPARK-13283: -- User 'xguo27' has created a pull request for this issue:

[jira] [Commented] (SPARK-13283) Spark doesn't escape column names when creating table on JDBC

[ https://issues.apache.org/jira/browse/SPARK-13283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149387#comment-15149387 ] Xiu (Joe) Guo commented on SPARK-13283: --- Yes, it is a different problem from

[jira] [Commented] (SPARK-12846) Follow up SPARK-12707, Update documentation and other related code

[ https://issues.apache.org/jira/browse/SPARK-12846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149349#comment-15149349 ] Felix Cheung commented on SPARK-12846: -- changes to fix Jenkins was in PR

[jira] [Commented] (SPARK-12846) Follow up SPARK-12707, Update documentation and other related code

[ https://issues.apache.org/jira/browse/SPARK-12846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149343#comment-15149343 ] Felix Cheung commented on SPARK-12846: -- actually I was referring to how Jenkins/tests were broken by

[jira] [Created] (SPARK-13348) Avoid duplicated broadcasts

Davies Liu created SPARK-13348: -- Summary: Avoid duplicated broadcasts Key: SPARK-13348 URL: https://issues.apache.org/jira/browse/SPARK-13348 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-13347) Reuse the shuffle for duplicated exchange

Davies Liu created SPARK-13347: -- Summary: Reuse the shuffle for duplicated exchange Key: SPARK-13347 URL: https://issues.apache.org/jira/browse/SPARK-13347 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-5158) Allow for keytab-based HDFS security in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149309#comment-15149309 ] Henry Saputra edited comment on SPARK-5158 at 2/16/16 9:14 PM: --- HI All,

[jira] [Commented] (SPARK-5158) Allow for keytab-based HDFS security in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149309#comment-15149309 ] Henry Saputra commented on SPARK-5158: -- All, the PR for this issues are closed. This PR:

[jira] [Resolved] (SPARK-13308) ManagedBuffers passed to OneToOneStreamManager need to be freed in non-error cases

[ https://issues.apache.org/jira/browse/SPARK-13308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-13308. -- Resolution: Fixed Fix Version/s: 2.0.0 > ManagedBuffers passed to OneToOneStreamManager

[jira] [Commented] (SPARK-10759) Missing Python code example in ML Programming guide

[ https://issues.apache.org/jira/browse/SPARK-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149266#comment-15149266 ] Jeremy commented on SPARK-10759: Cannot add example for code that doesn't exist. > Missing Python code

[jira] [Created] (SPARK-13346) DataFrame caching is not handled well during planning or execution

Joseph K. Bradley created SPARK-13346: - Summary: DataFrame caching is not handled well during planning or execution Key: SPARK-13346 URL: https://issues.apache.org/jira/browse/SPARK-13346

[jira] [Commented] (SPARK-13346) DataFrame caching is not handled well during planning or execution

[ https://issues.apache.org/jira/browse/SPARK-13346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149227#comment-15149227 ] Joseph K. Bradley commented on SPARK-13346: --- CC: [~andrewor14] [~joshrosen] whom I spoke with

[jira] [Created] (SPARK-13345) Adding one way ANOVA to Spark ML stat

yuhao yang created SPARK-13345: -- Summary: Adding one way ANOVA to Spark ML stat Key: SPARK-13345 URL: https://issues.apache.org/jira/browse/SPARK-13345 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-12154) Upgrade to Jersey 2

[ https://issues.apache.org/jira/browse/SPARK-12154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12154: Assignee: Apache Spark > Upgrade to Jersey 2 > --- > >

[jira] [Commented] (SPARK-12154) Upgrade to Jersey 2

[ https://issues.apache.org/jira/browse/SPARK-12154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149176#comment-15149176 ] Apache Spark commented on SPARK-12154: -- User 'mccheah' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12154) Upgrade to Jersey 2

[ https://issues.apache.org/jira/browse/SPARK-12154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12154: Assignee: (was: Apache Spark) > Upgrade to Jersey 2 > --- > >

[jira] [Commented] (SPARK-13333) DataFrame filter + randn + unionAll has bad interaction

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149155#comment-15149155 ] Xiao Li commented on SPARK-1: - [~josephkb] I found the root cause. : ) In the genCode of Randn and

[jira] [Resolved] (SPARK-13280) FileBasedWriteAheadLog logger name should be under o.a.s namespace

[ https://issues.apache.org/jira/browse/SPARK-13280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-13280. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.0.0 >

[jira] [Commented] (SPARK-9273) Add Convolutional Neural network to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149139#comment-15149139 ] Alexander Ulanov commented on SPARK-9273: - Hi [~gsateesh110], Besides the one mentioned by Yuhao,

[jira] [Resolved] (SPARK-11701) YARN - dynamic allocation and speculation active task accounting wrong

[ https://issues.apache.org/jira/browse/SPARK-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-11701. --- Resolution: Duplicate > YARN - dynamic allocation and speculation active task accounting

[jira] [Commented] (SPARK-13027) Add API for updateStateByKey to provide batch time as input

[ https://issues.apache.org/jira/browse/SPARK-13027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149126#comment-15149126 ] Aaditya Ramesh commented on SPARK-13027: Hi [~zsxwing] sorry to bump this again, I've submitted a

[jira] [Updated] (SPARK-11701) YARN - dynamic allocation and speculation active task accounting wrong

[ https://issues.apache.org/jira/browse/SPARK-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-11701: -- Description: I am using dynamic container allocation and speculation and am seeing issues

[jira] [Commented] (SPARK-13344) SaveLoadSuite has many accumulator exceptions

[ https://issues.apache.org/jira/browse/SPARK-13344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149106#comment-15149106 ] Apache Spark commented on SPARK-13344: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13344) SaveLoadSuite has many accumulator exceptions

[ https://issues.apache.org/jira/browse/SPARK-13344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13344: Assignee: Andrew Or (was: Apache Spark) > SaveLoadSuite has many accumulator exceptions

[jira] [Assigned] (SPARK-13344) SaveLoadSuite has many accumulator exceptions

[ https://issues.apache.org/jira/browse/SPARK-13344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13344: Assignee: Apache Spark (was: Andrew Or) > SaveLoadSuite has many accumulator exceptions

[jira] [Created] (SPARK-13344) SaveLoadSuite has many accumulator exceptions

Andrew Or created SPARK-13344: - Summary: SaveLoadSuite has many accumulator exceptions Key: SPARK-13344 URL: https://issues.apache.org/jira/browse/SPARK-13344 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-12976) Add LazilyGenerateOrdering and use it for RangePartitioner of Exchange.

[ https://issues.apache.org/jira/browse/SPARK-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12976. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10894

[jira] [Updated] (SPARK-12976) Add LazilyGenerateOrdering and use it for RangePartitioner of Exchange.

[ https://issues.apache.org/jira/browse/SPARK-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-12976: --- Assignee: Takuya Ueshin > Add LazilyGenerateOrdering and use it for RangePartitioner of Exchange. >

[jira] [Created] (SPARK-13343) speculative tasks that didn't commit shouldn't be marked as success

Thomas Graves created SPARK-13343: - Summary: speculative tasks that didn't commit shouldn't be marked as success Key: SPARK-13343 URL: https://issues.apache.org/jira/browse/SPARK-13343 Project: Spark

[jira] [Commented] (SPARK-13333) DataFrame filter + randn + unionAll has bad interaction

[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149053#comment-15149053 ] Joseph K. Bradley commented on SPARK-1: --- I now have a much more complex example which does

[jira] [Assigned] (SPARK-13242) Moderately complex `when` expression causes code generation failure

[ https://issues.apache.org/jira/browse/SPARK-13242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13242: Assignee: Apache Spark > Moderately complex `when` expression causes code generation

[jira] [Commented] (SPARK-13242) Moderately complex `when` expression causes code generation failure

[ https://issues.apache.org/jira/browse/SPARK-13242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149036#comment-15149036 ] Apache Spark commented on SPARK-13242: -- User 'joehalliwell' has created a pull request for this

[jira] [Assigned] (SPARK-13242) Moderately complex `when` expression causes code generation failure

[ https://issues.apache.org/jira/browse/SPARK-13242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13242: Assignee: (was: Apache Spark) > Moderately complex `when` expression causes code

[jira] [Updated] (SPARK-13342) Cannot run INSERT statements in Spark

[ https://issues.apache.org/jira/browse/SPARK-13342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] neo updated SPARK-13342: Priority: Critical (was: Major) > Cannot run INSERT statements in Spark > - >

[jira] [Commented] (SPARK-13327) colnames()<- allows invalid column names

[ https://issues.apache.org/jira/browse/SPARK-13327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149017#comment-15149017 ] Apache Spark commented on SPARK-13327: -- User 'olarayej' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13327) colnames()<- allows invalid column names

[ https://issues.apache.org/jira/browse/SPARK-13327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13327: Assignee: Apache Spark > colnames()<- allows invalid column names >

  1   2   >