[jira] [Commented] (SPARK-20243) DebugFilesystem.assertNoOpenStreams thread race

2017-04-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962761#comment-15962761 ] Apache Spark commented on SPARK-20243: -- User 'bogdanrdc' has created a pull request for this issue:

[jira] [Updated] (SPARK-20279) In web ui,'Only showing 200' should be changed to 'only showing last 200'.

2017-04-10 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20279: --- Description: In web ui,'Only showing 200' should be changed to 'only showing last 200' in

[jira] [Created] (SPARK-20280) SharedInMemoryCache Weigher integer overflow

2017-04-10 Thread Bogdan Raducanu (JIRA)
Bogdan Raducanu created SPARK-20280: --- Summary: SharedInMemoryCache Weigher integer overflow Key: SPARK-20280 URL: https://issues.apache.org/jira/browse/SPARK-20280 Project: Spark Issue

[jira] [Comment Edited] (SPARK-12837) Spark driver requires large memory space for serialized results even there are no data collected to the driver

2017-04-10 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962731#comment-15962731 ] Wenchen Fan edited comment on SPARK-12837 at 4/10/17 11:54 AM: --- [~jbherman]

[jira] [Commented] (SPARK-20280) SharedInMemoryCache Weigher integer overflow

2017-04-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962751#comment-15962751 ] Apache Spark commented on SPARK-20280: -- User 'bogdanrdc' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20280) SharedInMemoryCache Weigher integer overflow

2017-04-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20280: Assignee: Apache Spark > SharedInMemoryCache Weigher integer overflow >

[jira] [Assigned] (SPARK-20280) SharedInMemoryCache Weigher integer overflow

2017-04-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20280: Assignee: (was: Apache Spark) > SharedInMemoryCache Weigher integer overflow >

[jira] [Commented] (SPARK-20280) SharedInMemoryCache Weigher integer overflow

2017-04-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962750#comment-15962750 ] Sean Owen commented on SPARK-20280: --- I guess cap it at {{Int.MaxValue}}? > SharedInMemoryCache Weigher

[jira] [Updated] (SPARK-20279) In web ui,'Only showing 200' should be changed to 'only showing last 200'.

2017-04-10 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20279: --- Summary: In web ui,'Only showing 200' should be changed to 'only showing last 200'. (was:

[jira] [Assigned] (SPARK-20243) DebugFilesystem.assertNoOpenStreams thread race

2017-04-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20243: Assignee: (was: Apache Spark) > DebugFilesystem.assertNoOpenStreams thread race >

[jira] [Updated] (SPARK-20279) In web ui,'Only showing 200' should be changed to 'only showing last 200'.

2017-04-10 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20279: --- Attachment: stages.png jobs.png > In web ui,'Only showing 200' should be

[jira] [Created] (SPARK-20279) In web ui,'Only showing 200' should be changed to 'only showing last 200'.

2017-04-10 Thread guoxiaolongzte (JIRA)
guoxiaolongzte created SPARK-20279: -- Summary: In web ui,'Only showing 200' should be changed to 'only showing last 200'. Key: SPARK-20279 URL: https://issues.apache.org/jira/browse/SPARK-20279

[jira] [Created] (SPARK-20281) Table-valued function range in SQL should use the same number of partitions as spark.range

2017-04-10 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-20281: --- Summary: Table-valued function range in SQL should use the same number of partitions as spark.range Key: SPARK-20281 URL: https://issues.apache.org/jira/browse/SPARK-20281

[jira] [Commented] (SPARK-20277) Allow Spark on YARN to be launched with Docker

2017-04-10 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962787#comment-15962787 ] Zhankun Tang commented on SPARK-20277: -- It requires at least hadoop 2.8 Alpha1 from the roadmap. I

[jira] [Commented] (SPARK-20000) Spark Hive tests aborted due to lz4-java on ppc64le

2017-04-10 Thread Ayappan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962896#comment-15962896 ] Ayappan commented on SPARK-2: - https://github.com/lz4/lz4-java/pull/84 > Spark Hive tests aborted

[jira] [Commented] (SPARK-20202) Remove references to org.spark-project.hive

2017-04-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962903#comment-15962903 ] Steve Loughran commented on SPARK-20202: One thing I do recall as trouble here was that ivy

[jira] [Updated] (SPARK-20000) Spark Hive tests aborted due to lz4-java on ppc64le

2017-04-10 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) OK so this is about updating

[jira] [Commented] (SPARK-16544) Support for conversion from compatible schema for Parquet data source when data types are not matched

2017-04-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962579#comment-15962579 ] Apache Spark commented on SPARK-16544: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-20277) Allow Spark on YARN to be launched with Docker

2017-04-10 Thread Zhankun Tang (JIRA)
Zhankun Tang created SPARK-20277: Summary: Allow Spark on YARN to be launched with Docker Key: SPARK-20277 URL: https://issues.apache.org/jira/browse/SPARK-20277 Project: Spark Issue Type:

[jira] [Issue Comment Deleted] (SPARK-20157) In the menu ‘Storage’in Web UI, click the Go button, and shows no paging menu interface.

2017-04-10 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20157: --- Comment: was deleted (was: [~srowen] In jobs in web ui,Choose 'show' text box, fill in the

[jira] [Assigned] (SPARK-20278) Disable 'multiple_dots_linter' lint rule that is against project's code style

2017-04-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20278: Assignee: Apache Spark > Disable 'multiple_dots_linter' lint rule that is against

[jira] [Assigned] (SPARK-20278) Disable 'multiple_dots_linter' lint rule that is against project's code style

2017-04-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20278: Assignee: (was: Apache Spark) > Disable 'multiple_dots_linter' lint rule that is

[jira] [Commented] (SPARK-12837) Spark driver requires large memory space for serialized results even there are no data collected to the driver

2017-04-10 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963815#comment-15963815 ] Wenchen Fan commented on SPARK-12837: - [~Tagar] due to some implementation limitations, in Spark SQL

[jira] [Commented] (SPARK-3383) DecisionTree aggregate size could be smaller

2017-04-10 Thread 颜发才
[ https://issues.apache.org/jira/browse/SPARK-3383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963741#comment-15963741 ] Yan Facai (颜发才) commented on SPARK-3383: I think the task contains two subtask: 1. separate

[jira] [Resolved] (SPARK-17564) Flaky RequestTimeoutIntegrationSuite, furtherRequestsDelay

2017-04-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17564. - Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.2.0

[jira] [Commented] (SPARK-12837) Spark driver requires large memory space for serialized results even there are no data collected to the driver

2017-04-10 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963812#comment-15963812 ] Ruslan Dautkhanov commented on SPARK-12837: --- [~cloud_fan] I didn't realize torrent broadcast

[jira] [Resolved] (SPARK-20283) Add preOptimizationBatches

2017-04-10 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-20283. - Resolution: Fixed Fix Version/s: 2.2.0 > Add preOptimizationBatches >

[jira] [Commented] (SPARK-16742) Kerberos support for Spark on Mesos

2017-04-10 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963583#comment-15963583 ] Michael Gummelt commented on SPARK-16742: - bq. That sounds problematic. The way YARN works is

[jira] [Commented] (SPARK-18084) write.partitionBy() does not recognize nested columns that select() can access

2017-04-10 Thread Rupesh Mane (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963621#comment-15963621 ] Rupesh Mane commented on SPARK-18084: - Any update on when this will be fixed? > write.partitionBy()

<    1   2