[jira] [Assigned] (SPARK-22781) Support creating streaming dataset with ORC files

[ https://issues.apache.org/jira/browse/SPARK-22781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reassigned SPARK-22781: Assignee: Dongjoon Hyun > Support creating streaming dataset with ORC files >

[jira] [Resolved] (SPARK-22781) Support creating streaming dataset with ORC files

[ https://issues.apache.org/jira/browse/SPARK-22781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-22781. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19975

[jira] [Created] (SPARK-22841) Select regexp_extract from table with where clause having is null throws indexoutofbounds exception

Chetan Bhat created SPARK-22841: --- Summary: Select regexp_extract from table with where clause having is null throws indexoutofbounds exception Key: SPARK-22841 URL: https://issues.apache.org/jira/browse/SPARK-22841

[jira] [Created] (SPARK-22840) Incorrect results when using distinct on window

Lior Chaga created SPARK-22840: -- Summary: Incorrect results when using distinct on window Key: SPARK-22840 URL: https://issues.apache.org/jira/browse/SPARK-22840 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-22840) Incorrect results when using distinct on window

[ https://issues.apache.org/jira/browse/SPARK-22840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lior Chaga updated SPARK-22840: --- Description: Given the following schema: {code} root |-- id: string (nullable = true) |--

[jira] [Updated] (SPARK-22840) Incorrect results when using distinct on window

[ https://issues.apache.org/jira/browse/SPARK-22840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lior Chaga updated SPARK-22840: --- Attachment: sample.parquet.zip > Incorrect results when using distinct on window >

[jira] [Updated] (SPARK-22822) Basic tests for WindowFrameCoercion and DecimalPrecision

[ https://issues.apache.org/jira/browse/SPARK-22822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-22822: Summary: Basic tests for WindowFrameCoercion and DecimalPrecision (was: Basic tests for

[jira] [Created] (SPARK-22839) Refactor Kubernetes code for configuring driver/executor pods to use consistent and cleaner abstraction

Yinan Li created SPARK-22839: Summary: Refactor Kubernetes code for configuring driver/executor pods to use consistent and cleaner abstraction Key: SPARK-22839 URL: https://issues.apache.org/jira/browse/SPARK-22839

[jira] [Comment Edited] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297914#comment-16297914 ] Xuefu Zhang edited comment on SPARK-22765 at 12/20/17 5:45 AM: --- Alright, I

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297914#comment-16297914 ] Xuefu Zhang commented on SPARK-22765: - Alright, I tested upfront allocation and its combinations with

[jira] [Commented] (SPARK-19053) Supporting multiple evaluation metrics in DataFrame-based API: discussion

[ https://issues.apache.org/jira/browse/SPARK-19053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297887#comment-16297887 ] yuhao yang commented on SPARK-19053: Plan for further development: 1. Initial API and function

[jira] [Assigned] (SPARK-19053) Supporting multiple evaluation metrics in DataFrame-based API: discussion

[ https://issues.apache.org/jira/browse/SPARK-19053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19053: Assignee: Apache Spark > Supporting multiple evaluation metrics in DataFrame-based API:

[jira] [Assigned] (SPARK-19053) Supporting multiple evaluation metrics in DataFrame-based API: discussion

[ https://issues.apache.org/jira/browse/SPARK-19053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19053: Assignee: (was: Apache Spark) > Supporting multiple evaluation metrics in

[jira] [Commented] (SPARK-19053) Supporting multiple evaluation metrics in DataFrame-based API: discussion

[ https://issues.apache.org/jira/browse/SPARK-19053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297884#comment-16297884 ] Apache Spark commented on SPARK-19053: -- User 'hhbyyh' has created a pull request for this issue:

[jira] [Resolved] (SPARK-22649) localCheckpoint support in Dataset API

[ https://issues.apache.org/jira/browse/SPARK-22649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22649. - Resolution: Fixed Assignee: Fernando Pereira Fix Version/s: 2.3.0 > localCheckpoint

[jira] [Resolved] (SPARK-22829) Add new built-in function date_trunc()

[ https://issues.apache.org/jira/browse/SPARK-22829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22829. - Resolution: Fixed Assignee: Youngbin Kim Fix Version/s: 2.3.0 > Add new built-in

[jira] [Assigned] (SPARK-22827) Avoid throwing OutOfMemoryError in case of exception in spill

[ https://issues.apache.org/jira/browse/SPARK-22827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22827: --- Assignee: Sital Kedia > Avoid throwing OutOfMemoryError in case of exception in spill >

[jira] [Resolved] (SPARK-22827) Avoid throwing OutOfMemoryError in case of exception in spill

[ https://issues.apache.org/jira/browse/SPARK-22827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22827. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20014

[jira] [Assigned] (SPARK-22838) Avoid unnecessary copying of data

[ https://issues.apache.org/jira/browse/SPARK-22838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22838: Assignee: (was: Apache Spark) > Avoid unnecessary copying of data >

[jira] [Commented] (SPARK-22838) Avoid unnecessary copying of data

[ https://issues.apache.org/jira/browse/SPARK-22838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297859#comment-16297859 ] Apache Spark commented on SPARK-22838: -- User 'ConeyLiu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22838) Avoid unnecessary copying of data

[ https://issues.apache.org/jira/browse/SPARK-22838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22838: Assignee: Apache Spark > Avoid unnecessary copying of data >

[jira] [Created] (SPARK-22838) Avoid unnecessary copying of data

Xianyang Liu created SPARK-22838: Summary: Avoid unnecessary copying of data Key: SPARK-22838 URL: https://issues.apache.org/jira/browse/SPARK-22838 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-22837) Session timeout checker does not work in SessionManager

[ https://issues.apache.org/jira/browse/SPARK-22837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297811#comment-16297811 ] Apache Spark commented on SPARK-22837: -- User 'zuotingbing' has created a pull request for this

[jira] [Assigned] (SPARK-22837) Session timeout checker does not work in SessionManager

[ https://issues.apache.org/jira/browse/SPARK-22837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22837: Assignee: Apache Spark > Session timeout checker does not work in SessionManager >

[jira] [Assigned] (SPARK-22837) Session timeout checker does not work in SessionManager

[ https://issues.apache.org/jira/browse/SPARK-22837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22837: Assignee: (was: Apache Spark) > Session timeout checker does not work in

[jira] [Updated] (SPARK-22837) Session timeout checker does not work in SessionManager

[ https://issues.apache.org/jira/browse/SPARK-22837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-22837: Summary: Session timeout checker does not work in SessionManager (was: Session timeout checker

[jira] [Closed] (SPARK-22831) Long running spark app gets slower and slower over time,Maybe cause by unsafe/Platform

[ https://issues.apache.org/jira/browse/SPARK-22831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dingdong closed SPARK-22831. > Long running spark app gets slower and slower over time,Maybe cause by > unsafe/Platform >

[jira] [Updated] (SPARK-22837) Session timeout checker does not work in Hive Thrift Server

[ https://issues.apache.org/jira/browse/SPARK-22837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-22837: Description: Currently, {code:java} SessionManager.init {code} will not be called, the config

[jira] [Created] (SPARK-22837) Session timeout checker does not work in Hive Thrift Server

zuotingbing created SPARK-22837: --- Summary: Session timeout checker does not work in Hive Thrift Server Key: SPARK-22837 URL: https://issues.apache.org/jira/browse/SPARK-22837 Project: Spark

[jira] [Created] (SPARK-22836) Executors page is not showing driver logs links

Marcelo Vanzin created SPARK-22836: -- Summary: Executors page is not showing driver logs links Key: SPARK-22836 URL: https://issues.apache.org/jira/browse/SPARK-22836 Project: Spark Issue

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297645#comment-16297645 ] Xuefu Zhang commented on SPARK-22765: - Haven't got a chance to try upfront allocation. Tried one

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297549#comment-16297549 ] Thomas Graves commented on SPARK-22765: --- with SPARK-21656 does upfront allocation vs exponential

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297529#comment-16297529 ] Xuefu Zhang commented on SPARK-22765: - {quote} SPARK-21656 and the dynamic allocation should handle

[jira] [Resolved] (SPARK-22835) Spark toJSON gives wrong results when there is quote sign in value

[ https://issues.apache.org/jira/browse/SPARK-22835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński resolved SPARK-22835. Resolution: Invalid > Spark toJSON gives wrong results when there is quote sign in value >

[jira] [Created] (SPARK-22835) Spark toJSON gives wrong results when there is quote sign in value

Maciej Bryński created SPARK-22835: -- Summary: Spark toJSON gives wrong results when there is quote sign in value Key: SPARK-22835 URL: https://issues.apache.org/jira/browse/SPARK-22835 Project:

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297453#comment-16297453 ] Nan Zhu commented on SPARK-22765: - I took a look at the code, one of the possibilities is as following:

[jira] [Commented] (SPARK-22828) Data corruption happens when same RDD being repeatedly used as parent RDD of a custom RDD which reads each parent RDD in concurrent threads

[ https://issues.apache.org/jira/browse/SPARK-22828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297369#comment-16297369 ] Yongqin Xiao commented on SPARK-22828: -- I have trouble putting below response to your question in

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297346#comment-16297346 ] Xuefu Zhang commented on SPARK-22765: - I'm not 100% positive, but that seems to be what I saw. I will

[jira] [Resolved] (SPARK-22821) Basic tests for WidenSetOperationTypes, BooleanEquality, StackCoercion and Division

[ https://issues.apache.org/jira/browse/SPARK-22821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22821. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 2.3.0 > Basic tests for

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297335#comment-16297335 ] Thomas Graves commented on SPARK-22765: --- SPARK-21656 and the dynamic allocation should handle that,

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297316#comment-16297316 ] Xuefu Zhang commented on SPARK-22765: - Actually I meant across parallel stages (those connected to

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297307#comment-16297307 ] Thomas Graves commented on SPARK-22765: --- yes between stages becomes a problem with lower timeout,

[jira] [Updated] (SPARK-22828) Data corruption happens when same RDD being repeatedly used as parent RDD of a custom RDD which reads each parent RDD in concurrent threads

[ https://issues.apache.org/jira/browse/SPARK-22828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22828: -- Target Version/s: (was: 2.2.0) Labels: (was: spark) > Data corruption happens when

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297276#comment-16297276 ] Xuefu Zhang commented on SPARK-22765: - Hi [~CodingCat], yes, we adapted both #1 and #2, but we still

[jira] [Commented] (SPARK-21645) SparkSQL Left outer join get the error result when use phoenix spark plugin

[ https://issues.apache.org/jira/browse/SPARK-21645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297252#comment-16297252 ] Sunitha Kambhampati commented on SPARK-21645: - I tried to see if I can reproduce this issue

[jira] [Resolved] (SPARK-21652) Optimizer cannot reach a fixed point on certain queries

[ https://issues.apache.org/jira/browse/SPARK-21652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21652. - Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.3.0 > Optimizer cannot reach a

[jira] [Assigned] (SPARK-22825) Incorrect results of Casting Array to String

[ https://issues.apache.org/jira/browse/SPARK-22825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22825: Assignee: (was: Apache Spark) > Incorrect results of Casting Array to String >

[jira] [Assigned] (SPARK-22825) Incorrect results of Casting Array to String

[ https://issues.apache.org/jira/browse/SPARK-22825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22825: Assignee: Apache Spark > Incorrect results of Casting Array to String >

[jira] [Commented] (SPARK-22825) Incorrect results of Casting Array to String

[ https://issues.apache.org/jira/browse/SPARK-22825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297073#comment-16297073 ] Apache Spark commented on SPARK-22825: -- User 'maropu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22036) BigDecimal multiplication sometimes returns null

[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22036: Assignee: (was: Apache Spark) > BigDecimal multiplication sometimes returns null >

[jira] [Assigned] (SPARK-22036) BigDecimal multiplication sometimes returns null

[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22036: Assignee: Apache Spark > BigDecimal multiplication sometimes returns null >

[jira] [Commented] (SPARK-22036) BigDecimal multiplication sometimes returns null

[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297056#comment-16297056 ] Apache Spark commented on SPARK-22036: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22363) Add unit test for Window spilling

[ https://issues.apache.org/jira/browse/SPARK-22363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22363: Assignee: (was: Apache Spark) > Add unit test for Window spilling >

[jira] [Assigned] (SPARK-22363) Add unit test for Window spilling

[ https://issues.apache.org/jira/browse/SPARK-22363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22363: Assignee: Apache Spark > Add unit test for Window spilling >

[jira] [Commented] (SPARK-22363) Add unit test for Window spilling

[ https://issues.apache.org/jira/browse/SPARK-22363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297051#comment-16297051 ] Apache Spark commented on SPARK-22363: -- User 'gaborgsomogyi' has created a pull request for this

[jira] [Assigned] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-18016: --- Assignee: Kazuaki Ishizaki (was: Aleksander Eskilson) > Code Generation: Constant Pool

[jira] [Resolved] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-18016. - Resolution: Fixed Issue resolved by pull request 19811

[jira] [Commented] (SPARK-22668) CodegenContext.splitExpressions() creates incorrect results with global variable arguments

[ https://issues.apache.org/jira/browse/SPARK-22668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16296991#comment-16296991 ] Apache Spark commented on SPARK-22668: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Resolved] (SPARK-22794) Spark Job failed, but the state is succeeded in Yarn Web

[ https://issues.apache.org/jira/browse/SPARK-22794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22794. --- Resolution: Duplicate > Spark Job failed, but the state is succeeded in Yarn Web >

[jira] [Commented] (SPARK-22834) Make insert commands have real children to fix UI issues

[ https://issues.apache.org/jira/browse/SPARK-22834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16296883#comment-16296883 ] Apache Spark commented on SPARK-22834: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-22834) Make insert commands have real children to fix UI issues

[ https://issues.apache.org/jira/browse/SPARK-22834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22834: Assignee: Apache Spark > Make insert commands have real children to fix UI issues >

[jira] [Assigned] (SPARK-22834) Make insert commands have real children to fix UI issues

[ https://issues.apache.org/jira/browse/SPARK-22834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22834: Assignee: (was: Apache Spark) > Make insert commands have real children to fix UI

[jira] [Resolved] (SPARK-22815) Keep PromotePrecision in Optimized Plans

[ https://issues.apache.org/jira/browse/SPARK-22815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22815. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 2

[jira] [Created] (SPARK-22834) Make insert commands have real children to fix UI issues

Gengliang Wang created SPARK-22834: -- Summary: Make insert commands have real children to fix UI issues Key: SPARK-22834 URL: https://issues.apache.org/jira/browse/SPARK-22834 Project: Spark

[jira] [Resolved] (SPARK-22791) Redact Output of Explain

[ https://issues.apache.org/jira/browse/SPARK-22791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22791. - Resolution: Fixed Fix Version/s: 2.3.0 > Redact Output of Explain >

[jira] [Commented] (SPARK-21975) Histogram support in cost-based optimizer

[ https://issues.apache.org/jira/browse/SPARK-21975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16296824#comment-16296824 ] Wenchen Fan commented on SPARK-21975: - [~ZenWzh] any more subtasks for this JIRA? > Histogram

[jira] [Assigned] (SPARK-21984) Use histogram stats in join estimation

[ https://issues.apache.org/jira/browse/SPARK-21984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21984: --- Assignee: Zhenhua Wang > Use histogram stats in join estimation >

[jira] [Resolved] (SPARK-21984) Use histogram stats in join estimation

[ https://issues.apache.org/jira/browse/SPARK-21984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21984. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19594

[jira] [Assigned] (SPARK-22673) InMemoryRelation should utilize on-disk table stats whenever possible

[ https://issues.apache.org/jira/browse/SPARK-22673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22673: --- Assignee: Nan Zhu > InMemoryRelation should utilize on-disk table stats whenever possible >

[jira] [Resolved] (SPARK-22673) InMemoryRelation should utilize on-disk table stats whenever possible

[ https://issues.apache.org/jira/browse/SPARK-22673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22673. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19864

[jira] [Commented] (SPARK-22765) Create a new executor allocation scheme based on that of MR

[ https://issues.apache.org/jira/browse/SPARK-22765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16296811#comment-16296811 ] Thomas Graves commented on SPARK-22765: --- [~CodingCat] with SPARK-21656 executors shouldn't timeout

[jira] [Updated] (SPARK-22833) [Examples] Improvements made at SparkHive Example with Scala

[ https://issues.apache.org/jira/browse/SPARK-22833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22833: -- Priority: Minor (was: Major) > [Examples] Improvements made at SparkHive Example with Scala >

[jira] [Updated] (SPARK-22830) Scala Coding style has been improved in Spark Examples

[ https://issues.apache.org/jira/browse/SPARK-22830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22830: -- Priority: Trivial (was: Major) > Scala Coding style has been improved in Spark Examples >

[jira] [Resolved] (SPARK-22831) Long running spark app gets slower and slower over time,Maybe cause by unsafe/Platform

[ https://issues.apache.org/jira/browse/SPARK-22831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22831. --- Resolution: Invalid This is unclear, and not specific. I think at best you could rewrite this and

[jira] [Commented] (SPARK-22361) Add unit test for Window Frames

[ https://issues.apache.org/jira/browse/SPARK-22361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16296785#comment-16296785 ] Apache Spark commented on SPARK-22361: -- User 'gaborgsomogyi' has created a pull request for this

[jira] [Assigned] (SPARK-22361) Add unit test for Window Frames

[ https://issues.apache.org/jira/browse/SPARK-22361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22361: Assignee: Apache Spark > Add unit test for Window Frames >

[jira] [Assigned] (SPARK-22361) Add unit test for Window Frames

[ https://issues.apache.org/jira/browse/SPARK-22361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22361: Assignee: (was: Apache Spark) > Add unit test for Window Frames >

[jira] [Updated] (SPARK-22830) Scala Coding style has been improved in Spark Examples

[ https://issues.apache.org/jira/browse/SPARK-22830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22830: - Fix Version/s: (was: 2.2.1) > Scala Coding style has been improved in Spark Examples >

[jira] [Updated] (SPARK-22830) Scala Coding style has been improved in Spark Examples

[ https://issues.apache.org/jira/browse/SPARK-22830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22830: - Target Version/s: (was: 2.2.1) > Scala Coding style has been improved in Spark Examples >

[jira] [Updated] (SPARK-22833) [Examples] Improvements made at SparkHive Example with Scala

[ https://issues.apache.org/jira/browse/SPARK-22833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22833: - Fix Version/s: (was: 2.2.2) > [Examples] Improvements made at SparkHive Example with Scala >

[jira] [Updated] (SPARK-22833) [Examples] Improvements made at SparkHive Example with Scala

[ https://issues.apache.org/jira/browse/SPARK-22833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-22833: - Target Version/s: (was: 2.2.1) > [Examples] Improvements made at SparkHive Example with Scala

[jira] [Commented] (SPARK-22363) Add unit test for Window spilling

[ https://issues.apache.org/jira/browse/SPARK-22363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16296687#comment-16296687 ] Gabor Somogyi commented on SPARK-22363: --- I would like to work on this task. Please notify me if

[jira] [Assigned] (SPARK-22833) [Examples] Improvements made at SparkHive Example with Scala

[ https://issues.apache.org/jira/browse/SPARK-22833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22833: Assignee: Apache Spark > [Examples] Improvements made at SparkHive Example with Scala >

[jira] [Commented] (SPARK-22833) [Examples] Improvements made at SparkHive Example with Scala

[ https://issues.apache.org/jira/browse/SPARK-22833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16296658#comment-16296658 ] Apache Spark commented on SPARK-22833: -- User 'chetkhatri' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22833) [Examples] Improvements made at SparkHive Example with Scala

[ https://issues.apache.org/jira/browse/SPARK-22833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22833: Assignee: (was: Apache Spark) > [Examples] Improvements made at SparkHive Example

[jira] [Created] (SPARK-22833) [Examples] Improvements made at SparkHive Example with Scala

Chetan Khatri created SPARK-22833: - Summary: [Examples] Improvements made at SparkHive Example with Scala Key: SPARK-22833 URL: https://issues.apache.org/jira/browse/SPARK-22833 Project: Spark

[jira] [Assigned] (SPARK-22832) BisectingKMeans unpersist unused datasets

[ https://issues.apache.org/jira/browse/SPARK-22832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22832: Assignee: Apache Spark > BisectingKMeans unpersist unused datasets >

[jira] [Assigned] (SPARK-22832) BisectingKMeans unpersist unused datasets

[ https://issues.apache.org/jira/browse/SPARK-22832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22832: Assignee: (was: Apache Spark) > BisectingKMeans unpersist unused datasets >

[jira] [Commented] (SPARK-22832) BisectingKMeans unpersist unused datasets

[ https://issues.apache.org/jira/browse/SPARK-22832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16296574#comment-16296574 ] Apache Spark commented on SPARK-22832: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-22832) BisectingKMeans unpersist unused datasets

zhengruifeng created SPARK-22832: Summary: BisectingKMeans unpersist unused datasets Key: SPARK-22832 URL: https://issues.apache.org/jira/browse/SPARK-22832 Project: Spark Issue Type:

[jira] [Updated] (SPARK-22831) Long running spark app gets slower and slower over time,Maybe cause by unsafe/Platform

[ https://issues.apache.org/jira/browse/SPARK-22831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dingdong updated SPARK-22831: - Environment: * Linux * yarn-client * jdk7 * spark2.1 * scala-2.11.8 was: * Linux * yarn-client * jdk7

[jira] [Created] (SPARK-22831) Long running spark app gets slower and slower over time,Maybe cause by unsafe/Platform

dingdong created SPARK-22831: Summary: Long running spark app gets slower and slower over time,Maybe cause by unsafe/Platform Key: SPARK-22831 URL: https://issues.apache.org/jira/browse/SPARK-22831