[jira] [Issue Comment Deleted] (SPARK-17129) Support statistics collection and cardinality estimation for partitioned tables

[ https://issues.apache.org/jira/browse/SPARK-17129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-17129: - Comment: was deleted (was: Sure, that'll be great~) > Support statistics collection and

[jira] [Commented] (SPARK-17129) Support statistics collection and cardinality estimation for partitioned tables

[ https://issues.apache.org/jira/browse/SPARK-17129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057030#comment-16057030 ] Zhenhua Wang commented on SPARK-17129: -- Sure, that'll be great~ > Support statistics collection and

[jira] [Resolved] (SPARK-10655) Enhance DB2 dialect to handle XML, and DECIMAL , and DECFLOAT

[ https://issues.apache.org/jira/browse/SPARK-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-10655. - Resolution: Fixed Fix Version/s: 2.3.0 > Enhance DB2 dialect to handle XML, and DECIMAL , and

[jira] [Assigned] (SPARK-10655) Enhance DB2 dialect to handle XML, and DECIMAL , and DECFLOAT

[ https://issues.apache.org/jira/browse/SPARK-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-10655: --- Assignee: Suresh Thalamati > Enhance DB2 dialect to handle XML, and DECIMAL , and DECFLOAT >

[jira] [Commented] (SPARK-19293) Spark 2.1.x unstable with spark.speculation=true

[ https://issues.apache.org/jira/browse/SPARK-19293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056992#comment-16056992 ] coneyliu commented on SPARK-19293: -- When a task is finished, the `DAGScheduler` will try to kill the

[jira] [Commented] (SPARK-20466) HadoopRDD#addLocalConfiguration throws NPE

[ https://issues.apache.org/jira/browse/SPARK-20466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056991#comment-16056991 ] liyunzhang_intel commented on SPARK-20466: -- [~q79969786]: found the NPE when runing Hive on

[jira] [Commented] (SPARK-20466) HadoopRDD#addLocalConfiguration throws NPE

[ https://issues.apache.org/jira/browse/SPARK-20466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056985#comment-16056985 ] Yuming Wang commented on SPARK-20466: - [~kellyzly] How to reproduce it? >

[jira] [Resolved] (SPARK-21139) java.util.concurrent.RejectedExecutionException: rejected from java.util.concurrent.ThreadPoolExecutor@46477dd0[Terminated, pool size = 0, active threads = 0, queued ta

[ https://issues.apache.org/jira/browse/SPARK-21139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21139. -- Resolution: Invalid I am resolving this as it looks there is no argument against ^. Please

[jira] [Updated] (SPARK-20431) Support a DDL-formatted string in DataFrameReader.schema

[ https://issues.apache.org/jira/browse/SPARK-20431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-20431: - Component/s: Structured Streaming > Support a DDL-formatted string in DataFrameReader.schema >

[jira] [Commented] (SPARK-20431) Support a DDL-formatted string in DataFrameReader.schema

[ https://issues.apache.org/jira/browse/SPARK-20431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056899#comment-16056899 ] Apache Spark commented on SPARK-20431: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-21159) Cluster mode, driver throws connection refused exception submitted by SparkLauncher

[ https://issues.apache.org/jira/browse/SPARK-21159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056872#comment-16056872 ] Marcelo Vanzin commented on SPARK-21159: standalone cluster mode applications are not supported

[jira] [Created] (SPARK-21159) Cluster mode, driver throws connection refused exception submitted by SparkLauncher

niefei created SPARK-21159: -- Summary: Cluster mode, driver throws connection refused exception submitted by SparkLauncher Key: SPARK-21159 URL: https://issues.apache.org/jira/browse/SPARK-21159 Project:

[jira] [Commented] (SPARK-21157) Report Total Memory Used by Spark Executors

[ https://issues.apache.org/jira/browse/SPARK-21157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056779#comment-16056779 ] Marcelo Vanzin commented on SPARK-21157: I'm pretty confused by the description of flights. How

[jira] [Commented] (SPARK-21158) SparkSQL function SparkSession.Catalog.ListTables() does not handle spark setting for case-sensitivity

[ https://issues.apache.org/jira/browse/SPARK-21158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056758#comment-16056758 ] Cam Quoc Mach commented on SPARK-21158: --- Can I take this task? > SparkSQL function

[jira] [Resolved] (SPARK-20951) Built-in SQL Function FormatNumber should validate input value

[ https://issues.apache.org/jira/browse/SPARK-20951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-20951. - Resolution: Won't Fix > Built-in SQL Function FormatNumber should validate input value >

[jira] [Updated] (SPARK-21158) SparkSQL function SparkSession.Catalog.ListTables() does not handle spark setting for case-sensitivity

[ https://issues.apache.org/jira/browse/SPARK-21158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kathryn McClintic updated SPARK-21158: -- Description: When working with SQL table names in Spark SQL we have noticed some

[jira] [Created] (SPARK-21158) SparkSQL function SparkSession.Catalog.ListTables() does not handle spark setting for case-sensitivity

Kathryn McClintic created SPARK-21158: - Summary: SparkSQL function SparkSession.Catalog.ListTables() does not handle spark setting for case-sensitivity Key: SPARK-21158 URL:

[jira] [Updated] (SPARK-21157) Report Total Memory Used by Spark Executors

[ https://issues.apache.org/jira/browse/SPARK-21157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Soltren updated SPARK-21157: - Attachment: TotalMemoryReportingDesignDoc.pdf > Report Total Memory Used by Spark Executors >

[jira] [Created] (SPARK-21157) Report Total Memory Used by Spark Executors

Jose Soltren created SPARK-21157: Summary: Report Total Memory Used by Spark Executors Key: SPARK-21157 URL: https://issues.apache.org/jira/browse/SPARK-21157 Project: Spark Issue Type:

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056601#comment-16056601 ] Charles Allen commented on SPARK-19111: --- [~ste...@apache.org] It makes it unstable because the

[jira] [Updated] (SPARK-21155) Add (? running tasks) into Spark UI progress

[ https://issues.apache.org/jira/browse/SPARK-21155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Vandenberg updated SPARK-21155: Attachment: Screen Shot 2017-06-20 at 3.40.39 PM.png Before > Add (? running tasks) into

[jira] [Commented] (SPARK-20889) SparkR grouped documentation for Column methods

[ https://issues.apache.org/jira/browse/SPARK-20889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056560#comment-16056560 ] Apache Spark commented on SPARK-20889: -- User 'actuaryzhang' has created a pull request for this

[jira] [Commented] (SPARK-21156) Spark cannot handle multiple KMS server configuration

[ https://issues.apache.org/jira/browse/SPARK-21156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056524#comment-16056524 ] Monica Raj commented on SPARK-21156: This issue has been seen with spark-1.6.1 and Ranger KMS from

[jira] [Updated] (SPARK-21156) Spark cannot handle multiple KMS server configuration

[ https://issues.apache.org/jira/browse/SPARK-21156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Monica Raj updated SPARK-21156: --- Summary: Spark cannot handle multiple KMS server configuration (was: Spark cannot handle multiple

[jira] [Updated] (SPARK-21156) Spark cannot handle multiple Ranger KMS server configuration

[ https://issues.apache.org/jira/browse/SPARK-21156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Monica Raj updated SPARK-21156: --- Summary: Spark cannot handle multiple Ranger KMS server configuration (was: Spark token renewal is

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056516#comment-16056516 ] Steve Loughran commented on SPARK-19111: Followup: [~drcrallen]; Hadoop 2.8 is out the door with

[jira] [Resolved] (SPARK-19277) YARN topology script configuration needs to be localized by Spark

[ https://issues.apache.org/jira/browse/SPARK-19277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-19277. Resolution: Won't Fix After thinking a lot about this I think this is the wrong approach.

[jira] [Assigned] (SPARK-9825) Spark overwrites remote cluster "final" properties with local config

[ https://issues.apache.org/jira/browse/SPARK-9825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9825: --- Assignee: Apache Spark > Spark overwrites remote cluster "final" properties with local

[jira] [Assigned] (SPARK-9825) Spark overwrites remote cluster "final" properties with local config

[ https://issues.apache.org/jira/browse/SPARK-9825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9825: --- Assignee: (was: Apache Spark) > Spark overwrites remote cluster "final" properties with

[jira] [Commented] (SPARK-9825) Spark overwrites remote cluster "final" properties with local config

[ https://issues.apache.org/jira/browse/SPARK-9825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056506#comment-16056506 ] Apache Spark commented on SPARK-9825: - User 'vanzin' has created a pull request for this issue:

[jira] [Commented] (SPARK-21155) Add (? running tasks) into Spark UI progress

[ https://issues.apache.org/jira/browse/SPARK-21155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056500#comment-16056500 ] Eric Vandenberg commented on SPARK-21155: - The pr is @

[jira] [Commented] (SPARK-21155) Add (? running tasks) into Spark UI progress

[ https://issues.apache.org/jira/browse/SPARK-21155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056499#comment-16056499 ] Apache Spark commented on SPARK-21155: -- User 'ericvandenbergfb' has created a pull request for this

[jira] [Assigned] (SPARK-21155) Add (? running tasks) into Spark UI progress

[ https://issues.apache.org/jira/browse/SPARK-21155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21155: Assignee: Apache Spark > Add (? running tasks) into Spark UI progress >

[jira] [Assigned] (SPARK-21155) Add (? running tasks) into Spark UI progress

[ https://issues.apache.org/jira/browse/SPARK-21155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21155: Assignee: (was: Apache Spark) > Add (? running tasks) into Spark UI progress >

[jira] [Assigned] (SPARK-21102) Refresh command is too aggressive in parsing

[ https://issues.apache.org/jira/browse/SPARK-21102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21102: Assignee: Apache Spark > Refresh command is too aggressive in parsing >

[jira] [Assigned] (SPARK-21102) Refresh command is too aggressive in parsing

[ https://issues.apache.org/jira/browse/SPARK-21102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21102: Assignee: (was: Apache Spark) > Refresh command is too aggressive in parsing >

[jira] [Commented] (SPARK-21102) Refresh command is too aggressive in parsing

[ https://issues.apache.org/jira/browse/SPARK-21102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056491#comment-16056491 ] Apache Spark commented on SPARK-21102: -- User 'aokolnychyi' has created a pull request for this

[jira] [Created] (SPARK-21156) Spark token renewal is not compatible multiple Ranger KMS server configuration

Monica Raj created SPARK-21156: -- Summary: Spark token renewal is not compatible multiple Ranger KMS server configuration Key: SPARK-21156 URL: https://issues.apache.org/jira/browse/SPARK-21156 Project:

[jira] [Comment Edited] (SPARK-21122) Address starvation issues when dynamic allocation is enabled

[ https://issues.apache.org/jira/browse/SPARK-21122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056399#comment-16056399 ] Craig Ingram edited comment on SPARK-21122 at 6/20/17 8:35 PM: --- Attached

[jira] [Updated] (SPARK-21122) Address starvation issues when dynamic allocation is enabled

[ https://issues.apache.org/jira/browse/SPARK-21122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Ingram updated SPARK-21122: - Attachment: Preventing Starvation with Dynamic Allocation Enabled.pdf Initial high-level design

[jira] [Updated] (SPARK-21155) Add (? running tasks) into Spark UI progress

[ https://issues.apache.org/jira/browse/SPARK-21155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21155: -- Target Version/s: (was: 2.3.0) Fix Version/s: (was: 2.3.0) Don't set target / fix

[jira] [Updated] (SPARK-21123) Options for file stream source are in a wrong table

[ https://issues.apache.org/jira/browse/SPARK-21123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-21123: - Fix Version/s: 2.1.2 > Options for file stream source are in a wrong table >

[jira] [Assigned] (SPARK-21123) Options for file stream source are in a wrong table

[ https://issues.apache.org/jira/browse/SPARK-21123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reassigned SPARK-21123: Assignee: Assaf Mendelson > Options for file stream source are in a wrong table >

[jira] [Updated] (SPARK-21155) Add (? running tasks) into Spark UI progress

[ https://issues.apache.org/jira/browse/SPARK-21155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Vandenberg updated SPARK-21155: Attachment: Screen Shot 2017-06-20 at 12.32.58 PM.png > Add (? running tasks) into Spark

[jira] [Created] (SPARK-21155) Add (? running tasks) into Spark UI progress

Eric Vandenberg created SPARK-21155: --- Summary: Add (? running tasks) into Spark UI progress Key: SPARK-21155 URL: https://issues.apache.org/jira/browse/SPARK-21155 Project: Spark Issue

[jira] [Commented] (SPARK-21154) ParseException when Create View from another View in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-21154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056314#comment-16056314 ] Brian Zhang commented on SPARK-21154: - default.my_view in the expanded SQL is causing the issue, I

[jira] [Updated] (SPARK-21154) ParseException when Create View from another View in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-21154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Zhang updated SPARK-21154: Description: When creating View from another existing View in Spark SQL, we will see

[jira] [Updated] (SPARK-21154) ParseException when Create View from another View in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-21154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Zhang updated SPARK-21154: Description: When creating View from another existing View in Spark SQL, we will see

[jira] [Commented] (SPARK-21074) Parquet files are read fully even though only count() is requested

[ https://issues.apache.org/jira/browse/SPARK-21074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056309#comment-16056309 ] Steve Loughran commented on SPARK-21074: Given this is an s3 URL, it may be amplifying the

[jira] [Created] (SPARK-21154) ParseException when Create View from another View in Spark SQL

Brian Zhang created SPARK-21154: --- Summary: ParseException when Create View from another View in Spark SQL Key: SPARK-21154 URL: https://issues.apache.org/jira/browse/SPARK-21154 Project: Spark

[jira] [Updated] (SPARK-21154) ParseException when Create View from another View in Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-21154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Zhang updated SPARK-21154: Description: When creating View from another existing View in Spark SQL, we will see

[jira] [Resolved] (SPARK-21103) QueryPlanConstraints should be part of LogicalPlan

[ https://issues.apache.org/jira/browse/SPARK-21103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-21103. - Resolution: Fixed Fix Version/s: 2.3.0 > QueryPlanConstraints should be part of

[jira] [Assigned] (SPARK-21008) Streaming applications read stale credentials file when recovering from checkpoint.

[ https://issues.apache.org/jira/browse/SPARK-21008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-21008: -- Assignee: Xing Shi > Streaming applications read stale credentials file when

[jira] [Assigned] (SPARK-21008) Streaming applications read stale credentials file when recovering from checkpoint.

[ https://issues.apache.org/jira/browse/SPARK-21008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-21008: -- Assignee: (was: Xing Shi) > Streaming applications read stale credentials file

[jira] [Assigned] (SPARK-19688) Spark on Yarn Credentials File set to different application directory

[ https://issues.apache.org/jira/browse/SPARK-19688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-19688: -- Assignee: Xing Shi > Spark on Yarn Credentials File set to different application

[jira] [Commented] (SPARK-21082) Consider Executor's memory usage when scheduling task

[ https://issues.apache.org/jira/browse/SPARK-21082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056118#comment-16056118 ] Thomas Graves commented on SPARK-21082: --- Yes executor should not oom if you are trying to cache to

[jira] [Commented] (SPARK-20889) SparkR grouped documentation for Column methods

[ https://issues.apache.org/jira/browse/SPARK-20889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056117#comment-16056117 ] Apache Spark commented on SPARK-20889: -- User 'actuaryzhang' has created a pull request for this

[jira] [Resolved] (SPARK-21151) Maven release error - Spark 2.0.2 with scala 2.10 version

[ https://issues.apache.org/jira/browse/SPARK-21151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21151. --- Resolution: Not A Problem Fix Version/s: (was: 2.0.2) Please read

[jira] [Assigned] (SPARK-21147) the schema of socket source can not be set.

[ https://issues.apache.org/jira/browse/SPARK-21147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21147: Assignee: Apache Spark > the schema of socket source can not be set. >

[jira] [Assigned] (SPARK-21147) the schema of socket source can not be set.

[ https://issues.apache.org/jira/browse/SPARK-21147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21147: Assignee: (was: Apache Spark) > the schema of socket source can not be set. >

[jira] [Commented] (SPARK-21147) the schema of socket source can not be set.

[ https://issues.apache.org/jira/browse/SPARK-21147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056037#comment-16056037 ] Apache Spark commented on SPARK-21147: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-21152) Use level 3 BLAS operations in LogisticAggregator

Seth Hendrickson created SPARK-21152: Summary: Use level 3 BLAS operations in LogisticAggregator Key: SPARK-21152 URL: https://issues.apache.org/jira/browse/SPARK-21152 Project: Spark

[jira] [Resolved] (SPARK-21150) Persistent view stored in Hive metastore should be case preserving.

[ https://issues.apache.org/jira/browse/SPARK-21150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21150. - Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 2.2.0 > Persistent view stored in

[jira] [Commented] (SPARK-21152) Use level 3 BLAS operations in LogisticAggregator

[ https://issues.apache.org/jira/browse/SPARK-21152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056025#comment-16056025 ] Seth Hendrickson commented on SPARK-21152: -- cc [~dbtsai] [~mlnick] [~srowen] BTW, I've been

[jira] [Commented] (SPARK-21153) Time windowing for tumbling windows can use a project instead of expand + filter

[ https://issues.apache.org/jira/browse/SPARK-21153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056022#comment-16056022 ] Apache Spark commented on SPARK-21153: -- User 'brkyvz' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21153) Time windowing for tumbling windows can use a project instead of expand + filter

[ https://issues.apache.org/jira/browse/SPARK-21153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21153: Assignee: Burak Yavuz (was: Apache Spark) > Time windowing for tumbling windows can use

[jira] [Assigned] (SPARK-21153) Time windowing for tumbling windows can use a project instead of expand + filter

[ https://issues.apache.org/jira/browse/SPARK-21153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21153: Assignee: Apache Spark (was: Burak Yavuz) > Time windowing for tumbling windows can use

[jira] [Created] (SPARK-21153) Time windowing for tumbling windows can use a project instead of expand + filter

Burak Yavuz created SPARK-21153: --- Summary: Time windowing for tumbling windows can use a project instead of expand + filter Key: SPARK-21153 URL: https://issues.apache.org/jira/browse/SPARK-21153

[jira] [Commented] (SPARK-17129) Support statistics collection and cardinality estimation for partitioned tables

[ https://issues.apache.org/jira/browse/SPARK-17129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056008#comment-16056008 ] Maria commented on SPARK-17129: --- [~ZenWzh], I happen to work with large number of partitioned tables where

[jira] [Created] (SPARK-21151) Maven release error - Spark 2.0.2 with scala 2.10 version

Kanagha Pradha created SPARK-21151: -- Summary: Maven release error - Spark 2.0.2 with scala 2.10 version Key: SPARK-21151 URL: https://issues.apache.org/jira/browse/SPARK-21151 Project: Spark

[jira] [Commented] (SPARK-21123) Options for file stream source are in a wrong table

[ https://issues.apache.org/jira/browse/SPARK-21123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055847#comment-16055847 ] Apache Spark commented on SPARK-21123: -- User 'assafmendelson' has created a pull request for this

[jira] [Assigned] (SPARK-20832) Standalone master should explicitly inform drivers of worker deaths and invalidate external shuffle service outputs

[ https://issues.apache.org/jira/browse/SPARK-20832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20832: Assignee: Apache Spark > Standalone master should explicitly inform drivers of worker

[jira] [Commented] (SPARK-20832) Standalone master should explicitly inform drivers of worker deaths and invalidate external shuffle service outputs

[ https://issues.apache.org/jira/browse/SPARK-20832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055746#comment-16055746 ] Apache Spark commented on SPARK-20832: -- User 'jiangxb1987' has created a pull request for this

[jira] [Assigned] (SPARK-20832) Standalone master should explicitly inform drivers of worker deaths and invalidate external shuffle service outputs

[ https://issues.apache.org/jira/browse/SPARK-20832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20832: Assignee: (was: Apache Spark) > Standalone master should explicitly inform drivers of

[jira] [Commented] (SPARK-19660) Replace the configuration property names that are deprecated in the version of Hadoop 2.6

[ https://issues.apache.org/jira/browse/SPARK-19660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055543#comment-16055543 ] Apache Spark commented on SPARK-19660: -- User 'wangyum' has created a pull request for this issue:

[jira] [Closed] (SPARK-21134) Codegen-only expressions should not be collapsed with upper CodegenFallback expression

[ https://issues.apache.org/jira/browse/SPARK-21134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh closed SPARK-21134. --- Resolution: Won't Fix > Codegen-only expressions should not be collapsed with upper

[jira] [Commented] (SPARK-21134) Codegen-only expressions should not be collapsed with upper CodegenFallback expression

[ https://issues.apache.org/jira/browse/SPARK-21134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055499#comment-16055499 ] Liang-Chi Hsieh commented on SPARK-21134: - Due to the discussion on the PR, we may remove

[jira] [Assigned] (SPARK-20989) Fail to start multiple workers on one host if external shuffle service is enabled in standalone mode

[ https://issues.apache.org/jira/browse/SPARK-20989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-20989: --- Assignee: Jiang Xingbo > Fail to start multiple workers on one host if external shuffle

[jira] [Resolved] (SPARK-20989) Fail to start multiple workers on one host if external shuffle service is enabled in standalone mode

[ https://issues.apache.org/jira/browse/SPARK-20989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20989. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18290

[jira] [Commented] (SPARK-21150) Persistent view stored in Hive metastore should be case preserving.

[ https://issues.apache.org/jira/browse/SPARK-21150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055388#comment-16055388 ] Apache Spark commented on SPARK-21150: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21150) Persistent view stored in Hive metastore should be case preserving.

[ https://issues.apache.org/jira/browse/SPARK-21150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21150: Assignee: (was: Apache Spark) > Persistent view stored in Hive metastore should be

[jira] [Assigned] (SPARK-21150) Persistent view stored in Hive metastore should be case preserving.

[ https://issues.apache.org/jira/browse/SPARK-21150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21150: Assignee: Apache Spark > Persistent view stored in Hive metastore should be case

[jira] [Comment Edited] (SPARK-21066) LibSVM load just one input file

[ https://issues.apache.org/jira/browse/SPARK-21066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055336#comment-16055336 ] Yan Facai (颜发才) edited comment on SPARK-21066 at 6/20/17 8:27 AM: --

[jira] [Commented] (SPARK-21066) LibSVM load just one input file

[ https://issues.apache.org/jira/browse/SPARK-21066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055336#comment-16055336 ] Yan Facai (颜发才) commented on SPARK-21066: - [~sowen] I believe that the API has explained well in

[jira] [Commented] (SPARK-21066) LibSVM load just one input file

[ https://issues.apache.org/jira/browse/SPARK-21066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055328#comment-16055328 ] Yan Facai (颜发才) commented on SPARK-21066: - Hi, [~darion] . If `numFeature` is specified,

[jira] [Comment Edited] (SPARK-21066) LibSVM load just one input file

[ https://issues.apache.org/jira/browse/SPARK-21066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055328#comment-16055328 ] Yan Facai (颜发才) edited comment on SPARK-21066 at 6/20/17 8:12 AM: -- Hi,

[jira] [Commented] (SPARK-21144) Unexpected results when the data schema and partition schema have the duplicate columns

[ https://issues.apache.org/jira/browse/SPARK-21144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055283#comment-16055283 ] Apache Spark commented on SPARK-21144: -- User 'maropu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21150) Persistent view stored in Hive metastore should be case preserving.

[ https://issues.apache.org/jira/browse/SPARK-21150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-21150: --- Assignee: (was: Jiang Xingbo) > Persistent view stored in Hive metastore should be case

[jira] [Assigned] (SPARK-21150) Persistent view stored in Hive metastore should be case preserving.

[ https://issues.apache.org/jira/browse/SPARK-21150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-21150: --- Assignee: Jiang Xingbo Target Version/s: 2.2.0 Priority: Blocker (was:

[jira] [Created] (SPARK-21150) Persistent view stored in Hive metastore should be case preserving.

Xiao Li created SPARK-21150: --- Summary: Persistent view stored in Hive metastore should be case preserving. Key: SPARK-21150 URL: https://issues.apache.org/jira/browse/SPARK-21150 Project: Spark

[jira] [Resolved] (SPARK-20929) LinearSVC should not use shared Param HasThresholds

[ https://issues.apache.org/jira/browse/SPARK-20929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-20929. --- Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 Issue

[jira] [Updated] (SPARK-20929) LinearSVC should not use shared Param HasThresholds

[ https://issues.apache.org/jira/browse/SPARK-20929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20929: -- Target Version/s: 2.2.1, 2.3.0 > LinearSVC should not use shared Param HasThresholds >