[jira] [Commented] (SPARK-17129) Support statistics collection and cardinality estimation for partitioned tables

2017-06-20 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057033#comment-16057033 ] Zhenhua Wang commented on SPARK-17129: -- [~mbasmanova] Sure, that'll be great~ > Sup

[jira] [Commented] (SPARK-17129) Support statistics collection and cardinality estimation for partitioned tables

2017-06-20 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057030#comment-16057030 ] Zhenhua Wang commented on SPARK-17129: -- Sure, that'll be great~ > Support statistic

[jira] [Issue Comment Deleted] (SPARK-17129) Support statistics collection and cardinality estimation for partitioned tables

2017-06-20 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-17129: - Comment: was deleted (was: Sure, that'll be great~) > Support statistics collection and cardinal

[jira] [Resolved] (SPARK-10655) Enhance DB2 dialect to handle XML, and DECIMAL , and DECFLOAT

2017-06-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-10655. - Resolution: Fixed Fix Version/s: 2.3.0 > Enhance DB2 dialect to handle XML, and DECIMAL , and DECF

[jira] [Assigned] (SPARK-10655) Enhance DB2 dialect to handle XML, and DECIMAL , and DECFLOAT

2017-06-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-10655: --- Assignee: Suresh Thalamati > Enhance DB2 dialect to handle XML, and DECIMAL , and DECFLOAT > ---

[jira] [Commented] (SPARK-19293) Spark 2.1.x unstable with spark.speculation=true

2017-06-20 Thread coneyliu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056992#comment-16056992 ] coneyliu commented on SPARK-19293: -- When a task is finished, the `DAGScheduler` will try

[jira] [Commented] (SPARK-20466) HadoopRDD#addLocalConfiguration throws NPE

2017-06-20 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056991#comment-16056991 ] liyunzhang_intel commented on SPARK-20466: -- [~q79969786]: found the NPE when run

[jira] [Commented] (SPARK-20466) HadoopRDD#addLocalConfiguration throws NPE

2017-06-20 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056985#comment-16056985 ] Yuming Wang commented on SPARK-20466: - [~kellyzly] How to reproduce it? > HadoopRDD#

[jira] [Resolved] (SPARK-21139) java.util.concurrent.RejectedExecutionException: rejected from java.util.concurrent.ThreadPoolExecutor@46477dd0[Terminated, pool size = 0, active threads = 0, queued ta

2017-06-20 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21139. -- Resolution: Invalid I am resolving this as it looks there is no argument against ^. Please reop

[jira] [Updated] (SPARK-20431) Support a DDL-formatted string in DataFrameReader.schema

2017-06-20 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-20431: - Component/s: Structured Streaming > Support a DDL-formatted string in DataFrameReader.schema > --

[jira] [Commented] (SPARK-20431) Support a DDL-formatted string in DataFrameReader.schema

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056899#comment-16056899 ] Apache Spark commented on SPARK-20431: -- User 'HyukjinKwon' has created a pull reques

[jira] [Commented] (SPARK-21159) Cluster mode, driver throws connection refused exception submitted by SparkLauncher

2017-06-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056872#comment-16056872 ] Marcelo Vanzin commented on SPARK-21159: standalone cluster mode applications are

[jira] [Created] (SPARK-21159) Cluster mode, driver throws connection refused exception submitted by SparkLauncher

2017-06-20 Thread niefei (JIRA)
niefei created SPARK-21159: -- Summary: Cluster mode, driver throws connection refused exception submitted by SparkLauncher Key: SPARK-21159 URL: https://issues.apache.org/jira/browse/SPARK-21159 Project: Spar

[jira] [Commented] (SPARK-21157) Report Total Memory Used by Spark Executors

2017-06-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056779#comment-16056779 ] Marcelo Vanzin commented on SPARK-21157: I'm pretty confused by the description o

[jira] [Commented] (SPARK-21158) SparkSQL function SparkSession.Catalog.ListTables() does not handle spark setting for case-sensitivity

2017-06-20 Thread Cam Quoc Mach (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056758#comment-16056758 ] Cam Quoc Mach commented on SPARK-21158: --- Can I take this task? > SparkSQL function

[jira] [Resolved] (SPARK-20951) Built-in SQL Function FormatNumber should validate input value

2017-06-20 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-20951. - Resolution: Won't Fix > Built-in SQL Function FormatNumber should validate input value >

[jira] [Updated] (SPARK-21158) SparkSQL function SparkSession.Catalog.ListTables() does not handle spark setting for case-sensitivity

2017-06-20 Thread Kathryn McClintic (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kathryn McClintic updated SPARK-21158: -- Description: When working with SQL table names in Spark SQL we have noticed some issues

[jira] [Created] (SPARK-21158) SparkSQL function SparkSession.Catalog.ListTables() does not handle spark setting for case-sensitivity

2017-06-20 Thread Kathryn McClintic (JIRA)
Kathryn McClintic created SPARK-21158: - Summary: SparkSQL function SparkSession.Catalog.ListTables() does not handle spark setting for case-sensitivity Key: SPARK-21158 URL: https://issues.apache.org/jira/brow

[jira] [Updated] (SPARK-21157) Report Total Memory Used by Spark Executors

2017-06-20 Thread Jose Soltren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Soltren updated SPARK-21157: - Attachment: TotalMemoryReportingDesignDoc.pdf > Report Total Memory Used by Spark Executors > ---

[jira] [Created] (SPARK-21157) Report Total Memory Used by Spark Executors

2017-06-20 Thread Jose Soltren (JIRA)
Jose Soltren created SPARK-21157: Summary: Report Total Memory Used by Spark Executors Key: SPARK-21157 URL: https://issues.apache.org/jira/browse/SPARK-21157 Project: Spark Issue Type: Impro

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

2017-06-20 Thread Charles Allen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056601#comment-16056601 ] Charles Allen commented on SPARK-19111: --- [~ste...@apache.org] It makes it unstable

[jira] [Updated] (SPARK-21155) Add (? running tasks) into Spark UI progress

2017-06-20 Thread Eric Vandenberg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Vandenberg updated SPARK-21155: Attachment: Screen Shot 2017-06-20 at 3.40.39 PM.png Before > Add (? running tasks) into

[jira] [Commented] (SPARK-20889) SparkR grouped documentation for Column methods

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056560#comment-16056560 ] Apache Spark commented on SPARK-20889: -- User 'actuaryzhang' has created a pull reque

[jira] [Commented] (SPARK-21156) Spark cannot handle multiple KMS server configuration

2017-06-20 Thread Monica Raj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056524#comment-16056524 ] Monica Raj commented on SPARK-21156: This issue has been seen with spark-1.6.1 and Ra

[jira] [Updated] (SPARK-21156) Spark cannot handle multiple KMS server configuration

2017-06-20 Thread Monica Raj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Monica Raj updated SPARK-21156: --- Summary: Spark cannot handle multiple KMS server configuration (was: Spark cannot handle multiple Ra

[jira] [Updated] (SPARK-21156) Spark cannot handle multiple Ranger KMS server configuration

2017-06-20 Thread Monica Raj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Monica Raj updated SPARK-21156: --- Summary: Spark cannot handle multiple Ranger KMS server configuration (was: Spark token renewal is n

[jira] [Commented] (SPARK-19111) S3 Mesos history upload fails silently if too large

2017-06-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056516#comment-16056516 ] Steve Loughran commented on SPARK-19111: Followup: [~drcrallen]; Hadoop 2.8 is ou

[jira] [Resolved] (SPARK-19277) YARN topology script configuration needs to be localized by Spark

2017-06-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-19277. Resolution: Won't Fix After thinking a lot about this I think this is the wrong approach. T

[jira] [Assigned] (SPARK-9825) Spark overwrites remote cluster "final" properties with local config

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9825: --- Assignee: Apache Spark > Spark overwrites remote cluster "final" properties with local config

[jira] [Assigned] (SPARK-9825) Spark overwrites remote cluster "final" properties with local config

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9825: --- Assignee: (was: Apache Spark) > Spark overwrites remote cluster "final" properties with l

[jira] [Commented] (SPARK-9825) Spark overwrites remote cluster "final" properties with local config

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056506#comment-16056506 ] Apache Spark commented on SPARK-9825: - User 'vanzin' has created a pull request for th

[jira] [Commented] (SPARK-21155) Add (? running tasks) into Spark UI progress

2017-06-20 Thread Eric Vandenberg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056500#comment-16056500 ] Eric Vandenberg commented on SPARK-21155: - The pr is @ https://github.com/apache/

[jira] [Commented] (SPARK-21155) Add (? running tasks) into Spark UI progress

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056499#comment-16056499 ] Apache Spark commented on SPARK-21155: -- User 'ericvandenbergfb' has created a pull r

[jira] [Assigned] (SPARK-21155) Add (? running tasks) into Spark UI progress

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21155: Assignee: Apache Spark > Add (? running tasks) into Spark UI progress > --

[jira] [Assigned] (SPARK-21155) Add (? running tasks) into Spark UI progress

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21155: Assignee: (was: Apache Spark) > Add (? running tasks) into Spark UI progress > ---

[jira] [Assigned] (SPARK-21102) Refresh command is too aggressive in parsing

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21102: Assignee: Apache Spark > Refresh command is too aggressive in parsing > --

[jira] [Assigned] (SPARK-21102) Refresh command is too aggressive in parsing

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21102: Assignee: (was: Apache Spark) > Refresh command is too aggressive in parsing > ---

[jira] [Commented] (SPARK-21102) Refresh command is too aggressive in parsing

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056491#comment-16056491 ] Apache Spark commented on SPARK-21102: -- User 'aokolnychyi' has created a pull reques

[jira] [Created] (SPARK-21156) Spark token renewal is not compatible multiple Ranger KMS server configuration

2017-06-20 Thread Monica Raj (JIRA)
Monica Raj created SPARK-21156: -- Summary: Spark token renewal is not compatible multiple Ranger KMS server configuration Key: SPARK-21156 URL: https://issues.apache.org/jira/browse/SPARK-21156 Project: S

[jira] [Comment Edited] (SPARK-21122) Address starvation issues when dynamic allocation is enabled

2017-06-20 Thread Craig Ingram (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056399#comment-16056399 ] Craig Ingram edited comment on SPARK-21122 at 6/20/17 8:35 PM:

[jira] [Updated] (SPARK-21122) Address starvation issues when dynamic allocation is enabled

2017-06-20 Thread Craig Ingram (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Ingram updated SPARK-21122: - Attachment: Preventing Starvation with Dynamic Allocation Enabled.pdf Initial high-level design d

[jira] [Updated] (SPARK-21155) Add (? running tasks) into Spark UI progress

2017-06-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21155: -- Target Version/s: (was: 2.3.0) Fix Version/s: (was: 2.3.0) Don't set target / fix version.

[jira] [Updated] (SPARK-21123) Options for file stream source are in a wrong table

2017-06-20 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-21123: - Fix Version/s: 2.1.2 > Options for file stream source are in a wrong table >

[jira] [Assigned] (SPARK-21123) Options for file stream source are in a wrong table

2017-06-20 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reassigned SPARK-21123: Assignee: Assaf Mendelson > Options for file stream source are in a wrong table >

[jira] [Updated] (SPARK-21155) Add (? running tasks) into Spark UI progress

2017-06-20 Thread Eric Vandenberg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Vandenberg updated SPARK-21155: Attachment: Screen Shot 2017-06-20 at 12.32.58 PM.png > Add (? running tasks) into Spark UI

[jira] [Created] (SPARK-21155) Add (? running tasks) into Spark UI progress

2017-06-20 Thread Eric Vandenberg (JIRA)
Eric Vandenberg created SPARK-21155: --- Summary: Add (? running tasks) into Spark UI progress Key: SPARK-21155 URL: https://issues.apache.org/jira/browse/SPARK-21155 Project: Spark Issue Type

[jira] [Commented] (SPARK-21154) ParseException when Create View from another View in Spark SQL

2017-06-20 Thread Brian Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056314#comment-16056314 ] Brian Zhang commented on SPARK-21154: - default.my_view in the expanded SQL is causing

[jira] [Updated] (SPARK-21154) ParseException when Create View from another View in Spark SQL

2017-06-20 Thread Brian Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Zhang updated SPARK-21154: Description: When creating View from another existing View in Spark SQL, we will see ParseExceptio

[jira] [Updated] (SPARK-21154) ParseException when Create View from another View in Spark SQL

2017-06-20 Thread Brian Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Zhang updated SPARK-21154: Description: When creating View from another existing View in Spark SQL, we will see ParseExceptio

[jira] [Commented] (SPARK-21074) Parquet files are read fully even though only count() is requested

2017-06-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056309#comment-16056309 ] Steve Loughran commented on SPARK-21074: Given this is an s3 URL, it may be ampli

[jira] [Created] (SPARK-21154) ParseException when Create View from another View in Spark SQL

2017-06-20 Thread Brian Zhang (JIRA)
Brian Zhang created SPARK-21154: --- Summary: ParseException when Create View from another View in Spark SQL Key: SPARK-21154 URL: https://issues.apache.org/jira/browse/SPARK-21154 Project: Spark

[jira] [Updated] (SPARK-21154) ParseException when Create View from another View in Spark SQL

2017-06-20 Thread Brian Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Zhang updated SPARK-21154: Description: When creating View from another existing View in Spark SQL, we will see ParseExceptio

[jira] [Resolved] (SPARK-21103) QueryPlanConstraints should be part of LogicalPlan

2017-06-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-21103. - Resolution: Fixed Fix Version/s: 2.3.0 > QueryPlanConstraints should be part of LogicalPla

[jira] [Assigned] (SPARK-21008) Streaming applications read stale credentials file when recovering from checkpoint.

2017-06-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-21008: -- Assignee: Xing Shi > Streaming applications read stale credentials file when recoverin

[jira] [Assigned] (SPARK-21008) Streaming applications read stale credentials file when recovering from checkpoint.

2017-06-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-21008: -- Assignee: (was: Xing Shi) > Streaming applications read stale credentials file whe

[jira] [Assigned] (SPARK-19688) Spark on Yarn Credentials File set to different application directory

2017-06-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-19688: -- Assignee: Xing Shi > Spark on Yarn Credentials File set to different application direc

[jira] [Commented] (SPARK-21082) Consider Executor's memory usage when scheduling task

2017-06-20 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056118#comment-16056118 ] Thomas Graves commented on SPARK-21082: --- Yes executor should not oom if you are try

[jira] [Commented] (SPARK-20889) SparkR grouped documentation for Column methods

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056117#comment-16056117 ] Apache Spark commented on SPARK-20889: -- User 'actuaryzhang' has created a pull reque

[jira] [Resolved] (SPARK-21151) Maven release error - Spark 2.0.2 with scala 2.10 version

2017-06-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21151. --- Resolution: Not A Problem Fix Version/s: (was: 2.0.2) Please read http://spark.apache.org/

[jira] [Assigned] (SPARK-21147) the schema of socket source can not be set.

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21147: Assignee: Apache Spark > the schema of socket source can not be set. > ---

[jira] [Assigned] (SPARK-21147) the schema of socket source can not be set.

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21147: Assignee: (was: Apache Spark) > the schema of socket source can not be set. >

[jira] [Commented] (SPARK-21147) the schema of socket source can not be set.

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056037#comment-16056037 ] Apache Spark commented on SPARK-21147: -- User 'HyukjinKwon' has created a pull reques

[jira] [Created] (SPARK-21152) Use level 3 BLAS operations in LogisticAggregator

2017-06-20 Thread Seth Hendrickson (JIRA)
Seth Hendrickson created SPARK-21152: Summary: Use level 3 BLAS operations in LogisticAggregator Key: SPARK-21152 URL: https://issues.apache.org/jira/browse/SPARK-21152 Project: Spark Iss

[jira] [Resolved] (SPARK-21150) Persistent view stored in Hive metastore should be case preserving.

2017-06-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21150. - Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 2.2.0 > Persistent view stored in

[jira] [Commented] (SPARK-21152) Use level 3 BLAS operations in LogisticAggregator

2017-06-20 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056025#comment-16056025 ] Seth Hendrickson commented on SPARK-21152: -- cc [~dbtsai] [~mlnick] [~srowen] BT

[jira] [Commented] (SPARK-21153) Time windowing for tumbling windows can use a project instead of expand + filter

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056022#comment-16056022 ] Apache Spark commented on SPARK-21153: -- User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-21153) Time windowing for tumbling windows can use a project instead of expand + filter

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21153: Assignee: Burak Yavuz (was: Apache Spark) > Time windowing for tumbling windows can use a

[jira] [Assigned] (SPARK-21153) Time windowing for tumbling windows can use a project instead of expand + filter

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21153: Assignee: Apache Spark (was: Burak Yavuz) > Time windowing for tumbling windows can use a

[jira] [Created] (SPARK-21153) Time windowing for tumbling windows can use a project instead of expand + filter

2017-06-20 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-21153: --- Summary: Time windowing for tumbling windows can use a project instead of expand + filter Key: SPARK-21153 URL: https://issues.apache.org/jira/browse/SPARK-21153 Projec

[jira] [Commented] (SPARK-17129) Support statistics collection and cardinality estimation for partitioned tables

2017-06-20 Thread Maria (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056008#comment-16056008 ] Maria commented on SPARK-17129: --- [~ZenWzh], I happen to work with large number of partition

[jira] [Created] (SPARK-21151) Maven release error - Spark 2.0.2 with scala 2.10 version

2017-06-20 Thread Kanagha Pradha (JIRA)
Kanagha Pradha created SPARK-21151: -- Summary: Maven release error - Spark 2.0.2 with scala 2.10 version Key: SPARK-21151 URL: https://issues.apache.org/jira/browse/SPARK-21151 Project: Spark

[jira] [Commented] (SPARK-21123) Options for file stream source are in a wrong table

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16055847#comment-16055847 ] Apache Spark commented on SPARK-21123: -- User 'assafmendelson' has created a pull req

[jira] [Assigned] (SPARK-20832) Standalone master should explicitly inform drivers of worker deaths and invalidate external shuffle service outputs

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20832: Assignee: Apache Spark > Standalone master should explicitly inform drivers of worker deat

[jira] [Commented] (SPARK-20832) Standalone master should explicitly inform drivers of worker deaths and invalidate external shuffle service outputs

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16055746#comment-16055746 ] Apache Spark commented on SPARK-20832: -- User 'jiangxb1987' has created a pull reques

[jira] [Assigned] (SPARK-20832) Standalone master should explicitly inform drivers of worker deaths and invalidate external shuffle service outputs

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20832: Assignee: (was: Apache Spark) > Standalone master should explicitly inform drivers of

[jira] [Commented] (SPARK-19660) Replace the configuration property names that are deprecated in the version of Hadoop 2.6

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16055543#comment-16055543 ] Apache Spark commented on SPARK-19660: -- User 'wangyum' has created a pull request fo

[jira] [Closed] (SPARK-21134) Codegen-only expressions should not be collapsed with upper CodegenFallback expression

2017-06-20 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh closed SPARK-21134. --- Resolution: Won't Fix > Codegen-only expressions should not be collapsed with upper CodegenFa

[jira] [Commented] (SPARK-21134) Codegen-only expressions should not be collapsed with upper CodegenFallback expression

2017-06-20 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16055499#comment-16055499 ] Liang-Chi Hsieh commented on SPARK-21134: - Due to the discussion on the PR, we ma

[jira] [Assigned] (SPARK-20989) Fail to start multiple workers on one host if external shuffle service is enabled in standalone mode

2017-06-20 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-20989: --- Assignee: Jiang Xingbo > Fail to start multiple workers on one host if external shuffle serv

[jira] [Resolved] (SPARK-20989) Fail to start multiple workers on one host if external shuffle service is enabled in standalone mode

2017-06-20 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20989. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18290 [https://githu

[jira] [Commented] (SPARK-21150) Persistent view stored in Hive metastore should be case preserving.

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16055388#comment-16055388 ] Apache Spark commented on SPARK-21150: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-21150) Persistent view stored in Hive metastore should be case preserving.

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21150: Assignee: (was: Apache Spark) > Persistent view stored in Hive metastore should be cas

[jira] [Assigned] (SPARK-21150) Persistent view stored in Hive metastore should be case preserving.

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21150: Assignee: Apache Spark > Persistent view stored in Hive metastore should be case preservin

[jira] [Comment Edited] (SPARK-21066) LibSVM load just one input file

2017-06-20 Thread 颜发才
[ https://issues.apache.org/jira/browse/SPARK-21066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16055336#comment-16055336 ] Yan Facai (颜发才) edited comment on SPARK-21066 at 6/20/17 8:27 AM: -

[jira] [Commented] (SPARK-21066) LibSVM load just one input file

2017-06-20 Thread 颜发才
[ https://issues.apache.org/jira/browse/SPARK-21066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16055336#comment-16055336 ] Yan Facai (颜发才) commented on SPARK-21066: - [~sowen] I believe that the API has ex

[jira] [Commented] (SPARK-21066) LibSVM load just one input file

2017-06-20 Thread 颜发才
[ https://issues.apache.org/jira/browse/SPARK-21066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16055328#comment-16055328 ] Yan Facai (颜发才) commented on SPARK-21066: - Hi, [~darion] . If `numFeature` is sp

[jira] [Comment Edited] (SPARK-21066) LibSVM load just one input file

2017-06-20 Thread 颜发才
[ https://issues.apache.org/jira/browse/SPARK-21066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16055328#comment-16055328 ] Yan Facai (颜发才) edited comment on SPARK-21066 at 6/20/17 8:12 AM: -

[jira] [Commented] (SPARK-21144) Unexpected results when the data schema and partition schema have the duplicate columns

2017-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16055283#comment-16055283 ] Apache Spark commented on SPARK-21144: -- User 'maropu' has created a pull request for