[jira] [Resolved] (SPARK-27830) Show Spark version at app lists of Spark History UI

2019-05-24 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27830. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 3.0.0 This is

[jira] [Commented] (SPARK-27705) kubernetes integration test break on osx when test PVTestsSuite

2019-05-24 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847943#comment-16847943 ] Dongjoon Hyun commented on SPARK-27705: --- Sorry, but I'm not sure what you mean, but any

[jira] [Assigned] (SPARK-27838) Support user provided non-nullable avro schema for nullable catalyst schema without any null record

2019-05-24 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-27838: --- Assignee: DB Tsai > Support user provided non-nullable avro schema for nullable catalyst schema >

[jira] [Assigned] (SPARK-27809) Make optional clauses order insensitive for CREATE DATABASE/VIEW SQL statement

2019-05-24 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-27809: --- Assignee: Yesheng Ma > Make optional clauses order insensitive for CREATE DATABASE/VIEW SQL

[jira] [Resolved] (SPARK-27809) Make optional clauses order insensitive for CREATE DATABASE/VIEW SQL statement

2019-05-24 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27809. - Resolution: Fixed Fix Version/s: (was: 2.4.3) 3.0.0 Target

[jira] [Commented] (SPARK-24149) Automatic namespaces discovery in HDFS federation

2019-05-24 Thread Dhruve Ashar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847929#comment-16847929 ] Dhruve Ashar commented on SPARK-24149: -- I also think that HDFS client shouldn't be figuring out if

[jira] [Commented] (SPARK-24149) Automatic namespaces discovery in HDFS federation

2019-05-24 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847926#comment-16847926 ] Marcelo Vanzin commented on SPARK-24149: bq. If they are unrelated the user explicitly provides

[jira] [Commented] (SPARK-24149) Automatic namespaces discovery in HDFS federation

2019-05-24 Thread Dhruve Ashar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847923#comment-16847923 ] Dhruve Ashar commented on SPARK-24149: --   Spark should be agnostic about the namenodes for which

[jira] [Resolved] (SPARK-27838) Support user provided non-nullable avro schema for nullable catalyst schema without any null record

2019-05-24 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-27838. - Resolution: Fixed Issue resolved by pull request 24682 [https://github.com/apache/spark/pull/24682] >

[jira] [Comment Edited] (SPARK-23986) CompileException when using too many avg aggregation after joining

2019-05-24 Thread Siddharth Dangi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847906#comment-16847906 ] Siddharth Dangi edited comment on SPARK-23986 at 5/24/19 9:28 PM: --

[jira] [Comment Edited] (SPARK-23986) CompileException when using too many avg aggregation after joining

2019-05-24 Thread Siddharth Dangi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847906#comment-16847906 ] Siddharth Dangi edited comment on SPARK-23986 at 5/24/19 9:28 PM: --

[jira] [Commented] (SPARK-23986) CompileException when using too many avg aggregation after joining

2019-05-24 Thread Siddharth Dangi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847906#comment-16847906 ] Siddharth Dangi commented on SPARK-23986: - [~pedromorfeu] I had 25 operations in the aggregation

[jira] [Commented] (SPARK-24149) Automatic namespaces discovery in HDFS federation

2019-05-24 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847888#comment-16847888 ] Marcelo Vanzin commented on SPARK-24149: bq. I think we are duplicating the logic here Do you

[jira] [Commented] (SPARK-27838) Support user provided non-nullable avro schema for nullable catalyst schema without any null record

2019-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847887#comment-16847887 ] Apache Spark commented on SPARK-27838: -- User 'dbtsai' has created a pull request for this issue:

[jira] [Assigned] (SPARK-27838) Support user provided non-nullable avro schema for nullable catalyst schema without any null record

2019-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27838: Assignee: (was: Apache Spark) > Support user provided non-nullable avro schema for

[jira] [Assigned] (SPARK-27838) Support user provided non-nullable avro schema for nullable catalyst schema without any null record

2019-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27838: Assignee: Apache Spark > Support user provided non-nullable avro schema for nullable

[jira] [Created] (SPARK-27838) Support user provided non-nullable avro schema for nullable catalyst schema without any null record

2019-05-24 Thread DB Tsai (JIRA)
DB Tsai created SPARK-27838: --- Summary: Support user provided non-nullable avro schema for nullable catalyst schema without any null record Key: SPARK-27838 URL: https://issues.apache.org/jira/browse/SPARK-27838

[jira] [Commented] (SPARK-24149) Automatic namespaces discovery in HDFS federation

2019-05-24 Thread Dhruve Ashar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847854#comment-16847854 ] Dhruve Ashar commented on SPARK-24149: -- [~mgaido] [~vanzin], The change this PR introduced is

[jira] [Created] (SPARK-27837) Running rand() in SQL with seed of column results in error (rand(col1))

2019-05-24 Thread Jason Ferrell (JIRA)
Jason Ferrell created SPARK-27837: - Summary: Running rand() in SQL with seed of column results in error (rand(col1)) Key: SPARK-27837 URL: https://issues.apache.org/jira/browse/SPARK-27837 Project:

[jira] [Created] (SPARK-27836) Issue with seeded rand() function in Spark SQL

2019-05-24 Thread Jason Ferrell (JIRA)
Jason Ferrell created SPARK-27836: - Summary: Issue with seeded rand() function in Spark SQL Key: SPARK-27836 URL: https://issues.apache.org/jira/browse/SPARK-27836 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-27824) Make rule EliminateResolvedHint idempotent

2019-05-24 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27824. - Resolution: Fixed Fix Version/s: 3.0.0 > Make rule EliminateResolvedHint idempotent >

[jira] [Assigned] (SPARK-27824) Make rule EliminateResolvedHint idempotent

2019-05-24 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-27824: --- Assignee: Maryann Xue > Make rule EliminateResolvedHint idempotent >

[jira] [Comment Edited] (SPARK-27593) CSV Parser returns 2 DataFrame - Valid and Malformed DFs

2019-05-24 Thread Ladislav Jech (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847787#comment-16847787 ] Ladislav Jech edited comment on SPARK-27593 at 5/24/19 6:15 PM: Ok,

[jira] [Assigned] (SPARK-27362) Kubernetes support for GPU-aware scheduling

2019-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27362: Assignee: Apache Spark > Kubernetes support for GPU-aware scheduling >

[jira] [Assigned] (SPARK-27362) Kubernetes support for GPU-aware scheduling

2019-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27362: Assignee: (was: Apache Spark) > Kubernetes support for GPU-aware scheduling >

[jira] [Commented] (SPARK-27593) CSV Parser returns 2 DataFrame - Valid and Malformed DFs

2019-05-24 Thread Ladislav Jech (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847787#comment-16847787 ] Ladislav Jech commented on SPARK-27593: --- Ok, sorry, this was my misunderstanding of some options

[jira] [Resolved] (SPARK-26356) Remove SaveMode from data source v2 API

2019-05-24 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-26356. - Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 3.0.0 > Remove SaveMode from

[jira] [Resolved] (SPARK-27831) Move Hive test jars to maven dependency

2019-05-24 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27831. --- Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 This is

[jira] [Commented] (SPARK-27593) CSV Parser returns 2 DataFrame - Valid and Malformed DFs

2019-05-24 Thread Ladislav Jech (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847734#comment-16847734 ] Ladislav Jech commented on SPARK-27593: --- I cannot get this working, I have following code:

[jira] [Commented] (SPARK-27833) java.lang.AssertionError: assertion failed: No plan for EventTimeWatermark

2019-05-24 Thread Raviteja (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847718#comment-16847718 ] Raviteja commented on SPARK-27833: -- yes, using Console sink works fine. But when i write my own custom

[jira] [Comment Edited] (SPARK-7898) pyspark merges stderr into stdout

2019-05-24 Thread Kyle Brooks (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847651#comment-16847651 ] Kyle Brooks edited comment on SPARK-7898 at 5/24/19 3:44 PM: - I have a use

[jira] [Commented] (SPARK-7898) pyspark merges stderr into stdout

2019-05-24 Thread Kyle Brooks (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847651#comment-16847651 ] Kyle Brooks commented on SPARK-7898: I have a use case for printing an aggregation does in spark to

[jira] [Commented] (SPARK-27816) make TreeNode tag type safe

2019-05-24 Thread Mark Hamstra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847624#comment-16847624 ] Mark Hamstra commented on SPARK-27816: -- Jira issues with no description are really irritating –

[jira] [Assigned] (SPARK-27834) Make separate PySpark/SparkR vectorization configurations

2019-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27834: Assignee: (was: Apache Spark) > Make separate PySpark/SparkR vectorization

[jira] [Assigned] (SPARK-27834) Make separate PySpark/SparkR vectorization configurations

2019-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27834: Assignee: Apache Spark > Make separate PySpark/SparkR vectorization configurations >

[jira] [Created] (SPARK-27835) Resource Scheduling: change driver config from addresses to resourcesFile

2019-05-24 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-27835: - Summary: Resource Scheduling: change driver config from addresses to resourcesFile Key: SPARK-27835 URL: https://issues.apache.org/jira/browse/SPARK-27835 Project:

[jira] [Assigned] (SPARK-27666) Stop python runner threads when task finishes

2019-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27666: Assignee: Apache Spark > Stop python runner threads when task finishes >

[jira] [Assigned] (SPARK-27666) Stop python runner threads when task finishes

2019-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27666: Assignee: (was: Apache Spark) > Stop python runner threads when task finishes >

[jira] [Created] (SPARK-27834) Make separate PySpark/SparkR vectorization configurations

2019-05-24 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-27834: Summary: Make separate PySpark/SparkR vectorization configurations Key: SPARK-27834 URL: https://issues.apache.org/jira/browse/SPARK-27834 Project: Spark

[jira] [Commented] (SPARK-27833) java.lang.AssertionError: assertion failed: No plan for EventTimeWatermark

2019-05-24 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847598#comment-16847598 ] Gabor Somogyi commented on SPARK-27833: --- You mean when you're this one it works?

[jira] [Issue Comment Deleted] (SPARK-27833) java.lang.AssertionError: assertion failed: No plan for EventTimeWatermark

2019-05-24 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-27833: -- Comment: was deleted (was: Because you haven't shared the source of

[jira] [Updated] (SPARK-27833) java.lang.AssertionError: assertion failed: No plan for EventTimeWatermark

2019-05-24 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-27833: -- Priority: Minor (was: Blocker) > java.lang.AssertionError: assertion failed: No plan for

[jira] [Commented] (SPARK-27833) java.lang.AssertionError: assertion failed: No plan for EventTimeWatermark

2019-05-24 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847587#comment-16847587 ] Gabor Somogyi commented on SPARK-27833: --- Because you haven't shared the source of

[jira] [Updated] (SPARK-27833) Structured Streaming Custom Sink -- java.lang.AssertionError: assertion failed: No plan for EventTimeWatermark

2019-05-24 Thread Raviteja (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raviteja updated SPARK-27833: - Summary: Structured Streaming Custom Sink -- java.lang.AssertionError: assertion failed: No plan for

[jira] [Updated] (SPARK-27833) java.lang.AssertionError: assertion failed: No plan for EventTimeWatermark

2019-05-24 Thread Raviteja (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raviteja updated SPARK-27833: - Summary: java.lang.AssertionError: assertion failed: No plan for EventTimeWatermark (was: Structured

[jira] [Updated] (SPARK-27833) Structured Streaming Custom Sink --

2019-05-24 Thread Raviteja (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raviteja updated SPARK-27833: - Attachment: kafka_custom_sink.java > Structured Streaming Custom Sink -- >

[jira] [Updated] (SPARK-27833) Structured Streaming Custom Sink --

2019-05-24 Thread Raviteja (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raviteja updated SPARK-27833: - Attachment: kafka_error_log.txt > Structured Streaming Custom Sink -- >

[jira] [Updated] (SPARK-27833) Structured Streaming Custom Sink --

2019-05-24 Thread Raviteja (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raviteja updated SPARK-27833: - Attachment: kafka_consumer_code.java > Structured Streaming Custom Sink -- >

[jira] [Updated] (SPARK-27833) Structured Streaming Custom Sink --

2019-05-24 Thread Raviteja (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raviteja updated SPARK-27833: - Docs Text: (was: 19/05/24 17:31:58 INFO ConsumerConfig: ConsumerConfig values:

[jira] [Created] (SPARK-27833) Structured Streaming Custom Sink --

2019-05-24 Thread Raviteja (JIRA)
Raviteja created SPARK-27833: Summary: Structured Streaming Custom Sink -- Key: SPARK-27833 URL: https://issues.apache.org/jira/browse/SPARK-27833 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-16738) Queryable state for Spark State Store

2019-05-24 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-16738: Affects Version/s: (was: 2.0.0) > Queryable state for Spark State Store >

[jira] [Updated] (SPARK-16738) Queryable state for Spark State Store

2019-05-24 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-16738: Labels: features (was: bulk-closed features) > Queryable state for Spark State

[jira] [Commented] (SPARK-16738) Queryable state for Spark State Store

2019-05-24 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847469#comment-16847469 ] Stavros Kontopoulos commented on SPARK-16738: - [~marmbrus] [~zsxwing] [~brkyvz] [~dongjoon] 

[jira] [Comment Edited] (SPARK-27808) Ability to ignore existing files for structured streaming

2019-05-24 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847460#comment-16847460 ] Gabor Somogyi edited comment on SPARK-27808 at 5/24/19 10:45 AM: - You've

[jira] [Commented] (SPARK-27808) Ability to ignore existing files for structured streaming

2019-05-24 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847460#comment-16847460 ] Gabor Somogyi commented on SPARK-27808: --- You've marked component as Structured Streaming and

[jira] [Issue Comment Deleted] (SPARK-16738) Queryable state for Spark State Store

2019-05-24 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-16738: Comment: was deleted (was: Let's vote for this useful feature, I will ping the

[jira] [Reopened] (SPARK-16738) Queryable state for Spark State Store

2019-05-24 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos reopened SPARK-16738: - Let's vote for this useful feature, I will ping the committers for that purpose. >

[jira] [Commented] (SPARK-16738) Queryable state for Spark State Store

2019-05-24 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847458#comment-16847458 ] Stavros Kontopoulos commented on SPARK-16738: - Sure  [~hyukjin.kwon] will do.   >

[jira] [Updated] (SPARK-16738) Queryable state for Spark State Store

2019-05-24 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-16738: Affects Version/s: 3.0.0 > Queryable state for Spark State Store >

[jira] [Assigned] (SPARK-27832) Don't decompress and create column batch when the task is completed

2019-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27832: Assignee: (was: Apache Spark) > Don't decompress and create column batch when the

[jira] [Assigned] (SPARK-27832) Don't decompress and create column batch when the task is completed

2019-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27832: Assignee: Apache Spark > Don't decompress and create column batch when the task is

[jira] [Created] (SPARK-27832) Don't decompress and create column batch when the task is completed

2019-05-24 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-27832: --- Summary: Don't decompress and create column batch when the task is completed Key: SPARK-27832 URL: https://issues.apache.org/jira/browse/SPARK-27832 Project:

[jira] [Assigned] (SPARK-27831) Move Hive test jars to maven dependency

2019-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27831: Assignee: (was: Apache Spark) > Move Hive test jars to maven dependency >

[jira] [Assigned] (SPARK-27831) Move Hive test jars to maven dependency

2019-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27831: Assignee: Apache Spark > Move Hive test jars to maven dependency >

[jira] [Created] (SPARK-27831) Move Hive test jars to maven dependency

2019-05-24 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-27831: --- Summary: Move Hive test jars to maven dependency Key: SPARK-27831 URL: https://issues.apache.org/jira/browse/SPARK-27831 Project: Spark Issue Type:

[jira] [Commented] (SPARK-27593) CSV Parser returns 2 DataFrame - Valid and Malformed DFs

2019-05-24 Thread Ladislav Jech (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847340#comment-16847340 ] Ladislav Jech commented on SPARK-27593: --- What is the behavior when you load multiple files, I need

[jira] [Commented] (SPARK-27593) CSV Parser returns 2 DataFrame - Valid and Malformed DFs

2019-05-24 Thread Ladislav Jech (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847338#comment-16847338 ] Ladislav Jech commented on SPARK-27593: --- [~hyukjin.kwon] - I got the point, thx for information

[jira] [Updated] (SPARK-27822) Spark WebUi - for running applications have a drivername column

2019-05-24 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated SPARK-27822: - Attachment: spark-ui-waiting-2.png > Spark WebUi - for running applications have a drivername column >

[jira] [Commented] (SPARK-27822) Spark WebUi - for running applications have a drivername column

2019-05-24 Thread t oo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847329#comment-16847329 ] t oo commented on SPARK-27822: -- [~hyukjin.kwon] attached > Spark WebUi - for running applications have a

[jira] [Assigned] (SPARK-27830) Show Spark version at app lists of Spark History UI

2019-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27830: Assignee: (was: Apache Spark) > Show Spark version at app lists of Spark History UI

[jira] [Assigned] (SPARK-27830) Show Spark version at app lists of Spark History UI

2019-05-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27830: Assignee: Apache Spark > Show Spark version at app lists of Spark History UI >

[jira] [Created] (SPARK-27830) Show Spark version at app lists of Spark History UI

2019-05-24 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-27830: - Summary: Show Spark version at app lists of Spark History UI Key: SPARK-27830 URL: https://issues.apache.org/jira/browse/SPARK-27830 Project: Spark Issue