[jira] [Resolved] (SPARK-28348) Avoid cast twice for decimal type

2019-07-30 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-28348. - Resolution: Won't Fix > Avoid cast twice for decimal type > - >

[jira] [Updated] (SPARK-28576) Fix the dead lock issue when enable new adaptive execution

2019-07-30 Thread Ke Jia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-28576: --- Description: After enable AE(SPARK-23128), we found the dead lock issue in Q6 1TB TPC-DS. The root cause is

[jira] [Updated] (SPARK-28576) Fix the dead lock issue when enable new adaptive execution

2019-07-30 Thread Ke Jia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-28576: --- Description: After enable AE([lSPARK-23128|https://issues.apache.org/jira/browse/SPARK-23128]), we found

[jira] [Updated] (SPARK-28576) Fix the dead lock issue when enable new adaptive execution

2019-07-30 Thread Ke Jia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-28576: --- Attachment: q6.sql physical plan.txt jstack.log > Fix the dead lock issue

[jira] [Created] (SPARK-28576) Fix the dead lock issue when enable new adaptive execution

2019-07-30 Thread Ke Jia (JIRA)
Ke Jia created SPARK-28576: -- Summary: Fix the dead lock issue when enable new adaptive execution Key: SPARK-28576 URL: https://issues.apache.org/jira/browse/SPARK-28576 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-25382) Remove ImageSchema.readImages in 3.0

2019-07-30 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25382: Assignee: Weichen Xu > Remove ImageSchema.readImages in 3.0 >

[jira] [Resolved] (SPARK-25382) Remove ImageSchema.readImages in 3.0

2019-07-30 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25382. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25245

[jira] [Created] (SPARK-28575) Spark job time increasing when upgrading Spark from 2.1.1 to 2.3.1

2019-07-30 Thread Kushal Mahajan (JIRA)
Kushal Mahajan created SPARK-28575: -- Summary: Spark job time increasing when upgrading Spark from 2.1.1 to 2.3.1 Key: SPARK-28575 URL: https://issues.apache.org/jira/browse/SPARK-28575 Project:

[jira] [Created] (SPARK-28574) Allow to config different sizes for event queues

2019-07-30 Thread Yun Zou (JIRA)
Yun Zou created SPARK-28574: --- Summary: Allow to config different sizes for event queues Key: SPARK-28574 URL: https://issues.apache.org/jira/browse/SPARK-28574 Project: Spark Issue Type:

[jira] [Created] (SPARK-28573) Convert InsertIntoTable(HiveTableRelation) to Datasource inserting for partitioned table

2019-07-30 Thread Xianjin YE (JIRA)
Xianjin YE created SPARK-28573: -- Summary: Convert InsertIntoTable(HiveTableRelation) to Datasource inserting for partitioned table Key: SPARK-28573 URL: https://issues.apache.org/jira/browse/SPARK-28573

[jira] [Assigned] (SPARK-28038) Add text.sql

2019-07-30 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28038: Assignee: Yuming Wang > Add text.sql > > > Key: SPARK-28038

[jira] [Resolved] (SPARK-28038) Add text.sql

2019-07-30 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28038. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24862

[jira] [Created] (SPARK-28572) Add simple analysis checks to the V2 Create Table code paths

2019-07-30 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-28572: --- Summary: Add simple analysis checks to the V2 Create Table code paths Key: SPARK-28572 URL: https://issues.apache.org/jira/browse/SPARK-28572 Project: Spark

[jira] [Assigned] (SPARK-28426) Metadata Handling in Thrift Server

2019-07-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28426: --- Assignee: yuming.wang > Metadata Handling in Thrift Server > -- >

[jira] [Assigned] (SPARK-28426) Metadata Handling in Thrift Server

2019-07-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28426: --- Assignee: Yuming Wang (was: yuming.wang) > Metadata Handling in Thrift Server >

[jira] [Resolved] (SPARK-26175) PySpark cannot terminate worker process if user program reads from stdin

2019-07-30 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26175. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25138

[jira] [Assigned] (SPARK-26175) PySpark cannot terminate worker process if user program reads from stdin

2019-07-30 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-26175: Assignee: Weichen Xu > PySpark cannot terminate worker process if user program reads

[jira] [Resolved] (SPARK-27994) Spark Avro Failed to read logical type decimal backed by bytes

2019-07-30 Thread Nicolas Pascal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Pascal resolved SPARK-27994. Resolution: Invalid After investigation, data produced was not correct format > Spark

[jira] [Commented] (SPARK-28375) Enforce idempotence on the PullupCorrelatedPredicates optimizer rule

2019-07-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896617#comment-16896617 ] Xiao Li commented on SPARK-28375: - This is possible, if users add the rule into

[jira] [Resolved] (SPARK-28375) Enforce idempotence on the PullupCorrelatedPredicates optimizer rule

2019-07-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28375. - Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 3.0.0 > Enforce idempotence on

[jira] [Updated] (SPARK-28209) Shuffle Storage API: Writer API and usage in BypassMergeSortShuffleWriter

2019-07-30 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-28209: --- Description: Adds the write-side API for storing shuffle data in arbitrary storage systems. Also

[jira] [Created] (SPARK-28571) Shuffle storage API: Use API in SortShuffleWriter

2019-07-30 Thread Matt Cheah (JIRA)
Matt Cheah created SPARK-28571: -- Summary: Shuffle storage API: Use API in SortShuffleWriter Key: SPARK-28571 URL: https://issues.apache.org/jira/browse/SPARK-28571 Project: Spark Issue Type:

[jira] [Created] (SPARK-28570) Shuffle Storage API: Use writer API in UnsafeShuffleWriter

2019-07-30 Thread Matt Cheah (JIRA)
Matt Cheah created SPARK-28570: -- Summary: Shuffle Storage API: Use writer API in UnsafeShuffleWriter Key: SPARK-28570 URL: https://issues.apache.org/jira/browse/SPARK-28570 Project: Spark Issue

[jira] [Updated] (SPARK-28209) Shuffle Storage API: Writer API and usage in BypassMergeSortShuffleWriter

2019-07-30 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-28209: --- Summary: Shuffle Storage API: Writer API and usage in BypassMergeSortShuffleWriter (was: Shuffle

[jira] [Updated] (SPARK-28209) Shuffle Storage API: Writer API

2019-07-30 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah updated SPARK-28209: --- Summary: Shuffle Storage API: Writer API (was: Shuffle Storage API: Writes) > Shuffle Storage API:

[jira] [Created] (SPARK-28569) Recommended additions to SECRET_REDACTION_PATTERN

2019-07-30 Thread Sean Mackrory (JIRA)
Sean Mackrory created SPARK-28569: - Summary: Recommended additions to SECRET_REDACTION_PATTERN Key: SPARK-28569 URL: https://issues.apache.org/jira/browse/SPARK-28569 Project: Spark Issue

[jira] [Updated] (SPARK-26152) Synchronize Worker Cleanup with Worker Shutdown

2019-07-30 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-26152: Affects Version/s: 2.4.0 2.4.1 2.4.2

[jira] [Updated] (SPARK-26152) Synchronize Worker Cleanup with Worker Shutdown

2019-07-30 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-26152: Fix Version/s: 2.4.4 > Synchronize Worker Cleanup with Worker Shutdown >

[jira] [Resolved] (SPARK-28209) Shuffle Storage API: Writes

2019-07-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28209. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25007

[jira] [Assigned] (SPARK-28209) Shuffle Storage API: Writes

2019-07-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28209: -- Assignee: Matt Cheah > Shuffle Storage API: Writes > --- > >

[jira] [Created] (SPARK-28568) Make Javadoc in org.apache.spark.shuffle.api visible

2019-07-30 Thread Matt Cheah (JIRA)
Matt Cheah created SPARK-28568: -- Summary: Make Javadoc in org.apache.spark.shuffle.api visible Key: SPARK-28568 URL: https://issues.apache.org/jira/browse/SPARK-28568 Project: Spark Issue Type:

[jira] [Updated] (SPARK-26152) Synchronize Worker Cleanup with Worker Shutdown

2019-07-30 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26152: -- Summary: Synchronize Worker Cleanup with Worker Shutdown (was: Flaky test: BroadcastSuite)

[jira] [Resolved] (SPARK-28525) Allow Launcher to be applied Java options

2019-07-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28525. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25265

[jira] [Created] (SPARK-28567) pyspark-sql returns error "Paths and fileStatuses are expected to be 1. . Got paths: 1 fileStatuses: 26"

2019-07-30 Thread Ganesh Kumar (JIRA)
Ganesh Kumar created SPARK-28567: Summary: pyspark-sql returns error "Paths and fileStatuses are expected to be 1. . Got paths: 1 fileStatuses: 26" Key: SPARK-28567 URL:

[jira] [Created] (SPARK-28566) window functions should not be allowed in window definitions

2019-07-30 Thread Dylan Guedes (JIRA)
Dylan Guedes created SPARK-28566: Summary: window functions should not be allowed in window definitions Key: SPARK-28566 URL: https://issues.apache.org/jira/browse/SPARK-28566 Project: Spark

[jira] [Created] (SPARK-28565) DataSourceV2: DataFrameWriter.saveAsTable

2019-07-30 Thread John Zhuge (JIRA)
John Zhuge created SPARK-28565: -- Summary: DataSourceV2: DataFrameWriter.saveAsTable Key: SPARK-28565 URL: https://issues.apache.org/jira/browse/SPARK-28565 Project: Spark Issue Type:

[jira] [Updated] (SPARK-28565) DataSourceV2: DataFrameWriter.saveAsTable

2019-07-30 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated SPARK-28565: --- Description: Support multiple catalogs in the following use cases: *

[jira] [Issue Comment Deleted] (SPARK-27689) Error to execute hive views with spark

2019-07-30 Thread feiwang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-27689: Comment: was deleted (was: It seemed that this failure is caused by PR-SPARK-18801,

[jira] [Commented] (SPARK-27689) Error to execute hive views with spark

2019-07-30 Thread feiwang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896249#comment-16896249 ] feiwang commented on SPARK-27689: - It seemed that this failure is caused by PR-SPARK-18801,

[jira] [Commented] (SPARK-27689) Error to execute hive views with spark

2019-07-30 Thread feiwang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896247#comment-16896247 ] feiwang commented on SPARK-27689: - It seemed that this failure is caused by PR-SPARK-18801,

[jira] [Assigned] (SPARK-28399) Impl RobustScaler

2019-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28399: - Assignee: zhengruifeng > Impl RobustScaler > - > > Key:

[jira] [Resolved] (SPARK-28399) Impl RobustScaler

2019-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28399. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25160

[jira] [Assigned] (SPARK-26755) Optimize Spark Scheduler to dequeue speculative tasks more efficiently

2019-07-30 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-26755: Assignee: Parth Gandhi > Optimize Spark Scheduler to dequeue speculative tasks more

[jira] [Resolved] (SPARK-26755) Optimize Spark Scheduler to dequeue speculative tasks more efficiently

2019-07-30 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-26755. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23677

[jira] [Updated] (SPARK-28519) Tests failed on aarch64 due the value of math.log and power function is different

2019-07-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28519: -- Docs Text: The result of `java.lang.Math`'s `log`, `log1p`, `exp`, `expm1`, and `pow` may vary

[jira] [Updated] (SPARK-28564) Access history application defaults to the last attempt id

2019-07-30 Thread dzcxzl (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-28564: --- Description: When we set spark.history.ui.maxApplications to a small value, we can't get some apps from

[jira] [Created] (SPARK-28564) Access history application defaults to the last attempt id

2019-07-30 Thread dzcxzl (JIRA)
dzcxzl created SPARK-28564: -- Summary: Access history application defaults to the last attempt id Key: SPARK-28564 URL: https://issues.apache.org/jira/browse/SPARK-28564 Project: Spark Issue Type:

[jira] [Updated] (SPARK-28503) Return null result on cast an out-of-range value to a integral type

2019-07-30 Thread Gengliang Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-28503: --- Summary: Return null result on cast an out-of-range value to a integral type (was: Return

[jira] [Comment Edited] (SPARK-28482) Data incomplete when using pandas udf in Python 3

2019-07-30 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896132#comment-16896132 ] Li Jin edited comment on SPARK-28482 at 7/30/19 1:28 PM: - Hi [~jiangyu1211],

[jira] [Comment Edited] (SPARK-28482) Data incomplete when using pandas udf in Python 3

2019-07-30 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896132#comment-16896132 ] Li Jin edited comment on SPARK-28482 at 7/30/19 1:28 PM: - Hi [~jiangyu1211],

[jira] [Updated] (SPARK-28561) DAG viz for barrier-execution mode

2019-07-30 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-28561: --- Summary: DAG viz for barrier-execution mode (was: DAG viz for barrier-mode execution) >

[jira] [Commented] (SPARK-28482) Data incomplete when using pandas udf in Python 3

2019-07-30 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896132#comment-16896132 ] Li Jin commented on SPARK-28482: Hi [~jiangyu1211], thank you for the bug report.   >From the

[jira] [Resolved] (SPARK-28553) subqueries must be aggregated before hand

2019-07-30 Thread Dylan Guedes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dylan Guedes resolved SPARK-28553. -- Resolution: Duplicate This is a duplicate of SPARK-28379. > subqueries must be aggregated

[jira] [Commented] (SPARK-28553) subqueries must be aggregated before hand

2019-07-30 Thread Dylan Guedes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896064#comment-16896064 ] Dylan Guedes commented on SPARK-28553: -- Oh, my bad. I even look'd for an already created JIRA, idk

[jira] [Resolved] (SPARK-28563) Spark 2.4 | Reading all the data inside partition like directory.

2019-07-30 Thread Vishal Donderia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vishal Donderia resolved SPARK-28563. - Resolution: Not A Bug > Spark 2.4 | Reading all the data inside partition like

[jira] [Created] (SPARK-28563) Spark 2.4 | Reading all the data inside partition like directory.

2019-07-30 Thread Vishal Donderia (JIRA)
Vishal Donderia created SPARK-28563: --- Summary: Spark 2.4 | Reading all the data inside partition like directory. Key: SPARK-28563 URL: https://issues.apache.org/jira/browse/SPARK-28563 Project:

[jira] [Resolved] (SPARK-28071) Add strings.sql

2019-07-30 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-28071. -- Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 Resolved

[jira] [Created] (SPARK-28562) PySpark profiling is not understandable

2019-07-30 Thread Albertus Kelvin (JIRA)
Albertus Kelvin created SPARK-28562: --- Summary: PySpark profiling is not understandable Key: SPARK-28562 URL: https://issues.apache.org/jira/browse/SPARK-28562 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-28559) when execute "create table" on ThriftServer ,the hive table owner is wrong

2019-07-30 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28559. -- Resolution: Duplicate > when execute "create table" on ThriftServer ,the hive table owner

[jira] [Assigned] (SPARK-28178) DataSourceV2: DataFrameWriter.insertInfo

2019-07-30 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28178: --- Assignee: John Zhuge > DataSourceV2: DataFrameWriter.insertInfo >

[jira] [Resolved] (SPARK-28178) DataSourceV2: DataFrameWriter.insertInfo

2019-07-30 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28178. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24980

[jira] [Updated] (SPARK-28156) Join plan sometimes does not use cached query

2019-07-30 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-28156: Fix Version/s: 2.3.4 > Join plan sometimes does not use cached query >

[jira] [Commented] (SPARK-28561) DAG viz for barrier-mode execution

2019-07-30 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16895862#comment-16895862 ] Kousuke Saruta commented on SPARK-28561: I've attached images of my prototype implementation. >

[jira] [Created] (SPARK-28561) DAG viz for barrier-mode execution

2019-07-30 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-28561: -- Summary: DAG viz for barrier-mode execution Key: SPARK-28561 URL: https://issues.apache.org/jira/browse/SPARK-28561 Project: Spark Issue Type:

[jira] [Updated] (SPARK-28561) DAG viz for barrier-mode execution

2019-07-30 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-28561: --- Attachment: Screenshot from 2019-07-30 16-31-09.png Screenshot from

[jira] [Resolved] (SPARK-28406) Port union.sql

2019-07-30 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28406. --- Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 This is

[jira] [Resolved] (SPARK-28326) Add join.sql

2019-07-30 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28326. --- Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 This is