[jira] [Updated] (SPARK-28000) Add comments.sql

2019-08-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28000: Description: In this ticket, we plan to add the regression test cases of

[jira] [Resolved] (SPARK-28852) Implement GetCatalogsOperation for Thrift Server

2019-08-25 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28852. - Fix Version/s: 3.0.0 Assignee: Yuming Wang Resolution: Fixed > Implement

[jira] [Resolved] (SPARK-28823) Document CREATE ROLE Statement

2019-08-25 Thread jobit mathew (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jobit mathew resolved SPARK-28823. -- Resolution: Invalid CREATE ROLE is not supporting in Spark sql ,so closing the JIRA. >

[jira] [Updated] (SPARK-28861) Jetty property handling: java.lang.NumberFormatException: For input string: "unknown".

2019-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28861: - Summary: Jetty property handling: java.lang.NumberFormatException: For input string: "unknown".

[jira] [Commented] (SPARK-28861) Jetty property handling: java.lang.NumberFormatException: For input string: "unknown".

2019-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915447#comment-16915447 ] Hyukjin Kwon commented on SPARK-28861: -- Can you share full stract trace? > Jetty property

[jira] [Updated] (SPARK-28861) Jetty property handling

2019-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28861: - Description: While processing data from certain files a {{NumberFormatExceltion}} was seen in

[jira] [Commented] (SPARK-28862) Read Impala view with UNION ALL operator

2019-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915446#comment-16915446 ] Hyukjin Kwon commented on SPARK-28862: -- Seems like a question rather than an issue at the current

[jira] [Resolved] (SPARK-28862) Read Impala view with UNION ALL operator

2019-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28862. -- Resolution: Invalid > Read Impala view with UNION ALL operator >

[jira] [Updated] (SPARK-28871) Some codes in 'Policy for handling multiple watermarks' does not show friendly

2019-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28871: - Summary: Some codes in 'Policy for handling multiple watermarks' does not show friendly (was:

[jira] [Commented] (SPARK-28869) Roll over event log files

2019-08-25 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915429#comment-16915429 ] Jungtaek Lim commented on SPARK-28869: -- Started working on this now. > Roll over event log files >

[jira] [Updated] (SPARK-28871) Som codes in 'Policy for handling multiple watermarks' does not show friendly

2019-08-25 Thread chaiyongqiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chaiyongqiang updated SPARK-28871: -- Attachment: Policy_for_handling_multiple_watermarks.png > Som codes in 'Policy for handling

[jira] [Updated] (SPARK-28871) Som codes in 'Policy for handling multiple watermarks' does not show friendly

2019-08-25 Thread chaiyongqiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chaiyongqiang updated SPARK-28871: -- Attachment: 屏幕快照 2019-08-26 上午9.01.12.png > Som codes in 'Policy for handling multiple

[jira] [Updated] (SPARK-28871) Som codes in 'Policy for handling multiple watermarks' does not show friendly

2019-08-25 Thread chaiyongqiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chaiyongqiang updated SPARK-28871: -- Attachment: (was: 屏幕快照 2019-08-26 上午9.01.12.png) > Som codes in 'Policy for handling

[jira] [Created] (SPARK-28871) Som codes in 'Policy for handling multiple watermarks' does not show friendly

2019-08-25 Thread chaiyongqiang (Jira)
chaiyongqiang created SPARK-28871: - Summary: Som codes in 'Policy for handling multiple watermarks' does not show friendly Key: SPARK-28871 URL: https://issues.apache.org/jira/browse/SPARK-28871

[jira] [Created] (SPARK-28870) Snapshot old event log files to support compaction

2019-08-25 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-28870: Summary: Snapshot old event log files to support compaction Key: SPARK-28870 URL: https://issues.apache.org/jira/browse/SPARK-28870 Project: Spark Issue

[jira] [Updated] (SPARK-28594) Allow event logs for running streaming apps to be rolled over.

2019-08-25 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-28594: - Component/s: (was: Input/Output) Spark Core > Allow event logs for running

[jira] [Created] (SPARK-28869) Roll over event log files

2019-08-25 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-28869: Summary: Roll over event log files Key: SPARK-28869 URL: https://issues.apache.org/jira/browse/SPARK-28869 Project: Spark Issue Type: Sub-task

[jira] [Comment Edited] (SPARK-28594) Allow event logs for running streaming apps to be rolled over.

2019-08-25 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915357#comment-16915357 ] Jungtaek Lim edited comment on SPARK-28594 at 8/25/19 11:47 PM:

[jira] [Resolved] (SPARK-27433) Spark Structured Streaming left outer joins returns outer nulls for already matched rows

2019-08-25 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-27433. -- Resolution: Duplicate > Spark Structured Streaming left outer joins returns outer nulls for

[jira] [Updated] (SPARK-27433) Spark Structured Streaming left outer joins returns outer nulls for already matched rows

2019-08-25 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-27433: - Issue Type: Bug (was: Question) > Spark Structured Streaming left outer joins returns outer

[jira] [Reopened] (SPARK-27433) Spark Structured Streaming left outer joins returns outer nulls for already matched rows

2019-08-25 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reopened SPARK-27433: -- Reopening to mark type and resolution correctly. > Spark Structured Streaming left outer joins

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over.

2019-08-25 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915383#comment-16915383 ] Jungtaek Lim commented on SPARK-28594: -- To ensure creating smaller PRs (easier reviews) I would

[jira] [Resolved] (SPARK-28868) Specify Jekyll version to 3.8.6 in release docker image

2019-08-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28868. --- Fix Version/s: 2.4.4 3.0.0 Resolution: Fixed Issue resolved by

[jira] [Resolved] (SPARK-25549) High level API to collect RDD statistics

2019-08-25 Thread Liang-Chi Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh resolved SPARK-25549. - Resolution: Won't Fix > High level API to collect RDD statistics >

[jira] [Assigned] (SPARK-28868) Specify Jekyll version to 3.8.6 in release docker image

2019-08-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28868: - Assignee: Dongjoon Hyun > Specify Jekyll version to 3.8.6 in release docker image >

[jira] [Commented] (SPARK-25549) High level API to collect RDD statistics

2019-08-25 Thread Liang-Chi Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915362#comment-16915362 ] Liang-Chi Hsieh commented on SPARK-25549: - Close this as it is not needed now. > High level API

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over.

2019-08-25 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915358#comment-16915358 ] Jungtaek Lim commented on SPARK-28594: -- I've raised priority as many end users are suffering with

[jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over.

2019-08-25 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915357#comment-16915357 ] Jungtaek Lim commented on SPARK-28594: -- Coincidentally I was working on the design of this feature

[jira] [Updated] (SPARK-28594) Allow event logs for running streaming apps to be rolled over.

2019-08-25 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-28594: - Priority: Major (was: Minor) > Allow event logs for running streaming apps to be rolled over.

[jira] [Updated] (SPARK-28868) Specify Jekyll version to 3.8.6 in release docker image

2019-08-25 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28868: -- Priority: Blocker (was: Major) > Specify Jekyll version to 3.8.6 in release docker image >

[jira] [Created] (SPARK-28868) Specify Jekyll version to 3.8.6 in release docker image

2019-08-25 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-28868: - Summary: Specify Jekyll version to 3.8.6 in release docker image Key: SPARK-28868 URL: https://issues.apache.org/jira/browse/SPARK-28868 Project: Spark

[jira] [Created] (SPARK-28867) InMemoryStore checkpoint to speed up replay log file in HistoryServer

2019-08-25 Thread wuyi (Jira)
wuyi created SPARK-28867: Summary: InMemoryStore checkpoint to speed up replay log file in HistoryServer Key: SPARK-28867 URL: https://issues.apache.org/jira/browse/SPARK-28867 Project: Spark Issue

[jira] [Assigned] (SPARK-27988) Add aggregates.sql - Part3

2019-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-27988: Assignee: Yuming Wang > Add aggregates.sql - Part3 > -- > >

[jira] [Resolved] (SPARK-27988) Add aggregates.sql - Part3

2019-08-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27988. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 24829

[jira] [Created] (SPARK-28866) Persist item factors RDD when checkpointing in ALS

2019-08-25 Thread Liang-Chi Hsieh (Jira)
Liang-Chi Hsieh created SPARK-28866: --- Summary: Persist item factors RDD when checkpointing in ALS Key: SPARK-28866 URL: https://issues.apache.org/jira/browse/SPARK-28866 Project: Spark

[jira] [Commented] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

2019-08-25 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915225#comment-16915225 ] angerszhu commented on SPARK-21067: --- the root cause is in Spark we use just one SessionState. In

[jira] [Created] (SPARK-28865) Table inheritance

2019-08-25 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-28865: --- Summary: Table inheritance Key: SPARK-28865 URL: https://issues.apache.org/jira/browse/SPARK-28865 Project: Spark Issue Type: Sub-task Components:

[jira] [Commented] (SPARK-28818) FrequentItems applies an incorrect schema to the resulting dataframe when nulls are present

2019-08-25 Thread Matt Hawes (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915181#comment-16915181 ] Matt Hawes commented on SPARK-28818: [PR|https://github.com/apache/spark/pull/25575] created with