[jira] [Commented] (SPARK-27055) Update Structured Streaming documentation because of DSv2 changes

2019-03-06 Thread Sandeep Katta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786451#comment-16786451 ] Sandeep Katta commented on SPARK-27055: --- [~gsomogyi]  [~cloud_fan] from the code c

[jira] [Updated] (SPARK-27069) Spark(2.3.1) LDA transfomation memory error(java.lang.OutOfMemoryError at java.io.ByteArrayOutputStream.hugeCapacity(ByteArrayOutputStream.java:1232

2019-03-06 Thread TAESUK KIM (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TAESUK KIM updated SPARK-27069: --- Summary: Spark(2.3.1) LDA transfomation memory error(java.lang.OutOfMemoryError at java.io.ByteArra

[jira] [Commented] (SPARK-23872) Can not connect to another metastore uri using two Spark sessions

2019-03-06 Thread Udbhav Agrawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786454#comment-16786454 ] Udbhav Agrawal commented on SPARK-23872: Hi [~chelsa] , you have to close the sp

[jira] [Commented] (SPARK-24624) Can not mix vectorized and non-vectorized UDFs

2019-03-06 Thread peay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786456#comment-16786456 ] peay commented on SPARK-24624: -- I mean regular aggregation functions and Pandas UDF aggrega

[jira] [Comment Edited] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Jiaxin Shan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786418#comment-16786418 ] Jiaxin Shan edited comment on SPARK-26742 at 3/7/19 6:05 AM: -

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Jiaxin Shan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786418#comment-16786418 ] Jiaxin Shan commented on SPARK-26742: - Got some failures. I think it's not related t

[jira] [Created] (SPARK-27081) Support launching executors in existed Pods

2019-03-06 Thread Klaus Ma (JIRA)
Klaus Ma created SPARK-27081: Summary: Support launching executors in existed Pods Key: SPARK-27081 URL: https://issues.apache.org/jira/browse/SPARK-27081 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-27080) Read parquet file with merging metastore schema should compare schema field in uniform case.

2019-03-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27080: Assignee: Apache Spark > Read parquet file with merging metastore schema should compare s

[jira] [Assigned] (SPARK-27080) Read parquet file with merging metastore schema should compare schema field in uniform case.

2019-03-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27080: Assignee: (was: Apache Spark) > Read parquet file with merging metastore schema shoul

[jira] [Created] (SPARK-27080) Read parquet file with merging metastore schema should compare schema field in uniform case.

2019-03-06 Thread BoMeng (JIRA)
BoMeng created SPARK-27080: -- Summary: Read parquet file with merging metastore schema should compare schema field in uniform case. Key: SPARK-27080 URL: https://issues.apache.org/jira/browse/SPARK-27080 Proj

[jira] [Commented] (SPARK-26879) Inconsistency in default column names for functions like inline and stack

2019-03-06 Thread Chakravarthi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786401#comment-16786401 ] Chakravarthi commented on SPARK-26879: -- Thanks for reporting. [~jashgala] I would l

[jira] [Commented] (SPARK-26604) Register channel for stream request

2019-03-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786397#comment-16786397 ] Felix Cheung commented on SPARK-26604: -- could we backport this to branch-2.4? > Re

[jira] [Commented] (SPARK-26868) Duplicate error message for implicit cartesian product in verbose explain

2019-03-06 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786381#comment-16786381 ] Takeshi Yamamuro commented on SPARK-26868: -- Yea, you can do. > Duplicate error

[jira] [Commented] (SPARK-26868) Duplicate error message for implicit cartesian product in verbose explain

2019-03-06 Thread nivedita singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786362#comment-16786362 ] nivedita singh commented on SPARK-26868: If no one is working on it, can I work

[jira] [Assigned] (SPARK-27079) Fix typo & Remove useless imports

2019-03-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27079: Assignee: (was: Apache Spark) > Fix typo & Remove useless imports > -

[jira] [Assigned] (SPARK-27079) Fix typo & Remove useless imports

2019-03-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27079: Assignee: Apache Spark > Fix typo & Remove useless imports >

[jira] [Commented] (SPARK-27079) Fix typo & Remove useless imports

2019-03-06 Thread Sharanabasappa G Keriwaddi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786358#comment-16786358 ] Sharanabasappa G Keriwaddi commented on SPARK-27079: Could you pleas

[jira] [Created] (SPARK-27079) Fix typo & Remove useless imports

2019-03-06 Thread EdisonWang (JIRA)
EdisonWang created SPARK-27079: -- Summary: Fix typo & Remove useless imports Key: SPARK-27079 URL: https://issues.apache.org/jira/browse/SPARK-27079 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-27049) Support handling partition values in the abstraction of file source V2

2019-03-06 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27049: --- Assignee: Gengliang Wang > Support handling partition values in the abstraction of file sou

[jira] [Resolved] (SPARK-27049) Support handling partition values in the abstraction of file source V2

2019-03-06 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27049. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23987 [https://gith

[jira] [Resolved] (SPARK-27057) Common trait for limit exec operators

2019-03-06 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27057. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23976 [https://gith

[jira] [Assigned] (SPARK-27057) Common trait for limit exec operators

2019-03-06 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27057: --- Assignee: Maxim Gekk > Common trait for limit exec operators >

[jira] [Resolved] (SPARK-27078) Read Hive materialized view throw MatchError

2019-03-06 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27078. --- Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0

[jira] [Assigned] (SPARK-27054) Remove Calcite dependency

2019-03-06 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-27054: - Assignee: Yuming Wang > Remove Calcite dependency > - > >

[jira] [Commented] (SPARK-24624) Can not mix vectorized and non-vectorized UDFs

2019-03-06 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786246#comment-16786246 ] Hyukjin Kwon commented on SPARK-24624: -- If you mean Pandas UDF aggregate function,

[jira] [Updated] (SPARK-27077) DataFrameReader and Number of Connection Limitation

2019-03-06 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu updated SPARK-27077: Description: I am not very sure this is a Spark core issue or a Vertica issue, however I intended to thin

[jira] [Commented] (SPARK-27078) Read Hive materialized view throw MatchError

2019-03-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786233#comment-16786233 ] Apache Spark commented on SPARK-27078: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-27078) Read Hive materialized view throw MatchError

2019-03-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27078: Assignee: (was: Apache Spark) > Read Hive materialized view throw MatchError > --

[jira] [Assigned] (SPARK-27078) Read Hive materialized view throw MatchError

2019-03-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27078: Assignee: Apache Spark > Read Hive materialized view throw MatchError > -

[jira] [Created] (SPARK-27078) Read Hive materialized view throw MatchError

2019-03-06 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-27078: --- Summary: Read Hive materialized view throw MatchError Key: SPARK-27078 URL: https://issues.apache.org/jira/browse/SPARK-27078 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-27077) DataFrameReader and Number of Connection Limitation

2019-03-06 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786228#comment-16786228 ] Yuming Wang commented on SPARK-27077: - Could you try to set {{numPartitions}} please

[jira] [Comment Edited] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Jiaxin Shan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786217#comment-16786217 ] Jiaxin Shan edited comment on SPARK-26742 at 3/6/19 11:28 PM:

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Jiaxin Shan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786217#comment-16786217 ] Jiaxin Shan commented on SPARK-26742: - I am willing to do that. I will make sure loc

[jira] [Commented] (SPARK-25863) java.lang.UnsupportedOperationException: empty.max at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$.updateAndGetCompilationStats(CodeGenerator.scala

2019-03-06 Thread Val Feldsher (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786202#comment-16786202 ] Val Feldsher commented on SPARK-25863: -- I recently experienced similar issue while

[jira] [Comment Edited] (SPARK-25863) java.lang.UnsupportedOperationException: empty.max at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$.updateAndGetCompilationStats(CodeGenerator.

2019-03-06 Thread Val Feldsher (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786202#comment-16786202 ] Val Feldsher edited comment on SPARK-25863 at 3/6/19 11:14 PM: ---

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786187#comment-16786187 ] shane knapp commented on SPARK-26742: - [~seedjeffwan] are you going to open a new PR

[jira] [Created] (SPARK-27077) DataFrameReader and Number of Connection Limitation

2019-03-06 Thread Paul Wu (JIRA)
Paul Wu created SPARK-27077: --- Summary: DataFrameReader and Number of Connection Limitation Key: SPARK-27077 URL: https://issues.apache.org/jira/browse/SPARK-27077 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-27076) Getting the timeout error while writing parquet/csv files to s3

2019-03-06 Thread srinivas rao gajjala (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] srinivas rao gajjala updated SPARK-27076: - Description: Hi, I'm trying to writing parquet/csv files from s3 using Amazon E

[jira] [Updated] (SPARK-27076) Getting the timeout error while writing parquet/csv files to s3

2019-03-06 Thread srinivas rao gajjala (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] srinivas rao gajjala updated SPARK-27076: - Summary: Getting the timeout error while writing parquet/csv files to s3 (was:

[jira] [Updated] (SPARK-27076) Getting the timeout error while reading parquet/csv files from s3

2019-03-06 Thread srinivas rao gajjala (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] srinivas rao gajjala updated SPARK-27076: - Summary: Getting the timeout error while reading parquet/csv files from s3 (was

[jira] [Updated] (SPARK-27076) Getting the timeout error while reading parquet/csv files from s3

2019-03-06 Thread srinivas rao gajjala (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] srinivas rao gajjala updated SPARK-27076: - Description: Hi, I'm trying to write parquet files from s3 using Amazon EMR clu

[jira] [Created] (SPARK-27076) Getting the timeout error while reading parquet files from s3

2019-03-06 Thread srinivas rao gajjala (JIRA)
srinivas rao gajjala created SPARK-27076: Summary: Getting the timeout error while reading parquet files from s3 Key: SPARK-27076 URL: https://issues.apache.org/jira/browse/SPARK-27076 Project

[jira] [Resolved] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-06 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27019. Resolution: Fixed Fix Version/s: 2.4.2 3.0.0 Issue resolved by p

[jira] [Assigned] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-06 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27019: -- Assignee: Shahid K I > Spark UI's SQL tab shows inconsistent values > ---

[jira] [Comment Edited] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786068#comment-16786068 ] shane knapp edited comment on SPARK-26742 at 3/6/19 9:18 PM: -

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786146#comment-16786146 ] Stavros Kontopoulos commented on SPARK-26742: - That is a good point [~seedje

[jira] [Comment Edited] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786146#comment-16786146 ] Stavros Kontopoulos edited comment on SPARK-26742 at 3/6/19 9:27 PM: -

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786142#comment-16786142 ] shane knapp commented on SPARK-26742: - my testing shows that 1.13.x passes our integ

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Jiaxin Shan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786140#comment-16786140 ] Jiaxin Shan commented on SPARK-26742: - Agree to target v1.13.x even though 4.1.2 may

[jira] [Comment Edited] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786132#comment-16786132 ] Stavros Kontopoulos edited comment on SPARK-26742 at 3/6/19 9:11 PM: -

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786132#comment-16786132 ] Stavros Kontopoulos commented on SPARK-26742: - My take is: latest for PRs an

[jira] [Updated] (SPARK-27075) Sorting table column in SQL WEBUI page throws 'IllegalArgumentException'

2019-03-06 Thread Shahid K I (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shahid K I updated SPARK-27075: --- Description: Test steps: 1) bin/spark-sql 2) run some queries 3) Open SQL page in the webui 4) T

[jira] [Updated] (SPARK-27075) Sorting table column in SQL WEBUI page throws 'IllegalArgumentException'

2019-03-06 Thread Shahid K I (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shahid K I updated SPARK-27075: --- Attachment: image-2019-03-07-02-37-20-453.png > Sorting table column in SQL WEBUI page throws 'Illeg

[jira] [Commented] (SPARK-27075) Sorting table column in SQL WEBUI page throws 'IllegalArgumentException'

2019-03-06 Thread Shahid K I (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786122#comment-16786122 ] Shahid K I commented on SPARK-27075: I will raise a PR > Sorting table column in SQ

[jira] [Assigned] (SPARK-27075) Sorting table column in SQL WEBUI page throws 'IllegalArgumentException'

2019-03-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27075: Assignee: Apache Spark > Sorting table column in SQL WEBUI page throws 'IllegalArgumentEx

[jira] [Assigned] (SPARK-27075) Sorting table column in SQL WEBUI page throws 'IllegalArgumentException'

2019-03-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27075: Assignee: (was: Apache Spark) > Sorting table column in SQL WEBUI page throws 'Illega

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786129#comment-16786129 ] shane knapp commented on SPARK-26742: - alright, last thing before these two PRs are

[jira] [Created] (SPARK-27075) Sorting table column in SQL WEBUI page throws 'IllegalArgumentException'

2019-03-06 Thread Shahid K I (JIRA)
Shahid K I created SPARK-27075: -- Summary: Sorting table column in SQL WEBUI page throws 'IllegalArgumentException' Key: SPARK-27075 URL: https://issues.apache.org/jira/browse/SPARK-27075 Project: Spark

[jira] [Comment Edited] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786102#comment-16786102 ] Stavros Kontopoulos edited comment on SPARK-26742 at 3/6/19 8:29 PM: -

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786102#comment-16786102 ] Stavros Kontopoulos commented on SPARK-26742: - Yeah I was able to do so than

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786097#comment-16786097 ] shane knapp commented on SPARK-26742: - [~skonto] -- i was able to downgrade k8s succ

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786074#comment-16786074 ] shane knapp commented on SPARK-26742: - [~skonto] the only problems i've had are when

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786069#comment-16786069 ] Stavros Kontopoulos commented on SPARK-26742: - That is awesome! > Bump Kube

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786068#comment-16786068 ] shane knapp commented on SPARK-26742: - 1.12.6 passes for me as well: {noformat} [I

[jira] [Comment Edited] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786067#comment-16786067 ] Stavros Kontopoulos edited comment on SPARK-26742 at 3/6/19 7:40 PM: -

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786067#comment-16786067 ] Stavros Kontopoulos commented on SPARK-26742: - I did all that plus rm /etc/k

[jira] [Comment Edited] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786060#comment-16786060 ] shane knapp edited comment on SPARK-26742 at 3/6/19 7:33 PM: -

[jira] [Updated] (SPARK-27023) Kubernetes client timeouts should be configurable

2019-03-06 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27023: -- Issue Type: Improvement (was: New Feature) > Kubernetes client timeouts should be configurabl

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786060#comment-16786060 ] shane knapp commented on SPARK-26742: - i was unable to get 1.11.7 to work until i di

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786056#comment-16786056 ] Stavros Kontopoulos commented on SPARK-26742: - I mean `minikube` binary beca

[jira] [Commented] (SPARK-27063) Spark on K8S Integration Tests timeouts are too short for some test clusters

2019-03-06 Thread Rob Vesse (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786051#comment-16786051 ] Rob Vesse commented on SPARK-27063: --- [~skonto] Yes we have experienced the same proble

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786047#comment-16786047 ] shane knapp commented on SPARK-26742: - works for me against k8s v1.11.7: {noformat

[jira] [Comment Edited] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786047#comment-16786047 ] shane knapp edited comment on SPARK-26742 at 3/6/19 7:17 PM: -

[jira] [Resolved] (SPARK-27023) Kubernetes client timeouts should be configurable

2019-03-06 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27023. --- Resolution: Fixed Assignee: Onur Satici Fix Version/s: 3.0.0 This is resolve

[jira] [Comment Edited] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786019#comment-16786019 ] Stavros Kontopoulos edited comment on SPARK-26742 at 3/6/19 6:59 PM: -

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786023#comment-16786023 ] shane knapp commented on SPARK-26742: - i think you mean: s/minikube/k8s anyways, e

[jira] [Commented] (SPARK-27006) SPIP: .NET bindings for Apache Spark

2019-03-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786030#comment-16786030 ] Sean Owen commented on SPARK-27006: --- You can use the Apache license, and follow Apache

[jira] [Commented] (SPARK-18748) UDF multiple evaluations causes very poor performance

2019-03-06 Thread Qingbo Hu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786029#comment-16786029 ] Qingbo Hu commented on SPARK-18748: --- We have the same problem when using Spark structu

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786012#comment-16786012 ] shane knapp commented on SPARK-26742: - 2.4 k8s integration tests pass w/the client u

[jira] [Comment Edited] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786019#comment-16786019 ] Stavros Kontopoulos edited comment on SPARK-26742 at 3/6/19 6:59 PM: -

[jira] [Comment Edited] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786019#comment-16786019 ] Stavros Kontopoulos edited comment on SPARK-26742 at 3/6/19 6:58 PM: -

[jira] [Comment Edited] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786019#comment-16786019 ] Stavros Kontopoulos edited comment on SPARK-26742 at 3/6/19 6:58 PM: -

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786019#comment-16786019 ] Stavros Kontopoulos commented on SPARK-26742: - Cool! The question is does it

[jira] [Commented] (SPARK-27006) SPIP: .NET bindings for Apache Spark

2019-03-06 Thread Terry Kim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16786001#comment-16786001 ] Terry Kim commented on SPARK-27006: --- Thanks for the feedback. We are happy to work on

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16785987#comment-16785987 ] shane knapp commented on SPARK-26742: - ok, i found the 2.4 PR: https://github.com/a

[jira] [Updated] (SPARK-27045) SQL tab in UI shows actual SQL instead of callsite

2019-03-06 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated SPARK-27045: Summary: SQL tab in UI shows actual SQL instead of callsite (was: SQL tab in UI shows callsite instead of

[jira] [Updated] (SPARK-27045) SQL tab in UI shows callsite instead of actual SQL

2019-03-06 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated SPARK-27045: Issue Type: Improvement (was: Bug) > SQL tab in UI shows callsite instead of actual SQL > ---

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16785983#comment-16785983 ] shane knapp commented on SPARK-26742: - please link to the PRs (master + 2.4) here an

[jira] [Comment Edited] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16785962#comment-16785962 ] Stavros Kontopoulos edited comment on SPARK-26742 at 3/6/19 6:14 PM: -

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16785962#comment-16785962 ] Stavros Kontopoulos commented on SPARK-26742: - I created one for the 2.4 bra

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

2019-03-06 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16785970#comment-16785970 ] shane knapp commented on SPARK-26742: - you can submit a PR now. it will fail on the

[jira] [Resolved] (SPARK-27065) avoid more than one active task set managers for a stage

2019-03-06 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-27065. -- Resolution: Fixed Fix Version/s: 2.3.4 2.4.1 3.0.0

[jira] [Resolved] (SPARK-25250) Race condition with tasks running when new attempt for same stage is created leads to other task in the next attempt running on the same partition id retry multiple tim

2019-03-06 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-25250. -- Resolution: Fixed > Race condition with tasks running when new attempt for same stage is creat

[jira] [Updated] (SPARK-25250) Race condition with tasks running when new attempt for same stage is created leads to other task in the next attempt running on the same partition id retry multiple time

2019-03-06 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-25250: - Fix Version/s: 3.0.0 2.4.1 > Race condition with tasks running when new attem

[jira] [Assigned] (SPARK-25250) Race condition with tasks running when new attempt for same stage is created leads to other task in the next attempt running on the same partition id retry multiple tim

2019-03-06 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-25250: Assignee: Parth Gandhi > Race condition with tasks running when new attempt for same stag

[jira] [Resolved] (SPARK-24669) Managed table was not cleared of path after drop database cascade

2019-03-06 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-24669. --- Resolution: Fixed Assignee: Udbhav Agrawal Fix Version/s: 3.0.0

[jira] [Commented] (SPARK-24624) Can not mix vectorized and non-vectorized UDFs

2019-03-06 Thread peay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16785920#comment-16785920 ] peay commented on SPARK-24624: -- Are there plans to support something similar for aggregatio

[jira] [Commented] (SPARK-24669) Managed table was not cleared of path after drop database cascade

2019-03-06 Thread Udbhav Agrawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16785900#comment-16785900 ] Udbhav Agrawal commented on SPARK-24669: Thankyou [~dongjoon] > Managed table w

[jira] [Commented] (SPARK-27072) Changing the parameter value of completedJob.sort to X prints stacktrace in sparkWebUI

2019-03-06 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16785889#comment-16785889 ] Marcelo Vanzin commented on SPARK-27072: I'd expect an error 401 here, but you g

[jira] [Updated] (SPARK-27074) Refactor HiveClientImpl runHive

2019-03-06 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-27074: Description: Hive 3.1.1's {{CommandProcessor}} have 2 changes: # HIVE-17626(Hive 3.0.0) add ReExe

  1   2   >