[jira] [Resolved] (SPARK-27043) Nested schema pruning benchmark for ORC

[ https://issues.apache.org/jira/browse/SPARK-27043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27043. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 3.0.0 This is res

[jira] [Updated] (SPARK-27043) Add ORC nested schema pruning benchmarks

[ https://issues.apache.org/jira/browse/SPARK-27043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27043: -- Summary: Add ORC nested schema pruning benchmarks (was: Nested schema pruning benchmark for O

[jira] [Commented] (SPARK-26947) Pyspark KMeans Clustering job fails on large values of k

[ https://issues.apache.org/jira/browse/SPARK-26947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784831#comment-16784831 ] Parth Gandhi commented on SPARK-26947: -- [~srowen] Yes your suggestion to limit the

[jira] [Resolved] (SPARK-26947) Pyspark KMeans Clustering job fails on large values of k

[ https://issues.apache.org/jira/browse/SPARK-26947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Parth Gandhi resolved SPARK-26947. -- Resolution: Invalid > Pyspark KMeans Clustering job fails on large values of k > -

[jira] [Commented] (SPARK-23961) pyspark toLocalIterator throws an exception

[ https://issues.apache.org/jira/browse/SPARK-23961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784843#comment-16784843 ] Bryan Cutler commented on SPARK-23961: -- I could also reproduce with a nearly identi

[jira] [Assigned] (SPARK-26944) Python unit-tests.log not available in artifacts for a build in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-26944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp reassigned SPARK-26944: --- Assignee: shane knapp > Python unit-tests.log not available in artifacts for a build in Jen

[jira] [Updated] (SPARK-26944) Python unit-tests.log not available in artifacts for a build in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-26944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp updated SPARK-26944: Attachment: Screen Shot 2019-03-05 at 12.08.43 PM.png > Python unit-tests.log not available in art

[jira] [Updated] (SPARK-26932) Add a warning for Hive 2.1.1 ORC reader issue

[ https://issues.apache.org/jira/browse/SPARK-26932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26932: -- Summary: Add a warning for Hive 2.1.1 ORC reader issue (was: Orc compatibility between hive a

[jira] [Commented] (SPARK-27025) Speed up toLocalIterator

[ https://issues.apache.org/jira/browse/SPARK-27025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784854#comment-16784854 ] Erik van Oosten commented on SPARK-27025: - If there is no obvious way to improve

[jira] [Resolved] (SPARK-27025) Speed up toLocalIterator

[ https://issues.apache.org/jira/browse/SPARK-27025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik van Oosten resolved SPARK-27025. - Resolution: Incomplete > Speed up toLocalIterator > > >

[jira] [Resolved] (SPARK-26932) Add a warning for Hive 2.1.1 ORC reader issue

[ https://issues.apache.org/jira/browse/SPARK-26932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26932. --- Resolution: Fixed Assignee: Bo Hai Fix Version/s: 3.0.0 2.

[jira] [Commented] (SPARK-26944) Python unit-tests.log not available in artifacts for a build in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-26944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784856#comment-16784856 ] shane knapp commented on SPARK-26944: - ill confirm that this works after the current

[jira] [Commented] (SPARK-26944) Python unit-tests.log not available in artifacts for a build in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-26944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784852#comment-16784852 ] shane knapp commented on SPARK-26944: - added a glob to store these (see attached ima

[jira] [Commented] (SPARK-26944) Python unit-tests.log not available in artifacts for a build in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-26944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784853#comment-16784853 ] Alessandro Bellina commented on SPARK-26944: [~shaneknapp] nice!! thank you

[jira] [Commented] (SPARK-26932) Add a warning for Hive 2.1.1 ORC reader issue

[ https://issues.apache.org/jira/browse/SPARK-26932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784858#comment-16784858 ] Dongjoon Hyun commented on SPARK-26932: --- Thank you, [~haiboself]. I added you to A

[jira] [Assigned] (SPARK-27021) Leaking Netty event loop group for shuffle chunk fetch requests

[ https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27021: -- Assignee: Attila Zsolt Piros > Leaking Netty event loop group for shuffle chunk fetch

[jira] [Resolved] (SPARK-27021) Leaking Netty event loop group for shuffle chunk fetch requests

[ https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27021. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23930 [https:

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784900#comment-16784900 ] Stavros Kontopoulos commented on SPARK-18057: - [~srowen]It seems the upgrade

[jira] [Comment Edited] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784900#comment-16784900 ] Stavros Kontopoulos edited comment on SPARK-18057 at 3/5/19 9:04 PM: -

[jira] [Comment Edited] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784900#comment-16784900 ] Stavros Kontopoulos edited comment on SPARK-18057 at 3/5/19 9:04 PM: -

[jira] [Comment Edited] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784900#comment-16784900 ] Stavros Kontopoulos edited comment on SPARK-18057 at 3/5/19 9:05 PM: -

[jira] [Resolved] (SPARK-27015) spark-submit does not properly escape arguments sent to Mesos dispatcher

[ https://issues.apache.org/jira/browse/SPARK-27015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27015. Resolution: Fixed Assignee: Martin Loncaric Fix Version/s: (was: 2.5.0)

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.1

[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784911#comment-16784911 ] shane knapp commented on SPARK-26742: - any idea of whom might be doing the PR to bum

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784914#comment-16784914 ] Sean Owen commented on SPARK-18057: --- [~skonto] go for it. I lost the context on this o

[jira] [Commented] (SPARK-27025) Speed up toLocalIterator

[ https://issues.apache.org/jira/browse/SPARK-27025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784892#comment-16784892 ] Sean Owen commented on SPARK-27025: --- You'll want to cache() the thing you call toLocal

[jira] [Updated] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp updated SPARK-26742: Summary: Bump Kubernetes Client Version to 4.1.2 (was: Bump Kubernetes Client Version to 4.1.1)

[jira] [Commented] (SPARK-26727) CREATE OR REPLACE VIEW query fails with TableAlreadyExistsException

[ https://issues.apache.org/jira/browse/SPARK-26727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784949#comment-16784949 ] Xiao Li commented on SPARK-26727: - Hi, all, this could happen since the whole DDL are no

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784945#comment-16784945 ] Stavros Kontopoulos commented on SPARK-18057: - Sure I will open a jira and t

[jira] [Commented] (SPARK-26775) Update Jenkins nodes to support local volumes for K8s integration tests

[ https://issues.apache.org/jira/browse/SPARK-26775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784953#comment-16784953 ] shane knapp commented on SPARK-26775: - btw, once https://issues.apache.org/jira/brow

[jira] [Commented] (SPARK-26727) CREATE OR REPLACE VIEW query fails with TableAlreadyExistsException

[ https://issues.apache.org/jira/browse/SPARK-26727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784956#comment-16784956 ] Xiao Li commented on SPARK-26727: - I resolved the ticket as "Not a bug". This is kind of

[jira] [Resolved] (SPARK-26727) CREATE OR REPLACE VIEW query fails with TableAlreadyExistsException

[ https://issues.apache.org/jira/browse/SPARK-26727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-26727. - Resolution: Not A Bug > CREATE OR REPLACE VIEW query fails with TableAlreadyExistsException > --

[jira] [Commented] (SPARK-26742) Bump Kubernetes Client Version to 4.1.2

[ https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784970#comment-16784970 ] Stavros Kontopoulos commented on SPARK-26742: - [~jiaxin] I think. > Bump Ku

[jira] [Assigned] (SPARK-26881) Scaling issue with Gramian computation for RowMatrix: too many results sent to driver

[ https://issues.apache.org/jira/browse/SPARK-26881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26881: Assignee: Apache Spark > Scaling issue with Gramian computation for RowMatrix: too many r

[jira] [Assigned] (SPARK-26881) Scaling issue with Gramian computation for RowMatrix: too many results sent to driver

[ https://issues.apache.org/jira/browse/SPARK-26881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26881: Assignee: (was: Apache Spark) > Scaling issue with Gramian computation for RowMatrix:

[jira] [Resolved] (SPARK-26922) Set socket timeout consistently in Arrow optimization

[ https://issues.apache.org/jira/browse/SPARK-26922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26922. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23971 [https://gi

[jira] [Assigned] (SPARK-26922) Set socket timeout consistently in Arrow optimization

[ https://issues.apache.org/jira/browse/SPARK-26922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-26922: Assignee: Hyukjin Kwon > Set socket timeout consistently in Arrow optimization >

[jira] [Commented] (SPARK-27045) SQL tab in UI shows callsite instead of actual SQL

[ https://issues.apache.org/jira/browse/SPARK-27045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16785077#comment-16785077 ] Dongjoon Hyun commented on SPARK-27045: --- [~ajithshetty]. If this is not a regressi

[jira] [Created] (SPARK-27068) Support failed jobs ui and completed jobs ui use different queue

zhoukang created SPARK-27068: Summary: Support failed jobs ui and completed jobs ui use different queue Key: SPARK-27068 URL: https://issues.apache.org/jira/browse/SPARK-27068 Project: Spark Iss

[jira] [Created] (SPARK-27069) Spark(2.3.1) LDA transfomation memory error(java.lang.OutOfMemoryError at java.io.ByteArrayOutputStream.hugeCapacity(ByteArrayOutputStream.java:123)

TAESUK KIM created SPARK-27069: -- Summary: Spark(2.3.1) LDA transfomation memory error(java.lang.OutOfMemoryError at java.io.ByteArrayOutputStream.hugeCapacity(ByteArrayOutputStream.java:123) Key: SPARK-27069 URL: ht

[jira] [Commented] (SPARK-26998) spark.ssl.keyStorePassword in plaintext on 'ps -ef' output of executor processes in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16785277#comment-16785277 ] Jungtaek Lim commented on SPARK-26998: -- [~toopt4] Yeah I tend to agree that hiding

<    1   2