[jira] [Commented] (SPARK-21727) Operating on an ArrayType in a SparkR DataFrame throws error

[ https://issues.apache.org/jira/browse/SPARK-21727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153194#comment-16153194 ] Yanbo Liang commented on SPARK-21727: - [~neilalex] Please feel free to take this task

[jira] [Resolved] (SPARK-21913) `withDatabase` should drop database with CASCADE

[ https://issues.apache.org/jira/browse/SPARK-21913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21913. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.3.0 > `withDatabase` should dr

[jira] [Updated] (SPARK-21913) `withDatabase` should drop database with CASCADE

[ https://issues.apache.org/jira/browse/SPARK-21913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21913: Component/s: (was: SQL) > `withDatabase` should drop database with CASCADE > --

[jira] [Created] (SPARK-21921) Remove `spark.sql.parquet.cacheMetadata`

Dongjoon Hyun created SPARK-21921: - Summary: Remove `spark.sql.parquet.cacheMetadata` Key: SPARK-21921 URL: https://issues.apache.org/jira/browse/SPARK-21921 Project: Spark Issue Type: Bug

[jira] [Closed] (SPARK-21921) Remove `spark.sql.parquet.cacheMetadata`

[ https://issues.apache.org/jira/browse/SPARK-21921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-21921. - Resolution: Duplicate Oops. I found the old one marked as 'Later'. > Remove `spark.sql.parquet.c

[jira] [Comment Edited] (SPARK-13656) Delete spark.sql.parquet.cacheMetadata

[ https://issues.apache.org/jira/browse/SPARK-13656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153226#comment-16153226 ] Dongjoon Hyun edited comment on SPARK-13656 at 9/5/17 7:41 AM:

[jira] [Commented] (SPARK-13656) Delete spark.sql.parquet.cacheMetadata

[ https://issues.apache.org/jira/browse/SPARK-13656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153227#comment-16153227 ] Apache Spark commented on SPARK-13656: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Reopened] (SPARK-13656) Delete spark.sql.parquet.cacheMetadata

[ https://issues.apache.org/jira/browse/SPARK-13656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-13656: --- I think this is the time, `Later`. > Delete spark.sql.parquet.cacheMetadata > --

[jira] [Assigned] (SPARK-13656) Delete spark.sql.parquet.cacheMetadata

[ https://issues.apache.org/jira/browse/SPARK-13656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13656: Assignee: (was: Apache Spark) > Delete spark.sql.parquet.cacheMetadata > -

[jira] [Assigned] (SPARK-13656) Delete spark.sql.parquet.cacheMetadata

[ https://issues.apache.org/jira/browse/SPARK-13656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13656: Assignee: Apache Spark > Delete spark.sql.parquet.cacheMetadata >

[jira] [Assigned] (SPARK-21917) Remote http(s) resources is not supported in YARN mode

[ https://issues.apache.org/jira/browse/SPARK-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21917: Assignee: Apache Spark > Remote http(s) resources is not supported in YARN mode >

[jira] [Assigned] (SPARK-21917) Remote http(s) resources is not supported in YARN mode

[ https://issues.apache.org/jira/browse/SPARK-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21917: Assignee: (was: Apache Spark) > Remote http(s) resources is not supported in YARN mode

[jira] [Commented] (SPARK-21917) Remote http(s) resources is not supported in YARN mode

[ https://issues.apache.org/jira/browse/SPARK-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153260#comment-16153260 ] Apache Spark commented on SPARK-21917: -- User 'jerryshao' has created a pull request

[jira] [Created] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

zhoukang created SPARK-21922: Summary: When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime' Key: SPARK-21922 URL: https

[jira] [Updated] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-21922: - Description: As title described,and below is an example: !duration-notfixed.png|Before fixed! was: As

[jira] [Updated] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-21922: - Attachment: duration-fixed.png duration-notfixed.png > When executor failed and task metr

[jira] [Comment Edited] (SPARK-21917) Remote http(s) resources is not supported in YARN mode

[ https://issues.apache.org/jira/browse/SPARK-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153141#comment-16153141 ] Saisai Shao edited comment on SPARK-21917 at 9/5/17 8:36 AM: -

[jira] [Updated] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-21922: - Description: As title described,and below is an example: !duration-notfixed.png|Before fixed! We can fix

[jira] [Updated] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-21922: - Attachment: (was: duration-fixed.png) > When executor failed and task metrics have not send to driver

[jira] [Updated] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-21922: - Attachment: (was: duration-notfixed.png) > When executor failed and task metrics have not send to dri

[jira] [Commented] (SPARK-21919) inconsistent behavior of AFTsurvivalRegression algorithm

[ https://issues.apache.org/jira/browse/SPARK-21919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153367#comment-16153367 ] Sean Owen commented on SPARK-21919: --- It does look like a problem. From R's survreg I ge

[jira] [Resolved] (SPARK-21920) DataFrame Fail To Find The Column Name

[ https://issues.apache.org/jira/browse/SPARK-21920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21920. --- Resolution: Invalid > DataFrame Fail To Find The Column Name > --

[jira] [Updated] (SPARK-21920) DataFrame Fail To Find The Column Name

[ https://issues.apache.org/jira/browse/SPARK-21920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21920: -- Flags: (was: Important) Priority: Minor (was: Critical) Questions should go to the mailing li

[jira] [Updated] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-21922: - Attachment: fixed01.png fixed02.png notfixed01.png notfixe

[jira] [Updated] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-21922: - Description: As title described,and below is an example: !notfixed01.png|Before fixed! !notfixed02.png|Be

[jira] [Resolved] (SPARK-21903) Upgrade scalastyle to 1.0.0

[ https://issues.apache.org/jira/browse/SPARK-21903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21903. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19116 [https://git

[jira] [Assigned] (SPARK-21903) Upgrade scalastyle to 1.0.0

[ https://issues.apache.org/jira/browse/SPARK-21903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-21903: Assignee: Hyukjin Kwon > Upgrade scalastyle to 1.0.0 > --- > >

[jira] [Assigned] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21922: Assignee: Apache Spark > When executor failed and task metrics have not send to driver,the

[jira] [Assigned] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21922: Assignee: (was: Apache Spark) > When executor failed and task metrics have not send to

[jira] [Commented] (SPARK-21922) When executor failed and task metrics have not send to driver,the status will always be 'RUNNING' and the duration will be 'CurrentTime - launchTime'

[ https://issues.apache.org/jira/browse/SPARK-21922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153455#comment-16153455 ] Apache Spark commented on SPARK-21922: -- User 'caneGuy' has created a pull request fo

[jira] [Updated] (SPARK-21902) BlockManager.doPut will hide actually exception when exception thrown in finally block

[ https://issues.apache.org/jira/browse/SPARK-21902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-21902: - Description: As logging below, actually exception will be hidden when removeBlockInternal throw an excep

[jira] [Assigned] (SPARK-21902) BlockManager.doPut will hide actually exception when exception thrown in finally block

[ https://issues.apache.org/jira/browse/SPARK-21902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21902: Assignee: (was: Apache Spark) > BlockManager.doPut will hide actually exception when e

[jira] [Commented] (SPARK-21902) BlockManager.doPut will hide actually exception when exception thrown in finally block

[ https://issues.apache.org/jira/browse/SPARK-21902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153463#comment-16153463 ] Apache Spark commented on SPARK-21902: -- User 'caneGuy' has created a pull request fo

[jira] [Assigned] (SPARK-21902) BlockManager.doPut will hide actually exception when exception thrown in finally block

[ https://issues.apache.org/jira/browse/SPARK-21902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21902: Assignee: Apache Spark > BlockManager.doPut will hide actually exception when exception th

[jira] [Updated] (SPARK-21893) Put Kafka 0.8 behind a profile

[ https://issues.apache.org/jira/browse/SPARK-21893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21893: -- Priority: Minor (was: Major) > Put Kafka 0.8 behind a profile > -- > >

[jira] [Assigned] (SPARK-21893) Put Kafka 0.8 behind a profile

[ https://issues.apache.org/jira/browse/SPARK-21893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21893: Assignee: (was: Apache Spark) > Put Kafka 0.8 behind a profile > -

[jira] [Assigned] (SPARK-21893) Put Kafka 0.8 behind a profile

[ https://issues.apache.org/jira/browse/SPARK-21893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21893: Assignee: Apache Spark > Put Kafka 0.8 behind a profile > -- >

[jira] [Commented] (SPARK-21893) Put Kafka 0.8 behind a profile

[ https://issues.apache.org/jira/browse/SPARK-21893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153503#comment-16153503 ] Apache Spark commented on SPARK-21893: -- User 'srowen' has created a pull request for

[jira] [Created] (SPARK-21923) Avoid call reserveUnrollMemoryForThisTask every record

Xianyang Liu created SPARK-21923: Summary: Avoid call reserveUnrollMemoryForThisTask every record Key: SPARK-21923 URL: https://issues.apache.org/jira/browse/SPARK-21923 Project: Spark Issue

[jira] [Assigned] (SPARK-21923) Avoid call reserveUnrollMemoryForThisTask every record

[ https://issues.apache.org/jira/browse/SPARK-21923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21923: Assignee: (was: Apache Spark) > Avoid call reserveUnrollMemoryForThisTask every record

[jira] [Assigned] (SPARK-21923) Avoid call reserveUnrollMemoryForThisTask every record

[ https://issues.apache.org/jira/browse/SPARK-21923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21923: Assignee: Apache Spark > Avoid call reserveUnrollMemoryForThisTask every record >

[jira] [Commented] (SPARK-21923) Avoid call reserveUnrollMemoryForThisTask every record

[ https://issues.apache.org/jira/browse/SPARK-21923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153590#comment-16153590 ] Apache Spark commented on SPARK-21923: -- User 'ConeyLiu' has created a pull request f

[jira] [Updated] (SPARK-21923) Avoid call reserveUnrollMemoryForThisTask every record

[ https://issues.apache.org/jira/browse/SPARK-21923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyang Liu updated SPARK-21923: - Description: When Spark persist data to Unsafe memory, we call the method `MemoryStore.putItera

[jira] [Updated] (SPARK-21888) Cannot add stuff to Client Classpath for Yarn Cluster Mode

[ https://issues.apache.org/jira/browse/SPARK-21888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-21888: -- Description: While running Spark on Yarn in cluster mode, currently there is no way to add any

[jira] [Created] (SPARK-21924) Bug in Structured Streaming Documentation

Riccardo Corbella created SPARK-21924: - Summary: Bug in Structured Streaming Documentation Key: SPARK-21924 URL: https://issues.apache.org/jira/browse/SPARK-21924 Project: Spark Issue Typ

[jira] [Commented] (SPARK-21866) SPIP: Image support in Spark

[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153647#comment-16153647 ] Yanbo Liang commented on SPARK-21866: - I would support this effort generally. For Spa

[jira] [Comment Edited] (SPARK-21866) SPIP: Image support in Spark

[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153647#comment-16153647 ] Yanbo Liang edited comment on SPARK-21866 at 9/5/17 1:37 PM: -

[jira] [Comment Edited] (SPARK-21866) SPIP: Image support in Spark

[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153647#comment-16153647 ] Yanbo Liang edited comment on SPARK-21866 at 9/5/17 1:38 PM: -

[jira] [Comment Edited] (SPARK-21866) SPIP: Image support in Spark

[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153647#comment-16153647 ] Yanbo Liang edited comment on SPARK-21866 at 9/5/17 1:39 PM: -

[jira] [Commented] (SPARK-21918) HiveClient shouldn't share Hive object between different thread

[ https://issues.apache.org/jira/browse/SPARK-21918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153672#comment-16153672 ] Marco Gaido commented on SPARK-21918: - hive.server2.enable.doAs=true is currently not

[jira] [Comment Edited] (SPARK-21918) HiveClient shouldn't share Hive object between different thread

[ https://issues.apache.org/jira/browse/SPARK-21918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153672#comment-16153672 ] Marco Gaido edited comment on SPARK-21918 at 9/5/17 1:54 PM: -

[jira] [Commented] (SPARK-15689) Data source API v2

[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153709#comment-16153709 ] Yanbo Liang commented on SPARK-15689: - [~cloud_fan] Great doc! I like the direction t

[jira] [Commented] (SPARK-21918) HiveClient shouldn't share Hive object between different thread

[ https://issues.apache.org/jira/browse/SPARK-21918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153713#comment-16153713 ] Hu Liu, commented on SPARK-21918: - [~mgaido] It seems that doAS works correctly in hiveTh

[jira] [Commented] (SPARK-21888) Cannot add stuff to Client Classpath for Yarn Cluster Mode

[ https://issues.apache.org/jira/browse/SPARK-21888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153739#comment-16153739 ] Thomas Graves commented on SPARK-21888: --- [~mgaido] I don't think that is true unle

[jira] [Commented] (SPARK-21888) Cannot add stuff to Client Classpath for Yarn Cluster Mode

[ https://issues.apache.org/jira/browse/SPARK-21888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153744#comment-16153744 ] Thomas Graves commented on SPARK-21888: --- also note that you can do this in client m

[jira] [Resolved] (SPARK-20978) CSV emits NPE when the number of tokens is less than given schema and corrupt column is given

[ https://issues.apache.org/jira/browse/SPARK-20978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20978. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19113 [https://githu

[jira] [Assigned] (SPARK-20978) CSV emits NPE when the number of tokens is less than given schema and corrupt column is given

[ https://issues.apache.org/jira/browse/SPARK-20978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-20978: --- Assignee: Hyukjin Kwon > CSV emits NPE when the number of tokens is less than given schema a

[jira] [Assigned] (SPARK-15689) Data source API v2

[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15689: Assignee: Apache Spark > Data source API v2 > -- > > Key:

[jira] [Commented] (SPARK-15689) Data source API v2

[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153834#comment-16153834 ] Apache Spark commented on SPARK-15689: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-15689) Data source API v2

[ https://issues.apache.org/jira/browse/SPARK-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15689: Assignee: (was: Apache Spark) > Data source API v2 > -- > >

[jira] [Commented] (SPARK-21924) Bug in Structured Streaming Documentation

[ https://issues.apache.org/jira/browse/SPARK-21924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153847#comment-16153847 ] Sean Owen commented on SPARK-21924: --- Agree, go ahead and make a pull request. > Bug in

[jira] [Commented] (SPARK-21924) Bug in Structured Streaming Documentation

[ https://issues.apache.org/jira/browse/SPARK-21924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153856#comment-16153856 ] Apache Spark commented on SPARK-21924: -- User 'riccardocorbella' has created a pull r

[jira] [Assigned] (SPARK-21924) Bug in Structured Streaming Documentation

[ https://issues.apache.org/jira/browse/SPARK-21924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21924: Assignee: Apache Spark > Bug in Structured Streaming Documentation > -

[jira] [Assigned] (SPARK-21924) Bug in Structured Streaming Documentation

[ https://issues.apache.org/jira/browse/SPARK-21924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21924: Assignee: (was: Apache Spark) > Bug in Structured Streaming Documentation > --

[jira] [Updated] (SPARK-21924) Bug in Structured Streaming Documentation

[ https://issues.apache.org/jira/browse/SPARK-21924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Riccardo Corbella updated SPARK-21924: -- Description: Under the structured streaming documentation page, more precisely in text

[jira] [Commented] (SPARK-21888) Cannot add stuff to Client Classpath for Yarn Cluster Mode

[ https://issues.apache.org/jira/browse/SPARK-21888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153888#comment-16153888 ] Marco Gaido commented on SPARK-21888: - [~tgraves] Sorry, I misread. Of course, this d

[jira] [Commented] (SPARK-21190) SPIP: Vectorized UDFs in Python

[ https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153955#comment-16153955 ] Takuya Ueshin commented on SPARK-21190: --- [~bryanc] Thank you for your suggestion. {

[jira] [Commented] (SPARK-21190) SPIP: Vectorized UDFs in Python

[ https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153978#comment-16153978 ] Takuya Ueshin commented on SPARK-21190: --- [~leif] Thank you for your proposal. I'm s

[jira] [Commented] (SPARK-21190) SPIP: Vectorized UDFs in Python

[ https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153986#comment-16153986 ] Leif Walsh commented on SPARK-21190: I think the size parameter is confusing: if a 1-

[jira] [Commented] (SPARK-21888) Cannot add stuff to Client Classpath for Yarn Cluster Mode

[ https://issues.apache.org/jira/browse/SPARK-21888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154006#comment-16154006 ] Thomas Graves commented on SPARK-21888: --- the client needs to get the hbase credenti

[jira] [Commented] (SPARK-21918) HiveClient shouldn't share Hive object between different thread

[ https://issues.apache.org/jira/browse/SPARK-21918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154033#comment-16154033 ] Marco Gaido commented on SPARK-21918: - What do you mean by "works correctly"? Actuall

[jira] [Commented] (SPARK-20922) Unsafe deserialization in Spark LauncherConnection

[ https://issues.apache.org/jira/browse/SPARK-20922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154075#comment-16154075 ] Sean Owen commented on SPARK-20922: --- This came up again today and our security folks al

[jira] [Commented] (SPARK-21917) Remote http(s) resources is not supported in YARN mode

[ https://issues.apache.org/jira/browse/SPARK-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154097#comment-16154097 ] Marcelo Vanzin commented on SPARK-21917: I think the optimal way would be to try

[jira] [Created] (SPARK-21925) Update trigger interval documentation in docs with behavior change in Spark 2.2

Burak Yavuz created SPARK-21925: --- Summary: Update trigger interval documentation in docs with behavior change in Spark 2.2 Key: SPARK-21925 URL: https://issues.apache.org/jira/browse/SPARK-21925 Project

[jira] [Commented] (SPARK-21925) Update trigger interval documentation in docs with behavior change in Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-21925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154106#comment-16154106 ] Apache Spark commented on SPARK-21925: -- User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-21925) Update trigger interval documentation in docs with behavior change in Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-21925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21925: Assignee: (was: Apache Spark) > Update trigger interval documentation in docs with beh

[jira] [Assigned] (SPARK-21925) Update trigger interval documentation in docs with behavior change in Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-21925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21925: Assignee: Apache Spark > Update trigger interval documentation in docs with behavior chang

[jira] [Commented] (SPARK-21866) SPIP: Image support in Spark

[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154132#comment-16154132 ] Timothy Hunter commented on SPARK-21866: [~yanboliang] thanks you for the comment

[jira] [Commented] (SPARK-21890) ObtainCredentials does not pass creds to addDelegationTokens

[ https://issues.apache.org/jira/browse/SPARK-21890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154190#comment-16154190 ] Apache Spark commented on SPARK-21890: -- User 'redsanket' has created a pull request

[jira] [Resolved] (SPARK-21925) Update trigger interval documentation in docs with behavior change in Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-21925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-21925. --- Resolution: Fixed Fix Version/s: 3.0.0 2.2.1 Issue resolved by pull

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154270#comment-16154270 ] Holger Brandl commented on SPARK-9776: -- I'm still having this issue with spark-2.2.0-

[jira] [Commented] (SPARK-21876) Idling Executors that never handled any tasks are not cleared from BlockManager after being removed

[ https://issues.apache.org/jira/browse/SPARK-21876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154303#comment-16154303 ] Imran Rashid commented on SPARK-21876: -- Thanks for reporting this [~julie.zhang]. I

[jira] [Created] (SPARK-21926) Some transformers in spark.ml.feature fail when trying to transform steaming dataframes

Bago Amirbekian created SPARK-21926: --- Summary: Some transformers in spark.ml.feature fail when trying to transform steaming dataframes Key: SPARK-21926 URL: https://issues.apache.org/jira/browse/SPARK-21926

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154336#comment-16154336 ] Marcelo Vanzin commented on SPARK-18085: Ok I think I was able to reproduce that

[jira] [Commented] (SPARK-21190) SPIP: Vectorized UDFs in Python

[ https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154361#comment-16154361 ] Bryan Cutler commented on SPARK-21190: -- Thanks [~ueshin], I think having an optional

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154363#comment-16154363 ] Marcelo Vanzin commented on SPARK-18085: That should be fixed if you sync to my r

[jira] [Created] (SPARK-21927) Spark pom.xml's dependency management is broken

Kris Mok created SPARK-21927: Summary: Spark pom.xml's dependency management is broken Key: SPARK-21927 URL: https://issues.apache.org/jira/browse/SPARK-21927 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-21927) Spark pom.xml's dependency management is broken

[ https://issues.apache.org/jira/browse/SPARK-21927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154426#comment-16154426 ] Kris Mok commented on SPARK-21927: -- [~sowen] Could you please take a look and see if rec

[jira] [Commented] (SPARK-21927) Spark pom.xml's dependency management is broken

[ https://issues.apache.org/jira/browse/SPARK-21927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154469#comment-16154469 ] Sean Owen commented on SPARK-21927: --- It's probably the scalastyle update today but why

[jira] [Created] (SPARK-21928) ML LogisticRegression training occasionally produces java.lang.ClassNotFoundException when attempting to load custom Kryo registrator class

John Brock created SPARK-21928: -- Summary: ML LogisticRegression training occasionally produces java.lang.ClassNotFoundException when attempting to load custom Kryo registrator class Key: SPARK-21928 URL: https://iss

[jira] [Updated] (SPARK-21927) Spark pom.xml's dependency management is broken

[ https://issues.apache.org/jira/browse/SPARK-21927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21927: Issue Type: Improvement (was: Bug) > Spark pom.xml's dependency management is broken > ---

[jira] [Updated] (SPARK-21927) Spark pom.xml's dependency management is broken

[ https://issues.apache.org/jira/browse/SPARK-21927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21927: Affects Version/s: (was: 2.2.1) 2.3.0 > Spark pom.xml's dependency management is

[jira] [Commented] (SPARK-21927) Spark pom.xml's dependency management is broken

[ https://issues.apache.org/jira/browse/SPARK-21927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154575#comment-16154575 ] Yin Huai commented on SPARK-21927: -- My worry is that it may mask actual issues related t

[jira] [Commented] (SPARK-21384) Spark 2.2 + YARN without spark.yarn.jars / spark.yarn.archive fails

[ https://issues.apache.org/jira/browse/SPARK-21384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154627#comment-16154627 ] Apache Spark commented on SPARK-21384: -- User 'devaraj-kavali' has created a pull req

[jira] [Assigned] (SPARK-21384) Spark 2.2 + YARN without spark.yarn.jars / spark.yarn.archive fails

[ https://issues.apache.org/jira/browse/SPARK-21384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21384: Assignee: Apache Spark > Spark 2.2 + YARN without spark.yarn.jars / spark.yarn.archive fai

[jira] [Assigned] (SPARK-21384) Spark 2.2 + YARN without spark.yarn.jars / spark.yarn.archive fails

[ https://issues.apache.org/jira/browse/SPARK-21384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21384: Assignee: (was: Apache Spark) > Spark 2.2 + YARN without spark.yarn.jars / spark.yarn.

[jira] [Created] (SPARK-21929) Support `ALTER TABLE table_name ADD COLUMNS(..)` for ORC data source

Dongjoon Hyun created SPARK-21929: - Summary: Support `ALTER TABLE table_name ADD COLUMNS(..)` for ORC data source Key: SPARK-21929 URL: https://issues.apache.org/jira/browse/SPARK-21929 Project: Spark

[jira] [Created] (SPARK-21930) When the number of attempting to restart receiver greater than 0,spark do nothing in 'else'

liuxianjiao created SPARK-21930: --- Summary: When the number of attempting to restart receiver greater than 0,spark do nothing in 'else' Key: SPARK-21930 URL: https://issues.apache.org/jira/browse/SPARK-21930

[jira] [Updated] (SPARK-21912) ORC/Parquet table should create invalid column names

[ https://issues.apache.org/jira/browse/SPARK-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21912: -- Summary: ORC/Parquet table should create invalid column names (was: Creating ORC datasource ta

[jira] [Updated] (SPARK-21912) ORC/Parquet table should not create invalid column names

[ https://issues.apache.org/jira/browse/SPARK-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21912: -- Summary: ORC/Parquet table should not create invalid column names (was: ORC/Parquet table shou

  1   2   >