[jira] [Comment Edited] (SPARK-19547) KafkaUtil throw 'No current assignment for partition' Exception

[ https://issues.apache.org/jira/browse/SPARK-19547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042241#comment-16042241 ] Utkarsh edited comment on SPARK-19547 at 6/8/17 6:00 AM: - Hi, I'm using Kafka

[jira] [Commented] (SPARK-21011) RDD filter can combine/corrupt columns

[ https://issues.apache.org/jira/browse/SPARK-21011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042337#comment-16042337 ] Liang-Chi Hsieh commented on SPARK-21011: - I can't re-produce it on current codebase. Because you

[jira] [Comment Edited] (SPARK-20953) Add hash map metrics to aggregate and join

[ https://issues.apache.org/jira/browse/SPARK-20953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042419#comment-16042419 ] Liang-Chi Hsieh edited comment on SPARK-20953 at 6/8/17 8:50 AM: - [~rxin]

[jira] [Commented] (SPARK-20953) Add hash map metrics to aggregate and join

[ https://issues.apache.org/jira/browse/SPARK-20953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042419#comment-16042419 ] Liang-Chi Hsieh commented on SPARK-20953: - [~rxin] Are we just going to log an error for too

[jira] [Assigned] (SPARK-19462) when spark.sql.adaptive.enabled is enabled, DF is not resilient to node/container failure

[ https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19462: Assignee: (was: Apache Spark) > when spark.sql.adaptive.enabled is enabled, DF is not

[jira] [Assigned] (SPARK-21017) Move the length getter before the while to improve performance

[ https://issues.apache.org/jira/browse/SPARK-21017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21017: Assignee: Apache Spark > Move the length getter before the while to improve performance >

[jira] [Resolved] (SPARK-20511) SparkR 2.2 QA: Check for new R APIs requiring example code

[ https://issues.apache.org/jira/browse/SPARK-20511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20511. --- Resolution: Done Felix indicated that he believes these are done. > SparkR 2.2 QA: Check for new R

[jira] [Resolved] (SPARK-20513) Update SparkR website for 2.2

[ https://issues.apache.org/jira/browse/SPARK-20513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20513. --- Resolution: Done Felix indicated that he believes these are done. > Update SparkR website for 2.2 >

[jira] [Commented] (SPARK-19462) when spark.sql.adaptive.enabled is enabled, DF is not resilient to node/container failure

[ https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042432#comment-16042432 ] Apache Spark commented on SPARK-19462: -- User 'jinxing64' has created a pull request for this issue:

[jira] [Commented] (SPARK-18075) UDF doesn't work on non-local spark

[ https://issues.apache.org/jira/browse/SPARK-18075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042431#comment-16042431 ] Liang Lee commented on SPARK-18075: --- Anyone can give a solution about this issue? This issue is really

[jira] [Assigned] (SPARK-21015) Check field name is not null and empty in GenericRowWithSchema

[ https://issues.apache.org/jira/browse/SPARK-21015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21015: Assignee: Apache Spark > Check field name is not null and empty in GenericRowWithSchema >

[jira] [Commented] (SPARK-21015) Check field name is not null and empty in GenericRowWithSchema

[ https://issues.apache.org/jira/browse/SPARK-21015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042272#comment-16042272 ] Apache Spark commented on SPARK-21015: -- User 'darionyaphet' has created a pull request for this

[jira] [Assigned] (SPARK-21015) Check field name is not null and empty in GenericRowWithSchema

[ https://issues.apache.org/jira/browse/SPARK-21015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21015: Assignee: (was: Apache Spark) > Check field name is not null and empty in

[jira] [Assigned] (SPARK-21006) Create rpcEnv and run later needs shutdown and awaitTermination

[ https://issues.apache.org/jira/browse/SPARK-21006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-21006: - Assignee: wangjiaochun > Create rpcEnv and run later needs shutdown and awaitTermination >

[jira] [Resolved] (SPARK-21006) Create rpcEnv and run later needs shutdown and awaitTermination

[ https://issues.apache.org/jira/browse/SPARK-21006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21006. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18226

[jira] [Created] (SPARK-21016) Improve code fault tolerance for converting string to number

liuxian created SPARK-21016: --- Summary: Improve code fault tolerance for converting string to number Key: SPARK-21016 URL: https://issues.apache.org/jira/browse/SPARK-21016 Project: Spark Issue

[jira] [Resolved] (SPARK-11811) Database can't be changed if it is specified in url

[ https://issues.apache.org/jira/browse/SPARK-11811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-11811. - Resolution: Fixed Fix Version/s: 2.1.0 > Database can't be changed if it is specified in

[jira] [Comment Edited] (SPARK-18802) java.lang.ClassCastException in a simple spark application

[ https://issues.apache.org/jira/browse/SPARK-18802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042448#comment-16042448 ] Dan edited comment on SPARK-18802 at 6/8/17 9:26 AM: - The issue marked here as

[jira] [Commented] (SPARK-18802) java.lang.ClassCastException in a simple spark application

[ https://issues.apache.org/jira/browse/SPARK-18802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042448#comment-16042448 ] Dan commented on SPARK-18802: - The issue marked here as duplicate is different - it refers to running a Spark

[jira] [Resolved] (SPARK-20914) Javadoc contains code that is invalid

[ https://issues.apache.org/jira/browse/SPARK-20914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20914. --- Resolution: Fixed Fix Version/s: 2.1.2 2.3.0 2.2.1

[jira] [Closed] (SPARK-21008) Streaming applications read stale credentials file when recovering from checkpoint.

[ https://issues.apache.org/jira/browse/SPARK-21008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao closed SPARK-21008. --- Resolution: Duplicate > Streaming applications read stale credentials file when recovering from >

[jira] [Reopened] (SPARK-19688) Spark on Yarn Credentials File set to different application directory

[ https://issues.apache.org/jira/browse/SPARK-19688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reopened SPARK-19688: - The issue still exists in master branch, so reopen it. > Spark on Yarn Credentials File set to

[jira] [Updated] (SPARK-21018) "Completed Jobs" and "Completed Stages" support pagination

[ https://issues.apache.org/jira/browse/SPARK-21018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinhua Fu updated SPARK-21018: -- Attachment: PagedTasks.png > "Completed Jobs" and "Completed Stages" support pagination >

[jira] [Assigned] (SPARK-20914) Javadoc contains code that is invalid

[ https://issues.apache.org/jira/browse/SPARK-20914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20914: - Assignee: Sean Owen Issue Type: Bug (was: Improvement) > Javadoc contains code that is

[jira] [Created] (SPARK-21014) Support get fields with schema name

darion yaphet created SPARK-21014: - Summary: Support get fields with schema name Key: SPARK-21014 URL: https://issues.apache.org/jira/browse/SPARK-21014 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-20998) BroadcastHashJoin producing wrong results

[ https://issues.apache.org/jira/browse/SPARK-20998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042321#comment-16042321 ] Liang-Chi Hsieh commented on SPARK-20998: - I've tried on current codebase and can't reproduce it.

[jira] [Assigned] (SPARK-21016) Improve code fault tolerance for converting string to number

[ https://issues.apache.org/jira/browse/SPARK-21016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21016: Assignee: Apache Spark > Improve code fault tolerance for converting string to number >

[jira] [Assigned] (SPARK-21016) Improve code fault tolerance for converting string to number

[ https://issues.apache.org/jira/browse/SPARK-21016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21016: Assignee: (was: Apache Spark) > Improve code fault tolerance for converting string to

[jira] [Commented] (SPARK-21016) Improve code fault tolerance for converting string to number

[ https://issues.apache.org/jira/browse/SPARK-21016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042429#comment-16042429 ] Apache Spark commented on SPARK-21016: -- User '10110346' has created a pull request for this issue:

[jira] [Commented] (SPARK-21017) Move the length getter before the while to improve performance

[ https://issues.apache.org/jira/browse/SPARK-21017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042439#comment-16042439 ] Apache Spark commented on SPARK-21017: -- User 'eatoncys' has created a pull request for this issue:

[jira] [Commented] (SPARK-19462) when spark.sql.adaptive.enabled is enabled, DF is not resilient to node/container failure

[ https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042440#comment-16042440 ] jin xing commented on SPARK-19462: -- [~ianlcsd] I can reproduce this bug in my env. I made a pr. It's

[jira] [Created] (SPARK-21015) Check field name is not null and empty in GenericRowWithSchema

darion yaphet created SPARK-21015: - Summary: Check field name is not null and empty in GenericRowWithSchema Key: SPARK-21015 URL: https://issues.apache.org/jira/browse/SPARK-21015 Project: Spark

[jira] [Updated] (SPARK-21013) Spark History Server does not show the logs of completed Yarn Jobs

[ https://issues.apache.org/jira/browse/SPARK-21013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-21013: Priority: Minor (was: Major) > Spark History Server does not show the logs of completed Yarn Jobs

[jira] [Resolved] (SPARK-19963) create view from select Fails when nullif() is used

[ https://issues.apache.org/jira/browse/SPARK-19963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-19963. - Resolution: Fixed Fix Version/s: 2.2.0 Marked as fix. > create view from select Fails

[jira] [Commented] (SPARK-20971) Purge the metadata log for FileStreamSource

[ https://issues.apache.org/jira/browse/SPARK-20971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042427#comment-16042427 ] Fei Shao commented on SPARK-20971: -- Hi Zhu, What does metadata logs stands for please? > Purge the

[jira] [Assigned] (SPARK-19462) when spark.sql.adaptive.enabled is enabled, DF is not resilient to node/container failure

[ https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19462: Assignee: Apache Spark > when spark.sql.adaptive.enabled is enabled, DF is not resilient

[jira] [Assigned] (SPARK-21017) Move the length getter before the while to improve performance

[ https://issues.apache.org/jira/browse/SPARK-21017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21017: Assignee: (was: Apache Spark) > Move the length getter before the while to improve

[jira] [Created] (SPARK-21018) "Completed Jobs" and "Completed Stages" support pagination

Jinhua Fu created SPARK-21018: - Summary: "Completed Jobs" and "Completed Stages" support pagination Key: SPARK-21018 URL: https://issues.apache.org/jira/browse/SPARK-21018 Project: Spark Issue

[jira] [Created] (SPARK-21017) Move the length getter before the while to improve performance

eaton created SPARK-21017: - Summary: Move the length getter before the while to improve performance Key: SPARK-21017 URL: https://issues.apache.org/jira/browse/SPARK-21017 Project: Spark Issue

[jira] [Updated] (SPARK-21018) "Completed Jobs" and "Completed Stages" support pagination

[ https://issues.apache.org/jira/browse/SPARK-21018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinhua Fu updated SPARK-21018: -- Attachment: CompletedJobs.png > "Completed Jobs" and "Completed Stages" support pagination >

[jira] [Commented] (SPARK-21016) Improve code fault tolerance for converting string to number

[ https://issues.apache.org/jira/browse/SPARK-21016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042453#comment-16042453 ] Sean Owen commented on SPARK-21016: --- There's no detail here. I don't think we should trim the input

[jira] [Comment Edited] (SPARK-21008) Streaming applications read stale credentials file when recovering from checkpoint.

[ https://issues.apache.org/jira/browse/SPARK-21008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042341#comment-16042341 ] Saisai Shao edited comment on SPARK-21008 at 6/8/17 7:19 AM: - This is

[jira] [Commented] (SPARK-21008) Streaming applications read stale credentials file when recovering from checkpoint.

[ https://issues.apache.org/jira/browse/SPARK-21008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042341#comment-16042341 ] Saisai Shao commented on SPARK-21008: - This is duplicated with SPARK-19588, can we please using that

[jira] [Updated] (SPARK-21018) "Completed Jobs" and "Completed Stages" support pagination

[ https://issues.apache.org/jira/browse/SPARK-21018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinhua Fu updated SPARK-21018: -- Description: When using Thriftsever, the number of jobs and Stages may be very large, and if not

[jira] [Commented] (SPARK-18802) java.lang.ClassCastException in a simple spark application

[ https://issues.apache.org/jira/browse/SPARK-18802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042451#comment-16042451 ] Sean Owen commented on SPARK-18802: --- Please have a look at

[jira] [Resolved] (SPARK-21017) Move the length getter before the while to improve performance

[ https://issues.apache.org/jira/browse/SPARK-21017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21017. --- Resolution: Not A Problem > Move the length getter before the while to improve performance >

[jira] [Updated] (SPARK-20129) JavaSparkContext should use SparkContext.getOrCreate

[ https://issues.apache.org/jira/browse/SPARK-20129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20129: -- Target Version/s: (was: 2.2.0) > JavaSparkContext should use SparkContext.getOrCreate >

[jira] [Commented] (SPARK-20952) TaskContext should be an InheritableThreadLocal

[ https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043714#comment-16043714 ] Robert Kruszewski commented on SPARK-20952: --- Right, but how do I pass it downstream? >

[jira] [Commented] (SPARK-20954) DESCRIBE showing 1 extra row of "| # col_name | data_type | comment |"

[ https://issues.apache.org/jira/browse/SPARK-20954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043972#comment-16043972 ] Wenchen Fan commented on SPARK-20954: - oh sorry I misclicked... > DESCRIBE showing 1 extra row of "|

[jira] [Assigned] (SPARK-20954) DESCRIBE showing 1 extra row of "| # col_name | data_type | comment |"

[ https://issues.apache.org/jira/browse/SPARK-20954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-20954: --- Assignee: Dongjoon Hyun (was: Liang-Chi Hsieh) > DESCRIBE showing 1 extra row of "| #

[jira] [Comment Edited] (SPARK-20952) TaskContext should be an InheritableThreadLocal

[ https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043714#comment-16043714 ] Robert Kruszewski edited comment on SPARK-20952 at 6/9/17 12:28 AM:

[jira] [Updated] (SPARK-21027) Parallel One vs. Rest Classifier

[ https://issues.apache.org/jira/browse/SPARK-21027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Saini updated SPARK-21027: --- Description: Adding a class called ParOneVsRest that includes support for a parallelism parameter in

[jira] [Resolved] (SPARK-20863) Add metrics/instrumentation to LiveListenerBus

[ https://issues.apache.org/jira/browse/SPARK-20863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20863. - Resolution: Fixed Fix Version/s: 2.3.0 > Add metrics/instrumentation to LiveListenerBus >

[jira] [Commented] (SPARK-20954) DESCRIBE showing 1 extra row of "| # col_name | data_type | comment |"

[ https://issues.apache.org/jira/browse/SPARK-20954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043700#comment-16043700 ] Apache Spark commented on SPARK-20954: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-20952) TaskContext should be an InheritableThreadLocal

[ https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043732#comment-16043732 ] Shixiong Zhu commented on SPARK-20952: -- For `ParquetFileFormat#readFootersInParallel`, I would

[jira] [Comment Edited] (SPARK-20952) TaskContext should be an InheritableThreadLocal

[ https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043714#comment-16043714 ] Robert Kruszewski edited comment on SPARK-20952 at 6/9/17 2:13 AM: ---

[jira] [Comment Edited] (SPARK-20952) TaskContext should be an InheritableThreadLocal

[ https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043714#comment-16043714 ] Robert Kruszewski edited comment on SPARK-20952 at 6/9/17 2:12 AM: ---

[jira] [Commented] (SPARK-21001) Staging folders from Hive table are not being cleared.

[ https://issues.apache.org/jira/browse/SPARK-21001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043869#comment-16043869 ] Liang-Chi Hsieh commented on SPARK-21001: - No, I mean the current 2.0 branch in git. I think

[jira] [Commented] (SPARK-20954) DESCRIBE showing 1 extra row of "| # col_name | data_type | comment |"

[ https://issues.apache.org/jira/browse/SPARK-20954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043948#comment-16043948 ] Dongjoon Hyun commented on SPARK-20954: --- Hi, Wenchen. I'm Dongjoon. :) > DESCRIBE showing 1 extra

[jira] [Commented] (SPARK-20954) DESCRIBE showing 1 extra row of "| # col_name | data_type | comment |"

[ https://issues.apache.org/jira/browse/SPARK-20954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043973#comment-16043973 ] Dongjoon Hyun commented on SPARK-20954: --- ^^ > DESCRIBE showing 1 extra row of "| # col_name |

[jira] [Commented] (SPARK-20952) TaskContext should be an InheritableThreadLocal

[ https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043655#comment-16043655 ] Shixiong Zhu commented on SPARK-20952: -- If TaskContext is not inheritable, we can always find a way

[jira] [Commented] (SPARK-20952) TaskContext should be an InheritableThreadLocal

[ https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043708#comment-16043708 ] Shixiong Zhu commented on SPARK-20952: -- Why it needs TaskContext? > TaskContext should be an

[jira] [Updated] (SPARK-21027) Parallel One vs. Rest Classifier

[ https://issues.apache.org/jira/browse/SPARK-21027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Saini updated SPARK-21027: --- Description: Adding a class called ParOneVsRest that includes support for a parallelism parameter in

[jira] [Created] (SPARK-21028) Parallel One vs. Rest Classifier Scala

Ajay Saini created SPARK-21028: -- Summary: Parallel One vs. Rest Classifier Scala Key: SPARK-21028 URL: https://issues.apache.org/jira/browse/SPARK-21028 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-18075) UDF doesn't work on non-local spark

[ https://issues.apache.org/jira/browse/SPARK-18075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043778#comment-16043778 ] Wenchen Fan commented on SPARK-18075: - for development/testing, you can special the spark master as

[jira] [Resolved] (SPARK-20954) DESCRIBE showing 1 extra row of "| # col_name | data_type | comment |"

[ https://issues.apache.org/jira/browse/SPARK-20954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20954. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 18245

[jira] [Commented] (SPARK-20511) SparkR 2.2 QA: Check for new R APIs requiring example code

[ https://issues.apache.org/jira/browse/SPARK-20511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043894#comment-16043894 ] Felix Cheung commented on SPARK-20511: -- credit to SPARK-20208 SPARK-20849 SPARK-20477 SPARK-20478

[jira] [Commented] (SPARK-20513) Update SparkR website for 2.2

[ https://issues.apache.org/jira/browse/SPARK-20513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043892#comment-16043892 ] Felix Cheung commented on SPARK-20513: -- right, I don't think there's a site for R

[jira] [Commented] (SPARK-20952) TaskContext should be an InheritableThreadLocal

[ https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043694#comment-16043694 ] Shixiong Zhu commented on SPARK-20952: -- [~robert3005] could you show me your codes? Are you

[jira] [Commented] (SPARK-20952) TaskContext should be an InheritableThreadLocal

[ https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043710#comment-16043710 ] Shixiong Zhu commented on SPARK-20952: -- Although I don't know what you plan to do, you can save the

[jira] [Commented] (SPARK-20952) TaskContext should be an InheritableThreadLocal

[ https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043712#comment-16043712 ] Robert Kruszewski commented on SPARK-20952: --- It doesn't but things underneath it do. It's weird

[jira] [Created] (SPARK-21027) Parallel One vs. Rest Classifier

Ajay Saini created SPARK-21027: -- Summary: Parallel One vs. Rest Classifier Key: SPARK-21027 URL: https://issues.apache.org/jira/browse/SPARK-21027 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-20510) SparkR 2.2 QA: Update user guide for new features & APIs

[ https://issues.apache.org/jira/browse/SPARK-20510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043895#comment-16043895 ] Felix Cheung commented on SPARK-20510: -- credit to SPARK-20208 SPARK-20849 SPARK-20477 SPARK-20478

[jira] [Commented] (SPARK-20589) Allow limiting task concurrency per stage

[ https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043877#comment-16043877 ] Fei Shao commented on SPARK-20589: -- Tasks are assigned to executors. If we set the number of executors

[jira] [Assigned] (SPARK-20954) DESCRIBE showing 1 extra row of "| # col_name | data_type | comment |"

[ https://issues.apache.org/jira/browse/SPARK-20954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-20954: --- Assignee: Liang-Chi Hsieh > DESCRIBE showing 1 extra row of "| # col_name | data_type |

[jira] [Created] (SPARK-21029) All StreamingQuery should be stopped when the SparkSession is stopped

Felix Cheung created SPARK-21029: Summary: All StreamingQuery should be stopped when the SparkSession is stopped Key: SPARK-21029 URL: https://issues.apache.org/jira/browse/SPARK-21029 Project: Spark

[jira] [Commented] (SPARK-20952) TaskContext should be an InheritableThreadLocal

[ https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043704#comment-16043704 ] Robert Kruszewski commented on SPARK-20952: --- No modifications, it's this code

[jira] [Assigned] (SPARK-13933) hadoop-2.7 profile's curator version should be 2.7.1

[ https://issues.apache.org/jira/browse/SPARK-13933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13933: Assignee: Apache Spark > hadoop-2.7 profile's curator version should be 2.7.1 >

[jira] [Assigned] (SPARK-13933) hadoop-2.7 profile's curator version should be 2.7.1

[ https://issues.apache.org/jira/browse/SPARK-13933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13933: Assignee: (was: Apache Spark) > hadoop-2.7 profile's curator version should be 2.7.1

[jira] [Commented] (SPARK-13933) hadoop-2.7 profile's curator version should be 2.7.1

[ https://issues.apache.org/jira/browse/SPARK-13933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043748#comment-16043748 ] Apache Spark commented on SPARK-13933: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-20952) TaskContext should be an InheritableThreadLocal

[ https://issues.apache.org/jira/browse/SPARK-20952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043669#comment-16043669 ] Robert Kruszewski commented on SPARK-20952: --- I am not really attached to the solution. Would be

[jira] [Created] (SPARK-21030) extend hint syntax to support any expression for Python and R

Felix Cheung created SPARK-21030: Summary: extend hint syntax to support any expression for Python and R Key: SPARK-21030 URL: https://issues.apache.org/jira/browse/SPARK-21030 Project: Spark

[jira] [Updated] (SPARK-18057) Update structured streaming kafka from 10.0.1 to 10.2.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18057: -- Target Version/s: 2.3.0 (was: 2.2.0) > Update structured streaming kafka from 10.0.1 to 10.2.0 >

[jira] [Updated] (SPARK-19522) --executor-memory flag doesn't work in local-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-19522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-19522: -- Target Version/s: (was: 2.0.3, 2.1.2, 2.2.0) > --executor-memory flag doesn't work in local-cluster

[jira] [Commented] (SPARK-17237) DataFrame fill after pivot causing org.apache.spark.sql.AnalysisException

[ https://issues.apache.org/jira/browse/SPARK-17237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042513#comment-16042513 ] Alberto Fernández commented on SPARK-17237: --- Hi there, thank you for your thorough answer. I

[jira] [Updated] (SPARK-21021) Reading partitioned parquet does not respect specified schema column order

[ https://issues.apache.org/jira/browse/SPARK-21021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michel Lemay updated SPARK-21021: - Description: When reading back a partitioned parquet folder, column order gets messed up.

[jira] [Commented] (SPARK-17237) DataFrame fill after pivot causing org.apache.spark.sql.AnalysisException

[ https://issues.apache.org/jira/browse/SPARK-17237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042713#comment-16042713 ] Takeshi Yamamuro commented on SPARK-17237: -- sorry for confusing you, but I originally mean

[jira] [Updated] (SPARK-21022) RDD.foreach swallows exceptions

[ https://issues.apache.org/jira/browse/SPARK-21022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Woodbury updated SPARK-21022: --- Summary: RDD.foreach swallows exceptions (was: foreach swallows exceptions) > RDD.foreach

[jira] [Updated] (SPARK-21022) foreach swallows exceptions

[ https://issues.apache.org/jira/browse/SPARK-21022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Woodbury updated SPARK-21022: --- Description: A `RDD.foreach` or `RDD.foreachPartition` call will swallow Exceptions thrown

[jira] [Updated] (SPARK-20984) Reading back from ORC format gives error on big endian systems.

[ https://issues.apache.org/jira/browse/SPARK-20984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende updated SPARK-20984: Labels: big-endian (was: ) > Reading back from ORC format gives error on big endian

[jira] [Created] (SPARK-21022) foreach swallows exceptions

Colin Woodbury created SPARK-21022: -- Summary: foreach swallows exceptions Key: SPARK-21022 URL: https://issues.apache.org/jira/browse/SPARK-21022 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-13736) Big-Endian plataform issues

[ https://issues.apache.org/jira/browse/SPARK-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende resolved SPARK-13736. - Resolution: Invalid We are using the big-endian label to track platform related issues.

[jira] [Comment Edited] (SPARK-20896) spark executor get java.lang.ClassCastException when trigger two job at same time

[ https://issues.apache.org/jira/browse/SPARK-20896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036462#comment-16036462 ] poseidon edited comment on SPARK-20896 at 6/8/17 10:59 AM: --- Sorry for the error

[jira] [Updated] (SPARK-21016) Improve code fault tolerance for converting string to number

[ https://issues.apache.org/jira/browse/SPARK-21016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian updated SPARK-21016: Description: Converting string to number(int, long or double), if the string has a space before or

[jira] [Resolved] (SPARK-20510) SparkR 2.2 QA: Update user guide for new features & APIs

[ https://issues.apache.org/jira/browse/SPARK-20510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20510. --- Resolution: Done Felix indicated that he believes these are done. > SparkR 2.2 QA: Update user

[jira] [Resolved] (SPARK-20508) Spark R 2.2 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-20508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20508. --- Resolution: Done Felix indicated that he believes these are done. > Spark R 2.2 QA umbrella >

[jira] [Commented] (SPARK-21016) Improve code fault tolerance for converting string to number

[ https://issues.apache.org/jira/browse/SPARK-21016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042505#comment-16042505 ] liuxian commented on SPARK-21016: - Converting string to number(int, long or double), if the string has a

[jira] [Created] (SPARK-21021) Reading partitioned parquet does not respect specified schema column order

Michel Lemay created SPARK-21021: Summary: Reading partitioned parquet does not respect specified schema column order Key: SPARK-21021 URL: https://issues.apache.org/jira/browse/SPARK-21021 Project:

[jira] [Commented] (SPARK-20896) spark executor get java.lang.ClassCastException when trigger two job at same time

[ https://issues.apache.org/jira/browse/SPARK-20896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042511#comment-16042511 ] Sean Owen commented on SPARK-20896: --- You can run multiple jobs concurrently in any Spark app. I'm not

[jira] [Resolved] (SPARK-21020) How to implement custom input source for creating streaming DataFrames?

[ https://issues.apache.org/jira/browse/SPARK-21020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21020. --- Resolution: Invalid Please use the mailing list > How to implement custom input source for creating

  1   2   >