[jira] [Created] (SPARK-21878) Create SQLMetricsTestUtils

Xiao Li created SPARK-21878: --- Summary: Create SQLMetricsTestUtils Key: SPARK-21878 URL: https://issues.apache.org/jira/browse/SPARK-21878 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-20313) Possible lack of join optimization when partitions are in the join condition

[ https://issues.apache.org/jira/browse/SPARK-20313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148463#comment-16148463 ] Tejas Patil commented on SPARK-20313: - I tried to replicate what you shared in the jira but dont see

[jira] [Resolved] (SPARK-21583) Create a ColumnarBatch with ArrowColumnVectors for row based iteration

[ https://issues.apache.org/jira/browse/SPARK-21583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-21583. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18787

[jira] [Assigned] (SPARK-21583) Create a ColumnarBatch with ArrowColumnVectors for row based iteration

[ https://issues.apache.org/jira/browse/SPARK-21583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-21583: - Assignee: Bryan Cutler > Create a ColumnarBatch with ArrowColumnVectors for row based

[jira] [Assigned] (SPARK-21534) PickleException when creating dataframe from python row with empty bytearray

[ https://issues.apache.org/jira/browse/SPARK-21534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-21534: Assignee: Liang-Chi Hsieh > PickleException when creating dataframe from python row with

[jira] [Resolved] (SPARK-21534) PickleException when creating dataframe from python row with empty bytearray

[ https://issues.apache.org/jira/browse/SPARK-21534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21534. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19085

[jira] [Commented] (SPARK-16854) mapWithState Support for Python

[ https://issues.apache.org/jira/browse/SPARK-16854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148343#comment-16148343 ] Radek Ostrowski commented on SPARK-16854: - +1 > mapWithState Support for Python >

[jira] [Commented] (SPARK-11574) Spark should support StatsD sink out of box

[ https://issues.apache.org/jira/browse/SPARK-11574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148333#comment-16148333 ] Saisai Shao commented on SPARK-11574: - Maybe it is my permission issue, will ask PMC to handle it. >

[jira] [Commented] (SPARK-11574) Spark should support StatsD sink out of box

[ https://issues.apache.org/jira/browse/SPARK-11574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148328#comment-16148328 ] Xiaofeng Lin commented on SPARK-11574: -- [~jerryshao], yes my JIRA username is still active. It's

[jira] [Assigned] (SPARK-17321) YARN shuffle service should use good disk from yarn.nodemanager.local-dirs

[ https://issues.apache.org/jira/browse/SPARK-17321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-17321: --- Assignee: Saisai Shao > YARN shuffle service should use good disk from

[jira] [Commented] (SPARK-11574) Spark should support StatsD sink out of box

[ https://issues.apache.org/jira/browse/SPARK-11574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148319#comment-16148319 ] Hyukjin Kwon commented on SPARK-11574: -- I can't assign the ID too and I met this issue too -

[jira] [Resolved] (SPARK-17321) YARN shuffle service should use good disk from yarn.nodemanager.local-dirs

[ https://issues.apache.org/jira/browse/SPARK-17321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-17321. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19032

[jira] [Commented] (SPARK-11574) Spark should support StatsD sink out of box

[ https://issues.apache.org/jira/browse/SPARK-11574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148292#comment-16148292 ] Saisai Shao commented on SPARK-11574: - Hi Xiaofeng, is your JIRA username still available, I cannot

[jira] [Resolved] (SPARK-11574) Spark should support StatsD sink out of box

[ https://issues.apache.org/jira/browse/SPARK-11574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-11574. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 9518

[jira] [Assigned] (SPARK-21877) Windows command script can not handle quotes in parameter

[ https://issues.apache.org/jira/browse/SPARK-21877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21877: Assignee: Apache Spark > Windows command script can not handle quotes in parameter >

[jira] [Assigned] (SPARK-21877) Windows command script can not handle quotes in parameter

[ https://issues.apache.org/jira/browse/SPARK-21877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21877: Assignee: (was: Apache Spark) > Windows command script can not handle quotes in

[jira] [Commented] (SPARK-21877) Windows command script can not handle quotes in parameter

[ https://issues.apache.org/jira/browse/SPARK-21877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148278#comment-16148278 ] Apache Spark commented on SPARK-21877: -- User 'minixalpha' has created a pull request for this issue:

[jira] [Created] (SPARK-21877) Windows command script can not handle quotes in parameter

Xiaokai Zhao created SPARK-21877: Summary: Windows command script can not handle quotes in parameter Key: SPARK-21877 URL: https://issues.apache.org/jira/browse/SPARK-21877 Project: Spark

[jira] [Commented] (SPARK-21866) SPIP: Image support in Spark

[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148268#comment-16148268 ] Joseph K. Bradley commented on SPARK-21866: --- It's a valid question, but overall, I'd support

[jira] [Assigned] (SPARK-21875) Jenkins passes Java code that violates ./dev/lint-java

[ https://issues.apache.org/jira/browse/SPARK-21875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-21875: Assignee: Andrew Ash > Jenkins passes Java code that violates ./dev/lint-java >

[jira] [Resolved] (SPARK-21875) Jenkins passes Java code that violates ./dev/lint-java

[ https://issues.apache.org/jira/browse/SPARK-21875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21875. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19088

[jira] [Comment Edited] (SPARK-20928) Continuous Processing Mode for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148227#comment-16148227 ] Michael Armbrust edited comment on SPARK-20928 at 8/30/17 11:52 PM:

[jira] [Commented] (SPARK-20928) Continuous Processing Mode for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148227#comment-16148227 ] Michael Armbrust commented on SPARK-20928: -- Hey everyone, thanks for your interest in this

[jira] [Resolved] (SPARK-21839) Support SQL config for ORC compression

[ https://issues.apache.org/jira/browse/SPARK-21839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21839. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19055

[jira] [Assigned] (SPARK-21839) Support SQL config for ORC compression

[ https://issues.apache.org/jira/browse/SPARK-21839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-21839: Assignee: Dongjoon Hyun > Support SQL config for ORC compression >

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148093#comment-16148093 ] Marcelo Vanzin commented on SPARK-18085: [~jincheng] do you have code that can reproduce that?

[jira] [Commented] (SPARK-21867) Support async spilling in UnsafeShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-21867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148090#comment-16148090 ] Reynold Xin commented on SPARK-21867: - This makes sense. The devil is in the details though (e.g. how

[jira] [Updated] (SPARK-21866) SPIP: Image support in Spark

[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-21866: -- Target Version/s: (was: 2.3.0) > SPIP: Image support in Spark >

[jira] [Resolved] (SPARK-21834) Incorrect executor request in case of dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-21834. Resolution: Fixed Assignee: Sital Kedia Fix Version/s: 2.3.0

[jira] [Created] (SPARK-21876) Idling Executors that never handled any tasks are not cleared from BlockManager after being removed

Julie Zhang created SPARK-21876: --- Summary: Idling Executors that never handled any tasks are not cleared from BlockManager after being removed Key: SPARK-21876 URL: https://issues.apache.org/jira/browse/SPARK-21876

[jira] [Commented] (SPARK-21728) Allow SparkSubmit to use logging

[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147987#comment-16147987 ] Apache Spark commented on SPARK-21728: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21728) Allow SparkSubmit to use logging

[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21728: Assignee: Apache Spark (was: Marcelo Vanzin) > Allow SparkSubmit to use logging >

[jira] [Assigned] (SPARK-21728) Allow SparkSubmit to use logging

[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21728: Assignee: Marcelo Vanzin (was: Apache Spark) > Allow SparkSubmit to use logging >

[jira] [Assigned] (SPARK-21875) Jenkins passes Java code that violates ./dev/lint-java

[ https://issues.apache.org/jira/browse/SPARK-21875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21875: Assignee: (was: Apache Spark) > Jenkins passes Java code that violates

[jira] [Commented] (SPARK-21875) Jenkins passes Java code that violates ./dev/lint-java

[ https://issues.apache.org/jira/browse/SPARK-21875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147976#comment-16147976 ] Andrew Ash commented on SPARK-21875: I'd be interested in more details on why it can't be run in the

[jira] [Assigned] (SPARK-21875) Jenkins passes Java code that violates ./dev/lint-java

[ https://issues.apache.org/jira/browse/SPARK-21875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21875: Assignee: Apache Spark > Jenkins passes Java code that violates ./dev/lint-java >

[jira] [Commented] (SPARK-21875) Jenkins passes Java code that violates ./dev/lint-java

[ https://issues.apache.org/jira/browse/SPARK-21875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147975#comment-16147975 ] Apache Spark commented on SPARK-21875: -- User 'ash211' has created a pull request for this issue:

[jira] [Updated] (SPARK-21728) Allow SparkSubmit to use logging

[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-21728: Attachment: logging.patch sparksubmit.patch > Allow SparkSubmit to use

[jira] [Commented] (SPARK-21728) Allow SparkSubmit to use logging

[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147957#comment-16147957 ] Jacek Laskowski commented on SPARK-21728: - After I changed your change, I could see the logs

[jira] [Reopened] (SPARK-21728) Allow SparkSubmit to use logging

[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reopened SPARK-21728: > Allow SparkSubmit to use logging > > > Key:

[jira] [Commented] (SPARK-21728) Allow SparkSubmit to use logging

[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147944#comment-16147944 ] Marcelo Vanzin commented on SPARK-21728: Ok, with your file and the streaming example from Spark

[jira] [Updated] (SPARK-21714) SparkSubmit in Yarn Client mode downloads remote files and then reuploads them again

[ https://issues.apache.org/jira/browse/SPARK-21714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-21714: --- Fix Version/s: 2.2.1 > SparkSubmit in Yarn Client mode downloads remote files and then

[jira] [Updated] (SPARK-21875) Jenkins passes Java code that violates ./dev/lint-java

[ https://issues.apache.org/jira/browse/SPARK-21875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21875: -- Priority: Trivial (was: Major) Issue Type: Improvement (was: Bug) (Certianly not a Major Bug)

[jira] [Created] (SPARK-21875) Jenkins passes Java code that violates ./dev/lint-java

Andrew Ash created SPARK-21875: -- Summary: Jenkins passes Java code that violates ./dev/lint-java Key: SPARK-21875 URL: https://issues.apache.org/jira/browse/SPARK-21875 Project: Spark Issue

[jira] [Commented] (SPARK-21841) Spark SQL doesn't pick up column added in hive when table created with saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-21841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147873#comment-16147873 ] Marcelo Vanzin commented on SPARK-21841: Good to know there's a way to say "I want a proper Hive

[jira] [Commented] (SPARK-21728) Allow SparkSubmit to use logging

[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147840#comment-16147840 ] Jacek Laskowski commented on SPARK-21728: - The idea behind the custom {{conf/log4j.properties}}

[jira] [Updated] (SPARK-21865) simplify the distribution semantic of Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-21865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-21865: Summary: simplify the distribution semantic of Spark SQL (was: remove

[jira] [Commented] (SPARK-21728) Allow SparkSubmit to use logging

[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147655#comment-16147655 ] Marcelo Vanzin commented on SPARK-21728: Can you share your whole command line? I just added

[jira] [Commented] (SPARK-21728) Allow SparkSubmit to use logging

[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147643#comment-16147643 ] Jacek Laskowski commented on SPARK-21728: - Thanks [~vanzin] for the prompt response! I'm stuck

[jira] [Commented] (SPARK-21728) Allow SparkSubmit to use logging

[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147617#comment-16147617 ] Marcelo Vanzin commented on SPARK-21728: What is user-visible here (other than potentially some

[jira] [Commented] (SPARK-21055) Support grouping__id

[ https://issues.apache.org/jira/browse/SPARK-21055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147433#comment-16147433 ] Apache Spark commented on SPARK-21055: -- User 'cenyuhai' has created a pull request for this issue:

[jira] [Commented] (SPARK-21874) Support changing database when rename table.

[ https://issues.apache.org/jira/browse/SPARK-21874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147429#comment-16147429 ] Apache Spark commented on SPARK-21874: -- User 'jinxing64' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21874) Support changing database when rename table.

[ https://issues.apache.org/jira/browse/SPARK-21874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21874: Assignee: (was: Apache Spark) > Support changing database when rename table. >

[jira] [Assigned] (SPARK-21874) Support changing database when rename table.

[ https://issues.apache.org/jira/browse/SPARK-21874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21874: Assignee: Apache Spark > Support changing database when rename table. >

[jira] [Commented] (SPARK-21453) Cached Kafka consumer may be closed too early

[ https://issues.apache.org/jira/browse/SPARK-21453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147419#comment-16147419 ] Pablo Panero commented on SPARK-21453: -- [~zsxwing] Failed again but not even there is conext around

[jira] [Created] (SPARK-21874) Support changing database when rename table.

jin xing created SPARK-21874: Summary: Support changing database when rename table. Key: SPARK-21874 URL: https://issues.apache.org/jira/browse/SPARK-21874 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-18859) Catalyst codegen does not mark column as nullable when it should. Causes NPE

[ https://issues.apache.org/jira/browse/SPARK-18859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147393#comment-16147393 ] Jonas Fonseca commented on SPARK-18859: --- For postgresql using {{nullif}} can be used as a

[jira] [Resolved] (SPARK-21469) Add doc and example for FeatureHasher

[ https://issues.apache.org/jira/browse/SPARK-21469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath resolved SPARK-21469. Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19024

[jira] [Assigned] (SPARK-21469) Add doc and example for FeatureHasher

[ https://issues.apache.org/jira/browse/SPARK-21469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath reassigned SPARK-21469: -- Assignee: Bryan Cutler > Add doc and example for FeatureHasher >

[jira] [Comment Edited] (SPARK-18350) Support session local timezone

[ https://issues.apache.org/jira/browse/SPARK-18350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136567#comment-16136567 ] Vinayak edited comment on SPARK-18350 at 8/30/17 12:56 PM: --- [~ueshin] I have

[jira] [Comment Edited] (SPARK-18350) Support session local timezone

[ https://issues.apache.org/jira/browse/SPARK-18350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136567#comment-16136567 ] Vinayak edited comment on SPARK-18350 at 8/30/17 12:55 PM: --- [~ueshin] I have

[jira] [Assigned] (SPARK-21764) Tests failures on Windows: resources not being closed and incorrect paths

[ https://issues.apache.org/jira/browse/SPARK-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-21764: Assignee: Hyukjin Kwon > Tests failures on Windows: resources not being closed and

[jira] [Resolved] (SPARK-21764) Tests failures on Windows: resources not being closed and incorrect paths

[ https://issues.apache.org/jira/browse/SPARK-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21764. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18971

[jira] [Resolved] (SPARK-16643) When doing Shuffle, report "java.io.FileNotFoundException"

[ https://issues.apache.org/jira/browse/SPARK-16643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16643. --- Resolution: Won't Fix If this only affects 1.5/1.6, I think it'd be WontFix at this point. Update to

[jira] [Commented] (SPARK-16643) When doing Shuffle, report "java.io.FileNotFoundException"

[ https://issues.apache.org/jira/browse/SPARK-16643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147139#comment-16147139 ] Sajith Dimal commented on SPARK-16643: -- We observed this in spark version 1.6.2 as well, please find

[jira] [Commented] (SPARK-21728) Allow SparkSubmit to use logging

[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147086#comment-16147086 ] Jacek Laskowski commented on SPARK-21728: - Thanks [~sowen]. I'll label it as such when I know if

[jira] [Resolved] (SPARK-21806) BinaryClassificationMetrics pr(): first point (0.0, 1.0) is misleading

[ https://issues.apache.org/jira/browse/SPARK-21806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21806. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19038

[jira] [Commented] (SPARK-21728) Allow SparkSubmit to use logging

[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147037#comment-16147037 ] Sean Owen commented on SPARK-21728: --- You can label such issues with 'releasenotes'. I consider that for

[jira] [Assigned] (SPARK-21806) BinaryClassificationMetrics pr(): first point (0.0, 1.0) is misleading

[ https://issues.apache.org/jira/browse/SPARK-21806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-21806: - Assignee: Sean Owen Labels: releasenotes (was: ) > BinaryClassificationMetrics pr():

[jira] [Resolved] (SPARK-21829) Enable config to permanently blacklist a list of nodes

[ https://issues.apache.org/jira/browse/SPARK-21829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21829. --- Resolution: Won't Fix > Enable config to permanently blacklist a list of nodes >

[jira] [Resolved] (SPARK-21873) CachedKafkaConsumer throws NonLocalReturnControl during fetching from Kafka

[ https://issues.apache.org/jira/browse/SPARK-21873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21873. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19059

[jira] [Assigned] (SPARK-21873) CachedKafkaConsumer throws NonLocalReturnControl during fetching from Kafka

[ https://issues.apache.org/jira/browse/SPARK-21873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-21873: - Assignee: Yuval Itzchakov Target Version/s: (was: 2.2.1) > CachedKafkaConsumer

[jira] [Updated] (SPARK-21873) CachedKafkaConsumer throws NonLocalReturnControl during fetching from Kafka

[ https://issues.apache.org/jira/browse/SPARK-21873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21873: -- Issue Type: Improvement (was: Bug) > CachedKafkaConsumer throws NonLocalReturnControl during fetching

[jira] [Assigned] (SPARK-21534) PickleException when creating dataframe from python row with empty bytearray

[ https://issues.apache.org/jira/browse/SPARK-21534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21534: Assignee: (was: Apache Spark) > PickleException when creating dataframe from python

[jira] [Commented] (SPARK-21534) PickleException when creating dataframe from python row with empty bytearray

[ https://issues.apache.org/jira/browse/SPARK-21534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146925#comment-16146925 ] Apache Spark commented on SPARK-21534: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21534) PickleException when creating dataframe from python row with empty bytearray

[ https://issues.apache.org/jira/browse/SPARK-21534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21534: Assignee: Apache Spark > PickleException when creating dataframe from python row with

[jira] [Updated] (SPARK-21873) CachedKafkaConsumer throws NonLocalReturnControl during fetching from Kafka

[ https://issues.apache.org/jira/browse/SPARK-21873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuval Itzchakov updated SPARK-21873: Description: In Scala, using `return` inside a function causes a `NonLocalReturnControl`

[jira] [Assigned] (SPARK-21873) CachedKafkaConsumer throws NonLocalReturnControl during fetching from Kafka

[ https://issues.apache.org/jira/browse/SPARK-21873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21873: Assignee: (was: Apache Spark) > CachedKafkaConsumer throws NonLocalReturnControl

[jira] [Assigned] (SPARK-21873) CachedKafkaConsumer throws NonLocalReturnControl during fetching from Kafka

[ https://issues.apache.org/jira/browse/SPARK-21873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21873: Assignee: Apache Spark > CachedKafkaConsumer throws NonLocalReturnControl during fetching

[jira] [Commented] (SPARK-21873) CachedKafkaConsumer throws NonLocalReturnControl during fetching from Kafka

[ https://issues.apache.org/jira/browse/SPARK-21873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146901#comment-16146901 ] Apache Spark commented on SPARK-21873: -- User 'YuvalItzchakov' has created a pull request for this

[jira] [Updated] (SPARK-21254) History UI: Taking over 1 minute for initial page display

[ https://issues.apache.org/jira/browse/SPARK-21254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21254: -- Fix Version/s: 2.2.1 > History UI: Taking over 1 minute for initial page display >

[jira] [Created] (SPARK-21873) CachedKafkaConsumer throws NonLocalReturnControl during fetching from Kafka

Yuval Itzchakov created SPARK-21873: --- Summary: CachedKafkaConsumer throws NonLocalReturnControl during fetching from Kafka Key: SPARK-21873 URL: https://issues.apache.org/jira/browse/SPARK-21873

[jira] [Resolved] (SPARK-21872) Is job duration value of Spark Jobs page on Web UI correct?

[ https://issues.apache.org/jira/browse/SPARK-21872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21872. --- Resolution: Not A Problem (Questions belong on the mailing list to start.) Yes, because in general

[jira] [Commented] (SPARK-21869) A cached Kafka producer should not be closed if any task is using it.

[ https://issues.apache.org/jira/browse/SPARK-21869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146889#comment-16146889 ] Prashant Sharma commented on SPARK-21869: - Yes, looking at it. > A cached Kafka producer should

[jira] [Commented] (SPARK-21728) Allow SparkSubmit to use logging

[ https://issues.apache.org/jira/browse/SPARK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146780#comment-16146780 ] Jacek Laskowski commented on SPARK-21728: - I think the change is user-visible and therefore