[jira] [Commented] (SPARK-23488) Add other missing Catalog methods to Python API

[ https://issues.apache.org/jira/browse/SPARK-23488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372430#comment-16372430 ] Apache Spark commented on SPARK-23488: -- User 'drboyer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23488) Add other missing Catalog methods to Python API

[ https://issues.apache.org/jira/browse/SPARK-23488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23488: Assignee: Apache Spark > Add other missing Catalog methods to Python API >

[jira] [Assigned] (SPARK-23488) Add other missing Catalog methods to Python API

[ https://issues.apache.org/jira/browse/SPARK-23488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23488: Assignee: (was: Apache Spark) > Add other missing Catalog methods to Python API >

[jira] [Updated] (SPARK-23488) Add other missing Catalog methods to Python API

[ https://issues.apache.org/jira/browse/SPARK-23488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devin Boyer updated SPARK-23488: Target Version/s: (was: 2.2.2, 2.3.1) > Add other missing Catalog methods to Python API >

[jira] [Created] (SPARK-23488) Add other missing Catalog methods to Python API

Devin Boyer created SPARK-23488: --- Summary: Add other missing Catalog methods to Python API Key: SPARK-23488 URL: https://issues.apache.org/jira/browse/SPARK-23488 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-23475) The "stages" page doesn't show any completed stages

[ https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23475. - Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.3.0 > The "stages" page

[jira] [Commented] (SPARK-23390) Flaky Test Suite: FileBasedDataSourceSuite in Spark 2.3/hadoop 2.7

[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372360#comment-16372360 ] Liang-Chi Hsieh commented on SPARK-23390: - {{FileBasedDataSourceSuite}} seems still flaky.  

[jira] [Resolved] (SPARK-23404) When the underlying buffers are already direct, we should copy them to the heap memory

[ https://issues.apache.org/jira/browse/SPARK-23404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxian resolved SPARK-23404. - Resolution: Invalid > When the underlying buffers are already direct, we should copy them to the > heap

[jira] [Commented] (SPARK-23487) Fix the failure in spark-branch-2.2-lint

[ https://issues.apache.org/jira/browse/SPARK-23487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372337#comment-16372337 ] Xiao Li commented on SPARK-23487: - This should be introduced by

[jira] [Created] (SPARK-23487) Fix the failure in spark-branch-2.2-lint

Xiao Li created SPARK-23487: --- Summary: Fix the failure in spark-branch-2.2-lint Key: SPARK-23487 URL: https://issues.apache.org/jira/browse/SPARK-23487 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-23361) Driver restart fails if it happens after 7 days from app submission

[ https://issues.apache.org/jira/browse/SPARK-23361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372334#comment-16372334 ] Apache Spark commented on SPARK-23361: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23361) Driver restart fails if it happens after 7 days from app submission

[ https://issues.apache.org/jira/browse/SPARK-23361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23361: Assignee: Apache Spark > Driver restart fails if it happens after 7 days from app

[jira] [Assigned] (SPARK-23361) Driver restart fails if it happens after 7 days from app submission

[ https://issues.apache.org/jira/browse/SPARK-23361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23361: Assignee: (was: Apache Spark) > Driver restart fails if it happens after 7 days from

[jira] [Commented] (SPARK-23474) mapWithState + async operations = no checkpointing

[ https://issues.apache.org/jira/browse/SPARK-23474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372293#comment-16372293 ] Gabor Somogyi commented on SPARK-23474: --- [~DLanza] could you share your smallest example? My app

[jira] [Commented] (SPARK-22700) Bucketizer.transform incorrectly drops row containing NaN

[ https://issues.apache.org/jira/browse/SPARK-22700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372292#comment-16372292 ] Joseph K. Bradley commented on SPARK-22700: --- Resolved for branch-2.2 via

[jira] [Updated] (SPARK-22700) Bucketizer.transform incorrectly drops row containing NaN

[ https://issues.apache.org/jira/browse/SPARK-22700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-22700: -- Fix Version/s: 2.2.2 > Bucketizer.transform incorrectly drops row containing NaN >

[jira] [Commented] (SPARK-19737) New analysis rule for reporting unregistered functions without relying on relation resolution

[ https://issues.apache.org/jira/browse/SPARK-19737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372289#comment-16372289 ] Cheng Lian commented on SPARK-19737: [~LANDAIS Christophe], I filed SPARK-23486 for this. Should be

[jira] [Updated] (SPARK-23486) LookupFunctions should not check the same function name more than once

[ https://issues.apache.org/jira/browse/SPARK-23486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-23486: --- Labels: starter (was: ) > LookupFunctions should not check the same function name more than once >

[jira] [Commented] (SPARK-23486) LookupFunctions should not check the same function name more than once

[ https://issues.apache.org/jira/browse/SPARK-23486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372285#comment-16372285 ] Cheng Lian commented on SPARK-23486: Please refer to [this

[jira] [Created] (SPARK-23486) LookupFunctions should not check the same function name more than once

Cheng Lian created SPARK-23486: -- Summary: LookupFunctions should not check the same function name more than once Key: SPARK-23486 URL: https://issues.apache.org/jira/browse/SPARK-23486 Project: Spark

[jira] [Commented] (SPARK-23483) Feature parity for Python vs Scala APIs

[ https://issues.apache.org/jira/browse/SPARK-23483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372269#comment-16372269 ] Hyukjin Kwon commented on SPARK-23483: -- Sure. > Feature parity for Python vs Scala APIs >

[jira] [Updated] (SPARK-23476) Spark will not start in local mode with authentication on

[ https://issues.apache.org/jira/browse/SPARK-23476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-23476: -- Component/s: Spark Core > Spark will not start in local mode with authentication on >

[jira] [Updated] (SPARK-23475) The "stages" page doesn't show any completed stages

[ https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-23475: - Target Version/s: 2.3.0 > The "stages" page doesn't show any completed stages >

[jira] [Resolved] (SPARK-23481) The job page shows wrong stages when some of stages are evicted

[ https://issues.apache.org/jira/browse/SPARK-23481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-23481. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20654

[jira] [Resolved] (SPARK-23484) Fix possible race condition in KafkaContinuousReader

[ https://issues.apache.org/jira/browse/SPARK-23484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-23484. --- Resolution: Fixed Fix Version/s: 2.3.0 3.0.0 Issue resolved by

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 10.0.1 to 10.2.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372138#comment-16372138 ] Michael Armbrust commented on SPARK-18057: -- We generally tend towards "don't break things that

[jira] [Commented] (SPARK-23475) The "stages" page doesn't show any completed stages

[ https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372135#comment-16372135 ] Apache Spark commented on SPARK-23475: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Commented] (SPARK-23485) Kubernetes should support node blacklist

[ https://issues.apache.org/jira/browse/SPARK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372134#comment-16372134 ] Imran Rashid commented on SPARK-23485: -- Also related to SPARK-16630 ... if that is solved before

[jira] [Created] (SPARK-23485) Kubernetes should support node blacklist

Imran Rashid created SPARK-23485: Summary: Kubernetes should support node blacklist Key: SPARK-23485 URL: https://issues.apache.org/jira/browse/SPARK-23485 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-23484) Fix possible race condition in KafkaContinuousReader

[ https://issues.apache.org/jira/browse/SPARK-23484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23484: Assignee: Tathagata Das (was: Apache Spark) > Fix possible race condition in

[jira] [Commented] (SPARK-23484) Fix possible race condition in KafkaContinuousReader

[ https://issues.apache.org/jira/browse/SPARK-23484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372109#comment-16372109 ] Apache Spark commented on SPARK-23484: -- User 'tdas' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23484) Fix possible race condition in KafkaContinuousReader

[ https://issues.apache.org/jira/browse/SPARK-23484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23484: Assignee: Apache Spark (was: Tathagata Das) > Fix possible race condition in

[jira] [Created] (SPARK-23484) Fix possible race condition in KafkaContinuousReader

Tathagata Das created SPARK-23484: - Summary: Fix possible race condition in KafkaContinuousReader Key: SPARK-23484 URL: https://issues.apache.org/jira/browse/SPARK-23484 Project: Spark Issue

[jira] [Comment Edited] (SPARK-15526) Shade JPMML

[ https://issues.apache.org/jira/browse/SPARK-15526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372091#comment-16372091 ] Joseph K. Bradley edited comment on SPARK-15526 at 2/21/18 10:09 PM: -

[jira] [Issue Comment Deleted] (SPARK-15526) Shade JPMML

[ https://issues.apache.org/jira/browse/SPARK-15526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15526: -- Comment: was deleted (was: [~srowen] I just found that PMML is now listed as a

[jira] [Commented] (SPARK-15526) Shade JPMML

[ https://issues.apache.org/jira/browse/SPARK-15526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372091#comment-16372091 ] Joseph K. Bradley commented on SPARK-15526: --- [~srowen] I just found that PMML is now listed as

[jira] [Created] (SPARK-23482) R support for robust regression with Huber loss

Joseph K. Bradley created SPARK-23482: - Summary: R support for robust regression with Huber loss Key: SPARK-23482 URL: https://issues.apache.org/jira/browse/SPARK-23482 Project: Spark

[jira] [Commented] (SPARK-23427) spark.sql.autoBroadcastJoinThreshold causing OOM exception in the driver

[ https://issues.apache.org/jira/browse/SPARK-23427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372000#comment-16372000 ] Pratik Dhumal commented on SPARK-23427: --- Sorry for very late reply. I am facing that issue when

[jira] [Commented] (SPARK-23483) Feature parity for Python vs Scala APIs

[ https://issues.apache.org/jira/browse/SPARK-23483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371905#comment-16371905 ] Xiao Li commented on SPARK-23483: - [~hyukjin.kwon] [~bryanc] Could you lead this effort and help the

[jira] [Updated] (SPARK-23475) The "stages" page doesn't show any completed stages

[ https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-23475: - Attachment: (was: Screen Shot 2018-02-21 at 12.39.46 AM.png) > The "stages" page doesn't

[jira] [Assigned] (SPARK-23481) The job page shows wrong stages when some of stages are evicted

[ https://issues.apache.org/jira/browse/SPARK-23481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23481: Assignee: Apache Spark (was: Shixiong Zhu) > The job page shows wrong stages when some

[jira] [Commented] (SPARK-23481) The job page shows wrong stages when some of stages are evicted

[ https://issues.apache.org/jira/browse/SPARK-23481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371902#comment-16371902 ] Shixiong Zhu commented on SPARK-23481: -- [~vanzin] Yep. Here is the fix with a regression test:

[jira] [Created] (SPARK-23481) The job page shows wrong stages when some of stages are evicted

Shixiong Zhu created SPARK-23481: Summary: The job page shows wrong stages when some of stages are evicted Key: SPARK-23481 URL: https://issues.apache.org/jira/browse/SPARK-23481 Project: Spark

[jira] [Commented] (SPARK-23475) The "stages" page doesn't show any completed stages

[ https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371897#comment-16371897 ] Shixiong Zhu commented on SPARK-23475: -- The job page issue is a separated issue. Created SPARK-23481

[jira] [Commented] (SPARK-23481) The job page shows wrong stages when some of stages are evicted

[ https://issues.apache.org/jira/browse/SPARK-23481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371901#comment-16371901 ] Marcelo Vanzin commented on SPARK-23481: [~zsxwing] you assigned this to yourself so I suppose

[jira] [Commented] (SPARK-23459) Improve the error message when unknown column is specified in partition columns

[ https://issues.apache.org/jira/browse/SPARK-23459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371891#comment-16371891 ] Apache Spark commented on SPARK-23459: -- User 'kiszk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23459) Improve the error message when unknown column is specified in partition columns

[ https://issues.apache.org/jira/browse/SPARK-23459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23459: Assignee: (was: Apache Spark) > Improve the error message when unknown column is

[jira] [Resolved] (SPARK-23463) Filter operation fails to handle blank values and evicts rows that even satisfy the filtering condition

[ https://issues.apache.org/jira/browse/SPARK-23463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manan Bakshi resolved SPARK-23463. -- Resolution: Not A Problem > Filter operation fails to handle blank values and evicts rows that

[jira] [Updated] (SPARK-23481) The job page shows wrong stages when some of stages are evicted

[ https://issues.apache.org/jira/browse/SPARK-23481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-23481: - Description: Run "bin/spark-shell --conf spark.ui.retainedJobs=10 --conf

[jira] [Updated] (SPARK-23475) The "stages" page doesn't show any completed stages

[ https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-23475: - Description: Run "bin/spark-shell --conf spark.ui.retainedJobs=10 --conf

[jira] [Commented] (SPARK-23463) Filter operation fails to handle blank values and evicts rows that even satisfy the filtering condition

[ https://issues.apache.org/jira/browse/SPARK-23463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371864#comment-16371864 ] Manan Bakshi commented on SPARK-23463: -- I will go ahead and resolve this. Thanks!  > Filter

[jira] [Assigned] (SPARK-23481) The job page shows wrong stages when some of stages are evicted

[ https://issues.apache.org/jira/browse/SPARK-23481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23481: Assignee: Shixiong Zhu (was: Apache Spark) > The job page shows wrong stages when some

[jira] [Commented] (SPARK-23481) The job page shows wrong stages when some of stages are evicted

[ https://issues.apache.org/jira/browse/SPARK-23481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371904#comment-16371904 ] Apache Spark commented on SPARK-23481: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23459) Improve the error message when unknown column is specified in partition columns

[ https://issues.apache.org/jira/browse/SPARK-23459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23459: Assignee: Apache Spark > Improve the error message when unknown column is specified in

[jira] [Updated] (SPARK-23483) Feature parity for Python vs Scala APIs

[ https://issues.apache.org/jira/browse/SPARK-23483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-23483: Component/s: (was: SQL) PySpark > Feature parity for Python vs Scala APIs >

[jira] [Created] (SPARK-23483) Feature parity for Python vs Scala APIs

Xiao Li created SPARK-23483: --- Summary: Feature parity for Python vs Scala APIs Key: SPARK-23483 URL: https://issues.apache.org/jira/browse/SPARK-23483 Project: Spark Issue Type: Umbrella

[jira] [Updated] (SPARK-23481) The job page shows wrong stages when some of stages are evicted

[ https://issues.apache.org/jira/browse/SPARK-23481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-23481: - Description: Run "bin/spark-shell --conf spark.ui.retainedJobs=10 --conf

[jira] [Updated] (SPARK-23481) The job page shows wrong stages when some of stages are evicted

[ https://issues.apache.org/jira/browse/SPARK-23481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-23481: - Attachment: Screen Shot 2018-02-21 at 12.39.46 AM.png > The job page shows wrong stages when

[jira] [Commented] (SPARK-21302) history server WebUI show HTTP ERROR 500

[ https://issues.apache.org/jira/browse/SPARK-21302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371628#comment-16371628 ] HARIKRISHNAN Ck commented on SPARK-21302: - Spark Driver logs and RM logs should tell some

[jira] [Commented] (SPARK-23459) Improve the error message when unknown column is specified in partition columns

[ https://issues.apache.org/jira/browse/SPARK-23459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371474#comment-16371474 ] Kazuaki Ishizaki commented on SPARK-23459: -- I am working for this. > Improve the error message

[jira] [Commented] (SPARK-23476) Spark will not start in local mode with authentication on

[ https://issues.apache.org/jira/browse/SPARK-23476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371473#comment-16371473 ] Apache Spark commented on SPARK-23476: -- User 'gaborgsomogyi' has created a pull request for this

[jira] [Assigned] (SPARK-23476) Spark will not start in local mode with authentication on

[ https://issues.apache.org/jira/browse/SPARK-23476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23476: Assignee: Apache Spark > Spark will not start in local mode with authentication on >

[jira] [Assigned] (SPARK-23476) Spark will not start in local mode with authentication on

[ https://issues.apache.org/jira/browse/SPARK-23476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23476: Assignee: (was: Apache Spark) > Spark will not start in local mode with

[jira] [Created] (SPARK-23480) NullPointerException in AppendOnlyMap.growTable

Erik LaBianca created SPARK-23480: - Summary: NullPointerException in AppendOnlyMap.growTable Key: SPARK-23480 URL: https://issues.apache.org/jira/browse/SPARK-23480 Project: Spark Issue

[jira] [Assigned] (SPARK-23475) The "stages" page doesn't show any completed stages

[ https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23475: Assignee: (was: Apache Spark) > The "stages" page doesn't show any completed stages >

[jira] [Assigned] (SPARK-23475) The "stages" page doesn't show any completed stages

[ https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23475: Assignee: Apache Spark > The "stages" page doesn't show any completed stages >

[jira] [Commented] (SPARK-23475) The "stages" page doesn't show any completed stages

[ https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371378#comment-16371378 ] Apache Spark commented on SPARK-23475: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Commented] (SPARK-19737) New analysis rule for reporting unregistered functions without relying on relation resolution

[ https://issues.apache.org/jira/browse/SPARK-19737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371377#comment-16371377 ] LANDAIS Christophe commented on SPARK-19737: Hello, Migrating our application from spark

[jira] [Commented] (SPARK-23475) The "stages" page doesn't show any completed stages

[ https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371347#comment-16371347 ] Marco Gaido commented on SPARK-23475: - The reason of this behavior is that SKIPPED stages, which were

[jira] [Comment Edited] (SPARK-23473) spark.catalog.listTables error when database name starts with a number

[ https://issues.apache.org/jira/browse/SPARK-23473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371279#comment-16371279 ] Marco Gaido edited comment on SPARK-23473 at 2/21/18 11:53 AM: --- Your stack

[jira] [Commented] (SPARK-23473) spark.catalog.listTables error when database name starts with a number

[ https://issues.apache.org/jira/browse/SPARK-23473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371279#comment-16371279 ] Marco Gaido commented on SPARK-23473: - Your stack error points out which is the real issue: {code}

[jira] [Resolved] (SPARK-23473) spark.catalog.listTables error when database name starts with a number

[ https://issues.apache.org/jira/browse/SPARK-23473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved SPARK-23473. - Resolution: Invalid > spark.catalog.listTables error when database name starts with a number >

[jira] [Commented] (SPARK-23477) Misleading exception message when union fails due to metadata

[ https://issues.apache.org/jira/browse/SPARK-23477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371278#comment-16371278 ] Marco Gaido commented on SPARK-23477: - [~kretes] yes. I think we can close this, do you agree? >

[jira] [Updated] (SPARK-23478) Inconsistent behaviour of union when columns have conflicting metadata

[ https://issues.apache.org/jira/browse/SPARK-23478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomasz Bartczak updated SPARK-23478: Priority: Minor (was: Major) > Inconsistent behaviour of union when columns have

[jira] [Commented] (SPARK-23477) Misleading exception message when union fails due to metadata

[ https://issues.apache.org/jira/browse/SPARK-23477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371271#comment-16371271 ] Tomasz Bartczak commented on SPARK-23477: - So what is the effect on master? no exception at all

[jira] [Updated] (SPARK-23479) struct() cannot be combined with alias(metadata={})

[ https://issues.apache.org/jira/browse/SPARK-23479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomasz Bartczak updated SPARK-23479: Priority: Minor (was: Major) > struct() cannot be combined with alias(metadata={}) >

[jira] [Commented] (SPARK-23408) Flaky test: StreamingOuterJoinSuite.left outer early state exclusion on right

[ https://issues.apache.org/jira/browse/SPARK-23408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371247#comment-16371247 ] Apache Spark commented on SPARK-23408: -- User 'tdas' has created a pull request for this issue:

[jira] [Commented] (SPARK-23477) Misleading exception message when union fails due to metadata

[ https://issues.apache.org/jira/browse/SPARK-23477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371238#comment-16371238 ] Marco Gaido commented on SPARK-23477: - I cannot reproduce this on master. > Misleading exception

[jira] [Created] (SPARK-23479) struct() cannot be combined with alias(metadata={})

Tomasz Bartczak created SPARK-23479: --- Summary: struct() cannot be combined with alias(metadata={}) Key: SPARK-23479 URL: https://issues.apache.org/jira/browse/SPARK-23479 Project: Spark

[jira] [Created] (SPARK-23478) Inconsistent behaviour of union when columns have conflicting metadata

Tomasz Bartczak created SPARK-23478: --- Summary: Inconsistent behaviour of union when columns have conflicting metadata Key: SPARK-23478 URL: https://issues.apache.org/jira/browse/SPARK-23478

[jira] [Created] (SPARK-23477) Misleading exception message when union fails due to metadata

Tomasz Bartczak created SPARK-23477: --- Summary: Misleading exception message when union fails due to metadata Key: SPARK-23477 URL: https://issues.apache.org/jira/browse/SPARK-23477 Project: Spark

[jira] [Updated] (SPARK-23473) spark.catalog.listTables error when database name starts with a number

[ https://issues.apache.org/jira/browse/SPARK-23473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido updated SPARK-23473: Component/s: (was: Spark Core) SQL > spark.catalog.listTables error when

[jira] [Commented] (SPARK-23463) Filter operation fails to handle blank values and evicts rows that even satisfy the filtering condition

[ https://issues.apache.org/jira/browse/SPARK-23463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371186#comment-16371186 ] Marco Gaido commented on SPARK-23463: - It changed Spark's implicit casting. Probably in 2.1.1

[jira] [Comment Edited] (SPARK-18057) Update structured streaming kafka from 10.0.1 to 10.2.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371174#comment-16371174 ] Sönke Liebau edited comment on SPARK-18057 at 2/21/18 10:10 AM: I agree

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 10.0.1 to 10.2.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371174#comment-16371174 ] Sönke Liebau commented on SPARK-18057: -- I agree that we should not rename the existing kafka_10

[jira] [Commented] (SPARK-23462) Improve the error message in `StructType`

[ https://issues.apache.org/jira/browse/SPARK-23462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371150#comment-16371150 ] Apache Spark commented on SPARK-23462: -- User 'xysun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23462) Improve the error message in `StructType`

[ https://issues.apache.org/jira/browse/SPARK-23462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23462: Assignee: (was: Apache Spark) > Improve the error message in `StructType` >

[jira] [Assigned] (SPARK-23462) Improve the error message in `StructType`

[ https://issues.apache.org/jira/browse/SPARK-23462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23462: Assignee: Apache Spark > Improve the error message in `StructType` >

[jira] [Commented] (SPARK-23462) Improve the error message in `StructType`

[ https://issues.apache.org/jira/browse/SPARK-23462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371148#comment-16371148 ] Xiayun Sun commented on SPARK-23462: PR created: [https://github.com/apache/spark/pull/20649]  >

[jira] [Assigned] (SPARK-23452) Extend test coverage to all ORC readers

[ https://issues.apache.org/jira/browse/SPARK-23452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23452: Assignee: Dongjoon Hyun (was: Apache Spark) > Extend test coverage to all ORC readers >

[jira] [Assigned] (SPARK-23452) Extend test coverage to all ORC readers

[ https://issues.apache.org/jira/browse/SPARK-23452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23452: Assignee: Apache Spark (was: Dongjoon Hyun) > Extend test coverage to all ORC readers >

[jira] [Commented] (SPARK-23452) Extend test coverage to all ORC readers

[ https://issues.apache.org/jira/browse/SPARK-23452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371144#comment-16371144 ] Apache Spark commented on SPARK-23452: -- User 'xysun' has created a pull request for this issue:

[jira] [Commented] (SPARK-23476) Spark will not start in local mode with authentication on

[ https://issues.apache.org/jira/browse/SPARK-23476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371128#comment-16371128 ] Gabor Somogyi commented on SPARK-23476: --- I'm working on it. > Spark will not start in local mode

[jira] [Created] (SPARK-23476) Spark will not start in local mode with authentication on

Gabor Somogyi created SPARK-23476: - Summary: Spark will not start in local mode with authentication on Key: SPARK-23476 URL: https://issues.apache.org/jira/browse/SPARK-23476 Project: Spark

[jira] [Commented] (SPARK-23462) Improve the error message in `StructType`

[ https://issues.apache.org/jira/browse/SPARK-23462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371122#comment-16371122 ] Xiayun Sun commented on SPARK-23462: I will take this.  > Improve the error message in `StructType`

[jira] [Assigned] (SPARK-23448) Dataframe returns wrong result when column don't respect datatype

[ https://issues.apache.org/jira/browse/SPARK-23448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23448: Assignee: Apache Spark > Dataframe returns wrong result when column don't respect

[jira] [Assigned] (SPARK-23448) Dataframe returns wrong result when column don't respect datatype

[ https://issues.apache.org/jira/browse/SPARK-23448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23448: Assignee: (was: Apache Spark) > Dataframe returns wrong result when column don't

[jira] [Commented] (SPARK-23448) Dataframe returns wrong result when column don't respect datatype

[ https://issues.apache.org/jira/browse/SPARK-23448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371120#comment-16371120 ] Apache Spark commented on SPARK-23448: -- User 'viirya' has created a pull request for this issue:

[jira] [Updated] (SPARK-23406) Stream-stream self joins does not work

[ https://issues.apache.org/jira/browse/SPARK-23406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-23406: - Fix Version/s: (was: 3.0.0) 2.4.0 > Stream-stream self joins does not

[jira] [Commented] (SPARK-23475) The "stages" page doesn't show any completed stages

[ https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371098#comment-16371098 ] Shixiong Zhu commented on SPARK-23475: -- cc [~vanzin] > The "stages" page doesn't show any completed

  1   2   >