[jira] [Commented] (SPARK-30786) Block replication is not retried on other BlockManagers when it fails on 1 of the peers

2020-02-10 Thread Prakhar Jain (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034210#comment-17034210 ] Prakhar Jain commented on SPARK-30786: -- I am working on this. > Block replication is not retried

[jira] [Created] (SPARK-30786) Block replication is not retried on other BlockManagers when it fails on 1 of the peers

2020-02-10 Thread Prakhar Jain (Jira)
Prakhar Jain created SPARK-30786: Summary: Block replication is not retried on other BlockManagers when it fails on 1 of the peers Key: SPARK-30786 URL: https://issues.apache.org/jira/browse/SPARK-30786

[jira] [Commented] (SPARK-30756) `ThriftServerWithSparkContextSuite` fails always on spark-branch-3.0-test-sbt-hadoop-2.7-hive-2.3

2020-02-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034171#comment-17034171 ] Hyukjin Kwon commented on SPARK-30756: -- I will reopen if this isn't fixed. >

[jira] [Assigned] (SPARK-30756) `ThriftServerWithSparkContextSuite` fails always on spark-branch-3.0-test-sbt-hadoop-2.7-hive-2.3

2020-02-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30756: Assignee: Hyukjin Kwon > `ThriftServerWithSparkContextSuite` fails always on >

[jira] [Resolved] (SPARK-30756) `ThriftServerWithSparkContextSuite` fails always on spark-branch-3.0-test-sbt-hadoop-2.7-hive-2.3

2020-02-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30756. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27513

[jira] [Commented] (SPARK-25929) Support metrics with tags

2020-02-10 Thread Paulius Dambrauskas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034167#comment-17034167 ] Paulius Dambrauskas commented on SPARK-25929: - After adding native support for Prometheus in

[jira] [Created] (SPARK-30785) Create table like should keep tracksPartitionsInCatalog same with source table

2020-02-10 Thread Lantao Jin (Jira)
Lantao Jin created SPARK-30785: -- Summary: Create table like should keep tracksPartitionsInCatalog same with source table Key: SPARK-30785 URL: https://issues.apache.org/jira/browse/SPARK-30785 Project:

[jira] [Commented] (SPARK-30288) Failed to write valid Parquet files when column names contains special characters like spaces

2020-02-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034115#comment-17034115 ] Hyukjin Kwon commented on SPARK-30288: -- Yes, see the discussion in the PR. > Failed to write valid

[jira] [Updated] (SPARK-30773) Support NativeBlas for level-1 routines

2020-02-10 Thread Yan Ma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yan Ma updated SPARK-30773: --- Description: In current ML BLAS.scala, all level-1 routines are fixed to use java implementation. But

[jira] [Updated] (SPARK-30784) Hive 2.3 profile should still use orc-nohive

2020-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30784: -- Parent: SPARK-23710 Issue Type: Sub-task (was: Bug) > Hive 2.3 profile should still

[jira] [Resolved] (SPARK-30777) PySpark test_arrow tests fail with Pandas >= 1.0.0

2020-02-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30777. -- Fix Version/s: 3.0.0 Resolution: Fixed Fixed in

[jira] [Commented] (SPARK-30784) Hive 2.3 profile should still use orc-nohive

2020-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034058#comment-17034058 ] Dongjoon Hyun commented on SPARK-30784: --- I linked SPARK-27176 because SPARK-27176 made the

[jira] [Commented] (SPARK-30756) `ThriftServerWithSparkContextSuite` fails always on spark-branch-3.0-test-sbt-hadoop-2.7-hive-2.3

2020-02-10 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034047#comment-17034047 ] Shane Knapp commented on SPARK-30756: - unsure what you mean by "special configuration"... if having

[jira] [Updated] (SPARK-30784) Hive 2.3 profile should still use orc-nohive

2020-02-10 Thread Yin Huai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-30784: - Description: Originally reported at

[jira] [Updated] (SPARK-30783) Hive 2.3 profile should exclude hive-service-rpc

2020-02-10 Thread Yin Huai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-30783: - Attachment: hive-service-rpc-2.3.6-classes

[jira] [Updated] (SPARK-30783) Hive 2.3 profile should exclude hive-service-rpc

2020-02-10 Thread Yin Huai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-30783: - Description: hive-service-rpc 2.3.6 and spark sql's thrift server module have duplicate classes.

[jira] [Resolved] (SPARK-29595) Insertion with named_struct should match by name

2020-02-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29595. -- Resolution: Not A Problem > Insertion with named_struct should match by name >

[jira] [Resolved] (SPARK-30779) Review and fix issues in Structured Streaming API docs

2020-02-10 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-30779. - Fix Version/s: 3.0.0 Assignee: Shixiong Zhu Resolution: Fixed > Review and fix issues

[jira] [Updated] (SPARK-30779) Review and fix issues in Structured Streaming API docs

2020-02-10 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30779: Parent: SPARK-26904 Issue Type: Sub-task (was: Bug) > Review and fix issues in Structured

[jira] [Created] (SPARK-30784) Hive 2.3 profile should still use orc-nohive

2020-02-10 Thread Yin Huai (Jira)
Yin Huai created SPARK-30784: Summary: Hive 2.3 profile should still use orc-nohive Key: SPARK-30784 URL: https://issues.apache.org/jira/browse/SPARK-30784 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-30783) Hive 2.3 profile should exclude hive-service-rpc

2020-02-10 Thread Yin Huai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-30783: Assignee: Yin Huai > Hive 2.3 profile should exclude hive-service-rpc >

[jira] [Created] (SPARK-30783) Hive 2.3 profile should exclude hive-service-rpc

2020-02-10 Thread Yin Huai (Jira)
Yin Huai created SPARK-30783: Summary: Hive 2.3 profile should exclude hive-service-rpc Key: SPARK-30783 URL: https://issues.apache.org/jira/browse/SPARK-30783 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-29628) Forcibly create a temporary view in CREATE VIEW if referencing a temporary view

2020-02-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29628. -- Resolution: Won't Fix > Forcibly create a temporary view in CREATE VIEW if referencing a

[jira] [Resolved] (SPARK-30421) Dropped columns still available for filtering

2020-02-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30421. -- Resolution: Won't Fix > Dropped columns still available for filtering >

[jira] [Created] (SPARK-30782) Column resolution doesn't respect current catalog/namespace for v2 tables.

2020-02-10 Thread Terry Kim (Jira)
Terry Kim created SPARK-30782: - Summary: Column resolution doesn't respect current catalog/namespace for v2 tables. Key: SPARK-30782 URL: https://issues.apache.org/jira/browse/SPARK-30782 Project: Spark

[jira] [Updated] (SPARK-30781) Missing SortedMap type in pyspark

2020-02-10 Thread Mateusz User (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mateusz User updated SPARK-30781: - Description: Currently there is only MapType in pyspark API, which does not keep order of

[jira] [Created] (SPARK-30781) Missing SortedMap type in pyspark

2020-02-10 Thread Mateusz User (Jira)
Mateusz User created SPARK-30781: Summary: Missing SortedMap type in pyspark Key: SPARK-30781 URL: https://issues.apache.org/jira/browse/SPARK-30781 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-30759) The cache in StringRegexExpression is not initialized for foldable patterns

2020-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30759. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27502

[jira] [Assigned] (SPARK-30759) The cache in StringRegexExpression is not initialized for foldable patterns

2020-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30759: - Assignee: Maxim Gekk > The cache in StringRegexExpression is not initialized for

[jira] [Created] (SPARK-30780) LocalRelation should use emptyRDD if it is empty

2020-02-10 Thread Jira
Herman van Hövell created SPARK-30780: - Summary: LocalRelation should use emptyRDD if it is empty Key: SPARK-30780 URL: https://issues.apache.org/jira/browse/SPARK-30780 Project: Spark

[jira] [Comment Edited] (SPARK-30759) The cache in StringRegexExpression is not initialized for foldable patterns

2020-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033889#comment-17033889 ] Dongjoon Hyun edited comment on SPARK-30759 at 2/10/20 7:48 PM: Hi,

[jira] [Commented] (SPARK-30759) The cache in StringRegexExpression is not initialized for foldable patterns

2020-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033889#comment-17033889 ] Dongjoon Hyun commented on SPARK-30759: --- Hi, [~maxgekk]. As you wrote on the PR, this is a

[jira] [Updated] (SPARK-30759) The cache in StringRegexExpression is not initialized for foldable patterns

2020-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30759: -- Issue Type: Improvement (was: Bug) > The cache in StringRegexExpression is not initialized

[jira] [Updated] (SPARK-30759) The cache in StringRegexExpression is not initialized for foldable patterns

2020-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30759: -- Affects Version/s: (was: 2.4.5) (was: 3.0.0)

[jira] [Commented] (SPARK-15006) Generated JavaDoc should hide package private objects

2020-02-10 Thread Shixiong Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-15006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033886#comment-17033886 ] Shixiong Zhu commented on SPARK-15006: -- cc [~jodersky] has this fixed in the upstream? > Generated

[jira] [Reopened] (SPARK-15006) Generated JavaDoc should hide package private objects

2020-02-10 Thread Shixiong Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-15006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu reopened SPARK-15006: -- Reopening this since the issue still exists (See

[jira] [Commented] (SPARK-30777) PySpark test_arrow tests fail with Pandas >= 1.0.0

2020-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033880#comment-17033880 ] Dongjoon Hyun commented on SPARK-30777: --- Got it~ > PySpark test_arrow tests fail with Pandas >=

[jira] [Commented] (SPARK-30777) PySpark test_arrow tests fail with Pandas >= 1.0.0

2020-02-10 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033873#comment-17033873 ] Bryan Cutler commented on SPARK-30777: -- [~dongjoon] I don't think it's a blocker, only the tests

[jira] [Commented] (SPARK-30777) PySpark test_arrow tests fail with Pandas >= 1.0.0

2020-02-10 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033871#comment-17033871 ] Bryan Cutler commented on SPARK-30777: -- I'm working on the patch > PySpark test_arrow tests fail

[jira] [Created] (SPARK-30779) Review and fix issues in Structured Streaming API docs

2020-02-10 Thread Shixiong Zhu (Jira)
Shixiong Zhu created SPARK-30779: Summary: Review and fix issues in Structured Streaming API docs Key: SPARK-30779 URL: https://issues.apache.org/jira/browse/SPARK-30779 Project: Spark Issue

[jira] [Created] (SPARK-30778) Javadoc of Java classes doesn't show up in Scala doc

2020-02-10 Thread Shixiong Zhu (Jira)
Shixiong Zhu created SPARK-30778: Summary: Javadoc of Java classes doesn't show up in Scala doc Key: SPARK-30778 URL: https://issues.apache.org/jira/browse/SPARK-30778 Project: Spark Issue

[jira] [Commented] (SPARK-30777) PySpark test_arrow tests fail with Pandas >= 1.0.0

2020-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033861#comment-17033861 ] Dongjoon Hyun commented on SPARK-30777: --- Hi, [~bryanc]. Is this a blocker for 3.0.0 release? Then,

[jira] [Updated] (SPARK-30777) PySpark test_arrow tests fail with Pandas >= 1.0.0

2020-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30777: -- Summary: PySpark test_arrow tests fail with Pandas >= 1.0.0 (was: PySpark test_arrow tests

[jira] [Created] (SPARK-30777) PySpark test_arrow tests fail with Pandas > 1.0.0

2020-02-10 Thread Bryan Cutler (Jira)
Bryan Cutler created SPARK-30777: Summary: PySpark test_arrow tests fail with Pandas > 1.0.0 Key: SPARK-30777 URL: https://issues.apache.org/jira/browse/SPARK-30777 Project: Spark Issue

[jira] [Reopened] (SPARK-30245) Add cache for Like and RLike when pattern is not static

2020-02-10 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-30245: - > Add cache for Like and RLike when pattern is not static >

[jira] [Updated] (SPARK-30245) Add cache for Like and RLike when pattern is not static

2020-02-10 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30245: Fix Version/s: (was: 3.0.0) > Add cache for Like and RLike when pattern is not static >

[jira] [Commented] (SPARK-30761) Nested pruning should not prune on required child outputs in Generate

2020-02-10 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033848#comment-17033848 ] L. C. Hsieh commented on SPARK-30761: - [~dongjoon]Thanks for reminding that! > Nested pruning

[jira] [Closed] (SPARK-30761) Nested pruning should not prune on required child outputs in Generate

2020-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-30761. - > Nested pruning should not prune on required child outputs in Generate >

[jira] [Reopened] (SPARK-30761) Nested pruning should not prune on required child outputs in Generate

2020-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-30761: --- > Nested pruning should not prune on required child outputs in Generate >

[jira] [Resolved] (SPARK-30761) Nested pruning should not prune on required child outputs in Generate

2020-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30761. --- Resolution: Cannot Reproduce Since SPARK-29721 is reverted, so this becomes `Cannot

[jira] [Commented] (SPARK-30761) Nested pruning should not prune on required child outputs in Generate

2020-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033846#comment-17033846 ] Dongjoon Hyun commented on SPARK-30761: --- Hi, [~viirya]. Please use `Fix Version` for only

[jira] [Updated] (SPARK-30761) Nested pruning should not prune on required child outputs in Generate

2020-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30761: -- Fix Version/s: (was: 3.0.0) > Nested pruning should not prune on required child outputs

[jira] [Updated] (SPARK-29721) Spark SQL reads unnecessary nested fields after using explode

2020-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29721: -- Affects Version/s: (was: 2.4.4) (was: 2.4.3)

[jira] [Updated] (SPARK-29721) Spark SQL reads unnecessary nested fields after using explode

2020-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29721: -- Fix Version/s: (was: 3.0.0) > Spark SQL reads unnecessary nested fields after using

[jira] [Assigned] (SPARK-29721) Spark SQL reads unnecessary nested fields after using explode

2020-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29721: - Assignee: (was: L. C. Hsieh) > Spark SQL reads unnecessary nested fields after

[jira] [Commented] (SPARK-29721) Spark SQL reads unnecessary nested fields after using explode

2020-02-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033778#comment-17033778 ] Dongjoon Hyun commented on SPARK-29721: --- This is reverted in `master/branch-3.0` via

[jira] [Created] (SPARK-30776) Support FValueRegressionSelector for continuous features and continuous labels

2020-02-10 Thread Huaxin Gao (Jira)
Huaxin Gao created SPARK-30776: -- Summary: Support FValueRegressionSelector for continuous features and continuous labels Key: SPARK-30776 URL: https://issues.apache.org/jira/browse/SPARK-30776 Project:

[jira] [Updated] (SPARK-30774) The default checkpointing interval is not as claimed in the comment.

2020-02-10 Thread Kyle Krueger (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Krueger updated SPARK-30774: - Description:

[jira] [Updated] (SPARK-30774) The default checkpointing interval is not as claimed in the comment.

2020-02-10 Thread Kyle Krueger (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Krueger updated SPARK-30774: - Description:

[jira] [Created] (SPARK-30775) Improve DOC for executor metrics

2020-02-10 Thread Luca Canali (Jira)
Luca Canali created SPARK-30775: --- Summary: Improve DOC for executor metrics Key: SPARK-30775 URL: https://issues.apache.org/jira/browse/SPARK-30775 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-30326) Raise exception if analyzer exceed max iterations

2020-02-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30326. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26977

[jira] [Created] (SPARK-30774) The default checkpointing interval is not as claimed in the comment.

2020-02-10 Thread Kyle Krueger (Jira)
Kyle Krueger created SPARK-30774: Summary: The default checkpointing interval is not as claimed in the comment. Key: SPARK-30774 URL: https://issues.apache.org/jira/browse/SPARK-30774 Project: Spark

[jira] [Created] (SPARK-30773) Support NativeBlas for level-1 routines

2020-02-10 Thread Yan Ma (Jira)
Yan Ma created SPARK-30773: -- Summary: Support NativeBlas for level-1 routines Key: SPARK-30773 URL: https://issues.apache.org/jira/browse/SPARK-30773 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-30288) Failed to write valid Parquet files when column names contains special characters like spaces

2020-02-10 Thread Jingyuan Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033640#comment-17033640 ] Jingyuan Wang commented on SPARK-30288: --- [~hyukjin.kwon], why the resolution for this ticket is

[jira] [Updated] (SPARK-30741) The data returned from SAS using JDBC reader contains column label

2020-02-10 Thread Gary Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Liu updated SPARK-30741: - Affects Version/s: 2.3.4 2.4.5 > The data returned from SAS using JDBC reader

[jira] [Comment Edited] (SPARK-30741) The data returned from SAS using JDBC reader contains column label

2020-02-10 Thread Gary Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033632#comment-17033632 ] Gary Liu edited comment on SPARK-30741 at 2/10/20 2:27 PM: --- Thanks Hyukjin

[jira] [Comment Edited] (SPARK-30741) The data returned from SAS using JDBC reader contains column label

2020-02-10 Thread Gary Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033632#comment-17033632 ] Gary Liu edited comment on SPARK-30741 at 2/10/20 2:26 PM: --- Thanks Hyukjin

[jira] [Comment Edited] (SPARK-30741) The data returned from SAS using JDBC reader contains column label

2020-02-10 Thread Gary Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033632#comment-17033632 ] Gary Liu edited comment on SPARK-30741 at 2/10/20 2:14 PM: --- Thanks Hyukjin

[jira] [Commented] (SPARK-30741) The data returned from SAS using JDBC reader contains column label

2020-02-10 Thread Gary Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033632#comment-17033632 ] Gary Liu commented on SPARK-30741: -- Thanks Hyukjin Kwon! We tried 2.1.x, 2.3.x and 2.4.x, all got the

[jira] [Resolved] (SPARK-30757) Update the doc on TableCatalog.alterTable's behavior

2020-02-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30757. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27496

[jira] [Assigned] (SPARK-30757) Update the doc on TableCatalog.alterTable's behavior

2020-02-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30757: --- Assignee: Terry Kim > Update the doc on TableCatalog.alterTable's behavior >

[jira] [Created] (SPARK-30772) avoid tuple assignment because it will circumvent the transient tag

2020-02-10 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-30772: Summary: avoid tuple assignment because it will circumvent the transient tag Key: SPARK-30772 URL: https://issues.apache.org/jira/browse/SPARK-30772 Project: Spark

[jira] [Updated] (SPARK-30771) Failed mount warning from kubernetes and support the "optional" mount.

2020-02-10 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-30771: Attachment: (was: Screenshot 2020-02-10 at 3.10.01 PM.png) > Failed mount warning

[jira] [Updated] (SPARK-30771) Failed mount warning from kubernetes and support the "optional" mount.

2020-02-10 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-30771: Attachment: Screenshot 2020-02-10 at 3.10.01 PM.png > Failed mount warning from

[jira] [Created] (SPARK-30771) Avoid failed mount warning from kubernetes and support the "optional" mount.

2020-02-10 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-30771: --- Summary: Avoid failed mount warning from kubernetes and support the "optional" mount. Key: SPARK-30771 URL: https://issues.apache.org/jira/browse/SPARK-30771

[jira] [Updated] (SPARK-30771) Failed mount warning from kubernetes and support the "optional" mount.

2020-02-10 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-30771: Summary: Failed mount warning from kubernetes and support the "optional" mount. (was:

[jira] [Updated] (SPARK-30771) Failed mount warning from kubernetes and support the "optional" mount.

2020-02-10 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-30771: Attachment: Screenshot 2020-02-10 at 3.10.01 PM.png > Failed mount warning from

[jira] [Created] (SPARK-30770) avoid vector conversion in GMM.transform

2020-02-10 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-30770: Summary: avoid vector conversion in GMM.transform Key: SPARK-30770 URL: https://issues.apache.org/jira/browse/SPARK-30770 Project: Spark Issue Type:

[jira] [Commented] (SPARK-26449) Missing Dataframe.transform API in Python API

2020-02-10 Thread Erik Christiansen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033430#comment-17033430 ] Erik Christiansen commented on SPARK-26449: --- [~koaning] could you provide an exampe where this