[jira] [Commented] (SPARK-26501) Unexpected overriden of exitFn in SparkSubmitSuite

[ https://issues.apache.org/jira/browse/SPARK-26501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730591#comment-16730591 ] Apache Spark commented on SPARK-26501: -- User 'liupc' has created a pull request for this issue:

[jira] [Assigned] (SPARK-26501) Unexpected overriden of exitFn in SparkSubmitSuite

[ https://issues.apache.org/jira/browse/SPARK-26501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26501: Assignee: (was: Apache Spark) > Unexpected overriden of exitFn in SparkSubmitSuite >

[jira] [Assigned] (SPARK-26501) Unexpected overriden of exitFn in SparkSubmitSuite

[ https://issues.apache.org/jira/browse/SPARK-26501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26501: Assignee: Apache Spark > Unexpected overriden of exitFn in SparkSubmitSuite >

[jira] [Updated] (SPARK-26501) Unexpected overrided exitFn in SparkSubmitSuite

[ https://issues.apache.org/jira/browse/SPARK-26501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liupengcheng updated SPARK-26501: - Summary: Unexpected overrided exitFn in SparkSubmitSuite (was: Fix overrided exitFn in

[jira] [Updated] (SPARK-26501) Unexpected overriden of exitFn in SparkSubmitSuite

[ https://issues.apache.org/jira/browse/SPARK-26501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liupengcheng updated SPARK-26501: - Summary: Unexpected overriden of exitFn in SparkSubmitSuite (was: Unexpected overrided exitFn

[jira] [Created] (SPARK-26501) Fix overrided exitFn in SparkSubmitSuite

liupengcheng created SPARK-26501: Summary: Fix overrided exitFn in SparkSubmitSuite Key: SPARK-26501 URL: https://issues.apache.org/jira/browse/SPARK-26501 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-26022) PySpark Comparison with Pandas

[ https://issues.apache.org/jira/browse/SPARK-26022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-26022: - Target Version/s: 3.0.0 > PySpark Comparison with Pandas > -- > >

[jira] [Assigned] (SPARK-26500) Add conf to support ignore hdfs data locality

[ https://issues.apache.org/jira/browse/SPARK-26500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26500: Assignee: Apache Spark > Add conf to support ignore hdfs data locality >

[jira] [Assigned] (SPARK-26500) Add conf to support ignore hdfs data locality

[ https://issues.apache.org/jira/browse/SPARK-26500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26500: Assignee: (was: Apache Spark) > Add conf to support ignore hdfs data locality >

[jira] [Created] (SPARK-26500) Add conf to support ignore hdfs data locality

EdisonWang created SPARK-26500: -- Summary: Add conf to support ignore hdfs data locality Key: SPARK-26500 URL: https://issues.apache.org/jira/browse/SPARK-26500 Project: Spark Issue Type:

[jira] [Commented] (SPARK-26442) Use ConfigEntry for hardcoded configs.

[ https://issues.apache.org/jira/browse/SPARK-26442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730528#comment-16730528 ] Takuya Ueshin commented on SPARK-26442: --- I see. I'll combine them into several subtasks. I'll

[jira] [Commented] (SPARK-26442) Use ConfigEntry for hardcoded configs.

[ https://issues.apache.org/jira/browse/SPARK-26442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730519#comment-16730519 ] Hyukjin Kwon commented on SPARK-26442: -- Yes.. maybe at least the JIRAs should be combined per, for

[jira] [Updated] (SPARK-26494) 【spark sql】 使用spark读取oracle TIMESTAMP(6) WITH LOCAL TIME ZONE 类型找不到

[ https://issues.apache.org/jira/browse/SPARK-26494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 秦坤 updated SPARK-26494: --- Priority: Minor (was: Major) > 【spark sql】 使用spark读取oracle TIMESTAMP(6) WITH LOCAL TIME ZONE 类型找不到 >

[jira] [Created] (SPARK-26499) JdbcUtils.getCatalystType maps TINYINT to IntegerType instead of ByteType

Thomas D'Silva created SPARK-26499: -- Summary: JdbcUtils.getCatalystType maps TINYINT to IntegerType instead of ByteType Key: SPARK-26499 URL: https://issues.apache.org/jira/browse/SPARK-26499

[jira] [Assigned] (SPARK-26499) JdbcUtils.getCatalystType maps TINYINT to IntegerType instead of ByteType

[ https://issues.apache.org/jira/browse/SPARK-26499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26499: Assignee: (was: Apache Spark) > JdbcUtils.getCatalystType maps TINYINT to

[jira] [Assigned] (SPARK-26499) JdbcUtils.getCatalystType maps TINYINT to IntegerType instead of ByteType

[ https://issues.apache.org/jira/browse/SPARK-26499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26499: Assignee: Apache Spark > JdbcUtils.getCatalystType maps TINYINT to IntegerType instead

[jira] [Created] (SPARK-26498) Integrate barrier execution with MMLSpark's LightGBM

Ilya Matiach created SPARK-26498: Summary: Integrate barrier execution with MMLSpark's LightGBM Key: SPARK-26498 URL: https://issues.apache.org/jira/browse/SPARK-26498 Project: Spark Issue

[jira] [Resolved] (SPARK-23949) makes "&&" supports the function of predicate operator "and"

[ https://issues.apache.org/jira/browse/SPARK-23949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23949. --- Resolution: Won't Fix > makes "&&" supports the function of predicate operator "and" >

[jira] [Assigned] (SPARK-26497) Show users where the pre-packaged SparkR and PySpark Dockerfiles are in the image build script.

[ https://issues.apache.org/jira/browse/SPARK-26497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26497: Assignee: holdenk (was: Apache Spark) > Show users where the pre-packaged SparkR and

[jira] [Assigned] (SPARK-26497) Show users where the pre-packaged SparkR and PySpark Dockerfiles are in the image build script.

[ https://issues.apache.org/jira/browse/SPARK-26497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26497: Assignee: Apache Spark (was: holdenk) > Show users where the pre-packaged SparkR and

[jira] [Created] (SPARK-26497) Show users where the pre-packaged SparkR and PySpark Dockerfiles are in the image build script.

holdenk created SPARK-26497: --- Summary: Show users where the pre-packaged SparkR and PySpark Dockerfiles are in the image build script. Key: SPARK-26497 URL: https://issues.apache.org/jira/browse/SPARK-26497

[jira] [Created] (SPARK-26496) Test "locality preferences of StateStoreAwareZippedRDD" frequently fails on High Sierra

Bruce Robbins created SPARK-26496: - Summary: Test "locality preferences of StateStoreAwareZippedRDD" frequently fails on High Sierra Key: SPARK-26496 URL: https://issues.apache.org/jira/browse/SPARK-26496

[jira] [Assigned] (SPARK-26493) spark.sql.extensions should support multiple extensions

[ https://issues.apache.org/jira/browse/SPARK-26493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26493: Assignee: Apache Spark > spark.sql.extensions should support multiple extensions >

[jira] [Assigned] (SPARK-26493) spark.sql.extensions should support multiple extensions

[ https://issues.apache.org/jira/browse/SPARK-26493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26493: Assignee: (was: Apache Spark) > spark.sql.extensions should support multiple

[jira] [Assigned] (SPARK-26495) Simplify SelectedField extractor

[ https://issues.apache.org/jira/browse/SPARK-26495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26495: Assignee: Apache Spark (was: Herman van Hovell) > Simplify SelectedField extractor >

[jira] [Assigned] (SPARK-26495) Simplify SelectedField extractor

[ https://issues.apache.org/jira/browse/SPARK-26495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26495: Assignee: Herman van Hovell (was: Apache Spark) > Simplify SelectedField extractor >

[jira] [Resolved] (SPARK-24888) spark-submit --master spark://host:port --status driver-id does not work

[ https://issues.apache.org/jira/browse/SPARK-24888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-24888. --- Resolution: Won't Fix > spark-submit --master spark://host:port --status driver-id does not work >

[jira] [Updated] (SPARK-24888) spark-submit --master spark://host:port --status driver-id does not work

[ https://issues.apache.org/jira/browse/SPARK-24888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-24888: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) > spark-submit --master

[jira] [Resolved] (SPARK-21688) performance improvement in mllib SVM with native BLAS

[ https://issues.apache.org/jira/browse/SPARK-21688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21688. --- Resolution: Won't Fix > performance improvement in mllib SVM with native BLAS >

[jira] [Commented] (SPARK-26477) Use ConfigEntry for hardcoded configs for unsafe category.

[ https://issues.apache.org/jira/browse/SPARK-26477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730340#comment-16730340 ] Kazuaki Ishizaki commented on SPARK-26477: -- I will work for this > Use ConfigEntry for

[jira] [Created] (SPARK-26495) Simplify SelectedField extractor

Herman van Hovell created SPARK-26495: - Summary: Simplify SelectedField extractor Key: SPARK-26495 URL: https://issues.apache.org/jira/browse/SPARK-26495 Project: Spark Issue Type:

[jira] [Commented] (SPARK-26442) Use ConfigEntry for hardcoded configs.

[ https://issues.apache.org/jira/browse/SPARK-26442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730334#comment-16730334 ] Takuya Ueshin commented on SPARK-26442: --- I'm sorry for bothering you. Since there are so many

[jira] [Assigned] (SPARK-26397) Driver-side only metrics support

[ https://issues.apache.org/jira/browse/SPARK-26397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26397: Assignee: Apache Spark > Driver-side only metrics support >

[jira] [Commented] (SPARK-26397) Driver-side only metrics support

[ https://issues.apache.org/jira/browse/SPARK-26397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730311#comment-16730311 ] Apache Spark commented on SPARK-26397: -- User 'xuanyuanking' has created a pull request for this

[jira] [Assigned] (SPARK-26397) Driver-side only metrics support

[ https://issues.apache.org/jira/browse/SPARK-26397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26397: Assignee: (was: Apache Spark) > Driver-side only metrics support >

[jira] [Created] (SPARK-26494) 【spark sql】 使用spark读取oracle TIMESTAMP(6) WITH LOCAL TIME ZONE 类型找不到

秦坤 created SPARK-26494: -- Summary: 【spark sql】 使用spark读取oracle TIMESTAMP(6) WITH LOCAL TIME ZONE 类型找不到 Key: SPARK-26494 URL: https://issues.apache.org/jira/browse/SPARK-26494 Project: Spark Issue Type:

[jira] [Created] (SPARK-26493) spark.sql.extensions should support multiple extensions

Jamison Bennett created SPARK-26493: --- Summary: spark.sql.extensions should support multiple extensions Key: SPARK-26493 URL: https://issues.apache.org/jira/browse/SPARK-26493 Project: Spark

[jira] [Commented] (SPARK-22579) BlockManager.getRemoteValues and BlockManager.getRemoteBytes should be implemented using streaming

[ https://issues.apache.org/jira/browse/SPARK-22579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730301#comment-16730301 ] Eyal Farago commented on SPARK-22579: - Glanced over this on my cell, seems like spark-25905 only

[jira] [Commented] (SPARK-26442) Use ConfigEntry for hardcoded configs.

[ https://issues.apache.org/jira/browse/SPARK-26442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730293#comment-16730293 ] Sean Owen commented on SPARK-26442: --- [~ueshin] yikes, why does this need 34 JIRAs! surely this is one

[jira] [Assigned] (SPARK-26444) Stage color doesn't change with it's status

[ https://issues.apache.org/jira/browse/SPARK-26444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26444: - Assignee: Chenxiao Mao > Stage color doesn't change with it's status >

[jira] [Updated] (SPARK-26444) Stage color doesn't change with it's status

[ https://issues.apache.org/jira/browse/SPARK-26444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26444: -- Priority: Minor (was: Major) > Stage color doesn't change with it's status >

[jira] [Resolved] (SPARK-26444) Stage color doesn't change with it's status

[ https://issues.apache.org/jira/browse/SPARK-26444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26444. --- Resolution: Fixed Fix Version/s: 2.4.1 3.0.0 2.3.3

[jira] [Assigned] (SPARK-26470) Use ConfigEntry for hardcoded configs for eventLog category.

[ https://issues.apache.org/jira/browse/SPARK-26470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26470: Assignee: Apache Spark > Use ConfigEntry for hardcoded configs for eventLog category. >

[jira] [Assigned] (SPARK-26470) Use ConfigEntry for hardcoded configs for eventLog category.

[ https://issues.apache.org/jira/browse/SPARK-26470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26470: Assignee: (was: Apache Spark) > Use ConfigEntry for hardcoded configs for eventLog

[jira] [Commented] (SPARK-26458) OneHotEncoderModel verifies the number of category values incorrectly when tries to transform a dataframe.

[ https://issues.apache.org/jira/browse/SPARK-26458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730188#comment-16730188 ] Marco Gaido commented on SPARK-26458: - Which is the issue you are encountering? Can you provide a

[jira] [Resolved] (SPARK-26433) Tail method for spark DataFrame

[ https://issues.apache.org/jira/browse/SPARK-26433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26433. -- Resolution: Won't Fix > Tail method for spark DataFrame > --- > >

[jira] [Commented] (SPARK-26433) Tail method for spark DataFrame

[ https://issues.apache.org/jira/browse/SPARK-26433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730180#comment-16730180 ] Hyukjin Kwon commented on SPARK-26433: -- You can simply do it after {{collect()}}. Let's avoid to

[jira] [Resolved] (SPARK-26455) Spark Kinesis Integration with no SSL

[ https://issues.apache.org/jira/browse/SPARK-26455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26455. -- Resolution: Invalid If it's asking for help, let's do that in Spark mailing list. We can

[jira] [Commented] (SPARK-26454) IllegegalArgument Exception is Thrown while creating new UDF with JAR

[ https://issues.apache.org/jira/browse/SPARK-26454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730173#comment-16730173 ] Hyukjin Kwon commented on SPARK-26454: -- what;s full stacktrace of {{IllegalArgumentException}}? Do

[jira] [Updated] (SPARK-26492) support streaming DecisionTreeRegressor

[ https://issues.apache.org/jira/browse/SPARK-26492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sky54521 updated SPARK-26492: - Labels: DecisionTreeRegressor (was: ) > support streaming DecisionTreeRegressor >

[jira] [Created] (SPARK-26492) support streaming DecisionTreeRegressor

sky54521 created SPARK-26492: Summary: support streaming DecisionTreeRegressor Key: SPARK-26492 URL: https://issues.apache.org/jira/browse/SPARK-26492 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-26446) Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager

[ https://issues.apache.org/jira/browse/SPARK-26446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-26446: - Assignee: Qingxin Wu > Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager

[jira] [Updated] (SPARK-26446) Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager

[ https://issues.apache.org/jira/browse/SPARK-26446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26446: -- Component/s: Documentation > Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager

[jira] [Resolved] (SPARK-26446) Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager

[ https://issues.apache.org/jira/browse/SPARK-26446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26446. --- Resolution: Fixed Fix Version/s: 3.0.0 This is resolved via

[jira] [Created] (SPARK-26470) Use ConfigEntry for hardcoded configs for eventLog category.

Takuya Ueshin created SPARK-26470: - Summary: Use ConfigEntry for hardcoded configs for eventLog category. Key: SPARK-26470 URL: https://issues.apache.org/jira/browse/SPARK-26470 Project: Spark