[jira] [Assigned] (SPARK-29520) Incorrect checking of negative intervals

[ https://issues.apache.org/jira/browse/SPARK-29520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29520: --- Assignee: Maxim Gekk > Incorrect checking of negative intervals > -

[jira] [Resolved] (SPARK-29520) Incorrect checking of negative intervals

[ https://issues.apache.org/jira/browse/SPARK-29520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29520. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26177 [https://gith

[jira] [Commented] (SPARK-29604) SessionState is initialized with isolated classloader for Hive if spark.sql.hive.metastore.jars is being set

[ https://issues.apache.org/jira/browse/SPARK-29604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963737#comment-16963737 ] Jungtaek Lim commented on SPARK-29604: -- I've manually ran the test suite locally (s

[jira] [Created] (SPARK-29680) ALTER TABLE (CHANGE COLUMN) should look up catalog/table like v2 commands

L. C. Hsieh created SPARK-29680: --- Summary: ALTER TABLE (CHANGE COLUMN) should look up catalog/table like v2 commands Key: SPARK-29680 URL: https://issues.apache.org/jira/browse/SPARK-29680 Project: Spar

[jira] [Commented] (SPARK-29616) Bankers' rounding for double types

[ https://issues.apache.org/jira/browse/SPARK-29616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963748#comment-16963748 ] Aman Omer commented on SPARK-29616: --- Banker's algorithm for rounding is already implem

[jira] [Created] (SPARK-29681) Spark Application UI- environment tab field "value" sort is not working

jobit mathew created SPARK-29681: Summary: Spark Application UI- environment tab field "value" sort is not working Key: SPARK-29681 URL: https://issues.apache.org/jira/browse/SPARK-29681 Project: Spa

[jira] [Commented] (SPARK-29681) Spark Application UI- environment tab field "value" sort is not working

[ https://issues.apache.org/jira/browse/SPARK-29681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963769#comment-16963769 ] Rakesh Raushan commented on SPARK-29681: I will work on this one > Spark Appli

[jira] [Updated] (SPARK-29681) Spark Application UI- environment tab field "value" sort is not working

[ https://issues.apache.org/jira/browse/SPARK-29681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jobit mathew updated SPARK-29681: - Attachment: Ascend.png > Spark Application UI- environment tab field "value" sort is not working

[jira] [Updated] (SPARK-29681) Spark Application UI- environment tab field "value" sort is not working

[ https://issues.apache.org/jira/browse/SPARK-29681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jobit mathew updated SPARK-29681: - Description: Spark Application UI- In environment tab, field "value" sort is not working if we

[jira] [Updated] (SPARK-29681) Spark Application UI- environment tab field "value" sort is not working

[ https://issues.apache.org/jira/browse/SPARK-29681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jobit mathew updated SPARK-29681: - Attachment: DESCEND.png > Spark Application UI- environment tab field "value" sort is not workin

[jira] [Updated] (SPARK-29681) Spark Application UI- environment tab field "value" sort is not working

[ https://issues.apache.org/jira/browse/SPARK-29681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jobit mathew updated SPARK-29681: - Description: Spark Application UI- In environment tab, field "value" sort is not working if we

[jira] [Created] (SPARK-29682) Failure when resolving conflicting references in Join:

sandeshyapuram created SPARK-29682: -- Summary: Failure when resolving conflicting references in Join: Key: SPARK-29682 URL: https://issues.apache.org/jira/browse/SPARK-29682 Project: Spark Is

[jira] [Updated] (SPARK-29682) Failure when resolving conflicting references in Join:

[ https://issues.apache.org/jira/browse/SPARK-29682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandeshyapuram updated SPARK-29682: --- Description: When I try to self join a parentDf with multiple childDf say childDf1 ... ... 

[jira] [Updated] (SPARK-29682) Failure when resolving conflicting references in Join:

[ https://issues.apache.org/jira/browse/SPARK-29682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandeshyapuram updated SPARK-29682: --- Description: When I try to self join a parentDf with multiple childDf say childDf1 ... ... 

[jira] [Updated] (SPARK-29682) Failure when resolving conflicting references in Join:

[ https://issues.apache.org/jira/browse/SPARK-29682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandeshyapuram updated SPARK-29682: --- Description: When I try to self join a parentDf with multiple childDf say childDf1 ... ... 

[jira] [Updated] (SPARK-29682) Failure when resolving conflicting references in Join:

[ https://issues.apache.org/jira/browse/SPARK-29682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandeshyapuram updated SPARK-29682: --- Description: When I try to self join a parentDf with multiple childDf say childDf1 ... ... 

[jira] [Commented] (SPARK-29682) Failure when resolving conflicting references in Join:

[ https://issues.apache.org/jira/browse/SPARK-29682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963789#comment-16963789 ] sandeshyapuram commented on SPARK-29682: I have reproduced this in spark-submit

[jira] [Commented] (SPARK-29681) Spark Application UI- environment tab field "value" sort is not working

[ https://issues.apache.org/jira/browse/SPARK-29681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963798#comment-16963798 ] jobit mathew commented on SPARK-29681: -- Issue observed in Spark Properties,System P

[jira] [Created] (SPARK-29683) Job failed due to executor failures all available nodes are blacklisted

Genmao Yu created SPARK-29683: - Summary: Job failed due to executor failures all available nodes are blacklisted Key: SPARK-29683 URL: https://issues.apache.org/jira/browse/SPARK-29683 Project: Spark

[jira] [Updated] (SPARK-29682) Failure when resolving conflicting references in Join:

[ https://issues.apache.org/jira/browse/SPARK-29682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandeshyapuram updated SPARK-29682: --- Component/s: Spark Shell Spark Core > Failure when resolving conflicting re

[jira] [Updated] (SPARK-29683) Job failed due to executor failures all available nodes are blacklisted

[ https://issues.apache.org/jira/browse/SPARK-29683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated SPARK-29683: -- Description: My streaming job will fail *due to executor failures all available nodes are blacklisted

[jira] [Commented] (SPARK-27736) Improve handling of FetchFailures caused by ExternalShuffleService losing track of executor registrations

[ https://issues.apache.org/jira/browse/SPARK-27736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963818#comment-16963818 ] weixiuli commented on SPARK-27736: -- https://github.com/apache/spark/pull/26206 > Impro

[jira] [Created] (SPARK-29684) Support divide/multiply for interval types

Kent Yao created SPARK-29684: Summary: Support divide/multiply for interval types Key: SPARK-29684 URL: https://issues.apache.org/jira/browse/SPARK-29684 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29685) Spark SQL also better to show the column details while doing SELECT * from table, like sparkshell and spark beeline

jobit mathew created SPARK-29685: Summary: Spark SQL also better to show the column details while doing SELECT * from table, like sparkshell and spark beeline Key: SPARK-29685 URL: https://issues.apache.org/jira/b

[jira] [Assigned] (SPARK-29686) LinearSVC should persist instances if needed

[ https://issues.apache.org/jira/browse/SPARK-29686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-29686: Assignee: zhengruifeng > LinearSVC should persist instances if needed > -

[jira] [Updated] (SPARK-29685) Spark SQL also better to show the column details while doing SELECT * from table, like sparkshell and spark beeline

[ https://issues.apache.org/jira/browse/SPARK-29685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jobit mathew updated SPARK-29685: - Description: Spark SQL also better to show the column details in top while doing SELECT * from

[jira] [Created] (SPARK-29686) LinearSVC should persist instances if needed

zhengruifeng created SPARK-29686: Summary: LinearSVC should persist instances if needed Key: SPARK-29686 URL: https://issues.apache.org/jira/browse/SPARK-29686 Project: Spark Issue Type: Impr

[jira] [Updated] (SPARK-29685) Spark SQL also better to show the column details while doing SELECT * from table, like sparkshell and spark beeline

[ https://issues.apache.org/jira/browse/SPARK-29685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jobit mathew updated SPARK-29685: - Description: Spark SQL also better to show the column details in top while doing SELECT * from

[jira] [Commented] (SPARK-29685) Spark SQL also better to show the column details while doing SELECT * from table, like sparkshell and spark beeline

[ https://issues.apache.org/jira/browse/SPARK-29685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963843#comment-16963843 ] Aman Omer commented on SPARK-29685: --- Thanks [~jobitmathew]. I am checking this one. >

[jira] [Updated] (SPARK-29685) Spark SQL also better to show the column details while doing SELECT * from table, like sparkshell and spark beeline

[ https://issues.apache.org/jira/browse/SPARK-29685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jobit mathew updated SPARK-29685: - Issue Type: Improvement (was: Bug) > Spark SQL also better to show the column details while doi

[jira] [Commented] (SPARK-29682) Failure when resolving conflicting references in Join:

[ https://issues.apache.org/jira/browse/SPARK-29682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963850#comment-16963850 ] Wenchen Fan commented on SPARK-29682: - [~imback82] do you want to look into it? > F

[jira] [Commented] (SPARK-29630) Not allowed to create a permanent view by referencing a temporary view in EXISTS

[ https://issues.apache.org/jira/browse/SPARK-29630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963858#comment-16963858 ] Wenchen Fan commented on SPARK-29630: - Yea this should be disallowed. We store view

[jira] [Created] (SPARK-29687) Fix jdbc metrics counter type to long

ulysses you created SPARK-29687: --- Summary: Fix jdbc metrics counter type to long Key: SPARK-29687 URL: https://issues.apache.org/jira/browse/SPARK-29687 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-29687) Fix jdbc metrics counter type to long

[ https://issues.apache.org/jira/browse/SPARK-29687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-29687: Affects Version/s: (was: 2.4.4) 3.0.0 > Fix jdbc metrics counter type t

[jira] [Commented] (SPARK-29687) Fix jdbc metrics counter type to long

[ https://issues.apache.org/jira/browse/SPARK-29687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963993#comment-16963993 ] jobit mathew commented on SPARK-29687: -- Hi can you give some details about this var

[jira] [Commented] (SPARK-29687) Fix jdbc metrics counter type to long

[ https://issues.apache.org/jira/browse/SPARK-29687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964011#comment-16964011 ] ulysses you commented on SPARK-29687: - You can just see the pr [26334|[https://githu

[jira] [Comment Edited] (SPARK-29687) Fix jdbc metrics counter type to long

[ https://issues.apache.org/jira/browse/SPARK-29687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964011#comment-16964011 ] ulysses you edited comment on SPARK-29687 at 10/31/19 1:31 PM: ---

[jira] [Comment Edited] (SPARK-29687) Fix jdbc metrics counter type to long

[ https://issues.apache.org/jira/browse/SPARK-29687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964011#comment-16964011 ] ulysses you edited comment on SPARK-29687 at 10/31/19 1:33 PM: ---

[jira] [Commented] (SPARK-29687) Fix jdbc metrics counter type to long

[ https://issues.apache.org/jira/browse/SPARK-29687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964015#comment-16964015 ] ulysses you commented on SPARK-29687: - Sorry for a misstake. > Fix jdbc metrics cou

[jira] [Created] (SPARK-29688) Support average with interval type values

Kent Yao created SPARK-29688: Summary: Support average with interval type values Key: SPARK-29688 URL: https://issues.apache.org/jira/browse/SPARK-29688 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29689) [UI] When task failed during reading shuffle data or other failure, enable show total shuffle read size

feiwang created SPARK-29689: --- Summary: [UI] When task failed during reading shuffle data or other failure, enable show total shuffle read size Key: SPARK-29689 URL: https://issues.apache.org/jira/browse/SPARK-29689

[jira] [Updated] (SPARK-29689) [WEB-UI] When task failed during reading shuffle data or other failure, enable show total shuffle read size

[ https://issues.apache.org/jira/browse/SPARK-29689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-29689: Summary: [WEB-UI] When task failed during reading shuffle data or other failure, enable show total shuffle

[jira] [Updated] (SPARK-29689) [WEB-UI] When task failed during reading shuffle data or other failure, enable show total shuffle read size

[ https://issues.apache.org/jira/browse/SPARK-29689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-29689: Attachment: screenshot-1.png > [WEB-UI] When task failed during reading shuffle data or other failure, >

[jira] [Updated] (SPARK-29689) [WEB-UI] When task failed during reading shuffle data or other failure, enable show total shuffle read size

[ https://issues.apache.org/jira/browse/SPARK-29689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-29689: Description: If task failed during reading shuffle data or because of executor loss, its shuffle read siz

[jira] [Updated] (SPARK-29689) [WEB-UI] When task failed during reading shuffle data or other failure, enable show total shuffle read size

[ https://issues.apache.org/jira/browse/SPARK-29689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-29689: Description: As shown in the attachment, if task failed during reading shuffle data or because of executo

[jira] [Resolved] (SPARK-29277) DataSourceV2: Add early filter and projection pushdown

[ https://issues.apache.org/jira/browse/SPARK-29277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29277. --- Resolution: Fixed Issue resolved by pull request 26341 [https://github.com/apache/spark/pull

[jira] [Assigned] (SPARK-29277) DataSourceV2: Add early filter and projection pushdown

[ https://issues.apache.org/jira/browse/SPARK-29277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29277: - Assignee: Ryan Blue > DataSourceV2: Add early filter and projection pushdown >

[jira] [Commented] (SPARK-29604) SessionState is initialized with isolated classloader for Hive if spark.sql.hive.metastore.jars is being set

[ https://issues.apache.org/jira/browse/SPARK-29604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964137#comment-16964137 ] Dongjoon Hyun commented on SPARK-29604: --- Thank you for keeping working on this. Ye

[jira] [Commented] (SPARK-29630) Not allowed to create a permanent view by referencing a temporary view in EXISTS

[ https://issues.apache.org/jira/browse/SPARK-29630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964157#comment-16964157 ] Terry Kim commented on SPARK-29630: --- Yes, I will take a look. > Not allowed to create

[jira] [Commented] (SPARK-29682) Failure when resolving conflicting references in Join:

[ https://issues.apache.org/jira/browse/SPARK-29682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964158#comment-16964158 ] Terry Kim commented on SPARK-29682: --- Sure, I will look into this. Thanks for pinging m

[jira] [Assigned] (SPARK-29675) Add exception when isolationLevel is Illegal

[ https://issues.apache.org/jira/browse/SPARK-29675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29675: - Assignee: ulysses you > Add exception when isolationLevel is Illegal >

[jira] [Resolved] (SPARK-29675) Add exception when isolationLevel is Illegal

[ https://issues.apache.org/jira/browse/SPARK-29675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29675. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26334 [https://

[jira] [Updated] (SPARK-29644) ShortType is wrongly set as Int in JDBCUtils.scala

[ https://issues.apache.org/jira/browse/SPARK-29644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-29644: - Issue Type: Bug (was: New Feature) > ShortType is wrongly set as Int in JDBCUtils.scala > -

[jira] [Created] (SPARK-29690) Spark Shell - Clear imports

dinesh created SPARK-29690: -- Summary: Spark Shell - Clear imports Key: SPARK-29690 URL: https://issues.apache.org/jira/browse/SPARK-29690 Project: Spark Issue Type: Bug Components: Spark

[jira] [Updated] (SPARK-29690) Spark Shell - Clear imports

[ https://issues.apache.org/jira/browse/SPARK-29690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dinesh updated SPARK-29690: --- Description: I 'm facing below problem with Spark Shell. So, in a shell session - # I imported following - 

[jira] [Updated] (SPARK-29690) Spark Shell - Clear imports

[ https://issues.apache.org/jira/browse/SPARK-29690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dinesh updated SPARK-29690: --- Description: I 'm facing below problem with Spark Shell. So, in a shell session - # I imported following - 

[jira] [Updated] (SPARK-29690) Spark Shell - Clear imports

[ https://issues.apache.org/jira/browse/SPARK-29690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dinesh updated SPARK-29690: --- Description: I 'm facing below problem with Spark Shell. So, in a shell session - # I imported following - 

[jira] [Commented] (SPARK-25923) SparkR UT Failure (checking CRAN incoming feasibility)

[ https://issues.apache.org/jira/browse/SPARK-25923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964232#comment-16964232 ] Sean R. Owen commented on SPARK-25923: -- [~viirya][~hyukjin.kwon][~dongjoon] Looks l

[jira] [Commented] (SPARK-25923) SparkR UT Failure (checking CRAN incoming feasibility)

[ https://issues.apache.org/jira/browse/SPARK-25923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964236#comment-16964236 ] L. C. Hsieh commented on SPARK-25923: - Noticed that and asked help from CRAN two hou

[jira] [Commented] (SPARK-25923) SparkR UT Failure (checking CRAN incoming feasibility)

[ https://issues.apache.org/jira/browse/SPARK-25923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964247#comment-16964247 ] L. C. Hsieh commented on SPARK-25923: - Got reply back now. It should be fixed now.

[jira] [Commented] (SPARK-29625) Spark Structure Streaming Kafka Wrong Reset Offset twice

[ https://issues.apache.org/jira/browse/SPARK-29625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964249#comment-16964249 ] Sandish Kumar HN commented on SPARK-29625: -- [~hyukjin.kwon] it is happening ran

[jira] [Commented] (SPARK-22579) BlockManager.getRemoteValues and BlockManager.getRemoteBytes should be implemented using streaming

[ https://issues.apache.org/jira/browse/SPARK-22579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964281#comment-16964281 ] Imran Rashid commented on SPARK-22579: -- Sorry I had not noticed this issue before.

[jira] [Commented] (SPARK-29673) upgrade jenkins pypy to PyPy3.6 v7.2.0

[ https://issues.apache.org/jira/browse/SPARK-29673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964359#comment-16964359 ] Shane Knapp commented on SPARK-29673: - pypy3.6-7.2.0-linux_x86_64-portable has been

[jira] [Commented] (SPARK-29415) Stage Level Sched: Add base ResourceProfile and Request classes

[ https://issues.apache.org/jira/browse/SPARK-29415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964360#comment-16964360 ] Thomas Graves commented on SPARK-29415: --- More details: TaskResourceRequest - this

[jira] [Comment Edited] (SPARK-29415) Stage Level Sched: Add base ResourceProfile and Request classes

[ https://issues.apache.org/jira/browse/SPARK-29415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964360#comment-16964360 ] Thomas Graves edited comment on SPARK-29415 at 10/31/19 7:59 PM: -

[jira] [Comment Edited] (SPARK-29415) Stage Level Sched: Add base ResourceProfile and Request classes

[ https://issues.apache.org/jira/browse/SPARK-29415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964360#comment-16964360 ] Thomas Graves edited comment on SPARK-29415 at 10/31/19 8:03 PM: -

[jira] [Created] (SPARK-29691) Estimator fit method fails to copy params (in PySpark)

John Bauer created SPARK-29691: -- Summary: Estimator fit method fails to copy params (in PySpark) Key: SPARK-29691 URL: https://issues.apache.org/jira/browse/SPARK-29691 Project: Spark Issue Type

[jira] [Updated] (SPARK-29691) Estimator fit method fails to copy params (in PySpark)

[ https://issues.apache.org/jira/browse/SPARK-29691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Bauer updated SPARK-29691: --- Description: Estimator `fit` method (implemented in Params) is supposed to copy a dictionary of par

[jira] [Updated] (SPARK-29691) Estimator fit method fails to copy params (in PySpark)

[ https://issues.apache.org/jira/browse/SPARK-29691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Bauer updated SPARK-29691: --- Description: Estimator `fit` method (implemented in Params) is supposed to copy a dictionary of par

[jira] [Updated] (SPARK-29691) Estimator fit method fails to copy params (in PySpark)

[ https://issues.apache.org/jira/browse/SPARK-29691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Bauer updated SPARK-29691: --- Description: Estimator `fit` method is supposed to copy a dictionary of params, overwriting the est

[jira] [Created] (SPARK-29692) SparkContext.defaultParallism should reflect resource limits when resource limits are set

Bago Amirbekian created SPARK-29692: --- Summary: SparkContext.defaultParallism should reflect resource limits when resource limits are set Key: SPARK-29692 URL: https://issues.apache.org/jira/browse/SPARK-29692

[jira] [Resolved] (SPARK-29687) Fix jdbc metrics counter type to long

[ https://issues.apache.org/jira/browse/SPARK-29687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-29687. -- Fix Version/s: 3.0.0 Assignee: ulysses you Resolution: Fixed Resolved

[jira] [Commented] (SPARK-12806) Support SQL expressions extracting values from VectorUDT

[ https://issues.apache.org/jira/browse/SPARK-12806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964475#comment-16964475 ] John Bauer commented on SPARK-12806: This is still a problem. For example, classifi

[jira] [Commented] (SPARK-12806) Support SQL expressions extracting values from VectorUDT

[ https://issues.apache.org/jira/browse/SPARK-12806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964481#comment-16964481 ] John Bauer commented on SPARK-12806: Also, when using PyArrow to convert a Spark Dat

[jira] [Commented] (SPARK-29625) Spark Structure Streaming Kafka Wrong Reset Offset twice

[ https://issues.apache.org/jira/browse/SPARK-29625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964489#comment-16964489 ] Hyukjin Kwon commented on SPARK-29625: -- It needs investigation. Can you share the c

[jira] [Commented] (SPARK-29693) Bucket map join if the one's bucket number is the multiple of the other

[ https://issues.apache.org/jira/browse/SPARK-29693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964490#comment-16964490 ] Yuming Wang commented on SPARK-29693: - https://data-flair.training/blogs/bucket-map-

[jira] [Created] (SPARK-29693) Bucket map join if the one's bucket number is the multiple of the other

Yuming Wang created SPARK-29693: --- Summary: Bucket map join if the one's bucket number is the multiple of the other Key: SPARK-29693 URL: https://issues.apache.org/jira/browse/SPARK-29693 Project: Spark

[jira] [Commented] (SPARK-29693) Bucket map join if the one's bucket number is the multiple of the other

[ https://issues.apache.org/jira/browse/SPARK-29693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964491#comment-16964491 ] Yuming Wang commented on SPARK-29693: - cc [~gwang3] > Bucket map join if the one's

[jira] [Commented] (SPARK-23643) XORShiftRandom.hashSeed allocates unnecessary memory

[ https://issues.apache.org/jira/browse/SPARK-23643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964528#comment-16964528 ] Dongjoon Hyun commented on SPARK-23643: --- I added `release-note` label because this

[jira] [Updated] (SPARK-23643) XORShiftRandom.hashSeed allocates unnecessary memory

[ https://issues.apache.org/jira/browse/SPARK-23643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23643: -- Labels: release-notes (was: ) > XORShiftRandom.hashSeed allocates unnecessary memory > --

[jira] [Updated] (SPARK-23643) XORShiftRandom.hashSeed allocates unnecessary memory

[ https://issues.apache.org/jira/browse/SPARK-23643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23643: -- Priority: Major (was: Trivial) > XORShiftRandom.hashSeed allocates unnecessary memory > -

[jira] [Commented] (SPARK-23643) XORShiftRandom.hashSeed allocates unnecessary memory

[ https://issues.apache.org/jira/browse/SPARK-23643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964529#comment-16964529 ] Dongjoon Hyun commented on SPARK-23643: --- This causes the UI test result difference

[jira] [Created] (SPARK-29694) Execute UDF only once when there are multiple identical UDF usages

Yuming Wang created SPARK-29694: --- Summary: Execute UDF only once when there are multiple identical UDF usages Key: SPARK-29694 URL: https://issues.apache.org/jira/browse/SPARK-29694 Project: Spark

[jira] [Commented] (SPARK-29695) ALTER TABLE (SerDe properties) should look up catalog/table like v2 commands

[ https://issues.apache.org/jira/browse/SPARK-29695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964559#comment-16964559 ] Huaxin Gao commented on SPARK-29695: I will work on this > ALTER TABLE (SerDe prope

[jira] [Created] (SPARK-29695) ALTER TABLE (SerDe properties) should look up catalog/table like v2 commands

Huaxin Gao created SPARK-29695: -- Summary: ALTER TABLE (SerDe properties) should look up catalog/table like v2 commands Key: SPARK-29695 URL: https://issues.apache.org/jira/browse/SPARK-29695 Project: Spa

[jira] [Updated] (SPARK-29657) Iterator spill supporting radix sort with null prefix

[ https://issues.apache.org/jira/browse/SPARK-29657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-29657: --- Issue Type: Bug (was: Improvement) > Iterator spill supporting radix sort with null prefix > --

[jira] [Commented] (SPARK-29694) Execute UDF only once when there are multiple identical UDF usages

[ https://issues.apache.org/jira/browse/SPARK-29694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964571#comment-16964571 ] Xuedong Luan commented on SPARK-29694: -- hi [~yumwang] I will work on this Jira >

[jira] [Assigned] (SPARK-29664) Column.getItem behavior is not consistent with Scala version

[ https://issues.apache.org/jira/browse/SPARK-29664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-29664: Assignee: Terry Kim > Column.getItem behavior is not consistent with Scala version >

[jira] [Resolved] (SPARK-29664) Column.getItem behavior is not consistent with Scala version

[ https://issues.apache.org/jira/browse/SPARK-29664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29664. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26351 [https://gi

[jira] [Assigned] (SPARK-29676) ALTER TABLE (RENAME PARTITION) should look up catalog/table like v2 commands

[ https://issues.apache.org/jira/browse/SPARK-29676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-29676: --- Assignee: Huaxin Gao > ALTER TABLE (RENAME PARTITION) should look up catalog/table like v2

[jira] [Resolved] (SPARK-29676) ALTER TABLE (RENAME PARTITION) should look up catalog/table like v2 commands

[ https://issues.apache.org/jira/browse/SPARK-29676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-29676. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26350 [https://gith

[jira] [Created] (SPARK-29696) Add groupingsets.sql

Takeshi Yamamuro created SPARK-29696: Summary: Add groupingsets.sql Key: SPARK-29696 URL: https://issues.apache.org/jira/browse/SPARK-29696 Project: Spark Issue Type: Sub-task C

[jira] [Commented] (SPARK-27763) Port test cases from PostgreSQL to Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-27763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964583#comment-16964583 ] Takeshi Yamamuro commented on SPARK-27763: -- Thanks for the check, Hyukjin! I've

[jira] [Comment Edited] (SPARK-27763) Port test cases from PostgreSQL to Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-27763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964583#comment-16964583 ] Takeshi Yamamuro edited comment on SPARK-27763 at 11/1/19 3:54 AM: ---

[jira] [Created] (SPARK-29697) Support bit string types/literals

Takeshi Yamamuro created SPARK-29697: Summary: Support bit string types/literals Key: SPARK-29697 URL: https://issues.apache.org/jira/browse/SPARK-29697 Project: Spark Issue Type: Sub-tas

[jira] [Resolved] (SPARK-29686) LinearSVC should persist instances if needed

[ https://issues.apache.org/jira/browse/SPARK-29686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-29686. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26344 [https://gi

[jira] [Created] (SPARK-29698) Support grouping function with multiple arguments

Takeshi Yamamuro created SPARK-29698: Summary: Support grouping function with multiple arguments Key: SPARK-29698 URL: https://issues.apache.org/jira/browse/SPARK-29698 Project: Spark Iss

[jira] [Created] (SPARK-29699) Different answers in nested aggregates with window functions

Takeshi Yamamuro created SPARK-29699: Summary: Different answers in nested aggregates with window functions Key: SPARK-29699 URL: https://issues.apache.org/jira/browse/SPARK-29699 Project: Spark

[jira] [Created] (SPARK-29700) Support nested grouping sets

Takeshi Yamamuro created SPARK-29700: Summary: Support nested grouping sets Key: SPARK-29700 URL: https://issues.apache.org/jira/browse/SPARK-29700 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-29701) Different answers when empty input given in GROUPING SETS

Takeshi Yamamuro created SPARK-29701: Summary: Different answers when empty input given in GROUPING SETS Key: SPARK-29701 URL: https://issues.apache.org/jira/browse/SPARK-29701 Project: Spark

  1   2   >