[jira] [Updated] (SPARK-31325) Control a plan explain mode in the events of SQL listeners via SQLConf

[ https://issues.apache.org/jira/browse/SPARK-31325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-31325: - Summary: Control a plan explain mode in the events of SQL listeners via SQLConf (was:

[jira] [Created] (SPARK-31325) Control a plan explain mode in listeners via SQLConf

Takeshi Yamamuro created SPARK-31325: Summary: Control a plan explain mode in listeners via SQLConf Key: SPARK-31325 URL: https://issues.apache.org/jira/browse/SPARK-31325 Project: Spark

[jira] [Commented] (SPARK-30839) Add version information for Spark configuration

[ https://issues.apache.org/jira/browse/SPARK-30839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073346#comment-17073346 ] Hyukjin Kwon commented on SPARK-30839: -- [~beliefer]do you have more tickets or PRs to add? > Add

[jira] [Resolved] (SPARK-31324) StreamingQuery stop() timeout exception should include the stream ID

[ https://issues.apache.org/jira/browse/SPARK-31324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31324. -- Fix Version/s: 3.0.0 Resolution: Fixed Fixed in

[jira] [Commented] (SPARK-31324) StreamingQuery stop() timeout exception should include the stream ID

[ https://issues.apache.org/jira/browse/SPARK-31324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073289#comment-17073289 ] Mukul Murthy commented on SPARK-31324: -- Gotcha, thanks. Was not planning on backporting this, but I

[jira] [Resolved] (SPARK-30297) Executor heartbeat expired cause app hung up forever

[ https://issues.apache.org/jira/browse/SPARK-30297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30297. --- Resolution: Duplicate > Executor heartbeat expired cause app hung up forever >

[jira] [Commented] (SPARK-31324) StreamingQuery stop() timeout exception should include the stream ID

[ https://issues.apache.org/jira/browse/SPARK-31324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073273#comment-17073273 ] Dongjoon Hyun commented on SPARK-31324: --- Hi, [~mukulmurthy]. Please use the version on `master`

[jira] [Updated] (SPARK-31324) StreamingQuery stop() timeout exception should include the stream ID

[ https://issues.apache.org/jira/browse/SPARK-31324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31324: -- Priority: Trivial (was: Major) > StreamingQuery stop() timeout exception should include the

[jira] [Updated] (SPARK-31324) StreamingQuery stop() timeout exception should include the stream ID

[ https://issues.apache.org/jira/browse/SPARK-31324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31324: -- Affects Version/s: (was: 2.4.4) 3.1.0 > StreamingQuery stop()

[jira] [Commented] (SPARK-31312) Transforming Hive simple UDF (using JAR) expression may incur CNFE in later evaluation

[ https://issues.apache.org/jira/browse/SPARK-31312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073264#comment-17073264 ] Jungtaek Lim commented on SPARK-31312: -- No, it wasn't triggered by SPARK-26560 and should be

[jira] [Commented] (SPARK-30951) Potential data loss for legacy applications after switch to proleptic Gregorian calendar

[ https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073233#comment-17073233 ] Dongjoon Hyun commented on SPARK-30951: --- The decision will depend on how much people are exposed

[jira] [Commented] (SPARK-30951) Potential data loss for legacy applications after switch to proleptic Gregorian calendar

[ https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073231#comment-17073231 ] Dongjoon Hyun commented on SPARK-30951: --- I'm +1 basically. Please make a Jira issue and PR for

[jira] [Created] (SPARK-31324) StreamingQuery stop() timeout exception should include the stream ID

Mukul Murthy created SPARK-31324: Summary: StreamingQuery stop() timeout exception should include the stream ID Key: SPARK-31324 URL: https://issues.apache.org/jira/browse/SPARK-31324 Project: Spark

[jira] [Commented] (SPARK-29574) spark with user provided hadoop doesn't work on kubernetes

[ https://issues.apache.org/jira/browse/SPARK-29574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073145#comment-17073145 ] Devin Boyer commented on SPARK-29574: - Will this or can this change be backported to future versions

[jira] [Resolved] (SPARK-31322) rename QueryPlan.collectInPlanAndSubqueries to collectWithSubqueries

[ https://issues.apache.org/jira/browse/SPARK-31322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31322. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28092

[jira] [Assigned] (SPARK-31285) Do not upper case schedule mode

[ https://issues.apache.org/jira/browse/SPARK-31285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31285: - Assignee: ulysses you > Do not upper case schedule mode >

[jira] [Resolved] (SPARK-31285) Do not upper case schedule mode

[ https://issues.apache.org/jira/browse/SPARK-31285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31285. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28049

[jira] [Comment Edited] (SPARK-31312) Transforming Hive simple UDF (using JAR) expression may incur CNFE in later evaluation

[ https://issues.apache.org/jira/browse/SPARK-31312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073075#comment-17073075 ] Dongjoon Hyun edited comment on SPARK-31312 at 4/1/20, 6:42 PM: Hi,

[jira] [Updated] (SPARK-31312) Transforming Hive simple UDF (using JAR) expression may incur CNFE in later evaluation

[ https://issues.apache.org/jira/browse/SPARK-31312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31312: -- Affects Version/s: (was: 3.1.0) > Transforming Hive simple UDF (using JAR) expression may

[jira] [Commented] (SPARK-31312) Transforming Hive simple UDF (using JAR) expression may incur CNFE in later evaluation

[ https://issues.apache.org/jira/browse/SPARK-31312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073075#comment-17073075 ] Dongjoon Hyun commented on SPARK-31312: --- Hi, [~kabhwan]. Could you add old versions to `Affected

[jira] [Updated] (SPARK-31313) Add `m01` node name to support Minikube 1.8.x

[ https://issues.apache.org/jira/browse/SPARK-31313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31313: -- Fix Version/s: (was: 3.1.0) 3.0.0 > Add `m01` node name to support

[jira] [Updated] (SPARK-31313) Add `m01` node name to support Minikube 1.8.x

[ https://issues.apache.org/jira/browse/SPARK-31313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31313: -- Affects Version/s: (was: 3.1.0) 3.0.0 > Add `m01` node name to

[jira] [Updated] (SPARK-31299) Pyspark.ml.clustering illegalArgumentException with dataframe created from rows

[ https://issues.apache.org/jira/browse/SPARK-31299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-31299: - Description: I hope this is the right place and way to report a bug in (at least) the PySpark

[jira] [Commented] (SPARK-31299) Pyspark.ml.clustering illegalArgumentException with dataframe created from rows

[ https://issues.apache.org/jira/browse/SPARK-31299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073027#comment-17073027 ] Bryan Cutler commented on SPARK-31299: -- It looks like you are using {{DenseVector}} from

[jira] [Resolved] (SPARK-31299) Pyspark.ml.clustering illegalArgumentException with dataframe created from rows

[ https://issues.apache.org/jira/browse/SPARK-31299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-31299. -- Resolution: Not A Problem > Pyspark.ml.clustering illegalArgumentException with dataframe

[jira] [Commented] (SPARK-30951) Potential data loss for legacy applications after switch to proleptic Gregorian calendar

[ https://issues.apache.org/jira/browse/SPARK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073026#comment-17073026 ] Bruce Robbins commented on SPARK-30951: --- Since there is some inherit danger in a migrating user

[jira] [Created] (SPARK-31323) Stage level scheduling: dedup resource profiles on creation

Thomas Graves created SPARK-31323: - Summary: Stage level scheduling: dedup resource profiles on creation Key: SPARK-31323 URL: https://issues.apache.org/jira/browse/SPARK-31323 Project: Spark

[jira] [Commented] (SPARK-30443) "Managed memory leak detected" even with no calls to take() or limit()

[ https://issues.apache.org/jira/browse/SPARK-30443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17072857#comment-17072857 ] Ben Roling commented on SPARK-30443: Thanks [~xiaojuwu]. Using explain() on the test program

[jira] [Created] (SPARK-31322) rename QueryPlan.collectInPlanAndSubqueries to collectWithSubqueries

Wenchen Fan created SPARK-31322: --- Summary: rename QueryPlan.collectInPlanAndSubqueries to collectWithSubqueries Key: SPARK-31322 URL: https://issues.apache.org/jira/browse/SPARK-31322 Project: Spark

[jira] [Commented] (SPARK-28624) make_date is inconsistent when reading from table

[ https://issues.apache.org/jira/browse/SPARK-28624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17072694#comment-17072694 ] Yuming Wang commented on SPARK-28624: - [~maxgekk] collect() also returns incorrect result: !collect

[jira] [Updated] (SPARK-28624) make_date is inconsistent when reading from table

[ https://issues.apache.org/jira/browse/SPARK-28624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28624: Attachment: collect make_date.png > make_date is inconsistent when reading from table >

[jira] [Updated] (SPARK-31320) Fix release script for 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-31320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31320: - Summary: Fix release script for 3.0.0 (was: fix release script for 3.0.0) > Fix release script

[jira] [Resolved] (SPARK-31320) fix release script for 3.0.0

[ https://issues.apache.org/jira/browse/SPARK-31320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31320. -- Fix Version/s: 3.0.0 Resolution: Fixed Fixed in

[jira] [Created] (SPARK-31321) Remove SaveMode check in v2 FileWriteBuilder

Kent Yao created SPARK-31321: Summary: Remove SaveMode check in v2 FileWriteBuilder Key: SPARK-31321 URL: https://issues.apache.org/jira/browse/SPARK-31321 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-31311) Benchmark date-time rebasing in ORC datasource

[ https://issues.apache.org/jira/browse/SPARK-31311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31311. - Resolution: Fixed Issue resolved by pull request 28076

[jira] [Commented] (SPARK-31301) flatten the result dataframe of tests in stat

[ https://issues.apache.org/jira/browse/SPARK-31301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17072428#comment-17072428 ] Huaxin Gao commented on SPARK-31301: It makes sense to flatten the output. Since the testChiSquare

[jira] [Commented] (SPARK-31301) flatten the result dataframe of tests in stat

[ https://issues.apache.org/jira/browse/SPARK-31301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17072408#comment-17072408 ] zhengruifeng commented on SPARK-31301: -- Another advantage that returning rows is that: high-dim

[jira] [Reopened] (SPARK-31309) Migrate the ChiSquareTest from MLlib to ML

[ https://issues.apache.org/jira/browse/SPARK-31309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reopened SPARK-31309: -- > Migrate the ChiSquareTest from MLlib to ML > -- > >