[jira] [Resolved] (SPARK-28332) SQLMetric wrong initValue

[ https://issues.apache.org/jira/browse/SPARK-28332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28332. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26899

[jira] [Created] (SPARK-30329) add iterator/foreach methods for Vectors

zhengruifeng created SPARK-30329: Summary: add iterator/foreach methods for Vectors Key: SPARK-30329 URL: https://issues.apache.org/jira/browse/SPARK-30329 Project: Spark Issue Type: Wish

[jira] [Assigned] (SPARK-30329) add iterator/foreach methods for Vectors

[ https://issues.apache.org/jira/browse/SPARK-30329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-30329: Assignee: zhengruifeng > add iterator/foreach methods for Vectors >

[jira] [Created] (SPARK-30328) Fail to write local files with RDD.saveTextFile when setting the incorrect Hadoop configuration files

chendihao created SPARK-30328: - Summary: Fail to write local files with RDD.saveTextFile when setting the incorrect Hadoop configuration files Key: SPARK-30328 URL: https://issues.apache.org/jira/browse/SPARK-30328

[jira] [Updated] (SPARK-26618) Make typed Timestamp/Date literals consistent to casting

[ https://issues.apache.org/jira/browse/SPARK-26618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-26618: Labels: (was: correctness) > Make typed Timestamp/Date literals consistent to casting >

[jira] [Updated] (SPARK-26618) Make typed Timestamp/Date literals consistent to casting

[ https://issues.apache.org/jira/browse/SPARK-26618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-26618: Labels: correctness (was: ) > Make typed Timestamp/Date literals consistent to casting >

[jira] [Commented] (SPARK-29699) Different answers in nested aggregates with window functions

[ https://issues.apache.org/jira/browse/SPARK-29699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002122#comment-17002122 ] Takeshi Yamamuro commented on SPARK-29699: -- A root cause is the NULL order difference in

[jira] [Updated] (SPARK-29699) Different answers in nested aggregates with window functions

[ https://issues.apache.org/jira/browse/SPARK-29699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-29699: - Description: A nested aggregate below with a window function seems to have different

[jira] [Created] (SPARK-30327) Caused by: java.lang.ArrayIndexOutOfBoundsException: -1

lujun created SPARK-30327: - Summary: Caused by: java.lang.ArrayIndexOutOfBoundsException: -1 Key: SPARK-30327 URL: https://issues.apache.org/jira/browse/SPARK-30327 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-6221) SparkSQL should support auto merging output files

[ https://issues.apache.org/jira/browse/SPARK-6221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002085#comment-17002085 ] Tian Tian edited comment on SPARK-6221 at 12/23/19 3:24 AM: I encounterd this

[jira] [Comment Edited] (SPARK-6221) SparkSQL should support auto merging output files

[ https://issues.apache.org/jira/browse/SPARK-6221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002085#comment-17002085 ] Tian Tian edited comment on SPARK-6221 at 12/23/19 3:21 AM: I encounterd this

[jira] [Commented] (SPARK-6221) SparkSQL should support auto merging output files

[ https://issues.apache.org/jira/browse/SPARK-6221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002085#comment-17002085 ] Tian Tian commented on SPARK-6221: -- I encounterd this problem and find

[jira] [Commented] (SPARK-30316) data size boom after shuffle writing dataframe save as parquet

[ https://issues.apache.org/jira/browse/SPARK-30316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002049#comment-17002049 ] Cesc commented on SPARK-30316: --- However, the rows of two results are the same. > data size boom after

[jira] [Updated] (SPARK-30326) Raise exception if analyzer exceed max iterations

[ https://issues.apache.org/jira/browse/SPARK-30326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Wu updated SPARK-30326: --- Description: Currently, both analyzer and optimizer just log warning message if rule execution exceed max

[jira] [Resolved] (SPARK-30269) Should use old partition stats to decide whether to update stats when analyzing partition

[ https://issues.apache.org/jira/browse/SPARK-30269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30269. -- Fix Version/s: (was: 3.0.0) Resolution: Fixed Issue resolved by pull request 26963

[jira] [Assigned] (SPARK-30269) Should use old partition stats to decide whether to update stats when analyzing partition

[ https://issues.apache.org/jira/browse/SPARK-30269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30269: Assignee: Zhenhua Wang > Should use old partition stats to decide whether to update

[jira] [Assigned] (SPARK-30128) Promote remaining "hidden" PySpark DataFrameReader options to load APIs

[ https://issues.apache.org/jira/browse/SPARK-30128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30128: Assignee: Hyukjin Kwon > Promote remaining "hidden" PySpark DataFrameReader options to

[jira] [Resolved] (SPARK-30128) Promote remaining "hidden" PySpark DataFrameReader options to load APIs

[ https://issues.apache.org/jira/browse/SPARK-30128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30128. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 26958

[jira] [Updated] (SPARK-27762) Support user provided avro schema for writing fields with different ordering

[ https://issues.apache.org/jira/browse/SPARK-27762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27762: Issue Type: Bug (was: New Feature) > Support user provided avro schema for writing fields with different