[jira] [Resolved] (SPARK-30859) Docstring syntax issues prevent proper compilation of documentation

[ https://issues.apache.org/jira/browse/SPARK-30859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30859. -- Fix Version/s: 2.4.6 3.0.0 Resolution: Fixed Fixed in https://github

[jira] [Updated] (SPARK-30859) Docstring syntax issues prevent proper compilation of documentation

[ https://issues.apache.org/jira/browse/SPARK-30859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-30859: - Fix Version/s: (was: 2.4.6) > Docstring syntax issues prevent proper compilation of document

[jira] [Updated] (SPARK-30850) RPC listener wildcard bindings (IPv6)

[ https://issues.apache.org/jira/browse/SPARK-30850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Steadman updated SPARK-30850: - Description: Running Spark Standalone on IPv6-first infrastructure requires that RPC listeners

[jira] [Commented] (SPARK-30852) Use Long instead of Int as argument type in Dataset limit method

[ https://issues.apache.org/jira/browse/SPARK-30852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17038857#comment-17038857 ] Wenchen Fan commented on SPARK-30852: - `df.collect` returns an Array, so Spark can't

[jira] [Resolved] (SPARK-30847) Take productPrefix into account in MurmurHash3.productHash

[ https://issues.apache.org/jira/browse/SPARK-30847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30847. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27601 [https://gith

[jira] [Assigned] (SPARK-30847) Take productPrefix into account in MurmurHash3.productHash

[ https://issues.apache.org/jira/browse/SPARK-30847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30847: --- Assignee: Hyukjin Kwon > Take productPrefix into account in MurmurHash3.productHash > -

[jira] [Resolved] (SPARK-30223) queries in thrift server may read wrong SQL configs

[ https://issues.apache.org/jira/browse/SPARK-30223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30223. - Resolution: Duplicate > queries in thrift server may read wrong SQL configs > --

[jira] [Commented] (SPARK-30223) queries in thrift server may read wrong SQL configs

[ https://issues.apache.org/jira/browse/SPARK-30223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17038818#comment-17038818 ] Wenchen Fan commented on SPARK-30223: - This is fixed by https://github.com/apache/sp

[jira] [Created] (SPARK-30865) Refactor DateTimeUtils

Maxim Gekk created SPARK-30865: -- Summary: Refactor DateTimeUtils Key: SPARK-30865 URL: https://issues.apache.org/jira/browse/SPARK-30865 Project: Spark Issue Type: Improvement Componen

[jira] [Created] (SPARK-30864) Add the user guide for Adaptive Query Execution

Ke Jia created SPARK-30864: -- Summary: Add the user guide for Adaptive Query Execution Key: SPARK-30864 URL: https://issues.apache.org/jira/browse/SPARK-30864 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-30863) Distinguish Cast and AnsiCast in toString()

wuyi created SPARK-30863: Summary: Distinguish Cast and AnsiCast in toString() Key: SPARK-30863 URL: https://issues.apache.org/jira/browse/SPARK-30863 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-30860) Different behavior between rolling and non-rolling event log

[ https://issues.apache.org/jira/browse/SPARK-30860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-30860: - Component/s: (was: Deploy) Spark Core > Different behavior between rolling

[jira] [Updated] (SPARK-30793) Wrong truncations of timestamps before the epoch to minutes and seconds

[ https://issues.apache.org/jira/browse/SPARK-30793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-30793: Fix Version/s: 2.4.6 > Wrong truncations of timestamps before the epoch to minutes and seconds > -

[jira] [Updated] (SPARK-30857) Wrong truncations of timestamps before the epoch to hours and days

[ https://issues.apache.org/jira/browse/SPARK-30857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30857: -- Labels: correctness (was: ) > Wrong truncations of timestamps before the epoch to hours and d

[jira] [Updated] (SPARK-30857) Wrong truncations of timestamps before the epoch to hours and days

[ https://issues.apache.org/jira/browse/SPARK-30857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30857: -- Affects Version/s: 2.3.0 2.3.4 > Wrong truncations of timestamps before

[jira] [Commented] (SPARK-27696) kubernetes driver pod not deleted after finish.

[ https://issues.apache.org/jira/browse/SPARK-27696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17038778#comment-17038778 ] Henry Yu commented on SPARK-27696: -- Too muck un deleted pod will lead to Etcd heavy pre

[jira] [Commented] (SPARK-30860) Different behavior between rolling and non-rolling event log

[ https://issues.apache.org/jira/browse/SPARK-30860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17038761#comment-17038761 ] Adam Binford commented on SPARK-30860: -- Yeah I'll see if I can manage to update it.

[jira] [Commented] (SPARK-30724) Support 'like any' and 'like all' operators

[ https://issues.apache.org/jira/browse/SPARK-30724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17038754#comment-17038754 ] Yuming Wang commented on SPARK-30724: - https://docs.snowflake.net/manuals/sql-refere

[jira] [Updated] (SPARK-30762) Add dtype="float32" support to vector_to_array UDF

[ https://issues.apache.org/jira/browse/SPARK-30762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-30762: --- Fix Version/s: 3.1.0 3.0.0 > Add dtype="float32" support to vector_to_array UDF >

[jira] [Updated] (SPARK-30791) Dataframe add sameResult and sementicHash method

[ https://issues.apache.org/jira/browse/SPARK-30791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-30791: --- Fix Version/s: 3.1.0 > Dataframe add sameResult and sementicHash method > --

[jira] [Updated] (SPARK-30791) Dataframe add sameResult and sementicHash method

[ https://issues.apache.org/jira/browse/SPARK-30791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-30791: --- Affects Version/s: (was: 3.0.0) 3.1.0 > Dataframe add sameResult and seme

[jira] [Updated] (SPARK-30791) Dataframe add sameResult and sementicHash method

[ https://issues.apache.org/jira/browse/SPARK-30791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-30791: --- Target Version/s: 3.1.0 (was: 3.0.0, 3.1.0) > Dataframe add sameResult and sementicHash method > --

[jira] [Resolved] (SPARK-30862) [Scala] date_format() incorrectly compute time when applied against more than 1 column

[ https://issues.apache.org/jira/browse/SPARK-30862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Huang resolved SPARK-30862. --- Resolution: Not A Problem My mistake in applying "hh" instead of "HH" in the date_format() parameter

[jira] [Updated] (SPARK-30862) [Scala] date_format() incorrectly compute time when applied against more than 1 column

[ https://issues.apache.org/jira/browse/SPARK-30862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Huang updated SPARK-30862: -- Description: Here is the sequence of code that demonstrates the weird inconsistent behavior that look

[jira] [Created] (SPARK-30862) [Scala] date_format() incorrectly compute time when applied against more than 1 column

Jim Huang created SPARK-30862: - Summary: [Scala] date_format() incorrectly compute time when applied against more than 1 column Key: SPARK-30862 URL: https://issues.apache.org/jira/browse/SPARK-30862 Proj

[jira] [Created] (SPARK-30861) Deprecate constructor of SQLContext and getOrCreate in SQLContext at PySpark

Hyukjin Kwon created SPARK-30861: Summary: Deprecate constructor of SQLContext and getOrCreate in SQLContext at PySpark Key: SPARK-30861 URL: https://issues.apache.org/jira/browse/SPARK-30861 Project:

[jira] [Resolved] (SPARK-30791) Dataframe add sameResult and sementicHash method

[ https://issues.apache.org/jira/browse/SPARK-30791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-30791. Target Version/s: 3.0.0, 3.1.0 Resolution: Done Resolved by https://github.com/apache/sp

[jira] [Assigned] (SPARK-30832) SQL function doc headers should link to anchors

[ https://issues.apache.org/jira/browse/SPARK-30832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-30832: Assignee: Nicholas Chammas > SQL function doc headers should link to anchors > --

[jira] [Resolved] (SPARK-30832) SQL function doc headers should link to anchors

[ https://issues.apache.org/jira/browse/SPARK-30832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30832. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27585 [https://gi

[jira] [Resolved] (SPARK-30825) Add documents information for window function.

[ https://issues.apache.org/jira/browse/SPARK-30825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30825. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27572 [https://gi

[jira] [Assigned] (SPARK-30825) Add documents information for window function.

[ https://issues.apache.org/jira/browse/SPARK-30825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-30825: Assignee: jiaan.geng > Add documents information for window function. > -

[jira] [Resolved] (SPARK-29174) LOCAL is not supported in INSERT OVERWRITE DIRECTORY to data source

[ https://issues.apache.org/jira/browse/SPARK-29174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-29174. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27039 [https://gi

[jira] [Assigned] (SPARK-29174) LOCAL is not supported in INSERT OVERWRITE DIRECTORY to data source

[ https://issues.apache.org/jira/browse/SPARK-29174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-29174: Assignee: Ajith S > LOCAL is not supported in INSERT OVERWRITE DIRECTORY to data source >

[jira] [Comment Edited] (SPARK-30860) Different behavior between rolling and non-rolling event log

[ https://issues.apache.org/jira/browse/SPARK-30860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17038662#comment-17038662 ] Jungtaek Lim edited comment on SPARK-30860 at 2/17/20 10:21 PM: --

[jira] [Commented] (SPARK-30860) Different behavior between rolling and non-rolling event log

[ https://issues.apache.org/jira/browse/SPARK-30860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17038662#comment-17038662 ] Jungtaek Lim commented on SPARK-30860: -- [~Kimahriman] Thanks for reporting! As we

[jira] [Created] (SPARK-30860) Different behavior between rolling and non-rolling event log

Adam Binford created SPARK-30860: Summary: Different behavior between rolling and non-rolling event log Key: SPARK-30860 URL: https://issues.apache.org/jira/browse/SPARK-30860 Project: Spark

[jira] [Commented] (SPARK-30859) Docstring syntax issues prevent proper compilation of documentation

[ https://issues.apache.org/jira/browse/SPARK-30859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17038585#comment-17038585 ] David Toneian commented on SPARK-30859: --- I have proposed a fix in [PR #27613|https

[jira] [Created] (SPARK-30859) Docstring syntax issues prevent proper compilation of documentation

David Toneian created SPARK-30859: - Summary: Docstring syntax issues prevent proper compilation of documentation Key: SPARK-30859 URL: https://issues.apache.org/jira/browse/SPARK-30859 Project: Spark

[jira] [Resolved] (SPARK-22590) Broadcast thread propagates the localProperties to task

[ https://issues.apache.org/jira/browse/SPARK-22590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22590. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27266 [https://gith

[jira] [Assigned] (SPARK-22590) Broadcast thread propagates the localProperties to task

[ https://issues.apache.org/jira/browse/SPARK-22590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22590: --- Assignee: Ajith S > Broadcast thread propagates the localProperties to task > -

[jira] [Resolved] (SPARK-30808) Thrift server returns wrong timestamps/dates strings before 1582

[ https://issues.apache.org/jira/browse/SPARK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30808. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27552 [https://gith

[jira] [Assigned] (SPARK-30808) Thrift server returns wrong timestamps/dates strings before 1582

[ https://issues.apache.org/jira/browse/SPARK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30808: --- Assignee: Maxim Gekk > Thrift server returns wrong timestamps/dates strings before 1582 > -

[jira] [Created] (SPARK-30858) IntegralDivide's dataType should not depend on SQLConf.get

Herman van Hövell created SPARK-30858: - Summary: IntegralDivide's dataType should not depend on SQLConf.get Key: SPARK-30858 URL: https://issues.apache.org/jira/browse/SPARK-30858 Project: Spark

[jira] [Commented] (SPARK-30793) Wrong truncations of timestamps before the epoch to minutes and seconds

[ https://issues.apache.org/jira/browse/SPARK-30793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17038530#comment-17038530 ] Dongjoon Hyun commented on SPARK-30793: --- I linked SPARK-22829 and added `2.3.4` to

[jira] [Updated] (SPARK-30793) Wrong truncations of timestamps before the epoch to minutes and seconds

[ https://issues.apache.org/jira/browse/SPARK-30793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30793: -- Labels: correctness (was: ) > Wrong truncations of timestamps before the epoch to minutes and

[jira] [Updated] (SPARK-30793) Wrong truncations of timestamps before the epoch to minutes and seconds

[ https://issues.apache.org/jira/browse/SPARK-30793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30793: -- Affects Version/s: 2.3.0 > Wrong truncations of timestamps before the epoch to minutes and sec

[jira] [Updated] (SPARK-30793) Wrong truncations of timestamps before the epoch to minutes and seconds

[ https://issues.apache.org/jira/browse/SPARK-30793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30793: -- Affects Version/s: 2.3.4 > Wrong truncations of timestamps before the epoch to minutes and sec

[jira] [Resolved] (SPARK-30755) Update migration guide and add actionable exception for HIVE-15167

[ https://issues.apache.org/jira/browse/SPARK-30755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30755. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27492 [https://

[jira] [Assigned] (SPARK-30755) Support Hive 1.2.1's Serde after making built-in Hive to 2.3

[ https://issues.apache.org/jira/browse/SPARK-30755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30755: - Assignee: Yuming Wang > Support Hive 1.2.1's Serde after making built-in Hive to 2.3 >

[jira] [Updated] (SPARK-30755) Update migration guide and add actionable exception for HIVE-15167

[ https://issues.apache.org/jira/browse/SPARK-30755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30755: -- Summary: Update migration guide and add actionable exception for HIVE-15167 (was: Support Hiv

[jira] [Updated] (SPARK-30857) Wrong truncations of timestamps before the epoch to hours and days

[ https://issues.apache.org/jira/browse/SPARK-30857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30857: --- Description: Truncations to seconds and minutes of timestamps after the epoch are correct: {code:sql

[jira] [Created] (SPARK-30857) Wrong truncations of timestamps before the epoch to hours and days

Maxim Gekk created SPARK-30857: -- Summary: Wrong truncations of timestamps before the epoch to hours and days Key: SPARK-30857 URL: https://issues.apache.org/jira/browse/SPARK-30857 Project: Spark

[jira] [Updated] (SPARK-30793) Wrong truncations of timestamps before the epoch to minutes and seconds

[ https://issues.apache.org/jira/browse/SPARK-30793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-30793: --- Affects Version/s: 2.4.5 > Wrong truncations of timestamps before the epoch to minutes and seconds >

[jira] [Resolved] (SPARK-30806) Evaluate once per group in UnboundedWindowFunctionFrame

[ https://issues.apache.org/jira/browse/SPARK-30806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-30806. --- Fix Version/s: 3.0.0 Assignee: EdisonWang Resolution: Fixed > Evalua

[jira] [Resolved] (SPARK-30829) Define LegacyBehaviorPolicy enumeration as the common value for result change configs

[ https://issues.apache.org/jira/browse/SPARK-30829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30829. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27579 [https://gith

[jira] [Assigned] (SPARK-30829) Define LegacyBehaviorPolicy enumeration as the common value for result change configs

[ https://issues.apache.org/jira/browse/SPARK-30829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30829: --- Assignee: Yuanjian Li > Define LegacyBehaviorPolicy enumeration as the common value for res

[jira] [Updated] (SPARK-30784) Hive 2.3 profile should still use orc-nohive

[ https://issues.apache.org/jira/browse/SPARK-30784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30784: -- Priority: Critical (was: Blocker) > Hive 2.3 profile should still use orc-nohive > --

[jira] [Commented] (SPARK-30784) Hive 2.3 profile should still use orc-nohive

[ https://issues.apache.org/jira/browse/SPARK-30784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17038515#comment-17038515 ] Dongjoon Hyun commented on SPARK-30784: --- Hi, [~yhuai]. I don't think this is a blo

[jira] [Updated] (SPARK-30850) RPC listener wildcard bindings (IPv6)

[ https://issues.apache.org/jira/browse/SPARK-30850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Steadman updated SPARK-30850: - Description: Running Spark Standalone on IPv6-first infrastructure requires that RPC listeners

[jira] [Updated] (SPARK-30850) RPC listener wildcard bindings (IPv6)

[ https://issues.apache.org/jira/browse/SPARK-30850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Steadman updated SPARK-30850: - Description: Running Spark Standalone on IPv6-first infrastructure requires that RPC listeners

[jira] [Updated] (SPARK-30850) RPC listener wildcard bindings (IPv6)

[ https://issues.apache.org/jira/browse/SPARK-30850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Steadman updated SPARK-30850: - Description: Running Spark Standalone on IPv6-first infrastructure requires that RPC listeners

[jira] [Updated] (SPARK-30850) RPC listener wildcard bindings (IPv6)

[ https://issues.apache.org/jira/browse/SPARK-30850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Steadman updated SPARK-30850: - Description: Running Spark Standalone on IPv6-first infrastructure requires that RPC listeners

[jira] [Updated] (SPARK-30850) RPC listener wildcard bindings (IPv6)

[ https://issues.apache.org/jira/browse/SPARK-30850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Steadman updated SPARK-30850: - Description: Running Spark Standalone on IPv6-first infrastructure requires that RPC listeners

[jira] [Created] (SPARK-30856) SQLContext retains reference to unusable instance after SparkContext restarted

Alex Favaro created SPARK-30856: --- Summary: SQLContext retains reference to unusable instance after SparkContext restarted Key: SPARK-30856 URL: https://issues.apache.org/jira/browse/SPARK-30856 Project:

[jira] [Updated] (SPARK-30855) Issue with Binding attribute: Couldn't find _gen_alias_ when using 'explode' function.

[ https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoit Roy updated SPARK-30855: --- Description: Im in the early phase of writting a custom spark datasource for messagepack.   I have

[jira] [Updated] (SPARK-30855) Issue with Binding attribute: Couldn't find _gen_alias_ when using 'explode' function.

[ https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoit Roy updated SPARK-30855: --- Description: Im in the early phase of writting a custom spark datasource for messagepack.   I have

[jira] [Updated] (SPARK-30855) Issue with Binding attribute: Couldn't find _gen_alias_ when using 'explode' function.

[ https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoit Roy updated SPARK-30855: --- Attachment: (was: msgpack-datasource.zip) > Issue with Binding attribute: Couldn't find _gen_ali

[jira] [Updated] (SPARK-30855) Issue with Binding attribute: Couldn't find _gen_alias_ when using 'explode' function.

[ https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoit Roy updated SPARK-30855: --- Attachment: messagepack-datasource.zip > Issue with Binding attribute: Couldn't find _gen_alias_ whe

[jira] [Updated] (SPARK-30855) Issue with Binding attribute: Couldn't find _gen_alias_ when using 'explode' function.

[ https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoit Roy updated SPARK-30855: --- Description: Im in the early phase of writting a custom spark datasource for messagepack. I have a

[jira] [Updated] (SPARK-30855) Issue with Binding attribute: Couldn't find _gen_alias_ when using 'explode' function.

[ https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoit Roy updated SPARK-30855: --- Description: Im in the early phase of writting a custom spark datasource for messagepack. I have a

[jira] [Created] (SPARK-30855) Issue with Binding attribute: Couldn't find _gen_alias_ when using 'explode' function.

Benoit Roy created SPARK-30855: -- Summary: Issue with Binding attribute: Couldn't find _gen_alias_ when using 'explode' function. Key: SPARK-30855 URL: https://issues.apache.org/jira/browse/SPARK-30855 Pr

[jira] [Updated] (SPARK-30855) Issue with Binding attribute: Couldn't find _gen_alias_ when using 'explode' function.

[ https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoit Roy updated SPARK-30855: --- Attachment: msgpack-datasource.zip > Issue with Binding attribute: Couldn't find _gen_alias_ when us

[jira] [Resolved] (SPARK-30736) One-Pass ChiSquareTest

[ https://issues.apache.org/jira/browse/SPARK-30736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30736. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27461 [https://gi

[jira] [Assigned] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-29089: Assignee: Arwin S Tio > DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecess

[jira] [Resolved] (SPARK-29089) DataFrameReader bottleneck in DataSource#checkAndGlobPathIfNecessary when reading large amount of S3 files

[ https://issues.apache.org/jira/browse/SPARK-29089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-29089. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 25899 [https://gi

[jira] [Resolved] (SPARK-30793) Wrong truncations of timestamps before the epoch to minutes and seconds

[ https://issues.apache.org/jira/browse/SPARK-30793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30793. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27543 [https://gith

[jira] [Assigned] (SPARK-30793) Wrong truncations of timestamps before the epoch to minutes and seconds

[ https://issues.apache.org/jira/browse/SPARK-30793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30793: --- Assignee: Maxim Gekk > Wrong truncations of timestamps before the epoch to minutes and seco

[jira] [Comment Edited] (SPARK-30852) Use Long instead of Int as argument type in Dataset limit method

[ https://issues.apache.org/jira/browse/SPARK-30852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17038304#comment-17038304 ] Rakesh Raushan edited comment on SPARK-30852 at 2/17/20 12:33 PM:

[jira] [Commented] (SPARK-30852) Use Long instead of Int as argument type in Dataset limit method

[ https://issues.apache.org/jira/browse/SPARK-30852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17038304#comment-17038304 ] Rakesh Raushan commented on SPARK-30852: [~cloud_fan] [~dongjoon] long value can

[jira] [Assigned] (SPARK-30346) Improve logging when events dropped

[ https://issues.apache.org/jira/browse/SPARK-30346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30346: --- Assignee: liupengcheng > Improve logging when events dropped >

[jira] [Resolved] (SPARK-30346) Improve logging when events dropped

[ https://issues.apache.org/jira/browse/SPARK-30346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30346. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27002 [https://gith

[jira] [Updated] (SPARK-30854) ThriftServer blocked by drop table command/getDelegationToken

[ https://issues.apache.org/jira/browse/SPARK-30854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-30854: Attachment: getDelegationToken.png > ThriftServer blocked by drop table command/getDelegationToken

[jira] [Updated] (SPARK-30854) ThriftServer blocked by drop table command/getDelegationToken

[ https://issues.apache.org/jira/browse/SPARK-30854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-30854: Attachment: drop table command.png > ThriftServer blocked by drop table command/getDelegationToken

[jira] [Updated] (SPARK-30854) ThriftServer blocked by drop table command/getDelegationToken

[ https://issues.apache.org/jira/browse/SPARK-30854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-30854: Attachment: drop table.png > ThriftServer blocked by drop table command/getDelegationToken > -

[jira] [Created] (SPARK-30854) ThriftServer blocked by drop table command/getDelegationToken

Yuming Wang created SPARK-30854: --- Summary: ThriftServer blocked by drop table command/getDelegationToken Key: SPARK-30854 URL: https://issues.apache.org/jira/browse/SPARK-30854 Project: Spark

[jira] [Updated] (SPARK-30853) Error communicating with MapOutputTracker issue

[ https://issues.apache.org/jira/browse/SPARK-30853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-30853: Attachment: heap dump.png > Error communicating with MapOutputTracker issue >

[jira] [Updated] (SPARK-30853) Error communicating with MapOutputTracker issue

[ https://issues.apache.org/jira/browse/SPARK-30853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-30853: Description: {noformat} org.apache.spark.SparkException: Error communicating with MapOutputTracker

[jira] [Created] (SPARK-30853) Error communicating with MapOutputTracker issue

Yuming Wang created SPARK-30853: --- Summary: Error communicating with MapOutputTracker issue Key: SPARK-30853 URL: https://issues.apache.org/jira/browse/SPARK-30853 Project: Spark Issue Type: Imp

[jira] [Resolved] (SPARK-30827) Direct relationship is not documented in configurations in "spark.history.*" namespace

[ https://issues.apache.org/jira/browse/SPARK-30827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30827. -- Fix Version/s: 3.0.0 Resolution: Fixed Fixed in https://github.com/apache/spark/pull/27

[jira] [Commented] (SPARK-30852) Use Long instead of Int as argument type in Dataset limit method

[ https://issues.apache.org/jira/browse/SPARK-30852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17038278#comment-17038278 ] Rakesh Raushan commented on SPARK-30852: I will check the issue. > Use Long ins

[jira] [Updated] (SPARK-30852) Use Long instead of Int as argument type in Dataset limit method

[ https://issues.apache.org/jira/browse/SPARK-30852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damianos Christophides updated SPARK-30852: --- Component/s: (was: Input/Output) SQL > Use Long instead

[jira] [Updated] (SPARK-30852) Use Long instead of Int as argument type in Dataset limit method

[ https://issues.apache.org/jira/browse/SPARK-30852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damianos Christophides updated SPARK-30852: --- Issue Type: Improvement (was: Bug) > Use Long instead of Int as argument ty

[jira] [Commented] (SPARK-30711) 64KB JVM bytecode limit - janino.InternalCompilerException

[ https://issues.apache.org/jira/browse/SPARK-30711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17038250#comment-17038250 ] Frederik Schreiber commented on SPARK-30711: I tried to replace the "when`s"

[jira] [Updated] (SPARK-30849) Application failed due to failed to get MapStatuses broadcast

[ https://issues.apache.org/jira/browse/SPARK-30849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liupengcheng updated SPARK-30849: - Issue Type: Bug (was: Improvement) > Application failed due to failed to get MapStatuses broadc

[jira] [Created] (SPARK-30852) Use Long instead of Int as argument type in Dataset limit method

Damianos Christophides created SPARK-30852: -- Summary: Use Long instead of Int as argument type in Dataset limit method Key: SPARK-30852 URL: https://issues.apache.org/jira/browse/SPARK-30852

[jira] [Commented] (SPARK-30851) Add 'path' field to the 'LoadInstanceEnd' ML listener event

[ https://issues.apache.org/jira/browse/SPARK-30851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17038227#comment-17038227 ] Vladislav Glinskiy commented on SPARK-30851: cc [~hyukjin.kwon] [~kabhwan]

[jira] [Commented] (SPARK-30851) Add 'path' field to the 'LoadInstanceEnd' ML listener event

[ https://issues.apache.org/jira/browse/SPARK-30851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17038224#comment-17038224 ] Vladislav Glinskiy commented on SPARK-30851: Created a PR to add 'path' fiel

[jira] [Created] (SPARK-30851) Add 'path' field to the 'LoadInstanceEnd' ML listener event

Vladislav Glinskiy created SPARK-30851: -- Summary: Add 'path' field to the 'LoadInstanceEnd' ML listener event Key: SPARK-30851 URL: https://issues.apache.org/jira/browse/SPARK-30851 Project: Spar

[jira] [Updated] (SPARK-30850) RPC listener wildcard bindings (IPv6)

[ https://issues.apache.org/jira/browse/SPARK-30850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Steadman updated SPARK-30850: - Description: Running Spark Standalone on IPv6-first infrastructure requires that RPC listeners

[jira] [Created] (SPARK-30850) RPC listener wildcard bindings (IPv6)

Ben Steadman created SPARK-30850: Summary: RPC listener wildcard bindings (IPv6) Key: SPARK-30850 URL: https://issues.apache.org/jira/browse/SPARK-30850 Project: Spark Issue Type: Improvement

  1   2   >