[jira] [Commented] (SPARK-36933) Reduce duplication in TaskMemoryManager.acquireExecutionMemory

2021-10-05 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424654#comment-17424654 ] Tim Armstrong commented on SPARK-36933: --- I intend to submit a patch for this. > Reduce

[jira] [Created] (SPARK-36933) Reduce duplication in TaskMemoryManager.acquireExecutionMemory

2021-10-05 Thread Tim Armstrong (Jira)
Tim Armstrong created SPARK-36933: - Summary: Reduce duplication in TaskMemoryManager.acquireExecutionMemory Key: SPARK-36933 URL: https://issues.apache.org/jira/browse/SPARK-36933 Project: Spark

[jira] [Commented] (SPARK-36501) LSHModel.approxSimilarityJoin can generate invalid column names

2021-08-12 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17398252#comment-17398252 ] Tim Armstrong commented on SPARK-36501: --- I have a fix for this... > LSHModel.approxSimilarityJoin

[jira] [Created] (SPARK-36501) LSHModel.approxSimilarityJoin can generate invalid column names

2021-08-12 Thread Tim Armstrong (Jira)
Tim Armstrong created SPARK-36501: - Summary: LSHModel.approxSimilarityJoin can generate invalid column names Key: SPARK-36501 URL: https://issues.apache.org/jira/browse/SPARK-36501 Project: Spark

[jira] [Updated] (SPARK-36229) conv() inconsistently handles invalid strings with > 64 invalid characters

2021-07-20 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong updated SPARK-36229: -- Environment: (was: SPARK-33428 fixed ArrayIndexOutofBoundsException but introduced a new

[jira] [Commented] (SPARK-36229) conv() inconsistently handles invalid strings with > 64 invalid characters

2021-07-20 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17384441#comment-17384441 ] Tim Armstrong commented on SPARK-36229: --- [~dgd_contributor] [~wenchen] > conv() inconsistently

[jira] [Updated] (SPARK-36229) conv() inconsistently handles invalid strings with > 64 invalid characters

2021-07-20 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong updated SPARK-36229: -- Description: SPARK-33428 fixed ArrayIndexOutofBoundsException but introduced a new

[jira] [Created] (SPARK-36229) conv() inconsistently handles invalid strings with > 64 invalid characters

2021-07-20 Thread Tim Armstrong (Jira)
Tim Armstrong created SPARK-36229: - Summary: conv() inconsistently handles invalid strings with > 64 invalid characters Key: SPARK-36229 URL: https://issues.apache.org/jira/browse/SPARK-36229

[jira] [Updated] (SPARK-36229) conv() inconsistently handles invalid strings with > 64 invalid characters

2021-07-20 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong updated SPARK-36229: -- Affects Version/s: (was: 3.1.2) 3.2.0 > conv() inconsistently

[jira] [Commented] (SPARK-35980) ThreadAudit test helper should log whether a thread is a Daemon thread

2021-07-01 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373065#comment-17373065 ] Tim Armstrong commented on SPARK-35980: --- I plan to contribute a fix for this. > ThreadAudit test

[jira] [Created] (SPARK-35980) ThreadAudit test helper should log whether a thread is a Daemon thread

2021-07-01 Thread Tim Armstrong (Jira)
Tim Armstrong created SPARK-35980: - Summary: ThreadAudit test helper should log whether a thread is a Daemon thread Key: SPARK-35980 URL: https://issues.apache.org/jira/browse/SPARK-35980 Project:

[jira] [Updated] (SPARK-35207) hash() and other hash builtins do not normalize negative zero

2021-04-23 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong updated SPARK-35207: -- Description: I would generally expect that {{x = y => hash(x) = hash(y)}}. However +-0 hash

[jira] [Updated] (SPARK-35207) hash() and other hash builtins do not normalize negative zero

2021-04-23 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong updated SPARK-35207: -- Description: I would generally expect that {{x = y => hash( x ) = hash( y )}}. However +-0

[jira] [Created] (SPARK-35207) hash() and other hash builtins do not normalize negative zero

2021-04-23 Thread Tim Armstrong (Jira)
Tim Armstrong created SPARK-35207: - Summary: hash() and other hash builtins do not normalize negative zero Key: SPARK-35207 URL: https://issues.apache.org/jira/browse/SPARK-35207 Project: Spark

[jira] [Created] (SPARK-34909) conv() does not convert negative inputs to unsigned correctly

2021-03-30 Thread Tim Armstrong (Jira)
Tim Armstrong created SPARK-34909: - Summary: conv() does not convert negative inputs to unsigned correctly Key: SPARK-34909 URL: https://issues.apache.org/jira/browse/SPARK-34909 Project: Spark

[jira] [Updated] (SPARK-34857) AtLeastNNonNulls does not show up correctly in explain

2021-03-24 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong updated SPARK-34857: -- Priority: Minor (was: Major) > AtLeastNNonNulls does not show up correctly in explain >

[jira] [Created] (SPARK-34857) AtLeastNNonNulls does not show up correctly in explain

2021-03-24 Thread Tim Armstrong (Jira)
Tim Armstrong created SPARK-34857: - Summary: AtLeastNNonNulls does not show up correctly in explain Key: SPARK-34857 URL: https://issues.apache.org/jira/browse/SPARK-34857 Project: Spark

[jira] [Commented] (SPARK-34857) AtLeastNNonNulls does not show up correctly in explain

2021-03-24 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17308055#comment-17308055 ] Tim Armstrong commented on SPARK-34857: --- [~LI,Xiao] i would like to take this one on. >

[jira] [Updated] (SPARK-34857) AtLeastNNonNulls does not show up correctly in explain

2021-03-24 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong updated SPARK-34857: -- Description: I see this in an explain plan {noformat} (12) Filter Input [3]: [c1#2410L,

[jira] [Updated] (SPARK-34857) AtLeastNNonNulls does not show up correctly in explain

2021-03-24 Thread Tim Armstrong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Armstrong updated SPARK-34857: -- Environment: (was: I see this in an explain plan {noformat} (12) Filter Input [3]:

[jira] [Commented] (SPARK-20937) Describe spark.sql.parquet.writeLegacyFormat property in Spark SQL, DataFrames and Datasets Guide

2018-09-24 Thread Tim Armstrong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625943#comment-16625943 ] Tim Armstrong commented on SPARK-20937: --- [~srowen] I would say it is. I know Spark made the change

[jira] [Commented] (SPARK-20937) Describe spark.sql.parquet.writeLegacyFormat property in Spark SQL, DataFrames and Datasets Guide

2017-07-14 Thread Tim Armstrong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087506#comment-16087506 ] Tim Armstrong commented on SPARK-20937: --- +1 too. The documentation should also be clear that the

[jira] [Commented] (SPARK-20297) Parquet Decimal(12,2) written by Spark is unreadable by Hive and Impala

2017-04-19 Thread Tim Armstrong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975559#comment-15975559 ] Tim Armstrong commented on SPARK-20297: --- The standard doesn't say that smaller decimals *have* to