[jira] [Updated] (SPARK-44973) Fix ArrayIndexOutOfBoundsException in conv()

2023-11-21 Thread Gera Shegalov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated SPARK-44973: -- Affects Version/s: 3.0.3 > Fix ArrayIndexOutOfBoundsException in conv() >

[jira] [Commented] (SPARK-44973) CONV('-9223372036854775808', 10, -2) throws ArrayIndexOutOfBoundsException

2023-11-20 Thread Gera Shegalov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17788157#comment-17788157 ] Gera Shegalov commented on SPARK-44973: --- 3.0.3 is the oldest version on my box and it exhibits the

[jira] [Commented] (SPARK-20075) Support classifier, packaging in Maven coordinates

2023-10-31 Thread Gera Shegalov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781550#comment-17781550 ] Gera Shegalov commented on SPARK-20075: --- This would be a great feature that can help spark-rapids

[jira] [Commented] (SPARK-43389) spark.read.csv throws NullPointerException when lineSep is set to None

2023-10-03 Thread Gera Shegalov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17771698#comment-17771698 ] Gera Shegalov commented on SPARK-43389: --- There is a symmetrical issue on the DataFrameWriter side:

[jira] [Created] (SPARK-44973) CONV('-9223372036854775808', 10, -2) throws ArrayIndexOutOfBoundsException

2023-08-25 Thread Gera Shegalov (Jira)
Gera Shegalov created SPARK-44973: - Summary: CONV('-9223372036854775808', 10, -2) throws ArrayIndexOutOfBoundsException Key: SPARK-44973 URL: https://issues.apache.org/jira/browse/SPARK-44973

[jira] [Updated] (SPARK-44943) CONV produces incorrect result near Long.MIN_VALUE, fails to detect overflow

2023-08-24 Thread Gera Shegalov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated SPARK-44943: -- Description: Signed conversion does not detect overflow  {code:java} >>>

[jira] [Updated] (SPARK-44943) CONV produces incorrect result near Long.MIN_VALUE, fails to detect overflow

2023-08-24 Thread Gera Shegalov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated SPARK-44943: -- Affects Version/s: 3.4.1 > CONV produces incorrect result near Long.MIN_VALUE, fails to

[jira] [Updated] (SPARK-44943) CONV produces incorrect result near Long.MIN_VALUE, fails to detect overflow

2023-08-24 Thread Gera Shegalov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated SPARK-44943: -- Affects Version/s: 3.5.0 > CONV produces incorrect result near Long.MIN_VALUE, fails to

[jira] [Updated] (SPARK-44943) CONV produces incorrect result near Long.MIN_VALUE, fails to detect overflow

2023-08-24 Thread Gera Shegalov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated SPARK-44943: -- Affects Version/s: 4.0.0 (was: 3.4.1) > CONV produces incorrect

[jira] [Created] (SPARK-44943) CONV produces incorrect result near Long.MIN_VALUE, fails to detect overflow

2023-08-24 Thread Gera Shegalov (Jira)
Gera Shegalov created SPARK-44943: - Summary: CONV produces incorrect result near Long.MIN_VALUE, fails to detect overflow Key: SPARK-44943 URL: https://issues.apache.org/jira/browse/SPARK-44943

[jira] [Updated] (SPARK-42752) Unprintable IllegalArgumentException with Hive catalog enabled in "Hadoop Free" distibution

2023-03-10 Thread Gera Shegalov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated SPARK-42752: -- Description: Reproduction steps: 1. download a standard "Hadoop Free" build 2. Start pyspark

[jira] [Created] (SPARK-42752) Unprintable IllegalArgumentException with Hive catalog enabled in "Hadoop Free" distibution

2023-03-10 Thread Gera Shegalov (Jira)
Gera Shegalov created SPARK-42752: - Summary: Unprintable IllegalArgumentException with Hive catalog enabled in "Hadoop Free" distibution Key: SPARK-42752 URL: https://issues.apache.org/jira/browse/SPARK-42752

[jira] [Reopened] (SPARK-41793) Incorrect result for window frames defined by a range clause on large decimals

2023-02-09 Thread Gera Shegalov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov reopened SPARK-41793: --- > Incorrect result for window frames defined by a range clause on large > decimals >

[jira] [Comment Edited] (SPARK-41793) Incorrect result for window frames defined by a range clause on large decimals

2023-02-09 Thread Gera Shegalov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17685384#comment-17685384 ] Gera Shegalov edited comment on SPARK-41793 at 2/9/23 6:26 PM: --- Another

[jira] [Commented] (SPARK-41793) Incorrect result for window frames defined by a range clause on large decimals

2023-02-07 Thread Gera Shegalov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17685384#comment-17685384 ] Gera Shegalov commented on SPARK-41793: --- Another interpretation of why the pre-3.4 count of 1 may

[jira] [Comment Edited] (SPARK-41793) Incorrect result for window frames defined by a range clause on large decimals

2023-02-06 Thread Gera Shegalov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17684903#comment-17684903 ] Gera Shegalov edited comment on SPARK-41793 at 2/6/23 7:38 PM: --- if the

[jira] [Commented] (SPARK-41793) Incorrect result for window frames defined by a range clause on large decimals

2023-02-06 Thread Gera Shegalov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17684903#comment-17684903 ] Gera Shegalov commented on SPARK-41793: --- if the consensus is that it's not a correctness bug in

[jira] [Commented] (SPARK-41793) Incorrect result for window frames defined by a range clause on large decimals

2022-12-30 Thread Gera Shegalov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653238#comment-17653238 ] Gera Shegalov commented on SPARK-41793: --- Similarly in SQLite {code} .header on create table

[jira] [Updated] (SPARK-41793) Incorrect result for window frames defined by a range clause on large decimals

2022-12-30 Thread Gera Shegalov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated SPARK-41793: -- Summary: Incorrect result for window frames defined by a range clause on large decimals

[jira] [Created] (SPARK-41793) Incorrect result for window frames defined as ranges on large decimals

2022-12-30 Thread Gera Shegalov (Jira)
Gera Shegalov created SPARK-41793: - Summary: Incorrect result for window frames defined as ranges on large decimals Key: SPARK-41793 URL: https://issues.apache.org/jira/browse/SPARK-41793 Project:

[jira] [Created] (SPARK-35408) Improve parameter validation in DataFrame.show

2021-05-14 Thread Gera Shegalov (Jira)
Gera Shegalov created SPARK-35408: - Summary: Improve parameter validation in DataFrame.show Key: SPARK-35408 URL: https://issues.apache.org/jira/browse/SPARK-35408 Project: Spark Issue Type:

[jira] [Created] (SPARK-31900) Client memory passed unvalidated to the JVM Xmx

2020-06-03 Thread Gera Shegalov (Jira)
Gera Shegalov created SPARK-31900: - Summary: Client memory passed unvalidated to the JVM Xmx Key: SPARK-31900 URL: https://issues.apache.org/jira/browse/SPARK-31900 Project: Spark Issue

[jira] [Commented] (SPARK-23155) YARN-aggregated executor/driver logs appear unavailable when NM is down

2019-02-01 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758102#comment-16758102 ] Gera Shegalov commented on SPARK-23155: --- [~kabhwan], [~vanzin] I would still be interested to be

[jira] [Commented] (SPARK-26792) Apply custom log URL to Spark UI

2019-02-01 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758095#comment-16758095 ] Gera Shegalov commented on SPARK-26792: --- [~kabhwan] thanks for doing this work. I verified that I

[jira] [Created] (SPARK-25221) [DEPLOY] Consistent trailing whitespace treatment of conf values

2018-08-23 Thread Gera Shegalov (JIRA)
Gera Shegalov created SPARK-25221: - Summary: [DEPLOY] Consistent trailing whitespace treatment of conf values Key: SPARK-25221 URL: https://issues.apache.org/jira/browse/SPARK-25221 Project: Spark

[jira] [Updated] (SPARK-23956) Use effective RPC port in AM registration

2018-04-11 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated SPARK-23956: -- Priority: Minor (was: Major) > Use effective RPC port in AM registration >

[jira] [Created] (SPARK-23956) Use effective RPC port in AM registration

2018-04-10 Thread Gera Shegalov (JIRA)
Gera Shegalov created SPARK-23956: - Summary: Use effective RPC port in AM registration Key: SPARK-23956 URL: https://issues.apache.org/jira/browse/SPARK-23956 Project: Spark Issue Type:

[jira] [Created] (SPARK-23386) Enable direct application links before replay

2018-02-10 Thread Gera Shegalov (JIRA)
Gera Shegalov created SPARK-23386: - Summary: Enable direct application links before replay Key: SPARK-23386 URL: https://issues.apache.org/jira/browse/SPARK-23386 Project: Spark Issue Type:

[jira] [Created] (SPARK-23296) Diagnostics message for user code exceptions should include the stacktrace

2018-02-01 Thread Gera Shegalov (JIRA)
Gera Shegalov created SPARK-23296: - Summary: Diagnostics message for user code exceptions should include the stacktrace Key: SPARK-23296 URL: https://issues.apache.org/jira/browse/SPARK-23296

[jira] [Updated] (SPARK-12963) In cluster mode,spark_local_ip will cause driver exception:Service 'Driver' failed after 16 retries!

2018-01-19 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated SPARK-12963: -- Shepherd: Sean Owen > In cluster mode,spark_local_ip will cause driver exception:Service

[jira] [Commented] (SPARK-12963) In cluster mode,spark_local_ip will cause driver exception:Service 'Driver' failed after 16 retries!

2018-01-18 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331815#comment-16331815 ] Gera Shegalov commented on SPARK-12963: --- We hit the same issue on nodes where a process is not

[jira] [Created] (SPARK-23155) YARN-aggregated executor/driver logs appear unavailable when NM is down

2018-01-18 Thread Gera Shegalov (JIRA)
Gera Shegalov created SPARK-23155: - Summary: YARN-aggregated executor/driver logs appear unavailable when NM is down Key: SPARK-23155 URL: https://issues.apache.org/jira/browse/SPARK-23155 Project:

[jira] [Created] (SPARK-22914) Subbing for spark.history.ui.port does not resolve by default

2017-12-27 Thread Gera Shegalov (JIRA)
Gera Shegalov created SPARK-22914: - Summary: Subbing for spark.history.ui.port does not resolve by default Key: SPARK-22914 URL: https://issues.apache.org/jira/browse/SPARK-22914 Project: Spark

[jira] [Updated] (SPARK-22875) Assembly build fails for a high user id

2017-12-22 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated SPARK-22875: -- Flags: Patch > Assembly build fails for a high user id >

[jira] [Updated] (SPARK-22875) Assembly build fails for a high user id

2017-12-22 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated SPARK-22875: -- Shepherd: Steve Loughran > Assembly build fails for a high user id >

[jira] [Created] (SPARK-22875) Assembly build fails for a high user id

2017-12-22 Thread Gera Shegalov (JIRA)
Gera Shegalov created SPARK-22875: - Summary: Assembly build fails for a high user id Key: SPARK-22875 URL: https://issues.apache.org/jira/browse/SPARK-22875 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2602) sbt/sbt test steals window focus on OS X

2014-07-20 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068044#comment-14068044 ] Gera Shegalov commented on SPARK-2602: -- Take a look at the thread on HADOOP-10290

[jira] [Created] (SPARK-2577) File upload to viewfs is broken due to mount point resolution

2014-07-18 Thread Gera Shegalov (JIRA)
Gera Shegalov created SPARK-2577: Summary: File upload to viewfs is broken due to mount point resolution Key: SPARK-2577 URL: https://issues.apache.org/jira/browse/SPARK-2577 Project: Spark

[jira] [Commented] (SPARK-2577) File upload to viewfs is broken due to mount point resolution

2014-07-18 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066243#comment-14066243 ] Gera Shegalov commented on SPARK-2577: -- https://github.com/apache/spark/pull/1483