[jira] [Updated] (SPARK-46328) Allocate capacity of array list of TColumns by columns size in TRowSet generation

2023-12-08 Thread Bowen Liang (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-46328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bowen Liang updated SPARK-46328:

Summary: Allocate capacity of array list of TColumns by columns size in 
TRowSet generation  (was: Allocate capacity by columns size for array list of 
TColumns in TRowSet generation)

> Allocate capacity of array list of TColumns by columns size in TRowSet 
> generation
> -
>
> Key: SPARK-46328
> URL: https://issues.apache.org/jira/browse/SPARK-46328
> Project: Spark
>  Issue Type: Improvement
>  Components: Spark Core
>Affects Versions: 3.5.0
>Reporter: Bowen Liang
>Priority: Minor
>  Labels: pull-request-available
>
> Background:
> ArrayList is created for TColumn value collections in RowSetUtils for TRowSet 
> generation. Currently, they are created with Java's default capacity of 16, 
> rather than by the number of columns, which could cause array copying in 
> assembling each TColumn collections when the column number exceeds the 
> default capacity.
>  
> Suggested solution:
> Allocate enough capacity by columns size for assembling array list of 
> TColumns in TRowSet generation.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-46328) Allocate capacity by columns size for array list of TColumns in TRowSet generation

2023-12-08 Thread Bowen Liang (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-46328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bowen Liang updated SPARK-46328:

Summary: Allocate capacity by columns size for array list of TColumns in 
TRowSet generation  (was: Allocate enough capacity for assembling array list of 
TColumns in TRowSet generation)

> Allocate capacity by columns size for array list of TColumns in TRowSet 
> generation
> --
>
> Key: SPARK-46328
> URL: https://issues.apache.org/jira/browse/SPARK-46328
> Project: Spark
>  Issue Type: Improvement
>  Components: Spark Core
>Affects Versions: 3.5.0
>Reporter: Bowen Liang
>Priority: Minor
>
> Background:
> ArrayList is created for TColumn value collections in RowSetUtils for TRowSet 
> generation. Currently, they are created with Java's default capacity of 16, 
> rather than by the number of columns, which could cause array copying in 
> assembling each TColumn collections when the column number exceeds the 
> default capacity.
>  
> Suggested solution:
> Allocate enough capacity by columns size for assembling array list of 
> TColumns in TRowSet generation.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Created] (SPARK-46328) Allocate enough capacity for assembling array list of TColumns in TRowSet generation

2023-12-08 Thread Bowen Liang (Jira)
Bowen Liang created SPARK-46328:
---

 Summary: Allocate enough capacity for assembling array list of 
TColumns in TRowSet generation
 Key: SPARK-46328
 URL: https://issues.apache.org/jira/browse/SPARK-46328
 Project: Spark
  Issue Type: Improvement
  Components: Spark Core
Affects Versions: 3.5.0
Reporter: Bowen Liang


Background:

ArrayList is created for TColumn value collections in RowSetUtils for TRowSet 
generation. Currently, they are created with Java's default capacity of 16, 
rather than by the number of columns, which could cause array copying in 
assembling each TColumn collections when the column number exceeds the default 
capacity.

 

Suggested solution:

Allocate enough capacity by columns size for assembling array list of TColumns 
in TRowSet generation.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-44032) Remove the bytecode version exclusion of threeten-extra when orc-core fixes the violation

2023-06-12 Thread Bowen Liang (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-44032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bowen Liang updated SPARK-44032:

Affects Version/s: 3.4.0
   (was: 3.4.1)

> Remove the bytecode version exclusion of threeten-extra when orc-core fixes 
> the violation
> -
>
> Key: SPARK-44032
> URL: https://issues.apache.org/jira/browse/SPARK-44032
> Project: Spark
>  Issue Type: Sub-task
>  Components: Build
>Affects Versions: 3.4.0
>Reporter: Bowen Liang
>Priority: Minor
>
> Remove the exclusion of threeten-extra when orc-core fixes the violation.
>  
> `threeten-extra` 1.7.1 is depended by `orc-core` 1.8.0, with 
> `package-info.class` violating the bytecode version enforcer rule which 
> enforcing max bytecode version to 52. 1.7.1 and latest available version 
> 1.7.2 has the similar problem. So exclusion for threeten-extra is added to 
> the enforcer rule. Remove it when orc-core fixed the upstream dependency 
> bytecode version violation.
>  
> threeten-extra-1.7.1/org/threeten/extra/scale/package-info.class, major 
> version:53
> threeten-extra-1.7.1/org/threeten/extra/chrono/package-info.class, major 
> version:53
> threeten-extra-1.7.1/org/threeten/extra/package-info.class, major version:53



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-44032) Remove the bytecode version exclusion of threeten-extra when orc-core fixes the violation

2023-06-12 Thread Bowen Liang (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-44032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bowen Liang updated SPARK-44032:

Target Version/s:   (was: 3.4.1)

> Remove the bytecode version exclusion of threeten-extra when orc-core fixes 
> the violation
> -
>
> Key: SPARK-44032
> URL: https://issues.apache.org/jira/browse/SPARK-44032
> Project: Spark
>  Issue Type: Sub-task
>  Components: Build
>Affects Versions: 3.4.1
>Reporter: Bowen Liang
>Priority: Minor
>
> Remove the exclusion of threeten-extra when orc-core fixes the violation.
>  
> `threeten-extra` 1.7.1 is depended by `orc-core` 1.8.0, with 
> `package-info.class` violating the bytecode version enforcer rule which 
> enforcing max bytecode version to 52. 1.7.1 and latest available version 
> 1.7.2 has the similar problem. So exclusion for threeten-extra is added to 
> the enforcer rule. Remove it when orc-core fixed the upstream dependency 
> bytecode version violation.
>  
> threeten-extra-1.7.1/org/threeten/extra/scale/package-info.class, major 
> version:53
> threeten-extra-1.7.1/org/threeten/extra/chrono/package-info.class, major 
> version:53
> threeten-extra-1.7.1/org/threeten/extra/package-info.class, major version:53



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-44022) Enforce max bytecode version on Maven dependencies

2023-06-12 Thread Bowen Liang (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-44022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bowen Liang updated SPARK-44022:

Target Version/s:   (was: 3.4.1)

> Enforce max bytecode version on Maven dependencies
> --
>
> Key: SPARK-44022
> URL: https://issues.apache.org/jira/browse/SPARK-44022
> Project: Spark
>  Issue Type: Improvement
>  Components: Build
>Affects Versions: 3.4.0
>Reporter: Bowen Liang
>Priority: Major
>
> To enforce Java's max bytecode version to maven dependencies, by using 
> `enforceBytecodeVersion` enforcer rule.
> Preventing introducing dependencies requiring higher Java version 11+, 
> including transparent dependencies.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-44022) Enforce max bytecode version on Maven dependencies

2023-06-12 Thread Bowen Liang (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-44022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bowen Liang updated SPARK-44022:

Summary: Enforce max bytecode version on Maven dependencies  (was: Enforce 
Java max bytecode version to maven dependencies)

> Enforce max bytecode version on Maven dependencies
> --
>
> Key: SPARK-44022
> URL: https://issues.apache.org/jira/browse/SPARK-44022
> Project: Spark
>  Issue Type: Improvement
>  Components: Build
>Affects Versions: 3.4.0
>Reporter: Bowen Liang
>Priority: Major
>
> To enforce Java's max bytecode version to maven dependencies, by using 
> `enforceBytecodeVersion` enforcer rule.
> Preventing introducing dependencies requiring higher Java version 11+, 
> including transparent dependencies.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-44022) Enforce Java max bytecode version to maven dependencies

2023-06-12 Thread Bowen Liang (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-44022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bowen Liang updated SPARK-44022:

 Target Version/s: 3.4.1
Affects Version/s: 3.4.0
   (was: 3.5.0)

> Enforce Java max bytecode version to maven dependencies
> ---
>
> Key: SPARK-44022
> URL: https://issues.apache.org/jira/browse/SPARK-44022
> Project: Spark
>  Issue Type: Improvement
>  Components: Build
>Affects Versions: 3.4.0
>Reporter: Bowen Liang
>Priority: Major
>
> To enforce Java's max bytecode version to maven dependencies, by using 
> `enforceBytecodeVersion` enforcer rule.
> Preventing introducing dependencies requiring higher Java version 11+, 
> including transparent dependencies.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-44032) Remove the bytecode version exclusion of threeten-extra when orc-core fixes the violation

2023-06-12 Thread Bowen Liang (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-44032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bowen Liang updated SPARK-44032:

Target Version/s: 3.4.1

> Remove the bytecode version exclusion of threeten-extra when orc-core fixes 
> the violation
> -
>
> Key: SPARK-44032
> URL: https://issues.apache.org/jira/browse/SPARK-44032
> Project: Spark
>  Issue Type: Sub-task
>  Components: Build
>Affects Versions: 3.4.1
>Reporter: Bowen Liang
>Priority: Minor
>
> Remove the exclusion of threeten-extra when orc-core fixes the violation.
>  
> `threeten-extra` 1.7.1 is depended by `orc-core` 1.8.0, with 
> `package-info.class` violating the bytecode version enforcer rule which 
> enforcing max bytecode version to 52. 1.7.1 and latest available version 
> 1.7.2 has the similar problem. So exclusion for threeten-extra is added to 
> the enforcer rule. Remove it when orc-core fixed the upstream dependency 
> bytecode version violation.
>  
> threeten-extra-1.7.1/org/threeten/extra/scale/package-info.class, major 
> version:53
> threeten-extra-1.7.1/org/threeten/extra/chrono/package-info.class, major 
> version:53
> threeten-extra-1.7.1/org/threeten/extra/package-info.class, major version:53



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-44032) Remove the bytecode version exclusion of threeten-extra when orc-core fixes the violation

2023-06-12 Thread Bowen Liang (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-44032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bowen Liang updated SPARK-44032:

Description: 
Remove the exclusion of threeten-extra when orc-core fixes the violation.
 
`threeten-extra` 1.7.1 is depended by `orc-core` 1.8.0, with 
`package-info.class` violating the bytecode version enforcer rule which 
enforcing max bytecode version to 52. 1.7.1 and latest available version 1.7.2 
has the similar problem. So exclusion for threeten-extra is added to the 
enforcer rule. Remove it when orc-core fixed the upstream dependency bytecode 
version violation.
 
threeten-extra-1.7.1/org/threeten/extra/scale/package-info.class, major 
version:53
threeten-extra-1.7.1/org/threeten/extra/chrono/package-info.class, major 
version:53
threeten-extra-1.7.1/org/threeten/extra/package-info.class, major version:53

  was:
Remove the exclusion of threeten-extra when orc-core fixes the violation.
 
`threeten-extra` 1.7.1 is depended by `orc-core` 1.8.0, with 
`package-info.class` violating the bytecode version enforcer rule. 1.7.1 and 
latest available version 1.7.2 has the similar problem. So exclusion for 
threeten-extra is added to the enforcer rule. Remove it when orc-core fixed the 
upstream dependency bytecode version violation.
 
threeten-extra-1.7.1/org/threeten/extra/scale/package-info.class, major 
version:53
threeten-extra-1.7.1/org/threeten/extra/chrono/package-info.class, major 
version:53
threeten-extra-1.7.1/org/threeten/extra/package-info.class, major version:53


> Remove the bytecode version exclusion of threeten-extra when orc-core fixes 
> the violation
> -
>
> Key: SPARK-44032
> URL: https://issues.apache.org/jira/browse/SPARK-44032
> Project: Spark
>  Issue Type: Sub-task
>  Components: Build
>Affects Versions: 3.4.1
>Reporter: Bowen Liang
>Priority: Minor
>
> Remove the exclusion of threeten-extra when orc-core fixes the violation.
>  
> `threeten-extra` 1.7.1 is depended by `orc-core` 1.8.0, with 
> `package-info.class` violating the bytecode version enforcer rule which 
> enforcing max bytecode version to 52. 1.7.1 and latest available version 
> 1.7.2 has the similar problem. So exclusion for threeten-extra is added to 
> the enforcer rule. Remove it when orc-core fixed the upstream dependency 
> bytecode version violation.
>  
> threeten-extra-1.7.1/org/threeten/extra/scale/package-info.class, major 
> version:53
> threeten-extra-1.7.1/org/threeten/extra/chrono/package-info.class, major 
> version:53
> threeten-extra-1.7.1/org/threeten/extra/package-info.class, major version:53



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-44032) Remove the bytecode version exclusion of threeten-extra when orc-core fixes the violation

2023-06-12 Thread Bowen Liang (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-44032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bowen Liang updated SPARK-44032:

Description: 
Remove the exclusion of threeten-extra when orc-core fixes the violation.
 
`threeten-extra` 1.7.1 is depended by `orc-core` 1.8.0, with 
`package-info.class` violating the bytecode version enforcer rule. 1.7.1 and 
latest available version 1.7.2 has the similar problem. So exclusion for 
threeten-extra is added to the enforcer rule. Remove it when orc-core fixed the 
upstream dependency bytecode version violation.
 
threeten-extra-1.7.1/org/threeten/extra/scale/package-info.class, major 
version:53
threeten-extra-1.7.1/org/threeten/extra/chrono/package-info.class, major 
version:53
threeten-extra-1.7.1/org/threeten/extra/package-info.class, major version:53

  was:
Remove the exclusion of threeten-extra when orc-core fixes the violation.
 
`threeten-extra` 1.7.1 is depended by `orc-core` 1.8.0, with 
`package-info.class` violating the bytecode version enforcer rule. 1.7.1 and 
latest available version 1.7.2 has the similar problem. So exclusion for 
threeten-extra is added to the enforcer rule. Remove it when orc-core fixed the 
upstream dependency bytecode version violation.
 
 {{threeten-extra-1.7.1/org/threeten/extra/scale/package-info.class, major 
version:53
threeten-extra-1.7.1/org/threeten/extra/chrono/package-info.class, major 
version:53
threeten-extra-1.7.1/org/threeten/extra/package-info.class, major version:53}}


> Remove the bytecode version exclusion of threeten-extra when orc-core fixes 
> the violation
> -
>
> Key: SPARK-44032
> URL: https://issues.apache.org/jira/browse/SPARK-44032
> Project: Spark
>  Issue Type: Sub-task
>  Components: Build
>Affects Versions: 3.4.1
>Reporter: Bowen Liang
>Priority: Minor
>
> Remove the exclusion of threeten-extra when orc-core fixes the violation.
>  
> `threeten-extra` 1.7.1 is depended by `orc-core` 1.8.0, with 
> `package-info.class` violating the bytecode version enforcer rule. 1.7.1 and 
> latest available version 1.7.2 has the similar problem. So exclusion for 
> threeten-extra is added to the enforcer rule. Remove it when orc-core fixed 
> the upstream dependency bytecode version violation.
>  
> threeten-extra-1.7.1/org/threeten/extra/scale/package-info.class, major 
> version:53
> threeten-extra-1.7.1/org/threeten/extra/chrono/package-info.class, major 
> version:53
> threeten-extra-1.7.1/org/threeten/extra/package-info.class, major version:53



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Created] (SPARK-44032) Remove the bytecode version exclusion of threeten-extra when orc-core fixes the violation

2023-06-12 Thread Bowen Liang (Jira)
Bowen Liang created SPARK-44032:
---

 Summary: Remove the bytecode version exclusion of threeten-extra 
when orc-core fixes the violation
 Key: SPARK-44032
 URL: https://issues.apache.org/jira/browse/SPARK-44032
 Project: Spark
  Issue Type: Sub-task
  Components: Build
Affects Versions: 3.4.1
Reporter: Bowen Liang


Remove the exclusion of threeten-extra when orc-core fixes the violation.
 
`threeten-extra` 1.7.1 is depended by `orc-core` 1.8.0, with 
`package-info.class` violating the bytecode version enforcer rule. 1.7.1 and 
latest available version 1.7.2 has the similar problem. So exclusion for 
threeten-extra is added to the enforcer rule. Remove it when orc-core fixed the 
upstream dependency bytecode version violation.
 
 {{threeten-extra-1.7.1/org/threeten/extra/scale/package-info.class, major 
version:53
threeten-extra-1.7.1/org/threeten/extra/chrono/package-info.class, major 
version:53
threeten-extra-1.7.1/org/threeten/extra/package-info.class, major version:53}}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-44022) Enforce Java max bytecode version to maven dependencies

2023-06-11 Thread Bowen Liang (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-44022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bowen Liang updated SPARK-44022:

Description: To enforce Java's max bytecode version to maven dependencies, 
by using `enforceBytecodeVersion` enforcer rule. Preventing introducing 
dependencies requiring higher Java version 11+, including transparent 
depencencies.  (was: To enforce Java's max bytecode version to maven 
dependencies, by using `enforceBytecodeVersion` enforcer rule. Preventing 
introducing dependencies requiring higher Java version 11+.)

> Enforce Java max bytecode version to maven dependencies
> ---
>
> Key: SPARK-44022
> URL: https://issues.apache.org/jira/browse/SPARK-44022
> Project: Spark
>  Issue Type: Improvement
>  Components: Build
>Affects Versions: 3.5.0
>Reporter: Bowen Liang
>Priority: Major
>
> To enforce Java's max bytecode version to maven dependencies, by using 
> `enforceBytecodeVersion` enforcer rule. Preventing introducing dependencies 
> requiring higher Java version 11+, including transparent depencencies.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-44022) Enforce Java max bytecode version to maven dependencies

2023-06-11 Thread Bowen Liang (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-44022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bowen Liang updated SPARK-44022:

Description: 
To enforce Java's max bytecode version to maven dependencies, by using 
`enforceBytecodeVersion` enforcer rule.

Preventing introducing dependencies requiring higher Java version 11+, 
including transparent dependencies.

  was:To enforce Java's max bytecode version to maven dependencies, by using 
`enforceBytecodeVersion` enforcer rule. Preventing introducing dependencies 
requiring higher Java version 11+, including transparent depencencies.


> Enforce Java max bytecode version to maven dependencies
> ---
>
> Key: SPARK-44022
> URL: https://issues.apache.org/jira/browse/SPARK-44022
> Project: Spark
>  Issue Type: Improvement
>  Components: Build
>Affects Versions: 3.5.0
>Reporter: Bowen Liang
>Priority: Major
>
> To enforce Java's max bytecode version to maven dependencies, by using 
> `enforceBytecodeVersion` enforcer rule.
> Preventing introducing dependencies requiring higher Java version 11+, 
> including transparent dependencies.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Created] (SPARK-44022) Enforce Java max bytecode version to maven dependencies

2023-06-11 Thread Bowen Liang (Jira)
Bowen Liang created SPARK-44022:
---

 Summary: Enforce Java max bytecode version to maven dependencies
 Key: SPARK-44022
 URL: https://issues.apache.org/jira/browse/SPARK-44022
 Project: Spark
  Issue Type: Improvement
  Components: Build
Affects Versions: 3.5.0
Reporter: Bowen Liang


To enforce Java's max bytecode version to maven dependencies, by using 
`enforceBytecodeVersion` enforcer rule. Preventing introducing dependencies 
requiring higher Java version 11+.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org