[
https://issues.apache.org/jira/browse/SPARK-49520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879735#comment-17879735
]
Wei Guo commented on SPARK-49520:
-
[~Shadowell] Oh, yes, I made a mistake.
arrays_over
[
https://issues.apache.org/jira/browse/SPARK-49350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17876886#comment-17876886
]
Wei Guo commented on SPARK-49350:
-
[~bersprockets] [~NathanKan] Yes, with the latest co
[
https://issues.apache.org/jira/browse/SPARK-49314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-49314:
Summary: Upgrade `h2` to 2.3.232, `postgresql` to 42.7.4 and `mssql` to
12.8.1.jre11 (was: Upgrade `h2` t
Wei Guo created SPARK-49124:
---
Summary: Upgrade tink to 1.14.1
Key: SPARK-49124
URL: https://issues.apache.org/jira/browse/SPARK-49124
Project: Spark
Issue Type: Improvement
Components: Bu
[
https://issues.apache.org/jira/browse/SPARK-49097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-49097:
Summary: Add Python3 environment detection for the `build_error_docs`
method in `build_api_decs.rb` (was:
Wei Guo created SPARK-49097:
---
Summary: Add Python3 environment detection for the
`build_orror_docs` method in `build_api_decs.rb`
Key: SPARK-49097
URL: https://issues.apache.org/jira/browse/SPARK-49097
Proj
[
https://issues.apache.org/jira/browse/SPARK-49095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-49095:
Summary: Update DecimalType compatible logic of Avro datasource to avoid
loss of decimal precision (was:
[
https://issues.apache.org/jira/browse/SPARK-49095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-49095:
Summary: Update DecimalType compatible logic of Avro data source to avoid
loss of decimal precision (was:
[
https://issues.apache.org/jira/browse/SPARK-49095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-49095:
Summary: Update DecimalType compatible logic of Avro datas ource to avoid
loss of decimal precision (was:
Wei Guo created SPARK-49095:
---
Summary: Update DecimalType compatible logic to avoid loss of
decimal precision
Key: SPARK-49095
URL: https://issues.apache.org/jira/browse/SPARK-49095
Project: Spark
Wei Guo created SPARK-49081:
---
Summary: Add data source options docs of Protobuf
Key: SPARK-49081
URL: https://issues.apache.org/jira/browse/SPARK-49081
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-49072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-49072:
Summary: Fix abnormal display of text content which contains two $ in one
line but non-formula in docs (w
Wei Guo created SPARK-49072:
---
Summary: Fix abnormal display of text content which contains two $
in one line but not non-formula in docs
Key: SPARK-49072
URL: https://issues.apache.org/jira/browse/SPARK-49072
Wei Guo created SPARK-49062:
---
Summary: Migrate xml to File Data Source V2
Key: SPARK-49062
URL: https://issues.apache.org/jira/browse/SPARK-49062
Project: Spark
Issue Type: Improvement
Co
[
https://issues.apache.org/jira/browse/SPARK-49062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-49062:
Summary: Migrate XML to File Data Source V2 (was: Migrate xml to File Data
Source V2)
> Migrate XML to F
[
https://issues.apache.org/jira/browse/SPARK-49042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869671#comment-17869671
]
Wei Guo commented on SPARK-49042:
-
[~arnaud.nauwynck] Can you provide some code to cons
[
https://issues.apache.org/jira/browse/SPARK-49016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17868981#comment-17868981
]
Wei Guo commented on SPARK-49016:
-
I made a PR for this issue https://github.com/apache/
[
https://issues.apache.org/jira/browse/SPARK-48973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48973:
Description:
In the spark the mask function when apply with a string contains invalid
character or wide c
[
https://issues.apache.org/jira/browse/SPARK-48973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48973:
Description:
In the spark the mask function when apply with a string contains invalid
character or wide c
[
https://issues.apache.org/jira/browse/SPARK-48926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48926:
Issue Type: Improvement (was: Bug)
> Use the `checkError` method to optimize the exception check logic re
Wei Guo created SPARK-48926:
---
Summary: Use the `checkError` method to optimize the exception
check logic related to `UNRESOLVED_COLUMN` error classes
Key: SPARK-48926
URL: https://issues.apache.org/jira/browse/SPARK-489
[
https://issues.apache.org/jira/browse/SPARK-48915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866743#comment-17866743
]
Wei Guo commented on SPARK-48915:
-
I have made a PR for this issue.
> Add inequality (!
Wei Guo created SPARK-48893:
---
Summary: Add some examples for linearRegression built-in functions
Key: SPARK-48893
URL: https://issues.apache.org/jira/browse/SPARK-48893
Project: Spark
Issue Type: I
[
https://issues.apache.org/jira/browse/SPARK-48882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48882:
Summary: Assign names to streaming output mode related error classes (was:
Assign streaming output mode r
Wei Guo created SPARK-48882:
---
Summary: Assign streaming output mode related error classes
Key: SPARK-48882
URL: https://issues.apache.org/jira/browse/SPARK-48882
Project: Spark
Issue Type: Sub-task
Wei Guo created SPARK-48858:
---
Summary: Remove deprecated `setDaemon` method call of `Thread` in
`log_communication.py`
Key: SPARK-48858
URL: https://issues.apache.org/jira/browse/SPARK-48858
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-48848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48848:
Summary: Set the upper bound version of sphinxcontrib-* in
dev/requirements.txt with sphinx==4.5.0 (was:
Wei Guo created SPARK-48848:
---
Summary: Pin 'sphinxcontrib-*' in `dev/requirements.txt` with
`sphinx==4.5.0`
Key: SPARK-48848
URL: https://issues.apache.org/jira/browse/SPARK-48848
Project: Spark
I
Wei Guo created SPARK-48846:
---
Summary: Fix the incorrect namings and missing params in func docs
in `builtin.py`
Key: SPARK-48846
URL: https://issues.apache.org/jira/browse/SPARK-48846
Project: Spark
Wei Guo created SPARK-48826:
---
Summary: Upgrade `fasterxml.jackson` to 2.17.2
Key: SPARK-48826
URL: https://issues.apache.org/jira/browse/SPARK-48826
Project: Spark
Issue Type: Improvement
Wei Guo created SPARK-48814:
---
Summary: Upgrade tink to 1.14.0
Key: SPARK-48814
URL: https://issues.apache.org/jira/browse/SPARK-48814
Project: Spark
Issue Type: Improvement
Components: Bu
[
https://issues.apache.org/jira/browse/SPARK-48812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48812:
Component/s: Connect
> Add some test suites for mariadb jdbc connector
> -
Wei Guo created SPARK-48812:
---
Summary: Add some test suites for mariadb jdbc connector
Key: SPARK-48812
URL: https://issues.apache.org/jira/browse/SPARK-48812
Project: Spark
Issue Type: Test
Wei Guo created SPARK-48795:
---
Summary: Upgrade mysql-connector-j to 9.0.0
Key: SPARK-48795
URL: https://issues.apache.org/jira/browse/SPARK-48795
Project: Spark
Issue Type: Sub-task
Compo
[
https://issues.apache.org/jira/browse/SPARK-48738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48738:
Summary: Correct since version for built-in func alias `random`,
`position`, `mod`, `cardinality`, `curren
[
https://issues.apache.org/jira/browse/SPARK-48738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48738:
Summary: Correct since version for built-in func alias `random`,
`position`, `mod`, `cardinality`, `curren
[
https://issues.apache.org/jira/browse/SPARK-48738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48738:
Summary: Correct since for method alias `random`, `position`, `mod`,
`cardinality`, `current_schema`, `use
[
https://issues.apache.org/jira/browse/SPARK-48738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48738:
Summary: Update since for method alias `random`, `position`, `mod`,
`cardinality`, `current_schema`, `user
Wei Guo created SPARK-48738:
---
Summary: Update since for `random`, `position`, `mod`,
`cardinality`, `current_schema`, `user` and `session_user`
Key: SPARK-48738
URL: https://issues.apache.org/jira/browse/SPARK-48738
[ https://issues.apache.org/jira/browse/SPARK-48719 ]
Wei Guo deleted comment on SPARK-48719:
-
was (Author: wayne guo):
I made a [PR|https://github.com/apache/spark/pull/47105] for this.
> Wrong Result in regr_slope®r_intercept Aggregate with Tuple
Wei Guo created SPARK-48732:
---
Summary: Cleanup deprecated api usage related to
JdbcDialect.compileAggregate
Key: SPARK-48732
URL: https://issues.apache.org/jira/browse/SPARK-48732
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-48719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17860200#comment-17860200
]
Wei Guo commented on SPARK-48719:
-
I made a [PR|https://github.com/apache/spark/pull/471
[
https://issues.apache.org/jira/browse/SPARK-48724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48724:
Description:
The code as follows:
{code:java}
withSQLConf(SQLConf.IGNORE_CORRUPT_FILES.key -> sqlConf) {
[
https://issues.apache.org/jira/browse/SPARK-48724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48724:
Description:
The code as belows:
> Fix incorrect conf settings of ignoreCorruptFiles related tests cas
Wei Guo created SPARK-48724:
---
Summary: Fix incorrect conf settings of ignoreCorruptFiles related
tests case in ParquetQuerySuite
Key: SPARK-48724
URL: https://issues.apache.org/jira/browse/SPARK-48724
Proje
[ https://issues.apache.org/jira/browse/SPARK-39901 ]
Wei Guo deleted comment on SPARK-39901:
-
was (Author: wayne guo):
The `ignoreCorruptFiles` features in SQL(spark.sql.files.ignoreCorruptFiles)
and RDD(spark.files.ignoreCorruptFiles) scenarios n
[
https://issues.apache.org/jira/browse/SPARK-48691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48691:
Summary: Upgrade `scalatest` related dependencies to the 3.2.18 series
(was: Upgrade `mockito` to 5.12.0)
[
https://issues.apache.org/jira/browse/SPARK-48689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856910#comment-17856910
]
Wei Guo edited comment on SPARK-48689 at 6/22/24 2:33 PM:
--
This
[
https://issues.apache.org/jira/browse/SPARK-48689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856910#comment-17856910
]
Wei Guo edited comment on SPARK-48689 at 6/22/24 7:36 AM:
--
This
[
https://issues.apache.org/jira/browse/SPARK-48689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48689:
Attachment: image-2024-06-22-15-33-38-833.png
> Reading lengthy JSON results in a corrupted record.
>
[
https://issues.apache.org/jira/browse/SPARK-48689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856910#comment-17856910
]
Wei Guo commented on SPARK-48689:
-
This is controlled by option `maxStringLen`, the defa
Wei Guo created SPARK-48671:
---
Summary: Add test cases for Hex.hex
Key: SPARK-48671
URL: https://issues.apache.org/jira/browse/SPARK-48671
Project: Spark
Issue Type: Test
Components: SQL
[
https://issues.apache.org/jira/browse/SPARK-48660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856122#comment-17856122
]
Wei Guo commented on SPARK-48660:
-
I am working on this and thank your for recommendatio
[
https://issues.apache.org/jira/browse/SPARK-48660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856122#comment-17856122
]
Wei Guo edited comment on SPARK-48660 at 6/19/24 4:18 AM:
--
I am
Wei Guo created SPARK-48661:
---
Summary: Upgrade RoaringBitmap to 1.1.0
Key: SPARK-48661
URL: https://issues.apache.org/jira/browse/SPARK-48661
Project: Spark
Issue Type: Sub-task
Component
[
https://issues.apache.org/jira/browse/SPARK-48635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48635:
Summary: Assign classes to join type errors and as-of join error (was:
Assign classes to join type err
[
https://issues.apache.org/jira/browse/SPARK-48635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48635:
Summary: Assign classes to join type errors and as-of join error
_LEGACY_ERROR_TEMP_3217 (was: Assign
[
https://issues.apache.org/jira/browse/SPARK-48635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48635:
Description:
job type errors:
LEGACY_ERROR_TEMP[1319, 3216]
as-of join error:
_LEGACY_ERROR_TEMP_3217
[
https://issues.apache.org/jira/browse/SPARK-48635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48635:
Description:
job type errors:
_LEGACY_ERROR_TEMP_[1319, 3216]
as-of join error:
> Assign classes to jo
[
https://issues.apache.org/jira/browse/SPARK-48635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48635:
Description:
job type errors:
_LEGACY_ERROR_TEMP_[1319, 3216]
as-of join error:
_LEGACY_ERROR_TEMP_3217
Wei Guo created SPARK-48635:
---
Summary: Assign classes to join type errors
_LEGACY_ERROR_TEMP_[1319, 3216] and as-of join error _LEGACY_ERROR_TEMP_3217
Key: SPARK-48635
URL: https://issues.apache.org/jira/browse/SPARK-
[
https://issues.apache.org/jira/browse/SPARK-48614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48614:
Description: (was: There are some deprecated classes and methods in
commons-io called in Spark, we nee
Wei Guo created SPARK-48614:
---
Summary: Cleanup deprecated api usage related to kafka-clients
Key: SPARK-48614
URL: https://issues.apache.org/jira/browse/SPARK-48614
Project: Spark
Issue Type: Impro
Wei Guo created SPARK-48604:
---
Summary: Replace deprecated classes and methods of arrow-vector
called in Spark
Key: SPARK-48604
URL: https://issues.apache.org/jira/browse/SPARK-48604
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-48604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48604:
Description:
There are some deprecated classes and methods in arrow-vector called in Spark,
we need to re
[
https://issues.apache.org/jira/browse/SPARK-48583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48583:
Summary: Replace deprecated classes and methods of commons-io called in
Spark (was: Replace deprecated cl
[
https://issues.apache.org/jira/browse/SPARK-48583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48583:
Description:
There are some deprecated classes and methods in commons-io called in Spark, we
need to repl
[
https://issues.apache.org/jira/browse/SPARK-48583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48583:
Description:
There are some deprecated classes and methods in `commons-io` called in Spark,
we need to re
[
https://issues.apache.org/jira/browse/SPARK-48583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48583:
Description:
There are some deprecated classes and methods in `commons-io` called in Spark,
we need to re
[
https://issues.apache.org/jira/browse/SPARK-48583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48583:
Summary: Replace deprecated classes and methods of `commons-io` called in
Spark (was: Replace deprecated
Wei Guo created SPARK-48583:
---
Summary: Replace deprecated `FileUtils#writeStringToFile`
Key: SPARK-48583
URL: https://issues.apache.org/jira/browse/SPARK-48583
Project: Spark
Issue Type: Improveme
[
https://issues.apache.org/jira/browse/SPARK-48581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-48581:
Summary: Upgrade dropwizard metrics to 4.2.26 (was: Upgrade dropwizard
metrics 4.2.26)
> Upgrade dropwiz
Wei Guo created SPARK-48581:
---
Summary: Upgrade dropwizard metrics 4.2.26
Key: SPARK-48581
URL: https://issues.apache.org/jira/browse/SPARK-48581
Project: Spark
Issue Type: Improvement
Com
Wei Guo created SPARK-48539:
---
Summary: Upgrade docker-java to 3.3.6
Key: SPARK-48539
URL: https://issues.apache.org/jira/browse/SPARK-48539
Project: Spark
Issue Type: Improvement
Componen
[
https://issues.apache.org/jira/browse/SPARK-47259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17850238#comment-17850238
]
Wei Guo commented on SPARK-47259:
-
Update `_LEGACY_ERROR_TEMP_32[08-14]` to `_LEGACY_ERR
[
https://issues.apache.org/jira/browse/SPARK-47259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-47259:
Description:
Choose a proper name for the error class *_LEGACY_ERROR_TEMP_32[09-14]* defined
in {*}core/s
[
https://issues.apache.org/jira/browse/SPARK-40678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17687573#comment-17687573
]
Wei Guo commented on SPARK-40678:
-
Fixed by PR 38154 https://github.com/apache/spark/pul
[
https://issues.apache.org/jira/browse/SPARK-39348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17686390#comment-17686390
]
Wei Guo commented on SPARK-39348:
-
After PR [https://github.com/apache/spark/pull/26559,
[
https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-42335:
Description:
In PR [https://github.com/apache/spark/pull/29516], in order to fix some bugs,
univocity-par
[
https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-42335:
Description:
In PR [https://github.com/apache/spark/pull/29516], in order to fix some bugs,
univocity-par
[
https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-42335:
Description:
In PR [https://github.com/apache/spark/pull/29516], in order to fix some bugs,
univocity-par
[
https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-42335:
Description:
In PR [https://github.com/apache/spark/pull/29516], in order to fix some bugs,
univocity-par
[
https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-42335:
Summary: Pass the comment option through to univocity if users set it
explicitly in CSV dataSource (was:
[
https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-42335:
Description:
In PR [https://github.com/apache/spark/pull/29516], in order to fix some bugs,
univocity-par
[
https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-42335:
Description:
In PR [https://github.com/apache/spark/pull/29516], in order to fix some bugs,
univocity-par
[
https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-42335:
Description:
In PR [https://github.com/apache/spark/pull/29516], in order to fix some bugs,
univocity-par
[
https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-42335:
Description:
In PR [https://github.com/apache/spark/pull/29516], in order to fix some bugs,
univocity-par
[
https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-42335:
Description:
In PR [https://github.com/apache/spark/pull/29516], in order to fix some bugs,
univocity-par
[
https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-42335:
Summary: Pass the comment option through to univocity if users set it
explicity in CSV dataSource (was: A
[
https://issues.apache.org/jira/browse/SPARK-42252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-42252:
Fix Version/s: 3.5.0
(was: 3.4.0)
> Deprecate spark.shuffle.unsafe.file.output.buff
[
https://issues.apache.org/jira/browse/SPARK-42252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-42252:
Affects Version/s: 3.3.0
3.2.0
3.1.0
3
[
https://issues.apache.org/jira/browse/SPARK-42252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-42252:
Target Version/s: 3.5.0 (was: 3.4.0)
> Deprecate spark.shuffle.unsafe.file.output.buffer and add a new co
[
https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-42335:
Attachment: image-2023-02-03-18-56-10-083.png
> Add a legacy config for restoring writer's comment option
[
https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-42335:
Description:
In PR [https://github.com/apache/spark/pull/29516], in order to fix some bugs,
univocity-par
[
https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-42335:
Attachment: image-2023-02-03-18-56-01-596.png
> Add a legacy config for restoring writer's comment option
Wei Guo created SPARK-42335:
---
Summary: Add a legacy config for restoring writer's comment option
behavior in CSV dataSource
Key: SPARK-42335
URL: https://issues.apache.org/jira/browse/SPARK-42335
Project: S
[
https://issues.apache.org/jira/browse/SPARK-42237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Guo updated SPARK-42237:
Description:
When a binary colunm is written into csv files, actual content of this colunm
is {*}object.t
Wei Guo created SPARK-42252:
---
Summary: Deprecate spark.shuffle.unsafe.file.output.buffer and add
a new config
Key: SPARK-42252
URL: https://issues.apache.org/jira/browse/SPARK-42252
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-42237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681978#comment-17681978
]
Wei Guo commented on SPARK-42237:
-
a pr is ready~
> change binary to unsupported dataTy
[ https://issues.apache.org/jira/browse/SPARK-42237 ]
Wei Guo deleted comment on SPARK-42237:
-
was (Author: wayne guo):
a pr is ready~
> change binary to unsupported dataType in csv format
> ---
>
>
1 - 100 of 154 matches
Mail list logo
