[
https://issues.apache.org/jira/browse/SPARK-47904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-47904:
-
Description:
When enableStableIdentifiersForUnionType is enabled, all of the types are
Ivan Sadikov created SPARK-47904:
Summary: Preserve case in Avro schema when using
enableStableIdentifiersForUnionType
Key: SPARK-47904
URL: https://issues.apache.org/jira/browse/SPARK-47904
Project:
[
https://issues.apache.org/jira/browse/SPARK-47904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-47904:
-
Description: When
> Preserve case in Avro schema when using
[
https://issues.apache.org/jira/browse/SPARK-47704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-47704:
-
Description:
When reading the following JSON \{"a":[{"key":{"b":0}}]}:
{code:java}
val df =
Ivan Sadikov created SPARK-47704:
Summary: JSON parsing fails with "java.lang.ClassCastException:
org.apache.spark.sql.catalyst.util.ArrayBasedMapData cannot be cast to
org.apache.spark.sql.catalyst.util.ArrayData" when
[
https://issues.apache.org/jira/browse/SPARK-47704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-47704:
-
Description: TODO: Please don't close the ticket, I will fill in the
description.
> JSON
[
https://issues.apache.org/jira/browse/SPARK-46990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828143#comment-17828143
]
Ivan Sadikov commented on SPARK-46990:
--
Opened PR https://github.com/apache/spark/pull/45578.
>
[
https://issues.apache.org/jira/browse/SPARK-46990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828107#comment-17828107
]
Ivan Sadikov commented on SPARK-46990:
--
Thanks, Kamil. I am still debugging, will try to open a PR
[
https://issues.apache.org/jira/browse/SPARK-46990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828100#comment-17828100
]
Ivan Sadikov commented on SPARK-46990:
--
Yes, sure. Thanks for reporting. I will take a look and
[
https://issues.apache.org/jira/browse/SPARK-46930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-46930:
-
Description: {{enableStableIdentifiersForUnionType}} allows to enable
stable identifiers in
Ivan Sadikov created SPARK-46930:
Summary: Add support for a custom prefix for fields of Avro union
type when enableStableIdentifiersForUnionType is enabled
Key: SPARK-46930
URL:
[
https://issues.apache.org/jira/browse/SPARK-46633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-46633:
-
Description:
When an Avro file contains empty blocks, Spark returns 0 records while
"fastavro"
Ivan Sadikov created SPARK-46633:
Summary: Reading a non-empty Avro file with empty blocks returns 0
records
Key: SPARK-46633
URL: https://issues.apache.org/jira/browse/SPARK-46633
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-46482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov resolved SPARK-46482.
--
Resolution: Duplicate
> Revert SPARK-43049 due to performance regression of using CLOB
>
[
https://issues.apache.org/jira/browse/SPARK-46482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-46482:
-
Affects Version/s: (was: 3.4.1)
> Revert SPARK-43049 due to performance regression of using
[
https://issues.apache.org/jira/browse/SPARK-46482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-46482:
-
Description:
SPARK-43049 causes performance regression when writing string fields to an
Oracle
[
https://issues.apache.org/jira/browse/SPARK-46482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-46482:
-
Description:
SPARK-43049 causes performance regression when writing string fields to an
Oracle
[
https://issues.apache.org/jira/browse/SPARK-46482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-46482:
-
Summary: Revert SPARK-43049 due to performance regression of using CLOB
(was: Revert
[
https://issues.apache.org/jira/browse/SPARK-45194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-45194:
-
Description:
I found that Parquet reads could fail due to incorrect schema inference with
two
[
https://issues.apache.org/jira/browse/SPARK-45194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-45194:
-
Description:
I found that Parquet reads could fail due to incorrect schema inference with
two
[
https://issues.apache.org/jira/browse/SPARK-45194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17766198#comment-17766198
]
Ivan Sadikov commented on SPARK-45194:
--
cc [~gengliang] [~cloud_fan]
> Parquet reads fail with
Ivan Sadikov created SPARK-45194:
Summary: Parquet reads fail with "RuntimeException: Unable to
create Parquet converter for data type "timestamp_ntz" due to incorrect schema
inference
Key: SPARK-45194
URL:
Ivan Sadikov created SPARK-45139:
Summary: Add DatabricksDialect to handle SQL type conversion
Key: SPARK-45139
URL: https://issues.apache.org/jira/browse/SPARK-45139
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-45139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-45139:
-
Description: Databricks SQL dialect is needed to refine type conversion
when connecting to a
[
https://issues.apache.org/jira/browse/SPARK-44940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758792#comment-17758792
]
Ivan Sadikov commented on SPARK-44940:
--
Opened https://github.com/apache/spark/pull/42667.
>
[
https://issues.apache.org/jira/browse/SPARK-44940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-44940:
-
Summary: Improve performance of JSON parsing when
"spark.sql.json.enablePartialResults" is
[
https://issues.apache.org/jira/browse/SPARK-44940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758394#comment-17758394
]
Ivan Sadikov commented on SPARK-44940:
--
I have prototyped the fix and will open a PR shortly.
>
[
https://issues.apache.org/jira/browse/SPARK-44940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-44940:
-
Description:
Follow-up on https://issues.apache.org/jira/browse/SPARK-40646.
I found that JSON
Ivan Sadikov created SPARK-44940:
Summary: Improve performance of JSON parsing when partial results
are enabled
Key: SPARK-44940
URL: https://issues.apache.org/jira/browse/SPARK-44940
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-42534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692438#comment-17692438
]
Ivan Sadikov commented on SPARK-42534:
--
I am going to open a PR to fix this.
> Fix DB2 Limit
Ivan Sadikov created SPARK-42534:
Summary: Fix DB2 Limit clause
Key: SPARK-42534
URL: https://issues.apache.org/jira/browse/SPARK-42534
Project: Spark
Issue Type: Bug
Components:
[
https://issues.apache.org/jira/browse/SPARK-42469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-42469:
-
Summary: Update MSSQL Dialect to use parentheses for TOP and add tests for
Limit clause (was:
[
https://issues.apache.org/jira/browse/SPARK-42469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-42469:
-
Summary: Update MSSQL Dialect to use parentheses for TOP and add tests for
Limit clause #40059
[
https://issues.apache.org/jira/browse/SPARK-42469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-42469:
-
Description: Follow up for SPARK-42131. (was: Follow up for
h1. SPARK-42131.)
> Small fix for
Ivan Sadikov created SPARK-42469:
Summary: Small fix for MSSQL dialect + tests
Key: SPARK-42469
URL: https://issues.apache.org/jira/browse/SPARK-42469
Project: Spark
Issue Type: Improvement
Ivan Sadikov created SPARK-42176:
Summary: Cast boolean to timestamp fails with ClassCastException
Key: SPARK-42176
URL: https://issues.apache.org/jira/browse/SPARK-42176
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-42176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-42176:
-
Description:
When casting a boolean value to timestamp, the following error is thrown:
Ivan Sadikov created SPARK-42128:
Summary: Limit pushdown for MS SQL Server
Key: SPARK-42128
URL: https://issues.apache.org/jira/browse/SPARK-42128
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-41248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-41248:
-
Description:
This is a follow-up for https://issues.apache.org/jira/browse/SPARK-40646.
It
[
https://issues.apache.org/jira/browse/SPARK-41248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-41248:
-
Attachment: json-benchmark-without-SPARK-40646.log
> Add config flag to control before of JSON
[
https://issues.apache.org/jira/browse/SPARK-41248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-41248:
-
Attachment: without-SPARK-40646-commit.log
> Add config flag to control before of JSON partial
[
https://issues.apache.org/jira/browse/SPARK-41248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-41248:
-
Attachment: json-benchmark-with-SPARK-40646.log
> Add config flag to control before of JSON
[
https://issues.apache.org/jira/browse/SPARK-41248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-41248:
-
Attachment: (was: without-SPARK-40646-commit.log)
> Add config flag to control before of
[
https://issues.apache.org/jira/browse/SPARK-41248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-41248:
-
Description:
This is a follow-up for https://issues.apache.org/jira/browse/SPARK-40646.
It
[
https://issues.apache.org/jira/browse/SPARK-41248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-41248:
-
Description:
This is a follow-up for https://issues.apache.org/jira/browse/SPARK-40646.
It
Ivan Sadikov created SPARK-41248:
Summary: Add config flag to control before of JSON partial results
parsing in SPARK-40646
Key: SPARK-41248
URL: https://issues.apache.org/jira/browse/SPARK-41248
[
https://issues.apache.org/jira/browse/SPARK-41209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-41209:
-
Summary: Improve PySpark type inference in _merge_type method (was:
Improve Pyspark type
Ivan Sadikov created SPARK-41209:
Summary: Improve Pyspark type inference in _merge_type method
Key: SPARK-41209
URL: https://issues.apache.org/jira/browse/SPARK-41209
Project: Spark
Issue
Ivan Sadikov created SPARK-40815:
Summary: SymlinkTextInputFormat returns incorrect result due to
enabled spark.hadoopRDD.ignoreEmptySplits
Key: SPARK-40815
URL: https://issues.apache.org/jira/browse/SPARK-40815
[
https://issues.apache.org/jira/browse/SPARK-40541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617914#comment-17617914
]
Ivan Sadikov edited comment on SPARK-40541 at 10/14/22 6:43 PM:
I was
[
https://issues.apache.org/jira/browse/SPARK-40541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617914#comment-17617914
]
Ivan Sadikov edited comment on SPARK-40541 at 10/14/22 6:42 PM:
I was
[
https://issues.apache.org/jira/browse/SPARK-40541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617914#comment-17617914
]
Ivan Sadikov commented on SPARK-40541:
--
I was asking about the actual problem. It is not clear what
[
https://issues.apache.org/jira/browse/SPARK-39783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617509#comment-17617509
]
Ivan Sadikov edited comment on SPARK-39783 at 10/14/22 7:14 AM:
It is
[
https://issues.apache.org/jira/browse/SPARK-39783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39783:
-
Description:
AnalysisException [UNRESOLVED_COLUMN] shows the wrong suggestion when a field
[
https://issues.apache.org/jira/browse/SPARK-39783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39783:
-
Description:
AnalysisException [UNRESOLVED_COLUMN]
The following code references a nested
[
https://issues.apache.org/jira/browse/SPARK-39783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39783:
-
Summary: Column backticks are misplaced in the AnalysisException
[UNRESOLVED_COLUMN] error
[
https://issues.apache.org/jira/browse/SPARK-39783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-39783:
-
Summary: Column backticks are misplaced in the erroWrong column backticks
in UNRESOLVED_COLUMN
[
https://issues.apache.org/jira/browse/SPARK-39783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617509#comment-17617509
]
Ivan Sadikov commented on SPARK-39783:
--
It is not clear from the ticket, you should update the
[ https://issues.apache.org/jira/browse/SPARK-39257 ]
Ivan Sadikov deleted comment on SPARK-39257:
--
was (Author: ivan.sadikov):
I have had a similar issue before, you would need to do packet capture to
figure out what the underlying issue is.
[
https://issues.apache.org/jira/browse/SPARK-39257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617463#comment-17617463
]
Ivan Sadikov commented on SPARK-39257:
--
I have had a similar issue before, you would need to do
[
https://issues.apache.org/jira/browse/SPARK-39783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617460#comment-17617460
]
Ivan Sadikov commented on SPARK-39783:
--
This is by design if I am not mistaken. Such columns need
[
https://issues.apache.org/jira/browse/SPARK-40430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617441#comment-17617441
]
Ivan Sadikov commented on SPARK-40430:
--
Can you try FSCK REPAIR TABLE command on your table if you
[
https://issues.apache.org/jira/browse/SPARK-40541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617439#comment-17617439
]
Ivan Sadikov commented on SPARK-40541:
--
What is the question here? Does marking column as nullable
[
https://issues.apache.org/jira/browse/SPARK-40637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617435#comment-17617435
]
Ivan Sadikov commented on SPARK-40637:
--
You are not writing to the table in the first example but
[
https://issues.apache.org/jira/browse/SPARK-40584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17613304#comment-17613304
]
Ivan Sadikov commented on SPARK-40584:
--
Disabling "multiLine" also fixes the issue.
Seems to be an
[
https://issues.apache.org/jira/browse/SPARK-40646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40646:
-
Description:
I recently found an issue when parsing the following JSON file:
{code:java}
{"a":
[
https://issues.apache.org/jira/browse/SPARK-40646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40646:
-
Description:
I recently found an issue when parsing the following JSON file:
{code:java}
{"a":
Ivan Sadikov created SPARK-40646:
Summary: Fix returning partial results in JSON data source and
JSON functions
Key: SPARK-40646
URL: https://issues.apache.org/jira/browse/SPARK-40646
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40527:
-
Summary: Keep struct field names or map keys in CreateStruct (was: Keep
struct field names or
[
https://issues.apache.org/jira/browse/SPARK-40527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40527:
-
Summary: Keep struct/map field names for UnresolvedExtractValue in
CreateNamedStruct (was:
[
https://issues.apache.org/jira/browse/SPARK-40527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40527:
-
Summary: Keep struct field names or map keys for UnresolvedExtractValue in
CreateNamedStruct
[
https://issues.apache.org/jira/browse/SPARK-40527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40527:
-
Summary: Keep struct field names or map keys in CreateNamedStruct (was:
Keep struct field
[
https://issues.apache.org/jira/browse/SPARK-40527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40527:
-
Description:
Using index-like notation when extracting columns in a struct produces
generated
[
https://issues.apache.org/jira/browse/SPARK-40527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40527:
-
Summary: Generate field names for UnresolvedExtractValue in
CreateNamedStruct (was: Generate
Ivan Sadikov created SPARK-40527:
Summary: Generate names for UnresolvedExtractValue in
CreateNamedStruct
Key: SPARK-40527
URL: https://issues.apache.org/jira/browse/SPARK-40527
Project: Spark
Ivan Sadikov created SPARK-40496:
Summary: Configs to control "enableDateTimeParsingFallback" are
incorrectly swapped
Key: SPARK-40496
URL: https://issues.apache.org/jira/browse/SPARK-40496
Project:
[
https://issues.apache.org/jira/browse/SPARK-40470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40470:
-
Summary: arrays_zip output unexpected alias column names when using
GetMapValue and
[
https://issues.apache.org/jira/browse/SPARK-40470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40470:
-
Description:
This is a follow-up for https://issues.apache.org/jira/browse/SPARK-40292.
I
[
https://issues.apache.org/jira/browse/SPARK-40470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40470:
-
Description:
This is a follow-up for https://issues.apache.org/jira/browse/SPARK-40292.
I
[
https://issues.apache.org/jira/browse/SPARK-40470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40470:
-
Description:
This is a follow-up for https://issues.apache.org/jira/browse/SPARK-40292.
I
Ivan Sadikov created SPARK-40470:
Summary: arrays_zip output unexpected alias column names when
using Map
Key: SPARK-40470
URL: https://issues.apache.org/jira/browse/SPARK-40470
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40468:
-
Description:
I have found that depending on the name of the corrupt record in CSV, the field
[
https://issues.apache.org/jira/browse/SPARK-40468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40468:
-
Description:
I have found that depending on the name of the corrupt record in CSV, the field
[
https://issues.apache.org/jira/browse/SPARK-40468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40468:
-
Description:
I have found that depending on the name of the corrupt record in CSV, the field
[
https://issues.apache.org/jira/browse/SPARK-40468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40468:
-
Description:
I have found that depending on the name of the corrupt record in CSV, the field
Ivan Sadikov created SPARK-40468:
Summary: Column pruning is not handled correctly in CSV when
_corrupt_record is used
Key: SPARK-40468
URL: https://issues.apache.org/jira/browse/SPARK-40468
Project:
[
https://issues.apache.org/jira/browse/SPARK-40292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600198#comment-17600198
]
Ivan Sadikov commented on SPARK-40292:
--
I will take a look.
> arrays_zip output unexpected alias
Ivan Sadikov created SPARK-40215:
Summary: Add SQL configs to control CSV/JSON date and timestamp
parsing behaviour
Key: SPARK-40215
URL: https://issues.apache.org/jira/browse/SPARK-40215
Project:
[
https://issues.apache.org/jira/browse/SPARK-40215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17584612#comment-17584612
]
Ivan Sadikov commented on SPARK-40215:
--
Follow-up.
> Add SQL configs to control CSV/JSON date and
[
https://issues.apache.org/jira/browse/SPARK-40169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582664#comment-17582664
]
Ivan Sadikov commented on SPARK-40169:
--
I would like to work on it as it was my responsibility to
[
https://issues.apache.org/jira/browse/SPARK-40169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Sadikov updated SPARK-40169:
-
Description:
This is a follow for SPARK-39833. In
Ivan Sadikov created SPARK-40169:
Summary: Fix the issue with Parquet column index and predicate
pushdown in Data source V1
Key: SPARK-40169
URL: https://issues.apache.org/jira/browse/SPARK-40169
Ivan Sadikov created SPARK-40052:
Summary: Handle direct byte buffers in
VectorizedDeltaBinaryPackedReader
Key: SPARK-40052
URL: https://issues.apache.org/jira/browse/SPARK-40052
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575032#comment-17575032
]
Ivan Sadikov edited comment on SPARK-39833 at 8/5/22 5:07 AM:
--
Your example
[
https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575570#comment-17575570
]
Ivan Sadikov commented on SPARK-39833:
--
I opened a PR to quickly fix it:
[
https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575032#comment-17575032
]
Ivan Sadikov edited comment on SPARK-39833 at 8/5/22 1:48 AM:
--
This is
[
https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575510#comment-17575510
]
Ivan Sadikov commented on SPARK-39833:
--
It appears to be a bug in Parquet-Mr.
There is a
[
https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575032#comment-17575032
]
Ivan Sadikov edited comment on SPARK-39833 at 8/4/22 5:51 AM:
--
This is
[
https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575032#comment-17575032
]
Ivan Sadikov edited comment on SPARK-39833 at 8/4/22 5:47 AM:
--
This is
[
https://issues.apache.org/jira/browse/SPARK-39833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17575032#comment-17575032
]
Ivan Sadikov commented on SPARK-39833:
--
This is related to case insensitive analysis in Spark. Your
1 - 100 of 139 matches
Mail list logo
