[
https://issues.apache.org/jira/browse/SPARK-45094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jean-Francis Roy updated SPARK-45094:
-
Environment: Tested on Spark 3.2.1 and Spark 3.4.0, using Scala 2.12.17 and
OpenJDK 11.0
Jean-Francis Roy created SPARK-45094:
Summary: isEmpty on union of RDDs sharing the same trait crash
when the first RDD is empty
Key: SPARK-45094
URL: https://issues.apache.org/jira/browse/SPARK-45094
[
https://issues.apache.org/jira/browse/SPARK-41129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roy updated SPARK-41129:
Description:
When a sql has only a small amount of concurrency (10), the sql will generate
11 jobs, and can be ex
[
https://issues.apache.org/jira/browse/SPARK-41129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roy updated SPARK-41129:
Attachment: image-2022-11-14-13-44-04-384.png
> When multiple SQLs are concurrent, the driver subquery thread is p
[
https://issues.apache.org/jira/browse/SPARK-41129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roy updated SPARK-41129:
Attachment: (was: image-2022-11-14-13-44-04-384.png)
> When multiple SQLs are concurrent, the driver subquery
[
https://issues.apache.org/jira/browse/SPARK-41129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roy updated SPARK-41129:
Attachment: (was: image-2022-11-14-13-43-48-537.png)
> When multiple SQLs are concurrent, the driver subquery
[
https://issues.apache.org/jira/browse/SPARK-41129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roy updated SPARK-41129:
Attachment: image-2022-11-14-13-43-48-537.png
> When multiple SQLs are concurrent, the driver subquery thread is p
[
https://issues.apache.org/jira/browse/SPARK-41129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roy updated SPARK-41129:
Attachment: locksqlPNG.PNG
> When multiple SQLs are concurrent, the driver subquery thread is permanently
> locke
[
https://issues.apache.org/jira/browse/SPARK-41129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roy updated SPARK-41129:
Attachment: normaljobs.PNG
> When multiple SQLs are concurrent, the driver subquery thread is permanently
> locke
Roy created SPARK-41129:
---
Summary: When multiple SQLs are concurrent, the driver subquery
thread is permanently locked
Key: SPARK-41129
URL: https://issues.apache.org/jira/browse/SPARK-41129
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-37751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17581506#comment-17581506
]
Benoit Roy edited comment on SPARK-37751 at 8/18/22 8:10 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-37751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17581506#comment-17581506
]
Benoit Roy edited comment on SPARK-37751 at 8/18/22 7:54 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-37751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17581506#comment-17581506
]
Benoit Roy edited comment on SPARK-37751 at 8/18/22 7:48 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-37751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17581506#comment-17581506
]
Benoit Roy edited comment on SPARK-37751 at 8/18/22 7:48 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-37751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17581506#comment-17581506
]
Benoit Roy commented on SPARK-37751:
Hello, we have also encountered this issue afte
[
https://issues.apache.org/jira/browse/SPARK-39900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574288#comment-17574288
]
Benoit Roy commented on SPARK-39900:
This is much appreciated! ;)
> Issue with quer
[
https://issues.apache.org/jira/browse/SPARK-39900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-39900:
---
Summary: Issue with querying dataframe produced by 'binaryFile' format
using 'not' operator (was: Q
[
https://issues.apache.org/jira/browse/SPARK-39900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-39900:
---
Description:
When creating a dataframe using the binaryFile format I am encountering weird
result w
[
https://issues.apache.org/jira/browse/SPARK-39900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-39900:
---
Description:
When creating a dataframe using the binaryFile format I am encountering weird
result w
[
https://issues.apache.org/jira/browse/SPARK-39900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-39900:
---
Summary: Querying dataframe produced by 'binaryFile' format using 'not'
operator (was: Incorrect re
[
https://issues.apache.org/jira/browse/SPARK-39900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-39900:
---
Description:
When creating a dataframe using the binaryFile format I am encountering weird
result w
[
https://issues.apache.org/jira/browse/SPARK-39900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-39900:
---
Description:
When creating a dataframe using the binaryFile format I am encountering weird
result w
Benoit Roy created SPARK-39900:
--
Summary: Incorrect result when query dataframe produced by
'binaryFile' format
Key: SPARK-39900
URL: https://issues.apache.org/jira/browse/SPARK-39900
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371868#comment-17371868
]
Roy commented on SPARK-30332:
-
We came up with similar situation. We apply many window funci
[
https://issues.apache.org/jira/browse/SPARK-34441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285618#comment-17285618
]
Jean-Francis Roy edited comment on SPARK-34441 at 2/17/21, 3:17 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-34441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285618#comment-17285618
]
Jean-Francis Roy commented on SPARK-34441:
--
[~hyukjin.kwon] of course, here is
[
https://issues.apache.org/jira/browse/SPARK-34441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284955#comment-17284955
]
Jean-Francis Roy commented on SPARK-34441:
--
It even seems we cannot reproduce t
[
https://issues.apache.org/jira/browse/SPARK-25243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284954#comment-17284954
]
Jean-Francis Roy commented on SPARK-25243:
--
```
from_json() doesn't support the
[
https://issues.apache.org/jira/browse/SPARK-25243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284954#comment-17284954
]
Jean-Francis Roy edited comment on SPARK-25243 at 2/15/21, 9:25 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-25243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284954#comment-17284954
]
Jean-Francis Roy edited comment on SPARK-25243 at 2/15/21, 9:25 PM:
--
Jean-Francis Roy created SPARK-34441:
Summary: from_json documentation is wrong about malformed JSONs
output
Key: SPARK-34441
URL: https://issues.apache.org/jira/browse/SPARK-34441
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-25243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284951#comment-17284951
]
Jean-Francis Roy commented on SPARK-25243:
--
The documentation still states that
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17046654#comment-17046654
]
Benoit Roy commented on SPARK-30855:
Ok thanks for letting me know. Are there any p
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17044741#comment-17044741
]
Benoit Roy commented on SPARK-30855:
Do you know if there is any distro available of
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17044453#comment-17044453
]
Benoit Roy commented on SPARK-30855:
Awesome. Thanks for contributing the PR. I se
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Description:
An exception occurs when trying to use a _* expand_ selection after performing
an expl
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Description:
An exception occurs when trying to use a _* expand_ selection after performing
an expl
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Description:
An exception occurs when trying to use a _* expand_ selection after performing
an expl
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Description:
An exception occurs when trying to use a _* expand_ selection after performing
an expl
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Description:
An exception occurs when trying to use a _* expand_ selection after performing
an expl
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Description:
An exception occurs when trying to use a _* expand_ selection after performing
an expl
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Description:
An exception occurs when trying to use a _* expand_ selection after performing
an expl
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Description:
An exception occurs when trying to use a _* expand_ selection after performing
an expl
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Description:
An exception occurs when trying to use a _* expand_ selection after performing
an expl
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Description:
An exception occurs when trying to use a _* expand_ selection after performing
an expl
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Description:
The a exception occurs when trying to use a _* expand_ selection after
performing an e
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Description:
The a exception occurs when trying to use a * expand selection after performing
an exp
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Description:
The a exception occurs when trying to use a * expand selection after performing
an exp
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Summary: Issue using 'explode' function followed by a (*)star expand
selection of resulting struct
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Description:
Here's a public repo containing a scala test case that reproduces the issue
* g...@
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Attachment: (was: messagepack-datasource.zip)
> Issue with Binding attribute: Couldn't find _gen
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Description:
Im in the early phase of writting a custom spark datasource for messagepack.
I have
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Description:
Im in the early phase of writting a custom spark datasource for messagepack.
I have
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Attachment: (was: msgpack-datasource.zip)
> Issue with Binding attribute: Couldn't find _gen_ali
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Attachment: messagepack-datasource.zip
> Issue with Binding attribute: Couldn't find _gen_alias_ whe
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Description:
Im in the early phase of writting a custom spark datasource for messagepack.
I have a
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Description:
Im in the early phase of writting a custom spark datasource for messagepack.
I have a
Benoit Roy created SPARK-30855:
--
Summary: Issue with Binding attribute: Couldn't find _gen_alias_
when using 'explode' function.
Key: SPARK-30855
URL: https://issues.apache.org/jira/browse/SPARK-30855
Pr
[
https://issues.apache.org/jira/browse/SPARK-30855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Benoit Roy updated SPARK-30855:
---
Attachment: msgpack-datasource.zip
> Issue with Binding attribute: Couldn't find _gen_alias_ when us
[
https://issues.apache.org/jira/browse/SPARK-28193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
SUSHMIT ROY resolved SPARK-28193.
-
Resolution: Fixed
This was due to a databricks environment issue. Hence closing it
> toPandas()
SUSHMIT ROY created SPARK-28193:
---
Summary: toPandas() not working as expected in Apache Spark 2.4.0
Key: SPARK-28193
URL: https://issues.apache.org/jira/browse/SPARK-28193
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-24018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jean-Francis Roy resolved SPARK-24018.
--
Resolution: Fixed
Fix Version/s: 2.3.2
I confirm the fix that appeared in Spark
[
https://issues.apache.org/jira/browse/SPARK-24018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16537815#comment-16537815
]
Jean-Francis Roy commented on SPARK-24018:
--
Oh, indeed you are right! I was mis
[
https://issues.apache.org/jira/browse/SPARK-24018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16535854#comment-16535854
]
Jean-Francis Roy commented on SPARK-24018:
--
I don't think this is only related
[
https://issues.apache.org/jira/browse/SPARK-24018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jean-Francis Roy updated SPARK-24018:
-
Description:
On a brand-new installation of Spark 2.3.0 with a user-provided hadoop-2.8.3
Jean-Francis Roy created SPARK-24018:
Summary: Spark-without-hadoop package fails to create or read
parquet files with snappy compression
Key: SPARK-24018
URL: https://issues.apache.org/jira/browse/SPARK-24018
Sudip Roy created SPARK-1692:
Summary: Enable external sorting in Spark SQL aggregates
Key: SPARK-1692
URL: https://issues.apache.org/jira/browse/SPARK-1692
Project: Spark
Issue Type: Improvement
67 matches
Mail list logo
