[
https://issues.apache.org/jira/browse/SPARK-32863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim reassigned SPARK-32863:
Assignee: Cheng Su
> Full outer stream-stream join
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-32863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-32863.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 30395
[
https://issues.apache.org/jira/browse/SPARK-33625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33625:
Assignee: L. C. Hsieh (was: Apache Spark)
> Subexpression elimination for whole-stage
[
https://issues.apache.org/jira/browse/SPARK-33625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17242087#comment-17242087
]
Apache Spark commented on SPARK-33625:
--
User 'viirya' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-33544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-33544:
Assignee: Thomas Graves
> explode should not filter when used with CreateArray
>
[
https://issues.apache.org/jira/browse/SPARK-33625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33625:
Assignee: Apache Spark (was: L. C. Hsieh)
> Subexpression elimination for whole-stage
[
https://issues.apache.org/jira/browse/SPARK-33544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-33544.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 30504
[
https://issues.apache.org/jira/browse/SPARK-32670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17242074#comment-17242074
]
Apache Spark commented on SPARK-32670:
--
User 'beliefer' has created a pull request for this issue:
Dear User2 New documents assigned to 'issues@spark.apache.org ' are available on spark.apache.org Cloudclick here to retrieve document(s) now
Powered by
spark.apache.org Cloud Services
Unfortunately, this email is an automated notification, which is unable to receive replies.
L. C. Hsieh created SPARK-33625:
---
Summary: Subexpression elimination for whole-stage codegen in
Filter
Key: SPARK-33625
URL: https://issues.apache.org/jira/browse/SPARK-33625
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-33621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anton Okolnychyi updated SPARK-33621:
-
Summary: Add a way to inject data source rewrite rules (was: Add a way to
inject
[
https://issues.apache.org/jira/browse/SPARK-33576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241769#comment-17241769
]
Bryan Cutler commented on SPARK-33576:
--
Is this due to the 2GB limit? As in
[
https://issues.apache.org/jira/browse/SPARK-33623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33623:
Assignee: (was: Apache Spark)
> Add canDeleteWhere to SupportsDelete
>
[
https://issues.apache.org/jira/browse/SPARK-33623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33623:
Assignee: Apache Spark
> Add canDeleteWhere to SupportsDelete
>
[
https://issues.apache.org/jira/browse/SPARK-33623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241816#comment-17241816
]
Apache Spark commented on SPARK-33623:
--
User 'aokolnychyi' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-33622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-33622.
---
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 30561
[
https://issues.apache.org/jira/browse/SPARK-33622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-33622:
-
Assignee: Maciej Szymkiewicz
> Add array_to_vector function to SparkR
>
[
https://issues.apache.org/jira/browse/SPARK-33612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-33612:
-
Assignee: Anton Okolnychyi
> Add dataSourceRewriteRules batch to Optimizer
>
[
https://issues.apache.org/jira/browse/SPARK-33612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-33612.
---
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 30558
[
https://issues.apache.org/jira/browse/SPARK-33611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-33611.
Fix Version/s: 3.0.2
3.1.0
Resolution: Fixed
Issue resolved by
Anton Okolnychyi created SPARK-33624:
Summary: Extend SupportsSubquery in Filter, Aggregate and Project
Key: SPARK-33624
URL: https://issues.apache.org/jira/browse/SPARK-33624
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-33520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu updated SPARK-33520:
---
Description:
Currently, pyspark support third-party library to define python backend
estimator,
[
https://issues.apache.org/jira/browse/SPARK-33520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu updated SPARK-33520:
---
Summary: make CrossValidator/TrainValidateSplit/OneVsRest Reader/Writer
support Python backend
[
https://issues.apache.org/jira/browse/SPARK-33072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241714#comment-17241714
]
Dongjoon Hyun commented on SPARK-33072:
---
Thank you!
> Remove two Hive 1.2-related Jenkins jobs
>
[
https://issues.apache.org/jira/browse/SPARK-33618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241345#comment-17241345
]
Apache Spark commented on SPARK-33618:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-33618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33618:
Assignee: Apache Spark
> hadoop-aws doesn't work
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-33619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leanken.Lin updated SPARK-33619:
Description:
```
In -SPARK-33460---
there is a bug as follow.
GetMapValueUtil generated code
[
https://issues.apache.org/jira/browse/SPARK-33616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241373#comment-17241373
]
Fang Wen commented on SPARK-33616:
--
ok, thanks
> Join queries across different datasources (hive and
[
https://issues.apache.org/jira/browse/SPARK-33619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33619:
Assignee: (was: Apache Spark)
> GetMapValueUtil code generation error
>
[
https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241400#comment-17241400
]
Maxim Gekk commented on SPARK-33571:
Spark 3.0.1 shows different results as well:
{code:scala}
[
https://issues.apache.org/jira/browse/SPARK-33619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241401#comment-17241401
]
Apache Spark commented on SPARK-33619:
--
User 'leanken' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-33617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33617:
Assignee: (was: Apache Spark)
> Avoid generating small files for INSERT INTO TABLE
[
https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241408#comment-17241408
]
Maxim Gekk commented on SPARK-33571:
[~simonvanderveldt] Looking at the dates, you tested, both
Yuming Wang created SPARK-33617:
---
Summary: Avoid generating small files for INSERT INTO TABLE from
VALUES
Key: SPARK-33617
URL: https://issues.apache.org/jira/browse/SPARK-33617
Project: Spark
Dongjoon Hyun created SPARK-33618:
-
Summary: hadoop-aws doesn't work
Key: SPARK-33618
URL: https://issues.apache.org/jira/browse/SPARK-33618
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-33576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241342#comment-17241342
]
Darshat commented on SPARK-33576:
-
I turned on the jvm exception logging, and this is the full trace:
[
https://issues.apache.org/jira/browse/SPARK-33617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241362#comment-17241362
]
Apache Spark commented on SPARK-33617:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-33617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33617:
Assignee: Apache Spark
> Avoid generating small files for INSERT INTO TABLE from VALUES
[
https://issues.apache.org/jira/browse/SPARK-33619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leanken.Lin updated SPARK-33619:
Description:
```
In -SPARK-33460---
there is a bug as follow.
GetMapValueUtil generated code
[
https://issues.apache.org/jira/browse/SPARK-33619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33619:
Assignee: Apache Spark
> GetMapValueUtil code generation error
>
[
https://issues.apache.org/jira/browse/SPARK-33599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241330#comment-17241330
]
jiaan.geng commented on SPARK-33599:
I'm working on.
> Group exception messages in
[
https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241379#comment-17241379
]
Maxim Gekk commented on SPARK-33571:
I have tried to reproduce the issue on the master branch by
[
https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241339#comment-17241339
]
Maxim Gekk commented on SPARK-33571:
[~simonvanderveldt] Thank you for the detailed description and
[
https://issues.apache.org/jira/browse/SPARK-33618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33618:
Assignee: (was: Apache Spark)
> hadoop-aws doesn't work
> ---
>
Leanken.Lin created SPARK-33619:
---
Summary: GetMapValueUtil code generation error
Key: SPARK-33619
URL: https://issues.apache.org/jira/browse/SPARK-33619
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-32910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-32910:
--
Affects Version/s: (was: 3.1.0)
3.2.0
> Remove
[
https://issues.apache.org/jira/browse/SPARK-32910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241403#comment-17241403
]
Gabor Somogyi commented on SPARK-32910:
---
I think there will be no time to put it into 3.1 so
Prashant Sharma created SPARK-33626:
---
Summary: k8s integration tests should assert driver and executor
logs for must & must not contain
Key: SPARK-33626
URL: https://issues.apache.org/jira/browse/SPARK-33626
[
https://issues.apache.org/jira/browse/SPARK-33572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-33572:
---
Assignee: zhoukeyong
> Datetime building should fail if the year, month, ..., second
[
https://issues.apache.org/jira/browse/SPARK-33572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-33572.
-
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 30516
Maciej Szymkiewicz created SPARK-33622:
--
Summary: Add array_to_vector function to SparkR
Key: SPARK-33622
URL: https://issues.apache.org/jira/browse/SPARK-33622
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-33623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241469#comment-17241469
]
Anton Okolnychyi commented on SPARK-33623:
--
I am going to submit a PR soon.
> Add
[
https://issues.apache.org/jira/browse/SPARK-33620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladislav Sterkhov updated SPARK-33620:
---
Description:
Hello i have problem with big memory used ~2000gb hdfs stack. With
Anton Okolnychyi created SPARK-33621:
Summary: Add a way to inject optimization rules after expression
optimization
Key: SPARK-33621
URL: https://issues.apache.org/jira/browse/SPARK-33621
[
https://issues.apache.org/jira/browse/SPARK-33612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anton Okolnychyi updated SPARK-33612:
-
Summary: Add dataSourceRewriteRules batch to Optimizer (was: Add
v2SourceRewriteRules
[
https://issues.apache.org/jira/browse/SPARK-32032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim reassigned SPARK-32032:
Assignee: Gabor Somogyi
> Eliminate deprecated poll(long) API calls to avoid infinite
[
https://issues.apache.org/jira/browse/SPARK-32032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-32032.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 29729
[
https://issues.apache.org/jira/browse/SPARK-33503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-33503.
--
Fix Version/s: 3.1.0
Assignee: Prakhar Jain
Resolution: Fixed
[
https://issues.apache.org/jira/browse/SPARK-33620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladislav Sterkhov updated SPARK-33620:
---
Attachment: mgg1s.png
> Task not started after filtering
>
[
https://issues.apache.org/jira/browse/SPARK-33620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladislav Sterkhov updated SPARK-33620:
---
Description:
Hello i have problem with big memory used ~2000gb hdfs stack. With
Anton Okolnychyi created SPARK-33623:
Summary: Add canDeleteWhere to SupportsDelete
Key: SPARK-33623
URL: https://issues.apache.org/jira/browse/SPARK-33623
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-33622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241480#comment-17241480
]
Apache Spark commented on SPARK-33622:
--
User 'zero323' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-33622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33622:
Assignee: (was: Apache Spark)
> Add array_to_vector function to SparkR
>
[
https://issues.apache.org/jira/browse/SPARK-33622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33622:
Assignee: Apache Spark
> Add array_to_vector function to SparkR
>
[
https://issues.apache.org/jira/browse/SPARK-33621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241450#comment-17241450
]
Anton Okolnychyi commented on SPARK-33621:
--
I am going to submit a PR soon.
> Add a way to
[
https://issues.apache.org/jira/browse/SPARK-33620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladislav Sterkhov updated SPARK-33620:
---
Attachment: VlwWJ.png
> Task not started after filtering
>
[
https://issues.apache.org/jira/browse/SPARK-33622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maciej Szymkiewicz updated SPARK-33622:
---
Component/s: ML
> Add array_to_vector function to SparkR
>
Vladislav Sterkhov created SPARK-33620:
--
Summary: Task not started after filtering
Key: SPARK-33620
URL: https://issues.apache.org/jira/browse/SPARK-33620
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-33612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anton Okolnychyi updated SPARK-33612:
-
Description: Right now, we have a special place in the optimizer where we
run rules for
[
https://issues.apache.org/jira/browse/SPARK-33624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241614#comment-17241614
]
Anton Okolnychyi commented on SPARK-33624:
--
Actually, we cannot do this as we distinguish
[
https://issues.apache.org/jira/browse/SPARK-33520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu updated SPARK-33520:
---
Summary: make CrossValidator/TrainValidateSplit/OneVsRest support Python
backend estimator/model
[
https://issues.apache.org/jira/browse/SPARK-33620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladislav Sterkhov updated SPARK-33620:
---
Description:
Hello i have problem with big memory used ~2000gb hdfs stack. With
[
https://issues.apache.org/jira/browse/SPARK-33608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-33608:
---
Assignee: Anton Okolnychyi
> Handle DELETE/UPDATE/MERGE in PullupCorrelatedPredicates rule
[
https://issues.apache.org/jira/browse/SPARK-33624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241567#comment-17241567
]
Anton Okolnychyi commented on SPARK-33624:
--
I am going to submit a PR soon.
> Extend
[
https://issues.apache.org/jira/browse/SPARK-33608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-33608.
-
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 30555
[
https://issues.apache.org/jira/browse/SPARK-33620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladislav Sterkhov updated SPARK-33620:
---
Description:
Hello i have problem with big memory used ~2000gb hdfs stack. With
[
https://issues.apache.org/jira/browse/SPARK-33620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladislav Sterkhov updated SPARK-33620:
---
Description:
Hello i have problem with big memory used ~2000gb hdfs stack. With
[
https://issues.apache.org/jira/browse/SPARK-33576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241683#comment-17241683
]
Darshat commented on SPARK-33576:
-
I set the following options to see if they'd help, but still get the
78 matches
Mail list logo