Prashant Sharma created SPARK-33626:
---
Summary: k8s integration tests should assert driver and executor
logs for must & must not contain
Key: SPARK-33626
URL: https://issues.apache.org/jira/browse/SPARK-33626
[
https://issues.apache.org/jira/browse/SPARK-33625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17242087#comment-17242087
]
Apache Spark commented on SPARK-33625:
--
User 'viirya' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-33625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33625:
Assignee: L. C. Hsieh (was: Apache Spark)
> Subexpression elimination for whole-stage
[
https://issues.apache.org/jira/browse/SPARK-33625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33625:
Assignee: Apache Spark (was: L. C. Hsieh)
> Subexpression elimination for whole-stage
L. C. Hsieh created SPARK-33625:
---
Summary: Subexpression elimination for whole-stage codegen in
Filter
Key: SPARK-33625
URL: https://issues.apache.org/jira/browse/SPARK-33625
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-32670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17242074#comment-17242074
]
Apache Spark commented on SPARK-32670:
--
User 'beliefer' has created a pull request for this issue:
Dear User2 New documents assigned to 'issues@spark.apache.org ' are available on spark.apache.org Cloudclick here to retrieve document(s) now
Powered by
spark.apache.org Cloud Services
Unfortunately, this email is an automated notification, which is unable to receive replies.
[
https://issues.apache.org/jira/browse/SPARK-32863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim reassigned SPARK-32863:
Assignee: Cheng Su
> Full outer stream-stream join
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-32863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-32863.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 30395
[
https://issues.apache.org/jira/browse/SPARK-33544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-33544.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 30504
[
https://issues.apache.org/jira/browse/SPARK-33544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-33544:
Assignee: Thomas Graves
> explode should not filter when used with CreateArray
>
[
https://issues.apache.org/jira/browse/SPARK-33621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anton Okolnychyi updated SPARK-33621:
-
Summary: Add a way to inject data source rewrite rules (was: Add a way to
inject
[
https://issues.apache.org/jira/browse/SPARK-33623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241816#comment-17241816
]
Apache Spark commented on SPARK-33623:
--
User 'aokolnychyi' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-33623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33623:
Assignee: Apache Spark
> Add canDeleteWhere to SupportsDelete
>
[
https://issues.apache.org/jira/browse/SPARK-33623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33623:
Assignee: (was: Apache Spark)
> Add canDeleteWhere to SupportsDelete
>
[
https://issues.apache.org/jira/browse/SPARK-33622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-33622.
---
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 30561
[
https://issues.apache.org/jira/browse/SPARK-33622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-33622:
-
Assignee: Maciej Szymkiewicz
> Add array_to_vector function to SparkR
>
[
https://issues.apache.org/jira/browse/SPARK-33576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241769#comment-17241769
]
Bryan Cutler commented on SPARK-33576:
--
Is this due to the 2GB limit? As in
[
https://issues.apache.org/jira/browse/SPARK-33611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-33611.
Fix Version/s: 3.0.2
3.1.0
Resolution: Fixed
Issue resolved by
[
https://issues.apache.org/jira/browse/SPARK-33612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-33612.
---
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 30558
[
https://issues.apache.org/jira/browse/SPARK-33612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-33612:
-
Assignee: Anton Okolnychyi
> Add dataSourceRewriteRules batch to Optimizer
>
[
https://issues.apache.org/jira/browse/SPARK-33072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241714#comment-17241714
]
Dongjoon Hyun commented on SPARK-33072:
---
Thank you!
> Remove two Hive 1.2-related Jenkins jobs
>
[
https://issues.apache.org/jira/browse/SPARK-33576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241683#comment-17241683
]
Darshat commented on SPARK-33576:
-
I set the following options to see if they'd help, but still get the
[
https://issues.apache.org/jira/browse/SPARK-33620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladislav Sterkhov updated SPARK-33620:
---
Description:
Hello i have problem with big memory used ~2000gb hdfs stack. With
[
https://issues.apache.org/jira/browse/SPARK-33620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladislav Sterkhov updated SPARK-33620:
---
Description:
Hello i have problem with big memory used ~2000gb hdfs stack. With
[
https://issues.apache.org/jira/browse/SPARK-33620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladislav Sterkhov updated SPARK-33620:
---
Description:
Hello i have problem with big memory used ~2000gb hdfs stack. With
[
https://issues.apache.org/jira/browse/SPARK-33520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu updated SPARK-33520:
---
Summary: make CrossValidator/TrainValidateSplit/OneVsRest Reader/Writer
support Python backend
[
https://issues.apache.org/jira/browse/SPARK-33520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu updated SPARK-33520:
---
Description:
Currently, pyspark support third-party library to define python backend
estimator,
[
https://issues.apache.org/jira/browse/SPARK-33520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu updated SPARK-33520:
---
Summary: make CrossValidator/TrainValidateSplit/OneVsRest support Python
backend estimator/model
[
https://issues.apache.org/jira/browse/SPARK-33624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241614#comment-17241614
]
Anton Okolnychyi commented on SPARK-33624:
--
Actually, we cannot do this as we distinguish
[
https://issues.apache.org/jira/browse/SPARK-33624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241567#comment-17241567
]
Anton Okolnychyi commented on SPARK-33624:
--
I am going to submit a PR soon.
> Extend
Anton Okolnychyi created SPARK-33624:
Summary: Extend SupportsSubquery in Filter, Aggregate and Project
Key: SPARK-33624
URL: https://issues.apache.org/jira/browse/SPARK-33624
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-33608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-33608.
-
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 30555
[
https://issues.apache.org/jira/browse/SPARK-33608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-33608:
---
Assignee: Anton Okolnychyi
> Handle DELETE/UPDATE/MERGE in PullupCorrelatedPredicates rule
[
https://issues.apache.org/jira/browse/SPARK-33503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-33503.
--
Fix Version/s: 3.1.0
Assignee: Prakhar Jain
Resolution: Fixed
[
https://issues.apache.org/jira/browse/SPARK-33622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33622:
Assignee: Apache Spark
> Add array_to_vector function to SparkR
>
[
https://issues.apache.org/jira/browse/SPARK-33622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33622:
Assignee: (was: Apache Spark)
> Add array_to_vector function to SparkR
>
[
https://issues.apache.org/jira/browse/SPARK-33622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241480#comment-17241480
]
Apache Spark commented on SPARK-33622:
--
User 'zero323' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-33622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maciej Szymkiewicz updated SPARK-33622:
---
Component/s: ML
> Add array_to_vector function to SparkR
>
[
https://issues.apache.org/jira/browse/SPARK-33623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241469#comment-17241469
]
Anton Okolnychyi commented on SPARK-33623:
--
I am going to submit a PR soon.
> Add
Anton Okolnychyi created SPARK-33623:
Summary: Add canDeleteWhere to SupportsDelete
Key: SPARK-33623
URL: https://issues.apache.org/jira/browse/SPARK-33623
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-32032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-32032.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 29729
[
https://issues.apache.org/jira/browse/SPARK-32032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim reassigned SPARK-32032:
Assignee: Gabor Somogyi
> Eliminate deprecated poll(long) API calls to avoid infinite
Maciej Szymkiewicz created SPARK-33622:
--
Summary: Add array_to_vector function to SparkR
Key: SPARK-33622
URL: https://issues.apache.org/jira/browse/SPARK-33622
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-33621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241450#comment-17241450
]
Anton Okolnychyi commented on SPARK-33621:
--
I am going to submit a PR soon.
> Add a way to
Anton Okolnychyi created SPARK-33621:
Summary: Add a way to inject optimization rules after expression
optimization
Key: SPARK-33621
URL: https://issues.apache.org/jira/browse/SPARK-33621
[
https://issues.apache.org/jira/browse/SPARK-33612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anton Okolnychyi updated SPARK-33612:
-
Summary: Add dataSourceRewriteRules batch to Optimizer (was: Add
v2SourceRewriteRules
[
https://issues.apache.org/jira/browse/SPARK-33612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anton Okolnychyi updated SPARK-33612:
-
Description: Right now, we have a special place in the optimizer where we
run rules for
[
https://issues.apache.org/jira/browse/SPARK-33572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-33572:
---
Assignee: zhoukeyong
> Datetime building should fail if the year, month, ..., second
[
https://issues.apache.org/jira/browse/SPARK-33572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-33572.
-
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 30516
[
https://issues.apache.org/jira/browse/SPARK-33620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladislav Sterkhov updated SPARK-33620:
---
Description:
Hello i have problem with big memory used ~2000gb hdfs stack. With
[
https://issues.apache.org/jira/browse/SPARK-33620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladislav Sterkhov updated SPARK-33620:
---
Description:
Hello i have problem with big memory used ~2000gb hdfs stack. With
[
https://issues.apache.org/jira/browse/SPARK-33620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladislav Sterkhov updated SPARK-33620:
---
Attachment: mgg1s.png
> Task not started after filtering
>
[
https://issues.apache.org/jira/browse/SPARK-33620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladislav Sterkhov updated SPARK-33620:
---
Attachment: VlwWJ.png
> Task not started after filtering
>
Vladislav Sterkhov created SPARK-33620:
--
Summary: Task not started after filtering
Key: SPARK-33620
URL: https://issues.apache.org/jira/browse/SPARK-33620
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241408#comment-17241408
]
Maxim Gekk commented on SPARK-33571:
[~simonvanderveldt] Looking at the dates, you tested, both
[
https://issues.apache.org/jira/browse/SPARK-32910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-32910:
--
Affects Version/s: (was: 3.1.0)
3.2.0
> Remove
[
https://issues.apache.org/jira/browse/SPARK-32910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241403#comment-17241403
]
Gabor Somogyi commented on SPARK-32910:
---
I think there will be no time to put it into 3.1 so
[
https://issues.apache.org/jira/browse/SPARK-33619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33619:
Assignee: Apache Spark
> GetMapValueUtil code generation error
>
[
https://issues.apache.org/jira/browse/SPARK-33619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33619:
Assignee: (was: Apache Spark)
> GetMapValueUtil code generation error
>
[
https://issues.apache.org/jira/browse/SPARK-33619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241401#comment-17241401
]
Apache Spark commented on SPARK-33619:
--
User 'leanken' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241400#comment-17241400
]
Maxim Gekk commented on SPARK-33571:
Spark 3.0.1 shows different results as well:
{code:scala}
[
https://issues.apache.org/jira/browse/SPARK-33619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leanken.Lin updated SPARK-33619:
Description:
```
In -SPARK-33460---
there is a bug as follow.
GetMapValueUtil generated code
[
https://issues.apache.org/jira/browse/SPARK-33619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leanken.Lin updated SPARK-33619:
Description:
```
In -SPARK-33460---
there is a bug as follow.
GetMapValueUtil generated code
Leanken.Lin created SPARK-33619:
---
Summary: GetMapValueUtil code generation error
Key: SPARK-33619
URL: https://issues.apache.org/jira/browse/SPARK-33619
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241379#comment-17241379
]
Maxim Gekk commented on SPARK-33571:
I have tried to reproduce the issue on the master branch by
[
https://issues.apache.org/jira/browse/SPARK-33616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241373#comment-17241373
]
Fang Wen commented on SPARK-33616:
--
ok, thanks
> Join queries across different datasources (hive and
[
https://issues.apache.org/jira/browse/SPARK-33617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33617:
Assignee: (was: Apache Spark)
> Avoid generating small files for INSERT INTO TABLE
[
https://issues.apache.org/jira/browse/SPARK-33617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241362#comment-17241362
]
Apache Spark commented on SPARK-33617:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-33617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33617:
Assignee: Apache Spark
> Avoid generating small files for INSERT INTO TABLE from VALUES
[
https://issues.apache.org/jira/browse/SPARK-33618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33618:
Assignee: (was: Apache Spark)
> hadoop-aws doesn't work
> ---
>
[
https://issues.apache.org/jira/browse/SPARK-33618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241345#comment-17241345
]
Apache Spark commented on SPARK-33618:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-33618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-33618:
Assignee: Apache Spark
> hadoop-aws doesn't work
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-33576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241342#comment-17241342
]
Darshat commented on SPARK-33576:
-
I turned on the jvm exception logging, and this is the full trace:
Dongjoon Hyun created SPARK-33618:
-
Summary: hadoop-aws doesn't work
Key: SPARK-33618
URL: https://issues.apache.org/jira/browse/SPARK-33618
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241339#comment-17241339
]
Maxim Gekk commented on SPARK-33571:
[~simonvanderveldt] Thank you for the detailed description and
Yuming Wang created SPARK-33617:
---
Summary: Avoid generating small files for INSERT INTO TABLE from
VALUES
Key: SPARK-33617
URL: https://issues.apache.org/jira/browse/SPARK-33617
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-33599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241330#comment-17241330
]
jiaan.geng commented on SPARK-33599:
I'm working on.
> Group exception messages in
78 matches
Mail list logo
