[
https://issues.apache.org/jira/browse/SPARK-35210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta updated SPARK-35210:
---
Component/s: (was: Spark Core)
Build
> Upgrade Jetty to 9.4.40 to fix E
Darcy Shen created SPARK-35211:
--
Summary: Support UDT for Pandas with Arrow Disabled
Key: SPARK-35211
URL: https://issues.apache.org/jira/browse/SPARK-35211
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-35211:
---
Parent: SPARK-34600
Issue Type: Sub-task (was: Bug)
> Support UDT for Pandas with Arrow Dis
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-35211:
---
Description:
{code:java}
pip freeze
certifi==2020.12.5
coverage==5.5
flake8==3.9.0
mccabe==0.6.1
my
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-35211:
---
Description:
{code:java}
$ pip freeze
certifi==2020.12.5
coverage==5.5
flake8==3.9.0
mccabe==0.6.1
m
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-35211:
---
Description:
{code:java}
$ pip freeze
certifi==2020.12.5
coverage==5.5
flake8==3.9.0
mccabe==0.6.1
m
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331170#comment-17331170
]
Darcy Shen commented on SPARK-35211:
With schema provided, it works fine.
{code}
(sp
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331170#comment-17331170
]
Darcy Shen edited comment on SPARK-35211 at 4/24/21, 8:52 AM:
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-35211:
---
Description:
{code:java}
$ pip freeze
certifi==2020.12.5
coverage==5.5
flake8==3.9.0
mccabe==0.6.1
m
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331175#comment-17331175
]
Darcy Shen commented on SPARK-35211:
Provided with schema, strict type check will be
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35211:
Assignee: Apache Spark
> Support UDT for Pandas with Arrow Disabled
> ---
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331181#comment-17331181
]
Apache Spark commented on SPARK-35211:
--
User 'sadhen' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35211:
Assignee: (was: Apache Spark)
> Support UDT for Pandas with Arrow Disabled
>
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331189#comment-17331189
]
Apache Spark commented on SPARK-35211:
--
User 'sadhen' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-35210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta resolved SPARK-35210.
Fix Version/s: 3.2.0
Resolution: Fixed
This issue is resolved in https://github.com
[
https://issues.apache.org/jira/browse/SPARK-34771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331191#comment-17331191
]
Apache Spark commented on SPARK-34771:
--
User 'sadhen' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-35210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331195#comment-17331195
]
Apache Spark commented on SPARK-35210:
--
User 'sarutak' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-35210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331196#comment-17331196
]
Apache Spark commented on SPARK-35210:
--
User 'sarutak' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-35210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331199#comment-17331199
]
Apache Spark commented on SPARK-35210:
--
User 'sarutak' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-35210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331200#comment-17331200
]
Apache Spark commented on SPARK-35210:
--
User 'sarutak' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-35210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331201#comment-17331201
]
Apache Spark commented on SPARK-35210:
--
User 'sarutak' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-35199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331210#comment-17331210
]
Leonard Lausen commented on SPARK-35199:
Thank you [~dongjoon]. I'll provide an
[
https://issues.apache.org/jira/browse/SPARK-34897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-34897.
-
Fix Version/s: 3.2.0
3.1.2
3.0.3
Assignee: Yuming
[
https://issues.apache.org/jira/browse/SPARK-34897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331225#comment-17331225
]
Yuming Wang commented on SPARK-34897:
-
Issue resolved by pull request 31993
https://
[
https://issues.apache.org/jira/browse/SPARK-35199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331233#comment-17331233
]
Leonard Lausen commented on SPARK-35199:
I failed to reproduce the issue with th
Wang Yuan created SPARK-35212:
-
Summary: Spark Streaming LocationStrategy should provide a random
option that mapping kafka partitions randomly to spark executors
Key: SPARK-35212
URL: https://issues.apache.org/jira/b
[
https://issues.apache.org/jira/browse/SPARK-34990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-34990.
---
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 32146
[https://
[
https://issues.apache.org/jira/browse/SPARK-34990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-34990:
-
Assignee: Maya Anderson
> Add ParquetEncryptionSuite
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-35200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-35200.
---
Fix Version/s: (was: 3.1.1)
(was: 3.0.2)
(w
[
https://issues.apache.org/jira/browse/SPARK-35200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-35200:
-
Assignee: weixiuli
> Avoid to recompute the pending speculative tasks in the
> Executo
[
https://issues.apache.org/jira/browse/SPARK-35142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-35142.
---
Fix Version/s: 3.2.0
3.1.2
3.0.3
Resolution: Fix
[
https://issues.apache.org/jira/browse/SPARK-35142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-35142:
-
Assignee: Harutaka Kawamura
> `OneVsRest` classifier uses incorrect data type for `rawP
[
https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331332#comment-17331332
]
Apache Spark commented on SPARK-33913:
--
User 'dongjoon-hyun' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331333#comment-17331333
]
Apache Spark commented on SPARK-33913:
--
User 'dongjoon-hyun' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-33913:
--
Parent: SPARK-34651
Issue Type: Sub-task (was: Improvement)
> Upgrade Kafka to 2.8.0
[
https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-33913:
-
Assignee: Dongjoon Hyun
> Upgrade Kafka to 2.8.0
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-33913:
--
Description:
This issue aims to upgrade Kafka client to 2.8.0.
Note that Kafka 2.8.0 uses ZSTD
Adam Binford created SPARK-35213:
Summary: Corrupt DataFrame for certain withField patterns
Key: SPARK-35213
URL: https://issues.apache.org/jira/browse/SPARK-35213
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-35212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wang Yuan updated SPARK-35212:
--
Component/s: Spark Core
> Spark Streaming LocationStrategy should provide a random option that mapping
[
https://issues.apache.org/jira/browse/SPARK-35212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35212:
Assignee: Apache Spark
> Spark Streaming LocationStrategy should provide a random option
[
https://issues.apache.org/jira/browse/SPARK-35212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35212:
Assignee: (was: Apache Spark)
> Spark Streaming LocationStrategy should provide a ran
[
https://issues.apache.org/jira/browse/SPARK-35212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331352#comment-17331352
]
Apache Spark commented on SPARK-35212:
--
User 'tiehexue' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-35212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331362#comment-17331362
]
Wang Yuan commented on SPARK-35212:
---
By the way, after looking into getPreferredLocati
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-35211:
---
Labels: correctness (was: )
> Support UDT for Pandas with Arrow Disabled
>
[
https://issues.apache.org/jira/browse/SPARK-34771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331373#comment-17331373
]
Apache Spark commented on SPARK-34771:
--
User 'sadhen' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-34771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331375#comment-17331375
]
Apache Spark commented on SPARK-34771:
--
User 'sadhen' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-35211:
---
External issue URL: https://github.com/apache/spark/pull/32320
> Support UDT for Pandas with Arrow D
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-35211:
---
External issue URL: (was: https://github.com/apache/spark/pull/32320)
> Support UDT for Pandas wit
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331376#comment-17331376
]
Apache Spark commented on SPARK-35211:
--
User 'sadhen' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-35210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta updated SPARK-35210:
---
Fix Version/s: 3.1.2
3.0.3
> Upgrade Jetty to 9.4.40 to fix ERR_CONNECTIO
[
https://issues.apache.org/jira/browse/SPARK-35139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331378#comment-17331378
]
PengLei commented on SPARK-35139:
-
I am working on this
> Support ANSI intervals as Arr
ulysses you created SPARK-35214:
---
Summary: OptimizeSkewedJoin support ShuffledHashJoinExec
Key: SPARK-35214
URL: https://issues.apache.org/jira/browse/SPARK-35214
Project: Spark
Issue Type: Imp
[
https://issues.apache.org/jira/browse/SPARK-35024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng resolved SPARK-35024.
--
Resolution: Resolved
> Refactor LinearSVC - support virtual centering
> --
[
https://issues.apache.org/jira/browse/SPARK-35214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35214:
Assignee: (was: Apache Spark)
> OptimizeSkewedJoin support ShuffledHashJoinExec
> ---
[
https://issues.apache.org/jira/browse/SPARK-35214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35214:
Assignee: Apache Spark
> OptimizeSkewedJoin support ShuffledHashJoinExec
> --
[
https://issues.apache.org/jira/browse/SPARK-35214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331393#comment-17331393
]
Apache Spark commented on SPARK-35214:
--
User 'ulysses-you' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-35190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331418#comment-17331418
]
xiaoli commented on SPARK-35190:
Hi [~hyukjin.kwon] Thanks for your checking my question
L. C. Hsieh created SPARK-35215:
---
Summary: Update custom metrics per certain rows
Key: SPARK-35215
URL: https://issues.apache.org/jira/browse/SPARK-35215
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-35215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331431#comment-17331431
]
Apache Spark commented on SPARK-35215:
--
User 'viirya' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-35215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331430#comment-17331430
]
Apache Spark commented on SPARK-35215:
--
User 'viirya' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-35215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35215:
Assignee: L. C. Hsieh (was: Apache Spark)
> Update custom metrics per certain rows
> ---
[
https://issues.apache.org/jira/browse/SPARK-35215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-35215:
Assignee: Apache Spark (was: L. C. Hsieh)
> Update custom metrics per certain rows
> ---
62 matches
Mail list logo
