jiaan.geng created SPARK-29446:
--
Summary: Upgrade netty-all to 4.1.42 and fix vulnerabilities.
Key: SPARK-29446
URL: https://issues.apache.org/jira/browse/SPARK-29446
Project: Spark
Issue Type:
Fokko Driesprong created SPARK-29445:
Summary: Bump netty-all from 4.1.39.Final to 4.1.42.Final
Key: SPARK-29445
URL: https://issues.apache.org/jira/browse/SPARK-29445
Project: Spark
Issu
[
https://issues.apache.org/jira/browse/SPARK-29432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949910#comment-16949910
]
L. C. Hsieh commented on SPARK-29432:
-
You can find related discussion like:
http:/
[
https://issues.apache.org/jira/browse/SPARK-29428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949908#comment-16949908
]
L. C. Hsieh commented on SPARK-29428:
-
Yeah, I think it is not valid to set None to
[
https://issues.apache.org/jira/browse/SPARK-29421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949899#comment-16949899
]
Lantao Jin commented on SPARK-29421:
PR filed. [~cloud_fan], could you help to revie
[
https://issues.apache.org/jira/browse/SPARK-29426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949892#comment-16949892
]
Jungtaek Lim commented on SPARK-29426:
--
Could you attach query listener and see the
[
https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949886#comment-16949886
]
angerszhu commented on SPARK-29295:
---
This probelm seems start from hive 1.2
I test i
[
https://issues.apache.org/jira/browse/SPARK-29435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949881#comment-16949881
]
Sandeep Katta commented on SPARK-29435:
---
[~koert] can you please apply this
[patc
[
https://issues.apache.org/jira/browse/SPARK-12014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949874#comment-16949874
]
Yuming Wang commented on SPARK-12014:
-
[~chutium] This issue has been fixed since we
[
https://issues.apache.org/jira/browse/SPARK-29222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949869#comment-16949869
]
huangtianhua commented on SPARK-29222:
--
[~hyukjin.kwon], we took test to increase d
Jackey Lee created SPARK-29444:
--
Summary: Add configuration to support JacksonGenrator to keep
fields with null values
Key: SPARK-29444
URL: https://issues.apache.org/jira/browse/SPARK-29444
Project: Spa
[
https://issues.apache.org/jira/browse/SPARK-29428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949863#comment-16949863
]
Huaxin Gao commented on SPARK-29428:
This seems to be a usage error. The error was i
[
https://issues.apache.org/jira/browse/SPARK-29402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Cutler reassigned SPARK-29402:
Assignee: Bryan Cutler
> Add tests for grouped map pandas_udf using window
>
[
https://issues.apache.org/jira/browse/SPARK-29402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Cutler resolved SPARK-29402.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 26063
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-25341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh reassigned SPARK-25341:
---
Assignee: Yuanjian Li
> Support rolling back a shuffle map stage and re-generate the shuffl
[
https://issues.apache.org/jira/browse/SPARK-29148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-29148:
-
Assignee: Thomas Graves
> Modify dynamic allocation manager for stage level scheduling
[
https://issues.apache.org/jira/browse/SPARK-29415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-29415:
-
Assignee: Thomas Graves
> Stage Level Sched: Add base ResourceProfile and Request class
[
https://issues.apache.org/jira/browse/SPARK-29306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-29306:
-
Assignee: Thomas Graves
> Executors need to track what ResourceProfile they are created
[
https://issues.apache.org/jira/browse/SPARK-28867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949767#comment-16949767
]
Imran Rashid commented on SPARK-28867:
--
This is closely related to SPARK-20656. It
[
https://issues.apache.org/jira/browse/SPARK-29396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949765#comment-16949765
]
Luca Canali commented on SPARK-29396:
-
This looks quite a good improvement proposal
[
https://issues.apache.org/jira/browse/SPARK-27812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ilan Filonenko updated SPARK-27812:
---
Affects Version/s: 2.4.4
> kubernetes client import non-daemon thread which block jvm exit.
[
https://issues.apache.org/jira/browse/SPARK-29432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949678#comment-16949678
]
Prasanna Saraswathi Krishnan commented on SPARK-29432:
--
Hello
I co
[
https://issues.apache.org/jira/browse/SPARK-29432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949068#comment-16949068
]
Prasanna Saraswathi Krishnan edited comment on SPARK-29432 at 10/11/19 5:51 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-29432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanna Saraswathi Krishnan updated SPARK-29432:
-
Issue Type: Bug (was: Question)
> nullable flag of new column c
[
https://issues.apache.org/jira/browse/SPARK-29432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanna Saraswathi Krishnan reopened SPARK-29432:
--
Edited the commands to reproduce the issue. The issue is not resol
[
https://issues.apache.org/jira/browse/SPARK-29432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasanna Saraswathi Krishnan updated SPARK-29432:
-
Description:
When I add a new column to a dataframe with {{withC
[
https://issues.apache.org/jira/browse/SPARK-29443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
James Nguyen updated SPARK-29443:
-
Environment:
EKS version: v1.14.6-eks-5047ed with 18 x r5a.12xlarge EC2 instances as Worker
nod
[
https://issues.apache.org/jira/browse/SPARK-29396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949669#comment-16949669
]
Imran Rashid commented on SPARK-29396:
--
The memory monitor plugin I wrote (why I pu
James Nguyen created SPARK-29443:
Summary: Spark-on-Kubernetes: driver pod keeps
spinning/terminating executor pods
Key: SPARK-29443
URL: https://issues.apache.org/jira/browse/SPARK-29443
Project: Spa
[
https://issues.apache.org/jira/browse/SPARK-29442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-29442:
--
Summary: Set `default` mode should override the existing mode (was: Last
`mode("default")` sh
Dongjoon Hyun created SPARK-29442:
-
Summary: Last `mode("default")` should work like `mode("error")`
Key: SPARK-29442
URL: https://issues.apache.org/jira/browse/SPARK-29442
Project: Spark
Iss
[
https://issues.apache.org/jira/browse/SPARK-27981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949598#comment-16949598
]
Kuhu Shukla commented on SPARK-27981:
-
Hello [~dongjoon], I am seeing the following
[
https://issues.apache.org/jira/browse/SPARK-29428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949586#comment-16949586
]
Huaxin Gao commented on SPARK-29428:
I will take a look of this.
> Can't persist/s
[
https://issues.apache.org/jira/browse/SPARK-28547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949561#comment-16949561
]
Hyukjin Kwon commented on SPARK-28547:
--
[~antonkulaga], if you're unable to elabora
[
https://issues.apache.org/jira/browse/SPARK-29423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-29423:
-
Affects Version/s: 2.4.3
> leak on org.apache.spark.sql.execution.streaming.StreamingQueryListe
[
https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949556#comment-16949556
]
Hyukjin Kwon commented on SPARK-16534:
--
Actually, this JIRA seems not going to be f
[
https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949554#comment-16949554
]
Hyukjin Kwon commented on SPARK-16534:
--
No, it was resolved as discussed about affe
prudhviraj created SPARK-29441:
--
Summary: Unable to Alter table column type in spark.
Key: SPARK-29441
URL: https://issues.apache.org/jira/browse/SPARK-29441
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949521#comment-16949521
]
Rakesh edited comment on SPARK-16534 at 10/11/19 2:59 PM:
--
Was
[
https://issues.apache.org/jira/browse/SPARK-29435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949522#comment-16949522
]
Sandeep Katta commented on SPARK-29435:
---
Ya I am even able to reproduce it, I am l
[
https://issues.apache.org/jira/browse/SPARK-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949521#comment-16949521
]
Rakesh commented on SPARK-16534:
Was this actually resolved? Any when the support will b
[
https://issues.apache.org/jira/browse/SPARK-29435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandeep Katta updated SPARK-29435:
--
Comment: was deleted
(was: [~koert] I will investigate this further, If I found root cause wil
[
https://issues.apache.org/jira/browse/SPARK-29435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949508#comment-16949508
]
Sandeep Katta commented on SPARK-29435:
---
[~koert] I will investigate this further,
[
https://issues.apache.org/jira/browse/SPARK-29437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949483#comment-16949483
]
Ankit Raj Boudh commented on SPARK-29437:
-
hi @Tomasz Bartczak,
I will check th
Maxim Gekk created SPARK-29440:
--
Summary: Support java.time.Duration as an external type of
CalendarIntervalType
Key: SPARK-29440
URL: https://issues.apache.org/jira/browse/SPARK-29440
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949465#comment-16949465
]
Jungtaek Lim commented on SPARK-29438:
--
Could you please link the actual code block
[
https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Genmao Yu updated SPARK-29438:
--
Description:
Now, Spark use the `TaskPartitionId` to determine the StateStore path.
{code:java}
TaskPa
[
https://issues.apache.org/jira/browse/SPARK-29396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949460#comment-16949460
]
Thomas Graves commented on SPARK-29396:
---
While I do like the idea, do we have som
[
https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949461#comment-16949461
]
Genmao Yu commented on SPARK-29438:
---
[~kabhwan] Yes, the whole statestore path is
`Ch
[
https://issues.apache.org/jira/browse/SPARK-29396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-29396:
-
Assignee: (was: Thomas Graves)
> Extend Spark plugin interface to driver
>
[
https://issues.apache.org/jira/browse/SPARK-29396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-29396:
-
Assignee: Thomas Graves
> Extend Spark plugin interface to driver
> ---
Wenchen Fan created SPARK-29439:
---
Summary: DDL commands should not use DataSourceV2Relation
Key: SPARK-29439
URL: https://issues.apache.org/jira/browse/SPARK-29439
Project: Spark
Issue Type: Im
[
https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949430#comment-16949430
]
Jungtaek Lim edited comment on SPARK-29438 at 10/11/19 1:12 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949430#comment-16949430
]
Jungtaek Lim commented on SPARK-29438:
--
Could you point out the codebase where you
[
https://issues.apache.org/jira/browse/SPARK-29427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexander Hagerf updated SPARK-29427:
-
Summary: Create KeyValueGroupedDataset in a relational way (was: Create
KeyValueGrouped
[
https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949365#comment-16949365
]
Genmao Yu edited comment on SPARK-29438 at 10/11/19 11:15 AM:
[
https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949365#comment-16949365
]
Genmao Yu edited comment on SPARK-29438 at 10/11/19 11:15 AM:
[
https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949365#comment-16949365
]
Genmao Yu commented on SPARK-29438:
---
There are several optional alternatives to resolv
[
https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949190#comment-16949190
]
Shimin Yang edited comment on SPARK-29302 at 10/11/19 10:41 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949359#comment-16949359
]
Shimin Yang commented on SPARK-29302:
-
Hi [~hzfeiwang], thanks for your contribution
[
https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Genmao Yu updated SPARK-29438:
--
Description:
Now, Spark use the `TaskPartitionId` to determine the StateStore path.
{code:java}
TaskPa
Genmao Yu created SPARK-29438:
-
Summary: Failed to get state store in stream-stream join
Key: SPARK-29438
URL: https://issues.apache.org/jira/browse/SPARK-29438
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-29423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949340#comment-16949340
]
Yuming Wang commented on SPARK-29423:
-
Maybe we should lazily initialize {{Streaming
[
https://issues.apache.org/jira/browse/SPARK-29436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
merrily01 updated SPARK-29436:
--
Issue Type: New Feature (was: Improvement)
> Support executor for selecting scheduler through schedul
Tomasz Bartczak created SPARK-29437:
---
Summary: CSV Writer should escape 'escapechar' when it exists in
the data
Key: SPARK-29437
URL: https://issues.apache.org/jira/browse/SPARK-29437
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-29427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949282#comment-16949282
]
L. C. Hsieh commented on SPARK-29427:
-
This seems to be an interesting idea. I think
[
https://issues.apache.org/jira/browse/SPARK-29436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
merrily01 updated SPARK-29436:
--
Summary: Support executor for selecting scheduler through scheduler name in
the case of k8s multi-sche
[
https://issues.apache.org/jira/browse/SPARK-29436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
merrily01 updated SPARK-29436:
--
Description: In the case of k8s multi-scheduler, support executor for
selecting scheduler through sche
merrily01 created SPARK-29436:
-
Summary: Support executor for selecting scheduler through
scheduler name
Key: SPARK-29436
URL: https://issues.apache.org/jira/browse/SPARK-29436
Project: Spark
Is
[
https://issues.apache.org/jira/browse/SPARK-29427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh updated SPARK-29427:
Component/s: (was: Spark Core)
> Create KeyValueGroupedDataset from RelationalGroupedDataset
>
[
https://issues.apache.org/jira/browse/SPARK-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
antonkulaga closed SPARK-6363.
--
Resolved
> Switch to Scala 2.11 for default build
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-28547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949230#comment-16949230
]
antonkulaga commented on SPARK-28547:
-
>I bet there is room for improvement, but, te
[
https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949229#comment-16949229
]
feiwang edited comment on SPARK-29302 at 10/11/19 7:46 AM:
---
[~
[
https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949229#comment-16949229
]
feiwang commented on SPARK-29302:
-
[~dangdangdang]
Hi, I have thought a simple solution
[
https://issues.apache.org/jira/browse/SPARK-29382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-29382:
---
Description:
Creating a table with `INTERVAL` column for writing failed with the error:
{code:java}
[
https://issues.apache.org/jira/browse/SPARK-29382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-29382:
---
Summary: Support writing `INTERVAL` type to datasource table (was: Support
the `INTERVAL` type by P
[
https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949190#comment-16949190
]
Shimin Yang edited comment on SPARK-29302 at 10/11/19 7:16 AM:
---
77 matches
Mail list logo
