[
https://issues.apache.org/jira/browse/SPARK-28870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-28870:
-
Description:
This issue tracks the effort on snapshotting the current status of
[
https://issues.apache.org/jira/browse/SPARK-28870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-28870:
-
Description:
This issue tracks the effort on snapshotting the current status of
[
https://issues.apache.org/jira/browse/SPARK-28870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977128#comment-16977128
]
Jungtaek Lim commented on SPARK-28870:
--
Given we have SPARK-29779, this issue is orthogonal to
[
https://issues.apache.org/jira/browse/SPARK-28870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-28870:
-
Parent: (was: SPARK-28594)
Issue Type: New Feature (was: Sub-task)
> Snapshot
[
https://issues.apache.org/jira/browse/SPARK-29579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-29579.
--
Resolution: Invalid
SPARK-29779 invalidates the needs of this. Closing.
> Guarantee
[
https://issues.apache.org/jira/browse/SPARK-29953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977111#comment-16977111
]
Jungtaek Lim commented on SPARK-29953:
--
[~zsxwing] Just raised the PR
[
https://issues.apache.org/jira/browse/SPARK-29953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977019#comment-16977019
]
Jungtaek Lim commented on SPARK-29953:
--
Thanks for pinging me, [~zsxwing]. Totally makes sense.
[
https://issues.apache.org/jira/browse/SPARK-29929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976294#comment-16976294
]
Jungtaek Lim commented on SPARK-29929:
--
Possibly duplicated with SPARK-23889 , though no one is
[
https://issues.apache.org/jira/browse/SPARK-29581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-29581.
--
Resolution: Invalid
We took the different approach: see SPARK-29779
> Enable cleanup old
[
https://issues.apache.org/jira/browse/SPARK-29779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-29779:
-
Parent: SPARK-28594
Issue Type: Sub-task (was: Task)
> Compact old event log files and
Jungtaek Lim created SPARK-29779:
Summary: Compact old event log files and clean up
Key: SPARK-29779
URL: https://issues.apache.org/jira/browse/SPARK-29779
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-29755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967354#comment-16967354
]
Jungtaek Lim commented on SPARK-29755:
--
Working on the patch.
> ClassCastException occurs when
Jungtaek Lim created SPARK-29755:
Summary: ClassCastException occurs when reading events from SHS
Key: SPARK-29755
URL: https://issues.apache.org/jira/browse/SPARK-29755
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-29604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963737#comment-16963737
]
Jungtaek Lim commented on SPARK-29604:
--
I've manually ran the test suite locally (single run) and
[
https://issues.apache.org/jira/browse/SPARK-29604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963476#comment-16963476
]
Jungtaek Lim commented on SPARK-29604:
--
[~dongjoon]
Do we have any annotation/trait to "isolate"
[
https://issues.apache.org/jira/browse/SPARK-29604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963000#comment-16963000
]
Jungtaek Lim commented on SPARK-29604:
--
I think it doesn't apply to branch-2.3 as the root issue is
Jungtaek Lim created SPARK-29642:
Summary: ContinuousMemoryStream throws error on String type
Key: SPARK-29642
URL: https://issues.apache.org/jira/browse/SPARK-29642
Project: Spark
Issue
Jungtaek Lim created SPARK-29635:
Summary: Deduplicate test suites between Kafka micro-batch sink
and Kafka continuous sink
Key: SPARK-29635
URL: https://issues.apache.org/jira/browse/SPARK-29635
[
https://issues.apache.org/jira/browse/SPARK-29604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959711#comment-16959711
]
Jungtaek Lim commented on SPARK-29604:
--
I've figured out the root cause and have a patch. Will
Jungtaek Lim created SPARK-29604:
Summary: SessionState is initialized with isolated classloader for
Hive if spark.sql.hive.metastore.jars is being set
Key: SPARK-29604
URL:
[
https://issues.apache.org/jira/browse/SPARK-28594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958412#comment-16958412
]
Jungtaek Lim commented on SPARK-28594:
--
Please note that SPARK-29579 and SPARK-29581 could be moved
Jungtaek Lim created SPARK-29581:
Summary: Enable cleanup old event log files
Key: SPARK-29581
URL: https://issues.apache.org/jira/browse/SPARK-29581
Project: Spark
Issue Type: Sub-task
Jungtaek Lim created SPARK-29579:
Summary: Guarantee compatibility of snapshot (live entities,
KVstore entities)
Key: SPARK-29579
URL: https://issues.apache.org/jira/browse/SPARK-29579
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-29261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-29261:
-
Description:
To achieve incremental reply goal in SHS, we need to support recover live
[
https://issues.apache.org/jira/browse/SPARK-29111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-29111:
-
Description:
This issue tracks the effort of supporting snapshot/restore from/to KVStore.
Note
[
https://issues.apache.org/jira/browse/SPARK-28870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-28870:
-
Description:
This issue tracks the effort on compacting event log files into snapshot and
[
https://issues.apache.org/jira/browse/SPARK-28870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-28870:
-
Description:
This issue tracks the effort on compacting event log files into snapshot and
[
https://issues.apache.org/jira/browse/SPARK-28870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958300#comment-16958300
]
Jungtaek Lim commented on SPARK-28870:
--
Discussed with Marcelo/Imran offline: I'm changing the goal
[
https://issues.apache.org/jira/browse/SPARK-28870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-28870:
-
Summary: Snapshot event log files to support incremental reading (was:
Snapshot old event log
[
https://issues.apache.org/jira/browse/SPARK-29538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-29538.
--
Resolution: Duplicate
SPARK-29552 dealt with this. Will reopen if it is still flaky.
> Test
[
https://issues.apache.org/jira/browse/SPARK-29538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956618#comment-16956618
]
Jungtaek Lim commented on SPARK-29538:
--
Another observation: the test fails consistently when the
[
https://issues.apache.org/jira/browse/SPARK-29538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956611#comment-16956611
]
Jungtaek Lim commented on SPARK-29538:
--
It doesn't even seem to be flaky. It fails consistently in
[
https://issues.apache.org/jira/browse/SPARK-29538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-29538:
-
Summary: Test failure:
org.apache.spark.sql.execution.adaptive.AdaptiveQueryExecSuite.multiple
Jungtaek Lim created SPARK-29538:
Summary: Flaky test:
org.apache.spark.sql.execution.adaptive.AdaptiveQueryExecSuite.multiple joins
Key: SPARK-29538
URL: https://issues.apache.org/jira/browse/SPARK-29538
[
https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955798#comment-16955798
]
Jungtaek Lim commented on SPARK-29438:
--
This would be pretty much easier to reproduce: make left
[
https://issues.apache.org/jira/browse/SPARK-29321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955508#comment-16955508
]
Jungtaek Lim commented on SPARK-29321:
--
[~Geopap]
Which process was taking slightly more memory?
[
https://issues.apache.org/jira/browse/SPARK-29321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-29321:
-
Attachment: Screen Shot 2019-10-20 at 10.55.03 PM.png
> Possible memory leak in Spark
>
[
https://issues.apache.org/jira/browse/SPARK-29503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955090#comment-16955090
]
Jungtaek Lim commented on SPARK-29503:
--
Thanks for reporting the issue in super detailed
Jungtaek Lim created SPARK-29509:
Summary: Deduplicate code blocks in Kafka data source
Key: SPARK-29509
URL: https://issues.apache.org/jira/browse/SPARK-29509
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953422#comment-16953422
]
Jungtaek Lim commented on SPARK-29438:
--
Any updates here?
> Failed to get state store in
[
https://issues.apache.org/jira/browse/SPARK-29461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950808#comment-16950808
]
Jungtaek Lim commented on SPARK-29461:
--
I'm taking a look at this.
> Spark dataframe writer does
[
https://issues.apache.org/jira/browse/SPARK-29361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-29361.
--
Resolution: Invalid
Closing this, as there was some explanation that DSv2 is the first one
[
https://issues.apache.org/jira/browse/SPARK-29129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-29129.
--
Resolution: Invalid
We don't support hadoop-2.7 & jdk 11 profile together. Resolving this as
Jungtaek Lim created SPARK-29450:
Summary: [SS] In streaming aggregation, metric for output rows is
not measured in append mode
Key: SPARK-29450
URL: https://issues.apache.org/jira/browse/SPARK-29450
[
https://issues.apache.org/jira/browse/SPARK-29426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949892#comment-16949892
]
Jungtaek Lim commented on SPARK-29426:
--
Could you attach query listener and see the actual event
[
https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949465#comment-16949465
]
Jungtaek Lim commented on SPARK-29438:
--
Could you please link the actual code block from Github
[
https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949430#comment-16949430
]
Jungtaek Lim edited comment on SPARK-29438 at 10/11/19 1:12 PM:
Could
[
https://issues.apache.org/jira/browse/SPARK-29438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949430#comment-16949430
]
Jungtaek Lim commented on SPARK-29438:
--
Could you point out the codebase where you are referring?
[
https://issues.apache.org/jira/browse/SPARK-29139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16945591#comment-16945591
]
Jungtaek Lim commented on SPARK-29139:
--
No problem! I was trying to resolve by myself and realized
[
https://issues.apache.org/jira/browse/SPARK-29139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16945482#comment-16945482
]
Jungtaek Lim commented on SPARK-29139:
--
[~dongjoon]
Somehow this wasn't marked as resolved when PR
[
https://issues.apache.org/jira/browse/SPARK-29361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-29361:
-
Component/s: (was: Spark Core)
SQL
> Enable streaming source support on
[
https://issues.apache.org/jira/browse/SPARK-29361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-29361:
-
Summary: Enable DataFrame with streaming source support on DSv1(was:
Enable streaming
[
https://issues.apache.org/jira/browse/SPARK-29361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944987#comment-16944987
]
Jungtaek Lim commented on SPARK-29361:
--
The plan for now is overloading below methods marked as
Jungtaek Lim created SPARK-29361:
Summary: Enable streaming source support on DSv1
Key: SPARK-29361
URL: https://issues.apache.org/jira/browse/SPARK-29361
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-29322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-29322:
-
Comment: was deleted
(was: For event log, we seem to still use "com.github.luben:zstd-jni"
[
https://issues.apache.org/jira/browse/SPARK-29322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942508#comment-16942508
]
Jungtaek Lim commented on SPARK-29322:
--
For event log, we seem to still use
[
https://issues.apache.org/jira/browse/SPARK-29322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-29322:
-
Description:
While working on SPARK-28869, I've discovered the issue that reading inprogress
[
https://issues.apache.org/jira/browse/SPARK-29322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942493#comment-16942493
]
Jungtaek Lim commented on SPARK-29322:
--
{quote}
Since this is ZSTD, you are using `hadoop-3.2`
[
https://issues.apache.org/jira/browse/SPARK-29322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942456#comment-16942456
]
Jungtaek Lim edited comment on SPARK-29322 at 10/2/19 4:17 AM:
---
Just
[
https://issues.apache.org/jira/browse/SPARK-29322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-29322:
-
Comment: was deleted
(was: I'll work on PR to propose removing zstd from supported compressions
[
https://issues.apache.org/jira/browse/SPARK-29322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942456#comment-16942456
]
Jungtaek Lim commented on SPARK-29322:
--
Just initiated discussion on dev. mailing list to see which
[
https://issues.apache.org/jira/browse/SPARK-29322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942446#comment-16942446
]
Jungtaek Lim commented on SPARK-29322:
--
FYI, thread being stuck was finished immediately when I
[
https://issues.apache.org/jira/browse/SPARK-29322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942445#comment-16942445
]
Jungtaek Lim commented on SPARK-29322:
--
I'll work on PR to propose removing zstd from supported
[
https://issues.apache.org/jira/browse/SPARK-29322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-29322:
-
Attachment: history-server-4.jstack
history-server-3.jstack
Jungtaek Lim created SPARK-29322:
Summary: History server is stuck reading incomplete event log file
compressed with zstd
Key: SPARK-29322
URL: https://issues.apache.org/jira/browse/SPARK-29322
[
https://issues.apache.org/jira/browse/SPARK-29097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942332#comment-16942332
]
Jungtaek Lim commented on SPARK-29097:
--
Could you check SPARK-29055 also resolves this? If then
[
https://issues.apache.org/jira/browse/SPARK-29321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942282#comment-16942282
]
Jungtaek Lim commented on SPARK-29321:
--
I'm sorry I meant your last comment not real last comment -
[
https://issues.apache.org/jira/browse/SPARK-29321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-29321:
-
Component/s: (was: Block Manager)
> Possible memory leak in Spark
>
[
https://issues.apache.org/jira/browse/SPARK-29321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942279#comment-16942279
]
Jungtaek Lim commented on SPARK-29321:
--
[~Geopap] Appreciate if you could migrate the last comment
[
https://issues.apache.org/jira/browse/SPARK-29321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-29321:
-
Summary: Possible memory leak in Spark (was: CLONE - Possible memory leak
in Spark)
>
[
https://issues.apache.org/jira/browse/SPARK-29321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-29321:
-
Summary: Possible memory leak in Spark (was: CLONE - Possible memory leak
in Spark)
>
[
https://issues.apache.org/jira/browse/SPARK-29321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-29321:
-
Fix Version/s: (was: 2.4.5)
(was: 3.0.0)
> CLONE - Possible memory
[
https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942267#comment-16942267
]
Jungtaek Lim commented on SPARK-29055:
--
Looks like I can update the title and description, but then
[
https://issues.apache.org/jira/browse/SPARK-28094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941710#comment-16941710
]
Jungtaek Lim edited comment on SPARK-28094 at 10/1/19 10:02 AM:
[
https://issues.apache.org/jira/browse/SPARK-28094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941710#comment-16941710
]
Jungtaek Lim commented on SPARK-28094:
--
SPARK-28074 is already merged so it will be included to
Jungtaek Lim created SPARK-29314:
Summary: ProgressReporter.extractStateOperatorMetrics should not
overwrite updated as 0 when it actually runs a batch even with no data
Key: SPARK-29314
URL:
[
https://issues.apache.org/jira/browse/SPARK-29312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941693#comment-16941693
]
Jungtaek Lim commented on SPARK-29312:
--
Maybe it is the intention to represent users have removed
Jungtaek Lim created SPARK-29312:
Summary: Inconsistent behavior on metrics when dropping rows in
state between FlatMapGroupWithState and other stateful operators
Key: SPARK-29312
URL:
[
https://issues.apache.org/jira/browse/SPARK-28094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941623#comment-16941623
]
Jungtaek Lim edited comment on SPARK-28094 at 10/1/19 8:22 AM:
---
FYI: After
[
https://issues.apache.org/jira/browse/SPARK-28094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941623#comment-16941623
]
Jungtaek Lim commented on SPARK-28094:
--
FYI: After SPARK-28074, Spark will log warn message for
[
https://issues.apache.org/jira/browse/SPARK-28074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-28074:
-
Issue Type: Improvement (was: Documentation)
> [SS] Log warn message on possible correctness
[
https://issues.apache.org/jira/browse/SPARK-28074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-28074:
-
Summary: [SS] Log warn message on possible correctness issue for multiple
stateful operations
[
https://issues.apache.org/jira/browse/SPARK-29301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941492#comment-16941492
]
Jungtaek Lim commented on SPARK-29301:
--
[~ploya]
This commit is for branch-2.4 :
[
https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941491#comment-16941491
]
Jungtaek Lim commented on SPARK-27648:
--
[~harichandan]
This commit is for branch-2.4 :
[
https://issues.apache.org/jira/browse/SPARK-29301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941473#comment-16941473
]
Jungtaek Lim commented on SPARK-29301:
--
I'll push the branch-2.4 version of code in my repo and
[
https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941474#comment-16941474
]
Jungtaek Lim commented on SPARK-27648:
--
I'll push the branch-2.4 version of code in my repo and
[
https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941453#comment-16941453
]
Jungtaek Lim commented on SPARK-29055:
--
I haven't observed increased memory usage even without the
[
https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940692#comment-16940692
]
Jungtaek Lim edited comment on SPARK-27648 at 9/30/19 7:23 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940692#comment-16940692
]
Jungtaek Lim commented on SPARK-27648:
--
[~yy3b2007com] [~harichandan]
Sorry I'm late on revisiting
[
https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940691#comment-16940691
]
Jungtaek Lim commented on SPARK-29055:
--
[~Geopap]
I guess you're hitting SPARK-29301. Please take
[
https://issues.apache.org/jira/browse/SPARK-29301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940672#comment-16940672
]
Jungtaek Lim commented on SPARK-29301:
--
Will raise a patch soon.
> Removing block is not reflected
Jungtaek Lim created SPARK-29301:
Summary: Removing block is not reflected to the driver/executor's
storage memory
Key: SPARK-29301
URL: https://issues.apache.org/jira/browse/SPARK-29301
Project:
[
https://issues.apache.org/jira/browse/SPARK-29222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940434#comment-16940434
]
Jungtaek Lim commented on SPARK-29222:
--
Did you see test failures consistently and the commit fixed
[
https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940429#comment-16940429
]
Jungtaek Lim commented on SPARK-29055:
--
[~Geopap]
Could you take memory dump for multiple of times
[
https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940252#comment-16940252
]
Jungtaek Lim commented on SPARK-29055:
--
[~Geopap]
Could you reproduce against latest Spark 2.4.4?
Jungtaek Lim created SPARK-29281:
Summary: Examples in Like/RLike doesn't consider the default value
of spark.sql.parser.escapedStringLiterals
Key: SPARK-29281
URL:
[
https://issues.apache.org/jira/browse/SPARK-29221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-29221.
--
Fix Version/s: 3.0.0
Resolution: Fixed
This is resolved via
[
https://issues.apache.org/jira/browse/SPARK-29248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938060#comment-16938060
]
Jungtaek Lim commented on SPARK-29248:
--
Assuming writer got the information of number of
[
https://issues.apache.org/jira/browse/SPARK-29248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938041#comment-16938041
]
Jungtaek Lim commented on SPARK-29248:
--
SPARK-23889 would be the correct approach to address this -
[
https://issues.apache.org/jira/browse/SPARK-29239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937491#comment-16937491
]
Jungtaek Lim edited comment on SPARK-29239 at 9/25/19 7:58 AM:
---
Would we
1301 - 1400 of 1857 matches
Mail list logo
