[
https://issues.apache.org/jira/browse/SPARK-28074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-28074:
-
Issue Type: Improvement (was: Documentation)
> [SS] Log warn message on possible correctness is
[
https://issues.apache.org/jira/browse/SPARK-28074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-28074:
-
Summary: [SS] Log warn message on possible correctness issue for multiple
stateful operations in
[
https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941514#comment-16941514
]
L. C. Hsieh commented on SPARK-29302:
-
No, I meant this:
{code:java}
val jobId = Spa
[
https://issues.apache.org/jira/browse/SPARK-29307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-29307.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25982
[https://
[
https://issues.apache.org/jira/browse/SPARK-29307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-29307:
-
Assignee: Dongjoon Hyun
> Remove scalatest compile warnings
> -
Alberto Andreotti created SPARK-29309:
-
Summary: StreamingContext.binaryRecordsStream() is useless
Key: SPARK-29309
URL: https://issues.apache.org/jira/browse/SPARK-29309
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-29301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941492#comment-16941492
]
Jungtaek Lim commented on SPARK-29301:
--
[~ploya]
This commit is for branch-2.4 :
[
https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941491#comment-16941491
]
Jungtaek Lim commented on SPARK-27648:
--
[~harichandan]
This commit is for branch-2
[
https://issues.apache.org/jira/browse/SPARK-29288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941487#comment-16941487
]
angerszhu commented on SPARK-29288:
---
[~dongjoon] Sorry for my mistake when report this
[
https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941485#comment-16941485
]
feiwang commented on SPARK-29302:
-
Yes, they are in a same stage, so they have a same jo
[
https://issues.apache.org/jira/browse/SPARK-29288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu resolved SPARK-29288.
---
Resolution: Not A Problem
> Spark SQL add jar can't support HTTP path.
> --
[
https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941483#comment-16941483
]
L. C. Hsieh commented on SPARK-29295:
-
I created a PR for this issue.
> Duplicate r
[
https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941482#comment-16941482
]
L. C. Hsieh commented on SPARK-29302:
-
Will a speculation task have the same JobID a
[
https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941475#comment-16941475
]
feiwang commented on SPARK-29295:
-
Yes, how can we resolve this issue?
Only by upgrading
[
https://issues.apache.org/jira/browse/SPARK-29301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941473#comment-16941473
]
Jungtaek Lim commented on SPARK-29301:
--
I'll push the branch-2.4 version of code in
[
https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941474#comment-16941474
]
Jungtaek Lim commented on SPARK-27648:
--
I'll push the branch-2.4 version of code in
[
https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941472#comment-16941472
]
feiwang edited comment on SPARK-29302 at 10/1/19 2:24 AM:
--
For
[
https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941472#comment-16941472
]
feiwang commented on SPARK-29302:
-
For dynamic partition overwrite, when execute a task,
[
https://issues.apache.org/jira/browse/SPARK-29308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-29308:
--
Description:
In hadoop 3.2, orc.classfier is empty.
https://github.com/apache/spark/blob/d841b33ba3a9b
angerszhu created SPARK-29308:
-
Summary: dev/deps/spark-deps-hadoop-3.2 orc jar is incorrect
Key: SPARK-29308
URL: https://issues.apache.org/jira/browse/SPARK-29308
Project: Spark
Issue Type: Ta
[
https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941467#comment-16941467
]
feiwang commented on SPARK-29302:
-
You can add the code below into FileFormatWriterSuite
[
https://issues.apache.org/jira/browse/SPARK-27475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941455#comment-16941455
]
Yuming Wang commented on SPARK-27475:
-
Sorry [~dongjoon] This is still incorrect:
ht
[
https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941453#comment-16941453
]
Jungtaek Lim commented on SPARK-29055:
--
I haven't observed increased memory usage e
[
https://issues.apache.org/jira/browse/SPARK-25153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Holden Karau resolved SPARK-25153.
--
Fix Version/s: 3.0.0
Resolution: Fixed
> Improve error messages for columns with dots/p
[
https://issues.apache.org/jira/browse/SPARK-29307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-29307:
--
Component/s: Tests
> Remove scalatest compile warnings
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-25153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Holden Karau reassigned SPARK-25153:
Assignee: Jeff Evans
> Improve error messages for columns with dots/periods
> ---
[
https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-24077.
--
Fix Version/s: 2.3.0
Assignee: Xiaochen Ouyang
Resolution: Fixed
Resol
[
https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941444#comment-16941444
]
Takeshi Yamamuro edited comment on SPARK-24077 at 10/1/19 1:20 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941444#comment-16941444
]
Takeshi Yamamuro commented on SPARK-24077:
--
Yea, its been fixed there;
{code}
s
[
https://issues.apache.org/jira/browse/SPARK-29300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-29300:
-
Assignee: Dongjoon Hyun
> Compare `catalyst` and `avro` module benchmark in JDK8/11
> -
[
https://issues.apache.org/jira/browse/SPARK-29300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-29300.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25972
[https://
[
https://issues.apache.org/jira/browse/SPARK-29307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-29307:
--
Component/s: (was: Spark Core)
Build
> Remove scalatest compile warnings
Dongjoon Hyun created SPARK-29307:
-
Summary: Remove scalatest compile warnings
Key: SPARK-29307
URL: https://issues.apache.org/jira/browse/SPARK-29307
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941404#comment-16941404
]
L. C. Hsieh commented on SPARK-29302:
-
Can you share a reproducer? or this sounds mo
[
https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941402#comment-16941402
]
L. C. Hsieh commented on SPARK-29302:
-
FileCommitProtocol will assign a filename bas
[
https://issues.apache.org/jira/browse/SPARK-29301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941401#comment-16941401
]
Puneet Loya edited comment on SPARK-29301 at 9/30/19 11:28 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-29301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941401#comment-16941401
]
Puneet Loya commented on SPARK-29301:
-
I tried to cherry pick your patch on Spark 2.
[
https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941399#comment-16941399
]
Harichandan Pulagam commented on SPARK-27648:
-
[~kabhwan] The changes in htt
[
https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941363#comment-16941363
]
Jeff Evans commented on SPARK-24077:
Is this still relevant, given SPARK-20383 is do
[
https://issues.apache.org/jira/browse/SPARK-29041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941289#comment-16941289
]
Ruslan Dautkhanov commented on SPARK-29041:
---
Thank you [~hyukjin.kwon]
Our us
[
https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941220#comment-16941220
]
George Papa commented on SPARK-29055:
-
[~kabhwan]
Good news!! I run the snippet cod
[
https://issues.apache.org/jira/browse/SPARK-29211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941173#comment-16941173
]
Dilip Biswal commented on SPARK-29211:
--
Thanks [~dongjoon]
> Second invocation of
Thomas Graves created SPARK-29306:
-
Summary: Executors need to track what ResourceProfile they are
created with
Key: SPARK-29306
URL: https://issues.apache.org/jira/browse/SPARK-29306
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-29291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-29291.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25968
[https://
[
https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh updated SPARK-29295:
Priority: Major (was: Minor)
> Duplicate result when dropping partition of an external table and
[
https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941060#comment-16941060
]
L. C. Hsieh commented on SPARK-29295:
-
I traced code last night, and yes it looks li
[
https://issues.apache.org/jira/browse/SPARK-29305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
angerszhu updated SPARK-29305:
--
Description:
{code}
com.fasterxml.jackson.jaxrs:jackson-jaxrs-base:2.9.5
com.fasterxml.jackson.jax
angerszhu created SPARK-29305:
-
Summary: Update LICENSE and NOTICE for hadoop 3.2
Key: SPARK-29305
URL: https://issues.apache.org/jira/browse/SPARK-29305
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-29304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kuhu Shukla updated SPARK-29304:
Attachment: jira-spark.png
> Input Bytes Metric for Datasource v2 is absent
>
Kuhu Shukla created SPARK-29304:
---
Summary: Input Bytes Metric for Datasource v2 is absent
Key: SPARK-29304
URL: https://issues.apache.org/jira/browse/SPARK-29304
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-27396.
---
Assignee: Robert Joseph Evans
Resolution: Fixed
> SPIP: Public APIs for extended Colum
[
https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940974#comment-16940974
]
Thomas Graves commented on SPARK-27396:
---
The main objectives have actually already
Thomas Graves created SPARK-29303:
-
Summary: UI updates for stage level scheduling
Key: SPARK-29303
URL: https://issues.apache.org/jira/browse/SPARK-29303
Project: Spark
Issue Type: Story
[
https://issues.apache.org/jira/browse/SPARK-28074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-28074:
-
Priority: Minor (was: Major)
> [SS] Document caveats on using multiple stateful operations in s
[
https://issues.apache.org/jira/browse/SPARK-28074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-28074:
Assignee: Jungtaek Lim
> [SS] Document caveats on using multiple stateful operations in s
[
https://issues.apache.org/jira/browse/SPARK-28074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-28074.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 24890
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-29252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-29252:
-
Priority: Minor (was: Major)
> Upgrade zookeeper to 3.4.14 and fix vulnerabilities.
> -
[
https://issues.apache.org/jira/browse/SPARK-29252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-29252.
--
Resolution: Fixed
Issue resolved by pull request 25933
[https://github.com/apache/spark/pull/2
[
https://issues.apache.org/jira/browse/SPARK-29252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-29252:
Assignee: jiaan.geng
> Upgrade zookeeper to 3.4.14 and fix vulnerabilities.
> ---
[
https://issues.apache.org/jira/browse/SPARK-29289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-29289.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25967
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-29232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940919#comment-16940919
]
Aman Omer commented on SPARK-29232:
---
Thnaks [~jiaqig]
> RandomForestRegressionModel
[
https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
feiwang updated SPARK-29302:
Description:
Now, for a dynamic partition overwrite operation, the filename of a task
output is determin
[
https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
feiwang updated SPARK-29302:
Description:
Now, for a dynamic partition overwrite operation, the filename of a task
output is determin
[
https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
feiwang updated SPARK-29302:
Description:
Now, for a dynamic partition overwrite operation, the filename of a task
output is determin
feiwang created SPARK-29302:
---
Summary: dynamic partition overwrite with speculation enabled
Key: SPARK-29302
URL: https://issues.apache.org/jira/browse/SPARK-29302
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940754#comment-16940754
]
feiwang commented on SPARK-29295:
-
relative hive issue, https://issues.apache.org/jira/b
[
https://issues.apache.org/jira/browse/SPARK-29295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940718#comment-16940718
]
L. C. Hsieh commented on SPARK-29295:
-
Thanks for reporting this. Will take a look.
[
https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940692#comment-16940692
]
Jungtaek Lim edited comment on SPARK-27648 at 9/30/19 7:23 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-27648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940692#comment-16940692
]
Jungtaek Lim commented on SPARK-27648:
--
[~yy3b2007com] [~harichandan]
Sorry I'm la
[
https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940691#comment-16940691
]
Jungtaek Lim commented on SPARK-29055:
--
[~Geopap]
I guess you're hitting SPARK-293
70 matches
Mail list logo