[
https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16818707#comment-16818707
]
Wenchen Fan commented on SPARK-25250:
-
good points! I'm creating another ticket for
[
https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-25250.
-
Resolution: Fixed
> Race condition with tasks running when new attempt for same stage is created
Wenchen Fan created SPARK-27474:
---
Summary: try best to not submit tasks when the partitions are
already completed
Key: SPARK-27474
URL: https://issues.apache.org/jira/browse/SPARK-27474
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16818882#comment-16818882
]
Gabor Somogyi commented on SPARK-27409:
---
[~pbharaj]
{quote}Yes, I'm following the
[
https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16818889#comment-16818889
]
Daniel Tomes commented on SPARK-27468:
--
Excellent [~shahid], if you need any assist
[
https://issues.apache.org/jira/browse/SPARK-27470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-27470.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24381
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-27474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-27474:
Summary: avoid retrying a task failed with CommitDeniedException many times
(was: try best to not
[
https://issues.apache.org/jira/browse/SPARK-27409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16818963#comment-16818963
]
Gabor Somogyi commented on SPARK-27409:
---
After I've modified the code the same way
[
https://issues.apache.org/jira/browse/SPARK-27397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-27397:
-
Assignee: Kazuaki Ishizaki
> Take care of OpenJ9 in JVM dependant parts
> -
[
https://issues.apache.org/jira/browse/SPARK-27330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819054#comment-16819054
]
Eyal Zituny commented on SPARK-27330:
-
[~gsomogyi] i've submitted a PR
> ForeachWri
[
https://issues.apache.org/jira/browse/SPARK-27397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-27397.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24308
[https://github.c
[
https://issues.apache.org/jira/browse/SPARK-27330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eyal Zituny updated SPARK-27330:
Description:
in cases where a micro batch is being killed (interrupted), not during actual
proces
[
https://issues.apache.org/jira/browse/SPARK-27469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-27469.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Resolved by https://github.com/apache/spark/pull/24378
[
https://issues.apache.org/jira/browse/SPARK-27464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-27464:
-
Assignee: Shivu Sondur
> Add Constant instead of referring string literal used from many place
[
https://issues.apache.org/jira/browse/SPARK-27464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-27464.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24368
[https://github.c
Yuming Wang created SPARK-27475:
---
Summary: dev/deps/spark-deps-hadoop-3.2 is incorrect
Key: SPARK-27475
URL: https://issues.apache.org/jira/browse/SPARK-27475
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-27475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27475:
Description: parquet-hadoop-bundle-1.6.0.jar should be
parquet-hadoop-bundle-1.8.1.jar. (was: par
[
https://issues.apache.org/jira/browse/SPARK-27475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819124#comment-16819124
]
Yuming Wang commented on SPARK-27475:
-
[~srowen]
One way to fix it is to change [th
[
https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819125#comment-16819125
]
Robert Joseph Evans commented on SPARK-27396:
-
[~bryanc],
I see your point
Liang-Chi Hsieh created SPARK-27476:
---
Summary: Refactoring SchemaPruning rule to remove duplicate code
Key: SPARK-27476
URL: https://issues.apache.org/jira/browse/SPARK-27476
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819130#comment-16819130
]
Sean Owen commented on SPARK-27475:
---
That seems OK if it's the only way; this script i
[
https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819153#comment-16819153
]
Thomas Graves commented on SPARK-27396:
---
Since I don't hear any strong objections
[
https://issues.apache.org/jira/browse/SPARK-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819178#comment-16819178
]
Mitesh commented on SPARK-11033:
[~vanzin] Is there any plan to get this working? I'm on
[
https://issues.apache.org/jira/browse/SPARK-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819178#comment-16819178
]
Mitesh edited comment on SPARK-11033 at 4/16/19 3:58 PM:
-
[~vanz
[
https://issues.apache.org/jira/browse/SPARK-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819178#comment-16819178
]
Mitesh edited comment on SPARK-11033 at 4/16/19 3:58 PM:
-
[~vanz
[
https://issues.apache.org/jira/browse/SPARK-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819178#comment-16819178
]
Mitesh edited comment on SPARK-11033 at 4/16/19 4:00 PM:
-
[~vanz
[
https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819181#comment-16819181
]
Kazuaki Ishizaki commented on SPARK-27396:
--
I have one question regarding low-l
[
https://issues.apache.org/jira/browse/SPARK-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819211#comment-16819211
]
Marcelo Vanzin commented on SPARK-11033:
I just filed the bug. I have no intenti
koert kuipers created SPARK-27477:
-
Summary: Kafka token provider should have provided dependency on
Spark
Key: SPARK-27477
URL: https://issues.apache.org/jira/browse/SPARK-27477
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819228#comment-16819228
]
Gengliang Wang commented on SPARK-27468:
[~shahid] Thanks
> "Storage Level" in
[
https://issues.apache.org/jira/browse/SPARK-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819270#comment-16819270
]
Mitesh commented on SPARK-11033:
Thanks [~vanzin]! One quick question...is getting this
[
https://issues.apache.org/jira/browse/SPARK-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819270#comment-16819270
]
Mitesh edited comment on SPARK-11033 at 4/16/19 4:59 PM:
-
Thanks
[
https://issues.apache.org/jira/browse/SPARK-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819274#comment-16819274
]
Marcelo Vanzin commented on SPARK-11033:
It's definitely not that simple.
> Lau
[
https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu updated SPARK-27468:
-
Description:
I ran the following unit test and checked the UI.
{code}
val conf = new SparkCo
[
https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu updated SPARK-27468:
-
Description:
I ran the following unit test and checked the UI.
{code}
val conf = new SparkCo
Nicholas Resnick created SPARK-27478:
Summary: Make HasParallelism public?
Key: SPARK-27478
URL: https://issues.apache.org/jira/browse/SPARK-27478
Project: Spark
Issue Type: Wish
[
https://issues.apache.org/jira/browse/SPARK-27409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819473#comment-16819473
]
Prabhjot Singh Bharaj commented on SPARK-27409:
---
[~gsomogyi] I haven't tri
Xiao Li created SPARK-27479:
---
Summary: Hide API docs for "org.apache.spark.util.kvstore"
Key: SPARK-27479
URL: https://issues.apache.org/jira/browse/SPARK-27479
Project: Spark
Issue Type: Improveme
[
https://issues.apache.org/jira/browse/SPARK-27476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27476.
---
Resolution: Fixed
Assignee: Liang-Chi Hsieh
Fix Version/s: 3.0.0
This is res
[
https://issues.apache.org/jira/browse/SPARK-27452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27452.
---
Resolution: Fixed
Fix Version/s: 3.0.0
This is resolved via https://github.com/apache
[
https://issues.apache.org/jira/browse/SPARK-27467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27467.
---
Resolution: Fixed
Assignee: Dongjoon Hyun
Fix Version/s: 3.0.0
This is resol
[
https://issues.apache.org/jira/browse/SPARK-27453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das resolved SPARK-27453.
---
Resolution: Fixed
Fix Version/s: 2.4.2
3.0.0
Issue resolved by pul
[
https://issues.apache.org/jira/browse/SPARK-25348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng resolved SPARK-25348.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24354
[https://
[
https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819592#comment-16819592
]
Robert Joseph Evans commented on SPARK-27396:
-
This SPIP is to put a framewo
Dilip Biswal created SPARK-27480:
Summary: Improve explain output of describe query command to show
the actual input query as opposed to a truncated logical plan.
Key: SPARK-27480
URL: https://issues.apache.org/ji
[
https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819662#comment-16819662
]
shahid commented on SPARK-16859:
[~Hauer][~toopt4] Can you try enabling
"spark.eventLog
[
https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819662#comment-16819662
]
shahid edited comment on SPARK-16859 at 4/17/19 2:07 AM:
-
[~Haue
Yuming Wang created SPARK-27481:
---
Summary: Upgrade commons-logging to 1.1.3
Key: SPARK-27481
URL: https://issues.apache.org/jira/browse/SPARK-27481
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-24630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kevin Zhang updated SPARK-24630:
Comment: was deleted
(was: thanks [~Jackey Lee]
So I'm wondering what's blocking the pr of this is
[
https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-27468:
---
Attachment: Screenshot from 2019-04-17 10-42-55.png
> "Storage Level" in "RDD Storage Page" is not correct
>
[
https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819679#comment-16819679
]
shahid commented on SPARK-27468:
Hi [~srfnmnk], I tried to reproduce in the master branc
[
https://issues.apache.org/jira/browse/SPARK-27479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-27479.
-
Resolution: Fixed
Fix Version/s: 2.4.2
> Hide API docs for "org.apache.spark.util.kvstore"
>
peng bo created SPARK-27482:
---
Summary: Show BroadcastHashJoinExec numOutputRows statistic info
on SparkSQL UI page
Key: SPARK-27482
URL: https://issues.apache.org/jira/browse/SPARK-27482
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peng bo updated SPARK-27482:
Attachment: SPARK-27482-1.png
> Show BroadcastHashJoinExec numOutputRows statistic info on SparkSQL UI pag
[
https://issues.apache.org/jira/browse/SPARK-27482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peng bo updated SPARK-27482:
Summary: Show BroadcastHashJoinExec numOutputRows statistics info on
SparkSQL UI page (was: Show Broadcas
[
https://issues.apache.org/jira/browse/SPARK-27482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peng bo updated SPARK-27482:
Description:
Currently, the {{SparkSQL}} UI page shows only actual {{metric}} info in each
{{SparkPlan}}
Wenchen Fan created SPARK-27483:
---
Summary: move the data source v2 fallback to v1 logic to an
analyzer rule
Key: SPARK-27483
URL: https://issues.apache.org/jira/browse/SPARK-27483
Project: Spark
Wenchen Fan created SPARK-27484:
---
Summary: create the streaming writing logical plan node before
query is analyzed
Key: SPARK-27484
URL: https://issues.apache.org/jira/browse/SPARK-27484
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-27483:
---
Assignee: (was: Wenchen Fan)
> move the data source v2 fallback to v1 logic to an analy
Muthu Jayakumar created SPARK-27485:
---
Summary: Certain query plans fail to run when
autoBroadcastJoinThreshold is set to -1
Key: SPARK-27485
URL: https://issues.apache.org/jira/browse/SPARK-27485
Pr
[
https://issues.apache.org/jira/browse/SPARK-27416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-27416.
-
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24357
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-27416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-27416:
---
Assignee: peng bo
> UnsafeMapData & UnsafeArrayData Kryo serialization breaks when two mach
[
https://issues.apache.org/jira/browse/SPARK-27486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819759#comment-16819759
]
shahid commented on SPARK-27486:
I will raise a PR
> Enable History server storage info
shahid created SPARK-27486:
--
Summary: Enable History server storage information test
Key: SPARK-27486
URL: https://issues.apache.org/jira/browse/SPARK-27486
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-25088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819764#comment-16819764
]
t oo commented on SPARK-25088:
--
why block rest if auth is on? for example i want to be able
[
https://issues.apache.org/jira/browse/SPARK-27402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27402:
Summary: Fix hadoop-3.2 test issue(except the hive-thriftserver module)
(was: Support HiveExterna
[
https://issues.apache.org/jira/browse/SPARK-27402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27402:
Description: (was: When we upgrade the built-in Hive to 2.3.4, the
default spark.sql.hive.meta
[
https://issues.apache.org/jira/browse/SPARK-27402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27402:
Description: Fix sql/core and sql/hive modules test issue for hadoop-3.2
> Fix hadoop-3.2 test iss
68 matches
Mail list logo
