[
https://issues.apache.org/jira/browse/SPARK-27416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-27416:
---
Assignee: peng bo
> UnsafeMapData & UnsafeArrayData Kryo serialization breaks when two
[
https://issues.apache.org/jira/browse/SPARK-27416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-27416.
-
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24357
Muthu Jayakumar created SPARK-27485:
---
Summary: Certain query plans fail to run when
autoBroadcastJoinThreshold is set to -1
Key: SPARK-27485
URL: https://issues.apache.org/jira/browse/SPARK-27485
[
https://issues.apache.org/jira/browse/SPARK-27483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-27483:
---
Assignee: (was: Wenchen Fan)
> move the data source v2 fallback to v1 logic to an
Wenchen Fan created SPARK-27484:
---
Summary: create the streaming writing logical plan node before
query is analyzed
Key: SPARK-27484
URL: https://issues.apache.org/jira/browse/SPARK-27484
Project: Spark
Wenchen Fan created SPARK-27483:
---
Summary: move the data source v2 fallback to v1 logic to an
analyzer rule
Key: SPARK-27483
URL: https://issues.apache.org/jira/browse/SPARK-27483
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peng bo updated SPARK-27482:
Description:
Currently, the {{SparkSQL}} UI page shows only actual {{metric}} info in each
{{SparkPlan}}
[
https://issues.apache.org/jira/browse/SPARK-27482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peng bo updated SPARK-27482:
Summary: Show BroadcastHashJoinExec numOutputRows statistics info on
SparkSQL UI page (was: Show
[
https://issues.apache.org/jira/browse/SPARK-27482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peng bo updated SPARK-27482:
Attachment: SPARK-27482-1.png
> Show BroadcastHashJoinExec numOutputRows statistic info on SparkSQL UI
peng bo created SPARK-27482:
---
Summary: Show BroadcastHashJoinExec numOutputRows statistic info
on SparkSQL UI page
Key: SPARK-27482
URL: https://issues.apache.org/jira/browse/SPARK-27482
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-27479.
-
Resolution: Fixed
Fix Version/s: 2.4.2
> Hide API docs for "org.apache.spark.util.kvstore"
>
[
https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819679#comment-16819679
]
shahid commented on SPARK-27468:
Hi [~srfnmnk], I tried to reproduce in the master branch. The steps
[
https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-27468:
---
Attachment: Screenshot from 2019-04-17 10-42-55.png
> "Storage Level" in "RDD Storage Page" is not correct
[
https://issues.apache.org/jira/browse/SPARK-24630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kevin Zhang updated SPARK-24630:
Comment: was deleted
(was: thanks [~Jackey Lee]
So I'm wondering what's blocking the pr of this
Yuming Wang created SPARK-27481:
---
Summary: Upgrade commons-logging to 1.1.3
Key: SPARK-27481
URL: https://issues.apache.org/jira/browse/SPARK-27481
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819662#comment-16819662
]
shahid edited comment on SPARK-16859 at 4/17/19 2:07 AM:
-
[~Hauer] [~toopt4] Can
[
https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819662#comment-16819662
]
shahid commented on SPARK-16859:
[~Hauer][~toopt4] Can you try enabling
Dilip Biswal created SPARK-27480:
Summary: Improve explain output of describe query command to show
the actual input query as opposed to a truncated logical plan.
Key: SPARK-27480
URL:
[
https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819592#comment-16819592
]
Robert Joseph Evans commented on SPARK-27396:
-
This SPIP is to put a framework in place to
[
https://issues.apache.org/jira/browse/SPARK-25348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng resolved SPARK-25348.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24354
[
https://issues.apache.org/jira/browse/SPARK-27453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das resolved SPARK-27453.
---
Resolution: Fixed
Fix Version/s: 2.4.2
3.0.0
Issue resolved by
[
https://issues.apache.org/jira/browse/SPARK-27452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27452.
---
Resolution: Fixed
Fix Version/s: 3.0.0
This is resolved via
[
https://issues.apache.org/jira/browse/SPARK-27467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27467.
---
Resolution: Fixed
Assignee: Dongjoon Hyun
Fix Version/s: 3.0.0
This is
[
https://issues.apache.org/jira/browse/SPARK-27476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27476.
---
Resolution: Fixed
Assignee: Liang-Chi Hsieh
Fix Version/s: 3.0.0
This is
Xiao Li created SPARK-27479:
---
Summary: Hide API docs for "org.apache.spark.util.kvstore"
Key: SPARK-27479
URL: https://issues.apache.org/jira/browse/SPARK-27479
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-27409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819473#comment-16819473
]
Prabhjot Singh Bharaj commented on SPARK-27409:
---
[~gsomogyi] I haven't tried it on master.
Nicholas Resnick created SPARK-27478:
Summary: Make HasParallelism public?
Key: SPARK-27478
URL: https://issues.apache.org/jira/browse/SPARK-27478
Project: Spark
Issue Type: Wish
[
https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu updated SPARK-27468:
-
Description:
I ran the following unit test and checked the UI.
{code}
val conf = new
[
https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu updated SPARK-27468:
-
Description:
I ran the following unit test and checked the UI.
{code}
val conf = new
[
https://issues.apache.org/jira/browse/SPARK-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819270#comment-16819270
]
Mitesh edited comment on SPARK-11033 at 4/16/19 4:59 PM:
-
Thanks [~vanzin]! One
[
https://issues.apache.org/jira/browse/SPARK-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819274#comment-16819274
]
Marcelo Vanzin commented on SPARK-11033:
It's definitely not that simple.
> Launcher: add
[
https://issues.apache.org/jira/browse/SPARK-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819270#comment-16819270
]
Mitesh commented on SPARK-11033:
Thanks [~vanzin]! One quick question...is getting this working just a
[
https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819228#comment-16819228
]
Gengliang Wang commented on SPARK-27468:
[~shahid] Thanks
> "Storage Level" in "RDD Storage
koert kuipers created SPARK-27477:
-
Summary: Kafka token provider should have provided dependency on
Spark
Key: SPARK-27477
URL: https://issues.apache.org/jira/browse/SPARK-27477
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819211#comment-16819211
]
Marcelo Vanzin commented on SPARK-11033:
I just filed the bug. I have no intention of working on
[
https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819181#comment-16819181
]
Kazuaki Ishizaki commented on SPARK-27396:
--
I have one question regarding low-level API. In my
[
https://issues.apache.org/jira/browse/SPARK-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819178#comment-16819178
]
Mitesh edited comment on SPARK-11033 at 4/16/19 4:00 PM:
-
[~vanzin] Is there any
[
https://issues.apache.org/jira/browse/SPARK-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819178#comment-16819178
]
Mitesh edited comment on SPARK-11033 at 4/16/19 3:58 PM:
-
[~vanzin] Is there any
[
https://issues.apache.org/jira/browse/SPARK-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819178#comment-16819178
]
Mitesh edited comment on SPARK-11033 at 4/16/19 3:58 PM:
-
[~vanzin] Is there any
[
https://issues.apache.org/jira/browse/SPARK-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819178#comment-16819178
]
Mitesh commented on SPARK-11033:
[~vanzin] Is there any plan to get this working? I'm on 2.3.2 using
[
https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819153#comment-16819153
]
Thomas Graves commented on SPARK-27396:
---
Since I don't hear any strong objections against the
[
https://issues.apache.org/jira/browse/SPARK-27475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819130#comment-16819130
]
Sean Owen commented on SPARK-27475:
---
That seems OK if it's the only way; this script is not run
Liang-Chi Hsieh created SPARK-27476:
---
Summary: Refactoring SchemaPruning rule to remove duplicate code
Key: SPARK-27476
URL: https://issues.apache.org/jira/browse/SPARK-27476
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819125#comment-16819125
]
Robert Joseph Evans commented on SPARK-27396:
-
[~bryanc],
I see your point that if this is
[
https://issues.apache.org/jira/browse/SPARK-27475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819124#comment-16819124
]
Yuming Wang commented on SPARK-27475:
-
[~srowen]
One way to fix it is to change [this
Yuming Wang created SPARK-27475:
---
Summary: dev/deps/spark-deps-hadoop-3.2 is incorrect
Key: SPARK-27475
URL: https://issues.apache.org/jira/browse/SPARK-27475
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-27475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-27475:
Description: parquet-hadoop-bundle-1.6.0.jar should be
parquet-hadoop-bundle-1.8.1.jar. (was:
[
https://issues.apache.org/jira/browse/SPARK-27464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-27464:
-
Assignee: Shivu Sondur
> Add Constant instead of referring string literal used from many
[
https://issues.apache.org/jira/browse/SPARK-27464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-27464.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24368
[
https://issues.apache.org/jira/browse/SPARK-27469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-27469.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Resolved by
[
https://issues.apache.org/jira/browse/SPARK-27330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eyal Zituny updated SPARK-27330:
Description:
in cases where a micro batch is being killed (interrupted), not during actual
[
https://issues.apache.org/jira/browse/SPARK-27397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-27397.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24308
[
https://issues.apache.org/jira/browse/SPARK-27330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819054#comment-16819054
]
Eyal Zituny commented on SPARK-27330:
-
[~gsomogyi] i've submitted a PR
> ForeachWriter is not being
[
https://issues.apache.org/jira/browse/SPARK-27397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-27397:
-
Assignee: Kazuaki Ishizaki
> Take care of OpenJ9 in JVM dependant parts
>
[
https://issues.apache.org/jira/browse/SPARK-27409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818963#comment-16818963
]
Gabor Somogyi commented on SPARK-27409:
---
After I've modified the code the same way just like in
[
https://issues.apache.org/jira/browse/SPARK-27474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-27474:
Summary: avoid retrying a task failed with CommitDeniedException many times
(was: try best to
[
https://issues.apache.org/jira/browse/SPARK-27470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-27470.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24381
[
https://issues.apache.org/jira/browse/SPARK-27468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818889#comment-16818889
]
Daniel Tomes commented on SPARK-27468:
--
Excellent [~shahid], if you need any assistance
[
https://issues.apache.org/jira/browse/SPARK-27409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818882#comment-16818882
]
Gabor Somogyi commented on SPARK-27409:
---
[~pbharaj]
{quote}Yes, I'm following the kafka
Wenchen Fan created SPARK-27474:
---
Summary: try best to not submit tasks when the partitions are
already completed
Key: SPARK-27474
URL: https://issues.apache.org/jira/browse/SPARK-27474
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818707#comment-16818707
]
Wenchen Fan commented on SPARK-25250:
-
good points! I'm creating another ticket for the issue, and
[
https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-25250.
-
Resolution: Fixed
> Race condition with tasks running when new attempt for same stage is
[
https://issues.apache.org/jira/browse/SPARK-27448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-27448.
-
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 24356
[
https://issues.apache.org/jira/browse/SPARK-27448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-27448:
---
Assignee: Gengliang Wang
> File source V2 table provider should be compatible with V1
[
https://issues.apache.org/jira/browse/SPARK-27465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Praveen updated SPARK-27465:
Description:
Hi Team,
We are getting the below exceptions with Kafka Client Version 0.11.0.0 for
65 matches
Mail list logo
