[
https://issues.apache.org/jira/browse/SPARK-30246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16999830#comment-16999830
]
huangweiyi commented on SPARK-30246:
hi , [~jfilipiak], I add a figure about the inc
[
https://issues.apache.org/jira/browse/SPARK-30246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16999832#comment-16999832
]
huangweiyi commented on SPARK-30246:
I'm working on this and have added a patch for
[
https://issues.apache.org/jira/browse/SPARK-30246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16999832#comment-16999832
]
huangweiyi edited comment on SPARK-30246 at 12/19/19 8:03 AM:
Kent Yao created SPARK-30303:
Summary: Percentile will hit match err when percentage is null
Key: SPARK-30303
URL: https://issues.apache.org/jira/browse/SPARK-30303
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-28328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-28328:
---
Comment: was deleted
(was: I'm working on.)
> Support ANSI SQL:member predicate
> -
[
https://issues.apache.org/jira/browse/SPARK-28315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16999854#comment-16999854
]
Oleg Bonar commented on SPARK-28315:
Seems like it's not possible or unreasonably di
[
https://issues.apache.org/jira/browse/SPARK-29450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-29450:
Assignee: Jungtaek Lim
> [SS] In streaming aggregation, metric for output rows is not mea
[
https://issues.apache.org/jira/browse/SPARK-29450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-29450.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 26104
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-30120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng updated SPARK-30120:
-
Summary: LSH approxNearestNeighbors should use BoundedPriorityQueue when
numNearestNeighbors is
[
https://issues.apache.org/jira/browse/SPARK-30175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1643#comment-1643
]
Oleg Bonar commented on SPARK-30175:
I would fix this.
> Eliminate warnings: part 5
[
https://issues.apache.org/jira/browse/SPARK-30298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1659#comment-1659
]
Ankit Raj Boudh commented on SPARK-30298:
-
[~imback82] ok , Thank you for raisin
[
https://issues.apache.org/jira/browse/SPARK-30175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Oleg Bonar updated SPARK-30175:
---
Comment: was deleted
(was: I would fix this.)
> Eliminate warnings: part 5
> --
Jiaqi Li created SPARK-30304:
Summary: When the specified shufflemanager is incorrect, print the
prompt.
Key: SPARK-30304
URL: https://issues.apache.org/jira/browse/SPARK-30304
Project: Spark
Is
David Lindelöf created SPARK-30305:
--
Summary: Unable to overwrite table created by another Spark session
Key: SPARK-30305
URL: https://issues.apache.org/jira/browse/SPARK-30305
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Lindelöf updated SPARK-30305:
---
Attachment: pyspark.out
> Unable to overwrite table created by another Spark session
> -
[
https://issues.apache.org/jira/browse/SPARK-30305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Lindelöf updated SPARK-30305:
---
Description:
I'm unable to save a dataframe to a table, even when passing the
`mode='overwr
[
https://issues.apache.org/jira/browse/SPARK-30305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Lindelöf updated SPARK-30305:
---
Description:
I'm unable to save a dataframe to a table, even when passing the
`mode='overwr
Luca Canali created SPARK-30306:
---
Summary: Instrument Python UDF execution time and metrics using
Spark Metrics system
Key: SPARK-30306
URL: https://issues.apache.org/jira/browse/SPARK-30306
Project: Sp
Wenchen Fan created SPARK-30307:
---
Summary: remove ReusedQueryStageExec
Key: SPARK-30307
URL: https://issues.apache.org/jira/browse/SPARK-30307
Project: Spark
Issue Type: Improvement
C
[
https://issues.apache.org/jira/browse/SPARK-30306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Luca Canali updated SPARK-30306:
Attachment: PandasUDF_Time_Instrumentation_Annotated.png
> Instrument Python UDF execution time an
Vishwas created SPARK-30308:
---
Summary: Update Netty and Netty-all to address CVE-2019-16869
Key: SPARK-30308
URL: https://issues.apache.org/jira/browse/SPARK-30308
Project: Spark
Issue Type: Depend
[
https://issues.apache.org/jira/browse/SPARK-30308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vishwas updated SPARK-30308:
Description:
As per [CVE-2019-16869|http://www.cvedetails.com/cve/CVE-2019-16869/], netty
mishandled whit
Maxim Gekk created SPARK-30309:
--
Summary: Mark `Filter` as a `sealed` class
Key: SPARK-30309
URL: https://issues.apache.org/jira/browse/SPARK-30309
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-30309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-30309:
-
Assignee: Maxim Gekk
> Mark `Filter` as a `sealed` class
>
[
https://issues.apache.org/jira/browse/SPARK-30309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30309.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 26950
[https://
[
https://issues.apache.org/jira/browse/SPARK-30236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30236:
--
Fix Version/s: 2.4.5
> Clarify date and time patterns supported by date_format
> -
Tin Hang To created SPARK-30310:
---
Summary: SparkUncaughtExceptionHandler halts running process
unexpectedly
Key: SPARK-30310
URL: https://issues.apache.org/jira/browse/SPARK-30310
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tin Hang To updated SPARK-30310:
Description:
During 2.4.x testing, we have many occasions where the Worker process would
just DEA
[
https://issues.apache.org/jira/browse/SPARK-30310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tin Hang To updated SPARK-30310:
Description:
During 2.4.x testing, we have many occasions where the Worker process would
just DEA
[
https://issues.apache.org/jira/browse/SPARK-30310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tin Hang To updated SPARK-30310:
Docs Text: Resolved SparkUncaughtExceptionHandler halting process
unexpectedly.
> SparkUncaughtEx
Dongjoon Hyun created SPARK-30311:
-
Summary: Use KafkaConsumer.poll(Duration) instead of deprecated one
Key: SPARK-30311
URL: https://issues.apache.org/jira/browse/SPARK-30311
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30311.
---
Resolution: Duplicate
> Use KafkaConsumer.poll(Duration) instead of deprecated one
> ---
L. C. Hsieh created SPARK-30312:
---
Summary: Preserve path permission when truncate table
Key: SPARK-30312
URL: https://issues.apache.org/jira/browse/SPARK-30312
Project: Spark
Issue Type: Improv
Marcelo Masiero Vanzin created SPARK-30313:
--
Summary: Flaky test: MasterSuite.master/worker web ui available
with reverseProxy
Key: SPARK-30313
URL: https://issues.apache.org/jira/browse/SPARK-30313
2 AM:
---
>From the logs (in case jenkins cleans them up):
{noformat}
19/12/19 13:48:39.160 dispatcher-event-loop-4 INFO Worker: WorkerWebUI is
available at http://localhost:8080/proxy/worker-20191219
134839-localhost-36054
19/12/19 13:48:39.296 WorkerUI-52072 WARN Jet
ogs (in case jenkins cleans the up):
{noformat}
19/12/19 13:48:39.160 dispatcher-event-loop-4 INFO Worker: WorkerWebUI is
available at http://localhost:8080/proxy/worker-20191219
134839-localhost-36054
19/12/19 13:48:39.296 WorkerUI-52072 WARN JettyUtils: GET /json/ failed:
java.lang.NullPointerEx
[
https://issues.apache.org/jira/browse/SPARK-30313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000519#comment-17000519
]
Ankit Raj Boudh commented on SPARK-30313:
-
[~vanzin], i will check this issue
>
[
https://issues.apache.org/jira/browse/SPARK-30308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000522#comment-17000522
]
Ankit Raj Boudh commented on SPARK-30308:
-
[~vishwaskumar], 4.1.43.Final version
[
https://issues.apache.org/jira/browse/SPARK-30313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000524#comment-17000524
]
Ankit Raj Boudh commented on SPARK-30313:
-
it's failing in local also i will rai
[
https://issues.apache.org/jira/browse/SPARK-30313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankit Raj Boudh updated SPARK-30313:
Comment: was deleted
(was: it's failing in local also i will raise PR for this today)
> F
[
https://issues.apache.org/jira/browse/SPARK-30300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000538#comment-17000538
]
Ankit Raj Boudh commented on SPARK-30300:
-
[~nartal1], no problem finally we nee
[
https://issues.apache.org/jira/browse/SPARK-30313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000542#comment-17000542
]
Ankit Raj Boudh commented on SPARK-30313:
-
[~vanzin], I run in my local system,
[
https://issues.apache.org/jira/browse/SPARK-30288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-30288.
--
Resolution: Won't Fix
> Failed to write valid Parquet files when column names contains special
Yuchen Huo created SPARK-30314:
--
Summary: Add identifier and catalog information to
DataSourceV2Relation
Key: SPARK-30314
URL: https://issues.apache.org/jira/browse/SPARK-30314
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-30313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000547#comment-17000547
]
Jungtaek Lim commented on SPARK-30313:
--
Flaky test means it doesn't fail consistent
[
https://issues.apache.org/jira/browse/SPARK-30313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000548#comment-17000548
]
Ankit Raj Boudh commented on SPARK-30313:
-
I think it's not an issue.
> Flaky t
[
https://issues.apache.org/jira/browse/SPARK-30313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankit Raj Boudh updated SPARK-30313:
Comment: was deleted
(was: I think it's not an issue.)
> Flaky test: MasterSuite.master/w
[
https://issues.apache.org/jira/browse/SPARK-30313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000550#comment-17000550
]
Ankit Raj Boudh commented on SPARK-30313:
-
ok, i will try to reproduce it.
> Fl
[
https://issues.apache.org/jira/browse/SPARK-30313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000570#comment-17000570
]
Ankit Raj Boudh commented on SPARK-30313:
-
[~vanzin] , i have reproduce the issu
[
https://issues.apache.org/jira/browse/SPARK-28825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000593#comment-17000593
]
pavithra ramachandran commented on SPARK-28825:
---
[~LI,Xiao] and [~dkbiswal
Wei Xue created SPARK-30315:
---
Summary: Add adaptive execution context
Key: SPARK-30315
URL: https://issues.apache.org/jira/browse/SPARK-30315
Project: Spark
Issue Type: Task
Components: S
[
https://issues.apache.org/jira/browse/SPARK-30313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ankit Raj Boudh updated SPARK-30313:
Comment: was deleted
(was: [~vanzin] , i have reproduce the issue, i will submit the PR so
[
https://issues.apache.org/jira/browse/SPARK-29294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000622#comment-17000622
]
Jungtaek Lim commented on SPARK-29294:
--
Hopefully there's alternative to ZkUtils be
[
https://issues.apache.org/jira/browse/SPARK-28367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-28367:
-
Comment: was deleted
(was: Small correction: we're waiting for Kafka 2.4 to leverage KIP-396.)
[
https://issues.apache.org/jira/browse/SPARK-28367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000650#comment-17000650
]
Jungtaek Lim commented on SPARK-28367:
--
I just realized Kafka 2.4 doesn't contain K
[
https://issues.apache.org/jira/browse/SPARK-30184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-30184:
---
Assignee: Aman Omer
> Implement a helper method for aliasing functions
> --
[
https://issues.apache.org/jira/browse/SPARK-30184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30184.
-
Fix Version/s: 3.0.0
Resolution: Fixed
> Implement a helper method for aliasing functions
[
https://issues.apache.org/jira/browse/SPARK-29708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro updated SPARK-29708:
-
Summary: Different answers in aggregates of duplicate grouping sets (was:
Different ans
58 matches
Mail list logo
