[
https://issues.apache.org/jira/browse/SPARK-29450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-29450:
Fix Version/s: 2.4.5
> [SS] In streaming aggregation, metric for output rows is not measured in
[
https://issues.apache.org/jira/browse/SPARK-27750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989249#comment-16989249
]
t oo edited comment on SPARK-27750 at 1/16/20 6:33 AM:
---
WDYT [~Ngone51] [~squito]
[
https://issues.apache.org/jira/browse/SPARK-30521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-30521.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27221
[
https://issues.apache.org/jira/browse/SPARK-30521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-30521:
Assignee: Maxim Gekk
> Eliminate deprecation warnings for ExpressionInfo
>
[
https://issues.apache.org/jira/browse/SPARK-27868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016541#comment-17016541
]
Dongjoon Hyun commented on SPARK-27868:
---
Hi, [~vanzin]. Since there is no proper way to set `Fixed
[
https://issues.apache.org/jira/browse/SPARK-27868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27868:
--
Labels: release-notes (was: )
> Better document shuffle / RPC listen backlog
>
[
https://issues.apache.org/jira/browse/SPARK-27868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-27868:
--
Fix Version/s: (was: 2.4.4)
> Better document shuffle / RPC listen backlog
>
[
https://issues.apache.org/jira/browse/SPARK-27868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016540#comment-17016540
]
Dongjoon Hyun commented on SPARK-27868:
---
This is reverted from `branch-2.4` via
[
https://issues.apache.org/jira/browse/SPARK-30491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-30491:
-
Assignee: Xinrong Meng
> Enable dependency audit files to tell dependency classifier
>
[
https://issues.apache.org/jira/browse/SPARK-30491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30491.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27177
[
https://issues.apache.org/jira/browse/SPARK-30323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-30323:
Assignee: Maxim Gekk
> Support filters pushdown in CSV datasource
>
[
https://issues.apache.org/jira/browse/SPARK-30323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-30323.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 26973
[
https://issues.apache.org/jira/browse/SPARK-30522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
phanikumar updated SPARK-30522:
---
Description:
I have written a spark streaming consumer to consume the data from Kafka. I
found a
[
https://issues.apache.org/jira/browse/SPARK-30522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
phanikumar updated SPARK-30522:
---
Description:
I have written a spark streaming consumer to consume the data from Kafka. I
found a
[
https://issues.apache.org/jira/browse/SPARK-30522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
phanikumar updated SPARK-30522:
---
Description:
I have written a spark streaming consumer to consume the data from Kafka. I
found a
[
https://issues.apache.org/jira/browse/SPARK-30325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-30325:
Fix Version/s: 2.4.5
> markPartitionCompleted cause task status inconsistent
>
[
https://issues.apache.org/jira/browse/SPARK-30522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
phanikumar updated SPARK-30522:
---
Description:
I have written a spark streaming consumer to consume the data from Kafka. I
found a
[
https://issues.apache.org/jira/browse/SPARK-30502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng reassigned SPARK-30502:
Assignee: zhengruifeng
> PeriodicRDDCheckpointer supports storageLevel
>
[
https://issues.apache.org/jira/browse/SPARK-30502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng resolved SPARK-30502.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27189
[
https://issues.apache.org/jira/browse/SPARK-30518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-30518.
--
Fix Version/s: 3.0.0
Assignee: wuyi
Resolution: Fixed
Resolved by
[
https://issues.apache.org/jira/browse/SPARK-30524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ke Jia updated SPARK-30524:
---
Description: The OptimizeSkewedJoin will break the outputPartitioning of
origin SMJ. And it may introduce
Ke Jia created SPARK-30524:
--
Summary: Disable OptimizeSkewJoin rule if introducing additional
shuffle.
Key: SPARK-30524
URL: https://issues.apache.org/jira/browse/SPARK-30524
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-26736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-26736.
--
Fix Version/s: 3.0.0
Assignee: Takeshi Yamamuro
Resolution: Fixed
[
https://issues.apache.org/jira/browse/SPARK-27750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989249#comment-16989249
]
t oo edited comment on SPARK-27750 at 1/15/20 11:36 PM:
WDYT [~Ngone51]
Jason Altekruse created SPARK-30523:
---
Summary: Collapse back to back aggregations into a single
aggregate to reduce the number of shuffles
Key: SPARK-30523
URL: https://issues.apache.org/jira/browse/SPARK-30523
[
https://issues.apache.org/jira/browse/SPARK-23273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Henrique dos Santos Goulart closed SPARK-23273.
---
> Spark Dataset withColumn - schema column order isn't the same as case
[
https://issues.apache.org/jira/browse/SPARK-30246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Masiero Vanzin updated SPARK-30246:
---
Fix Version/s: (was: 2.4.5)
2.4.6
> Spark on Yarn
[
https://issues.apache.org/jira/browse/SPARK-30246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Masiero Vanzin reassigned SPARK-30246:
--
Assignee: Henrique dos Santos Goulart
> Spark on Yarn External
[
https://issues.apache.org/jira/browse/SPARK-30246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Masiero Vanzin resolved SPARK-30246.
Fix Version/s: 3.0.0
2.4.5
Resolution: Fixed
[
https://issues.apache.org/jira/browse/SPARK-28403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016316#comment-17016316
]
Zebing Lin edited comment on SPARK-28403 at 1/15/20 8:53 PM:
-
In our
[
https://issues.apache.org/jira/browse/SPARK-28403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016316#comment-17016316
]
Zebing Lin commented on SPARK-28403:
In our production, this just caused a fluctuation of requested
[
https://issues.apache.org/jira/browse/SPARK-29448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk resolved SPARK-29448.
Resolution: Won't Fix
> Support the `INTERVAL` type by Parquet datasource
>
[
https://issues.apache.org/jira/browse/SPARK-30511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zebing Lin updated SPARK-30511:
---
Description:
*TL;DR*
When speculative tasks finished/failed/got killed, they are still considered
[
https://issues.apache.org/jira/browse/SPARK-30495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Masiero Vanzin resolved SPARK-30495.
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-30495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Masiero Vanzin reassigned SPARK-30495:
--
Assignee: Gabor Somogyi
> How to disable
[
https://issues.apache.org/jira/browse/SPARK-30190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016263#comment-17016263
]
Steve Loughran commented on SPARK-30190:
S3A creates a dir marker and deletes it
But I'd rather
[
https://issues.apache.org/jira/browse/SPARK-30511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zebing Lin updated SPARK-30511:
---
Description:
*TL;DR*
When speculative tasks finished/failed/got killed, they are still considered
[
https://issues.apache.org/jira/browse/SPARK-30511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zebing Lin updated SPARK-30511:
---
Attachment: Screen Shot 2020-01-15 at 11.13.17.png
> Spark marks ended speculative tasks as pending
[
https://issues.apache.org/jira/browse/SPARK-30511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zebing Lin updated SPARK-30511:
---
Description:
*TL;DR*
When speculative tasks finished/failed/got killed, they are still considered
[
https://issues.apache.org/jira/browse/SPARK-30511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zebing Lin updated SPARK-30511:
---
Description:
*TL;DR*
When speculative tasks finished/failed/got killed, they are still considered
[
https://issues.apache.org/jira/browse/SPARK-30511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zebing Lin updated SPARK-30511:
---
Description:
*TL;DR*
When speculative tasks finished/failed/got killed, they are still considered
[
https://issues.apache.org/jira/browse/SPARK-30479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Masiero Vanzin resolved SPARK-30479.
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-30479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Masiero Vanzin reassigned SPARK-30479:
--
Assignee: Jungtaek Lim
> Apply compaction of event log to SQL events
[
https://issues.apache.org/jira/browse/SPARK-18165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016213#comment-17016213
]
Sowmya commented on SPARK-18165:
Hi [~itsvikramagr] ,Can this library be used in production with spark
[
https://issues.apache.org/jira/browse/SPARK-26570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016200#comment-17016200
]
ShivaKumar SS commented on SPARK-26570:
---
Unfortunately I have hit the same issue.
[
https://issues.apache.org/jira/browse/SPARK-30522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
phanikumar updated SPARK-30522:
---
Summary: Spark Streaming dynamic executors override or take default kafka
parameters in cluster
phanikumar created SPARK-30522:
--
Summary: Spark Streaming dynamic executors overried kafka
parameters in cluster mode
Key: SPARK-30522
URL: https://issues.apache.org/jira/browse/SPARK-30522
Project:
[
https://issues.apache.org/jira/browse/SPARK-30504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-30504.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27190
[
https://issues.apache.org/jira/browse/SPARK-30504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-30504:
-
Priority: Minor (was: Major)
> OneVsRest and OneVsRestModel _from_java and _to_java should
[
https://issues.apache.org/jira/browse/SPARK-30504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-30504:
Assignee: Maciej Szymkiewicz
> OneVsRest and OneVsRestModel _from_java and _to_java
Maxim Gekk created SPARK-30521:
--
Summary: Eliminate deprecation warnings for ExpressionInfo
Key: SPARK-30521
URL: https://issues.apache.org/jira/browse/SPARK-30521
Project: Spark
Issue Type:
Maxim Gekk created SPARK-30520:
--
Summary: Eliminate deprecation warnings for
UserDefinedAggregateFunction
Key: SPARK-30520
URL: https://issues.apache.org/jira/browse/SPARK-30520
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-30165:
---
Attachment: spark_warnings.txt
> Eliminate compilation warnings
> --
>
[
https://issues.apache.org/jira/browse/SPARK-30165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-30165:
---
Attachment: (was: spark_warnings.txt)
> Eliminate compilation warnings
>
[
https://issues.apache.org/jira/browse/SPARK-29708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-29708.
--
Fix Version/s: 3.0.0
Assignee: Takeshi Yamamuro
Resolution: Fixed
[
https://issues.apache.org/jira/browse/SPARK-30515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takeshi Yamamuro resolved SPARK-30515.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Resolved by
[
https://issues.apache.org/jira/browse/SPARK-30177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-30177:
---
Summary: Eliminate warnings: part 7 (was: Eliminate warnings: part7)
> Eliminate warnings: part 7
[
https://issues.apache.org/jira/browse/SPARK-30172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-30172:
---
Summary: Eliminate warnings: part 3 (was: Eliminate warnings: part3)
> Eliminate warnings: part 3
[
https://issues.apache.org/jira/browse/SPARK-30174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-30174:
---
Summary: Eliminate warnings: part 4 (was: Eliminate warnings :part 4)
> Eliminate warnings: part 4
[
https://issues.apache.org/jira/browse/SPARK-30171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk updated SPARK-30171:
---
Summary: Eliminate warnings: part 2 (was: Eliminate warnings: part2)
> Eliminate warnings: part 2
[
https://issues.apache.org/jira/browse/SPARK-30174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk resolved SPARK-30174.
Resolution: Duplicate
> Eliminate warnings :part 4
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-30171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk resolved SPARK-30171.
Resolution: Won't Fix
As per discussion in
[
https://issues.apache.org/jira/browse/SPARK-30490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maxim Gekk resolved SPARK-30490.
Resolution: Won't Fix
See [https://github.com/apache/spark/pull/27174#discussion_r365629991]
>
Xiaoming created SPARK-30519:
Summary: Executor can't use spark.executorEnv.HADOOP_USER_NAME to
change the user accessing to hdfs
Key: SPARK-30519
URL: https://issues.apache.org/jira/browse/SPARK-30519
wuyi created SPARK-30518:
Summary: Precision and scale should be same for values between
-1.0 and 1.0 in Decimal
Key: SPARK-30518
URL: https://issues.apache.org/jira/browse/SPARK-30518
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015706#comment-17015706
]
Ajith S edited comment on SPARK-30517 at 1/15/20 8:01 AM:
--
[~srowen]
[
https://issues.apache.org/jira/browse/SPARK-30517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015706#comment-17015706
]
Ajith S commented on SPARK-30517:
-
[~srowen] [~dongjoon] [~vanzin] Please let me know about your opinion
67 matches
Mail list logo