[
https://issues.apache.org/jira/browse/SPARK-27034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27034:
Assignee: Apache Spark
> Nested schema pruning for ORC
> -
>
Liang-Chi Hsieh created SPARK-27034:
---
Summary: Nested schema pruning for ORC
Key: SPARK-27034
URL: https://issues.apache.org/jira/browse/SPARK-27034
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-27034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27034:
Assignee: (was: Apache Spark)
> Nested schema pruning for ORC
>
[
https://issues.apache.org/jira/browse/SPARK-27033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27033:
Assignee: Apache Spark
> Add rule to optimize binary comparisons to its push down format
[
https://issues.apache.org/jira/browse/SPARK-27033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27033:
Assignee: (was: Apache Spark)
> Add rule to optimize binary comparisons to its push
[
https://issues.apache.org/jira/browse/SPARK-27033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
EdisonWang updated SPARK-27033:
---
Affects Version/s: (was: 3.0.0)
2.4.0
> Add rule to optimize binary
[
https://issues.apache.org/jira/browse/SPARK-27033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
EdisonWang updated SPARK-27033:
---
Description: Currently, filters like this "select * from table where a + 1
>= 3" cannot be pushed
[
https://issues.apache.org/jira/browse/SPARK-27033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
EdisonWang updated SPARK-27033:
---
Description: _emphasized text_
> Add rule to optimize binary comparisons to its push down format
>
EdisonWang created SPARK-27033:
--
Summary: Add rule to optimize binary comparisons to its push down
format
Key: SPARK-27033
URL: https://issues.apache.org/jira/browse/SPARK-27033
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-26860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782575#comment-16782575
]
Jagadesh Kiran N commented on SPARK-26860:
--
For Followup only i have mentioned few days back
[
https://issues.apache.org/jira/browse/SPARK-26860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782573#comment-16782573
]
Jagadesh Kiran N commented on SPARK-26860:
--
@srowen i took time to understand steps both R
[
https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782565#comment-16782565
]
Felix Cheung commented on SPARK-26918:
--
[~srowen] what do you think?
> All .md should have ASF
[
https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782564#comment-16782564
]
Felix Cheung commented on SPARK-26918:
--
I'm for doing this (Reopen this issue)
Also
[
https://issues.apache.org/jira/browse/SPARK-27029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-27029.
---
Resolution: Fixed
Fix Version/s: 3.0.0
This is resolved via
[
https://issues.apache.org/jira/browse/SPARK-26016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782542#comment-16782542
]
Maxim Gekk commented on SPARK-26016:
[~srowen] JSON datasource uses Text datasource in schema
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781670#comment-16781670
]
shahid edited comment on SPARK-27019 at 3/2/19 9:44 PM:
seems event reordering
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27019:
Assignee: (was: Apache Spark)
> Spark UI's SQL tab shows inconsistent values
>
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27019:
Assignee: Apache Spark
> Spark UI's SQL tab shows inconsistent values
>
[
https://issues.apache.org/jira/browse/SPARK-25762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-25762:
--
Target Version/s: 3.0.0
Updating Guava can be really disruptive, but we shade it, so it's possible I
[
https://issues.apache.org/jira/browse/SPARK-25781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782537#comment-16782537
]
Sean Owen commented on SPARK-25781:
---
PS are you referring to Shapley values?
> relative importance of
[
https://issues.apache.org/jira/browse/SPARK-25941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-25941.
---
Resolution: Not A Problem
This isn't a bug. The implementation has changed in Spark and MLlib a lot
[
https://issues.apache.org/jira/browse/SPARK-25814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-25814.
---
Resolution: Duplicate
I think there are a few related items that this could be a duplicate of;
[
https://issues.apache.org/jira/browse/SPARK-25911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-25911.
---
Resolution: Won't Fix
I don't think we'd add all of those. Some of these are already in JIRA as
[
https://issues.apache.org/jira/browse/SPARK-25928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-25928.
---
Resolution: Not A Problem
Yeah, you have an lz4-java version conflict somewhere. That's not a Spark
[
https://issues.apache.org/jira/browse/SPARK-25982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782527#comment-16782527
]
Ramandeep Singh commented on SPARK-25982:
-
No, as I said those operations at a stage are
[
https://issues.apache.org/jira/browse/SPARK-26146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782526#comment-16782526
]
Sean Owen commented on SPARK-26146:
---
It's possible, even likely, that the dependency is transitive. In
[
https://issues.apache.org/jira/browse/SPARK-26146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782519#comment-16782519
]
Michael Heuer commented on SPARK-26146:
---
[~srowen] Hey, wait a minute, the full example from the
[
https://issues.apache.org/jira/browse/SPARK-26146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782522#comment-16782522
]
Michael Heuer commented on SPARK-26146:
---
It appears that this is a duplicate of SPARK-26583 and
[
https://issues.apache.org/jira/browse/SPARK-25982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782521#comment-16782521
]
Sean Owen commented on SPARK-25982:
---
I don't understand this; you're running operations in parallel on
[
https://issues.apache.org/jira/browse/SPARK-26016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782520#comment-16782520
]
Sean Owen commented on SPARK-26016:
---
Yeah, the TL;DR from reading the code is that it writes UTF-8,
[
https://issues.apache.org/jira/browse/SPARK-26943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782518#comment-16782518
]
Will Uto commented on SPARK-26943:
--
Thanks for the information - I was hoping that if I e.g. installed
[
https://issues.apache.org/jira/browse/SPARK-26045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782508#comment-16782508
]
Sean Owen commented on SPARK-26045:
---
Avro is already on 1.8.2 in 2.4.0. I think the problem may be
[
https://issues.apache.org/jira/browse/SPARK-24295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782510#comment-16782510
]
Alfredo Gimenez commented on SPARK-24295:
-
Our current workaround FWII:
We've added a streaming
[
https://issues.apache.org/jira/browse/SPARK-26017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-26017.
---
Resolution: Invalid
I don't think this states an actionable issue; high relative to what?
> SVD++
[
https://issues.apache.org/jira/browse/SPARK-26166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782502#comment-16782502
]
Sean Owen commented on SPARK-26166:
---
I agree there's a problem there. I don't think checkpoint() is
[
https://issues.apache.org/jira/browse/SPARK-26058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-26058:
--
Priority: Minor (was: Major)
Description:
In order to make the bug more evident, please
[
https://issues.apache.org/jira/browse/SPARK-26128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-26128.
---
Resolution: Cannot Reproduce
> filter breaks input_file_name
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-26146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-26146.
---
Resolution: Cannot Reproduce
Is that code from Spark? it doesn't quite look like it from the stack
[
https://issues.apache.org/jira/browse/SPARK-26152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782505#comment-16782505
]
Sean Owen commented on SPARK-26152:
---
I haven't seen this one in a while, FWIW.
> Flaky test:
[
https://issues.apache.org/jira/browse/SPARK-26162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-26162.
---
Resolution: Not A Problem
I don't think it's a bug; the distributed computation and blocking might
[
https://issues.apache.org/jira/browse/SPARK-26183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-26183.
---
Resolution: Not A Problem
This doesn't look like a bug. It arises because you are (inadvertently)
[
https://issues.apache.org/jira/browse/SPARK-26214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-26214.
---
Resolution: Won't Fix
> Add "broadcast" method to DataFrame
> ---
>
[
https://issues.apache.org/jira/browse/SPARK-26224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782496#comment-16782496
]
Sean Owen commented on SPARK-26224:
---
The most realistic thing I can imagine is exposing `withColumns`.
[
https://issues.apache.org/jira/browse/SPARK-26229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-26229.
---
Resolution: Won't Fix
It's pretty internal. I don't think we'd want to expose it further,
[
https://issues.apache.org/jira/browse/SPARK-26247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782494#comment-16782494
]
Sean Owen commented on SPARK-26247:
---
I tend to think of this problem as about as solved as it will be
[
https://issues.apache.org/jira/browse/SPARK-26257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782491#comment-16782491
]
Sean Owen commented on SPARK-26257:
---
I'm not sure how much of the Pyspark and SparkR integration is
[
https://issues.apache.org/jira/browse/SPARK-26261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782489#comment-16782489
]
Sean Owen commented on SPARK-26261:
---
Why would you truncate the file -- how would this happen
[
https://issues.apache.org/jira/browse/SPARK-26266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-26266.
---
Resolution: Fixed
Assignee: Sean Owen (was: Yuming Wang)
Fix Version/s: 3.0.0
[
https://issues.apache.org/jira/browse/SPARK-26272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-26272.
---
Resolution: Fixed
Fix Version/s: 2.3.3
Yep, we do this regularly, and do it alongside
[
https://issues.apache.org/jira/browse/SPARK-27029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782441#comment-16782441
]
Apache Spark commented on SPARK-27029:
--
User 'srowen' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-27029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27029:
Assignee: Sean Owen (was: Apache Spark)
> Update Thrift to 0.12.0
>
[
https://issues.apache.org/jira/browse/SPARK-27029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782439#comment-16782439
]
Apache Spark commented on SPARK-27029:
--
User 'srowen' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-27029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27029:
Assignee: Apache Spark (was: Sean Owen)
> Update Thrift to 0.12.0
>
[
https://issues.apache.org/jira/browse/SPARK-26048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-26048.
---
Resolution: Fixed
Assignee: Marcelo Vanzin
Fix Version/s: 3.0.0
[
https://issues.apache.org/jira/browse/SPARK-26048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782435#comment-16782435
]
Dongjoon Hyun edited comment on SPARK-26048 at 3/2/19 4:18 PM:
---
This is
[
https://issues.apache.org/jira/browse/SPARK-26943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782429#comment-16782429
]
Sean Owen commented on SPARK-26943:
---
You can download and run the Spark distro wherever you like. If
[
https://issues.apache.org/jira/browse/SPARK-26274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-26274:
--
Priority: Minor (was: Major)
Component/s: (was: Web UI)
(was: Deploy)
[
https://issues.apache.org/jira/browse/SPARK-26943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782418#comment-16782418
]
Will Uto commented on SPARK-26943:
--
Thanks for explanation [~srowen], makes sense - I think this is why
[
https://issues.apache.org/jira/browse/SPARK-27007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-27007.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 23910
[
https://issues.apache.org/jira/browse/SPARK-27007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-27007:
-
Assignee: Huaxin Gao
> add rawPrediction to OneVsRest in PySpark
>
[
https://issues.apache.org/jira/browse/SPARK-26860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-26860.
---
Resolution: Not A Problem
> RangeBetween docs appear to be wrong
>
[
https://issues.apache.org/jira/browse/SPARK-27032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27032:
Assignee: Sean Owen (was: Apache Spark)
> Flaky test:
>
[
https://issues.apache.org/jira/browse/SPARK-27032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27032:
Assignee: Apache Spark (was: Sean Owen)
> Flaky test:
>
Sean Owen created SPARK-27032:
-
Summary: Flaky test:
org.apache.spark.sql.execution.streaming.HDFSMetadataLogSuite.HDFSMetadataLog:
metadata directory collision
Key: SPARK-27032
URL:
[
https://issues.apache.org/jira/browse/SPARK-27031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27031:
Assignee: Apache Spark
> Avoid double formatting in timestampToString
>
[
https://issues.apache.org/jira/browse/SPARK-27031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27031:
Assignee: (was: Apache Spark)
> Avoid double formatting in timestampToString
>
Maxim Gekk created SPARK-27031:
--
Summary: Avoid double formatting in timestampToString
Key: SPARK-27031
URL: https://issues.apache.org/jira/browse/SPARK-27031
Project: Spark
Issue Type:
Lev Katzav created SPARK-27030:
--
Summary: DataFrameWriter.insertInto fails when writing in parallel
to a hive table
Key: SPARK-27030
URL: https://issues.apache.org/jira/browse/SPARK-27030
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782330#comment-16782330
]
t oo commented on SPARK-26998:
--
[https://github.com/apache/spark/pull/23820] is only about hiding password
[
https://issues.apache.org/jira/browse/SPARK-27025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782322#comment-16782322
]
Erik van Oosten edited comment on SPARK-27025 at 3/2/19 8:43 AM:
-
The
[
https://issues.apache.org/jira/browse/SPARK-27025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782322#comment-16782322
]
Erik van Oosten commented on SPARK-27025:
-
I have a program in which several steps need to be
71 matches
Mail list logo
