zenglinxi created SPARK-21223:
-
Summary: Thread-safety issue in FsHistoryProvider
Key: SPARK-21223
URL: https://issues.apache.org/jira/browse/SPARK-21223
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-21223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21223:
Assignee: Apache Spark
> Thread-safety issue in FsHistoryProvider
> -
[
https://issues.apache.org/jira/browse/SPARK-21223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21223:
Assignee: (was: Apache Spark)
> Thread-safety issue in FsHistoryProvider
> --
[
https://issues.apache.org/jira/browse/SPARK-21223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064406#comment-16064406
]
Apache Spark commented on SPARK-21223:
--
User 'zenglinxi0615' has created a pull requ
Hyukjin Kwon created SPARK-21224:
Summary: Support a DDL-formatted string in DataFrameReader.schema
in R
Key: SPARK-21224
URL: https://issues.apache.org/jira/browse/SPARK-21224
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-21224:
-
Summary: Support a DDL-formatted string as schema in reading for R (was:
Support a DDL-formatted
[
https://issues.apache.org/jira/browse/SPARK-21208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21208:
Assignee: (was: Apache Spark)
> Ability to "setLocalProperty" from sc, in sparkR
> ---
[
https://issues.apache.org/jira/browse/SPARK-21224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-21224:
-
Description:
This might have to be a followup for SPARK-20431 but I just decided to make
this se
[
https://issues.apache.org/jira/browse/SPARK-21222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064441#comment-16064441
]
Sean Owen commented on SPARK-21222:
---
Do you mean this is the same as "SELECT MAX(a) FRO
[
https://issues.apache.org/jira/browse/SPARK-21208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21208:
Assignee: Apache Spark
> Ability to "setLocalProperty" from sc, in sparkR
> --
[
https://issues.apache.org/jira/browse/SPARK-21208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064438#comment-16064438
]
Apache Spark commented on SPARK-21208:
--
User 'HyukjinKwon' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-21208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064448#comment-16064448
]
Hyukjin Kwon commented on SPARK-21208:
--
Ooops, I linked wrong JIRA. I renamed it bac
[
https://issues.apache.org/jira/browse/SPARK-21224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064446#comment-16064446
]
Apache Spark commented on SPARK-21224:
--
User 'HyukjinKwon' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-21224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-21224:
-
Description:
This might have to be a followup for SPARK-20431 but I just decided to make
this se
[
https://issues.apache.org/jira/browse/SPARK-21224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21224:
Assignee: Apache Spark
> Support a DDL-formatted string as schema in reading for R
> -
[
https://issues.apache.org/jira/browse/SPARK-21224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21224:
Assignee: (was: Apache Spark)
> Support a DDL-formatted string as schema in reading fo
[
https://issues.apache.org/jira/browse/SPARK-20977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sharkd tu updated SPARK-20977:
--
Description:
{code:java}
17/06/03 13:39:31 ERROR Utils: Uncaught exception in thread
heartbeat-receiv
[
https://issues.apache.org/jira/browse/SPARK-20977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sharkd tu updated SPARK-20977:
--
Environment: (was: OpenJDK 64-Bit Server VM (25.71-b00) for linux-ppc64
JRE (1.8.0-internal-centos_
[
https://issues.apache.org/jira/browse/SPARK-20977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sharkd tu updated SPARK-20977:
--
Description:
{code:java}
17/06/03 13:39:31 ERROR Utils: Uncaught exception in thread
heartbeat-receive
[
https://issues.apache.org/jira/browse/SPARK-21063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064469#comment-16064469
]
Peter Bykov commented on SPARK-21063:
-
[~q79969786] i have both spark hive-thriftser
[
https://issues.apache.org/jira/browse/SPARK-21063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064481#comment-16064481
]
Peter Bykov commented on SPARK-21063:
-
[~q79969786] also, i can receive data using JD
[
https://issues.apache.org/jira/browse/SPARK-21196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-21196:
---
Assignee: Gengliang Wang
> Split codegen info of query plan into sequence
>
[
https://issues.apache.org/jira/browse/SPARK-21196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-21196.
-
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 18409
[https://githu
yangZhiguo created SPARK-21225:
--
Summary: decrease the Mem using for variable 'tasks' in function
resourceOffers
Key: SPARK-21225
URL: https://issues.apache.org/jira/browse/SPARK-21225
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Styles updated SPARK-21218:
---
Attachment: Starscream Console on
OTT---Michael-Styles---MBP-15-inch-Mid-2015 - Details for Q
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Styles updated SPARK-21218:
---
Attachment: IN Predicate.png
OR Predicate.png
> Convert IN predicate to equiv
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Styles updated SPARK-21218:
---
Attachment: (was: Starscream Console on
OTT---Michael-Styles---MBP-15-inch-Mid-2015 - Det
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Styles updated SPARK-21218:
---
Attachment: (was: Starscream Console on
OTT---Michael-Styles---MBP-15-inch-Mid-2015 - Det
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064608#comment-16064608
]
Michael Styles commented on SPARK-21218:
By not pushing the filter to Parquet, ar
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064608#comment-16064608
]
Michael Styles edited comment on SPARK-21218 at 6/27/17 10:25 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064608#comment-16064608
]
Michael Styles edited comment on SPARK-21218 at 6/27/17 10:30 AM:
-
Carlos M. Casas created SPARK-21226:
---
Summary: Save empty dataframe in pyspark prints nothing
Key: SPARK-21226
URL: https://issues.apache.org/jira/browse/SPARK-21226
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-21225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yangZhiguo updated SPARK-21225:
---
Description:
In the function 'resourceOffers', It declare a variable 'tasks' for storage
the tas
[
https://issues.apache.org/jira/browse/SPARK-21225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064658#comment-16064658
]
Apache Spark commented on SPARK-21225:
--
User 'JackYangzg' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-21225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21225:
Assignee: Apache Spark
> decrease the Mem using for variable 'tasks' in function resourceO
[
https://issues.apache.org/jira/browse/SPARK-21225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21225:
Assignee: (was: Apache Spark)
> decrease the Mem using for variable 'tasks' in functio
[
https://issues.apache.org/jira/browse/SPARK-21226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-21226:
--
Priority: Minor (was: Major)
What is the error?
> Save empty dataframe in pyspark prints nothing
> --
[
https://issues.apache.org/jira/browse/SPARK-21223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064676#comment-16064676
]
Sean Owen commented on SPARK-21223:
---
[~gostop_zlx] this overlaps a lot with SPARK-21078
[
https://issues.apache.org/jira/browse/SPARK-21225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064682#comment-16064682
]
Apache Spark commented on SPARK-21225:
--
User 'JackYangzg' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-21226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064706#comment-16064706
]
Carlos M. Casas commented on SPARK-21226:
-
The error is a different way of writin
[
https://issues.apache.org/jira/browse/SPARK-20073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064729#comment-16064729
]
Apache Spark commented on SPARK-20073:
--
User 'maropu' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-20073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20073:
Assignee: (was: Apache Spark)
> Unexpected Cartesian product when using eqNullSafe in
[
https://issues.apache.org/jira/browse/SPARK-20073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20073:
Assignee: Apache Spark
> Unexpected Cartesian product when using eqNullSafe in join with a
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064608#comment-16064608
]
Michael Styles edited comment on SPARK-21218 at 6/27/17 12:17 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-21176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064747#comment-16064747
]
Apache Spark commented on SPARK-21176:
--
User 'IngoSchuster' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-21176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21176:
Assignee: (was: Apache Spark)
> Master UI hangs with spark.ui.reverseProxy=true if the
[
https://issues.apache.org/jira/browse/SPARK-21176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21176:
Assignee: Apache Spark
> Master UI hangs with spark.ui.reverseProxy=true if the master nod
Seydou Dia created SPARK-21227:
--
Summary: Unicode in Json field causes AnalysisException when
selecting from Dataframe
Key: SPARK-21227
URL: https://issues.apache.org/jira/browse/SPARK-21227
Project: Spa
[
https://issues.apache.org/jira/browse/SPARK-21227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Seydou Dia updated SPARK-21227:
---
Description:
Hi,
please find below the step to reproduce the issue I am facing,
{code:python}
$ py
[
https://issues.apache.org/jira/browse/SPARK-21227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Seydou Dia updated SPARK-21227:
---
Description:
Hi,
please find below the step to reproduce the issue I am facing.
First I create a jso
[
https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064833#comment-16064833
]
Dominic Ricard commented on SPARK-21067:
[~q79969786], yes. As stated in the desc
[
https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064833#comment-16064833
]
Dominic Ricard edited comment on SPARK-21067 at 6/27/17 1:31 PM:
--
Bogdan Raducanu created SPARK-21228:
---
Summary: InSet.doCodeGen incorrect handling of structs
Key: SPARK-21228
URL: https://issues.apache.org/jira/browse/SPARK-21228
Project: Spark
Issue Typ
[
https://issues.apache.org/jira/browse/SPARK-21228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bogdan Raducanu updated SPARK-21228:
Description:
In InSet it's possible that hset contains GenericInternalRows while child
ret
[
https://issues.apache.org/jira/browse/SPARK-21228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bogdan Raducanu updated SPARK-21228:
Description:
In InSet it's possible that hset contains GenericInternalRows while child
ret
[
https://issues.apache.org/jira/browse/SPARK-21228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bogdan Raducanu updated SPARK-21228:
Description:
In InSet it's possible that hset contains GenericInternalRows while child
ret
[
https://issues.apache.org/jira/browse/SPARK-21228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bogdan Raducanu updated SPARK-21228:
Description:
In InSet it's possible that hset contains GenericInternalRows while child
ret
[
https://issues.apache.org/jira/browse/SPARK-21228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bogdan Raducanu updated SPARK-21228:
Description:
In InSet it's possible that hset contains GenericInternalRows while child
ret
[
https://issues.apache.org/jira/browse/SPARK-21228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bogdan Raducanu updated SPARK-21228:
Summary: InSet incorrect handling of structs (was: InSet.doCodeGen
incorrect handling of s
[
https://issues.apache.org/jira/browse/SPARK-21228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bogdan Raducanu updated SPARK-21228:
Description:
In InSet it's possible that hset contains GenericInternalRows while child
ret
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064880#comment-16064880
]
Hyukjin Kwon commented on SPARK-21218:
--
Yea, I support this for what it worth. Let's
[
https://issues.apache.org/jira/browse/SPARK-21228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064945#comment-16064945
]
Bogdan Raducanu commented on SPARK-21228:
-
I tested manually (since there is no f
[
https://issues.apache.org/jira/browse/SPARK-20002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064947#comment-16064947
]
Leon Pham commented on SPARK-20002:
---
We're actually reading data from two different sou
[
https://issues.apache.org/jira/browse/SPARK-21228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064970#comment-16064970
]
Bogdan Raducanu commented on SPARK-21228:
-
InSubquery.doCodeGen is using InSet di
[
https://issues.apache.org/jira/browse/SPARK-20226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16064972#comment-16064972
]
Barry Becker commented on SPARK-20226:
--
Calling cache() on the dataframe on the afte
[
https://issues.apache.org/jira/browse/SPARK-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065023#comment-16065023
]
Apache Spark commented on SPARK-18294:
--
User 'jiangxb1987' has created a pull reques
Wenchen Fan created SPARK-21229:
---
Summary: remove QueryPlan.preCanonicalized
Key: SPARK-21229
URL: https://issues.apache.org/jira/browse/SPARK-21229
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-21229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065118#comment-16065118
]
Apache Spark commented on SPARK-21229:
--
User 'cloud-fan' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-21229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21229:
Assignee: Apache Spark (was: Wenchen Fan)
> remove QueryPlan.preCanonicalized
> -
[
https://issues.apache.org/jira/browse/SPARK-21229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21229:
Assignee: Wenchen Fan (was: Apache Spark)
> remove QueryPlan.preCanonicalized
> -
[
https://issues.apache.org/jira/browse/SPARK-19104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-19104.
-
Resolution: Fixed
Fix Version/s: 2.2.0
Issue resolved by pull request 18418
[https://githu
[
https://issues.apache.org/jira/browse/SPARK-19104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-19104:
---
Assignee: Liang-Chi Hsieh
> CompileException with Map and Case Class in Spark 2.1.0
> -
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065142#comment-16065142
]
Michael Styles commented on SPARK-21218:
[~hyukjin.kwon] Not sure I understand wh
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065177#comment-16065177
]
Andrew Duffy commented on SPARK-21218:
--
Curious, I wonder what the previous benchmar
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065177#comment-16065177
]
Andrew Duffy edited comment on SPARK-21218 at 6/27/17 5:39 PM:
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065210#comment-16065210
]
Michael Styles commented on SPARK-21218:
In Parquet 1.7, there as a bug involving
[
https://issues.apache.org/jira/browse/SPARK-21215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065329#comment-16065329
]
Michael Kunkel commented on SPARK-21215:
The "resolution for this by [~sowen] was
Michael Kunkel created SPARK-21230:
--
Summary: Spark Encoder with mysql Enum and data truncated Error
Key: SPARK-21230
URL: https://issues.apache.org/jira/browse/SPARK-21230
Project: Spark
Is
[
https://issues.apache.org/jira/browse/SPARK-21215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065336#comment-16065336
]
Sean Owen commented on SPARK-21215:
---
I'm not sure what you're referring to. The user@ l
[
https://issues.apache.org/jira/browse/SPARK-21230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065338#comment-16065338
]
Sean Owen commented on SPARK-21230:
---
This does also not look like a useful JIRA. It loo
[
https://issues.apache.org/jira/browse/SPARK-21215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065345#comment-16065345
]
Michael Kunkel commented on SPARK-21215:
I looked at a few months worth of posts,
[
https://issues.apache.org/jira/browse/SPARK-21215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065354#comment-16065354
]
Michael Kunkel commented on SPARK-21215:
The posts go onto the list, but the owne
[
https://issues.apache.org/jira/browse/SPARK-21230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065347#comment-16065347
]
Michael Kunkel commented on SPARK-21230:
The problem is with the Spark Encoder of
[
https://issues.apache.org/jira/browse/SPARK-21215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065354#comment-16065354
]
Michael Kunkel edited comment on SPARK-21215 at 6/27/17 7:40 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-21215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065351#comment-16065351
]
Michael Kunkel commented on SPARK-21215:
[~sowen] I am not attempting to argue th
[
https://issues.apache.org/jira/browse/SPARK-21215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065348#comment-16065348
]
Sean Owen commented on SPARK-21215:
---
Not sure what you're looking at, but the mailing l
[
https://issues.apache.org/jira/browse/SPARK-21215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065351#comment-16065351
]
Michael Kunkel edited comment on SPARK-21215 at 6/27/17 7:37 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-17091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Styles reopened SPARK-17091:
> ParquetFilters rewrite IN to OR of Eq
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-17091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065413#comment-16065413
]
Michael Styles commented on SPARK-17091:
By not pushing the filter to Parquet, ar
[
https://issues.apache.org/jira/browse/SPARK-17091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Styles updated SPARK-17091:
---
Attachment: IN Predicate.png
OR Predicate.png
> ParquetFilters rewrite IN to
[
https://issues.apache.org/jira/browse/SPARK-17091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Styles updated SPARK-17091:
---
Summary: Convert IN predicate to equivalent Parquet filter (was:
ParquetFilters rewrite IN t
[
https://issues.apache.org/jira/browse/SPARK-17091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065413#comment-16065413
]
Michael Styles edited comment on SPARK-17091 at 6/27/17 8:26 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-21218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Styles resolved SPARK-21218.
Resolution: Duplicate
> Convert IN predicate to equivalent Parquet filter
> ---
[
https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065423#comment-16065423
]
Steve Loughran commented on SPARK-21137:
Looking at this.
something is trying to
[
https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065428#comment-16065428
]
Steve Loughran commented on SPARK-21137:
ps, for now, do it in parallel:
{{mapre
[
https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065445#comment-16065445
]
Steve Loughran commented on SPARK-21137:
Filed HADOOP-14600.
Looks like a v. old
[
https://issues.apache.org/jira/browse/SPARK-12868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065448#comment-16065448
]
Steve Loughran commented on SPARK-12868:
I think this is the case of HADOOP-14598
[
https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21137:
Assignee: Apache Spark
> Spark reads many small files slowly
> ---
[
https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065476#comment-16065476
]
Apache Spark commented on SPARK-21137:
--
User 'srowen' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065475#comment-16065475
]
Sean Owen commented on SPARK-21137:
---
OK, so it is something that could be optimized in
1 - 100 of 143 matches
Mail list logo
