[
https://issues.apache.org/jira/browse/SPARK-12843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maciej Bryński updated SPARK-12843:
-----------------------------------
Description:
SQL Query:
{code}
select * from table limit 100
{code}
force Spark to scan all partition even when data are available on the beginning
of scan.
This behaviour should be avoided and scan should stop when enough data is
collected.
Is it related to: [SPARK-9850] ?
was:
SQL Query:
{code}
select * from table limit 100
{code}
force Spark to scan all partition even when data are available on the beginning
of scan.
Is it related to: [SPARK-9850] ?
> Spark should avoid scanning all partitions when limit is set
> ------------------------------------------------------------
>
> Key: SPARK-12843
> URL: https://issues.apache.org/jira/browse/SPARK-12843
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 1.6.0
> Reporter: Maciej Bryński
>
> SQL Query:
> {code}
> select * from table limit 100
> {code}
> force Spark to scan all partition even when data are available on the
> beginning of scan.
> This behaviour should be avoided and scan should stop when enough data is
> collected.
> Is it related to: [SPARK-9850] ?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
