[
https://issues.apache.org/jira/browse/PHOENIX-1779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500548#comment-14500548
]
Hudson commented on PHOENIX-1779:
---------------------------------
SUCCESS: Integrated in Phoenix-master #690 (See
[https://builds.apache.org/job/Phoenix-master/690/])
PHOENIX-1779 Parallelize fetching of next batch of records for scans
corresponding to queries with no order by (samarth.jain: rev
8b1d7d9bc4e35630259c60d66bc7476f96273642)
* phoenix-core/src/main/java/org/apache/phoenix/execute/BaseQueryPlan.java
* phoenix-core/src/test/java/org/apache/phoenix/query/QueryServicesTestImpl.java
*
phoenix-core/src/it/java/org/apache/phoenix/iterate/RoundRobinResultIteratorIT.java
* phoenix-core/src/main/java/org/apache/phoenix/compile/TraceQueryPlan.java
*
phoenix-core/src/test/java/org/apache/phoenix/filter/SkipScanBigFilterTest.java
* phoenix-core/src/main/java/org/apache/phoenix/execute/UnionPlan.java
* phoenix-core/src/main/java/org/apache/phoenix/execute/SortMergeJoinPlan.java
* phoenix-core/src/test/java/org/apache/phoenix/compile/QueryCompilerTest.java
*
phoenix-core/src/test/java/org/apache/phoenix/query/ParallelIteratorsSplitTest.java
* phoenix-core/src/main/java/org/apache/phoenix/util/ScanUtil.java
* phoenix-core/src/main/java/org/apache/phoenix/compile/QueryPlan.java
*
phoenix-core/src/main/java/org/apache/phoenix/mapreduce/PhoenixRecordReader.java
*
phoenix-core/src/it/java/org/apache/phoenix/end2end/SkipScanAfterManualSplitIT.java
* phoenix-core/src/it/java/org/apache/phoenix/mapreduce/IndexToolIT.java
* phoenix-core/src/main/java/org/apache/phoenix/execute/DelegateQueryPlan.java
* phoenix-core/src/main/java/org/apache/phoenix/query/QueryServicesOptions.java
* phoenix-core/src/main/java/org/apache/phoenix/jdbc/PhoenixStatement.java
*
phoenix-core/src/main/java/org/apache/phoenix/iterate/RoundRobinResultIterator.java
* phoenix-core/src/main/java/org/apache/phoenix/jdbc/PhoenixResultSet.java
* phoenix-core/src/main/java/org/apache/phoenix/execute/ScanPlan.java
* phoenix-core/src/main/java/org/apache/phoenix/schema/MetaDataClient.java
* phoenix-core/src/main/java/org/apache/phoenix/query/QueryServices.java
* phoenix-core/src/main/java/org/apache/phoenix/execute/AggregatePlan.java
* phoenix-core/src/main/java/org/apache/phoenix/execute/DegenerateQueryPlan.java
> Parallelize fetching of next batch of records for scans corresponding to
> queries with no order by
> --------------------------------------------------------------------------------------------------
>
> Key: PHOENIX-1779
> URL: https://issues.apache.org/jira/browse/PHOENIX-1779
> Project: Phoenix
> Issue Type: Improvement
> Reporter: Samarth Jain
> Assignee: Samarth Jain
> Fix For: 5.0.0, 4.4.0
>
> Attachments: PHOENIX-1779.patch, PHOENIX-1779_v2.patch,
> PHOENIX-1779_v3.patch, wip.patch, wip3.patch, wipwithsplits.patch
>
>
> Today in Phoenix we parallelize the first execution of scans i.e. we load
> only the first batch of records up to the scan's cache size in parallel.
> Loading of subsequent batches of records in scanners is essentially serial.
> This could be improved especially for queries, including the ones with no
> order by clauses, that do not need any kind of merge sort on the client.
> This could also potentially improve the performance of UPSERT SELECT
> statements that load data from one table and insert into another. One such
> use case being creating immutable indexes for tables that already have data.
> It could also potentially improve the performance of our MapReduce solution
> for bulk loading data by improving the speed of the loading/mapping phase.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
