[jira] [Updated] (HBASE-12338) Client side scanning prefetching.
[ https://issues.apache.org/jira/browse/HBASE-12338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HBASE-12338: -- Resolution: Won't Fix Status: Resolved (was: Patch Available) Resolving as won't fix for this particular direction (old issue gone stale). As [~chia7712] points out, similar functionality available in HBASE-13071. > Client side scanning prefetching. > - > > Key: HBASE-12338 > URL: https://issues.apache.org/jira/browse/HBASE-12338 > Project: HBase > Issue Type: Improvement > Components: Client >Affects Versions: 1.0.0, 2.0.0, 0.98.6.1 >Reporter: Yi Deng >Assignee: Yi Deng > Labels: prefetch, results, scanner > Attachments: > 0001-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch, > 0001-ScanPrefetcher.patch, > 2.0-0001-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch, > 2.0-0002-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch, > 2.0-0003-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch > > > Since server side prefetching was not proved to be a good way to prefetch, we > need to do it on client side. > This is a wrapper class that takes any instance of `ResultScanner` as the > underneath scanning component. The class will schedule the scanning in a > background thread. There is a buffering queue storing prefetched results, > whose's length is configurable. The prefetcher will release the thread if the > queue is full and wait for results to be consumed. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (HBASE-12338) Client side scanning prefetching.
[ https://issues.apache.org/jira/browse/HBASE-12338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark updated HBASE-12338: -- Issue Type: Improvement (was: Sub-task) Parent: (was: HBASE-12037) > Client side scanning prefetching. > - > > Key: HBASE-12338 > URL: https://issues.apache.org/jira/browse/HBASE-12338 > Project: HBase > Issue Type: Improvement > Components: Client >Affects Versions: 1.0.0, 2.0.0, 0.98.6.1 >Reporter: Yi Deng >Assignee: Yi Deng > Labels: prefetch, results, scanner > Attachments: > 0001-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch, > 0001-ScanPrefetcher.patch, > 2.0-0001-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch, > 2.0-0002-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch, > 2.0-0003-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch > > > Since server side prefetching was not proved to be a good way to prefetch, we > need to do it on client side. > This is a wrapper class that takes any instance of `ResultScanner` as the > underneath scanning component. The class will schedule the scanning in a > background thread. There is a buffering queue storing prefetched results, > whose's length is configurable. The prefetcher will release the thread if the > queue is full and wait for results to be consumed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12338) Client side scanning prefetching.
[ https://issues.apache.org/jira/browse/HBASE-12338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Deng updated HBASE-12338: Status: Patch Available (was: Open) > Client side scanning prefetching. > - > > Key: HBASE-12338 > URL: https://issues.apache.org/jira/browse/HBASE-12338 > Project: HBase > Issue Type: Sub-task > Components: Client >Affects Versions: 0.98.6.1, 1.0.0, 2.0.0 >Reporter: Yi Deng >Assignee: Yi Deng > Labels: prefetch, results, scanner > Attachments: > 0001-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch, > 0001-ScanPrefetcher.patch, > 2.0-0001-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch, > 2.0-0002-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch, > 2.0-0003-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch > > > Since server side prefetching was not proved to be a good way to prefetch, we > need to do it on client side. > This is a wrapper class that takes any instance of `ResultScanner` as the > underneath scanning component. The class will schedule the scanning in a > background thread. There is a buffering queue storing prefetched results, > whose's length is configurable. The prefetcher will release the thread if the > queue is full and wait for results to be consumed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12338) Client side scanning prefetching.
[ https://issues.apache.org/jira/browse/HBASE-12338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Deng updated HBASE-12338: Release Note: ScanPrefetcher wraps a ClientScanner and make fetching on background. Specially useful for cases with slow speed of consuming scanned data. > Client side scanning prefetching. > - > > Key: HBASE-12338 > URL: https://issues.apache.org/jira/browse/HBASE-12338 > Project: HBase > Issue Type: Sub-task > Components: Client >Affects Versions: 1.0.0, 2.0.0, 0.98.6.1 >Reporter: Yi Deng >Assignee: Yi Deng > Labels: prefetch, results, scanner > Attachments: > 0001-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch, > 0001-ScanPrefetcher.patch, > 2.0-0001-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch, > 2.0-0002-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch, > 2.0-0003-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch > > > Since server side prefetching was not proved to be a good way to prefetch, we > need to do it on client side. > This is a wrapper class that takes any instance of `ResultScanner` as the > underneath scanning component. The class will schedule the scanning in a > background thread. There is a buffering queue storing prefetched results, > whose's length is configurable. The prefetcher will release the thread if the > queue is full and wait for results to be consumed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12338) Client side scanning prefetching.
[ https://issues.apache.org/jira/browse/HBASE-12338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Deng updated HBASE-12338: Attachment: 2.0-0003-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch Remove usage of deprecated methods Optimize comments. > Client side scanning prefetching. > - > > Key: HBASE-12338 > URL: https://issues.apache.org/jira/browse/HBASE-12338 > Project: HBase > Issue Type: Sub-task > Components: Client >Affects Versions: 1.0.0, 2.0.0, 0.98.6.1 >Reporter: Yi Deng >Assignee: Yi Deng > Labels: prefetch, results, scanner > Attachments: > 0001-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch, > 0001-ScanPrefetcher.patch, > 2.0-0001-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch, > 2.0-0002-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch, > 2.0-0003-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch > > > Since server side prefetching was not proved to be a good way to prefetch, we > need to do it on client side. > This is a wrapper class that takes any instance of `ResultScanner` as the > underneath scanning component. The class will schedule the scanning in a > background thread. There is a buffering queue storing prefetched results, > whose's length is configurable. The prefetcher will release the thread if the > queue is full and wait for results to be consumed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12338) Client side scanning prefetching.
[ https://issues.apache.org/jira/browse/HBASE-12338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Deng updated HBASE-12338: Attachment: 2.0-0002-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch Revert the change on ScanPerformanceEvaulation > Client side scanning prefetching. > - > > Key: HBASE-12338 > URL: https://issues.apache.org/jira/browse/HBASE-12338 > Project: HBase > Issue Type: Sub-task > Components: Client >Affects Versions: 1.0.0, 2.0.0, 0.98.6.1 >Reporter: Yi Deng >Assignee: Yi Deng > Labels: prefetch, results, scanner > Attachments: > 0001-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch, > 0001-ScanPrefetcher.patch, > 2.0-0001-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch, > 2.0-0002-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch > > > Since server side prefetching was not proved to be a good way to prefetch, we > need to do it on client side. > This is a wrapper class that takes any instance of `ResultScanner` as the > underneath scanning component. The class will schedule the scanning in a > background thread. There is a buffering queue storing prefetched results, > whose's length is configurable. The prefetcher will release the thread if the > queue is full and wait for results to be consumed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12338) Client side scanning prefetching.
[ https://issues.apache.org/jira/browse/HBASE-12338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Deng updated HBASE-12338: Attachment: 2.0-0001-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch Fix some bug. Add `CopyPerformanceEvaluation` to test the performance difference. > Client side scanning prefetching. > - > > Key: HBASE-12338 > URL: https://issues.apache.org/jira/browse/HBASE-12338 > Project: HBase > Issue Type: Sub-task > Components: Client >Affects Versions: 1.0.0, 2.0.0, 0.98.6.1 >Reporter: Yi Deng >Assignee: Yi Deng > Labels: prefetch, results, scanner > Attachments: > 0001-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch, > 0001-ScanPrefetcher.patch, > 2.0-0001-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch > > > Since server side prefetching was not proved to be a good way to prefetch, we > need to do it on client side. > This is a wrapper class that takes any instance of `ResultScanner` as the > underneath scanning component. The class will schedule the scanning in a > background thread. There is a buffering queue storing prefetched results, > whose's length is configurable. The prefetcher will release the thread if the > queue is full and wait for results to be consumed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12338) Client side scanning prefetching.
[ https://issues.apache.org/jira/browse/HBASE-12338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Deng updated HBASE-12338: Attachment: 0001-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch Address [~tedyu] and [~stack]'s comments and some small refactoring. > Client side scanning prefetching. > - > > Key: HBASE-12338 > URL: https://issues.apache.org/jira/browse/HBASE-12338 > Project: HBase > Issue Type: Sub-task > Components: Client >Affects Versions: 1.0.0, 2.0.0, 0.98.6.1 >Reporter: Yi Deng >Assignee: Yi Deng > Labels: prefetch, results, scanner > Attachments: > 0001-Add-ScanPrefetcher-for-client-side-scanning-prefetch.patch, > 0001-ScanPrefetcher.patch > > > Since server side prefetching was not proved to be a good way to prefetch, we > need to do it on client side. > This is a wrapper class that takes any instance of `ResultScanner` as the > underneath scanning component. The class will schedule the scanning in a > background thread. There is a buffering queue storing prefetched results, > whose's length is configurable. The prefetcher will release the thread if the > queue is full and wait for results to be consumed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12338) Client side scanning prefetching.
[ https://issues.apache.org/jira/browse/HBASE-12338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Deng updated HBASE-12338: Attachment: 0001-ScanPrefetcher.patch > Client side scanning prefetching. > - > > Key: HBASE-12338 > URL: https://issues.apache.org/jira/browse/HBASE-12338 > Project: HBase > Issue Type: Sub-task > Components: Client >Affects Versions: 1.0.0, 2.0.0, 0.98.6.1 >Reporter: Yi Deng >Assignee: Yi Deng > Labels: prefetch, results, scanner > Attachments: 0001-ScanPrefetcher.patch > > > Since server side prefetching was not proved to be a good way to prefetch, we > need to do it on client side. > This is a wrapper class that takes any instance of `ResultScanner` as the > underneath scanning component. The class will schedule the scanning in a > background thread. There is a buffering queue storing prefetched results, > whose's length is configurable. The prefetcher will release the thread if the > queue is full and wait for results to be consumed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HBASE-12338) Client side scanning prefetching.
[ https://issues.apache.org/jira/browse/HBASE-12338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Deng updated HBASE-12338: Labels: prefetch results scanner (was: ) > Client side scanning prefetching. > - > > Key: HBASE-12338 > URL: https://issues.apache.org/jira/browse/HBASE-12338 > Project: HBase > Issue Type: Sub-task > Components: Client >Affects Versions: 1.0.0, 2.0.0, 0.98.6.1 >Reporter: Yi Deng >Assignee: Yi Deng > Labels: prefetch, results, scanner > > Since server side prefetching was not proved to be a good way to prefetch, we > need to do it on client side. > This is a wrapper class that takes any instance of `ResultScanner` as the > underneath scanning component. The class will schedule the scanning in a > background thread. There is a buffering queue storing prefetched results, > whose's length is configurable. The prefetcher will release the thread if the > queue is full and wait for results to be consumed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
