----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26087/ -----------------------------------------------------------
Review request for drill. Bugs: DRILL-1414 https://issues.apache.org/jira/browse/DRILL-1414 Repository: drill-git Description ------- This is the first draft of the changes done for this feature. It implements the first approach described on the feature JIRA (https://issues.apache.org/jira/browse/DRILL-1414) Extend org.apache.drill.exec.store.sys.PStore interface to add two additional functions public V getBlob(String key); public void putBlob(String key, V value); Now these two methods can be used by the consumers to store large amount of data, that may not require frequent enumeration and not suitable for storage on systems like Zookeeper. A particular PStore implementation could choose to store the blob data differently than the primary value, for example, HBase PStore provider could store them in a different column family while Zookeeper PStore provider can store them on DFS (as this JIRA summary suggests). The Query Profile, then can be split into two part where small, meta info about the query is stored with a put() while the fragment profiles are stored using putBlob(). Diffs ----- contrib/storage-hbase/src/main/java/org/apache/drill/exec/store/hbase/config/HBasePStore.java 6324180 contrib/storage-hbase/src/main/java/org/apache/drill/exec/store/hbase/config/HBasePStoreProvider.java 48e6c42 exec/java-exec/src/main/java/org/apache/drill/exec/ExecConstants.java c210541 exec/java-exec/src/main/java/org/apache/drill/exec/server/rest/ProfileResources.java 9cbc2e7 exec/java-exec/src/main/java/org/apache/drill/exec/store/sys/PStore.java e6cca8c exec/java-exec/src/main/java/org/apache/drill/exec/store/sys/local/LocalPStore.java 35e4aea exec/java-exec/src/main/java/org/apache/drill/exec/store/sys/local/NoWriteLocalPStore.java 435bd0d exec/java-exec/src/main/java/org/apache/drill/exec/store/sys/zk/ZkPStore.java eb21c70 exec/java-exec/src/main/java/org/apache/drill/exec/store/sys/zk/ZkPStoreProvider.java f4513c2 exec/java-exec/src/main/java/org/apache/drill/exec/work/foreman/QueryStatus.java 45a151e exec/java-exec/src/main/resources/rest/profile/list.ftl 76f9a07 Diff: https://reviews.apache.org/r/26087/diff/ Testing ------- All existing unit tests pass. I'll add more tests for this change soon. Thanks, Aditya Kishore