[ https://issues.apache.org/jira/browse/NIFI-3268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
qfdk updated NIFI-3268: ----------------------- Description: I added AUTO_INCREMENT column in GenerateTableFetch to benefit index column By default this processor uses OFFSET, i have problems with large data. somme column has index so we could use index to speed up query time. I posted question here : https://community.hortonworks.com/questions/72586/how-can-i-use-an-array-with-putelasticsearch.html If you indexed un column (id), you could use this sql ``` select xxx >From xxxxx where 200000=>id order by id limit 200000 ``` “OFFSET is bad for skipping previous rows.” [Online]. Available: http://Use-The-Index-Luke.com/sql/partial-results/fetch-next-page. [Accessed: 27-Dec-2016]. Thank you in advance was: I added AUTO_INCREMENT column in GenerateTableFetch to benefit index column By default this processor uses OFFSET, i have problems with large data. somme column has index so we could use index to speed up query time. I posted question here : https://community.hortonworks.com/questions/72586/how-can-i-use-an-array-with-putelasticsearch.html “OFFSET is bad for skipping previous rows.” [Online]. Available: http://Use-The-Index-Luke.com/sql/partial-results/fetch-next-page. [Accessed: 27-Dec-2016]. Thank you in advance > Add AUTO_INCREMENT column in GenerateTableFetch to benefit index > ---------------------------------------------------------------- > > Key: NIFI-3268 > URL: https://issues.apache.org/jira/browse/NIFI-3268 > Project: Apache NiFi > Issue Type: Improvement > Components: Core Framework > Affects Versions: 1.1.1 > Environment: - ubuntu 16.04 > - java version "1.8.0_111" > - Java(TM) SE Runtime Environment (build 1.8.0_111-b14) > - Java HotSpot(TM) 64-Bit Server VM (build 25.111-b14, mixed mode) > Reporter: qfdk > Labels: easyfix > Fix For: 1.2.0 > > > I added AUTO_INCREMENT column in GenerateTableFetch to benefit index column > By default this processor uses OFFSET, i have problems with large data. > somme column has index so we could use index to speed up query time. > I posted question here : > https://community.hortonworks.com/questions/72586/how-can-i-use-an-array-with-putelasticsearch.html > If you indexed un column (id), you could use this sql > ``` > select xxx > From xxxxx > where 200000=>id > order by id > limit 200000 > ``` > “OFFSET is bad for skipping previous rows.” [Online]. Available: > http://Use-The-Index-Luke.com/sql/partial-results/fetch-next-page. [Accessed: > 27-Dec-2016]. > Thank you in advance -- This message was sent by Atlassian JIRA (v6.3.4#6332)