Did not use any framewok. Just a phoenix connection with jdbc.
---------------------------------------------------------------- jinzhuan 原始邮件 发件人:Salou [email protected] 收件人:[email protected] 发送时间:2016年11月24日(周四) 21:53 主题:Re: huge query result miss some fields My rows are bigger than 1KB. I've tried to put limit in pig query, but it's not possible, trying to do with MR job. jinzhuan what is your framework to do the dump ? The problem doesn't exist with dump throw flink. Regards, 2016-11-24 14:19 GMT+01:00 金砖 [email protected]: thanks Ankit. PHOEINX-3112 is not my case. Each row is less than 1KB. ---------------------------------------------------------------- 金砖 挖财网络技术有限公司 地址：杭州市西湖区古翠路80号浙江科技产业大厦12楼 手机：15558015995 原始邮件 发件人:Ankit [email protected] 收件人:[email protected] 发送时间:2016年11月24日(周四) 20:52 主题:Re: huge query result miss some fields Do you have bigger rows? if yes , it may be similar to https://issues.apache.org/jira/browse/PHOENIX-3112 and increasinghbase.client.scanner.max.result.size can help. On Thu, Nov 24, 2016 at 6:00 PM, 金砖 [email protected] wrote: thanks Abel. I tried update statistics, it did not work. But after some retries, I found something interesting: I add 'limit 100000000' after my sql. Even actual size of result is the same(since there’s only 100000 rows in table), but the missing problem is solved. ---------------------------------------------------------------- 金砖 挖财网络技术有限公司 地址：杭州市西湖区古翠路80号浙江科技产业大厦12楼 手机：15558015995 原始邮件 发件人:Abel Ferná[email protected] 收件人:[email protected] 发送时间:2016年11月24日(周四) 20:14 主题:Re: huge query result miss some fields Hi Jinzhuan, Have you tried to update the statistics of your table? https://phoenix.apache.org/update_statistics.html On Thu, 24 Nov 2016 at 11:46 金砖 [email protected] wrote: hi, all: I’m using phoenix-4.8.0-hbase-1.1 with hbase 1.1.3. When query a lot of rows(ex: 100,000), some fileds of rows does not exists in result set. steps 1. I created a table test(pk varchar primary key, id bigint, name varchar, age bigint). 2. then populated with 100000 rows, with key prefix 'prefix', and rows will be 'prefix1' - 'prefix100000'. 3. then query with select * from test; occasionally some fields with be lost in rows, sometimes 2 rows missing id and age, some times 3 rows missing name. Can anyone be helpful? Is there some settings should be done ? ---------------------------------------------------------------- jinzhuan -- Un saludo - Best Regards. Abel
