[ https://issues.apache.org/jira/browse/PHOENIX-3112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16188908#comment-16188908 ]
Hadoop QA commented on PHOENIX-3112: ------------------------------------ {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12890023/PHOENIX-3112_wip2.patch against master branch at commit 3f28cc0ad609a6afd6a70a32aa598a5bb5e66dd8. ATTACHMENT ID: 12890023 {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:red}-1 lineLengths{color}. The patch introduces the following lines longer than 100: + long rowCount = IndexScrutiny.scrutinizeIndex(conn, dataTableFullName, indexTableFullName); + statement.setString(++index, randString(1, sourceOfRandomness)); // FEED_TYPE,\n" + statement.setString(++index, randString(15, sourceOfRandomness)); // NETWORK_ID,\n" + statement.setString(++index, randString(15, sourceOfRandomness)); // USER_ID,\n" + statement.setTimestamp(++index, new Timestamp(System.currentTimeMillis())); // CREATED_TIME,\n" + statement.setTimestamp(++index, new Timestamp(System.currentTimeMillis())); // LAST_UPDATE\n" + statement.setString(++index, randString(1, sourceOfRandomness)); // FEED_ITEM_TYPE\n" + statement.setString(++index, randString(1, sourceOfRandomness)); // FEED_ELEMENT_TYPE\n" + statement.setString(++index, randString(1, sourceOfRandomness)); // FEED_ELEMENT_STATUS\n" + statement.setString(++index, randString(1, sourceOfRandomness)); // FEED_ELEMENT_VISIBILITY\n" {color:red}-1 core tests{color}. The patch failed these unit tests: ./phoenix-core/target/failsafe-reports/TEST-org.apache.phoenix.end2end.ExplainPlanWithStatsEnabledIT ./phoenix-core/target/failsafe-reports/TEST-org.apache.phoenix.end2end.index.MutableIndexParallelWriteIT Test results: https://builds.apache.org/job/PreCommit-PHOENIX-Build/1505//testReport/ Console output: https://builds.apache.org/job/PreCommit-PHOENIX-Build/1505//console This message is automatically generated. > Partial row scan not handled correctly > -------------------------------------- > > Key: PHOENIX-3112 > URL: https://issues.apache.org/jira/browse/PHOENIX-3112 > Project: Phoenix > Issue Type: Bug > Affects Versions: 4.7.0 > Reporter: Pierre Lacave > Assignee: Sergey Soldatov > Priority: Blocker > Fix For: 4.12.0 > > Attachments: PHOENIX-3112-1.patch, PHOENIX-3112-ssa-v4.patch, > PHOENIX-3112_v3.patch, PHOENIX-3112_wip2.patch > > > When doing a select of a relatively large table (a few touthands rows) some > rows return partially missing. > When increasing the fitler to return those specific rows, the values appear > as expected > {noformat} > CREATE TABLE IF NOT EXISTS TEST ( > BUCKET VARCHAR, > TIMESTAMP_DATE TIMESTAMP, > TIMESTAMP UNSIGNED_LONG NOT NULL, > SRC VARCHAR, > DST VARCHAR, > ID VARCHAR, > ION VARCHAR, > IC BOOLEAN NOT NULL, > MI UNSIGNED_LONG, > AV UNSIGNED_LONG, > MA UNSIGNED_LONG, > CNT UNSIGNED_LONG, > DUMMY VARCHAR > CONSTRAINT pk PRIMARY KEY (BUCKET, TIMESTAMP DESC, SRC, DST, ID, ION, IC) > );{noformat} > using a python script to generate a CSV with 5000 rows > {noformat} > for i in xrange(5000): > print "5SEC,2016-07-21 > 07:25:35.{i},146908593500{i},WWWWWWWW,AAA,BBBB,CCCCCCCC,false,{i}1181000,1788000{i},2497001{i},{i},aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa{i}".format(i=i) > {noformat} > bulk inserting the csv in the table > {noformat} > phoenix/bin/psql.py localhost -t TEST large.csv > {noformat} > here we can see one row that contains no TIMESTAMP_DATE and null values in MI > and MA > {noformat} > 0: jdbc:phoenix:localhost:2181> select * from TEST > .... > +---------+--------------------------+-------------------+-----------+------+-------+-----------+--------+--------------+--------------+--------------+-------+----------------------------------------------------------------------------+ > | BUCKET | TIMESTAMP_DATE | TIMESTAMP | SRC | DST | > ID | ION | IC | MI | AV | MA | > CNT | DUMMY > | > +---------+--------------------------+-------------------+-----------+------+-------+-----------+--------+--------------+--------------+--------------+-------+----------------------------------------------------------------------------+ > | 5SEC | 2016-07-21 07:25:35.100 | 1469085935001000 | WWWWWWWW | AAA | > BBBB | CCCCCCCC | false | 10001181000 | 17880001000 | 24970011000 | > 1000 | > aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa1000 | > | 5SEC | 2016-07-21 07:25:35.999 | 146908593500999 | WWWWWWWW | AAA | > BBBB | CCCCCCCC | false | 9991181000 | 1788000999 | 2497001999 | 999 > | aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa999 > | > | 5SEC | 2016-07-21 07:25:35.998 | 146908593500998 | WWWWWWWW | AAA | > BBBB | CCCCCCCC | false | 9981181000 | 1788000998 | 2497001998 | 998 > | aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa998 > | > | 5SEC | | 146908593500997 | WWWWWWWW | AAA | > BBBB | CCCCCCCC | false | null | 1788000997 | null | 997 > | > | > | 5SEC | 2016-07-21 07:25:35.996 | 146908593500996 | WWWWWWWW | AAA | > BBBB | CCCCCCCC | false | 9961181000 | 1788000996 | 2497001996 | 996 > | aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa996 > | > | 5SEC | 2016-07-21 07:25:35.995 | 146908593500995 | WWWWWWWW | AAA | > BBBB | CCCCCCCC | false | 9951181000 | 1788000995 | 2497001995 | 995 > | aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa995 > | > | 5SEC | 2016-07-21 07:25:35.994 | 146908593500994 | WWWWWWWW | AAA | > BBBB | CCCCCCCC | false | 9941181000 | 1788000994 | 2497001994 | 994 > | aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa994 > | > .... > {noformat} > but when selecting that row specifically the values are correct > {noformat} > 0: jdbc:phoenix:localhost:2181> select * from TEST where timestamp = > 146908593500997; > +---------+--------------------------+------------------+-----------+------+-------+-----------+--------+-------------+-------------+-------------+------+---------------------------------------------------------------------------+ > | BUCKET | TIMESTAMP_DATE | TIMESTAMP | SRC | DST | > ID | ION | IC | MI | AV | MA | CNT | > DUMMY | > +---------+--------------------------+------------------+-----------+------+-------+-----------+--------+-------------+-------------+-------------+------+---------------------------------------------------------------------------+ > | 5SEC | 2016-07-21 07:25:35.997 | 146908593500997 | WWWWWWWW | AAA | > BBBB | CCCCCCCC | false | 9971181000 | 1788000997 | 2497001997 | 997 | > aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa997 | > +---------+--------------------------+------------------+-----------+------+-------+-----------+--------+-------------+-------------+-------------+------+---------------------------------------------------------------------------+ > 1 row selected (0.159 seconds){noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029)