[
https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146294#comment-15146294
]
James Taylor commented on PHOENIX-1973:
---------------------------------------
When applying the patch locally, I'm seeing failures in CsvBulkLoadToolIT.
There may be other failures - haven't run the full test suite.
{code}
Running org.apache.phoenix.end2end.CsvBulkLoadToolIT
Tests run: 9, Failures: 3, Errors: 0, Skipped: 0, Time elapsed: 493.902 sec <<<
FAILURE! - in org.apache.phoenix.end2end.CsvBulkLoadToolIT
testImportWithLocalIndex(org.apache.phoenix.end2end.CsvBulkLoadToolIT) Time
elapsed: 62.896 sec <<< FAILURE!
java.lang.AssertionError: expected:<0> but was:<-1>
at
org.apache.phoenix.end2end.CsvBulkLoadToolIT.testImportWithLocalIndex(CsvBulkLoadToolIT.java:241)
testImportOneLocalIndexTable(org.apache.phoenix.end2end.CsvBulkLoadToolIT)
Time elapsed: 56.956 sec <<< FAILURE!
java.lang.AssertionError: expected:<0> but was:<-1>
at
org.apache.phoenix.end2end.CsvBulkLoadToolIT.testImportOneIndexTable(CsvBulkLoadToolIT.java:287)
at
org.apache.phoenix.end2end.CsvBulkLoadToolIT.testImportOneLocalIndexTable(CsvBulkLoadToolIT.java:259)
testImportOneIndexTable(org.apache.phoenix.end2end.CsvBulkLoadToolIT) Time
elapsed: 58.349 sec <<< FAILURE!
java.lang.AssertionError: expected:<0> but was:<-1>
at
org.apache.phoenix.end2end.CsvBulkLoadToolIT.testImportOneIndexTable(CsvBulkLoadToolIT.java:287)
at
org.apache.phoenix.end2end.CsvBulkLoadToolIT.testImportOneIndexTable(CsvBulkLoadToolIT.java:254)
Results :
Failed tests:
CsvBulkLoadToolIT.testImportOneIndexTable:254->testImportOneIndexTable:287
expected:<0> but was:<-1>
CsvBulkLoadToolIT.testImportOneLocalIndexTable:259->testImportOneIndexTable:287
expected:<0> but was:<-1>
CsvBulkLoadToolIT.testImportWithLocalIndex:241 expected:<0> but was:<-1>
{code}
> Improve CsvBulkLoadTool performance by moving keyvalue construction from map
> phase to reduce phase
> --------------------------------------------------------------------------------------------------
>
> Key: PHOENIX-1973
> URL: https://issues.apache.org/jira/browse/PHOENIX-1973
> Project: Phoenix
> Issue Type: Improvement
> Reporter: Rajeshbabu Chintaguntla
> Assignee: Sergey Soldatov
> Fix For: 4.7.0
>
> Attachments: PHOENIX-1973-1.patch, PHOENIX-1973-2.patch,
> PHOENIX-1973-3.patch, PHOENIX-1973-4.patch, PHOENIX-1973-5.patch
>
>
> It's similar to HBASE-8768. Only thing is we need to write custom mapper and
> reducer in Phoenix. In Map phase we just need to get row key from primary key
> columns and write the full text of a line as usual(to ensure sorting). In
> reducer we need to get actual key values by running upsert query.
> It's basically reduces lot of map output to write to disk and data need to be
> transferred through network.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
