[
https://issues.apache.org/jira/browse/ASTERIXDB-1056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15265765#comment-15265765
]
Wail Alkowaileet commented on ASTERIXDB-1056:
---------------------------------------------
I did a "hack" on the HDFS adapter to test it. It seems to be working just fine
and reduced the time of ingesting a single file by half.
{noformat}
File: 8 GB csv file
compiler.sortmemory = 327680 // Test configuration
localfs
Duration of all jobs: 1804.747 sec
hdfs (fs.local.LocalFs)
Duration of all jobs: 907.609 sec
{noformat}
> Loading (parsing) ADMs from LocalFS is single-threaded per NC
> -------------------------------------------------------------
>
> Key: ASTERIXDB-1056
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1056
> Project: Apache AsterixDB
> Issue Type: Improvement
> Components: Adapters, AsterixDB, Operators
> Reporter: asterixdb-importer
> Assignee: Yingyi Bu
> Priority: Minor
>
> Loading (parsing) ADMs from LocalFS is single-threaded per NC
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
