Matthias Boehm created SYSTEMML-1697:
----------------------------------------

             Summary: Reading multi-part files object stores w/o existing 
directory
                 Key: SYSTEMML-1697
                 URL: https://issues.apache.org/jira/browse/SYSTEMML-1697
             Project: SystemML
          Issue Type: Task
            Reporter: Matthias Boehm


Assume a multi-part binary matrix written to an object store. As the object 
store only emulates a directory structure, the parent directory does not exist. 
Accordingly, our binary block matrix readers (which directly read from sequence 
files instead of record readers) fail because the check for {{isDirectory}} 
returns false. In order to fix this, we would need to be aware of this issues 
and handle it when ran against object store file schemes. Similarly, 
{{listStatus}} also returns the meta data file which has the same prefix as the 
created "directory" and needs to be filtered out.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to