Thomas Hille created HDFS-10327: ----------------------------------- Summary: Open files in WEBHDFS which are stored in folders by Spark Key: HDFS-10327 URL: https://issues.apache.org/jira/browse/HDFS-10327 Project: Hadoop HDFS Issue Type: Bug Components: webhdfs Reporter: Thomas Hille
When Spark saves a file in HDFS it creates a directory which includes many parts of the file. When you read it with spark programmatically, you can read this directory as it is a normal file. If you try to read this directory-style file in webhdfs, it returns {"exception":"FileNotFoundException","javaClassName":"java.io.FileNotFoundException","message":"Path is not a file: [...] -- This message was sent by Atlassian JIRA (v6.3.4#6332)