[jira] [Commented] (HADOOP-3518) Want NIO.2 (JSR 203) file system provider for Hadoop FileSystem
[ https://issues.apache.org/jira/browse/HADOOP-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260144#comment-15260144 ] Damien Carol commented on HADOOP-3518: -- No sure we are talking about the same thing. The goal of this JIRA (also what is implemented by https://github.com/damiencarol/jsr203-hadoop) is to make this works: Client ==(NIO/JSR203 interface)==> HDFS => Native FS What you are talking about is that: Client ==> HDFS ==(NIO)==> Native FS > Want NIO.2 (JSR 203) file system provider for Hadoop FileSystem > --- > > Key: HADOOP-3518 > URL: https://issues.apache.org/jira/browse/HADOOP-3518 > Project: Hadoop Common > Issue Type: Wish > Components: fs >Reporter: Tom White > > JSR 203 (aka "NIO.2" or "more NIO") is defining a rich set of classes for > interacting with files and file systems (as well as other NIO enhancements). > It is scheduled to be released as a part of Java 7. > This motivation behind this issue is to see if NIO.2 can be used as an > interface to Hadoop's FileSystem class before NIO.2 is finalized, thus giving > Hadoop developers an opportunity to influence NIO's design (if necessary). > Also, learning more about NIO.2 may inform design decisions for Hadoop > filesystems. > The starting point for this work should be the java.nio.file.spi package > (http://openjdk.java.net/projects/nio/javadoc/java/nio/file/spi/package-summary.html). > There is an example of a filesystem provider (for ZIP files) linked from the > OpenJDK page for NIO.2: http://openjdk.java.net/projects/nio/. This page also > has other useful links, such as a JavaOne talk, javadoc and source code. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-3518) Want NIO.2 (JSR 203) file system provider for Hadoop FileSystem
[ https://issues.apache.org/jira/browse/HADOOP-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259913#comment-15259913 ] Steve Loughran commented on HADOOP-3518: [~damiencarol] -hi, I hadn't seen this before, sorry if you felt ignored. # Moving to NIO can only be good as a drop in for RawLocalFileSystem; HADOOP-9590 proposed upgrading that, maybe having a RawNioFileSystem would be safer. # This would really help Windows. But that also means windows testing. Are you set up for that? If not, you'll need help # Testing really matters for filesystems. That's why we have both a filesystem specification and a large set of FS contract tests. These are all the foundational tests ... they verify the core API works, though they don't check things like concurrency, consistency, durability & failure handling ... > Want NIO.2 (JSR 203) file system provider for Hadoop FileSystem > --- > > Key: HADOOP-3518 > URL: https://issues.apache.org/jira/browse/HADOOP-3518 > Project: Hadoop Common > Issue Type: Wish > Components: fs >Reporter: Tom White > > JSR 203 (aka "NIO.2" or "more NIO") is defining a rich set of classes for > interacting with files and file systems (as well as other NIO enhancements). > It is scheduled to be released as a part of Java 7. > This motivation behind this issue is to see if NIO.2 can be used as an > interface to Hadoop's FileSystem class before NIO.2 is finalized, thus giving > Hadoop developers an opportunity to influence NIO's design (if necessary). > Also, learning more about NIO.2 may inform design decisions for Hadoop > filesystems. > The starting point for this work should be the java.nio.file.spi package > (http://openjdk.java.net/projects/nio/javadoc/java/nio/file/spi/package-summary.html). > There is an example of a filesystem provider (for ZIP files) linked from the > OpenJDK page for NIO.2: http://openjdk.java.net/projects/nio/. This page also > has other useful links, such as a JavaOne talk, javadoc and source code. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-3518) Want NIO.2 (JSR 203) file system provider for Hadoop FileSystem
[ https://issues.apache.org/jira/browse/HADOOP-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123343#comment-15123343 ] Damien Carol commented on HADOOP-3518: -- I'm making some progress with https://github.com/damiencarol/jsr203-hadoop. I hope I could push a patch for this JIRA in few months. Many work to do :/ > Want NIO.2 (JSR 203) file system provider for Hadoop FileSystem > --- > > Key: HADOOP-3518 > URL: https://issues.apache.org/jira/browse/HADOOP-3518 > Project: Hadoop Common > Issue Type: Wish > Components: fs >Reporter: Tom White > > JSR 203 (aka "NIO.2" or "more NIO") is defining a rich set of classes for > interacting with files and file systems (as well as other NIO enhancements). > It is scheduled to be released as a part of Java 7. > This motivation behind this issue is to see if NIO.2 can be used as an > interface to Hadoop's FileSystem class before NIO.2 is finalized, thus giving > Hadoop developers an opportunity to influence NIO's design (if necessary). > Also, learning more about NIO.2 may inform design decisions for Hadoop > filesystems. > The starting point for this work should be the java.nio.file.spi package > (http://openjdk.java.net/projects/nio/javadoc/java/nio/file/spi/package-summary.html). > There is an example of a filesystem provider (for ZIP files) linked from the > OpenJDK page for NIO.2: http://openjdk.java.net/projects/nio/. This page also > has other useful links, such as a JavaOne talk, javadoc and source code. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-3518) Want NIO.2 (JSR 203) file system provider for Hadoop FileSystem
[ https://issues.apache.org/jira/browse/HADOOP-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933580#comment-14933580 ] Olivier Girardot commented on HADOOP-3518: -- is there any way to make this go forward ? > Want NIO.2 (JSR 203) file system provider for Hadoop FileSystem > --- > > Key: HADOOP-3518 > URL: https://issues.apache.org/jira/browse/HADOOP-3518 > Project: Hadoop Common > Issue Type: Wish > Components: fs >Reporter: Tom White > > JSR 203 (aka "NIO.2" or "more NIO") is defining a rich set of classes for > interacting with files and file systems (as well as other NIO enhancements). > It is scheduled to be released as a part of Java 7. > This motivation behind this issue is to see if NIO.2 can be used as an > interface to Hadoop's FileSystem class before NIO.2 is finalized, thus giving > Hadoop developers an opportunity to influence NIO's design (if necessary). > Also, learning more about NIO.2 may inform design decisions for Hadoop > filesystems. > The starting point for this work should be the java.nio.file.spi package > (http://openjdk.java.net/projects/nio/javadoc/java/nio/file/spi/package-summary.html). > There is an example of a filesystem provider (for ZIP files) linked from the > OpenJDK page for NIO.2: http://openjdk.java.net/projects/nio/. This page also > has other useful links, such as a JavaOne talk, javadoc and source code. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-3518) Want NIO.2 (JSR 203) file system provider for Hadoop FileSystem
[ https://issues.apache.org/jira/browse/HADOOP-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14323049#comment-14323049 ] Florian Brunner commented on HADOOP-3518: - APIs which use java.io.File should be deprecated as java.io.File is considered legacy API: http://docs.oracle.com/javase/tutorial/essential/io/legacy.html > Want NIO.2 (JSR 203) file system provider for Hadoop FileSystem > --- > > Key: HADOOP-3518 > URL: https://issues.apache.org/jira/browse/HADOOP-3518 > Project: Hadoop Common > Issue Type: Wish > Components: fs >Reporter: Tom White > > JSR 203 (aka "NIO.2" or "more NIO") is defining a rich set of classes for > interacting with files and file systems (as well as other NIO enhancements). > It is scheduled to be released as a part of Java 7. > This motivation behind this issue is to see if NIO.2 can be used as an > interface to Hadoop's FileSystem class before NIO.2 is finalized, thus giving > Hadoop developers an opportunity to influence NIO's design (if necessary). > Also, learning more about NIO.2 may inform design decisions for Hadoop > filesystems. > The starting point for this work should be the java.nio.file.spi package > (http://openjdk.java.net/projects/nio/javadoc/java/nio/file/spi/package-summary.html). > There is an example of a filesystem provider (for ZIP files) linked from the > OpenJDK page for NIO.2: http://openjdk.java.net/projects/nio/. This page also > has other useful links, such as a JavaOne talk, javadoc and source code. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-3518) Want NIO.2 (JSR 203) file system provider for Hadoop FileSystem
[ https://issues.apache.org/jira/browse/HADOOP-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14202324#comment-14202324 ] Damien Carol commented on HADOOP-3518: -- I'm working on a small project in order to test how possible/hard this work is. https://github.com/damiencarol/jsr203-hadoop > Want NIO.2 (JSR 203) file system provider for Hadoop FileSystem > --- > > Key: HADOOP-3518 > URL: https://issues.apache.org/jira/browse/HADOOP-3518 > Project: Hadoop Common > Issue Type: Wish > Components: fs >Reporter: Tom White > > JSR 203 (aka "NIO.2" or "more NIO") is defining a rich set of classes for > interacting with files and file systems (as well as other NIO enhancements). > It is scheduled to be released as a part of Java 7. > This motivation behind this issue is to see if NIO.2 can be used as an > interface to Hadoop's FileSystem class before NIO.2 is finalized, thus giving > Hadoop developers an opportunity to influence NIO's design (if necessary). > Also, learning more about NIO.2 may inform design decisions for Hadoop > filesystems. > The starting point for this work should be the java.nio.file.spi package > (http://openjdk.java.net/projects/nio/javadoc/java/nio/file/spi/package-summary.html). > There is an example of a filesystem provider (for ZIP files) linked from the > OpenJDK page for NIO.2: http://openjdk.java.net/projects/nio/. This page also > has other useful links, such as a JavaOne talk, javadoc and source code. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HADOOP-3518) Want NIO.2 (JSR 203) file system provider for Hadoop FileSystem
[ https://issues.apache.org/jira/browse/HADOOP-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066396#comment-14066396 ] Tom White commented on HADOOP-3518: --- I think it is, and having [java.nio.file|http://docs.oracle.com/javase/7/docs/api/java/nio/file/package-summary.html] as an interface to Hadoop filesystems would be generally useful. > Want NIO.2 (JSR 203) file system provider for Hadoop FileSystem > --- > > Key: HADOOP-3518 > URL: https://issues.apache.org/jira/browse/HADOOP-3518 > Project: Hadoop Common > Issue Type: Wish > Components: fs >Reporter: Tom White > > JSR 203 (aka "NIO.2" or "more NIO") is defining a rich set of classes for > interacting with files and file systems (as well as other NIO enhancements). > It is scheduled to be released as a part of Java 7. > This motivation behind this issue is to see if NIO.2 can be used as an > interface to Hadoop's FileSystem class before NIO.2 is finalized, thus giving > Hadoop developers an opportunity to influence NIO's design (if necessary). > Also, learning more about NIO.2 may inform design decisions for Hadoop > filesystems. > The starting point for this work should be the java.nio.file.spi package > (http://openjdk.java.net/projects/nio/javadoc/java/nio/file/spi/package-summary.html). > There is an example of a filesystem provider (for ZIP files) linked from the > OpenJDK page for NIO.2: http://openjdk.java.net/projects/nio/. This page also > has other useful links, such as a JavaOne talk, javadoc and source code. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HADOOP-3518) Want NIO.2 (JSR 203) file system provider for Hadoop FileSystem
[ https://issues.apache.org/jira/browse/HADOOP-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066066#comment-14066066 ] Allen Wittenauer commented on HADOOP-3518: -- Is this still a viable request? > Want NIO.2 (JSR 203) file system provider for Hadoop FileSystem > --- > > Key: HADOOP-3518 > URL: https://issues.apache.org/jira/browse/HADOOP-3518 > Project: Hadoop Common > Issue Type: Wish > Components: fs >Reporter: Tom White > > JSR 203 (aka "NIO.2" or "more NIO") is defining a rich set of classes for > interacting with files and file systems (as well as other NIO enhancements). > It is scheduled to be released as a part of Java 7. > This motivation behind this issue is to see if NIO.2 can be used as an > interface to Hadoop's FileSystem class before NIO.2 is finalized, thus giving > Hadoop developers an opportunity to influence NIO's design (if necessary). > Also, learning more about NIO.2 may inform design decisions for Hadoop > filesystems. > The starting point for this work should be the java.nio.file.spi package > (http://openjdk.java.net/projects/nio/javadoc/java/nio/file/spi/package-summary.html). > There is an example of a filesystem provider (for ZIP files) linked from the > OpenJDK page for NIO.2: http://openjdk.java.net/projects/nio/. This page also > has other useful links, such as a JavaOne talk, javadoc and source code. -- This message was sent by Atlassian JIRA (v6.2#6252)
