Hello Spark fans, I would like to inform you about our tool we want to share in big data community. I think it can be also handy for Spark users.
We created a new utility - HDFS Shell to work with HDFS data more easily. https://github.com/avast/hdfs-shell *Feature highlights* - HDFS DFS command initiates JVM for each command call, HDFS Shell does it only once - which means great speed enhancement when you need to work with HDFS more often - Commands can be used in a short way - eg. *hdfs dfs -ls /*, *ls /* - both will work - *HDFS path completion using TAB key* - you can easily add any other HDFS manipulation function - there is a command history persisting in history log (~/.hdfs-shell/hdfs-shell.log) - support for relative directory + commands *cd* and *pwd* - it can be also launched as a daemon (using UNIX domain sockets) - 100% Java, it's open source Your suggestions are welcome. -L. Vitasek aka Vity