Author: lmccay Date: Fri Feb 24 17:48:38 2017 New Revision: 1784308 URL: http://svn.apache.org/viewvc?rev=1784308&view=rev Log: KNOX-891 docs for submitSqoop (kevin risden via lmccay)
Modified: knox/site/books/knox-0-10-0/deployment-overview.png knox/site/books/knox-0-10-0/deployment-provider.png knox/site/books/knox-0-10-0/deployment-service.png knox/site/books/knox-0-10-0/general_saml_flow.png knox/site/books/knox-0-10-0/runtime-overview.png knox/site/books/knox-0-10-0/runtime-request-processing.png knox/site/books/knox-0-10-0/user-guide.html knox/site/books/knox-0-11-0/deployment-overview.png knox/site/books/knox-0-11-0/deployment-provider.png knox/site/books/knox-0-11-0/deployment-service.png knox/site/books/knox-0-11-0/general_saml_flow.png knox/site/books/knox-0-11-0/runtime-overview.png knox/site/books/knox-0-11-0/runtime-request-processing.png knox/site/books/knox-0-11-0/user-guide.html knox/site/books/knox-0-12-0/deployment-overview.png knox/site/books/knox-0-12-0/deployment-provider.png knox/site/books/knox-0-12-0/deployment-service.png knox/site/books/knox-0-12-0/general_saml_flow.png knox/site/books/knox-0-12-0/runtime-overview.png knox/site/books/knox-0-12-0/runtime-request-processing.png knox/site/books/knox-0-12-0/user-guide.html knox/site/books/knox-0-4-0/deployment-overview.png knox/site/books/knox-0-4-0/deployment-provider.png knox/site/books/knox-0-4-0/deployment-service.png knox/site/books/knox-0-4-0/runtime-overview.png knox/site/books/knox-0-4-0/runtime-request-processing.png knox/site/books/knox-0-5-0/deployment-overview.png knox/site/books/knox-0-5-0/deployment-provider.png knox/site/books/knox-0-5-0/deployment-service.png knox/site/books/knox-0-5-0/runtime-overview.png knox/site/books/knox-0-5-0/runtime-request-processing.png knox/site/books/knox-0-6-0/deployment-overview.png knox/site/books/knox-0-6-0/deployment-provider.png knox/site/books/knox-0-6-0/deployment-service.png knox/site/books/knox-0-6-0/runtime-overview.png knox/site/books/knox-0-6-0/runtime-request-processing.png knox/site/books/knox-0-7-0/deployment-overview.png knox/site/books/knox-0-7-0/deployment-provider.png knox/site/books/knox-0-7-0/deployment-service.png knox/site/books/knox-0-7-0/general_saml_flow.png knox/site/books/knox-0-7-0/runtime-overview.png knox/site/books/knox-0-7-0/runtime-request-processing.png knox/site/books/knox-0-8-0/deployment-overview.png knox/site/books/knox-0-8-0/deployment-provider.png knox/site/books/knox-0-8-0/deployment-service.png knox/site/books/knox-0-8-0/general_saml_flow.png knox/site/books/knox-0-8-0/runtime-overview.png knox/site/books/knox-0-8-0/runtime-request-processing.png knox/site/books/knox-0-9-0/deployment-overview.png knox/site/books/knox-0-9-0/deployment-provider.png knox/site/books/knox-0-9-0/deployment-service.png knox/site/books/knox-0-9-0/general_saml_flow.png knox/site/books/knox-0-9-0/runtime-overview.png knox/site/books/knox-0-9-0/runtime-request-processing.png knox/site/books/knox-0-9-1/deployment-overview.png knox/site/books/knox-0-9-1/deployment-provider.png knox/site/books/knox-0-9-1/deployment-service.png knox/site/books/knox-0-9-1/general_saml_flow.png knox/site/books/knox-0-9-1/runtime-overview.png knox/site/books/knox-0-9-1/runtime-request-processing.png knox/site/index.html knox/site/issue-tracking.html knox/site/license.html knox/site/mail-lists.html knox/site/project-info.html knox/site/team-list.html knox/trunk/books/0.10.0/book_client-details.md knox/trunk/books/0.11.0/book_client-details.md knox/trunk/books/0.12.0/book_client-details.md Modified: knox/site/books/knox-0-10-0/deployment-overview.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-10-0/deployment-overview.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-10-0/deployment-provider.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-10-0/deployment-provider.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-10-0/deployment-service.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-10-0/deployment-service.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-10-0/general_saml_flow.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-10-0/general_saml_flow.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-10-0/runtime-overview.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-10-0/runtime-overview.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-10-0/runtime-request-processing.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-10-0/runtime-request-processing.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-10-0/user-guide.html URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-10-0/user-guide.html?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== --- knox/site/books/knox-0-10-0/user-guide.html (original) +++ knox/site/books/knox-0-10-0/user-guide.html Fri Feb 24 17:48:38 2017 @@ -2904,7 +2904,19 @@ json = (new JsonSlurper()).parseText( te println json.FileStatuses.FileStatus.pathSuffix session.shutdown() exit -</code></pre><p>Notice the <code>Hdfs.rm</code> command. This is included simply to ensure that the script can be rerun. Without this an error would result the second time it is run.</p><h3><a id="Futures">Futures</a> <a href="#Futures"><img src="markbook-section-link.png"/></a></h3><p>The DSL supports the ability to invoke commands asynchronously via the later() invocation method. The object returned from the later() method is a java.util.concurrent.Future parameterized with the response type of the command. This is an example of how to asynchronously put a file to HDFS.</p> +</code></pre><p>Notice the <code>Hdfs.rm</code> command. This is included simply to ensure that the script can be rerun. Without this an error would result the second time it is run.</p><h4><a id="submitSqoop+Job+API">submitSqoop Job API</a> <a href="#submitSqoop+Job+API"><img src="markbook-section-link.png"/></a></h4><p>Using the Knox DSL, you can now easily submit and monitor <a href="https://sqoop.apache.org">Apache Sqoop</a> jobs. The WebHCat Job class now supports the <code>submitSqoop</code> command.</p> +<pre><code>Job.submitSqoop(session) + .command("import --connect jdbc:mysql://hostname:3306/dbname ... ") + .statusDir(remoteStatusDir) + .now().jobId +</code></pre><p>The <code>submitSqoop</code> command supports the following arguments:</p> +<ul> + <li>command (String) - The sqoop command string to execute.</li> + <li>files (String) - Comma separated files to be copied to the templeton controller job.</li> + <li>optionsfile (String) - The remote file which contain Sqoop command need to run.</li> + <li>libdir (String) - The remote directory containing jdbc jar to include with sqoop lib</li> + <li>statusDir (String) - The remote directory to store status output.</li> +</ul><p>A complete example is available here: <a href="https://cwiki.apache.org/confluence/display/KNOX/2016/11/08/Running+SQOOP+job+via+KNOX+Shell+DSL">https://cwiki.apache.org/confluence/display/KNOX/2016/11/08/Running+SQOOP+job+via+KNOX+Shell+DSL</a></p><h3><a id="Futures">Futures</a> <a href="#Futures"><img src="markbook-section-link.png"/></a></h3><p>The DSL supports the ability to invoke commands asynchronously via the later() invocation method. The object returned from the later() method is a java.util.concurrent.Future parameterized with the response type of the command. This is an example of how to asynchronously put a file to HDFS.</p> <pre><code>future = Hdfs.put(session).file("README").to("/tmp/example/README").later() println future.get().statusCode </code></pre><p>The future.get() method will block until the asynchronous command is complete. To illustrate the usefulness of this however multiple concurrent commands are required.</p> Modified: knox/site/books/knox-0-11-0/deployment-overview.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-11-0/deployment-overview.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-11-0/deployment-provider.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-11-0/deployment-provider.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-11-0/deployment-service.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-11-0/deployment-service.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-11-0/general_saml_flow.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-11-0/general_saml_flow.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-11-0/runtime-overview.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-11-0/runtime-overview.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-11-0/runtime-request-processing.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-11-0/runtime-request-processing.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-11-0/user-guide.html URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-11-0/user-guide.html?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== --- knox/site/books/knox-0-11-0/user-guide.html (original) +++ knox/site/books/knox-0-11-0/user-guide.html Fri Feb 24 17:48:38 2017 @@ -2996,7 +2996,19 @@ json = (new JsonSlurper()).parseText( te println json.FileStatuses.FileStatus.pathSuffix session.shutdown() exit -</code></pre><p>Notice the <code>Hdfs.rm</code> command. This is included simply to ensure that the script can be rerun. Without this an error would result the second time it is run.</p><h3><a id="Futures">Futures</a> <a href="#Futures"><img src="markbook-section-link.png"/></a></h3><p>The DSL supports the ability to invoke commands asynchronously via the later() invocation method. The object returned from the later() method is a java.util.concurrent.Future parameterized with the response type of the command. This is an example of how to asynchronously put a file to HDFS.</p> +</code></pre><p>Notice the <code>Hdfs.rm</code> command. This is included simply to ensure that the script can be rerun. Without this an error would result the second time it is run.</p><h4><a id="submitSqoop+Job+API">submitSqoop Job API</a> <a href="#submitSqoop+Job+API"><img src="markbook-section-link.png"/></a></h4><p>Using the Knox DSL, you can now easily submit and monitor <a href="https://sqoop.apache.org">Apache Sqoop</a> jobs. The WebHCat Job class now supports the <code>submitSqoop</code> command.</p> +<pre><code>Job.submitSqoop(session) + .command("import --connect jdbc:mysql://hostname:3306/dbname ... ") + .statusDir(remoteStatusDir) + .now().jobId +</code></pre><p>The <code>submitSqoop</code> command supports the following arguments:</p> +<ul> + <li>command (String) - The sqoop command string to execute.</li> + <li>files (String) - Comma separated files to be copied to the templeton controller job.</li> + <li>optionsfile (String) - The remote file which contain Sqoop command need to run.</li> + <li>libdir (String) - The remote directory containing jdbc jar to include with sqoop lib</li> + <li>statusDir (String) - The remote directory to store status output.</li> +</ul><p>A complete example is available here: <a href="https://cwiki.apache.org/confluence/display/KNOX/2016/11/08/Running+SQOOP+job+via+KNOX+Shell+DSL">https://cwiki.apache.org/confluence/display/KNOX/2016/11/08/Running+SQOOP+job+via+KNOX+Shell+DSL</a></p><h3><a id="Futures">Futures</a> <a href="#Futures"><img src="markbook-section-link.png"/></a></h3><p>The DSL supports the ability to invoke commands asynchronously via the later() invocation method. The object returned from the later() method is a java.util.concurrent.Future parameterized with the response type of the command. This is an example of how to asynchronously put a file to HDFS.</p> <pre><code>future = Hdfs.put(session).file("README").to("/tmp/example/README").later() println future.get().statusCode </code></pre><p>The future.get() method will block until the asynchronous command is complete. To illustrate the usefulness of this however multiple concurrent commands are required.</p> Modified: knox/site/books/knox-0-12-0/deployment-overview.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-12-0/deployment-overview.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-12-0/deployment-provider.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-12-0/deployment-provider.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-12-0/deployment-service.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-12-0/deployment-service.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-12-0/general_saml_flow.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-12-0/general_saml_flow.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-12-0/runtime-overview.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-12-0/runtime-overview.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-12-0/runtime-request-processing.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-12-0/runtime-request-processing.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-12-0/user-guide.html URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-12-0/user-guide.html?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== --- knox/site/books/knox-0-12-0/user-guide.html (original) +++ knox/site/books/knox-0-12-0/user-guide.html Fri Feb 24 17:48:38 2017 @@ -2996,7 +2996,19 @@ json = (new JsonSlurper()).parseText( te println json.FileStatuses.FileStatus.pathSuffix session.shutdown() exit -</code></pre><p>Notice the <code>Hdfs.rm</code> command. This is included simply to ensure that the script can be rerun. Without this an error would result the second time it is run.</p><h3><a id="Futures">Futures</a> <a href="#Futures"><img src="markbook-section-link.png"/></a></h3><p>The DSL supports the ability to invoke commands asynchronously via the later() invocation method. The object returned from the later() method is a java.util.concurrent.Future parameterized with the response type of the command. This is an example of how to asynchronously put a file to HDFS.</p> +</code></pre><p>Notice the <code>Hdfs.rm</code> command. This is included simply to ensure that the script can be rerun. Without this an error would result the second time it is run.</p><h4><a id="submitSqoop+Job+API">submitSqoop Job API</a> <a href="#submitSqoop+Job+API"><img src="markbook-section-link.png"/></a></h4><p>Using the Knox DSL, you can now easily submit and monitor <a href="https://sqoop.apache.org">Apache Sqoop</a> jobs. The WebHCat Job class now supports the <code>submitSqoop</code> command.</p> +<pre><code>Job.submitSqoop(session) + .command("import --connect jdbc:mysql://hostname:3306/dbname ... ") + .statusDir(remoteStatusDir) + .now().jobId +</code></pre><p>The <code>submitSqoop</code> command supports the following arguments:</p> +<ul> + <li>command (String) - The sqoop command string to execute.</li> + <li>files (String) - Comma separated files to be copied to the templeton controller job.</li> + <li>optionsfile (String) - The remote file which contain Sqoop command need to run.</li> + <li>libdir (String) - The remote directory containing jdbc jar to include with sqoop lib</li> + <li>statusDir (String) - The remote directory to store status output.</li> +</ul><p>A complete example is available here: <a href="https://cwiki.apache.org/confluence/display/KNOX/2016/11/08/Running+SQOOP+job+via+KNOX+Shell+DSL">https://cwiki.apache.org/confluence/display/KNOX/2016/11/08/Running+SQOOP+job+via+KNOX+Shell+DSL</a></p><h3><a id="Futures">Futures</a> <a href="#Futures"><img src="markbook-section-link.png"/></a></h3><p>The DSL supports the ability to invoke commands asynchronously via the later() invocation method. The object returned from the later() method is a java.util.concurrent.Future parameterized with the response type of the command. This is an example of how to asynchronously put a file to HDFS.</p> <pre><code>future = Hdfs.put(session).file("README").to("/tmp/example/README").later() println future.get().statusCode </code></pre><p>The future.get() method will block until the asynchronous command is complete. To illustrate the usefulness of this however multiple concurrent commands are required.</p> Modified: knox/site/books/knox-0-4-0/deployment-overview.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-4-0/deployment-overview.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-4-0/deployment-provider.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-4-0/deployment-provider.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-4-0/deployment-service.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-4-0/deployment-service.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-4-0/runtime-overview.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-4-0/runtime-overview.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-4-0/runtime-request-processing.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-4-0/runtime-request-processing.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-5-0/deployment-overview.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-5-0/deployment-overview.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-5-0/deployment-provider.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-5-0/deployment-provider.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-5-0/deployment-service.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-5-0/deployment-service.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-5-0/runtime-overview.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-5-0/runtime-overview.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-5-0/runtime-request-processing.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-5-0/runtime-request-processing.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-6-0/deployment-overview.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-6-0/deployment-overview.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-6-0/deployment-provider.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-6-0/deployment-provider.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-6-0/deployment-service.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-6-0/deployment-service.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-6-0/runtime-overview.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-6-0/runtime-overview.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-6-0/runtime-request-processing.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-6-0/runtime-request-processing.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-7-0/deployment-overview.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-7-0/deployment-overview.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-7-0/deployment-provider.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-7-0/deployment-provider.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-7-0/deployment-service.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-7-0/deployment-service.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-7-0/general_saml_flow.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-7-0/general_saml_flow.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-7-0/runtime-overview.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-7-0/runtime-overview.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-7-0/runtime-request-processing.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-7-0/runtime-request-processing.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-8-0/deployment-overview.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-8-0/deployment-overview.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-8-0/deployment-provider.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-8-0/deployment-provider.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-8-0/deployment-service.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-8-0/deployment-service.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-8-0/general_saml_flow.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-8-0/general_saml_flow.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-8-0/runtime-overview.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-8-0/runtime-overview.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-8-0/runtime-request-processing.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-8-0/runtime-request-processing.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-9-0/deployment-overview.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-9-0/deployment-overview.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-9-0/deployment-provider.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-9-0/deployment-provider.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-9-0/deployment-service.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-9-0/deployment-service.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-9-0/general_saml_flow.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-9-0/general_saml_flow.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-9-0/runtime-overview.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-9-0/runtime-overview.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-9-0/runtime-request-processing.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-9-0/runtime-request-processing.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-9-1/deployment-overview.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-9-1/deployment-overview.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-9-1/deployment-provider.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-9-1/deployment-provider.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-9-1/deployment-service.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-9-1/deployment-service.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-9-1/general_saml_flow.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-9-1/general_saml_flow.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-9-1/runtime-overview.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-9-1/runtime-overview.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/books/knox-0-9-1/runtime-request-processing.png URL: http://svn.apache.org/viewvc/knox/site/books/knox-0-9-1/runtime-request-processing.png?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== Binary files - no diff available. Modified: knox/site/index.html URL: http://svn.apache.org/viewvc/knox/site/index.html?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== --- knox/site/index.html (original) +++ knox/site/index.html Fri Feb 24 17:48:38 2017 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2017-02-21 + | Generated by Apache Maven Doxia at 2017-02-24 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20170221" /> + <meta name="Date-Revision-yyyymmdd" content="20170224" /> <meta http-equiv="Content-Language" content="en" /> <title>Knox Gateway – REST API Gateway for the Apache Hadoop Ecosystem</title> <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" /> @@ -58,7 +58,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2017-02-21</li> + <li id="publishDate" class="pull-right">Last Published: 2017-02-24</li> </ul> </div> Modified: knox/site/issue-tracking.html URL: http://svn.apache.org/viewvc/knox/site/issue-tracking.html?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== --- knox/site/issue-tracking.html (original) +++ knox/site/issue-tracking.html Fri Feb 24 17:48:38 2017 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2017-02-21 + | Generated by Apache Maven Doxia at 2017-02-24 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20170221" /> + <meta name="Date-Revision-yyyymmdd" content="20170224" /> <meta http-equiv="Content-Language" content="en" /> <title>Knox Gateway – Issue Tracking</title> <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" /> @@ -58,7 +58,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2017-02-21</li> + <li id="publishDate" class="pull-right">Last Published: 2017-02-24</li> </ul> </div> Modified: knox/site/license.html URL: http://svn.apache.org/viewvc/knox/site/license.html?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== --- knox/site/license.html (original) +++ knox/site/license.html Fri Feb 24 17:48:38 2017 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2017-02-21 + | Generated by Apache Maven Doxia at 2017-02-24 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20170221" /> + <meta name="Date-Revision-yyyymmdd" content="20170224" /> <meta http-equiv="Content-Language" content="en" /> <title>Knox Gateway – Project License</title> <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" /> @@ -58,7 +58,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2017-02-21</li> + <li id="publishDate" class="pull-right">Last Published: 2017-02-24</li> </ul> </div> Modified: knox/site/mail-lists.html URL: http://svn.apache.org/viewvc/knox/site/mail-lists.html?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== --- knox/site/mail-lists.html (original) +++ knox/site/mail-lists.html Fri Feb 24 17:48:38 2017 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2017-02-21 + | Generated by Apache Maven Doxia at 2017-02-24 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20170221" /> + <meta name="Date-Revision-yyyymmdd" content="20170224" /> <meta http-equiv="Content-Language" content="en" /> <title>Knox Gateway – Project Mailing Lists</title> <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" /> @@ -58,7 +58,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2017-02-21</li> + <li id="publishDate" class="pull-right">Last Published: 2017-02-24</li> </ul> </div> Modified: knox/site/project-info.html URL: http://svn.apache.org/viewvc/knox/site/project-info.html?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== --- knox/site/project-info.html (original) +++ knox/site/project-info.html Fri Feb 24 17:48:38 2017 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2017-02-21 + | Generated by Apache Maven Doxia at 2017-02-24 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20170221" /> + <meta name="Date-Revision-yyyymmdd" content="20170224" /> <meta http-equiv="Content-Language" content="en" /> <title>Knox Gateway – Project Information</title> <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" /> @@ -58,7 +58,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2017-02-21</li> + <li id="publishDate" class="pull-right">Last Published: 2017-02-24</li> </ul> </div> Modified: knox/site/team-list.html URL: http://svn.apache.org/viewvc/knox/site/team-list.html?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== --- knox/site/team-list.html (original) +++ knox/site/team-list.html Fri Feb 24 17:48:38 2017 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2017-02-21 + | Generated by Apache Maven Doxia at 2017-02-24 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20170221" /> + <meta name="Date-Revision-yyyymmdd" content="20170224" /> <meta http-equiv="Content-Language" content="en" /> <title>Knox Gateway – Team list</title> <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" /> @@ -58,7 +58,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2017-02-21</li> + <li id="publishDate" class="pull-right">Last Published: 2017-02-24</li> </ul> </div> Modified: knox/trunk/books/0.10.0/book_client-details.md URL: http://svn.apache.org/viewvc/knox/trunk/books/0.10.0/book_client-details.md?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== --- knox/trunk/books/0.10.0/book_client-details.md (original) +++ knox/trunk/books/0.10.0/book_client-details.md Fri Feb 24 17:48:38 2017 @@ -176,6 +176,23 @@ This would be the content of that script Notice the `Hdfs.rm` command. This is included simply to ensure that the script can be rerun. Without this an error would result the second time it is run. +#### submitSqoop Job API #### +Using the Knox DSL, you can now easily submit and monitor [Apache Sqoop](https://sqoop.apache.org) jobs. The WebHCat Job class now supports the `submitSqoop` command. + + Job.submitSqoop(session) + .command("import --connect jdbc:mysql://hostname:3306/dbname ... ") + .statusDir(remoteStatusDir) + .now().jobId + +The `submitSqoop` command supports the following arguments: + +* command (String) - The sqoop command string to execute. +* files (String) - Comma separated files to be copied to the templeton controller job. +* optionsfile (String) - The remote file which contain Sqoop command need to run. +* libdir (String) - The remote directory containing jdbc jar to include with sqoop lib +* statusDir (String) - The remote directory to store status output. + +A complete example is available here: https://cwiki.apache.org/confluence/display/KNOX/2016/11/08/Running+SQOOP+job+via+KNOX+Shell+DSL ### Futures ### Modified: knox/trunk/books/0.11.0/book_client-details.md URL: http://svn.apache.org/viewvc/knox/trunk/books/0.11.0/book_client-details.md?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== --- knox/trunk/books/0.11.0/book_client-details.md (original) +++ knox/trunk/books/0.11.0/book_client-details.md Fri Feb 24 17:48:38 2017 @@ -176,6 +176,23 @@ This would be the content of that script Notice the `Hdfs.rm` command. This is included simply to ensure that the script can be rerun. Without this an error would result the second time it is run. +#### submitSqoop Job API #### +Using the Knox DSL, you can now easily submit and monitor [Apache Sqoop](https://sqoop.apache.org) jobs. The WebHCat Job class now supports the `submitSqoop` command. + + Job.submitSqoop(session) + .command("import --connect jdbc:mysql://hostname:3306/dbname ... ") + .statusDir(remoteStatusDir) + .now().jobId + +The `submitSqoop` command supports the following arguments: + +* command (String) - The sqoop command string to execute. +* files (String) - Comma separated files to be copied to the templeton controller job. +* optionsfile (String) - The remote file which contain Sqoop command need to run. +* libdir (String) - The remote directory containing jdbc jar to include with sqoop lib +* statusDir (String) - The remote directory to store status output. + +A complete example is available here: https://cwiki.apache.org/confluence/display/KNOX/2016/11/08/Running+SQOOP+job+via+KNOX+Shell+DSL ### Futures ### Modified: knox/trunk/books/0.12.0/book_client-details.md URL: http://svn.apache.org/viewvc/knox/trunk/books/0.12.0/book_client-details.md?rev=1784308&r1=1784307&r2=1784308&view=diff ============================================================================== --- knox/trunk/books/0.12.0/book_client-details.md (original) +++ knox/trunk/books/0.12.0/book_client-details.md Fri Feb 24 17:48:38 2017 @@ -176,6 +176,23 @@ This would be the content of that script Notice the `Hdfs.rm` command. This is included simply to ensure that the script can be rerun. Without this an error would result the second time it is run. +#### submitSqoop Job API #### +Using the Knox DSL, you can now easily submit and monitor [Apache Sqoop](https://sqoop.apache.org) jobs. The WebHCat Job class now supports the `submitSqoop` command. + + Job.submitSqoop(session) + .command("import --connect jdbc:mysql://hostname:3306/dbname ... ") + .statusDir(remoteStatusDir) + .now().jobId + +The `submitSqoop` command supports the following arguments: + +* command (String) - The sqoop command string to execute. +* files (String) - Comma separated files to be copied to the templeton controller job. +* optionsfile (String) - The remote file which contain Sqoop command need to run. +* libdir (String) - The remote directory containing jdbc jar to include with sqoop lib +* statusDir (String) - The remote directory to store status output. + +A complete example is available here: https://cwiki.apache.org/confluence/display/KNOX/2016/11/08/Running+SQOOP+job+via+KNOX+Shell+DSL ### Futures ###