You are probably getting far enough now to be hitting errors due to your lack of providers. Start with sandbox.xml config and start the ldap server. See the apache docs for details. On Jul 2, 2015 3:14 PM, "Aneela Saleem" <[email protected]> wrote:
> Hey Larry, > > i got the following error > > <title>Error 500 Server Error</title> > </head> > <body><h2>HTTP ERROR 500</h2> > <p>Problem accessing /gateway/cluster1/webhdfs/v1/. > > And the gateway.log file contains: > > 2015-07-03 00:09:04,560 ERROR hadoop.gateway > (AbstractGatewayFilter.java:doFilter(69)) - Failed to execute filter: > java.lang.NullPointerException > 2015-07-03 00:09:04,560 ERROR hadoop.gateway > (GatewayFilter.java:doFilter(135)) - Gateway processing failed: > javax.servlet.ServletException: java.lang.NullPointerException > javax.servlet.ServletException: java.lang.NullPointerException > at > org.apache.hadoop.gateway.filter.AbstractGatewayFilter.doFilter(AbstractGatewayFilter.java:70) > at > org.apache.hadoop.gateway.GatewayFilter$Holder.doFilter(GatewayFilter.java:315) > at > org.apache.hadoop.gateway.GatewayFilter$Chain.doFilter(GatewayFilter.java:215) > at org.apache.hadoop.gateway.GatewayFilter.doFilter(GatewayFilter.java:129) > at > org.apache.hadoop.gateway.GatewayServlet.service(GatewayServlet.java:121) > at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684) > at > org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:501) > at > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) > at > org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) > at > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) > at > org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1086) > at > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:428) > at > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) > at > org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1020) > at > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) > at > org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255) > at > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) > at org.eclipse.jetty.server.Server.handle(Server.java:370) > at > org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:494) > at > org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:971) > at > org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1033) > at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:644) > at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235) > at > org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82) > at org.eclipse.jetty.io.nio.SslConnection.handle(SslConnection.java:196) > at > org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:667) > at > org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52) > at > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) > at > org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.lang.NullPointerException > > > > > On Fri, Jul 3, 2015 at 12:07 AM, larry mccay <[email protected]> > wrote: > >> Try lower case webhdfs as in: >> >> 'https://localhost:8443/gateway/cluster1/webhdfs/v1/?op=GETHOMEDIRECTORY' >> >> >> On Thu, Jul 2, 2015 at 2:59 PM, Aneela Saleem <[email protected]> >> wrote: >> >>> Dear larry, >>> >>> The gateway.log file contains the following logs: >>> >>> 2015-07-02 23:43:16,391 INFO hadoop.gateway >>> (GatewayServer.java:handleCreateDeployment(427)) - Deploying topology >>> cluster1 to >>> /home/hduser/knox-0.6.0/bin/../data/deployments/cluster1.war.14e501479a0 >>> 2015-07-02 23:43:16,392 INFO hadoop.gateway >>> (DeploymentFactory.java:createDeployment(82)) - Configured services >>> directory is /home/hduser/knox-0.6.0/bin/../data/services >>> 2015-07-02 23:43:16,428 INFO hadoop.gateway >>> (DefaultGatewayServices.java:initializeContribution(180)) - Credential >>> store found for the cluster: cluster1 - no need to create one. >>> 2015-07-02 23:44:40,453 WARN hadoop.gateway >>> (GatewayFilter.java:doFilter(152)) - Failed to match path >>> /WEBHDFS/v1?op=GETHOMEDIRECTORY >>> 2015-07-02 23:44:51,722 WARN hadoop.gateway >>> (GatewayFilter.java:doFilter(152)) - Failed to match path >>> /WEBHDFS/v1?op=GETHOMEDIRECTORY >>> 2015-07-02 23:45:30,783 WARN hadoop.gateway >>> (GatewayFilter.java:doFilter(152)) - Failed to match path >>> /WEBHDFS/v1?op=GETHOMEDIRECTORY >>> >>> And i'm just a beginner. I'm trying to configure Knox Topology to >>> connect to HDFS, using default services provided. And i'm validating >>> connection to services. >>> >>> On Thu, Jul 2, 2015 at 11:50 PM, larry mccay <[email protected]> >>> wrote: >>> >>>> Please check the {GATEWAY_HOME}/logs/gateway.log file for errors during >>>> deployment. >>>> >>>> I notice that you have no providers described in cluster1.xml - this >>>> may be the root of your problem. >>>> I don't think that I have ever even tried that. >>>> >>>> What are you expecting the authentication behavior to be there? >>>> >>>> >>>> On Thu, Jul 2, 2015 at 2:27 PM, Aneela Saleem <[email protected]> >>>> wrote: >>>> >>>>> ${KNOX_HOME}/knox/conf/topologies has the following contents: >>>>> >>>>> admin.xml cluster1.xml README sandbox.xml >>>>> >>>>> cluster1.xml is the topology descriptor file created by me. >>>>> >>>>> cluster1.xml has following contents: >>>>> >>>>> <topology> >>>>> <gateway> >>>>> </gateway> >>>>> <service> >>>>> <role>NAMENODE</role> >>>>> <url>hdfs:// namenode-host :8020</url> >>>>> </service> >>>>> >>>>> <service> >>>>> <role>JOBTRACKER</role> >>>>> <url>rpc:// jobtracker-host :8050</url> >>>>> </service> >>>>> >>>>> <service> >>>>> <role>RESOURCEMANAGER</role> >>>>> <url>http://red3:8088/ws</url> >>>>> </service> >>>>> >>>>> <service> >>>>> <role>WEBHDFS</role> >>>>> <url>http://localhost:50070/webhdfs</url> >>>>> </service> >>>>> >>>>> <service> >>>>> <role>WEBHCAT</role> >>>>> <url>http://webcat-host :50111/templeton</url> >>>>> </service> >>>>> >>>>> <service> >>>>> <role>OOZIE</role> >>>>> <url>http://oozie-host :11000/oozie</url> >>>>> </service> >>>>> >>>>> <service> >>>>> <role>WEBHBASE</role> >>>>> <url>http://webhbase-host :60080</url> >>>>> </service> >>>>> </topology> >>>>> >>>>> >>>>> admin.xml has default contents. I did not make any changes. >>>>> >>>>> >>>>> >>>>> On Thu, Jul 2, 2015 at 11:15 PM, Steve Howard <[email protected]> >>>>> wrote: >>>>> >>>>>> To be clear, the error isn't hostname not found (that just means it >>>>>> wasn't in the DNS cache on your computer), it's that the URL can't be >>>>>> found >>>>>> by the knox server. >>>>>> >>>>>> Can you post the contents of your ${KNOX_HOME}/knox/conf/topologies >>>>>> directory? >>>>>> >>>>>> On Thu, Jul 2, 2015 at 1:50 PM, Aneela Saleem <[email protected] >>>>>> > wrote: >>>>>> >>>>>>> Hi, >>>>>>> >>>>>>> I'm trying to connect to HDFS through Knox gateway. I run the >>>>>>> following command: >>>>>>> >>>>>>> curl -vk >>>>>>> https://localhost:8443/gateway/cluster1/WEBHDFS/v1?op=GETHOMEDIRECTORY >>>>>>> >>>>>>> when i run this command i get the following error: >>>>>>> >>>>>>> * Hostname was NOT found in DNS cache >>>>>>> * Trying 127.0.0.1... >>>>>>> * Connected to localhost (127.0.0.1) port 8443 (#0) >>>>>>> * successfully set certificate verify locations: >>>>>>> * CAfile: none >>>>>>> CApath: /etc/ssl/certs >>>>>>> * SSLv3, TLS handshake, Client hello (1): >>>>>>> * SSLv3, TLS handshake, Server hello (2): >>>>>>> * SSLv3, TLS handshake, CERT (11): >>>>>>> * SSLv3, TLS handshake, Server key exchange (12): >>>>>>> * SSLv3, TLS handshake, Server finished (14): >>>>>>> * SSLv3, TLS handshake, Client key exchange (16): >>>>>>> * SSLv3, TLS change cipher, Client hello (1): >>>>>>> * SSLv3, TLS handshake, Finished (20): >>>>>>> * SSLv3, TLS change cipher, Client hello (1): >>>>>>> * SSLv3, TLS handshake, Finished (20): >>>>>>> * SSL connection using ECDHE-RSA-DES-CBC3-SHA >>>>>>> * Server certificate: >>>>>>> * subject: C=US; ST=Test; L=Test; O=Hadoop; OU=Test; CN=localhost >>>>>>> * start date: 2015-06-29 21:39:18 GMT >>>>>>> * expire date: 2016-06-28 21:39:18 GMT >>>>>>> * issuer: C=US; ST=Test; L=Test; O=Hadoop; OU=Test; CN=localhost >>>>>>> * SSL certificate verify result: self signed certificate (18), >>>>>>> continuing anyway. >>>>>>> > GET /gateway/cluster1/WEBHDFS/v1?op=GETHOMEDIRECTORY HTTP/1.1 >>>>>>> > User-Agent: curl/7.35.0 >>>>>>> > Host: localhost:8443 >>>>>>> > Accept: */* >>>>>>> > >>>>>>> < HTTP/1.1 404 Not Found >>>>>>> < Content-Length: 0 >>>>>>> * Server Jetty(8.1.14.v20131031) is not blacklisted >>>>>>> < Server: Jetty(8.1.14.v20131031) >>>>>>> < >>>>>>> * Connection #0 to host localhost left intact >>>>>>> >>>>>>> >>>>>>> >>>>>>> Can anyone please help me in tackling this issue? >>>>>>> >>>>>> >>>>>> >>>>> >>>> >>> >> >
