Hi Ananth,
I don't see anything that stands out in the application master log.
Can you send me the output of this command?
curl -D - http://<rm_ip>:8088/proxy/<your_app_id>/ws/v2/stram
rm_ip is the IP address of the resource manager in your hadoop cluster.
David
On Mon, May 2, 2016 at 6:07 PM, Ananth Gundabattula <agundabatt...@gmail.com
> wrote:
> Hello David,
>
> Thanks for taking this thread up.
>
> Here is the log of the application master.
>
> Please note that I could not upload the entire log as the log size was too
> much and the attached log contains the debug version of the logs for the
> first few hours. I believe the error started occuring in the first few
> minutes of launching the app itself as described in the mail above.
>
>
>
> Regards,
> Ananth
>
>
>
> On Tue, May 3, 2016 at 1:53 AM, David Yan <da...@datatorrent.com> wrote:
>
>> Hi Ananth,
>>
>> This error indicates that dtGateway has trouble accessing the app master.
>> Can you check the app master log for application_1462007878015_0037?
>>
>> David
>>
>> On Mon, May 2, 2016 at 4:27 AM, Ananth Gundabattula <
>> agundabatt...@gmail.com> wrote:
>>
>>> Hello All,
>>>
>>> I am trying to launch my app on Apex/DT 3.3 version running on top of
>>> CDH 5.7. I tried on DT/Apex 3.2 as well running on CDH 5.7. Both these
>>> deployments show the following behavior. (We have a requirement to run Apex
>>> on CDH 5.7 )
>>>
>>> I was wondering if you could advise on any workarounds for the following
>>> issue:
>>>
>>> I am not able to see any metrics in the web console when I open the
>>> "Monitor" section. The application code seems to be working fine as I see
>>> data flow happening fine as expected. However I see no metrics ( even the
>>> top level container metrics) .
>>>
>>> One more observed issue is that when I click on the container ID from
>>> the monitor section, the UI crashes. ( In the sense the UI simply does not
>>> show anything ). I am however able to get some preliminary UI ( barring the
>>> metrics ) if I click on the container link from the monitor section if the
>>> application is in the "ACCEPTED" state. The container link does not work
>>> the moment the app moves from ACCEPTED to Running State.
>>>
>>>
>>> The DtGateway shows the following logs :
>>>
>>> 2016-05-02 11:08:48,964 WARN com.datatorrent.stram.client.StramAgent:
>>>> Caught exception when retrieving web service info for app
>>>> application_1462007878015_0037
>>>> org.codehaus.jettison.json.JSONException: A JSONObject text must begin
>>>> with '{' at character 1 of <html>
>>>> <head>
>>>> <meta http-equiv="Content-Type" content="text/html;
>>>> charset=ISO-8859-1"/>
>>>> <title>Error 500
>>>> javax.ws.rs.core.UriBuilder.uri(Ljava/lang/String;)Ljavax/ws/rs/core/UriBuilder;</title>
>>>> </head>
>>>> <body><h2>HTTP ERROR 500</h2>
>>>> <p>Problem accessing /ws. Reason:
>>>> <pre>
>>>> javax.ws.rs.core.UriBuilder.uri(Ljava/lang/String;)Ljavax/ws/rs/core/UriBuilder;</pre></p><h3>Caused
>>>> by:</h3><pre>java.lang.AbstractMethodError:
>>>> javax.ws.rs.core.UriBuilder.uri(Ljava/lang/String;)Ljavax/ws/rs/core/UriBuilder;
>>>> at javax.ws.rs.core.UriBuilder.fromUri(UriBuilder.java:119)
>>>> at
>>>> com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:870)
>>>> at
>>>> com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:834)
>>>> at
>>>> com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:795)
>>>> at
>>>> com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163)
>>>> at
>>>> com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>>>> at
>>>> com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:118)
>>>> at
>>>> com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:113)
>>>> at
>>>> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>>>> at
>>>> org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter.doFilter(StaticUserWebFilter.java:109)
>>>> at
>>>> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>>>> at
>>>> org.apache.hadoop.http.HttpServer2$QuotingInputFilter.doFilter(HttpServer2.java:1286)
>>>> at
>>>> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>>>> at
>>>> org.apache.hadoop.http.NoCacheFilter.doFilter(NoCacheFilter.java:45)
>>>> at
>>>> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>>>> at
>>>> org.apache.hadoop.http.NoCacheFilter.doFilter(NoCacheFilter.java:45)
>>>> at
>>>> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>>>> at
>>>> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>>>> at
>>>> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>>>> at
>>>> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>>>> at
>>>> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:767)
>>>> at
>>>> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
>>>> at
>>>> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
>>>> at
>>>> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>>>> at org.mortbay.jetty.Server.handle(Server.java:326)
>>>> at
>>>> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>>>> at
>>>> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
>>>> at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
>>>> at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
>>>> at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>>>> at
>>>> org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
>>>> at
>>>> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>>>> </pre>
>>>> <hr /><i><small>Powered by Jetty://</small></i><br/>
>>>> <br/>
>>>> <br/>
>>>> <br/>
>>>> <br/>
>>>> <br/>
>>>> <br/>
>>>> <br/>
>>>> <br/>
>>>> <br/>
>>>> <br/>
>>>> <br/>
>>>> <br/>
>>>> <br/>
>>>> <br/>
>>>> <br/>
>>>> <br/>
>>>> <br/>
>>>> <br/>
>>>> <br/>
>>>>
>>>> </body>
>>>> </html>
>>>>
>>>> at
>>>> org.codehaus.jettison.json.JSONTokener.syntaxError(JSONTokener.java:439)
>>>> at org.codehaus.jettison.json.JSONObject.<init>(JSONObject.java:169)
>>>> at org.codehaus.jettison.json.JSONObject.<init>(JSONObject.java:266)
>>>> at
>>>> com.datatorrent.stram.client.StramAgent.retrieveWebServicesInfo(StramAgent.java:402)
>>>> at
>>>> com.datatorrent.stram.client.StramAgent.getWebServicesInfo(StramAgent.java:181)
>>>> at
>>>> com.datatorrent.stram.client.StramAgent.getStramWebURIBuilder(StramAgent.java:205)
>>>> at
>>>> com.datatorrent.stram.client.StramAgent.issueStramWebRequest(StramAgent.java:275)
>>>> at
>>>> com.datatorrent.stram.client.StramAgent.issueStramWebRequest(StramAgent.java:305)
>>>> at
>>>> com.datatorrent.stram.client.StramAgent.issueStramWebGetRequest(StramAgent.java:311)
>>>> at
>>>> com.datatorrent.gateway.resources.ws.v2.ApplicationsResource.getApplication(sc:378)
>>>> at com.datatorrent.gateway.R.F(ud:255)
>>>> at com.datatorrent.gateway.R.call(ud:157)
>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>>> at
>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>>> at
>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>>> at java.lang.Thread.run(Thread.java:745)
>>>> 2016-05-02 11:08:48,965 WARN com.datatorrent.gateway.u: Cannot get
>>>> application info for app application_1462007878015_0037. HTTP returns 404
>>>>
>>>
>>> Regards,
>>> Ananth
>>>
>>
>>
>
