[
https://issues.apache.org/jira/browse/LENS-703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645743#comment-14645743
]
Rajat Khandelwal commented on LENS-703:
---------------------------------------
Have tested by having an XPartition with output format specified and updating
its path(once created). Gave the error before the patch. Goes through after the
patch. Haven't added test cases since it's ultimately expected to be fixed in
Hive, our solution is just a work around. As for build result, here it is:
{noformat}
[INFO] Fork Value is true
[java] Warnings generated: 1
[INFO] Done FindBugs Analysis....
[INFO]
[INFO] <<< findbugs-maven-plugin:3.0.1:check (findbugs-check) @ lens-examples
<<<
[INFO]
[INFO] --- findbugs-maven-plugin:3.0.1:check (findbugs-check) @ lens-examples
---
[INFO] BugInstance size is 1
[INFO] Error size is 0
[INFO] Total bugs: 1
[INFO]
org.apache.lens.examples.PopulateSampleMetastore.createContinuousFactData()
passes a nonconstant String to an execute or addBatch method on an SQL
statement [org.apache.lens.examples.PopulateSampleMetastore] At
PopulateSampleMetastore.java:[line 113]
[INFO]
To see bug detail using the Findbugs GUI, use the following command "mvn
findbugs:gui"
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Lens Checkstyle Rules ............................. SUCCESS [1.849s]
[INFO] Lens .............................................. SUCCESS [2.990s]
[INFO] Lens API .......................................... SUCCESS [23.420s]
[INFO] Lens API for server and extensions ................ SUCCESS [17.976s]
[INFO] Lens Cube ......................................... SUCCESS [6:23.138s]
[INFO] Lens DB storage ................................... SUCCESS [20.677s]
[INFO] Lens Query Library ................................ SUCCESS [15.051s]
[INFO] Lens Hive Driver .................................. SUCCESS [2:45.720s]
[INFO] Lens Driver for JDBC .............................. SUCCESS [34.724s]
[INFO] Lens Server ....................................... SUCCESS [5:25.753s]
[INFO] Lens client ....................................... SUCCESS [33.979s]
[INFO] Lens CLI .......................................... SUCCESS [2:37.592s]
[INFO] Lens Examples ..................................... FAILURE [9.935s]
[INFO] Lens Distribution ................................. SKIPPED
[INFO] Lens ML Lib ....................................... SKIPPED
[INFO] Lens ML Ext Distribution .......................... SKIPPED
[INFO] Lens Regression ................................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 19:53.645s
[INFO] Finished at: Wed Jul 29 07:09:18 UTC 2015
[INFO] Final Memory: 152M/1341M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.codehaus.mojo:findbugs-maven-plugin:3.0.1:check (findbugs-check) on project
lens-examples: failed with 1 bugs and 0 errors -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :lens-examples
{noformat}
The error I'm expecting to be fixed through LENS-698 which wasn't present in my
commit history at the time of this testing.
> ClassNotFound while doing "list partition" after "update partition"
> -------------------------------------------------------------------
>
> Key: LENS-703
> URL: https://issues.apache.org/jira/browse/LENS-703
> Project: Apache Lens
> Issue Type: Bug
> Affects Versions: 2.3
> Reporter: Arshad Matin
> Assignee: Rajat Khandelwal
> Fix For: 2.3
>
> Attachments: LENS-703_2015-07-29_12:09:21.patch
>
>
> {noformat}
> 29 Jul 2015 06:26:49,748 [616fb893-c46c-41a5-be69-f9325be67052]
> [Grizzly-worker(6)] ERROR org.apache.lens.server.LensRequestListener -
> Encountered HTTP exception
> org.glassfish.jersey.server.internal.process.MappableException:
> org.apache.lens.server.api.error.LensException
> at
> org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.mapTargetToRuntimeEx(AbstractJavaResourceMethodDispatcher.java:190)
> at
> org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.access$200(AbstractJavaResourceMethodDispatcher.java:74)
> at
> org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:160)
> at
> org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:171)
> at
> org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:195)
> at
> org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:104)
> at
> org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:353)
> at
> org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:343)
> at
> org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102)
> at
> org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:255)
> at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)
> at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)
> at org.glassfish.jersey.internal.Errors.process(Errors.java:315)
> at org.glassfish.jersey.internal.Errors.process(Errors.java:297)
> at org.glassfish.jersey.internal.Errors.process(Errors.java:267)
> at
> org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:318)
> at
> org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:235)
> at
> org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:983)
> at
> org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:330)
> at
> org.glassfish.grizzly.http.server.HttpHandler$1.run(HttpHandler.java:212)
> at
> org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:565)
> at
> org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:545)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.lens.server.api.error.LensException
> at
> org.apache.lens.server.metastore.CubeMetastoreServiceImpl.getAllPartitionsOfFactStorage(CubeMetastoreServiceImpl.java:715)
> at
> org.apache.lens.server.metastore.MetastoreResource.getAllPartitionsOfFactStorageByFilter(MetastoreResource.java:1046)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497)
> at
> org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81)
> at
> org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:151)
> ... 20 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Class not found:
> class org.apache.hadoop.hive.ql.io.RCFileOutputFormat
> at
> org.apache.hadoop.hive.ql.metadata.Partition.getOutputFormatClass(Partition.java:331)
> at
> org.apache.lens.server.metastore.JAXBUtils.xpartitionFromPartition(JAXBUtils.java:795)
> at
> org.apache.lens.server.metastore.CubeMetastoreServiceImpl.getAllPartitionsOfFactStorage(CubeMetastoreServiceImpl.java:707)
> ... 27 more
> Caused by: java.lang.ClassNotFoundException: class
> org.apache.hadoop.hive.ql.io.RCFileOutputFormat
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:348)
> at
> org.apache.hadoop.hive.ql.metadata.Partition.getOutputFormatClass(Partition.java:322)
> ... 29 more
> 29 Jul 2015 06:26:49,749 [616fb893-c46c-41a5-be69-f9325be67052]
> [Grizzly-worker(6)] WARN org.glassfish.jersey.server.ServerRuntime$Responder
> - WebApplicationException cause:
> org.apache.lens.server.api.error.LensException
> at
> org.apache.lens.server.metastore.CubeMetastoreServiceImpl.getAllPartitionsOfFactStorage(CubeMetastoreServiceImpl.java:715)
> at
> org.apache.lens.server.metastore.MetastoreResource.getAllPartitionsOfFactStorageByFilter(MetastoreResource.java:1046)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497)
> at
> org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81)
> at
> org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:151)
> at
> org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:171)
> at
> org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:195)
> at
> org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:104)
> at
> org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:353)
> at
> org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:343)
> at
> org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102)
> at
> org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:255)
> at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)
> at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)
> at org.glassfish.jersey.internal.Errors.process(Errors.java:315)
> at org.glassfish.jersey.internal.Errors.process(Errors.java:297)
> at org.glassfish.jersey.internal.Errors.process(Errors.java:267)
> at
> org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:318)
> at
> org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:235)
> at
> org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:983)
> at
> org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:330)
> at
> org.glassfish.grizzly.http.server.HttpHandler$1.run(HttpHandler.java:212)
> at
> org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:565)
> at
> org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:545)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Class not found:
> class org.apache.hadoop.hive.ql.io.RCFileOutputFormat
> at
> org.apache.hadoop.hive.ql.metadata.Partition.getOutputFormatClass(Partition.java:331)
> at
> org.apache.lens.server.metastore.JAXBUtils.xpartitionFromPartition(JAXBUtils.java:795)
> at
> org.apache.lens.server.metastore.CubeMetastoreServiceImpl.getAllPartitionsOfFactStorage(CubeMetastoreServiceImpl.java:707)
> ... 27 more
> Caused by: java.lang.ClassNotFoundException: class
> org.apache.hadoop.hive.ql.io.RCFileOutputFormat
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:348)
> at
> org.apache.hadoop.hive.ql.metadata.Partition.getOutputFormatClass(Partition.java:322)
> ... 29 more
> 29 Jul 2015 06:26:49,751 [616fb893-c46c-41a5-be69-f9325be67052]
> [Grizzly-worker(6)] ERROR org.glassfish.jersey.server.ServerRuntime$Responder
> - An exception has been thrown from an exception mapper class
> org.apache.lens.server.error.LensExceptionMapper.
> java.lang.NullPointerException
> at
> org.apache.lens.server.error.LensExceptionMapper.toResponse(LensExceptionMapper.java:35)
> at
> org.apache.lens.server.error.LensExceptionMapper.toResponse(LensExceptionMapper.java:28)
> at
> org.glassfish.jersey.server.ServerRuntime$Responder.mapException(ServerRuntime.java:443)
> at
> org.glassfish.jersey.server.ServerRuntime$Responder.process(ServerRuntime.java:371)
> at
> org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:261)
> at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)
> at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)
> at org.glassfish.jersey.internal.Errors.process(Errors.java:315)
> at org.glassfish.jersey.internal.Errors.process(Errors.java:297)
> at org.glassfish.jersey.internal.Errors.process(Errors.java:267)
> at
> org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:318)
> at
> org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:235)
> at
> org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:983)
> at
> org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:330)
> at
> org.glassfish.grizzly.http.server.HttpHandler$1.run(HttpHandler.java:212)
> at
> org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:565)
> at
> org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:545)
> at java.lang.Thread.run(Thread.java:745)
> 29 Jul 2015 06:26:49,751 [616fb893-c46c-41a5-be69-f9325be67052]
> [Grizzly-worker(6)] ERROR org.glassfish.jersey.server.ServerRuntime$Responder
> - An exception was not mapped due to exception mapper failure. The HTTP 500
> response will be returned.
> org.apache.lens.server.api.error.LensException
> at
> org.apache.lens.server.metastore.CubeMetastoreServiceImpl.getAllPartitionsOfFactStorage(CubeMetastoreServiceImpl.java:715)
> at
> org.apache.lens.server.metastore.MetastoreResource.getAllPartitionsOfFactStorageByFilter(MetastoreResource.java:1046)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497)
> at
> org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81)
> at
> org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:151)
> at
> org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:171)
> at
> org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:195)
> at
> org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:104)
> at
> org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:353)
> at
> org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:343)
> at
> org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102)
> at
> org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:255)
> at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)
> at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)
> at org.glassfish.jersey.internal.Errors.process(Errors.java:315)
> at org.glassfish.jersey.internal.Errors.process(Errors.java:297)
> at org.glassfish.jersey.internal.Errors.process(Errors.java:267)
> at
> org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:318)
> at
> org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:235)
> at
> org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:983)
> at
> org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:330)
> at
> org.glassfish.grizzly.http.server.HttpHandler$1.run(HttpHandler.java:212)
> at
> org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:565)
> at
> org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:545)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Class not found:
> class org.apache.hadoop.hive.ql.io.RCFileOutputFormat
> at
> org.apache.hadoop.hive.ql.metadata.Partition.getOutputFormatClass(Partition.java:331)
> at
> org.apache.lens.server.metastore.JAXBUtils.xpartitionFromPartition(JAXBUtils.java:795)
> at
> org.apache.lens.server.metastore.CubeMetastoreServiceImpl.getAllPartitionsOfFactStorage(CubeMetastoreServiceImpl.java:707)
> ... 27 more
> Caused by: java.lang.ClassNotFoundException: class
> org.apache.hadoop.hive.ql.io.RCFileOutputFormat
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:348)
> at
> org.apache.hadoop.hive.ql.metadata.Partition.getOutputFormatClass(Partition.java:322)
> ... 29 more
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
