Postgresql works fine. I guess this is just an issue with mysql.
On Tuesday, November 5, 2013 10:07 AM, bowen zhang <bowenzhang...@yahoo.com> wrote: Bug-1603 filed. Will try to test it on postgresql as well. Bowen On Tuesday, November 5, 2013 9:56 AM, Virag Kothari <vi...@yahoo-inc.com> wrote: Hi Bowen, The compression property oozie.output.compression.codec' is in oozie-default.xml You can set the value to 'NONE' or blank string to disable compression. However this might not fix the issue you are facing. OpenJPA is complaining that Binaryblob is not serializable even though all its fields (byte[]) are serializable. This is not happening with Derby or Oracle. So we need to check for Mysql case. Can you file a JIRA for this? Thanks, Virag On 11/4/13 5:19 PM, "bowen zhang" <bowenzhang...@yahoo.com> wrote: >Hi all, >I recently rebased oozie to trunk and used mysql as the db. Upon >submission of a job, I see this error on the command line: >Error: E0803 : E0803: IO error, E0603: SQL error in operation, ><openjpa-2.2.2-r422266:1468616 fatal store error> >org.apache.openjpa.persistence.RollbackException: The transaction has >been rolled back. See the nested exceptions for details on the errors >that occurred. >The log in oozie.log shows: >org.apache.oozie.command.CommandException: E0803: IO error, E0603: SQL >error in operation, <openjpa-2.2.2-r422266:1468616 fatal store error> >org.apache.openjpa.persistence.RollbackException: The transaction has >been rolled back. See the nested exceptions for details on the errors >that occurred. > at >org.apache.oozie.command.wf.SubmitXCommand.execute(SubmitXCommand.java:252 >) > at >org.apache.oozie.command.wf.SubmitXCommand.execute(SubmitXCommand.java:72) > at org.apache.oozie.command.XCommand.call(XCommand.java:280) > at org.apache.oozie.DagEngine.submitJob(DagEngine.java:109) > at >org.apache.oozie.servlet.V1JobsServlet.submitWorkflowJob(V1JobsServlet.jav >a:188) > at >org.apache.oozie.servlet.V1JobsServlet.submitJob(V1JobsServlet.java:88) > at >org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:99) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:643) > at >org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:286) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:723) > at >org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicati >onFilterChain.java:290) > at >org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilter >Chain.java:206) > at >org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:126) > at >org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFi >lter(AuthenticationFilter.java:372) > at >org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:131) > at >org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicati >onFilterChain.java:235) > at >org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilter >Chain.java:206) > at >org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:84) > at >org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicati >onFilterChain.java:235) > at >org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilter >Chain.java:206) > at >org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve. >java:233) > at >org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve. >java:191) > at >org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:1 >27) > at >org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:1 >03) > at >org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.ja >va:109) > at >org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293 >) > at >org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:861) > at >org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Ht >tp11Protocol.java:606) > at >org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) > at java.lang.Thread.run(Thread.java:680) >Caused by: org.apache.oozie.command.CommandException: E0603: SQL error in >operation, <openjpa-2.2.2-r422266:1468616 fatal store error> >org.apache.openjpa.persistence.RollbackException: The transaction has >been rolled back. See the nested exceptions for details on the errors >that occurred. > at >org.apache.oozie.command.wf.SubmitXCommand.execute(SubmitXCommand.java:231 >) > ... 29 more >Caused by: org.apache.oozie.executor.jpa.JPAExecutorException: E0603: SQL >error in operation, <openjpa-2.2.2-r422266:1468616 fatal store error> >org.apache.openjpa.persistence.RollbackException: The transaction has >been rolled back. See the nested exceptions for details on the errors >that occurred. > at >org.apache.oozie.service.JPAService.executeBatchInsertUpdateDelete(JPAServ >ice.java:392) > at >org.apache.oozie.executor.jpa.BatchQueryExecutor.executeBatchInsertUpdateD >elete(BatchQueryExecutor.java:140) > at >org.apache.oozie.command.wf.SubmitXCommand.execute(SubmitXCommand.java:228 >) > ... 29 more >Caused by: <openjpa-2.2.2-r422266:1468616 fatal store error> >org.apache.openjpa.persistence.RollbackException: The transaction has >been rolled back. See the nested exceptions for details on the errors >that occurred. > at >org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl. >java:594) > at >org.apache.oozie.service.JPAService.executeBatchInsertUpdateDelete(JPAServ >ice.java:388) > ... 31 more >Caused by: <openjpa-2.2.2-r422266:1468616 fatal general error> >org.apache.openjpa.persistence.PersistenceException: The transaction has >been rolled back. See the nested exceptions for details on the errors >that occurred. > at >org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:234 >7) > at >org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2184) > at >org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2082) > at >org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:2000 >) > at >org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.j >ava:81) > at >org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1524) > at >org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:93 >3) > at >org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl. >java:570) > ... 32 more >Caused by: <openjpa-2.2.2-r422266:1468616 nonfatal general error> >org.apache.openjpa.persistence.PersistenceException: >org.apache.oozie.BinaryBlob > at >org.apache.openjpa.util.Serialization.serialize(Serialization.java:67) > at >org.apache.openjpa.jdbc.sql.DBDictionary.serialize(DBDictionary.java:1510) > at >org.apache.openjpa.jdbc.sql.DBDictionary.setBlobObject(DBDictionary.java:1 >010) > at >org.apache.openjpa.jdbc.sql.DBDictionary.setTyped(DBDictionary.java:1337) > at org.apache.openjpa.jdbc.sql.RowImpl.flush(RowImpl.java:896) > at org.apache.openjpa.jdbc.sql.RowImpl.flush(RowImpl.java:856) > at >org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate >(PreparedStatementManagerImpl.java:117) > at >org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushA >ndUpdate(BatchingPreparedStatementManagerImpl.java:79) > at >org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal( >PreparedStatementManagerImpl.java:100) > at >org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(Prepared >StatementManagerImpl.java:88) > at >org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpd >ateManager.java:550) > at >org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpd >ateManager.java:106) > at >org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(Batch >ingConstraintUpdateManager.java:59) > at >org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateM >anager.java:105) > at >org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateM >anager.java:78) > at >org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.jav >a:732) > at >org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreMana >ger.java:131) > ... 39 more >Caused by: <openjpa-2.2.2-r422266:1468616 nonfatal general error> >org.apache.openjpa.persistence.PersistenceException: >org.apache.oozie.BinaryBlob > at >org.apache.openjpa.util.Serialization.serialize(Serialization.java:67) > at >org.apache.openjpa.jdbc.sql.DBDictionary.serialize(DBDictionary.java:1510) > at >org.apache.openjpa.jdbc.sql.DBDictionary.setBlobObject(DBDictionary.java:1 >010) > at >org.apache.openjpa.jdbc.sql.DBDictionary.setTyped(DBDictionary.java:1337) > at org.apache.openjpa.jdbc.sql.RowImpl.flush(RowImpl.java:896) > at org.apache.openjpa.jdbc.sql.RowImpl.flush(RowImpl.java:856) > at >org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate >(PreparedStatementManagerImpl.java:117) > at >org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushA >ndUpdate(BatchingPreparedStatementManagerImpl.java:79) > at >org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal( >PreparedStatementManagerImpl.java:100) > at >org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(Prepared >StatementManagerImpl.java:88) > at >org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpd >ateManager.java:550) > at >org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpd >ateManager.java:106) > at >org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(Batch >ingConstraintUpdateManager.java:59) > at >org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateM >anager.java:105) > at >org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateM >anager.java:78) > at >org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.jav >a:732) > at >org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreMana >ger.java:131) > ... 39 more >Caused by: java.io.NotSerializableException: org.apache.oozie.BinaryBlob > at >java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1164) > at >java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:330) > at >org.apache.openjpa.util.Serialization.serialize(Serialization.java:63) > ... 55 more >2013-11-04 17:12:12,943 WARN V1JobsServlet:542 - >SERVER[BZhangs-MacBook-Pro.local] USER[bzhang] GROUP[-] TOKEN[] >APP[map-reduce-wf] JOB[0000000-131104170850462-oozie-bzha-W] ACTION[-] >URL[POST http://localhost:11000/oozie/v2/jobs?action=start] error[E0803], >E0803: IO error, E0603: SQL error in operation, ><openjpa-2.2.2-r422266:1468616 fatal store error> org.apa >che.openjpa.persistence.RollbackException: The transaction has been >rolled back. See the nested exceptions for details on the errors that >occurred. >org.apache.oozie.servlet.XServletException: E0803: IO error, E0603: SQL >error in operation, <openjpa-2.2.2-r422266:1468616 fatal store error> >org.apache.openjpa.persistence.RollbackException: The transaction has >been rolled back. See the nested exceptions for details on the errors >that occurred. > at >org.apache.oozie.servlet.V1JobsServlet.submitWorkflowJob(V1JobsServlet.jav >a:193) > at >org.apache.oozie.servlet.V1JobsServlet.submitJob(V1JobsServlet.java:88) > at >org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:99) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:643) > at >org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:286) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:723) > at >org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicati >onFilterChain.java:290) > at >org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilter >Chain.java:206) > at >org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:126) > at >org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFi >lter(AuthenticationFilter.java:372) > at >org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:131) > at >org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicati >onFilterChain.java:235) > at >org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilter >Chain.java:206) > at >org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:84) > at >org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicati >onFilterChain.java:235) > at >org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilter >Chain.java:206) > at >org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve. >java:233) > at >org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve. >java:191) > at >org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:1 >27) > at >org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:1 >03) > at >org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.ja >va:109) > at >org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293 >) > at >org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:861) > at >org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Ht >tp11Protocol.java:606) > at >org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) > at java.lang.Thread.run(Thread.java:680) >Caused by: org.apache.oozie.DagEngineException: E0803: IO error, E0603: >SQL error in operation, <openjpa-2.2.2-r422266:1468616 fatal store error> >org.apache.openjpa.persistence.RollbackException: The transaction has >been rolled back. See the nested exceptions for details on the errors >that occurred. > at org.apache.oozie.DagEngine.submitJob(DagEngine.java:116) > at >org.apache.oozie.servlet.V1JobsServlet.submitWorkflowJob(V1JobsServlet.jav >a:188) > ... 25 more >Caused by: org.apache.oozie.command.CommandException: E0803: IO error, >E0603: SQL error in operation, <openjpa-2.2.2-r422266:1468616 fatal store >error> org.apache.openjpa.persistence.RollbackException: The transaction >has been rolled back. See the nested exceptions for details on the >errors that occurred. > at >org.apache.oozie.command.wf.SubmitXCommand.execute(SubmitXCommand.java:252 >) > at >org.apache.oozie.command.wf.SubmitXCommand.execute(SubmitXCommand.java:72) > at org.apache.oozie.command.XCommand.call(XCommand.java:280) > at org.apache.oozie.DagEngine.submitJob(DagEngine.java:109) > ... 26 more >Caused by: org.apache.oozie.command.CommandException: E0603: SQL error in >operation, <openjpa-2.2.2-r422266:1468616 fatal store error> >org.apache.openjpa.persistence.RollbackException: The transaction has >been rolled back. See the nested exceptions for details on the errors >that occurred. > at >org.apache.oozie.command.wf.SubmitXCommand.execute(SubmitXCommand.java:231 >) > ... 29 more >Caused by: org.apache.oozie.executor.jpa.JPAExecutorException: E0603: SQL >error in operation, <openjpa-2.2.2-r422266:1468616 fatal store error> >org.apache.openjpa.persistence.RollbackException: The transaction has >been rolled back. See the nested exceptions for details on the errors >that occurred. > at >org.apache.oozie.service.JPAService.executeBatchInsertUpdateDelete(JPAServ >ice.java:392) > at >org.apache.oozie.executor.jpa.BatchQueryExecutor.executeBatchInsertUpdateD >elete(BatchQueryExecutor.java:140) > at >org.apache.oozie.command.wf.SubmitXCommand.execute(SubmitXCommand.java:228 >) > ... 29 more >Caused by: <openjpa-2.2.2-r422266:1468616 fatal store error> >org.apache.openjpa.persistence.RollbackException: The transaction has >been rolled back. See the nested exceptions for details on the errors >that occurred. > at >org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl. >java:594) > at >org.apache.oozie.service.JPAService.executeBatchInsertUpdateDelete(JPAServ >ice.java:388) > ... 31 more >Caused by: <openjpa-2.2.2-r422266:1468616 fatal general error> >org.apache.openjpa.persistence.PersistenceException: The transaction has >been rolled back. See the nested exceptions for details on the errors >that occurred. > at >org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:234 >7) > at >org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2184) > at >org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2082) > at >org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:2000 >) > at >org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.j >ava:81) > at >org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1524) > at >org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:93 >3) > at >org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl. >java:570) > ... 32 more >Caused by: <openjpa-2.2.2-r422266:1468616 nonfatal general error> >org.apache.openjpa.persistence.PersistenceException: >org.apache.oozie.BinaryBlob > at >org.apache.openjpa.util.Serialization.serialize(Serialization.java:67) > at >org.apache.openjpa.jdbc.sql.DBDictionary.serialize(DBDictionary.java:1510) > at >org.apache.openjpa.jdbc.sql.DBDictionary.setBlobObject(DBDictionary.java:1 >010) > at >org.apache.openjpa.jdbc.sql.DBDictionary.setTyped(DBDictionary.java:1337) > at org.apache.openjpa.jdbc.sql.RowImpl.flush(RowImpl.java:896) > at org.apache.openjpa.jdbc.sql.RowImpl.flush(RowImpl.java:856) > at >org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate >(PreparedStatementManagerImpl.java:117) > at >org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushA >ndUpdate(BatchingPreparedStatementManagerImpl.java:79) > at >org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal( >PreparedStatementManagerImpl.java:100) > at >org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(Prepared >StatementManagerImpl.java:88) > at >org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpd >ateManager.java:550) > at >org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpd >ateManager.java:106) > at >org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(Batch >ingConstraintUpdateManager.java:59) > at >org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateM >anager.java:105) > at >org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateM >anager.java:78) > at >org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.jav >a:732) > at >org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreMana >ger.java:131) > ... 39 more >Caused by: java.io.NotSerializableException: org.apache.oozie.BinaryBlob > at >java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1164) > at >java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:330) > at >org.apache.openjpa.util.Serialization.serialize(Serialization.java:63) > ... 55 more > >Could this be related to oozie-1462? I don't see the config in >oozie-site.xml to turn the compression off. Virag, can you take a look at >it? I am using mysql 5.6. > > >Bowen
