Louis Mau created SQOOP-1251:
--------------------------------

             Summary: Sqoop job performing Incremental import hangs after the 
successful import
                 Key: SQOOP-1251
                 URL: https://issues.apache.org/jira/browse/SQOOP-1251
             Project: Sqoop
          Issue Type: Bug
          Components: metastore
    Affects Versions: 1.4.3
            Reporter: Louis Mau


To reproduce the problem, create an incremental import job.
$SQOOP_HOME/bin/sqoop job --create mergetest -- import --options-file 
sqoop-params.txt --table mergetest --incremental lastmodified --check-column 
lastmod -m 1
In subsequent "exec", the import completed successfully but the process  hung.

It appears that hsqldb v1.8 used in the metastore only allows "a single session 
at a time performs an SQL statement completely, before the next session is 
allowed access."    In this scenario, the JobTool created a session to retrieve 
the previously saved Job info and the ImportTool created a separate connection 
for saving incremental info.    Adding a connection.rollback() call in the 
read(String jobName) method of  HsqldbJobStorage.java eliminated the hang.   
Upgrading hsqldb to v2.0 might also resolve the problem.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Reply via email to