Re: Exporting hive table data into oracle give date format error

[Jarek Jarcec Cecho]

[-CC h...@user.apache.org]

Hi Ajit,
would you mind upgrading to Sqoop 1.4.3? We've improved the logging for this 
particular exception, so it should significantly help in triangulating your 
issue.

Jarcec

On Wed, Mar 13, 2013 at 01:43:11PM +, Ajit Kumar Shreevastava wrote:
 Hi All,
 
 Can you please let me know how can I bypass this error. I am currently using 
 Apache  SQOOP version 1.4.2.
 
 
 [hadoop@NHCLT-PC44-2 sqoop-oper]$ sqoop export --connect 
 jdbc:oracle:thin:@10.99.42.11:1521/clouddb --username HDFSUSER  --table 
 BTTN_BKP_TEST --export-dir  /home/hadoop/user/hive/warehouse/bttn_bkp -P -m 1 
  --input-fields-terminated-by '\0001' --verbose --input-null-string '\\N' 
 --input-null-non-string '\\N'
 
 Please set $HBASE_HOME to the root of your HBase installation.
 13/03/13 18:20:42 DEBUG tool.BaseSqoopTool: Enabled debug logging.
 Enter password:
 13/03/13 18:20:47 DEBUG sqoop.ConnFactory: Loaded manager factory: 
 com.cloudera.sqoop.manager.DefaultManagerFactory
 13/03/13 18:20:47 DEBUG sqoop.ConnFactory: Trying ManagerFactory: 
 com.cloudera.sqoop.manager.DefaultManagerFactory
 13/03/13 18:20:47 DEBUG manager.DefaultManagerFactory: Trying with scheme: 
 jdbc:oracle:thin:@10.99.42.11
 13/03/13 18:20:47 DEBUG manager.OracleManager$ConnCache: Instantiated new 
 connection cache.
 13/03/13 18:20:47 INFO manager.SqlManager: Using default fetchSize of 1000
 13/03/13 18:20:47 DEBUG sqoop.ConnFactory: Instantiated ConnManager 
 org.apache.sqoop.manager.OracleManager@74b23210
 13/03/13 18:20:47 INFO tool.CodeGenTool: Beginning code generation
 13/03/13 18:20:47 DEBUG manager.OracleManager: Using column names query: 
 SELECT t.* FROM BTTN_BKP_TEST t WHERE 1=0
 13/03/13 18:20:47 DEBUG manager.OracleManager: Creating a new connection for 
 jdbc:oracle:thin:@10.99.42.11:1521/clouddb, using username: HDFSUSER
 13/03/13 18:20:47 DEBUG manager.OracleManager: No connection paramenters 
 specified. Using regular API for making connection.
 13/03/13 18:20:47 INFO manager.OracleManager: Time zone has been set to GMT
 13/03/13 18:20:47 DEBUG manager.SqlManager: Using fetchSize for next query: 
 1000
 13/03/13 18:20:47 INFO manager.SqlManager: Executing SQL statement: SELECT 
 t.* FROM BTTN_BKP_TEST t WHERE 1=0
 13/03/13 18:20:47 DEBUG manager.OracleManager$ConnCache: Caching released 
 connection for jdbc:oracle:thin:@10.99.42.11:1521/clouddb/HDFSUSER
 13/03/13 18:20:47 DEBUG orm.ClassWriter: selected columns:
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   BTTN_ID
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   DATA_INST_ID
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   SCR_ID
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   BTTN_NU
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   CAT
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   WDTH
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   HGHT
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   KEY_SCAN
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   KEY_SHFT
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   FRGND_CPTN_COLR
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   FRGND_CPTN_COLR_PRSD
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   BKGD_CPTN_COLR
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   BKGD_CPTN_COLR_PRSD
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   BLM_FL
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   LCLZ_FL
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   MENU_ITEM_NU
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   BTTN_ASGN_LVL_ID
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   ON_ATVT
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   ON_CLIK
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   ENBL_FL
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   BLM_SET_ID
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   BTTN_ASGN_LVL_NAME
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   MKT_ID
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   CRTE_TS
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   CRTE_USER_ID
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   UPDT_TS
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   UPDT_USER_ID
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   DEL_TS
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   DEL_USER_ID
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   DLTD_FL
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   MENU_ITEM_NA
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   PRD_CD
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   BLM_SET_NA
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   SOUND_FILE_ID
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   IS_DYNMC_BTTN
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   FRGND_CPTN_COLR_ID
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   FRGND_CPTN_COLR_PRSD_ID
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   BKGD_CPTN_COLR_ID
 13/03/13 18:20:47 DEBUG orm.ClassWriter:   BKGD_CPTN_COLR_PRSD_ID
 13/03/13 18:20:47 DEBUG orm.ClassWriter: Writing source file: 
 /tmp/sqoop-hadoop/compile/69b6a9d2ebb99cebced808e559528531/BTTN_BKP_TEST.java
 13/03/13 18:20:47 DEBUG orm.ClassWriter: Table name: BTTN_BKP_TEST
 13/03/13 18:20:47 DEBUG orm.ClassWriter: Columns: BTTN_ID:2, DATA_INST_ID:2, 
 SCR_ID:2, BTTN_NU:2, CAT:2, WDTH:2, HGHT:2, KEY_SCAN:2, KEY_SHFT:2, 
 

Exporting hive table data into oracle give date format error

[Ajit Kumar Shreevastava]

Hi All,

Can you please let me know how can I bypass this error. I am currently using 
Apache  SQOOP version 1.4.2.


[hadoop@NHCLT-PC44-2 sqoop-oper]$ sqoop export --connect 
jdbc:oracle:thin:@10.99.42.11:1521/clouddb --username HDFSUSER  --table 
BTTN_BKP_TEST --export-dir  /home/hadoop/user/hive/warehouse/bttn_bkp -P -m 1  
--input-fields-terminated-by '\0001' --verbose --input-null-string '\\N' 
--input-null-non-string '\\N'

Please set $HBASE_HOME to the root of your HBase installation.
13/03/13 18:20:42 DEBUG tool.BaseSqoopTool: Enabled debug logging.
Enter password:
13/03/13 18:20:47 DEBUG sqoop.ConnFactory: Loaded manager factory: 
com.cloudera.sqoop.manager.DefaultManagerFactory
13/03/13 18:20:47 DEBUG sqoop.ConnFactory: Trying ManagerFactory: 
com.cloudera.sqoop.manager.DefaultManagerFactory
13/03/13 18:20:47 DEBUG manager.DefaultManagerFactory: Trying with scheme: 
jdbc:oracle:thin:@10.99.42.11
13/03/13 18:20:47 DEBUG manager.OracleManager$ConnCache: Instantiated new 
connection cache.
13/03/13 18:20:47 INFO manager.SqlManager: Using default fetchSize of 1000
13/03/13 18:20:47 DEBUG sqoop.ConnFactory: Instantiated ConnManager 
org.apache.sqoop.manager.OracleManager@74b23210
13/03/13 18:20:47 INFO tool.CodeGenTool: Beginning code generation
13/03/13 18:20:47 DEBUG manager.OracleManager: Using column names query: SELECT 
t.* FROM BTTN_BKP_TEST t WHERE 1=0
13/03/13 18:20:47 DEBUG manager.OracleManager: Creating a new connection for 
jdbc:oracle:thin:@10.99.42.11:1521/clouddb, using username: HDFSUSER
13/03/13 18:20:47 DEBUG manager.OracleManager: No connection paramenters 
specified. Using regular API for making connection.
13/03/13 18:20:47 INFO manager.OracleManager: Time zone has been set to GMT
13/03/13 18:20:47 DEBUG manager.SqlManager: Using fetchSize for next query: 1000
13/03/13 18:20:47 INFO manager.SqlManager: Executing SQL statement: SELECT t.* 
FROM BTTN_BKP_TEST t WHERE 1=0
13/03/13 18:20:47 DEBUG manager.OracleManager$ConnCache: Caching released 
connection for jdbc:oracle:thin:@10.99.42.11:1521/clouddb/HDFSUSER
13/03/13 18:20:47 DEBUG orm.ClassWriter: selected columns:
13/03/13 18:20:47 DEBUG orm.ClassWriter:   BTTN_ID
13/03/13 18:20:47 DEBUG orm.ClassWriter:   DATA_INST_ID
13/03/13 18:20:47 DEBUG orm.ClassWriter:   SCR_ID
13/03/13 18:20:47 DEBUG orm.ClassWriter:   BTTN_NU
13/03/13 18:20:47 DEBUG orm.ClassWriter:   CAT
13/03/13 18:20:47 DEBUG orm.ClassWriter:   WDTH
13/03/13 18:20:47 DEBUG orm.ClassWriter:   HGHT
13/03/13 18:20:47 DEBUG orm.ClassWriter:   KEY_SCAN
13/03/13 18:20:47 DEBUG orm.ClassWriter:   KEY_SHFT
13/03/13 18:20:47 DEBUG orm.ClassWriter:   FRGND_CPTN_COLR
13/03/13 18:20:47 DEBUG orm.ClassWriter:   FRGND_CPTN_COLR_PRSD
13/03/13 18:20:47 DEBUG orm.ClassWriter:   BKGD_CPTN_COLR
13/03/13 18:20:47 DEBUG orm.ClassWriter:   BKGD_CPTN_COLR_PRSD
13/03/13 18:20:47 DEBUG orm.ClassWriter:   BLM_FL
13/03/13 18:20:47 DEBUG orm.ClassWriter:   LCLZ_FL
13/03/13 18:20:47 DEBUG orm.ClassWriter:   MENU_ITEM_NU
13/03/13 18:20:47 DEBUG orm.ClassWriter:   BTTN_ASGN_LVL_ID
13/03/13 18:20:47 DEBUG orm.ClassWriter:   ON_ATVT
13/03/13 18:20:47 DEBUG orm.ClassWriter:   ON_CLIK
13/03/13 18:20:47 DEBUG orm.ClassWriter:   ENBL_FL
13/03/13 18:20:47 DEBUG orm.ClassWriter:   BLM_SET_ID
13/03/13 18:20:47 DEBUG orm.ClassWriter:   BTTN_ASGN_LVL_NAME
13/03/13 18:20:47 DEBUG orm.ClassWriter:   MKT_ID
13/03/13 18:20:47 DEBUG orm.ClassWriter:   CRTE_TS
13/03/13 18:20:47 DEBUG orm.ClassWriter:   CRTE_USER_ID
13/03/13 18:20:47 DEBUG orm.ClassWriter:   UPDT_TS
13/03/13 18:20:47 DEBUG orm.ClassWriter:   UPDT_USER_ID
13/03/13 18:20:47 DEBUG orm.ClassWriter:   DEL_TS
13/03/13 18:20:47 DEBUG orm.ClassWriter:   DEL_USER_ID
13/03/13 18:20:47 DEBUG orm.ClassWriter:   DLTD_FL
13/03/13 18:20:47 DEBUG orm.ClassWriter:   MENU_ITEM_NA
13/03/13 18:20:47 DEBUG orm.ClassWriter:   PRD_CD
13/03/13 18:20:47 DEBUG orm.ClassWriter:   BLM_SET_NA
13/03/13 18:20:47 DEBUG orm.ClassWriter:   SOUND_FILE_ID
13/03/13 18:20:47 DEBUG orm.ClassWriter:   IS_DYNMC_BTTN
13/03/13 18:20:47 DEBUG orm.ClassWriter:   FRGND_CPTN_COLR_ID
13/03/13 18:20:47 DEBUG orm.ClassWriter:   FRGND_CPTN_COLR_PRSD_ID
13/03/13 18:20:47 DEBUG orm.ClassWriter:   BKGD_CPTN_COLR_ID
13/03/13 18:20:47 DEBUG orm.ClassWriter:   BKGD_CPTN_COLR_PRSD_ID
13/03/13 18:20:47 DEBUG orm.ClassWriter: Writing source file: 
/tmp/sqoop-hadoop/compile/69b6a9d2ebb99cebced808e559528531/BTTN_BKP_TEST.java
13/03/13 18:20:47 DEBUG orm.ClassWriter: Table name: BTTN_BKP_TEST
13/03/13 18:20:47 DEBUG orm.ClassWriter: Columns: BTTN_ID:2, DATA_INST_ID:2, 
SCR_ID:2, BTTN_NU:2, CAT:2, WDTH:2, HGHT:2, KEY_SCAN:2, KEY_SHFT:2, 
FRGND_CPTN_COLR:12, FRGND_CPTN_COLR_PRSD:12, BKGD_CPTN_COLR:12, 
BKGD_CPTN_COLR_PRSD:12, BLM_FL:2, LCLZ_FL:2, MENU_ITEM_NU:2, 
BTTN_ASGN_LVL_ID:2, ON_ATVT:2, ON_CLIK:2, ENBL_FL:2, BLM_SET_ID:2, 
BTTN_ASGN_LVL_NAME:12, MKT_ID:2, CRTE_TS:93, CRTE_USER_ID:12, UPDT_TS:93, 
UPDT_USER_ID:12, DEL_TS:93, DEL_USER_ID:12, DLTD_FL:2, MENU_ITEM_NA:12, 
PRD_CD:2, BLM_SET_NA:12,