However, with Sqoop 1.4.4, all schema and table names are lower-case, and
it is successful to make import.
As a result, I am not sure if case sensitivity will be a problem in Sqoop 2.
*This is the connection I created:*
1 connection(s) to show:
Connection with id 1 and name ds_msg_log (Created 9/2/13 10:54 AM, Updated
9/3/13 6:35 PM)
Using Connector id 1
Connection configuration
JDBC Driver Class: org.postgresql.Driver
JDBC Connection String: jdbc:postgresql://MY_IP:MY_PORT/invoice
Username: hadoop
Password:
JDBC Connection Properties:
Security related configuration options
Max connections: 123
*This is the job I created:*
Job with id 3 and name ds_msg_log (Created 9/2/13 11:37 AM, Updated 9/3/13
5:57 PM)
Using Connection id 1 and Connector id 1
Database configuration
Schema name: invoice
Table name: ds_msg_log
Table SQL statement:
Table column names:
Partition column name:
Boundary query:
Output configuration
Storage type: HDFS
Output format: TEXT_FILE
Output directory: /user/root/ds_msg_log_sqoop2
Throttling resources
Extractors:
Loaders:
*The command I use to start this job is:*
submission start --jid 3
On Wed, Sep 4, 2013 at 9:24 AM, Abraham Elmahrek <[email protected]> wrote:
> Sorry, I missed that you are using PostGreSQL. I think case sensitivity
> will be a problem with that database.
>
>
> On Tue, Sep 3, 2013 at 6:23 PM, Abraham Elmahrek <[email protected]> wrote:
>
>> What database are you using? Are table names or schema names case
>> sensitive in your database? Sqoop quotes all names, so case sensitivity
>> makes a difference here.
>>
>> Also, could you provide the corresponding Sqoop 1.4.4 command that worked
>> for you?
>>
>> -Abe
>>
>>
>> On Tue, Sep 3, 2013 at 6:06 PM, 陳彥廷(Yanting Chen) <[email protected]
>> > wrote:
>>
>>> I am pretty sure that the schema "invoice" exists because I successfully
>>> imported data to this schema using Sqoop 1.4.4
>>>
>>> Also, I already remove "*" when creating job.
>>>
>>> The following is the table in invoice schema:
>>> TABLE DS_MSG_LOG
>>> (
>>> MESSAGE_ID VARCHAR2(23) NOT NULL,
>>> LOGIN_ID VARCHAR2(30),
>>> ACPT_DTS TIMESTAMP(6),
>>> DLVR_DTS TIMESTAMP(6),
>>> SENDER_ID VARCHAR2(30),
>>> SENDER_VAC_ID VARCHAR2(39),
>>> RECEIVER_ID VARCHAR2(30),
>>> RECEIVER_VAC_ID VARCHAR2(39),
>>> STATUS VARCHAR2(1),
>>> MESSAGE_TYPE VARCHAR2(8),
>>> FLOW_TYPE VARCHAR2(5),
>>> SERVICE_TYPE VARCHAR2(1),
>>> SOURCE_FILE_NAME VARCHAR2(150),
>>> ARCHIVE_FILE_NAME VARCHAR2(250),
>>> ARCHIVE_CHAR_COUNT NUMBER,
>>> DECRYPT_FILE_NAME VARCHAR2(250),
>>> DECRYPT_CHAR_COUNT NUMBER,
>>> RESP_FILE_NAME VARCHAR2(250),
>>> RESP_CHAR_COUNT NUMBER,
>>> RESP_FLAG VARCHAR2(1),
>>> RTG_SEQ VARCHAR2(8),
>>> RESENT_FLAG VARCHAR2(1) DEFAULT 'N',
>>> TOTAL_INV_COUNT NUMBER,
>>> CONSTRAINT PK_DS_MSG_LOG PRIMARY KEY (MESSAGE_ID)
>>> )
>>>
>>>
>>> On Wed, Sep 4, 2013 at 1:46 AM, Abraham Elmahrek <[email protected]>wrote:
>>>
>>>> Hey User,
>>>>
>>>> It looks like the schema "invoice" does not exist in your database.
>>>> Could you please provide your database schema? Also, "*" is unnecessary
>>>> when specifying "Table column names". If you leave it blank it will import
>>>> all columns by default.
>>>>
>>>> -Abe
>>>>
>>>>
>>>> On Tue, Sep 3, 2013 at 3:03 AM, 陳彥廷(Yanting Chen) <
>>>> [email protected]> wrote:
>>>>
>>>>> According to the official guide,
>>>>> http://sqoop.apache.org/docs/1.99.2/Sqoop5MinutesDemo.html , I
>>>>> successfully created a job.
>>>>>
>>>>> However, when I executed the command, submission start --jid 1, I got
>>>>> this error message: "Exception has occurred during processing command
>>>>> Server has returned exception: Exception: java.lang.Throwable Message:
>>>>> GENERIC_JDBC_CONNECTOR_0002:Unable to execute the SQL statement"
>>>>>
>>>>> This is the information of my job.
>>>>>
>>>>> Database configuration
>>>>>
>>>>> Schema name: invoice
>>>>> Table name: ds_msg_log
>>>>> Table SQL statement:
>>>>> Table column names: *
>>>>> Partition column name:
>>>>> Boundary query:
>>>>>
>>>>> Output configuration
>>>>>
>>>>> Storage type: HDFS
>>>>> Output format: TEXT_FILE
>>>>> Output directory: /user/root/ds_msg_log
>>>>>
>>>>> Throttling resources Extractors: Loaders:
>>>>>
>>>>> Since there is no information in the official guide talking about how
>>>>> to set the values above, does any know anything wrong in my job setting?
>>>>>
>>>>> This is the log: Stack trace: at
>>>>> org.apache.sqoop.connector.jdbc.GenericJdbcExecutor
>>>>> (GenericJdbcExecutor.java:59)
>>>>> at org.apache.sqoop.connector.jdbc.GenericJdbcImportInitializer
>>>>> (GenericJdbcImportInitializer.java:155)
>>>>> at org.apache.sqoop.connector.jdbc.GenericJdbcImportInitializer
>>>>> (GenericJdbcImportInitializer.java:48)
>>>>> at org.apache.sqoop.connector.jdbc.GenericJdbcImportInitializer
>>>>> (GenericJdbcImportInitializer.java:37)
>>>>> at org.apache.sqoop.framework.FrameworkManager
>>>>> (FrameworkManager.java:447)
>>>>> at org.apache.sqoop.handler.SubmissionRequestHandler
>>>>> (SubmissionRequestHandler.java:112)
>>>>> at org.apache.sqoop.handler.SubmissionRequestHandler
>>>>> (SubmissionRequestHandler.java:98)
>>>>> at org.apache.sqoop.handler.SubmissionRequestHandler
>>>>> (SubmissionRequestHandler.java:68)
>>>>> at org.apache.sqoop.server.v1.SubmissionServlet
>>>>> (SubmissionServlet.java:44)
>>>>> at org.apache.sqoop.server.SqoopProtocolServlet
>>>>> (SqoopProtocolServlet.java:63)
>>>>> at javax.servlet.http.HttpServlet (HttpServlet.java:637)
>>>>> at javax.servlet.http.HttpServlet (HttpServlet.java:717)
>>>>> at org.apache.catalina.core.ApplicationFilterChain
>>>>> (ApplicationFilterChain.java:290)
>>>>> at org.apache.catalina.core.ApplicationFilterChain
>>>>> (ApplicationFilterChain.java:206)
>>>>> at org.apache.catalina.core.StandardWrapperValve
>>>>> (StandardWrapperValve.java:233)
>>>>> at org.apache.catalina.core.StandardContextValve
>>>>> (StandardContextValve.java:191)
>>>>> at org.apache.catalina.core.StandardHostValve
>>>>> (StandardHostValve.java:127)
>>>>> at org.apache.catalina.valves.ErrorReportValve
>>>>> (ErrorReportValve.java:102)
>>>>> at org.apache.catalina.core.StandardEngineValve
>>>>> (StandardEngineValve.java:109)
>>>>> at org.apache.catalina.connector.CoyoteAdapter (CoyoteAdapter.java:293)
>>>>> at org.apache.coyote.http11.Http11Processor (Http11Processor.java:859)
>>>>> at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler
>>>>> (Http11Protocol.java:602)
>>>>> at org.apache.tomcat.util.net.JIoEndpoint$Worker (JIoEndpoint.java:489)
>>>>> at java.lang.Thread (Thread.java:724)
>>>>> Caused by: Exception: java.lang.Throwable Message: ERROR: schema
>>>>> "invoice" does not exist Position: 46 Stack trace: at
>>>>> org.postgresql.core.v3.QueryExecutorImpl (QueryExecutorImpl.java:2102)
>>>>> at org.postgresql.core.v3.QueryExecutorImpl
>>>>> (QueryExecutorImpl.java:1835)
>>>>> at org.postgresql.core.v3.QueryExecutorImpl
>>>>> (QueryExecutorImpl.java:257)
>>>>> at org.postgresql.jdbc2.AbstractJdbc2Statement
>>>>> (AbstractJdbc2Statement.java:500)
>>>>> at org.postgresql.jdbc2.AbstractJdbc2Statement
>>>>> (AbstractJdbc2Statement.java:374)
>>>>> at org.postgresql.jdbc2.AbstractJdbc2Statement
>>>>> (AbstractJdbc2Statement.java:254)
>>>>> at org.apache.sqoop.connector.jdbc.GenericJdbcExecutor
>>>>> (GenericJdbcExecutor.java:56)
>>>>> at org.apache.sqoop.connector.jdbc.GenericJdbcImportInitializer
>>>>> (GenericJdbcImportInitializer.java:155)
>>>>> at org.apache.sqoop.connector.jdbc.GenericJdbcImportInitializer
>>>>> (GenericJdbcImportInitializer.java:48)
>>>>> at org.apache.sqoop.connector.jdbc.GenericJdbcImportInitializer
>>>>> (GenericJdbcImportInitializer.java:37)
>>>>> at org.apache.sqoop.framework.FrameworkManager
>>>>> (FrameworkManager.java:447)
>>>>> at org.apache.sqoop.handler.SubmissionRequestHandler
>>>>> (SubmissionRequestHandler.java:112)
>>>>> at org.apache.sqoop.handler.SubmissionRequestHandler
>>>>> (SubmissionRequestHandler.java:98)
>>>>> at org.apache.sqoop.handler.SubmissionRequestHandler
>>>>> (SubmissionRequestHandler.java:68)
>>>>> at org.apache.sqoop.server.v1.SubmissionServlet
>>>>> (SubmissionServlet.java:44)
>>>>> at org.apache.sqoop.server.SqoopProtocolServlet
>>>>> (SqoopProtocolServlet.java:63)
>>>>> at javax.servlet.http.HttpServlet (HttpServlet.java:637)
>>>>> at javax.servlet.http.HttpServlet (HttpServlet.java:717)
>>>>> at org.apache.catalina.core.ApplicationFilterChain
>>>>> (ApplicationFilterChain.java:290)
>>>>> at org.apache.catalina.core.ApplicationFilterChain
>>>>> (ApplicationFilterChain.java:206)
>>>>> at org.apache.catalina.core.StandardWrapperValve
>>>>> (StandardWrapperValve.java:233)
>>>>> at org.apache.catalina.core.StandardContextValve
>>>>> (StandardContextValve.java:191)
>>>>> at org.apache.catalina.core.StandardHostValve
>>>>> (StandardHostValve.java:127)
>>>>> at org.apache.catalina.valves.ErrorReportValve
>>>>> (ErrorReportValve.java:102)
>>>>> at org.apache.catalina.core.StandardEngineValve
>>>>> (StandardEngineValve.java:109)
>>>>> at org.apache.catalina.connector.CoyoteAdapter (CoyoteAdapter.java:293)
>>>>> at org.apache.coyote.http11.Http11Processor (Http11Processor.java:859)
>>>>> at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler
>>>>> (Http11Protocol.java:602)
>>>>> at org.apache.tomcat.util.net.JIoEndpoint$Worker (JIoEndpoint.java:489)
>>>>> at java.lang.Thread (Thread.java:724)
>>>>>
>>>>
>>>>
>>>
>>
>
