Hi Eduardo,
Thanks for the reply.
I’m not running a sqoop command yet, I’m setting up the Job object as described
in the link below. Because I can never get further than the error message
“There are issues with entered data, please revise your input:”, I can’t
proceed to run the job, and without further guidance on what input to revise, I
don’t know how to complete the creation of my Job object.
Can you see anything wrong with the details I have entered? Here’s a copy of
the info I’m entering (a blank line means I’ve entered hit CR at that prompt,
also I have obfuscated my schema, table and column names for this email):
sqoop:000> create job -f "sqoop-link-redshift" -t "sqoop-link-hdfs"
Creating job for links with from name sqoop-link-redshift and to name
sqoop-link-hdfs
Please fill following values to create new job object
Name: sqoop-job-import-test
Database source
Schema name: sqoop
Table name: sqoop
SQL statement: select distinct [field] from [schema].[table] where [date
field]>20180101 and ${CONDITIONS};
Column names:
There are currently 0 values in the list:
element#
Partition column:
Partition column nullable:
Boundary query:
Incremental read
Check column:
Last value:
Target configuration
Override null value:
Null value:
File format:
0 : TEXT_FILE
1 : SEQUENCE_FILE
2 : PARQUET_FILE
Choose: 0
Compression codec:
0 : NONE
1 : DEFAULT
2 : DEFLATE
3 : GZIP
4 : BZIP2
5 : LZO
6 : LZ4
7 : SNAPPY
8 : CUSTOM
Choose: 0
Custom codec: 0
Output directory: /user/hadoop/redshift
Append mode:
Throttling resources
Extractors:
Loaders:
Classpath configuration
Extra mapper jars:
There are currently 0 values in the list:
element#
There are issues with entered data, please revise your input:
Name: sqoop-job-import-test
Thanks!
Tony
From: Eduardo Mello [mailto:[email protected]]
Sent: 02 January 2018 13:43
To: [email protected]
Subject: Re: please revise your input?
Hello Tony,
Can u please send the sqoop command (or an example) that are u using?
Att,
Eduardo Mello
On Tue, Jan 2, 2018 at 8:37 AM, Tony Burton
<[email protected]<mailto:[email protected]>> wrote:
Hi,
Anyone got any suggestions for this? Thanks!
Tony
From: Tony Burton
[mailto:[email protected]<mailto:[email protected]>]
Sent: 19 December 2017 15:10
To: [email protected]<mailto:[email protected]>
Subject: please revise your input?
Hi,
I’m using sqoop 1.99.7 with hadoop 2.6.4 for the first time, and I’m having
trouble setting up a sqoop job. I’ve successfully created a couple of links,
one is a JDCB connection to an AWS Redshift database, the other an HDFS
connection to a local Hadoop installation.
I’m following the guidelines at
http://sqoop.apache.org/docs/1.99.7/user/Sqoop5MinutesDemo.html#creating-job-object
and https://sqoop.apache.org/docs/1.99.7/user/CommandLineClient.html, and I am
entering a simple sql command (select distinct [field] from [schema].[table]
where date>[date] and ${CONDITIONS}) , a file format (text), a compression
codec (none), and an output directory (/user/hadoop/redshift).
When all the data is entered, I get the error message “There are issues with
entered data, please revise your input:”
How do I find out what is wrong, and what I need to change? Are there any
non-optional parameters that I need to enter?
Thanks,
Tony
Tony Burton
e: [email protected]<mailto:[email protected]>
[https://media.sportingindex.com/zmsmedia/vsporting%20index/rebrand/sportingsolutions_logotype_rgb_v2.png]<https://www.sportingsolutions.com/>
This email and any attachments are confidential, protected by copyright and may
be legally privileged. If you are not the intended recipient, then the
dissemination or copying of this email is prohibited. If you have received this
in error, please notify the sender by replying by email and then delete the
email completely from your system. Neither Sporting Group nor the sender
accepts responsibility for any virus, or any other defect which might affect
any computer or IT system into which the email is received and/or opened. It is
the responsibility of the recipient to scan the email and no responsibility is
accepted for any loss or damage arising in any way from receipt or use of this
email. Sporting Index Ltd is a company registered in England and Wales with
company number 2636842, whose registered office is at Gateway House, Milverton
Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the
UK Financial Conduct Authority (reg. no. 150404) and UK Gambling Commission
(reg. no. 000-027343-R-308898-001). Any financial promotion contained herein
has been issued and approved by Sporting Index Ltd. Sporting Solutions is the
trading name of SPIN Services Ltd, a company registered in England and Wales
with company number 06268648, whose registered office is at Gateway House,
Milverton Street, London, SE11 4AP.
This email and any attachments are confidential, protected by copyright and may
be legally privileged. If you are not the intended recipient, then the
dissemination or copying of this email is prohibited. If you have received this
in error, please notify the sender by replying by email and then delete the
email completely from your system. Neither Sporting Group nor the sender
accepts responsibility for any virus, or any other defect which might affect
any computer or IT system into which the email is received and/or opened. It is
the responsibility of the recipient to scan the email and no responsibility is
accepted for any loss or damage arising in any way from receipt or use of this
email. Sporting Index Ltd is a company registered in England and Wales with
company number 2636842, whose registered office is at Gateway House, Milverton
Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the
UK Financial Conduct Authority (reg. no. 150404) and UK Gambling Commission
(reg. no. 000-027343-R-308898-001). Any financial promotion contained herein
has been issued and approved by Sporting Index Ltd. Sporting Solutions is the
trading name of SPIN Services Ltd, a company registered in England and Wales
with company number 06268648, whose registered office is at Gateway House,
Milverton Street, London, SE11 4AP.
This email and any attachments are confidential, protected by copyright and may
be legally privileged. If you are not the intended recipient, then the
dissemination or copying of this email is prohibited. If you have received this
in error, please notify the sender by replying by email and then delete the
email completely from your system. Neither Sporting Group nor the sender
accepts responsibility for any virus, or any other defect which might affect
any computer or IT system into which the email is received and/or opened. It is
the responsibility of the recipient to scan the email and no responsibility is
accepted for any loss or damage arising in any way from receipt or use of this
email. Sporting Index Ltd is a company registered in England and Wales with
company number 2636842, whose registered office is at Gateway House, Milverton
Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the
UK Financial Conduct Authority (reg. no. 150404) and UK Gambling Commission
(reg. no. 000-027343-R-308898-001). Any financial promotion contained herein
has been issued and approved by Sporting Index Ltd. Sporting Solutions is the
trading name of SPIN Services Ltd, a company registered in England and Wales
with company number 06268648, whose registered office is at Gateway House,
Milverton Street, London, SE11 4AP.
