Hello, everone,
I'm trying to test "import-mainframe" sqoop command added with this
patch: https://issues.apache.org/jira/browse/SQOOP-1272. It is not yet
available in any sqoop releases, so I've compiled sqoop from trunk.
As far as I understand, I could test import-mainframe using a normal ftp
server. So, I've installed one, created a directory 'empleados' and
copied some text files in it. I was hoping sqoop would download the
files from my ftp server.
Here is the command I launch and the result:
sqoop import-mainframe --connect 192.168.10.210:21 --dataset empleados
--username user1234 --password pass1234 --verbose
5/02/03 15:30:10 INFO mainframe.MainframeDatasetInputFormat: Datasets to
transfer from: empleados
15/02/03 15:30:10 DEBUG db.DBConfiguration: Fetching password from job
credentials store
220 (vsFTPd 2.2.2)
15/02/03 15:30:10 INFO util.MainframeFTPClientUtils: Connected to
192.168.10.210 on 21
USER *******
331 Please specify the password.
PASS *******
230 Login successful.
TYPE A
200 Switching to ASCII mode.
CWD 'empleados'
250 Directory successfully changed.
PASV
227 Entering Passive Mode (192,168,10,210,251,170).
LIST
150 Here comes the directory listing.
226 Directory send OK.
NOOP
200 NOOP ok.
QUIT
221 Goodbye.
15/02/03 15:30:10 INFO mapreduce.JobSubmitter: Cleaning up the staging
area /user/root/.staging/job_1422968174081_0008
15/02/03 15:30:10 WARN security.UserGroupInformation:
PriviledgedActionException as:root (auth:SIMPLE)
cause:java.io.IOException: No sequential datasets retrieved from empleados
15/02/03 15:30:10 DEBUG util.ClassLoaderStack: Restoring classloader:
sun.misc.Launcher$AppClassLoader@530f243b
15/02/03 15:30:10 ERROR tool.ImportTool: Encountered IOException running
import job: java.io.IOException: No sequential datasets retrieved from
empleados
at
org.apache.sqoop.mapreduce.mainframe.MainframeDatasetInputFormat.getSplits(MainframeDatasetInputFormat.java:65)
at
org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:493)
at
org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:510)
at
org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:394)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1295)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1292)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1554)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1292)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1313)
at
org.apache.sqoop.mapreduce.ImportJobBase.doSubmitJob(ImportJobBase.java:186)
at org.apache.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:159)
at
org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:247)
at
org.apache.sqoop.manager.MainframeManager.importTable(MainframeManager.java:97)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:497)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
I could check with tcpdump that my ftp sends a list of files from
directory 'empleados' to sqoop. However sqoop somehow sees an empty list.
If anyone has sqoop import-mainframe working, please help me resolve this.
Thanks in advance
--
AVISO CONFIDENCIAL\nEste correo y la información contenida o adjunta al mismo
es privada y confidencial y va dirigida exclusivamente a su destinatario.
Pragsis informa a quien pueda haber recibido este correo por error que contiene
información confidencial cuyo uso, copia, reproducción o distribución está
expresamente prohibida. Si no es Vd. el destinatario del mismo y recibe este
correo por error, le rogamos lo ponga en conocimiento del emisor y proceda a su
eliminación sin copiarlo, imprimirlo o utilizarlo de ningún
modo.\nCONFIDENTIALITY WARNING.\nThis message and the information contained in
or attached to it are private and confidential and intended exclusively for the
addressee. Pragsis informs to whom it may receive it in error that it contains
privileged information and its use, copy, reproduction or distribution is
prohibited. If you are not an intended recipient of this E-mail, please notify
the sender, delete it and do not read, act upon, print, disclose, copy, reta
in or redistribute any portion of this E-mail.
