Thank you for creating the JIRA Rama! Jarcec
On Fri, Jul 19, 2013 at 11:12:10PM +0530, Ramakrishna Nalam wrote: > Thanks a lot for replying, Jarek. (Dont know how i missed adding a subject > - my bad) > Have opened a feature request - > SQOOP-1146<https://issues.apache.org/jira/browse/SQOOP-1146> > > Thanks, > Rama. > > > On Fri, Jul 19, 2013 at 8:29 PM, Jarek Jarcec Cecho <[email protected]>wrote: > > > Hi Ramakrishna, > > indeed your investigation is correct, the MySQL direct import/export do > > not supports file formats other than text. Please do not hesitate and open > > a feature request for it [1]. > > > > All emails sent to apache mailing are publicly archived so that people > > looking having questions can easily search the list if the question was > > already answered. As the subject field significantly helps during search, > > please do fill this field next time. > > > > Jarcec > > > > Links: > > 1: https://issues.apache.org/jira/browse/SQOOP > > > > On Fri, Jul 19, 2013 at 05:12:34PM +0530, Ramakrishna Nalam wrote: > > > Update: Did some more digging into the logic of sqoop, realized the avro > > > check happens only in JDBCExportJob, and DirectMySQLManager uses > > > MysqlExportJob that does not extend JDBCExportJob. > > > Guessing avro is supported only for record based inputs and not bulk > > import > > > of mysql. > > > > > > The mapper itself seems to iterate over the rows, though. Can anyone help > > > me out with why is the avro format not supported by MysqlExportJob? > > > > > > Regards, > > > Rama. > > > > > > > > > > > > On Fri, Jul 19, 2013 at 9:27 AM, Ramakrishna Nalam > > > <[email protected]>wrote: > > > > > > > > > > > (Pls ignore the --direct pasted twice, I'm using it only once, the > > problem > > > > still remains) > > > > > > > > > > > > On Fri, Jul 19, 2013 at 9:25 AM, Ramakrishna Nalam < > > [email protected] > > > > > wrote: > > > > > > > >> Hi, > > > >> > > > >> I'm trying to export a set of avro files to mysql using the > > > >> DirectMysqlManager, using the sqoop export command as follows: > > > >> > > > >> sqoop export --verbose --connect jdbc:mysql://<mysqluri>/<dbname> > > > >> --direct --username <username> --password <password> --direct > > > >> --export-dir <dir with avro files> --table <tablename> > > > >> > > > >> > > > >> On running this command, I see that the job's > > *mapred.inputformat.class* as > > > >> '*org.apache.sqoop.mapreduce.ExportInputFormat'* wheras I was > > expecting > > > >> it to set it to '*org.apache.sqoop.mapreduce.AvroInputFormat**'* > > > >> > > > >> I have also checked that* > > org.apache.sqoop.mapreduce.ExportJobBase.getFileType(conf > > > >> , path ) *on the same path returns *AVRO_DATA_FILE* > > > >> > > > >> Please let me know if I'm missing something here? > > > >> > > > >> TIA, > > > >> Rama. > > > >> > > > > > > > > > >
signature.asc
Description: Digital signature
