Nice test script! Maybe put it in the wiki :) People love having script examples to copy-paste.
On Wed, Apr 22, 2015 at 1:21 AM, Abraham Elmahrek <[email protected]> wrote: > Hey guys, > > +1 LGTM: > > - Verified signatures > - Verified checksums > - Verified tag > - Build and unit tests work fine > - Manually tested new authorization work > - Ran the script below successfuly > *mysql.sqoop* > > set option --name verbose --value true > > // Create generic MySQL link > create link --cid 4 --name mysql --link-linkConfig-connectionString > jdbc:mysql://.../test --link-linkConfig-username sqoop > --link-linkConfig-password sqoop --link-linkConfig-jdbcDriver > com.mysql.jdbc.Driver > > // Create HDFS link > create link --cid 3 --name hdfs --link-linkConfig-uri hdfs://...:8020/ > > // Create Kite hdfs link > create link --cid 1 --name kitehdfs --link-linkConfig-authority ...:8020 > > // Create Kite hive link > create link --cid 1 --name kitehive --link-linkConfig-authority ...:9083 > > // Create MySQL to HDFS Job > create job --from 1 --to 2 --name mysql2hdfs > --from-fromJobConfig-tableName fl --to-toJobConfig-outputFormat TEXT_FILE > --to-toJobConfig-compression NONE --to-toJobConfig-outputDirectory > /tmp/sqoop2/hdfs/text > > // Create HDFS to MySQL Job > create job --from 2 --to 1 --name hdfs2mysql > --from-fromJobConfig-inputDirectory /tmp/sqoop2/hdfs/text > --to-toJobConfig-tableName fl > > // Create MySQL to Kite - HDFS Job > create job --from 1 --to 3 --name mysql2kitehdfsavro > --from-fromJobConfig-tableName test --to-toJobConfig-uri > dataset:hdfs:/tmp/sqoop2/kite/avro --to-toJobConfig-fileFormat AVRO > > // Create MySQL to Kite - HDFS Job > create job --from 1 --to 3 --name mysql2kitehdfsparquet > --from-fromJobConfig-tableName test --to-toJobConfig-uri > dataset:hdfs:/tmp/sqoop2/kite/parquet --to-toJobConfig-fileFormat PARQUET > > // Create MySQL to Kite - Hive Job > create job --from 1 --to 4 --name mysql2kitehiveavro > --from-fromJobConfig-tableName test --to-toJobConfig-uri > dataset:hive:tmp/avro --to-toJobConfig-fileFormat AVRO > > // Create MySQL to Kite - Hive Job > create job --from 1 --to 4 --name mysql2kitehiveparquet > --from-fromJobConfig-tableName test --to-toJobConfig-uri > dataset:hive:tmp/parquet --to-toJobConfig-fileFormat PARQUET > > // Create Kive - Hive to MySQL > create job --from 4 --to 1 --name kitehiveavro2mysql > --from-fromJobConfig-uri dataset:hive:tmp/avro --to-toJobConfig-tableName > test > > // Create Kive - Hive to MySQL > create job --from 4 --to 1 --name kitehiveparquet2mysql > --from-fromJobConfig-uri dataset:hive:tmp/parquet > --to-toJobConfig-tableName test > > // Create Kive - HDFS to MySQL > create job --from 3 --to 1 --name kitehdfsavro2mysql > --from-fromJobConfig-uri dataset:hdfs:/tmp/sqoop2/kite/avro > --to-toJobConfig-tableName test > > // Create Kive - HDFS to MySQL > create job --from 3 --to 1 --name kitehdfsparquet2mysql > --from-fromJobConfig-uri dataset:hdfs:/tmp/sqoop2/kite/parquet > --to-toJobConfig-tableName test > > On Sun, Apr 19, 2015 at 11:01 PM, Zhou, Richard <[email protected]> > wrote: > >> Hi all Sqoop developers, >> >> This is the release candidate 1 of Sqoop 2, version 1.99.6. There are 3 >> purposes of this release: >> >> - Role Based Access Control ( >> https://issues.apache.org/jira/browse/SQOOP-1763 ) >> - Making the Rest API backwards compatible ( >> https://issues.apache.org/jira/browse/SQOOP-2162 ) >> - Fixing Sqoop2 upgrade path ( >> https://issues.apache.org/jira/browse/SQOOP-1841 ) >> >> *** Please cast your vote by Friday 2015-4-23 *** >> >> The list of fixed issues: >> >> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12328967&styleName=Text&projectId=12311320&Create=Create&atl_token=A5KQ-2QAV-T4JA-FDED%7Cfacf4add2faf24a264f9ea680204bc568b1401b0%7Clin >> >> The tarball (*.tar.gz), signature (*.asc), checksum (*.md5, *.sha): >> http://people.apache.org/~abe/sqoop/releases/1.99.6/rc1/ >> >> The tag to be voted upon: >> >> https://git-wip-us.apache.org/repos/asf?p=sqoop.git;a=tag;h=refs/tags/release-1.99.6-rc1 >> >> The KEYS file: >> http://www.apache.org/dist/sqoop/KEYS >> >> Thanks Abe for the great support to make it happen. >> >> >> Regards >> Richard >> >>
