Re: OODT Officially Stable - Hats off to Ross Laidlaw
Great work Ross. I know it hasn't been easy getting those tests fixed up, so thank you for being persistent and seeing it through. -Cam On Fri, Aug 8, 2014 at 2:05 PM, Ross Laidlaw wrote: > Thanks all! Glad to contribute! There are some remaining issues to > discuss/resolve with file manager tests (e.g. see OODT-736 and OODT-741), > but we're getting there! > > There are also some issues with the protocol tests that Chris highlighted > in OODT-644. So Jenkins builds will probably still fail sometimes, but > hopefully we can fix these soon. > > > Ross > > > > On 8 August 2014 13:47, Verma, Rishi (398J) > wrote: > >> Way to go Ross, way to go everyone! >> >> Rishi >> Sent from my iPhone >> >> On Aug 8, 2014, at 1:29 PM, "Chris Mattmann" >> wrote: >> >> > Fscking awesome!! >> > >> > Thank you Ross and everyone! >> > >> > >> > Chris Mattmann >> > chris.mattm...@gmail.com >> > >> > >> > >> > >> > -Original Message- >> > From: Tom Barber >> > Reply-To: >> > Date: Friday, August 8, 2014 1:07 PM >> > To: >> > Subject: Re: OODT Officially Stable - Hats off to Ross Laidlaw >> > >> >> Wp >> >> On 8 Aug 2014 21:05, "Lewis John Mcgibbney" > > >> >> wrote: >> >> >> >> Folks, >> >> >> >> The OODT trunk (0.7-SNAPSHOT) codebase is stable [0] now for the first >> >> time in a while which is extremely good news. >> >> >> >> I personally (and I'm sure I speak on behalf of many of us) am >> extremely >> >> appreciative of the work Ross has recently put in to ensuring the >> >> codebase is stabalized. >> >> >> >> Hats off Ross. The drinks are on me... and make sure to remind me about >> >> it. >> >> >> >> Have a great weekend folks. >> >> >> >> Lewis >> >> >> >> [0] https://builds.apache.org/job/oodt-trunk/1438/ >> >> >> >> >> >> -- >> >> Lewis >> > >> > >> > >
Re: OODT Officially Stable - Hats off to Ross Laidlaw
ACK AutoACK +1 Bewm On Sat, Aug 9, 2014 at 8:10 AM, Cameron Goodale wrote: > Great work Ross. I know it hasn't been easy getting those tests fixed up, > so thank you for being persistent and seeing it through. > > -Cam > > > On Fri, Aug 8, 2014 at 2:05 PM, Ross Laidlaw > wrote: > > > Thanks all! Glad to contribute! There are some remaining issues to > > discuss/resolve with file manager tests (e.g. see OODT-736 and OODT-741), > > but we're getting there! > > > > There are also some issues with the protocol tests that Chris highlighted > > in OODT-644. So Jenkins builds will probably still fail sometimes, but > > hopefully we can fix these soon. > > > > > > Ross > > > > > > > > On 8 August 2014 13:47, Verma, Rishi (398J) > > wrote: > > > >> Way to go Ross, way to go everyone! > >> > >> Rishi > >> Sent from my iPhone > >> > >> On Aug 8, 2014, at 1:29 PM, "Chris Mattmann" > >> wrote: > >> > >> > Fscking awesome!! > >> > > >> > Thank you Ross and everyone! > >> > > >> > > >> > Chris Mattmann > >> > chris.mattm...@gmail.com > >> > > >> > > >> > > >> > > >> > -Original Message- > >> > From: Tom Barber > >> > Reply-To: > >> > Date: Friday, August 8, 2014 1:07 PM > >> > To: > >> > Subject: Re: OODT Officially Stable - Hats off to Ross Laidlaw > >> > > >> >> Wp > >> >> On 8 Aug 2014 21:05, "Lewis John Mcgibbney" < > lewis.mcgibb...@gmail.com > >> > > >> >> wrote: > >> >> > >> >> Folks, > >> >> > >> >> The OODT trunk (0.7-SNAPSHOT) codebase is stable [0] now for the > first > >> >> time in a while which is extremely good news. > >> >> > >> >> I personally (and I'm sure I speak on behalf of many of us) am > >> extremely > >> >> appreciative of the work Ross has recently put in to ensuring the > >> >> codebase is stabalized. > >> >> > >> >> Hats off Ross. The drinks are on me... and make sure to remind me > about > >> >> it. > >> >> > >> >> Have a great weekend folks. > >> >> > >> >> Lewis > >> >> > >> >> [0] https://builds.apache.org/job/oodt-trunk/1438/ > >> >> > >> >> > >> >> -- > >> >> Lewis > >> > > >> > > >> > > > > > -- *Lewis*
Re: OODT Officially Stable - Hats off to Ross Laidlaw
Ba-Bewm Chris Mattmann chris.mattm...@gmail.com -Original Message- From: Lewis John Mcgibbney Reply-To: Date: Saturday, August 9, 2014 10:38 AM To: "dev@oodt.apache.org" Subject: Re: OODT Officially Stable - Hats off to Ross Laidlaw >ACK >AutoACK >+1 >Bewm > > >On Sat, Aug 9, 2014 at 8:10 AM, Cameron Goodale >wrote: > >> Great work Ross. I know it hasn't been easy getting those tests fixed >>up, >> so thank you for being persistent and seeing it through. >> >> -Cam >> >> >> On Fri, Aug 8, 2014 at 2:05 PM, Ross Laidlaw >> wrote: >> >> > Thanks all! Glad to contribute! There are some remaining issues to >> > discuss/resolve with file manager tests (e.g. see OODT-736 and >>OODT-741), >> > but we're getting there! >> > >> > There are also some issues with the protocol tests that Chris >>highlighted >> > in OODT-644. So Jenkins builds will probably still fail sometimes, >>but >> > hopefully we can fix these soon. >> > >> > >> > Ross >> > >> > >> > >> > On 8 August 2014 13:47, Verma, Rishi (398J) >> > wrote: >> > >> >> Way to go Ross, way to go everyone! >> >> >> >> Rishi >> >> Sent from my iPhone >> >> >> >> On Aug 8, 2014, at 1:29 PM, "Chris Mattmann" >> >> >> wrote: >> >> >> >> > Fscking awesome!! >> >> > >> >> > Thank you Ross and everyone! >> >> > >> >> > >> >> > Chris Mattmann >> >> > chris.mattm...@gmail.com >> >> > >> >> > >> >> > >> >> > >> >> > -Original Message- >> >> > From: Tom Barber >> >> > Reply-To: >> >> > Date: Friday, August 8, 2014 1:07 PM >> >> > To: >> >> > Subject: Re: OODT Officially Stable - Hats off to Ross Laidlaw >> >> > >> >> >> Wp >> >> >> On 8 Aug 2014 21:05, "Lewis John Mcgibbney" < >> lewis.mcgibb...@gmail.com >> >> > >> >> >> wrote: >> >> >> >> >> >> Folks, >> >> >> >> >> >> The OODT trunk (0.7-SNAPSHOT) codebase is stable [0] now for the >> first >> >> >> time in a while which is extremely good news. >> >> >> >> >> >> I personally (and I'm sure I speak on behalf of many of us) am >> >> extremely >> >> >> appreciative of the work Ross has recently put in to ensuring the >> >> >> codebase is stabalized. >> >> >> >> >> >> Hats off Ross. The drinks are on me... and make sure to remind me >> about >> >> >> it. >> >> >> >> >> >> Have a great weekend folks. >> >> >> >> >> >> Lewis >> >> >> >> >> >> [0] https://builds.apache.org/job/oodt-trunk/1438/ >> >> >> >> >> >> >> >> >> -- >> >> >> Lewis >> >> > >> >> > >> >> >> > >> > >> > > > >-- >*Lewis*
Review Request 24529: CAS-PGE no longer respects writers and file tags from earlier pgeConfig.xml files
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24529/ --- Review request for oodt. Bugs: OODT-667 https://issues.apache.org/jira/browse/OODT-667 Repository: oodt Description --- This patch restores functionality and fixes CAS-PGE in trunk for users expecting 0.3 CAS-PGE and before style configuration in which you didn't need a MIME extractor repo and could configure CAS-PGE entirely from the pge-config.xml files. This patch effectively makes CAS-PGE usable again in trunk for 0.7 and going forward and is fully forward compatible with Brian's changes. If you specify a MIME extractor repo, you get an AutoDetectCrawler - otherwise you get the familiar StdProductCrawler. Diffs - ./trunk/metadata/src/main/java/org/apache/oodt/cas/metadata/filenaming/PathUtilsNamingConvention.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/PGETaskInstance.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/config/OutputDir.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/config/PgeConfigMetKeys.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/config/RegExprOutputFiles.java PRE-CREATION ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/metadata/PgeMetadata.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/metadata/PgeTaskMetKeys.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/metadata/PgeTaskStatus.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/util/GenericPgeObjectFactory.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/util/XmlHelper.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/CsvConfigFileWriter.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/DynamicConfigFileWriter.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/ExternExtractorMetWriter.java PRE-CREATION ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/FilenameExtractorWriter.java PRE-CREATION ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/MetadataKeyReplacerTemplateWriter.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/PcsMetFileWriter.java PRE-CREATION ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/SciPgeConfigFileWriter.java PRE-CREATION ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/TextConfigFileWriter.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/VelocityConfigFileWriter.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/XslTransformWriter.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/metlist/MetadataListPcsMetFileWriter.java PRE-CREATION ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/xslt/XslTransformWriter.java PRE-CREATION ./trunk/pge/src/main/resources/examples/PgeConfigFiles/pge-config.xml 1616402 ./trunk/pge/src/test/java/org/apache/oodt/cas/pge/staging/TestFileStager.java 1616402 ./trunk/pge/src/test/java/org/apache/oodt/cas/pge/writers/MockDynamicConfigFileWriter.java 1616402 Diff: https://reviews.apache.org/r/24529/diff/ Testing --- I've tested this on my DARPA XDATA translation ETL pipeline. Full tests are ongoing, but this works up the point of ingestion. There is something weird going on here with InPlaceIngestion, which I'm going to take a look at, and fix, but it's pretty much done. Enjoy! Thanks, Chris Mattmann
Re: Review Request 24529: CAS-PGE no longer respects writers and file tags from earlier pgeConfig.xml files
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24529/ --- (Updated Aug. 9, 2014, 10:01 p.m.) Review request for oodt. Changes --- - updated diff, now fully working and tested on DARPA XDATA. Bugs: OODT-667 https://issues.apache.org/jira/browse/OODT-667 Repository: oodt Description --- This patch restores functionality and fixes CAS-PGE in trunk for users expecting 0.3 CAS-PGE and before style configuration in which you didn't need a MIME extractor repo and could configure CAS-PGE entirely from the pge-config.xml files. This patch effectively makes CAS-PGE usable again in trunk for 0.7 and going forward and is fully forward compatible with Brian's changes. If you specify a MIME extractor repo, you get an AutoDetectCrawler - otherwise you get the familiar StdProductCrawler. Diffs (updated) - ./trunk/metadata/src/main/java/org/apache/oodt/cas/metadata/filenaming/PathUtilsNamingConvention.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/PGETaskInstance.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/config/OutputDir.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/config/PgeConfigMetKeys.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/config/RegExprOutputFiles.java PRE-CREATION ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/metadata/PgeMetadata.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/metadata/PgeTaskMetKeys.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/metadata/PgeTaskStatus.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/util/GenericPgeObjectFactory.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/util/XmlHelper.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/CsvConfigFileWriter.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/DynamicConfigFileWriter.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/ExternExtractorMetWriter.java PRE-CREATION ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/FilenameExtractorWriter.java PRE-CREATION ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/MetadataKeyReplacerTemplateWriter.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/PcsMetFileWriter.java PRE-CREATION ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/SciPgeConfigFileWriter.java PRE-CREATION ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/TextConfigFileWriter.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/VelocityConfigFileWriter.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/XslTransformWriter.java 1616402 ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/metlist/MetadataListPcsMetFileWriter.java PRE-CREATION ./trunk/pge/src/main/java/org/apache/oodt/cas/pge/writers/xslt/XslTransformWriter.java PRE-CREATION ./trunk/pge/src/main/resources/examples/PgeConfigFiles/pge-config.xml 1616402 ./trunk/pge/src/test/java/org/apache/oodt/cas/pge/metadata/TestPgeMetadata.java 1616402 ./trunk/pge/src/test/java/org/apache/oodt/cas/pge/staging/TestFileStager.java 1616402 ./trunk/pge/src/test/java/org/apache/oodt/cas/pge/writers/MockDynamicConfigFileWriter.java 1616402 Diff: https://reviews.apache.org/r/24529/diff/ Testing --- I've tested this on my DARPA XDATA translation ETL pipeline. Full tests are ongoing, but this works up the point of ingestion. There is something weird going on here with InPlaceIngestion, which I'm going to take a look at, and fix, but it's pretty much done. Enjoy! Thanks, Chris Mattmann
