Re: [ANNOUNCE] Welcome Thomas Bennett as OODT committer and PMC member

2011-06-02 Thread Thomas Bennett
+ > Adjunct Assistant Professor, Computer Science Department > University of Southern California, Los Angeles, CA 90089 USA > ++ > > -- Thomas Bennett SKA South Africa Office : +2721 506 7341 Mobile : +2779 523 7105 Email : tbenn...@ska.ac.za

Re: [jira] [Commented] (OODT-52) Update the CAS File Manager User Guide

2011-09-22 Thread Thomas Bennett
Hi Cameron, Thanks for your reply. I've start a wiki page. https://cwiki.apache.org/confluence/display/OODT/OODT+Filemgr+User+Guide Regards, Tom On 22 September 2011 06:20, Cameron Goodale (JIRA) wrote: > >[ > https://issues.apache.org/jira/browse/OODT-52?page=com.atlassian.jira.plugin.sy

Re: [jira] [Commented] (OODT-52) Update the CAS File Manager User Guide

2011-09-27 Thread Thomas Bennett
Hi Cameron, I previously built another wiki page that is dedicated to File Manager > Policy. If you ever decide to tackle that part of File Manager I have a > pretty good start you can fold back into the User Guide. > > > https://cwiki.apache.org/confluence/display/OODT/Everything+you+want+to+kno

Re: [jira] [Commented] (OODT-325) QueryTool does not retain query order

2011-10-07 Thread Thomas Bennett
; > > > QueryTool does not retain query order > > - > > > > Key: OODT-325 > > URL: https://issues.apache.org/jira/browse/OODT-325 > > Project: OODT > > Issue Type: Improvement

Re: OODT Wiki Content Organized

2011-10-31 Thread Thomas Bennett
chris.a.mattm...@nasa.gov > WWW: http://sunset.usc.edu/~mattmann/ > ++ > Adjunct Assistant Professor, Computer Science Department > University of Southern California, Los Angeles, CA 90089 USA > ++++++++++

Introspecting the XML-RPC interfaces

2011-11-28 Thread Thomas Bennett
Hi, I'm currently looking into integrating the cas-filemgr and cas-crawler into our python based monitor and control implementation for the KAT-7 telescope. I've been having an email conversation with Chris and Cameron about developing the python code, when I suggested that it would be cool to ma

Re: Filemgr query not returning list of values

2012-03-09 Thread Thomas Bennett
Hey Sheryl, Just to let you know that I've also experienced exactly the same problem. Cheers, Tom Sent from my iPhone On 10 Mar 2012, at 1:37 AM, Sheryl John wrote: > Hi, > > I'm working with 0.4-SNAPSHOT( not latest build) and when querying the > Filemanager on a multivalue key, it's not r

Re: Filemgr query not returning list of values

2012-03-12 Thread Thomas Bennett
;ll dig a bit further and keep you guys posted. Cheers, Tom On 12 March 2012 05:56, Mattmann, Chris A (388J) < chris.a.mattm...@jpl.nasa.gov> wrote: > Hey Tom, > > OK, I'll take a look at this with Paul R. too... > > Cheers, > Chris > > On Mar 9, 2012, at

Re: Filemgr query not returning list of values

2012-03-12 Thread Thomas Bennett
just fine. As Chris > mentioned my next step is going to be to look into the new CLI stuff. > Hmmm. Bazaar. I'll recheck what I've seen and get back to you with more details ;) Cheers, Tom > > --Paul > > Sent from my iPhone > > On Mar 12, 2012, at 1:28 AM, "

Review Request: Drop Spring logging levels from WARNING to SEVERE

2012-03-14 Thread Thomas Bennett
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4342/ --- Review request for oodt and brian Foster. Summary --- Drop Spring logging l

crawler actionIds

2012-03-22 Thread Thomas Bennett
Hi, I can't seem to add multiple actionIds when I launch a crawler. Specifying a single actionId seems to work. I'm just wondering if I need to specify the actionId's in a different way. Note I'm not using the script + abs paths to configuration files. Cheers, Tom Command executed: ~$ java -Do

Re: crawler actionIds

2012-03-22 Thread Thomas Bennett
Sorry forgot to mention that I'm using 0.4. ;-) On 22 March 2012 16:02, Thomas Bennett wrote: > Hi, > > I can't seem to add multiple actionIds when I launch a crawler. Specifying > a single actionId seems to work. > > I'm just wondering if I need to specify

Re: crawler actionIds

2012-03-22 Thread Thomas Bennett
7;ll create an > issue describing the problem and post the fix so you can patch it in as soon > as i have something. > > -brian > > On Mar 22, 2012, at 07:07 AM, Thomas Bennett wrote: > >> Sorry forgot to mention that I'm using 0.4. ;-) >> >>

Re: crawler actionIds

2012-03-22 Thread Thomas Bennett
> On Mar 22, 2012, at 01:36 PM, Brian Foster wrote: > >> hey thomas, >> >> i know what the problem is... working on the fix right now... i'll create an >> issue describing the problem and post the fix so you can patch it in as soon >> as i have som

Re: crawler actionIds

2012-03-22 Thread Thomas Bennett
01:36 PM, Brian Foster wrote: > >> hey thomas, >> >> i know what the problem is... working on the fix right now... i'll create an >> issue describing the problem and post the fix so you can patch it in as soon >> as i have something. >> >> -bria

Review Request: CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options

2012-03-23 Thread Thomas Bennett
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4465/ --- Review request for oodt, Chris Mattmann, brian Foster, Paul Ramirez, and Sheryl J

Re: Review Request: CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options

2012-03-23 Thread Thomas Bennett
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4465/ --- (Updated 2012-03-23 09:47:04.472182) Review request for oodt, Chris Mattmann, br

Re: [jira] [Commented] (OODT-430) CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options like noRecur

2012-03-23 Thread Thomas Bennett
>> >>Key: OODT-430 >>URL: https://issues.apache.org/jira/browse/OODT-430 >>Project: OODT >> Issue Type: Bug >> Components: crawler >> Affects V

Re: Review Request: CrawlerBeansPropHandler doesn't set list properties for Spring PropertyOverrideConfigurer correctly

2012-03-26 Thread Thomas Bennett
; Review request for oodt, Chris Mattmann, Ricky Nguyen, Paul Ramirez, and > Thomas Bennett. > > > Summary > --- > > It currently was setting lists keys to: value1,value2,value3,... > > This patch will instead change it to: > key[0] = value1 > key[1] = value2

Re: crawler actionIds

2012-03-26 Thread Thomas Bennett
Hi Chris, I'm wondering if the beans are named DeleteDataFile and DeleteMetadataFile: > have you checked the action-beans.xml file? > If I understand you're question correctly, yes, the beans are named DeleteDataFile and DeleteMetadataFile in the action-beans.xml. Since there have been a few iss

Re: svn commit: r1304212 - /oodt/trunk/crawler/src/main/resources/cmd-line-options.xml

2012-03-26 Thread Thomas Bennett
Hey Chris, Ooops. Thanks for the pointers. Hopefully I'll iron out all the noob mistakes soon enough! I sensed I was missing something hence my email reply with the issue summary. > Thanks for this. If this was tied to a JIRA issue, it's always a good > practice to ref the JIRA issue > in your

Review Request: Get product references before calling retrieveProduct(). Update unit tests testRetrieveFilesById() and testRetrieveFilesByName()

2012-03-29 Thread Thomas Bennett
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4553/ --- Review request for oodt, Chris Mattmann, brian Foster, Paul Ramirez, and Sheryl J

Re: Review Request: Get product references before calling retrieveProduct(). Update unit tests testRetrieveFilesById() and testRetrieveFilesByName()

2012-03-29 Thread Thomas Bennett
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4553/ --- (Updated 2012-03-29 12:26:06.602271) Review request for oodt, Chris Mattmann, br

Re: Review Request: Get product references before calling retrieveProduct(). Update unit tests testRetrieveFilesById() and testRetrieveFilesByName()

2012-03-30 Thread Thomas Bennett
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4553/ --- (Updated 2012-03-30 08:45:40.520457) Review request for oodt, Chris Mattmann, br

Re: OODT-402 progress update

2012-04-01 Thread Thomas Bennett
Hey Ross, I also wanted to say great work so far, looks very promising! Regards, Tom On 1 April 2012 18:59, Cameron Goodale wrote: > Ross, > > I agree with Chris that you are doing a great job on this. Thank you for > all the hard work in setting this up. Having a standard geospatial > inter

Review Request: String search and replace getMetadata("UUID with getMetadata("CAS.ProductId

2012-04-12 Thread Thomas Bennett
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4709/ --- Review request for oodt, Chris Mattmann, brian Foster, Paul Ramirez, and Sheryl J

Re: Review Request: String search and replace getMetadata("UUID with getMetadata("CAS.ProductId

2012-04-17 Thread Thomas Bennett
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4709/ --- (Updated 2012-04-17 14:36:54.936567) Review request for oodt, Chris Mattmann, br

Review Request: Crawler command line bugs

2012-05-03 Thread Thomas Bennett
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4989/ --- Review request for oodt, Chris Mattmann, brian Foster, Paul Ramirez, and Sheryl J

Re: [jira] [Commented] (OODT-454) Crawler command line bugs

2012-05-04 Thread Thomas Bennett
Hey Chris, > Hey Tom, nothing to do with you here, but (maybe for bfost) -- why did this > action name change to TriggerPostIngestWorkflow? Good catch!That's why you're the boss man. I think I'm mixing up my TriggerPostIngestWorkflow with my WorkflowMgrStatusUpdate. :-) I'll confirm, update an

Re: OODT SoCal Meetup/Hackathon

2012-05-21 Thread Thomas Bennett
Hey, Totally awesome idea. Wish I could be there to join in ;). If this becomes a more regular event - keep me posted. I'll be in the US in November - it would be great way to meet the team. Cheers, Tom On 18 May 2012 07:16, Cameron Goodale wrote: > I think the pool/house idea sounds great. I

Re: [jira] [Commented] (OODT-454) Crawler command line bugs

2012-06-18 Thread Thomas Bennett
Hi, Sorry for the late reply. I'm at isc12 in Hamburg and have been traveling with no Internet access. I'm okay to push to 0.5 - its a really minor issue. Thanks for the reply. Chuss, Tom. -- Thomas Bennett SKA South Africa Office: +2721 506 7341 Mobile: +2779 523 7105 Em

Re: [jira] [Commented] (OODT-454) Crawler command line bugs

2012-06-18 Thread Thomas Bennett
Kind regards from Hamburg, Tom. -- Thomas Bennett SKA South Africa Office: +2721 506 7341 Mobile: +2779 523 7105 Email: tbenn...@ska.ac.za On 17 Jun 2012, at 7:11 AM, "Ramirez, Paul M (388J)" wrote: > I don't mind rolling a new one. > > --Paul > > Sent from m

Re: Problem happened when I tried to run the script "crawler_launcher"

2012-08-13 Thread Thomas Bennett
Hey YunHee and Chris, Sorry I've been out of the office for the last week and I've not gotten around to check my emails yet :). YunHee, apologies for the stale documentation relating to the crawler. I'll head over there and update the guide to reflect the new interface when I get some free time.

Re: [jira] [Resolved] (OODT-592) Native Solr implementation of CAS File manager

2013-04-29 Thread Thomas Bennett
Hey Luca, Thanks for this. I'm going to give it a whirl too. Great work! Cheers, Tom On 27 April 2013 17:56, Cinquini, Luca (3980) wrote: > Thanks Rishi, there's two guides on the apache wiki by the way. > Let me know if you find any problems, > Luca > > > > > On Apr 27, 2013, at 9:50 AM, "Ver

Re: [jira] [Resolved] (OODT-592) Native Solr implementation of CAS File manager

2013-04-30 Thread Thomas Bennett
+Guide > > > https://cwiki.apache.org/confluence/display/OODT/Solr+File+Manager+Developer%27s+Guide > > thanks, Luca > > On Apr 29, 2013, at 1:10 AM, Thomas Bennett wrote: > > > Hey Luca, > > > > Thanks for this. I'm going to give it a whirl too. Great work! >

Re: [jira] [Resolved] (OODT-592) Native Solr implementation of CAS File manager

2013-05-24 Thread Thomas Bennett
t; > > https://cwiki.apache.org/confluence/display/OODT/Solr+File+Manager+Quick+Start+Guide > > > https://cwiki.apache.org/confluence/display/OODT/Solr+File+Manager+Developer%27s+Guide > > thanks, Luca > > On Apr 29, 2013, at 1:10 AM, Thomas Bennett wrote: > > > H

Re: [jira] [Resolved] (OODT-592) Native Solr implementation of CAS File manager

2013-05-29 Thread Thomas Bennett
sferStatus().equals(Product.STATUS_RECEIVED); > } > > If you agree, I will make the change. This should solve your problem > > thanks, Luca > > On May 24, 2013, at 2:31 AM, Thomas Bennett wrote: > > > Hey Luca, > > > > I'm getting my Solr

Re: OODT build issues (Fwd: APPS Third-party (TPS) software component list)

2013-06-24 Thread Thomas Bennett
Hi Greg, On 22 June 2013 20:51, Mattmann, Chris A (398J) < chris.a.mattm...@jpl.nasa.gov> wrote: > > > >(2) CAS Protocol SFTP Implementation > > > >The "TestJschSftpProtocol" test is failing because it can't contact > >whatever server it is trying to contact ("Connection refused"). > > Od

Re: OODT Documentation Organisation

2013-07-15 Thread Thomas Bennett
Hey Tom, +1 from me. I'm keen to change it. Cheers, Tom On 12 July 2013 22:18, Tom Barber wrote: > Hi guys > > Whilst working on getting to know OODT better I walked through the CAS > Curation tutorial on the website and found it both hard to read and buggy > in places. I also (as a newbie) f

Re: Filemgr Operations

2014-03-23 Thread Thomas Bennett
Hey Tom, Are you perhaps looking for deleteProductById and deleteProductByName? Cheers, Tom On 23 March 2014 00:15, Tom Barber wrote: > Another random question, > > So you use the Ingester class to check hasProduct and ingest files... > how do you remove stuff from filemgr? > > Just a thou

Re: Filemgr Operations

2014-03-24 Thread Thomas Bennett
x27;,description='Product name'] $ filemgr-client --url http://localhost:9101 --operation --deleteProductByName *--productName $PROD_NAME* I can finally delete that product :) Cheers, Tom On 23 March 2014 22:16, Tom Barber wrote: > Sounds about right, I didn't delve too de

Metadata based versioning

2014-05-27 Thread Thomas Bennett
Hey, When calling *XmlRpcFileManager.ingestProduct()*, I noticed that the variable *"m"* (Metadata m = new Metadata()) is never updated with server side met extraction. This means that metadata based versioning cannot work unless the metadata used is client side metadata. For example: I use C

Re: Metadata based versioning

2014-05-30 Thread Thomas Bennett
Hey Chris, Thanks for your reply. I think you may have clarified some of my understanding of oodt under the hood. Woot. (or is that woodt?) Firstly, from OODT-72 I can see how the design decisions were made. It just so happens that I'm wanting the filename for versioning and suddenly I understan

Review Request 22302: Exception when creating a zipfile of a hierarchical product

2014-06-06 Thread Thomas Bennett
: https://reviews.apache.org/r/22302/diff/ Testing --- Unit test passes Thanks, Thomas Bennett

Re: [jira] [Closed] (OODT-703) DataUtil.createProductZipFile throws exception when creating a zipfile of a hierarchical product

2014-06-09 Thread Thomas Bennett
t > University of Southern California, Los Angeles, CA 90089 USA > ++++++++++ > > > > > > > -Original Message- > From: "Thomas Bennett (JIRA)" > Reply-To: "dev@oodt.apache.org" > Date: Monday, June 9, 2014 12:25 AM >

Re: Where can I find the best "getting started" documentation?

2014-06-10 Thread Thomas Bennett
Hey Valerie, I maintain the following two guides: https://cwiki.apache.org/confluence/display/OODT/OODT+Filemgr+User+Guide https://cwiki.apache.org/confluence/display/OODT/OODT+Crawler+Help I see that the guides are a little out of date (they're still based on an older snapshot of OODT). I will

Re: Remote data transfer

2014-08-16 Thread Thomas Bennett
e there any tutorials you would recommend? > > Thanks > Etienne > > > From: Mattmann, Chris A (3980) [chris.a.mattm...@jpl.nasa.gov] > Sent: Wednesday, August 13, 2014 6:04 PM > To: Etienne Koen; Thomas Bennett > Cc: cschol...@sk

Re: Remote data transfer

2014-08-18 Thread Thomas Bennett
o? > > Regards > Etienne > ________ > From: Thomas Bennett [tho...@ska.ac.za] > Sent: Friday, August 15, 2014 9:54 AM > To: Etienne Koen > Cc: Mattmann, Chris A (3980); cschol...@ska.ac.za; dev@oodt.apache.org > Subject: Re: Remote data transfe

Re: Remote data transfer

2014-08-18 Thread Thomas Bennett
+ > Adjunct Associate Professor, Computer Science Department > University of Southern California, Los Angeles, CA 90089 USA > ++++++++++ > > > > > > > -Original Message- > From: Etienne Koen > > Date: Monday, August 18, 2014 2:36 AM > To: Thomas Bennett >

Datastore references for a duplicate products

2015-04-22 Thread Thomas Bennett
Hi, Okay - so a 'flat' product has a single datastore reference. So, how do you handle redundant copies of products? At the moment I have an independent catalogue at each site. I was thinking of a site metadata key, so multiple products can be filtered, but I thought I would see what other peopl

Re: Datastore references for a duplicate products

2015-04-23 Thread Thomas Bennett
Hey Chris, Thanks for your reply :) >Or does that totally break the OODT model? It probably does... > > Nope doesn’t break the model at all - the Product with structure > ProductStructure.HIERARCHICAL works fine with this - data transfers > work fine - metadata retrieval works fine (try ingesting

Re: Datastore references for a duplicate products

2015-04-23 Thread Thomas Bennett
Hey Lewis, Well do you want to retain them or discard them? Yeah. We keep the copy while we still can. I'm more interested in tying our current databases together so that I have one place I can query for duplicates - stuff could also be on tape. > Are you interested in provenance tracking?

Re: Datastore references for a duplicate products

2015-04-23 Thread Thomas Bennett
Hi Bruce, Interesting! As a note on practice, NASA's ERBE and CERES projects > (the latter continuing on JPSS) use a hierarchical categorization > of files. Just so that I understand - do you add to the hierarchy over time - i.e like a version control same product each added reference is a newe

Big data conference

2015-06-03 Thread Thomas Bennett
Hey, I'm submitting a talk for the Apache Big Data conference in September. It would be great to hook up with any other OODT'lings that might be going or considering going. Anyone going? Cheers, Tom Bennett

Re: Big data conference

2015-06-03 Thread Thomas Bennett
t; Thanks > > On Wed, Jun 3, 2015 at 3:06 AM, Thomas Bennett > wrote: > > > Hey, > > > > I'm submitting a talk for the Apache Big Data conference in September. > > > > It would be great to hook up with any other OODT'lings that might be > goin

Re: [VOTE] Move Apache OODT SCM to Apache Git

2015-09-23 Thread Thomas Bennett
+1 On 23 September 2015 at 02:24, Lewis John Mcgibbney < lewis.mcgibb...@gmail.com> wrote: > Hi Folks, > Lets have a formal VOTE on the above topic further to our DISCUSS thread > [0]. > The VOTE will be open for at least 72 hours. > > VOTE to move the Apache OODT source code management from SVN