Hi Cynthia Can you file jira issues for the oodt project @ issues.apache.org please so we can track them.
If they are bugs they need fixing if they are procedural they could do with being documented. That's not to say don't discuss here, just a place of reference so we can tidy it up. Thanks Tom On 26 Oct 2015 18:06, "Wong, Cynthia L (398G)" <cynthia.l.w...@jpl.nasa.gov> wrote: > Chris, > > Here is the filemgr.properties deployed by RADIX. I modified slightly for > my project. I also verified that FILEMGR_HOME contains valid path. The odd > is that I can ingest but I can’t delete. If there is problem with > FILEMGR_HOME, then ingest should break too. > > I originally could not check for the ingested product (-product -pn) > either due to multiple records in the catalog for the same product. I > cleaned up the catalog and ingested only one record but I still can’t > delete the product. > > Here is the segment of filemgr.properties. I noticed that lines contain > “file:[FILEMGR_HOME]” rather than “file://[FILEMGR_HOME]". > > # lucene catalog configuration > org.apache.oodt.cas.filemgr.catalog.lucene.idxPath=[OODT_HOME]/data/catalog > org.apache.oodt.cas.filemgr.catalog.lucene.pageSize=20 > org.apache.oodt.cas.filemgr.catalog.lucene.commitLockTimeout.seconds=60 > org.apache.oodt.cas.filemgr.catalog.lucene.writeLockTimeout.seconds=60 > org.apache.oodt.cas.filemgr.catalog.lucene.mergeFactor=20 > > # XML repository manager configuration > org.apache.oodt.cas.filemgr.repositorymgr.dirs=file:[FILEMGR_HOME]/policy/o > odt,file:[FILEMGR_HOME]/policy/gnss-h2o > > # XML validation layer configuration > org.apache.oodt.cas.filemgr.validation.dirs=file:[FILEMGR_HOME]/policy/oodt > ,file:[FILEMGR_HOME]/policy/gnss-h2o > > # remote data transfer configuration > org.apache.oodt.cas.filemgr.datatransfer.remote.chunkSize=1024 > > # location of Mime-Type repository > org.apache.oodt.cas.filemgr.mime.type.repository=[FILEMGR_HOME]/etc/mime-ty > pes.xml > > > > I changed those lines to have “file://[FILEMGR_HOME]" > > > # XML repository manager configuration > org.apache.oodt.cas.filemgr.repositorymgr.dirs=file://[FILEMGR_HOME]/policy > /oodt,file://[FILEMGR_HOME]/policy/gnss-h2o > > # XML validation layer configuration > org.apache.oodt.cas.filemgr.validation.dirs=file://[FILEMGR_HOME]/policy/oo > dt,file://[FILEMGR_HOME]/policy/gnss-h2o > > > % fm -dbyid -pid ca00685a-79d4-11e5-9cae-33480ce63ace > ERROR: Failed to delete product > 'org.apache.oodt.cas.filemgr.structs.Product@3d52315f' : > java.lang.Exception: java.lang.IllegalArgumentException: URI is not > absolute > > > > But, the result is same. Then, I replaced all FILEMGR_HOME in > filemgr.properties with valid paths. Same result… > > FYI. My ingest command is as below: > > % ./filemgr-client -url http://localhost:9000 -op -ingest -ptn rinex -ps > Flat -mf > "file:///project/amigho/deploy/gnss-h2o/pcs/data/staging/p1012850.15S.met" > -rs "file:///project/amigho/deploy/gnss-h2o/pcs/data/staging/p1012850.15S" > -pn p1012850.15S > > However, I found in lucene the <reference_data_store> contains an illegal > path. I’m not sure if that causes the problem for deletion. But, I see > this in other catalog (i.e. SMAP) too but it can be deleted. I’m sort of > stuck. ;) No big deal. I just can’t test and will have to remove the > entire catalog every time. > > > > > > BTW, RADIX does not deploy filemgr/etc/logging.properties. > > Thanks for your & Lewis’ pointer. I will continue to troubleshoot. > Cynthia > > > > > On 10/25/15, 10:33 AM, "Mattmann, Chris A (3980)" > <chris.a.mattm...@jpl.nasa.gov> wrote: > > >Cynthia, > > > >The: > > > >"URI is not absolute” > > > >error is a long standing configuration issue wherein which > >an environment variable referenced in a config (likely > >etc/filemgr.properties) > >is not defined, and there is a file://[SOME_VAR] use of it, that is a > >URI. In this case you get a non absolute URI an hence the error. > > > >Please check your filemgr.properties and other configs as that is > >the most likely cause of your problem. > > > >Cheers, > >Chris > > > > > >++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > >Chris Mattmann, Ph.D. > >Chief Architect > >Instrument Software and Science Data Systems Section (398) > >NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA > >Office: 168-519, Mailstop: 168-527 > >Email: chris.a.mattm...@nasa.gov > >WWW: http://sunset.usc.edu/~mattmann/ > >++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > >Adjunct Associate Professor, Computer Science Department > >University of Southern California, Los Angeles, CA 90089 USA > >++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > > > > > > > > > > > >-----Original Message----- > >From: "Wong, Cynthia L (398G)" <cynthia.l.w...@jpl.nasa.gov> > >Reply-To: "dev@oodt.apache.org" <dev@oodt.apache.org> > >Date: Thursday, October 22, 2015 at 4:15 PM > >To: "dev@oodt.apache.org" <dev@oodt.apache.org> > >Subject: OODT 0.10 FileMgr Errors > > > >>All, > >> > >>I¹m checking out OODT 0.10. Do you know if it works with JDK 1.7? > >> > >>I am able to ingest files but I can not perform the following commands to > >>get info or delete them. > >> > >>% ./filemgr-client -url http://localhost:9000 -op -product -pn > >>p1012850.15S > >>% ./filemgr-client -url http://localhost:9000 -op -pbyn -pn p1012850.15S > >>% ./filemgr-client -url http://localhost:9000 -op --deleteProductByName > >>-pn p1012850.15S > >>% ./filemgr-client -url http://localhost:9000 -op -dbyn -pn p1012850.15S > >>% ./filemgr-client -url http://localhost:9000 -op -dbyid -pid > >>68c41375-782d-11e5-808e-dd817024279f > >> > >>The error message onto console: > >> > >>ERROR: Failed to delete product > >>'org.apache.oodt.cas.filemgr.structs.Product@27a8eaf7' : > >>java.lang.Exception: java.lang.IllegalArgumentException: URI is not > >>absolute > >> > >> > >>And a list of files were ingested (in lucene): > >> > >>% ./filemgr-client -url http://localhost:9000 -op -page1 -ptn rinex > >>Page: [num=1, totalPages=1, pageSize=20] > >>Products: > >>Product: > >>[id=68c41375-782d-11e5-808e-dd817024279f,name=p1012850.15S,type=rinex,str > >>u > >>c > >>ture=Flat, transferStatus=TRANSFERING] > >>Product: > >>[id=ba7a0b76-782d-11e5-808e-dd817024279f,name=p1012850.15S,type=rinex,str > >>u > >>c > >>ture=Flat, transferStatus=TRANSFERING] > >>Product: > >>[id=dadee437-782d-11e5-808e-dd817024279f,name=p1012850.15S,type=rinex,str > >>u > >>c > >>ture=Flat, transferStatus=RECEIVED] > >>Product: > >>[id=ce936405-782f-11e5-adf7-2f670ce93a4d,name=p1012850.15S,type=rinex,str > >>u > >>c > >>ture=Flat, transferStatus=RECEIVED] > >>Product: > >>[id=e01b7556-782f-11e5-adf7-2f670ce93a4d,name=p1012850.15S,type=rinex,str > >>u > >>c > >>ture=Flat, transferStatus=RECEIVED] > >>Product: > >>[id=2d6c0385-78e7-11e5-be8b-2f30a366015e,name=p1012850.15S,type=rinex,str > >>u > >>c > >>ture=Flat, transferStatus=RECEIVED] > >> > >> > >> > >> > >> > >> > >> > >> > >>FileMgr log contains the following errors that lead me think of > >>compatibility issue. > >> > >> > >>Oct 22, 2015 3:52:05 PM > >>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver > >>initHandlerMappings > >>FINE: Ignoring namespace handler > >>[org.springframework.scripting.config.LangNamespaceHandler]: handler > >>class > >>not found > >>java.lang.ClassNotFoundException: > >>org.springframework.scripting.config.LangNamespaceHandler > >> at java.net.URLClassLoader$1.run(URLClassLoader.java:366) > >> at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > >> at java.security.AccessController.doPrivileged(Native Method) > >> at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > >> at java.lang.ClassLoader.loadClass(ClassLoader.java:425) > >> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) > >> at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > >> at org.springframework.util.ClassUtils.forName(ClassUtils.java:249) > >> at > >>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver.ini > >>t > >>H > >>andlerMappings(DefaultNamespaceHandlerResolver.java:117) > >> at > >>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver.<in > >>i > >>t > >>>(DefaultNamespaceHandlerResolver.java:96) > >> at > >>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver.<in > >>i > >>t > >>>(DefaultNamespaceHandlerResolver.java:83) > >> at > >>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.createDefau > >>l > >>t > >>NamespaceHandlerResolver(XmlBeanDefinitionReader.java:498) > >> at > >>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.createReade > >>r > >>C > >>ontext(XmlBeanDefinitionReader.java:487) > >> at > >>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.registerBea > >>n > >>D > >>efinitions(XmlBeanDefinitionReader.java:468) > >> at > >>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.doLoadBeanD > >>e > >>f > >>initions(XmlBeanDefinitionReader.java:363) > >> at > >>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDef > >>i > >>n > >>itions(XmlBeanDefinitionReader.java:313) > >> at > >>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDef > >>i > >>n > >>itions(XmlBeanDefinitionReader.java:290) > >> at > >>org.springframework.beans.factory.support.AbstractBeanDefinitionReader.lo > >>a > >>d > >>BeanDefinitions(AbstractBeanDefinitionReader.java:131) > >> at > >>org.springframework.beans.factory.support.AbstractBeanDefinitionReader.lo > >>a > >>d > >>BeanDefinitions(AbstractBeanDefinitionReader.java:147) > >> at > >>org.springframework.beans.factory.support.AbstractBeanDefinitionReader.lo > >>a > >>d > >>BeanDefinitions(AbstractBeanDefinitionReader.java:173) > >> at > >>org.springframework.context.support.AbstractXmlApplicationContext.loadBea > >>n > >>D > >>efinitions(AbstractXmlApplicationContext.java:112) > >> at > >>org.springframework.context.support.AbstractXmlApplicationContext.loadBea > >>n > >>D > >>efinitions(AbstractXmlApplicationContext.java:79) > >> at > >>org.springframework.context.support.AbstractRefreshableApplicationContext > >>. > >>r > >>efreshBeanFactory(AbstractRefreshableApplicationContext.java:101) > >> at > >>org.springframework.context.support.AbstractApplicationContext.obtainFres > >>h > >>B > >>eanFactory(AbstractApplicationContext.java:394) > >> at > >>org.springframework.context.support.AbstractApplicationContext.refresh(Ab > >>s > >>t > >>ractApplicationContext.java:324) > >> at > >>org.springframework.context.support.FileSystemXmlApplicationContext.<init > >>> > >>( > >>FileSystemXmlApplicationContext.java:124) > >> at > >>org.springframework.context.support.FileSystemXmlApplicationContext.<init > >>> > >>( > >>FileSystemXmlApplicationContext.java:68) > >> at > >>org.apache.oodt.cas.cli.option.store.spring.SpringCmdLineOptionStore.<ini > >>t > >>> > >>(SpringCmdLineOptionStore.java:45) > >> at > >>org.apache.oodt.cas.cli.option.store.spring.SpringCmdLineOptionStoreFacto > >>r > >>y > >>.createStore(SpringCmdLineOptionStoreFactory.java:42) > >> at > org.apache.oodt.cas.cli.CmdLineUtility.<init>(CmdLineUtility.java:94) > >> at > >>org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient.main(XmlRpcFil > >>e > >>M > >>anagerClient.java:1349) > >> > >> > >>Oct 22, 2015 3:52:05 PM > >>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver > >>initHandlerMappings > >>FINE: Ignoring namespace handler > >>[org.springframework.ejb.config.JeeNamespaceHandler]: handler class not > >>found > >>java.lang.ClassNotFoundException: > >>org.springframework.ejb.config.JeeNamespaceHandler > >> at java.net.URLClassLoader$1.run(URLClassLoader.java:366) > >> at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > >> at java.security.AccessController.doPrivileged(Native Method) > >> at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > >> at java.lang.ClassLoader.loadClass(ClassLoader.java:425) > >> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) > >> at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > >> at org.springframework.util.ClassUtils.forName(ClassUtils.java:249) > >> at > >>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver.ini > >>t > >>H > >>andlerMappings(DefaultNamespaceHandlerResolver.java:117) > >> at > >>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver.<in > >>i > >>t > >>>(DefaultNamespaceHandlerResolver.java:96) > >> at > >>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver.<in > >>i > >>t > >>>(DefaultNamespaceHandlerResolver.java:83) > >> at > >>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.createDefau > >>l > >>t > >>NamespaceHandlerResolver(XmlBeanDefinitionReader.java:498) > >> at > >>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.createReade > >>r > >>C > >>ontext(XmlBeanDefinitionReader.java:487) > >> at > >>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.registerBea > >>n > >>D > >>efinitions(XmlBeanDefinitionReader.java:468) > >> at > >>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.doLoadBeanD > >>e > >>f > >>initions(XmlBeanDefinitionReader.java:363) > >> at > >>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDef > >>i > >>n > >>itions(XmlBeanDefinitionReader.java:313) > >> at > >>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDef > >>i > >>n > >>itions(XmlBeanDefinitionReader.java:290) > >> at > >>org.springframework.beans.factory.support.AbstractBeanDefinitionReader.lo > >>a > >>d > >>BeanDefinitions(AbstractBeanDefinitionReader.java:131) > >> at > >>org.springframework.beans.factory.support.AbstractBeanDefinitionReader.lo > >>a > >>d > >>BeanDefinitions(AbstractBeanDefinitionReader.java:147) > >> at > >>org.springframework.beans.factory.support.AbstractBeanDefinitionReader.lo > >>a > >>d > >>BeanDefinitions(AbstractBeanDefinitionReader.java:173) > >> at > >>org.springframework.context.support.AbstractXmlApplicationContext.loadBea > >>n > >>D > >>efinitions(AbstractXmlApplicationContext.java:112) > >> at > >>org.springframework.context.support.AbstractXmlApplicationContext.loadBea > >>n > >>D > >>efinitions(AbstractXmlApplicationContext.java:79) > >> at > >>org.springframework.context.support.AbstractRefreshableApplicationContext > >>. > >>r > >>efreshBeanFactory(AbstractRefreshableApplicationContext.java:101) > >> at > >>org.springframework.context.support.AbstractApplicationContext.obtainFres > >>h > >>B > >>eanFactory(AbstractApplicationContext.java:394) > >> at > >>org.springframework.context.support.AbstractApplicationContext.refresh(Ab > >>s > >>t > >>ractApplicationContext.java:324) > >> at > >>org.springframework.context.support.FileSystemXmlApplicationContext.<init > >>> > >>( > >>FileSystemXmlApplicationContext.java:124) > >> at > >>org.springframework.context.support.FileSystemXmlApplicationContext.<init > >>> > >>( > >>FileSystemXmlApplicationContext.java:68) > >> at > >>org.apache.oodt.cas.cli.option.store.spring.SpringCmdLineOptionStore.<ini > >>t > >>> > >>(SpringCmdLineOptionStore.java:45) > >> at > >>org.apache.oodt.cas.cli.option.store.spring.SpringCmdLineOptionStoreFacto > >>r > >>y > >>.createStore(SpringCmdLineOptionStoreFactory.java:42) > >> at > org.apache.oodt.cas.cli.CmdLineUtility.<init>(CmdLineUtility.java:94) > >> at > >>org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient.main(XmlRpcFil > >>e > >>M > >>anagerClient.java:1349) > >> > >> > >>Oct 22, 2015 3:52:05 PM > >>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver > >>initHandlerMappings > >>FINE: Ignoring namespace handler > >>[org.springframework.aop.config.AopNamespaceHandler]: handler class not > >>found > >>java.lang.ClassNotFoundException: > >>org.springframework.aop.config.AopNamespaceHandler > >> at java.net.URLClassLoader$1.run(URLClassLoader.java:366) > >> at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > >> at java.security.AccessController.doPrivileged(Native Method) > >> at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > >> at java.lang.ClassLoader.loadClass(ClassLoader.java:425) > >> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) > >> at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > >> at org.springframework.util.ClassUtils.forName(ClassUtils.java:249) > >> at > >>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver.ini > >>t > >>H > >>andlerMappings(DefaultNamespaceHandlerResolver.java:117) > >> at > >>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver.<in > >>i > >>t > >>>(DefaultNamespaceHandlerResolver.java:96) > >> at > >>org.springframework.beans.factory.xml.DefaultNamespaceHandlerResolver.<in > >>i > >>t > >>>(DefaultNamespaceHandlerResolver.java:83) > >> at > >>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.createDefau > >>l > >>t > >>NamespaceHandlerResolver(XmlBeanDefinitionReader.java:498) > >> at > >>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.createReade > >>r > >>C > >>ontext(XmlBeanDefinitionReader.java:487) > >> at > >>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.registerBea > >>n > >>D > >>efinitions(XmlBeanDefinitionReader.java:468) > >> at > >>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.doLoadBeanD > >>e > >>f > >>initions(XmlBeanDefinitionReader.java:363) > >> at > >>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDef > >>i > >>n > >>itions(XmlBeanDefinitionReader.java:313) > >> at > >>org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDef > >>i > >>n > >>itions(XmlBeanDefinitionReader.java:290) > >> at > >>org.springframework.beans.factory.support.AbstractBeanDefinitionReader.lo > >>a > >>d > >>BeanDefinitions(AbstractBeanDefinitionReader.java:131) > >> at > >>org.springframework.beans.factory.support.AbstractBeanDefinitionReader.lo > >>a > >>d > >>BeanDefinitions(AbstractBeanDefinitionReader.java:147) > >> at > >>org.springframework.beans.factory.support.AbstractBeanDefinitionReader.lo > >>a > >>d > >>BeanDefinitions(AbstractBeanDefinitionReader.java:173) > >> at > >>org.springframework.context.support.AbstractXmlApplicationContext.loadBea > >>n > >>D > >>efinitions(AbstractXmlApplicationContext.java:112) > >> at > >>org.springframework.context.support.AbstractXmlApplicationContext.loadBea > >>n > >>D > >>efinitions(AbstractXmlApplicationContext.java:79) > >> at > >>org.springframework.context.support.AbstractRefreshableApplicationContext > >>. > >>r > >>efreshBeanFactory(AbstractRefreshableApplicationContext.java:101) > >> at > >>org.springframework.context.support.AbstractApplicationContext.obtainFres > >>h > >>B > >>eanFactory(AbstractApplicationContext.java:394) > >> at > >>org.springframework.context.support.AbstractApplicationContext.refresh(Ab > >>s > >>t > >>ractApplicationContext.java:324) > >> at > >>org.springframework.context.support.FileSystemXmlApplicationContext.<init > >>> > >>( > >>FileSystemXmlApplicationContext.java:124) > >> at > >>org.springframework.context.support.FileSystemXmlApplicationContext.<init > >>> > >>( > >>FileSystemXmlApplicationContext.java:68) > >> at > >>org.apache.oodt.cas.cli.option.store.spring.SpringCmdLineOptionStore.<ini > >>t > >>> > >>(SpringCmdLineOptionStore.java:45) > >> at > >>org.apache.oodt.cas.cli.option.store.spring.SpringCmdLineOptionStoreFacto > >>r > >>y > >>.createStore(SpringCmdLineOptionStoreFactory.java:42) > >> at > org.apache.oodt.cas.cli.CmdLineUtility.<init>(CmdLineUtility.java:94) > >> at > >>org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient.main(XmlRpcFil > >>e > >>M > >>anagerClient.java:1349) > >> > >> > >>Oct 22, 2015 3:52:05 PM > >>org.springframework.beans.factory.xml.DefaultBeanDefinitionDocumentReader > >>registerBeanDefinitions > >>FINE: Loading bean definitions > >>Oct 22, 2015 3:52:05 PM > >>org.springframework.beans.factory.xml.BeanDefinitionParserDelegate > >>parseBeanDefinitionElement > >>FINE: Neither XML 'id' nor 'name' specified - using generated bean name > >>[org.apache.oodt.cas.cli.option.handler.SetJavaPropertiesHandler#605514f9 > >>] > >> > >>Any help is appreciated. > >> > >> > >>Cynthia > >> > > > >
