RE: Deploying SOLR (was:Re: Fail to ingest a test file to file manager on SuSe Linux)

[Shi, Wei]

Thank you Tom!

Wei

-Original Message-
From: Tom Barber [mailto:tom.bar...@meteorite.bi] 
Sent: Wednesday, February 10, 2016 2:01 PM
To: dev@oodt.apache.org
Subject: Re: Deploying SOLR (was:Re: Fail to ingest a test file to file manager 
on SuSe Linux)

Wei, if you want to test the 0.12-SNAPSHOT radix again you should get time 
stamps now.

Tom

On Wed, Feb 10, 2016 at 6:25 PM, Tom Barber  wrote:

> Hey Wei:
>
> https://dl.dropboxusercontent.com/u/8503756/opsui-patch.png
>
> Will that do you? ;)
>
> I have a patch, I'll dump it into trunk and if Chris doesn't like it I 
> may have to tweak it, but I think there was a minor disconnect between 
> the Solr deserializer and the non solr stuff.
>
> Tom
>
> On Wed, Feb 10, 2016 at 6:55 AM, Tom Barber 
> wrote:
>
>> Okay cool. I'm not familiar with that part of the code base, but I'll 
>> prod around and see what I can come up with.
>>
>> Tom
>>
>> On Wed, Feb 10, 2016 at 12:11 AM, Shi, Wei  wrote:
>>
>>> Hi Tom,
>>> The installation went very well. I tested ingestion and deletion, 
>>> both worked as expected.
>>>
>>> The only thing I noticed is ³Received Time² displayed as ³UNKNOWN² 
>>> after the file is ingested.
>>>
>>> Thanks,
>>>
>>> Wei
>>>
>>> On 2/9/16, 6:08 PM, "Tom Barber"  wrote:
>>>
>>> >Okay Wei, Jordan
>>> >
>>> >Can you guys test this for me whilst I pass out:
>>> >
>>> >mvn -DarchetypeGroupId=org.apache.oodt
>>> >-DarchetypeArtifactId=radix-archetype -DarchetypeVersion=0.12-SNAPSHOT
>>> >-Doodt=0.12-SNAPSHOT -DgroupId=com.mycompany -DartifactId=oodt
>>> >-Dversion=0.1 -DarchetypeRepository= 
>>> >https://repository.apache.org/content/groups/snapshots/
>>> archetype:generate
>>> >-Pfm-solr-catalog
>>> >
>>> >mv oodt oodt-src; cd oodt-src; mvn clean package -Pfm-solr-catalog
>>> >
>>> >mkdir ../oodt; tar -xvf
>>> >distribution/target/oodt-distribution-0.1-bin.tar.gz -C ../oodt
>>> >
>>> >cd ../oodt; ./bin/oodt start
>>> >
>>> >
>>> >Its 0.12 RADIX with the start script patched so SOLR starts.
>>> >
>>> >Notice the -P profile flag for solr, it should deploy your solr 
>>> >config with no extra work.
>>> >
>>> >Let me know how it goes, I've not tested ingestion but I have 
>>> >verified that solr and the filemgr are running.
>>> >
>>> >Tom
>>> >
>>> >On Tue, Feb 9, 2016 at 9:17 PM, Tom Barber 
>>> >
>>> >wrote:
>>> >
>>> >> You don't need vagrant if you don't want it and you can use maven 
>>> >> 3
>>> BTW
>>> >> On 9 Feb 2016 22:13, "Tom Barber"  wrote:
>>> >>
>>> >>> Blimey!
>>> >>>
>>> >>> Okay you guys are mostly working.  I'm gonna fix the solr maven
>>> profile
>>> >>> before I cut 0.12 because it mostly works and it's a lot easier 
>>> >>>than that  solr tutorial! :)  On 9 Feb 2016 22:06, "Shi, Wei" 
>>> >>> wrote:
>>> >>>
>>> >>>> Here is a list I compiled:
>>> >>>>
>>> >>>> 1.  Download and Install VirtualBox 5.0
>>> >>>> 2.  Install Vagrant on Windows 7. It will be installed in
>>> >>>>VirtualBox
>>> >>>>
>>> >>>>
>>> >>>>
>>> http://www.seascapewebdesign.com/blog/part-1-getting-started-vagrant
>>> -wi
>>> >>>>ndows-7-and-8
>>> >>>> 3.  Install Java
>>> >>>>
>>> >>>>
>>> >>>>
>>> https://www.digitalocean.com/community/tutorials/how-to-install-java
>>> -on
>>> >>>>-ubuntu-with-apt-get
>>> >>>> 4.  Install Maven 2.2.1 (download from maven site cause the blog
>>> >>>> provided link is not working)
>>> >>>>
>>> >>>>
>>> >>>>
>>> http://archive.apache.org/dist/maven/binaries/apache-maven-2.2.1-bin
>>> .ta
>>> >>>>r.gz
>>> >>>>
>>> >>>>
>>> >>>>
>>> https://saeedkhattak.wordpress.com/2013/03/05/i

Re: Deploying SOLR (was:Re: Fail to ingest a test file to file manager on SuSe Linux)

[Shi, Wei]

Hi Tom,
The installation went very well. I tested ingestion and deletion, both
worked as expected.

The only thing I noticed is ³Received Time² displayed as ³UNKNOWN² after
the file is ingested.

Thanks,

Wei

On 2/9/16, 6:08 PM, "Tom Barber"  wrote:

>Okay Wei, Jordan
>
>Can you guys test this for me whilst I pass out:
>
>mvn -DarchetypeGroupId=org.apache.oodt
>-DarchetypeArtifactId=radix-archetype -DarchetypeVersion=0.12-SNAPSHOT
>-Doodt=0.12-SNAPSHOT -DgroupId=com.mycompany -DartifactId=oodt
>-Dversion=0.1 -DarchetypeRepository=
>https://repository.apache.org/content/groups/snapshots/ archetype:generate
>-Pfm-solr-catalog
>
>mv oodt oodt-src; cd oodt-src; mvn clean package -Pfm-solr-catalog
>
>mkdir ../oodt; tar -xvf
>distribution/target/oodt-distribution-0.1-bin.tar.gz -C ../oodt
>
>cd ../oodt; ./bin/oodt start
>
>
>Its 0.12 RADIX with the start script patched so SOLR starts.
>
>Notice the -P profile flag for solr, it should deploy your solr config
>with
>no extra work.
>
>Let me know how it goes, I've not tested ingestion but I have verified
>that
>solr and the filemgr are running.
>
>Tom
>
>On Tue, Feb 9, 2016 at 9:17 PM, Tom Barber 
>wrote:
>
>> You don't need vagrant if you don't want it and you can use maven 3 BTW
>> On 9 Feb 2016 22:13, "Tom Barber"  wrote:
>>
>>> Blimey!
>>>
>>> Okay you guys are mostly working.  I'm gonna fix the solr maven profile
>>> before I cut 0.12 because it mostly works and it's a lot easier than
>>>that
>>> solr tutorial! :)
>>> On 9 Feb 2016 22:06, "Shi, Wei"  wrote:
>>>
>>>> Here is a list I compiled:
>>>>
>>>> 1.  Download and Install VirtualBox 5.0
>>>> 2.  Install Vagrant on Windows 7. It will be installed in
>>>>VirtualBox
>>>>
>>>> 
>>>>http://www.seascapewebdesign.com/blog/part-1-getting-started-vagrant-wi
>>>>ndows-7-and-8
>>>> 3.  Install Java
>>>>
>>>> 
>>>>https://www.digitalocean.com/community/tutorials/how-to-install-java-on
>>>>-ubuntu-with-apt-get
>>>> 4.  Install Maven 2.2.1 (download from maven site cause the blog
>>>> provided link is not working)
>>>>
>>>> 
>>>>http://archive.apache.org/dist/maven/binaries/apache-maven-2.2.1-bin.ta
>>>>r.gz
>>>>
>>>> 
>>>>https://saeedkhattak.wordpress.com/2013/03/05/install-maven-in-ubuntu-1
>>>>2-04/
>>>> 5.  Install OODT
>>>> https://cwiki.apache.org/confluence/display/OODT/RADiX+Powered+By+OODT
>>>> 6.  You may need to open port 8080 to allow guest to access
>>>>
>>>> 
>>>>http://serverfault.com/questions/248568/how-to-open-a-8080-port-for-an-
>>>>application-with-iptables
>>>> 7.  Recompile filemgr in 0.12 and copy over, Note: logs folder is
>>>> missing. Create logs folder under filemgr
>>>> 8.  File Manger User Guide:
>>>> 
>>>>https://cwiki.apache.org/confluence/display/OODT/OODT+Filemgr+User+Guid
>>>>e
>>>> 9.  Solr
>>>>
>>>> 
>>>>https://cwiki.apache.org/confluence/display/OODT/Solr+File+Manager+Quic
>>>>k+Start+Guide
>>>> 10. Curator Setup
>>>>
>>>> 
>>>>http://svn.apache.org/repos/asf/oodt/site/components/maven/curator/user
>>>>/basic.html
>>>>
>>>>
>>>>
>>>> -Original Message-
>>>> From: Tom Barber [mailto:tom.bar...@meteorite.bi]
>>>> Sent: Tuesday, February 09, 2016 3:28 PM
>>>> To: dev@oodt.apache.org
>>>> Subject: Deploying SOLR (was:Re: Fail to ingest a test file to file
>>>> manager on SuSe Linux)
>>>>
>>>> Out of curiosity, Wei and Jordan if he checks this thread, what
>>>> instructions/hacks are you using to deploy OODT & SOLR?
>>>>
>>>> I know how I do it, I wondered how others do it, ie, what docs do you
>>>> follow?
>>>>
>>>> Cheers
>>>>
>>>> Tom
>>>> **
>>>> Electronic Mail is not secure, may not be read every day, and should
>>>>not
>>>> be used for urgent or sensitive issues
>>>>
>>>

**
Electronic Mail is not secure, may not be read every day, and should not be 
used for urgent or sensitive issues 

RE: Deploying SOLR (was:Re: Fail to ingest a test file to file manager on SuSe Linux)

[Shi, Wei]

Here is a list I compiled:

1.  Download and Install VirtualBox 5.0
2.  Install Vagrant on Windows 7. It will be installed in VirtualBox
http://www.seascapewebdesign.com/blog/part-1-getting-started-vagrant-windows-7-and-8
3.  Install Java
https://www.digitalocean.com/community/tutorials/how-to-install-java-on-ubuntu-with-apt-get
4.  Install Maven 2.2.1 (download from maven site cause the blog provided 
link is not working)
http://archive.apache.org/dist/maven/binaries/apache-maven-2.2.1-bin.tar.gz
https://saeedkhattak.wordpress.com/2013/03/05/install-maven-in-ubuntu-12-04/
5.  Install OODT
https://cwiki.apache.org/confluence/display/OODT/RADiX+Powered+By+OODT
6.  You may need to open port 8080 to allow guest to access
http://serverfault.com/questions/248568/how-to-open-a-8080-port-for-an-application-with-iptables
7.  Recompile filemgr in 0.12 and copy over, Note: logs folder is missing. 
Create logs folder under filemgr
8.  File Manger User Guide:  
https://cwiki.apache.org/confluence/display/OODT/OODT+Filemgr+User+Guide
9.  Solr
https://cwiki.apache.org/confluence/display/OODT/Solr+File+Manager+Quick+Start+Guide
10. Curator Setup
http://svn.apache.org/repos/asf/oodt/site/components/maven/curator/user/basic.html



-Original Message-
From: Tom Barber [mailto:tom.bar...@meteorite.bi] 
Sent: Tuesday, February 09, 2016 3:28 PM
To: dev@oodt.apache.org
Subject: Deploying SOLR (was:Re: Fail to ingest a test file to file manager on 
SuSe Linux)

Out of curiosity, Wei and Jordan if he checks this thread, what 
instructions/hacks are you using to deploy OODT & SOLR?

I know how I do it, I wondered how others do it, ie, what docs do you follow?

Cheers

Tom
**
Electronic Mail is not secure, may not be read every day, and should not be 
used for urgent or sensitive issues 

RE: Fail to ingest a test file to file manager on SuSe Linux

[Shi, Wei]

Sorry, it was my mistake. I specified repository manager directory wrong.

Wei

-Original Message-
From: Lewis John Mcgibbney [mailto:lewis.mcgibb...@gmail.com] 
Sent: Tuesday, February 09, 2016 1:11 PM
To: dev@oodt.apache.org
Subject: Re: Fail to ingest a test file to file manager on SuSe Linux

File manager log should provide more insight into the the exception is as right 
now it seems to be too vague for me to debug.
Lewis

On Tue, Feb 9, 2016 at 9:20 AM, Shi, Wei  wrote:

> Yes, the Solr is on 8080. The version is 4.2.0
>
> -Original Message-
> From: Lewis John Mcgibbney [mailto:lewis.mcgibb...@gmail.com]
> Sent: Tuesday, February 09, 2016 11:36 AM
> To: dev@oodt.apache.org
> Subject: Re: Fail to ingest a test file to file manager on SuSe Linux
>
> Is your Solr server running on port 8080 or another port?
> Which version of Solr are you running?
>
> On Tue, Feb 9, 2016 at 8:19 AM, Shi, Wei  wrote:
>
> > Hi Every,
> > I tried to setup the OODT on SuSe Linux server. The installation 
> > went well. I also installed Solr.
> > Now the ingest test failed because of Bad Request.
> > I am using jdk 8.
> >
> > Any ideas? I attached error message below.
> >
> >  ./filemgr-client --url http://localhost:9000 --operation 
> > --ingestProduct --productName test.txt --productStructure Flat 
> > --productTypeName GenericFile --metadataFile 
> > file:///tmp/test.txt.met --refs file:///tmp/test.txt
> >
> > log4j:WARN No appenders could be found for logger 
> > (org.springframework.context.support.FileSystemXmlApplicationContext).
> > log4j:WARN Please initialize the log4j system properly.
> > Feb 09, 2016 11:05:55 AM
> > org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient 
> > INFO: Loading File Manager Configuration Properties from:
> > [../etc/filemgr.properties]
> > Feb 09, 2016 11:05:56 AM
> > org.apache.oodt.cas.filemgr.catalog.solr.SolrCatalog addProduct
> > INFO: Adding product:test.txt
> > Feb 09, 2016 11:05:56 AM
> > org.apache.oodt.cas.filemgr.catalog.solr.SolrClient index
> > INFO: Posting message: > name="id">b69ee1e0-f9f4-4cf0-80e8-232f74e31d12 > name="CAS.ProductId">b69ee1e0-f9f4-4cf0-80e8-232f74e31d12 > el d name="CAS.ProductName">test.txt > name="CAS.ProductTypeName">GenericFile > name="CAS.ProductReceivedTime">2016-02-09T11:05:56Z > name="CAS.ProductTypeId">urn:oodt:GenericFile > name="CAS.ProductStructure">Flat > name="CAS.ProductTransferStatus">TRANSFERING to URL:
> > http://localhost:8080/solr/update
> > Feb 09, 2016 11:05:56 AM
> > org.apache.oodt.cas.filemgr.catalog.solr.SolrClient index
> > SEVERE: HTTP method failed: HTTP/1.1 400 Bad Request Feb 09, 2016
> > 11:05:56 AM org.apache.oodt.cas.filemgr.system.XmlRpcFileManager
> > catalogProduct
> > SEVERE: ingestProduct: CatalogException when adding Product: 
> > test.txt to
> > Catalog: Message: HTTP method failed: HTTP/1.1 400 Bad Request Feb 
> > 09,
> > 2016 11:05:56 AM 
> > org.apache.oodt.cas.filemgr.system.XmlRpcFileManager
> > ingestProductCore
> > SEVERE: HTTP method failed: HTTP/1.1 400 Bad Request Feb 09, 2016
> > 11:05:56 AM 
> > org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient
> > ingestProduct
> > SEVERE: Failed to ingest product [ name:test.txt] :java.lang.Exception:
> > org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: 
> > Error ingesting product 
> > [org.apache.oodt.cas.filemgr.structs.Product@469d4b24]
> > : HTTP method failed: HTTP/1.1 400 Bad Request -- rolling back 
> > ingest Feb 09, 2016 11:05:56 AM 
> > org.apache.oodt.cas.filemgr.catalog.solr.SolrClient delete
> > INFO: Posting message:id:null to URL:
> > http://localhost:8080/solr/update?commit=true
> > Feb 09, 2016 11:05:56 AM
> > org.apache.oodt.cas.filemgr.cli.action.IngestProductCliAction 
> > execute
> > SEVERE: java.lang.Exception:
> > org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: 
> > Error ingesting product 
> > [org.apache.oodt.cas.filemgr.structs.Product@469d4b24]
> > : HTTP method failed: HTTP/1.1 400 Bad Request
> > ERROR: Failed to ingest product 'test.txt' : java.lang.Exception:
> > org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: 
> > Error ingesting product 
> > [org.apache.oodt.cas.filemgr.structs.Product@469d4b24]
> > : HTTP method failed: HTTP/1.1 400 Bad Request
> >
> >
> > Thanks,
> >
> > Wei Shi, M.B.A., M.S.
> > Architect
> > UM Comprehensive Cancer Center
> > N

RE: Fail to ingest a test file to file manager on SuSe Linux

[Shi, Wei]

Yes, the Solr is on 8080. The version is 4.2.0

-Original Message-
From: Lewis John Mcgibbney [mailto:lewis.mcgibb...@gmail.com] 
Sent: Tuesday, February 09, 2016 11:36 AM
To: dev@oodt.apache.org
Subject: Re: Fail to ingest a test file to file manager on SuSe Linux

Is your Solr server running on port 8080 or another port?
Which version of Solr are you running?

On Tue, Feb 9, 2016 at 8:19 AM, Shi, Wei  wrote:

> Hi Every,
> I tried to setup the OODT on SuSe Linux server. The installation went 
> well. I also installed Solr.
> Now the ingest test failed because of Bad Request.
> I am using jdk 8.
>
> Any ideas? I attached error message below.
>
>  ./filemgr-client --url http://localhost:9000 --operation 
> --ingestProduct --productName test.txt --productStructure Flat 
> --productTypeName GenericFile --metadataFile file:///tmp/test.txt.met 
> --refs file:///tmp/test.txt
>
> log4j:WARN No appenders could be found for logger 
> (org.springframework.context.support.FileSystemXmlApplicationContext).
> log4j:WARN Please initialize the log4j system properly.
> Feb 09, 2016 11:05:55 AM
> org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient 
> INFO: Loading File Manager Configuration Properties from:
> [../etc/filemgr.properties]
> Feb 09, 2016 11:05:56 AM
> org.apache.oodt.cas.filemgr.catalog.solr.SolrCatalog addProduct
> INFO: Adding product:test.txt
> Feb 09, 2016 11:05:56 AM
> org.apache.oodt.cas.filemgr.catalog.solr.SolrClient index
> INFO: Posting message: name="id">b69ee1e0-f9f4-4cf0-80e8-232f74e31d12 name="CAS.ProductId">b69ee1e0-f9f4-4cf0-80e8-232f74e31d12 d name="CAS.ProductName">test.txt name="CAS.ProductTypeName">GenericFile name="CAS.ProductReceivedTime">2016-02-09T11:05:56Z name="CAS.ProductTypeId">urn:oodt:GenericFile name="CAS.ProductStructure">Flat name="CAS.ProductTransferStatus">TRANSFERING to URL:
> http://localhost:8080/solr/update
> Feb 09, 2016 11:05:56 AM
> org.apache.oodt.cas.filemgr.catalog.solr.SolrClient index
> SEVERE: HTTP method failed: HTTP/1.1 400 Bad Request Feb 09, 2016 
> 11:05:56 AM org.apache.oodt.cas.filemgr.system.XmlRpcFileManager 
> catalogProduct
> SEVERE: ingestProduct: CatalogException when adding Product: test.txt 
> to
> Catalog: Message: HTTP method failed: HTTP/1.1 400 Bad Request Feb 09, 
> 2016 11:05:56 AM org.apache.oodt.cas.filemgr.system.XmlRpcFileManager 
> ingestProductCore
> SEVERE: HTTP method failed: HTTP/1.1 400 Bad Request Feb 09, 2016 
> 11:05:56 AM org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient 
> ingestProduct
> SEVERE: Failed to ingest product [ name:test.txt] :java.lang.Exception:
> org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: Error 
> ingesting product 
> [org.apache.oodt.cas.filemgr.structs.Product@469d4b24]
> : HTTP method failed: HTTP/1.1 400 Bad Request -- rolling back ingest 
> Feb 09, 2016 11:05:56 AM 
> org.apache.oodt.cas.filemgr.catalog.solr.SolrClient delete
> INFO: Posting message:id:null to URL:
> http://localhost:8080/solr/update?commit=true
> Feb 09, 2016 11:05:56 AM
> org.apache.oodt.cas.filemgr.cli.action.IngestProductCliAction execute
> SEVERE: java.lang.Exception:
> org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: Error 
> ingesting product 
> [org.apache.oodt.cas.filemgr.structs.Product@469d4b24]
> : HTTP method failed: HTTP/1.1 400 Bad Request
> ERROR: Failed to ingest product 'test.txt' : java.lang.Exception:
> org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: Error 
> ingesting product 
> [org.apache.oodt.cas.filemgr.structs.Product@469d4b24]
> : HTTP method failed: HTTP/1.1 400 Bad Request
>
>
> Thanks,
>
> Wei Shi, M.B.A., M.S.
> Architect
> UM Comprehensive Cancer Center
> NCRC 100/134
> O: 734-763-8440 C: 248-835-8453
> shi...@med.umich.edu
>
>
>
> **
> Electronic Mail is not secure, may not be read every day, and should 
> not be used for urgent or sensitive issues
>



--
*Lewis*
**
Electronic Mail is not secure, may not be read every day, and should not be 
used for urgent or sensitive issues 

Fail to ingest a test file to file manager on SuSe Linux

[Shi, Wei]

Hi Every,
I tried to setup the OODT on SuSe Linux server. The installation went well. I 
also installed Solr.
Now the ingest test failed because of Bad Request.
I am using jdk 8.

Any ideas? I attached error message below.

 ./filemgr-client --url http://localhost:9000 --operation --ingestProduct 
--productName test.txt --productStructure Flat --productTypeName GenericFile 
--metadataFile file:///tmp/test.txt.met --refs file:///tmp/test.txt

log4j:WARN No appenders could be found for logger 
(org.springframework.context.support.FileSystemXmlApplicationContext).
log4j:WARN Please initialize the log4j system properly.
Feb 09, 2016 11:05:55 AM 
org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient 
INFO: Loading File Manager Configuration Properties from: 
[../etc/filemgr.properties]
Feb 09, 2016 11:05:56 AM org.apache.oodt.cas.filemgr.catalog.solr.SolrCatalog 
addProduct
INFO: Adding product:test.txt
Feb 09, 2016 11:05:56 AM org.apache.oodt.cas.filemgr.catalog.solr.SolrClient 
index
INFO: Posting message:b69ee1e0-f9f4-4cf0-80e8-232f74e31d12b69ee1e0-f9f4-4cf0-80e8-232f74e31d12test.txtGenericFile2016-02-09T11:05:56Zurn:oodt:GenericFileFlatTRANSFERING to 
URL:http://localhost:8080/solr/update
Feb 09, 2016 11:05:56 AM org.apache.oodt.cas.filemgr.catalog.solr.SolrClient 
index
SEVERE: HTTP method failed: HTTP/1.1 400 Bad Request
Feb 09, 2016 11:05:56 AM org.apache.oodt.cas.filemgr.system.XmlRpcFileManager 
catalogProduct
SEVERE: ingestProduct: CatalogException when adding Product: test.txt to 
Catalog: Message: HTTP method failed: HTTP/1.1 400 Bad Request
Feb 09, 2016 11:05:56 AM org.apache.oodt.cas.filemgr.system.XmlRpcFileManager 
ingestProductCore
SEVERE: HTTP method failed: HTTP/1.1 400 Bad Request
Feb 09, 2016 11:05:56 AM 
org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient ingestProduct
SEVERE: Failed to ingest product [ name:test.txt] :java.lang.Exception: 
org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: Error 
ingesting product [org.apache.oodt.cas.filemgr.structs.Product@469d4b24] : HTTP 
method failed: HTTP/1.1 400 Bad Request -- rolling back ingest
Feb 09, 2016 11:05:56 AM org.apache.oodt.cas.filemgr.catalog.solr.SolrClient 
delete
INFO: Posting message:id:null to 
URL:http://localhost:8080/solr/update?commit=true
Feb 09, 2016 11:05:56 AM 
org.apache.oodt.cas.filemgr.cli.action.IngestProductCliAction execute
SEVERE: java.lang.Exception: 
org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: Error 
ingesting product [org.apache.oodt.cas.filemgr.structs.Product@469d4b24] : HTTP 
method failed: HTTP/1.1 400 Bad Request
ERROR: Failed to ingest product 'test.txt' : java.lang.Exception: 
org.apache.oodt.cas.filemgr.structs.exceptions.CatalogException: Error 
ingesting product [org.apache.oodt.cas.filemgr.structs.Product@469d4b24] : HTTP 
method failed: HTTP/1.1 400 Bad Request


Thanks,

Wei Shi, M.B.A., M.S.
Architect 
UM Comprehensive Cancer Center
NCRC 100/134
O: 734-763-8440 C: 248-835-8453
shi...@med.umich.edu
 


**
Electronic Mail is not secure, may not be read every day, and should not be 
used for urgent or sensitive issues 

Re: filemgr-client script cannot delete product by id or name

[Shi, Wei]

Hi Lewis,
I¹ve signed up. My account is ³shiwei². But under ³Create² menu, I have
only ³Create Service Desk Request² option.

On 2/4/16, 4:41 PM, "Lewis John Mcgibbney" 
wrote:

>Hi Wei,
>Can you please log these issues in Jira
>https://issues.apache.org/jira/browse/OODT
>It would be good if you could reference this thread from the mail archive
>[0].
>We will try and get a fix going for this... and a test.
>Lewis
>
>[0] http://www.mail-archive.com/dev%40oodt.apache.org/msg06562.html
>
>On Thu, Feb 4, 2016 at 11:28 AM, Shi, Wei  wrote:
>
>> Tom,
>> You are my hero! It works!!
>> I notice that empty folders still stayed in archive folder, is that
>>normal?
>>
>> Another thing I noticed:
>> I have two different product type: GenericFile and MP3. There are two
>> GenericFile Type files and two MP3 Type files. While I was getting the
>> total number of the certain product type files, I always got the total.
>> I use the following command:
>>
>> ./filemgr-client -op --getNumProducts --productTypeName GenericFile
>>--url
>> http://localhost:9000
>> ./filemgr-client -op --getNumProducts --productTypeName MP3 --url
>> http://localhost:9000
>>
>> Both returned 4 back to me.
>>
>> It seems to reflect the numbers returned from OPS UI interface.  I have
>>2
>> generic Files and 2 MP3 files, on screen it displayed:
>>
>> GenericFile (4) MP3 (4)
>>
>> Thanks,
>>
>> Wei
>>
>> -Original Message-
>> From: Tom Barber [mailto:tom.bar...@meteorite.bi]
>> Sent: Thursday, February 04, 2016 1:42 PM
>> To: dev@oodt.apache.org
>> Subject: Re: filemgr-client script cannot delete product by id or name
>>
>> Ah sorry I thought you were building trunk after you asked about the
>>tests.
>>
>> git clone the trunk code, there's only been my fixes and someone
>>deleting
>> a readme since we cut 0.11: https://github.com/apache/oodt
>>
>> Tom
>>
>> On Thu, Feb 4, 2016 at 6:38 PM, Shi, Wei  wrote:
>>
>> > Hi Tom,
>> > Do I download it from
>> > http://www.apache.org/dyn/closer.cgi/oodt/apache-oodt-0.11-src.zip?
>> >
>> > I tried this one, same error.
>> >
>> > -Original Message-
>> > From: Tom Barber [mailto:tom.bar...@meteorite.bi]
>> > Sent: Thursday, February 04, 2016 1:03 PM
>> > To: dev@oodt.apache.org
>> > Subject: Re: filemgr-client script cannot delete product by id or name
>> >
>> > Sorry ballsed that up, try again! :)
>> >
>> > On Thu, Feb 4, 2016 at 5:53 PM, Tom Barber 
>> > wrote:
>> >
>> > > Hi Wei
>> > >
>> > > Can you give it a pull and see if my fix got you working.
>> > >
>> > > Thanks
>> > >
>> > > Tom
>> > >
>> > > On Thu, Feb 4, 2016 at 5:14 PM, Shi, Wei 
>>wrote:
>> > >
>> > >> I am using Sprint STS 3.6.4(Eclipse Luna SR1 (4.4.2)), JDK
>>1.7.0_75.
>> > >> I imported oodt as a maven project
>> > >>
>> > >>
>> > >> -Original Message-
>> > >> From: Lewis John Mcgibbney [mailto:lewis.mcgibb...@gmail.com]
>> > >> Sent: Thursday, February 04, 2016 11:40 AM
>> > >> To: dev@oodt.apache.org
>> > >> Subject: Re: filemgr-client script cannot delete product by id or
>> > >> name
>> > >>
>> > >> Ok well this has to be environment specific. OODT tests have never
>> > >> been that broken!
>> > >> What environment e.g. platform, JDK, etc are you trying to compile
>> > >> and test the code on?
>> > >> Our integration builds over at builds.apache.org prove that the
>> > >> code is compiling and testing in a clean build environment.
>> > >>
>> > >> On Thursday, February 4, 2016, Shi, Wei 
>>wrote:
>> > >>
>> > >> > Here is the summary of cas-filemgr compile result:
>> > >> >
>> > >> > Tests in error:
>> > >> >   TestDataSourceCatalog.testQuery:472 » Catalog
>> > >> >   TestLuceneCatalog.testGetReducedMetadata:213 » Catalog Unable
>> > >> > to index product...
>> > >> >   TestLuceneCatalog.testGetMetadata:198 » Catalog Unable to index
>> > >> product:
>> > >> > [test...
>> > >> >   TestLuceneCatalog.testGetReducedMetadataNull:227

RE: filemgr-client script cannot delete product by id or name

[Shi, Wei]

Tom,
You are my hero! It works!!
I notice that empty folders still stayed in archive folder, is that normal? 

Another thing I noticed:
I have two different product type: GenericFile and MP3. There are two 
GenericFile Type files and two MP3 Type files. While I was getting the total 
number of the certain product type files, I always got the total.
I use the following command:

./filemgr-client -op --getNumProducts --productTypeName GenericFile --url 
http://localhost:9000
./filemgr-client -op --getNumProducts --productTypeName MP3 --url 
http://localhost:9000

Both returned 4 back to me.

It seems to reflect the numbers returned from OPS UI interface.  I have 2 
generic Files and 2 MP3 files, on screen it displayed:
 
GenericFile (4) MP3 (4)

Thanks,

Wei

-Original Message-
From: Tom Barber [mailto:tom.bar...@meteorite.bi] 
Sent: Thursday, February 04, 2016 1:42 PM
To: dev@oodt.apache.org
Subject: Re: filemgr-client script cannot delete product by id or name

Ah sorry I thought you were building trunk after you asked about the tests.

git clone the trunk code, there's only been my fixes and someone deleting a 
readme since we cut 0.11: https://github.com/apache/oodt

Tom

On Thu, Feb 4, 2016 at 6:38 PM, Shi, Wei  wrote:

> Hi Tom,
> Do I download it from
> http://www.apache.org/dyn/closer.cgi/oodt/apache-oodt-0.11-src.zip?
>
> I tried this one, same error.
>
> -Original Message-
> From: Tom Barber [mailto:tom.bar...@meteorite.bi]
> Sent: Thursday, February 04, 2016 1:03 PM
> To: dev@oodt.apache.org
> Subject: Re: filemgr-client script cannot delete product by id or name
>
> Sorry ballsed that up, try again! :)
>
> On Thu, Feb 4, 2016 at 5:53 PM, Tom Barber 
> wrote:
>
> > Hi Wei
> >
> > Can you give it a pull and see if my fix got you working.
> >
> > Thanks
> >
> > Tom
> >
> > On Thu, Feb 4, 2016 at 5:14 PM, Shi, Wei  wrote:
> >
> >> I am using Sprint STS 3.6.4(Eclipse Luna SR1 (4.4.2)), JDK 1.7.0_75.
> >> I imported oodt as a maven project
> >>
> >>
> >> -Original Message-
> >> From: Lewis John Mcgibbney [mailto:lewis.mcgibb...@gmail.com]
> >> Sent: Thursday, February 04, 2016 11:40 AM
> >> To: dev@oodt.apache.org
> >> Subject: Re: filemgr-client script cannot delete product by id or 
> >> name
> >>
> >> Ok well this has to be environment specific. OODT tests have never 
> >> been that broken!
> >> What environment e.g. platform, JDK, etc are you trying to compile 
> >> and test the code on?
> >> Our integration builds over at builds.apache.org prove that the 
> >> code is compiling and testing in a clean build environment.
> >>
> >> On Thursday, February 4, 2016, Shi, Wei  wrote:
> >>
> >> > Here is the summary of cas-filemgr compile result:
> >> >
> >> > Tests in error:
> >> >   TestDataSourceCatalog.testQuery:472 » Catalog
> >> >   TestLuceneCatalog.testGetReducedMetadata:213 » Catalog Unable 
> >> > to index product...
> >> >   TestLuceneCatalog.testGetMetadata:198 » Catalog Unable to index
> >> product:
> >> > [test...
> >> >   TestLuceneCatalog.testGetReducedMetadataNull:227 » Catalog 
> >> > Unable to index pro...
> >> >   TestMappedDataSourceCatalog>TestDataSourceCatalog.testQuery:472 
> >> > »
> >> Catalog
> >> >   
> >> > TestOrderedDataSourceCatalog>TestDataSourceCatalog.testQuery:472
> >> > » Catalog
> >> >   
> >> > TestTypeHandler.testGetCatalogAndOrigValuesAndGetCatalogQuery:217
> >> > » RepositoryManager
> >> >   TestXmlRpcStructFactory.testProductMethods:119 » 
> >> > RepositoryManager java.lang.E...
> >> >   TestXmlRpcStructFactory.testProductTypeMethods:82 » 
> >> > RepositoryManager java.lan...
> >> >
> >> > Tests run: 213, Failures: 72, Errors: 9, Skipped: 0
> >> >
> >> > -Original Message-
> >> > From: Tom Barber [mailto:tom.bar...@meteorite.bi ]
> >> > Sent: Thursday, February 04, 2016 10:49 AM
> >> > To: dev@oodt.apache.org 
> >> > Subject: RE: filemgr-client script cannot delete product by id or 
> >> > name
> >> >
> >> > The tests always used to fail for me because for some reason they 
> >> > only compiled with the system clock not set to GMT! But I don't 
> >> > think that is your problem ;) what's the error?
> >> > On 4 Feb 2016 3:29 pm, "Shi, Wei"  >> > >
>

RE: filemgr-client script cannot delete product by id or name

[Shi, Wei]

Hi Tom,
Do I download it from 
http://www.apache.org/dyn/closer.cgi/oodt/apache-oodt-0.11-src.zip?

I tried this one, same error.

-Original Message-
From: Tom Barber [mailto:tom.bar...@meteorite.bi] 
Sent: Thursday, February 04, 2016 1:03 PM
To: dev@oodt.apache.org
Subject: Re: filemgr-client script cannot delete product by id or name

Sorry ballsed that up, try again! :)

On Thu, Feb 4, 2016 at 5:53 PM, Tom Barber  wrote:

> Hi Wei
>
> Can you give it a pull and see if my fix got you working.
>
> Thanks
>
> Tom
>
> On Thu, Feb 4, 2016 at 5:14 PM, Shi, Wei  wrote:
>
>> I am using Sprint STS 3.6.4(Eclipse Luna SR1 (4.4.2)), JDK 1.7.0_75.
>> I imported oodt as a maven project
>>
>>
>> -Original Message-
>> From: Lewis John Mcgibbney [mailto:lewis.mcgibb...@gmail.com]
>> Sent: Thursday, February 04, 2016 11:40 AM
>> To: dev@oodt.apache.org
>> Subject: Re: filemgr-client script cannot delete product by id or 
>> name
>>
>> Ok well this has to be environment specific. OODT tests have never 
>> been that broken!
>> What environment e.g. platform, JDK, etc are you trying to compile 
>> and test the code on?
>> Our integration builds over at builds.apache.org prove that the code 
>> is compiling and testing in a clean build environment.
>>
>> On Thursday, February 4, 2016, Shi, Wei  wrote:
>>
>> > Here is the summary of cas-filemgr compile result:
>> >
>> > Tests in error:
>> >   TestDataSourceCatalog.testQuery:472 » Catalog
>> >   TestLuceneCatalog.testGetReducedMetadata:213 » Catalog Unable to 
>> > index product...
>> >   TestLuceneCatalog.testGetMetadata:198 » Catalog Unable to index
>> product:
>> > [test...
>> >   TestLuceneCatalog.testGetReducedMetadataNull:227 » Catalog Unable 
>> > to index pro...
>> >   TestMappedDataSourceCatalog>TestDataSourceCatalog.testQuery:472 »
>> Catalog
>> >   TestOrderedDataSourceCatalog>TestDataSourceCatalog.testQuery:472 
>> > » Catalog
>> >   TestTypeHandler.testGetCatalogAndOrigValuesAndGetCatalogQuery:217 
>> > » RepositoryManager
>> >   TestXmlRpcStructFactory.testProductMethods:119 » 
>> > RepositoryManager java.lang.E...
>> >   TestXmlRpcStructFactory.testProductTypeMethods:82 » 
>> > RepositoryManager java.lan...
>> >
>> > Tests run: 213, Failures: 72, Errors: 9, Skipped: 0
>> >
>> > -Original Message-
>> > From: Tom Barber [mailto:tom.bar...@meteorite.bi ]
>> > Sent: Thursday, February 04, 2016 10:49 AM
>> > To: dev@oodt.apache.org 
>> > Subject: RE: filemgr-client script cannot delete product by id or 
>> > name
>> >
>> > The tests always used to fail for me because for some reason they 
>> > only compiled with the system clock not set to GMT! But I don't 
>> > think that is your problem ;) what's the error?
>> > On 4 Feb 2016 3:29 pm, "Shi, Wei" > > >
>> > wrote:
>> >
>> > > Separate question:
>> > > In order to compile it successfully, I have to skip tests.
>> > > Is there a way that I can also run tests successfully?
>> > >
>> > > -Original Message-
>> > > From: Tom Barber [mailto:tom.bar...@meteorite.bi ]
>> > > Sent: Thursday, February 04, 2016 10:24 AM
>> > > To: dev@oodt.apache.org 
>> > > Subject: RE: filemgr-client script cannot delete product by id or 
>> > > name
>> > >
>> > > Thinking more about it its probably a fudged xmlrpc mapping which 
>> > > is why it still compiles. Joy!
>> > >
>> > > I'll get it fixed.
>> > >
>> > > Tom
>> > > On 4 Feb 2016 3:11 pm, "Tom Barber" > > > wrote:
>> > >
>> > > > Hey Wei
>> > > >
>> > > > I'm just getting back from trip, when I reach my next hotel in 
>> > > > an hour or so,  I'll investigate properly for you.
>> > > >
>> > > > Tom
>> > > > On 4 Feb 2016 2:46 pm, "Shi, Wei" > > > > >
>> > wrote:
>> > > >
>> > > >> Thank you Tom and Lewis.
>> > > >>
>> > > >> I've downloaded 0.11 source and compiled project cas-filemgr. 
>> > > >> I unzipped cas-filemgr-0.11-dist.zip.
>> > > >> I was able to add products, but got same error while trying to 
>> > > >> delete a pr

RE: filemgr-client script cannot delete product by id or name

[Shi, Wei]

I am using Sprint STS 3.6.4(Eclipse Luna SR1 (4.4.2)), JDK 1.7.0_75.
I imported oodt as a maven project


-Original Message-
From: Lewis John Mcgibbney [mailto:lewis.mcgibb...@gmail.com] 
Sent: Thursday, February 04, 2016 11:40 AM
To: dev@oodt.apache.org
Subject: Re: filemgr-client script cannot delete product by id or name

Ok well this has to be environment specific. OODT tests have never been that 
broken!
What environment e.g. platform, JDK, etc are you trying to compile and test the 
code on?
Our integration builds over at builds.apache.org prove that the code is 
compiling and testing in a clean build environment.

On Thursday, February 4, 2016, Shi, Wei  wrote:

> Here is the summary of cas-filemgr compile result:
>
> Tests in error:
>   TestDataSourceCatalog.testQuery:472 » Catalog
>   TestLuceneCatalog.testGetReducedMetadata:213 » Catalog Unable to 
> index product...
>   TestLuceneCatalog.testGetMetadata:198 » Catalog Unable to index product:
> [test...
>   TestLuceneCatalog.testGetReducedMetadataNull:227 » Catalog Unable to 
> index pro...
>   TestMappedDataSourceCatalog>TestDataSourceCatalog.testQuery:472 » Catalog
>   TestOrderedDataSourceCatalog>TestDataSourceCatalog.testQuery:472 » 
> Catalog
>   TestTypeHandler.testGetCatalogAndOrigValuesAndGetCatalogQuery:217 » 
> RepositoryManager
>   TestXmlRpcStructFactory.testProductMethods:119 » RepositoryManager 
> java.lang.E...
>   TestXmlRpcStructFactory.testProductTypeMethods:82 » 
> RepositoryManager java.lan...
>
> Tests run: 213, Failures: 72, Errors: 9, Skipped: 0
>
> -Original Message-
> From: Tom Barber [mailto:tom.bar...@meteorite.bi ]
> Sent: Thursday, February 04, 2016 10:49 AM
> To: dev@oodt.apache.org 
> Subject: RE: filemgr-client script cannot delete product by id or name
>
> The tests always used to fail for me because for some reason they only 
> compiled with the system clock not set to GMT! But I don't think that 
> is your problem ;) what's the error?
> On 4 Feb 2016 3:29 pm, "Shi, Wei"  >
> wrote:
>
> > Separate question:
> > In order to compile it successfully, I have to skip tests.
> > Is there a way that I can also run tests successfully?
> >
> > -Original Message-
> > From: Tom Barber [mailto:tom.bar...@meteorite.bi ]
> > Sent: Thursday, February 04, 2016 10:24 AM
> > To: dev@oodt.apache.org 
> > Subject: RE: filemgr-client script cannot delete product by id or 
> > name
> >
> > Thinking more about it its probably a fudged xmlrpc mapping which is 
> > why it still compiles. Joy!
> >
> > I'll get it fixed.
> >
> > Tom
> > On 4 Feb 2016 3:11 pm, "Tom Barber"  > wrote:
> >
> > > Hey Wei
> > >
> > > I'm just getting back from trip, when I reach my next hotel in an 
> > > hour or so,  I'll investigate properly for you.
> > >
> > > Tom
> > > On 4 Feb 2016 2:46 pm, "Shi, Wei"  > > >
> wrote:
> > >
> > >> Thank you Tom and Lewis.
> > >>
> > >> I've downloaded 0.11 source and compiled project cas-filemgr. I 
> > >> unzipped cas-filemgr-0.11-dist.zip.
> > >> I was able to add products, but got same error while trying to 
> > >> delete a product.
> > >>
> > >> Command:
> > >> ./filemgr-client -op --deleteProductById --productId
> > >> e36b0c35-1e3b-4f70-8c7e-d57826d8a052 --url http://localhost:9000
> > >>
> > >> Error:
> > >> ERROR: Failed to delete product
> > >> 'org.apache.oodt.cas.filemgr.structs.Product@1475d8e' :
> > >> org.apache.xmlrpc.XmlRpcException: java.lang.NoSuchMethodException:
> > >> org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.removeProduc
> > >> t(
> > >> ja
> > >> va.util.Hashtable)
> > >>
> > >>
> > >> Could that be caused by incorrect property settings?
> > >>
> > >> Wei
> > >>
> > >> -Original Message-
> > >> From: Tom Barber [mailto:magicaltr...@apache.org ]
> > >> Sent: Wednesday, February 03, 2016 7:42 PM
> > >> To: Lewis John Mcgibbney
> > >> Cc: dev@oodt.apache.org 
> > >> Subject: Re: filemgr-client script cannot delete product by id or 
> > >> name
> > >>
> > >> There was a passing test I submitted in 0.11 to "ensure" the 
> > >> deletion works, technically... its fine.
> > >>
> > >> Tom
> > >>
> > >> On Wed, Feb 3, 201

RE: filemgr-client script cannot delete product by id or name

[Shi, Wei]

Here is the summary of cas-filemgr compile result:

Tests in error: 
  TestDataSourceCatalog.testQuery:472 » Catalog
  TestLuceneCatalog.testGetReducedMetadata:213 » Catalog Unable to index 
product...
  TestLuceneCatalog.testGetMetadata:198 » Catalog Unable to index product: 
[test...
  TestLuceneCatalog.testGetReducedMetadataNull:227 » Catalog Unable to index 
pro...
  TestMappedDataSourceCatalog>TestDataSourceCatalog.testQuery:472 » Catalog
  TestOrderedDataSourceCatalog>TestDataSourceCatalog.testQuery:472 » Catalog
  TestTypeHandler.testGetCatalogAndOrigValuesAndGetCatalogQuery:217 » 
RepositoryManager
  TestXmlRpcStructFactory.testProductMethods:119 » RepositoryManager 
java.lang.E...
  TestXmlRpcStructFactory.testProductTypeMethods:82 » RepositoryManager 
java.lan...

Tests run: 213, Failures: 72, Errors: 9, Skipped: 0

-Original Message-
From: Tom Barber [mailto:tom.bar...@meteorite.bi] 
Sent: Thursday, February 04, 2016 10:49 AM
To: dev@oodt.apache.org
Subject: RE: filemgr-client script cannot delete product by id or name

The tests always used to fail for me because for some reason they only compiled 
with the system clock not set to GMT! But I don't think that is your problem ;) 
what's the error?
On 4 Feb 2016 3:29 pm, "Shi, Wei"  wrote:

> Separate question:
> In order to compile it successfully, I have to skip tests.
> Is there a way that I can also run tests successfully?
>
> -Original Message-
> From: Tom Barber [mailto:tom.bar...@meteorite.bi]
> Sent: Thursday, February 04, 2016 10:24 AM
> To: dev@oodt.apache.org
> Subject: RE: filemgr-client script cannot delete product by id or name
>
> Thinking more about it its probably a fudged xmlrpc mapping which is 
> why it still compiles. Joy!
>
> I'll get it fixed.
>
> Tom
> On 4 Feb 2016 3:11 pm, "Tom Barber"  wrote:
>
> > Hey Wei
> >
> > I'm just getting back from trip, when I reach my next hotel in an 
> > hour or so,  I'll investigate properly for you.
> >
> > Tom
> > On 4 Feb 2016 2:46 pm, "Shi, Wei"  wrote:
> >
> >> Thank you Tom and Lewis.
> >>
> >> I've downloaded 0.11 source and compiled project cas-filemgr. I 
> >> unzipped cas-filemgr-0.11-dist.zip.
> >> I was able to add products, but got same error while trying to 
> >> delete a product.
> >>
> >> Command:
> >> ./filemgr-client -op --deleteProductById --productId
> >> e36b0c35-1e3b-4f70-8c7e-d57826d8a052 --url http://localhost:9000
> >>
> >> Error:
> >> ERROR: Failed to delete product
> >> 'org.apache.oodt.cas.filemgr.structs.Product@1475d8e' :
> >> org.apache.xmlrpc.XmlRpcException: java.lang.NoSuchMethodException:
> >> org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.removeProduct(
> >> ja
> >> va.util.Hashtable)
> >>
> >>
> >> Could that be caused by incorrect property settings?
> >>
> >> Wei
> >>
> >> -Original Message-
> >> From: Tom Barber [mailto:magicaltr...@apache.org]
> >> Sent: Wednesday, February 03, 2016 7:42 PM
> >> To: Lewis John Mcgibbney
> >> Cc: dev@oodt.apache.org
> >> Subject: Re: filemgr-client script cannot delete product by id or 
> >> name
> >>
> >> There was a passing test I submitted in 0.11 to "ensure" the 
> >> deletion works, technically... its fine.
> >>
> >> Tom
> >>
> >> On Wed, Feb 3, 2016 at 8:39 PM, Lewis John Mcgibbney < 
> >> lewis.mcgibb...@gmail.com> wrote:
> >>
> >> > Thanks Tom.
> >> > @Wei,
> >> > I wonder if you can upgrade to OODT to 0.11 to try again?
> >> >
> >> > On Wed, Feb 3, 2016 at 12:35 PM, Tom Barber 
> >> > 
> >> > wrote:
> >> >
> >> >> That is similar, but to me this looks like a jar file mismatch 
> >> >> because that error is a missing method, but the method can't be 
> >> >> missing, other wise it surely wouldn't compile?
> >> >>
> >> >> Tom
> >> >>
> >> >> On Wed, Feb 3, 2016 at 8:17 PM, Lewis John Mcgibbney < 
> >> >> lewis.mcgibb...@gmail.com> wrote:
> >> >>
> >> >>> Tom,
> >> >>> Is this issue not then one which was raised prior to the 0.11
> release?
> >> >>> Lewis
> >> >>>
> >> >>> On Wed, Feb 3, 2016 at 10:54 AM, Shi, Wei 
> >> >>> 
> >> wrote:
> >> >>>

RE: filemgr-client script cannot delete product by id or name

[Shi, Wei]

Separate question:
In order to compile it successfully, I have to skip tests. 
Is there a way that I can also run tests successfully?

-Original Message-
From: Tom Barber [mailto:tom.bar...@meteorite.bi] 
Sent: Thursday, February 04, 2016 10:24 AM
To: dev@oodt.apache.org
Subject: RE: filemgr-client script cannot delete product by id or name

Thinking more about it its probably a fudged xmlrpc mapping which is why it 
still compiles. Joy!

I'll get it fixed.

Tom
On 4 Feb 2016 3:11 pm, "Tom Barber"  wrote:

> Hey Wei
>
> I'm just getting back from trip, when I reach my next hotel in an hour 
> or so,  I'll investigate properly for you.
>
> Tom
> On 4 Feb 2016 2:46 pm, "Shi, Wei"  wrote:
>
>> Thank you Tom and Lewis.
>>
>> I've downloaded 0.11 source and compiled project cas-filemgr. I 
>> unzipped cas-filemgr-0.11-dist.zip.
>> I was able to add products, but got same error while trying to delete 
>> a product.
>>
>> Command:
>> ./filemgr-client -op --deleteProductById --productId
>> e36b0c35-1e3b-4f70-8c7e-d57826d8a052 --url http://localhost:9000
>>
>> Error:
>> ERROR: Failed to delete product
>> 'org.apache.oodt.cas.filemgr.structs.Product@1475d8e' :
>> org.apache.xmlrpc.XmlRpcException: java.lang.NoSuchMethodException:
>> org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.removeProduct(ja
>> va.util.Hashtable)
>>
>>
>> Could that be caused by incorrect property settings?
>>
>> Wei
>>
>> -Original Message-
>> From: Tom Barber [mailto:magicaltr...@apache.org]
>> Sent: Wednesday, February 03, 2016 7:42 PM
>> To: Lewis John Mcgibbney
>> Cc: dev@oodt.apache.org
>> Subject: Re: filemgr-client script cannot delete product by id or 
>> name
>>
>> There was a passing test I submitted in 0.11 to "ensure" the deletion 
>> works, technically... its fine.
>>
>> Tom
>>
>> On Wed, Feb 3, 2016 at 8:39 PM, Lewis John Mcgibbney < 
>> lewis.mcgibb...@gmail.com> wrote:
>>
>> > Thanks Tom.
>> > @Wei,
>> > I wonder if you can upgrade to OODT to 0.11 to try again?
>> >
>> > On Wed, Feb 3, 2016 at 12:35 PM, Tom Barber 
>> > 
>> > wrote:
>> >
>> >> That is similar, but to me this looks like a jar file mismatch 
>> >> because that error is a missing method, but the method can't be 
>> >> missing, other wise it surely wouldn't compile?
>> >>
>> >> Tom
>> >>
>> >> On Wed, Feb 3, 2016 at 8:17 PM, Lewis John Mcgibbney < 
>> >> lewis.mcgibb...@gmail.com> wrote:
>> >>
>> >>> Tom,
>> >>> Is this issue not then one which was raised prior to the 0.11 release?
>> >>> Lewis
>> >>>
>> >>> On Wed, Feb 3, 2016 at 10:54 AM, Shi, Wei 
>> wrote:
>> >>>
>> >>>> Hi,
>> >>>> I've setup an oodt test instance and followed "Solr File Manger 
>> >>>> Quick Start Guide" to deployed Solr.
>> >>>>
>> >>>> Now I can ingest files and query data using Solr query such as:
>> >>>> http://localhost:8080/solr/select/?q=*:*
>> >>>>
>> >>>> The only problem I have is deleting a product. Neither delete by 
>> >>>> id, nor delete by name works.
>> >>>>
>> >>>> After execution, the file in archive folder seems to be deleted, 
>> >>>> but the folder is still there.  All metadata can still be seen 
>> >>>> via OPS UI interface. And the error message shows:
>> >>>>
>> >>>> ---
>> >>>> ERROR: Failed to delete product
>> >>>> 'org.apache.oodt.cas.filemgr.structs.Product@a4fc7' :
>> >>>> java.lang.NoSuchMethodException:
>> >>>> org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.removeProdu
>> >>>> ct(
>> >>>> java.util.Hashtable)
>> >>>> 
>> >>>>
>> >>>> I double checked,  cas-filemgr-0.10.jar file, which should have 
>> >>>> class 
>> >>>> org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.removeProdu
>> >>>> ct is in library folder. I also tried to recompile version 0.12
>> (cas-filemgr-0.12-SNAPSHOT.jar), same error occurred.
>> >>>>
>> >>>> Can the files and metadata also be deleted manually via command 
>> >>>> line interface?
>> >>>>
>> >>>> Any suggestion is appreciated,
>> >>>>
>> >>>> Wei Shi, M.B.A., M.S.
>> >>>> Architect
>> >>>> UM Comprehensive Cancer Center
>> >>>> NCRC 100/134
>> >>>> O: 734-763-8440 C: 248-835-8453
>> >>>> shi...@med.umich.edu
>> >>>>
>> >>>>
>> >>>>
>> >>>> **
>> >>>> Electronic Mail is not secure, may not be read every day, and 
>> >>>> should not be used for urgent or sensitive issues
>> >>>>
>> >>>
>> >>>
>> >>>
>> >>> --
>> >>> *Lewis*
>> >>>
>> >>
>> >>
>> >
>> >
>> > --
>> > *Lewis*
>> >
>> **
>> Electronic Mail is not secure, may not be read every day, and should 
>> not be used for urgent or sensitive issues
>>
>
**
Electronic Mail is not secure, may not be read every day, and should not be 
used for urgent or sensitive issues 

RE: filemgr-client script cannot delete product by id or name

[Shi, Wei]

Thank you Tom and Lewis.

I've downloaded 0.11 source and compiled project cas-filemgr. I unzipped 
cas-filemgr-0.11-dist.zip.
I was able to add products, but got same error while trying to delete a product.

Command:
./filemgr-client -op --deleteProductById --productId 
e36b0c35-1e3b-4f70-8c7e-d57826d8a052 --url http://localhost:9000

Error:
ERROR: Failed to delete product 
'org.apache.oodt.cas.filemgr.structs.Product@1475d8e' : 
org.apache.xmlrpc.XmlRpcException: java.lang.NoSuchMethodException: 
org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.removeProduct(java.util.Hashtable)


Could that be caused by incorrect property settings?

Wei

-Original Message-
From: Tom Barber [mailto:magicaltr...@apache.org] 
Sent: Wednesday, February 03, 2016 7:42 PM
To: Lewis John Mcgibbney
Cc: dev@oodt.apache.org
Subject: Re: filemgr-client script cannot delete product by id or name

There was a passing test I submitted in 0.11 to "ensure" the deletion works, 
technically... its fine.

Tom

On Wed, Feb 3, 2016 at 8:39 PM, Lewis John Mcgibbney < 
lewis.mcgibb...@gmail.com> wrote:

> Thanks Tom.
> @Wei,
> I wonder if you can upgrade to OODT to 0.11 to try again?
>
> On Wed, Feb 3, 2016 at 12:35 PM, Tom Barber 
> wrote:
>
>> That is similar, but to me this looks like a jar file mismatch 
>> because that error is a missing method, but the method can't be 
>> missing, other wise it surely wouldn't compile?
>>
>> Tom
>>
>> On Wed, Feb 3, 2016 at 8:17 PM, Lewis John Mcgibbney < 
>> lewis.mcgibb...@gmail.com> wrote:
>>
>>> Tom,
>>> Is this issue not then one which was raised prior to the 0.11 release?
>>> Lewis
>>>
>>> On Wed, Feb 3, 2016 at 10:54 AM, Shi, Wei  wrote:
>>>
>>>> Hi,
>>>> I've setup an oodt test instance and followed "Solr File Manger 
>>>> Quick Start Guide" to deployed Solr.
>>>>
>>>> Now I can ingest files and query data using Solr query such as:
>>>> http://localhost:8080/solr/select/?q=*:*
>>>>
>>>> The only problem I have is deleting a product. Neither delete by 
>>>> id, nor delete by name works.
>>>>
>>>> After execution, the file in archive folder seems to be deleted, 
>>>> but the folder is still there.  All metadata can still be seen via 
>>>> OPS UI interface. And the error message shows:
>>>>
>>>> ---
>>>> ERROR: Failed to delete product
>>>> 'org.apache.oodt.cas.filemgr.structs.Product@a4fc7' :
>>>> java.lang.NoSuchMethodException:
>>>> org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.removeProduct(
>>>> java.util.Hashtable)
>>>> 
>>>>
>>>> I double checked,  cas-filemgr-0.10.jar file, which should have 
>>>> class 
>>>> org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.removeProduct 
>>>> is in library folder. I also tried to recompile version 0.12 
>>>> (cas-filemgr-0.12-SNAPSHOT.jar), same error occurred.
>>>>
>>>> Can the files and metadata also be deleted manually via command 
>>>> line interface?
>>>>
>>>> Any suggestion is appreciated,
>>>>
>>>> Wei Shi, M.B.A., M.S.
>>>> Architect
>>>> UM Comprehensive Cancer Center
>>>> NCRC 100/134
>>>> O: 734-763-8440 C: 248-835-8453
>>>> shi...@med.umich.edu
>>>>
>>>>
>>>>
>>>> **
>>>> Electronic Mail is not secure, may not be read every day, and 
>>>> should not be used for urgent or sensitive issues
>>>>
>>>
>>>
>>>
>>> --
>>> *Lewis*
>>>
>>
>>
>
>
> --
> *Lewis*
>
**
Electronic Mail is not secure, may not be read every day, and should not be 
used for urgent or sensitive issues 

filemgr-client script cannot delete product by id or name

[Shi, Wei]

Hi,
I've setup an oodt test instance and followed "Solr File Manger Quick Start 
Guide" to deployed Solr. 

Now I can ingest files and query data using Solr query such as:
http://localhost:8080/solr/select/?q=*:*

The only problem I have is deleting a product. Neither delete by id, nor delete 
by name works.

After execution, the file in archive folder seems to be deleted, but the folder 
is still there.  All metadata can still be seen via OPS UI interface. And the 
error message shows:

---
ERROR: Failed to delete product 
'org.apache.oodt.cas.filemgr.structs.Product@a4fc7' : 
java.lang.NoSuchMethodException: 
org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.removeProduct(java.util.Hashtable)


I double checked,  cas-filemgr-0.10.jar file, which should have class 
org.apache.oodt.cas.filemgr.system.XmlRpcFileManager.removeProduct is in 
library folder. I also tried to recompile version 0.12 
(cas-filemgr-0.12-SNAPSHOT.jar), same error occurred.

Can the files and metadata also be deleted manually via command line interface?

Any suggestion is appreciated,

Wei Shi, M.B.A., M.S.
Architect 
UM Comprehensive Cancer Center
NCRC 100/134
O: 734-763-8440 C: 248-835-8453
shi...@med.umich.edu
 


**
Electronic Mail is not secure, may not be read every day, and should not be 
used for urgent or sensitive issues 

Questions: Filemgr metadata ingest

[Shi, Wei]

All,
I am new to OODT. Just downloaded the software and installed it.

I am following "OODT Filemgr User Guide" to ingest files. 
(https://cwiki.apache.org/confluence/display/OODT/OODT+Filemgr+User+Guide)
Everything went well and I was able to ingest the blah.txt file successfully!

Now here comes my questions:

1.   If I want to add some my own metadata fields in blah.txt.met, what 
would be the format?

2.   In product-types.xml file, there is a tag called "metadata". Are these 
key/value pairs added to that relevant product type (such as GenericFile) as 
metadata fields?

3.   Is there any tutorial that describes a metExtractor creation (either 
in Java or Python)?

Thanks,

Wei Shi, M.B.A., M.S.
Architect
UM Comprehensive Cancer Center
NCRC 100/134
O: 734-763-8440 C: 248-835-8453
shi...@med.umich.edu


**
Electronic Mail is not secure, may not be read every day, and should not be 
used for urgent or sensitive issues