Re: Deploying SOLR (was:Re: Fail to ingest a test file to file manager on SuSe Linux)

2016-02-10 Thread Tom Barber 
Wei, if you want to test the 0.12-SNAPSHOT radix again you should get time
stamps now.

Tom

On Wed, Feb 10, 2016 at 6:25 PM, Tom Barber  wrote:

> Hey Wei:
>
> https://dl.dropboxusercontent.com/u/8503756/opsui-patch.png
>
> Will that do you? ;)
>
> I have a patch, I'll dump it into trunk and if Chris doesn't like it I may
> have to tweak it, but I think there was a minor disconnect between the Solr
> deserializer and the non solr stuff.
>
> Tom
>
> On Wed, Feb 10, 2016 at 6:55 AM, Tom Barber 
> wrote:
>
>> Okay cool. I'm not familiar with that part of the code base, but I'll
>> prod around and see what I can come up with.
>>
>> Tom
>>
>> On Wed, Feb 10, 2016 at 12:11 AM, Shi, Wei  wrote:
>>
>>> Hi Tom,
>>> The installation went very well. I tested ingestion and deletion, both
>>> worked as expected.
>>>
>>> The only thing I noticed is ³Received Time² displayed as ³UNKNOWN² after
>>> the file is ingested.
>>>
>>> Thanks,
>>>
>>> Wei
>>>
>>> On 2/9/16, 6:08 PM, "Tom Barber"  wrote:
>>>
>>> >Okay Wei, Jordan
>>> >
>>> >Can you guys test this for me whilst I pass out:
>>> >
>>> >mvn -DarchetypeGroupId=org.apache.oodt
>>> >-DarchetypeArtifactId=radix-archetype -DarchetypeVersion=0.12-SNAPSHOT
>>> >-Doodt=0.12-SNAPSHOT -DgroupId=com.mycompany -DartifactId=oodt
>>> >-Dversion=0.1 -DarchetypeRepository=
>>> >https://repository.apache.org/content/groups/snapshots/
>>> archetype:generate
>>> >-Pfm-solr-catalog
>>> >
>>> >mv oodt oodt-src; cd oodt-src; mvn clean package -Pfm-solr-catalog
>>> >
>>> >mkdir ../oodt; tar -xvf
>>> >distribution/target/oodt-distribution-0.1-bin.tar.gz -C ../oodt
>>> >
>>> >cd ../oodt; ./bin/oodt start
>>> >
>>> >
>>> >Its 0.12 RADIX with the start script patched so SOLR starts.
>>> >
>>> >Notice the -P profile flag for solr, it should deploy your solr config
>>> >with
>>> >no extra work.
>>> >
>>> >Let me know how it goes, I've not tested ingestion but I have verified
>>> >that
>>> >solr and the filemgr are running.
>>> >
>>> >Tom
>>> >
>>> >On Tue, Feb 9, 2016 at 9:17 PM, Tom Barber 
>>> >wrote:
>>> >
>>> >> You don't need vagrant if you don't want it and you can use maven 3
>>> BTW
>>> >> On 9 Feb 2016 22:13, "Tom Barber"  wrote:
>>> >>
>>> >>> Blimey!
>>> >>>
>>> >>> Okay you guys are mostly working.  I'm gonna fix the solr maven
>>> profile
>>> >>> before I cut 0.12 because it mostly works and it's a lot easier than
>>> >>>that
>>> >>> solr tutorial! :)
>>> >>> On 9 Feb 2016 22:06, "Shi, Wei"  wrote:
>>> >>>
>>>  Here is a list I compiled:
>>> 
>>>  1.  Download and Install VirtualBox 5.0
>>>  2.  Install Vagrant on Windows 7. It will be installed in
>>> VirtualBox
>>> 
>>> 
>>> 
>>> http://www.seascapewebdesign.com/blog/part-1-getting-started-vagrant-wi
>>> ndows-7-and-8
>>>  3.  Install Java
>>> 
>>> 
>>> 
>>> https://www.digitalocean.com/community/tutorials/how-to-install-java-on
>>> -ubuntu-with-apt-get
>>>  4.  Install Maven 2.2.1 (download from maven site cause the blog
>>>  provided link is not working)
>>> 
>>> 
>>> 
>>> http://archive.apache.org/dist/maven/binaries/apache-maven-2.2.1-bin.ta
>>> r.gz
>>> 
>>> 
>>> 
>>> https://saeedkhattak.wordpress.com/2013/03/05/install-maven-in-ubuntu-1
>>> 2-04/
>>>  5.  Install OODT
>>> 
>>> https://cwiki.apache.org/confluence/display/OODT/RADiX+Powered+By+OODT
>>>  6.  You may need to open port 8080 to allow guest to access
>>> 
>>> 
>>> 
>>> http://serverfault.com/questions/248568/how-to-open-a-8080-port-for-an-
>>> application-with-iptables
>>>  7.  Recompile filemgr in 0.12 and copy over, Note: logs folder
>>> is
>>>  missing. Create logs folder under filemgr
>>>  8.  File Manger User Guide:
>>> 
>>> 
>>> https://cwiki.apache.org/confluence/display/OODT/OODT+Filemgr+User+Guid
>>> e
>>>  9.  Solr
>>> 
>>> 
>>> 
>>> https://cwiki.apache.org/confluence/display/OODT/Solr+File+Manager+Quic
>>> k+Start+Guide
>>>  10. Curator Setup
>>> 
>>> 
>>> 
>>> http://svn.apache.org/repos/asf/oodt/site/components/maven/curator/user
>>> /basic.html
>>> 
>>> 
>>> 
>>>  -Original Message-
>>>  From: Tom Barber [mailto:tom.bar...@meteorite.bi]
>>>  Sent: Tuesday, February 09, 2016 3:28 PM
>>>  To: dev@oodt.apache.org
>>>  Subject: Deploying SOLR (was:Re: Fail to ingest a test file to file
>>>  manager on SuSe Linux)
>>> 
>>>  Out of curiosity, Wei and Jordan if he checks this thread, what
>>>  instructions/hacks are you using to deploy OODT & SOLR?
>>> 
>>>  I know how I do it, I wondered how others do it, ie, what docs do
>>> you
>>>  follow?
>>> 
>>>  Cheers
>>> 
>>>  Tom
>>>

Re: Deploying SOLR (was:Re: Fail to ingest a test file to file manager on SuSe Linux)

2016-02-10 Thread Tom Barber 
Hey Wei:

https://dl.dropboxusercontent.com/u/8503756/opsui-patch.png

Will that do you? ;)

I have a patch, I'll dump it into trunk and if Chris doesn't like it I may
have to tweak it, but I think there was a minor disconnect between the Solr
deserializer and the non solr stuff.

Tom

On Wed, Feb 10, 2016 at 6:55 AM, Tom Barber  wrote:

> Okay cool. I'm not familiar with that part of the code base, but I'll prod
> around and see what I can come up with.
>
> Tom
>
> On Wed, Feb 10, 2016 at 12:11 AM, Shi, Wei  wrote:
>
>> Hi Tom,
>> The installation went very well. I tested ingestion and deletion, both
>> worked as expected.
>>
>> The only thing I noticed is ³Received Time² displayed as ³UNKNOWN² after
>> the file is ingested.
>>
>> Thanks,
>>
>> Wei
>>
>> On 2/9/16, 6:08 PM, "Tom Barber"  wrote:
>>
>> >Okay Wei, Jordan
>> >
>> >Can you guys test this for me whilst I pass out:
>> >
>> >mvn -DarchetypeGroupId=org.apache.oodt
>> >-DarchetypeArtifactId=radix-archetype -DarchetypeVersion=0.12-SNAPSHOT
>> >-Doodt=0.12-SNAPSHOT -DgroupId=com.mycompany -DartifactId=oodt
>> >-Dversion=0.1 -DarchetypeRepository=
>> >https://repository.apache.org/content/groups/snapshots/
>> archetype:generate
>> >-Pfm-solr-catalog
>> >
>> >mv oodt oodt-src; cd oodt-src; mvn clean package -Pfm-solr-catalog
>> >
>> >mkdir ../oodt; tar -xvf
>> >distribution/target/oodt-distribution-0.1-bin.tar.gz -C ../oodt
>> >
>> >cd ../oodt; ./bin/oodt start
>> >
>> >
>> >Its 0.12 RADIX with the start script patched so SOLR starts.
>> >
>> >Notice the -P profile flag for solr, it should deploy your solr config
>> >with
>> >no extra work.
>> >
>> >Let me know how it goes, I've not tested ingestion but I have verified
>> >that
>> >solr and the filemgr are running.
>> >
>> >Tom
>> >
>> >On Tue, Feb 9, 2016 at 9:17 PM, Tom Barber 
>> >wrote:
>> >
>> >> You don't need vagrant if you don't want it and you can use maven 3 BTW
>> >> On 9 Feb 2016 22:13, "Tom Barber"  wrote:
>> >>
>> >>> Blimey!
>> >>>
>> >>> Okay you guys are mostly working.  I'm gonna fix the solr maven
>> profile
>> >>> before I cut 0.12 because it mostly works and it's a lot easier than
>> >>>that
>> >>> solr tutorial! :)
>> >>> On 9 Feb 2016 22:06, "Shi, Wei"  wrote:
>> >>>
>>  Here is a list I compiled:
>> 
>>  1.  Download and Install VirtualBox 5.0
>>  2.  Install Vagrant on Windows 7. It will be installed in
>> VirtualBox
>> 
>> 
>> 
>> http://www.seascapewebdesign.com/blog/part-1-getting-started-vagrant-wi
>> ndows-7-and-8
>>  3.  Install Java
>> 
>> 
>> 
>> https://www.digitalocean.com/community/tutorials/how-to-install-java-on
>> -ubuntu-with-apt-get
>>  4.  Install Maven 2.2.1 (download from maven site cause the blog
>>  provided link is not working)
>> 
>> 
>> 
>> http://archive.apache.org/dist/maven/binaries/apache-maven-2.2.1-bin.ta
>> r.gz
>> 
>> 
>> 
>> https://saeedkhattak.wordpress.com/2013/03/05/install-maven-in-ubuntu-1
>> 2-04/
>>  5.  Install OODT
>> 
>> https://cwiki.apache.org/confluence/display/OODT/RADiX+Powered+By+OODT
>>  6.  You may need to open port 8080 to allow guest to access
>> 
>> 
>> 
>> http://serverfault.com/questions/248568/how-to-open-a-8080-port-for-an-
>> application-with-iptables
>>  7.  Recompile filemgr in 0.12 and copy over, Note: logs folder is
>>  missing. Create logs folder under filemgr
>>  8.  File Manger User Guide:
>> 
>> 
>> https://cwiki.apache.org/confluence/display/OODT/OODT+Filemgr+User+Guid
>> e
>>  9.  Solr
>> 
>> 
>> 
>> https://cwiki.apache.org/confluence/display/OODT/Solr+File+Manager+Quic
>> k+Start+Guide
>>  10. Curator Setup
>> 
>> 
>> 
>> http://svn.apache.org/repos/asf/oodt/site/components/maven/curator/user
>> /basic.html
>> 
>> 
>> 
>>  -Original Message-
>>  From: Tom Barber [mailto:tom.bar...@meteorite.bi]
>>  Sent: Tuesday, February 09, 2016 3:28 PM
>>  To: dev@oodt.apache.org
>>  Subject: Deploying SOLR (was:Re: Fail to ingest a test file to file
>>  manager on SuSe Linux)
>> 
>>  Out of curiosity, Wei and Jordan if he checks this thread, what
>>  instructions/hacks are you using to deploy OODT & SOLR?
>> 
>>  I know how I do it, I wondered how others do it, ie, what docs do you
>>  follow?
>> 
>>  Cheers
>> 
>>  Tom
>>  **
>>  Electronic Mail is not secure, may not be read every day, and should
>> not
>>  be used for urgent or sensitive issues
>> 
>> >>>
>>
>> **
>> Electronic Mail is not secure, may not be read every day, and should

Re: Deploying SOLR (was:Re: Fail to ingest a test file to file manager on SuSe Linux)

2016-02-10 Thread Lewis John Mcgibbney 
If this is testing well on Jenkins I am +1 to rolling the release candidate.
Good work Tom.

On Wed, Feb 10, 2016 at 12:03 PM, Shi, Wei  wrote:

> Thank you Tom!
>
> Wei
>
> -Original Message-
> From: Tom Barber [mailto:tom.bar...@meteorite.bi]
> Sent: Wednesday, February 10, 2016 2:01 PM
> To: dev@oodt.apache.org
> Subject: Re: Deploying SOLR (was:Re: Fail to ingest a test file to file
> manager on SuSe Linux)
>
> Wei, if you want to test the 0.12-SNAPSHOT radix again you should get time
> stamps now.
>
> Tom
>
> On Wed, Feb 10, 2016 at 6:25 PM, Tom Barber 
> wrote:
>
> > Hey Wei:
> >
> > https://dl.dropboxusercontent.com/u/8503756/opsui-patch.png
> >
> > Will that do you? ;)
> >
> > I have a patch, I'll dump it into trunk and if Chris doesn't like it I
> > may have to tweak it, but I think there was a minor disconnect between
> > the Solr deserializer and the non solr stuff.
> >
> > Tom
> >
> > On Wed, Feb 10, 2016 at 6:55 AM, Tom Barber 
> > wrote:
> >
> >> Okay cool. I'm not familiar with that part of the code base, but I'll
> >> prod around and see what I can come up with.
> >>
> >> Tom
> >>
> >> On Wed, Feb 10, 2016 at 12:11 AM, Shi, Wei 
> wrote:
> >>
> >>> Hi Tom,
> >>> The installation went very well. I tested ingestion and deletion,
> >>> both worked as expected.
> >>>
> >>> The only thing I noticed is ³Received Time² displayed as ³UNKNOWN²
> >>> after the file is ingested.
> >>>
> >>> Thanks,
> >>>
> >>> Wei
> >>>
> >>> On 2/9/16, 6:08 PM, "Tom Barber"  wrote:
> >>>
> >>> >Okay Wei, Jordan
> >>> >
> >>> >Can you guys test this for me whilst I pass out:
> >>> >
> >>> >mvn -DarchetypeGroupId=org.apache.oodt
> >>> >-DarchetypeArtifactId=radix-archetype -DarchetypeVersion=0.12-SNAPSHOT
> >>> >-Doodt=0.12-SNAPSHOT -DgroupId=com.mycompany -DartifactId=oodt
> >>> >-Dversion=0.1 -DarchetypeRepository=
> >>> >https://repository.apache.org/content/groups/snapshots/
> >>> archetype:generate
> >>> >-Pfm-solr-catalog
> >>> >
> >>> >mv oodt oodt-src; cd oodt-src; mvn clean package -Pfm-solr-catalog
> >>> >
> >>> >mkdir ../oodt; tar -xvf
> >>> >distribution/target/oodt-distribution-0.1-bin.tar.gz -C ../oodt
> >>> >
> >>> >cd ../oodt; ./bin/oodt start
> >>> >
> >>> >
> >>> >Its 0.12 RADIX with the start script patched so SOLR starts.
> >>> >
> >>> >Notice the -P profile flag for solr, it should deploy your solr
> >>> >config with no extra work.
> >>> >
> >>> >Let me know how it goes, I've not tested ingestion but I have
> >>> >verified that solr and the filemgr are running.
> >>> >
> >>> >Tom
> >>> >
> >>> >On Tue, Feb 9, 2016 at 9:17 PM, Tom Barber
> >>> >
> >>> >wrote:
> >>> >
> >>> >> You don't need vagrant if you don't want it and you can use maven
> >>> >> 3
> >>> BTW
> >>> >> On 9 Feb 2016 22:13, "Tom Barber"  wrote:
> >>> >>
> >>> >>> Blimey!
> >>> >>>
> >>> >>> Okay you guys are mostly working.  I'm gonna fix the solr maven
> >>> profile
> >>> >>> before I cut 0.12 because it mostly works and it's a lot easier
> >>> >>>than that  solr tutorial! :)  On 9 Feb 2016 22:06, "Shi, Wei"
> >>> >>> wrote:
> >>> >>>
> >>>  Here is a list I compiled:
> >>> 
> >>>  1.  Download and Install VirtualBox 5.0
> >>>  2.  Install Vagrant on Windows 7. It will be installed in
> >>> VirtualBox
> >>> 
> >>> 
> >>> 
> >>> http://www.seascapewebdesign.com/blog/part-1-getting-started-vagrant
> >>> -wi
> >>> ndows-7-and-8
> >>>  3.  Install Java
> >>> 
> >>> 
> >>> 
> >>> https://www.digitalocean.com/community/tutorials/how-to-install-java
> >>> -on
> >>> -ubuntu-with-apt-get
> >>>  4.  Install Maven 2.2.1 (download from maven site cause the
> blog
> >>>  provided link is not working)
> >>> 
> >>> 
> >>> 
> >>> http://archive.apache.org/dist/maven/binaries/apache-maven-2.2.1-bin
> >>> .ta
> >>> r.gz
> >>> 
> >>> 
> >>> 
> >>> https://saeedkhattak.wordpress.com/2013/03/05/install-maven-in-ubunt
> >>> u-1
> >>> 2-04/
> >>>  5.  Install OODT
> >>> 
> >>> https://cwiki.apache.org/confluence/display/OODT/RADiX+Powered+By+OO
> >>> DT
> >>>  6.  You may need to open port 8080 to allow guest to access
> >>> 
> >>> 
> >>> 
> >>> http://serverfault.com/questions/248568/how-to-open-a-8080-port-for-
> >>> an-
> >>> application-with-iptables
> >>>  7.  Recompile filemgr in 0.12 and copy over, Note: logs folder
> >>> is
> >>>  missing. Create logs folder under filemgr
> >>>  8.  File Manger User Guide:
> >>> 
> >>> 
> >>> https://cwiki.apache.org/confluence/display/OODT/OODT+Filemgr+User+G
> >>> uid
> >>> e
> >>>  9.  Solr
> >>> 
> >>> 
> >>> 
> >>> https://cwiki.apache.org/confluence/display/OODT/Solr+File+Manager+Q
> >>> uic
> >>>

Re: Deploying SOLR (was:Re: Fail to ingest a test file to file manager on SuSe Linux)

2016-02-10 Thread Tom Barber 
The Jenkins tests threw up but thats some weird transient smtp issue. I'm
just checking OODT-992. re the build, I'll run it on minotaur and check and
if it works cut RC1

On Wed, Feb 10, 2016 at 8:59 PM, Lewis John Mcgibbney <
lewis.mcgibb...@gmail.com> wrote:

> If this is testing well on Jenkins I am +1 to rolling the release
> candidate.
> Good work Tom.
>
> On Wed, Feb 10, 2016 at 12:03 PM, Shi, Wei  wrote:
>
> > Thank you Tom!
> >
> > Wei
> >
> > -Original Message-
> > From: Tom Barber [mailto:tom.bar...@meteorite.bi]
> > Sent: Wednesday, February 10, 2016 2:01 PM
> > To: dev@oodt.apache.org
> > Subject: Re: Deploying SOLR (was:Re: Fail to ingest a test file to file
> > manager on SuSe Linux)
> >
> > Wei, if you want to test the 0.12-SNAPSHOT radix again you should get
> time
> > stamps now.
> >
> > Tom
> >
> > On Wed, Feb 10, 2016 at 6:25 PM, Tom Barber 
> > wrote:
> >
> > > Hey Wei:
> > >
> > > https://dl.dropboxusercontent.com/u/8503756/opsui-patch.png
> > >
> > > Will that do you? ;)
> > >
> > > I have a patch, I'll dump it into trunk and if Chris doesn't like it I
> > > may have to tweak it, but I think there was a minor disconnect between
> > > the Solr deserializer and the non solr stuff.
> > >
> > > Tom
> > >
> > > On Wed, Feb 10, 2016 at 6:55 AM, Tom Barber 
> > > wrote:
> > >
> > >> Okay cool. I'm not familiar with that part of the code base, but I'll
> > >> prod around and see what I can come up with.
> > >>
> > >> Tom
> > >>
> > >> On Wed, Feb 10, 2016 at 12:11 AM, Shi, Wei 
> > wrote:
> > >>
> > >>> Hi Tom,
> > >>> The installation went very well. I tested ingestion and deletion,
> > >>> both worked as expected.
> > >>>
> > >>> The only thing I noticed is ³Received Time² displayed as ³UNKNOWN²
> > >>> after the file is ingested.
> > >>>
> > >>> Thanks,
> > >>>
> > >>> Wei
> > >>>
> > >>> On 2/9/16, 6:08 PM, "Tom Barber"  wrote:
> > >>>
> > >>> >Okay Wei, Jordan
> > >>> >
> > >>> >Can you guys test this for me whilst I pass out:
> > >>> >
> > >>> >mvn -DarchetypeGroupId=org.apache.oodt
> > >>> >-DarchetypeArtifactId=radix-archetype
> -DarchetypeVersion=0.12-SNAPSHOT
> > >>> >-Doodt=0.12-SNAPSHOT -DgroupId=com.mycompany -DartifactId=oodt
> > >>> >-Dversion=0.1 -DarchetypeRepository=
> > >>> >https://repository.apache.org/content/groups/snapshots/
> > >>> archetype:generate
> > >>> >-Pfm-solr-catalog
> > >>> >
> > >>> >mv oodt oodt-src; cd oodt-src; mvn clean package -Pfm-solr-catalog
> > >>> >
> > >>> >mkdir ../oodt; tar -xvf
> > >>> >distribution/target/oodt-distribution-0.1-bin.tar.gz -C ../oodt
> > >>> >
> > >>> >cd ../oodt; ./bin/oodt start
> > >>> >
> > >>> >
> > >>> >Its 0.12 RADIX with the start script patched so SOLR starts.
> > >>> >
> > >>> >Notice the -P profile flag for solr, it should deploy your solr
> > >>> >config with no extra work.
> > >>> >
> > >>> >Let me know how it goes, I've not tested ingestion but I have
> > >>> >verified that solr and the filemgr are running.
> > >>> >
> > >>> >Tom
> > >>> >
> > >>> >On Tue, Feb 9, 2016 at 9:17 PM, Tom Barber
> > >>> >
> > >>> >wrote:
> > >>> >
> > >>> >> You don't need vagrant if you don't want it and you can use maven
> > >>> >> 3
> > >>> BTW
> > >>> >> On 9 Feb 2016 22:13, "Tom Barber" 
> wrote:
> > >>> >>
> > >>> >>> Blimey!
> > >>> >>>
> > >>> >>> Okay you guys are mostly working.  I'm gonna fix the solr maven
> > >>> profile
> > >>> >>> before I cut 0.12 because it mostly works and it's a lot easier
> > >>> >>>than that  solr tutorial! :)  On 9 Feb 2016 22:06, "Shi, Wei"
> > >>> >>> wrote:
> > >>> >>>
> > >>>  Here is a list I compiled:
> > >>> 
> > >>>  1.  Download and Install VirtualBox 5.0
> > >>>  2.  Install Vagrant on Windows 7. It will be installed in
> > >>> VirtualBox
> > >>> 
> > >>> 
> > >>> 
> > >>> http://www.seascapewebdesign.com/blog/part-1-getting-started-vagrant
> > >>> -wi
> > >>> ndows-7-and-8
> > >>>  3.  Install Java
> > >>> 
> > >>> 
> > >>> 
> > >>> https://www.digitalocean.com/community/tutorials/how-to-install-java
> > >>> -on
> > >>> -ubuntu-with-apt-get
> > >>>  4.  Install Maven 2.2.1 (download from maven site cause the
> > blog
> > >>>  provided link is not working)
> > >>> 
> > >>> 
> > >>> 
> > >>> http://archive.apache.org/dist/maven/binaries/apache-maven-2.2.1-bin
> > >>> .ta
> > >>> r.gz
> > >>> 
> > >>> 
> > >>> 
> > >>> https://saeedkhattak.wordpress.com/2013/03/05/install-maven-in-ubunt
> > >>> u-1
> > >>> 2-04/
> > >>>  5.  Install OODT
> > >>> 
> > >>> https://cwiki.apache.org/confluence/display/OODT/RADiX+Powered+By+OO
> > >>> DT
> > >>>  6.  You may need to open port 8080 to allow guest to access
> > >>> 
> > >>> 
> > >>> 
> > >>>

Re: Deploying SOLR (was:Re: Fail to ingest a test file to file manager on SuSe Linux)

2016-02-10 Thread Tom Barber 
Okay the count is wrong, as I have 1 MP3 file and 2 Generic files and both
flag 3.

I'll figuer out OODT-992 before shipping.

On Wed, Feb 10, 2016 at 9:04 PM, Tom Barber  wrote:

> The Jenkins tests threw up but thats some weird transient smtp issue. I'm
> just checking OODT-992. re the build, I'll run it on minotaur and check and
> if it works cut RC1
>
> On Wed, Feb 10, 2016 at 8:59 PM, Lewis John Mcgibbney <
> lewis.mcgibb...@gmail.com> wrote:
>
>> If this is testing well on Jenkins I am +1 to rolling the release
>> candidate.
>> Good work Tom.
>>
>> On Wed, Feb 10, 2016 at 12:03 PM, Shi, Wei  wrote:
>>
>> > Thank you Tom!
>> >
>> > Wei
>> >
>> > -Original Message-
>> > From: Tom Barber [mailto:tom.bar...@meteorite.bi]
>> > Sent: Wednesday, February 10, 2016 2:01 PM
>> > To: dev@oodt.apache.org
>> > Subject: Re: Deploying SOLR (was:Re: Fail to ingest a test file to file
>> > manager on SuSe Linux)
>> >
>> > Wei, if you want to test the 0.12-SNAPSHOT radix again you should get
>> time
>> > stamps now.
>> >
>> > Tom
>> >
>> > On Wed, Feb 10, 2016 at 6:25 PM, Tom Barber 
>> > wrote:
>> >
>> > > Hey Wei:
>> > >
>> > > https://dl.dropboxusercontent.com/u/8503756/opsui-patch.png
>> > >
>> > > Will that do you? ;)
>> > >
>> > > I have a patch, I'll dump it into trunk and if Chris doesn't like it I
>> > > may have to tweak it, but I think there was a minor disconnect between
>> > > the Solr deserializer and the non solr stuff.
>> > >
>> > > Tom
>> > >
>> > > On Wed, Feb 10, 2016 at 6:55 AM, Tom Barber 
>> > > wrote:
>> > >
>> > >> Okay cool. I'm not familiar with that part of the code base, but I'll
>> > >> prod around and see what I can come up with.
>> > >>
>> > >> Tom
>> > >>
>> > >> On Wed, Feb 10, 2016 at 12:11 AM, Shi, Wei 
>> > wrote:
>> > >>
>> > >>> Hi Tom,
>> > >>> The installation went very well. I tested ingestion and deletion,
>> > >>> both worked as expected.
>> > >>>
>> > >>> The only thing I noticed is ³Received Time² displayed as ³UNKNOWN²
>> > >>> after the file is ingested.
>> > >>>
>> > >>> Thanks,
>> > >>>
>> > >>> Wei
>> > >>>
>> > >>> On 2/9/16, 6:08 PM, "Tom Barber"  wrote:
>> > >>>
>> > >>> >Okay Wei, Jordan
>> > >>> >
>> > >>> >Can you guys test this for me whilst I pass out:
>> > >>> >
>> > >>> >mvn -DarchetypeGroupId=org.apache.oodt
>> > >>> >-DarchetypeArtifactId=radix-archetype
>> -DarchetypeVersion=0.12-SNAPSHOT
>> > >>> >-Doodt=0.12-SNAPSHOT -DgroupId=com.mycompany -DartifactId=oodt
>> > >>> >-Dversion=0.1 -DarchetypeRepository=
>> > >>> >https://repository.apache.org/content/groups/snapshots/
>> > >>> archetype:generate
>> > >>> >-Pfm-solr-catalog
>> > >>> >
>> > >>> >mv oodt oodt-src; cd oodt-src; mvn clean package -Pfm-solr-catalog
>> > >>> >
>> > >>> >mkdir ../oodt; tar -xvf
>> > >>> >distribution/target/oodt-distribution-0.1-bin.tar.gz -C ../oodt
>> > >>> >
>> > >>> >cd ../oodt; ./bin/oodt start
>> > >>> >
>> > >>> >
>> > >>> >Its 0.12 RADIX with the start script patched so SOLR starts.
>> > >>> >
>> > >>> >Notice the -P profile flag for solr, it should deploy your solr
>> > >>> >config with no extra work.
>> > >>> >
>> > >>> >Let me know how it goes, I've not tested ingestion but I have
>> > >>> >verified that solr and the filemgr are running.
>> > >>> >
>> > >>> >Tom
>> > >>> >
>> > >>> >On Tue, Feb 9, 2016 at 9:17 PM, Tom Barber
>> > >>> >
>> > >>> >wrote:
>> > >>> >
>> > >>> >> You don't need vagrant if you don't want it and you can use maven
>> > >>> >> 3
>> > >>> BTW
>> > >>> >> On 9 Feb 2016 22:13, "Tom Barber" 
>> wrote:
>> > >>> >>
>> > >>> >>> Blimey!
>> > >>> >>>
>> > >>> >>> Okay you guys are mostly working.  I'm gonna fix the solr maven
>> > >>> profile
>> > >>> >>> before I cut 0.12 because it mostly works and it's a lot easier
>> > >>> >>>than that  solr tutorial! :)  On 9 Feb 2016 22:06, "Shi, Wei"
>> > >>> >>> wrote:
>> > >>> >>>
>> > >>>  Here is a list I compiled:
>> > >>> 
>> > >>>  1.  Download and Install VirtualBox 5.0
>> > >>>  2.  Install Vagrant on Windows 7. It will be installed in
>> > >>> VirtualBox
>> > >>> 
>> > >>> 
>> > >>> 
>> > >>>
>> http://www.seascapewebdesign.com/blog/part-1-getting-started-vagrant
>> > >>> -wi
>> > >>> ndows-7-and-8
>> > >>>  3.  Install Java
>> > >>> 
>> > >>> 
>> > >>> 
>> > >>>
>> https://www.digitalocean.com/community/tutorials/how-to-install-java
>> > >>> -on
>> > >>> -ubuntu-with-apt-get
>> > >>>  4.  Install Maven 2.2.1 (download from maven site cause the
>> > blog
>> > >>>  provided link is not working)
>> > >>> 
>> > >>> 
>> > >>> 
>> > >>>
>> http://archive.apache.org/dist/maven/binaries/apache-maven-2.2.1-bin
>> > >>> .ta
>> > >>> r.gz
>> > >>> 
>> > >>> 
>> > >>> 
>> > >>>
>>

Re: Deploying SOLR (was:Re: Fail to ingest a test file to file manager on SuSe Linux)

2016-02-10 Thread Tom Barber 
 Boom.

Wei, once the latest snapshot has built, you'll get a correct product count
in solr as well.

Cut o'clock.

On Wed, Feb 10, 2016 at 9:05 PM, Tom Barber  wrote:

> Okay the count is wrong, as I have 1 MP3 file and 2 Generic files and both
> flag 3.
>
> I'll figuer out OODT-992 before shipping.
>
> On Wed, Feb 10, 2016 at 9:04 PM, Tom Barber 
> wrote:
>
>> The Jenkins tests threw up but thats some weird transient smtp issue. I'm
>> just checking OODT-992. re the build, I'll run it on minotaur and check and
>> if it works cut RC1
>>
>> On Wed, Feb 10, 2016 at 8:59 PM, Lewis John Mcgibbney <
>> lewis.mcgibb...@gmail.com> wrote:
>>
>>> If this is testing well on Jenkins I am +1 to rolling the release
>>> candidate.
>>> Good work Tom.
>>>
>>> On Wed, Feb 10, 2016 at 12:03 PM, Shi, Wei  wrote:
>>>
>>> > Thank you Tom!
>>> >
>>> > Wei
>>> >
>>> > -Original Message-
>>> > From: Tom Barber [mailto:tom.bar...@meteorite.bi]
>>> > Sent: Wednesday, February 10, 2016 2:01 PM
>>> > To: dev@oodt.apache.org
>>> > Subject: Re: Deploying SOLR (was:Re: Fail to ingest a test file to file
>>> > manager on SuSe Linux)
>>> >
>>> > Wei, if you want to test the 0.12-SNAPSHOT radix again you should get
>>> time
>>> > stamps now.
>>> >
>>> > Tom
>>> >
>>> > On Wed, Feb 10, 2016 at 6:25 PM, Tom Barber 
>>> > wrote:
>>> >
>>> > > Hey Wei:
>>> > >
>>> > > https://dl.dropboxusercontent.com/u/8503756/opsui-patch.png
>>> > >
>>> > > Will that do you? ;)
>>> > >
>>> > > I have a patch, I'll dump it into trunk and if Chris doesn't like it
>>> I
>>> > > may have to tweak it, but I think there was a minor disconnect
>>> between
>>> > > the Solr deserializer and the non solr stuff.
>>> > >
>>> > > Tom
>>> > >
>>> > > On Wed, Feb 10, 2016 at 6:55 AM, Tom Barber >> >
>>> > > wrote:
>>> > >
>>> > >> Okay cool. I'm not familiar with that part of the code base, but
>>> I'll
>>> > >> prod around and see what I can come up with.
>>> > >>
>>> > >> Tom
>>> > >>
>>> > >> On Wed, Feb 10, 2016 at 12:11 AM, Shi, Wei 
>>> > wrote:
>>> > >>
>>> > >>> Hi Tom,
>>> > >>> The installation went very well. I tested ingestion and deletion,
>>> > >>> both worked as expected.
>>> > >>>
>>> > >>> The only thing I noticed is ³Received Time² displayed as ³UNKNOWN²
>>> > >>> after the file is ingested.
>>> > >>>
>>> > >>> Thanks,
>>> > >>>
>>> > >>> Wei
>>> > >>>
>>> > >>> On 2/9/16, 6:08 PM, "Tom Barber"  wrote:
>>> > >>>
>>> > >>> >Okay Wei, Jordan
>>> > >>> >
>>> > >>> >Can you guys test this for me whilst I pass out:
>>> > >>> >
>>> > >>> >mvn -DarchetypeGroupId=org.apache.oodt
>>> > >>> >-DarchetypeArtifactId=radix-archetype
>>> -DarchetypeVersion=0.12-SNAPSHOT
>>> > >>> >-Doodt=0.12-SNAPSHOT -DgroupId=com.mycompany -DartifactId=oodt
>>> > >>> >-Dversion=0.1 -DarchetypeRepository=
>>> > >>> >https://repository.apache.org/content/groups/snapshots/
>>> > >>> archetype:generate
>>> > >>> >-Pfm-solr-catalog
>>> > >>> >
>>> > >>> >mv oodt oodt-src; cd oodt-src; mvn clean package -Pfm-solr-catalog
>>> > >>> >
>>> > >>> >mkdir ../oodt; tar -xvf
>>> > >>> >distribution/target/oodt-distribution-0.1-bin.tar.gz -C ../oodt
>>> > >>> >
>>> > >>> >cd ../oodt; ./bin/oodt start
>>> > >>> >
>>> > >>> >
>>> > >>> >Its 0.12 RADIX with the start script patched so SOLR starts.
>>> > >>> >
>>> > >>> >Notice the -P profile flag for solr, it should deploy your solr
>>> > >>> >config with no extra work.
>>> > >>> >
>>> > >>> >Let me know how it goes, I've not tested ingestion but I have
>>> > >>> >verified that solr and the filemgr are running.
>>> > >>> >
>>> > >>> >Tom
>>> > >>> >
>>> > >>> >On Tue, Feb 9, 2016 at 9:17 PM, Tom Barber
>>> > >>> >
>>> > >>> >wrote:
>>> > >>> >
>>> > >>> >> You don't need vagrant if you don't want it and you can use
>>> maven
>>> > >>> >> 3
>>> > >>> BTW
>>> > >>> >> On 9 Feb 2016 22:13, "Tom Barber" 
>>> wrote:
>>> > >>> >>
>>> > >>> >>> Blimey!
>>> > >>> >>>
>>> > >>> >>> Okay you guys are mostly working.  I'm gonna fix the solr maven
>>> > >>> profile
>>> > >>> >>> before I cut 0.12 because it mostly works and it's a lot easier
>>> > >>> >>>than that  solr tutorial! :)  On 9 Feb 2016 22:06, "Shi, Wei"
>>> > >>> >>> wrote:
>>> > >>> >>>
>>> > >>>  Here is a list I compiled:
>>> > >>> 
>>> > >>>  1.  Download and Install VirtualBox 5.0
>>> > >>>  2.  Install Vagrant on Windows 7. It will be installed in
>>> > >>> VirtualBox
>>> > >>> 
>>> > >>> 
>>> > >>> 
>>> > >>>
>>> http://www.seascapewebdesign.com/blog/part-1-getting-started-vagrant
>>> > >>> -wi
>>> > >>> ndows-7-and-8
>>> > >>>  3.  Install Java
>>> > >>> 
>>> > >>> 
>>> > >>> 
>>> > >>>
>>> https://www.digitalocean.com/community/tutorials/how-to-install-java
>>> > >>> -on
>>> >

RE: Deploying SOLR (was:Re: Fail to ingest a test file to file manager on SuSe Linux)

2016-02-09 Thread Shi, Wei 
Here is a list I compiled:

1.  Download and Install VirtualBox 5.0
2.  Install Vagrant on Windows 7. It will be installed in VirtualBox
http://www.seascapewebdesign.com/blog/part-1-getting-started-vagrant-windows-7-and-8
3.  Install Java
https://www.digitalocean.com/community/tutorials/how-to-install-java-on-ubuntu-with-apt-get
4.  Install Maven 2.2.1 (download from maven site cause the blog provided 
link is not working)
http://archive.apache.org/dist/maven/binaries/apache-maven-2.2.1-bin.tar.gz
https://saeedkhattak.wordpress.com/2013/03/05/install-maven-in-ubuntu-12-04/
5.  Install OODT
https://cwiki.apache.org/confluence/display/OODT/RADiX+Powered+By+OODT
6.  You may need to open port 8080 to allow guest to access
http://serverfault.com/questions/248568/how-to-open-a-8080-port-for-an-application-with-iptables
7.  Recompile filemgr in 0.12 and copy over, Note: logs folder is missing. 
Create logs folder under filemgr
8.  File Manger User Guide:  
https://cwiki.apache.org/confluence/display/OODT/OODT+Filemgr+User+Guide
9.  Solr
https://cwiki.apache.org/confluence/display/OODT/Solr+File+Manager+Quick+Start+Guide
10. Curator Setup
http://svn.apache.org/repos/asf/oodt/site/components/maven/curator/user/basic.html



-Original Message-
From: Tom Barber [mailto:tom.bar...@meteorite.bi] 
Sent: Tuesday, February 09, 2016 3:28 PM
To: dev@oodt.apache.org
Subject: Deploying SOLR (was:Re: Fail to ingest a test file to file manager on 
SuSe Linux)

Out of curiosity, Wei and Jordan if he checks this thread, what 
instructions/hacks are you using to deploy OODT & SOLR?

I know how I do it, I wondered how others do it, ie, what docs do you follow?

Cheers

Tom
**
Electronic Mail is not secure, may not be read every day, and should not be 
used for urgent or sensitive issues

Deploying SOLR (was:Re: Fail to ingest a test file to file manager on SuSe Linux)

2016-02-09 Thread Tom Barber 
Out of curiosity, Wei and Jordan if he checks this thread, what
instructions/hacks are you using to deploy OODT & SOLR?

I know how I do it, I wondered how others do it, ie, what docs do you
follow?

Cheers

Tom

Re: Deploying SOLR (was:Re: Fail to ingest a test file to file manager on SuSe Linux)

2016-02-09 Thread Tom Barber 
Okay Wei, Jordan

Can you guys test this for me whilst I pass out:

mvn -DarchetypeGroupId=org.apache.oodt
-DarchetypeArtifactId=radix-archetype -DarchetypeVersion=0.12-SNAPSHOT
-Doodt=0.12-SNAPSHOT -DgroupId=com.mycompany -DartifactId=oodt
-Dversion=0.1 -DarchetypeRepository=
https://repository.apache.org/content/groups/snapshots/ archetype:generate
-Pfm-solr-catalog

mv oodt oodt-src; cd oodt-src; mvn clean package -Pfm-solr-catalog

mkdir ../oodt; tar -xvf
distribution/target/oodt-distribution-0.1-bin.tar.gz -C ../oodt

cd ../oodt; ./bin/oodt start


Its 0.12 RADIX with the start script patched so SOLR starts.

Notice the -P profile flag for solr, it should deploy your solr config with
no extra work.

Let me know how it goes, I've not tested ingestion but I have verified that
solr and the filemgr are running.

Tom

On Tue, Feb 9, 2016 at 9:17 PM, Tom Barber  wrote:

> You don't need vagrant if you don't want it and you can use maven 3 BTW
> On 9 Feb 2016 22:13, "Tom Barber"  wrote:
>
>> Blimey!
>>
>> Okay you guys are mostly working.  I'm gonna fix the solr maven profile
>> before I cut 0.12 because it mostly works and it's a lot easier than that
>> solr tutorial! :)
>> On 9 Feb 2016 22:06, "Shi, Wei"  wrote:
>>
>>> Here is a list I compiled:
>>>
>>> 1.  Download and Install VirtualBox 5.0
>>> 2.  Install Vagrant on Windows 7. It will be installed in VirtualBox
>>>
>>> http://www.seascapewebdesign.com/blog/part-1-getting-started-vagrant-windows-7-and-8
>>> 3.  Install Java
>>>
>>> https://www.digitalocean.com/community/tutorials/how-to-install-java-on-ubuntu-with-apt-get
>>> 4.  Install Maven 2.2.1 (download from maven site cause the blog
>>> provided link is not working)
>>>
>>> http://archive.apache.org/dist/maven/binaries/apache-maven-2.2.1-bin.tar.gz
>>>
>>> https://saeedkhattak.wordpress.com/2013/03/05/install-maven-in-ubuntu-12-04/
>>> 5.  Install OODT
>>> https://cwiki.apache.org/confluence/display/OODT/RADiX+Powered+By+OODT
>>> 6.  You may need to open port 8080 to allow guest to access
>>>
>>> http://serverfault.com/questions/248568/how-to-open-a-8080-port-for-an-application-with-iptables
>>> 7.  Recompile filemgr in 0.12 and copy over, Note: logs folder is
>>> missing. Create logs folder under filemgr
>>> 8.  File Manger User Guide:
>>> https://cwiki.apache.org/confluence/display/OODT/OODT+Filemgr+User+Guide
>>> 9.  Solr
>>>
>>> https://cwiki.apache.org/confluence/display/OODT/Solr+File+Manager+Quick+Start+Guide
>>> 10. Curator Setup
>>>
>>> http://svn.apache.org/repos/asf/oodt/site/components/maven/curator/user/basic.html
>>>
>>>
>>>
>>> -Original Message-
>>> From: Tom Barber [mailto:tom.bar...@meteorite.bi]
>>> Sent: Tuesday, February 09, 2016 3:28 PM
>>> To: dev@oodt.apache.org
>>> Subject: Deploying SOLR (was:Re: Fail to ingest a test file to file
>>> manager on SuSe Linux)
>>>
>>> Out of curiosity, Wei and Jordan if he checks this thread, what
>>> instructions/hacks are you using to deploy OODT & SOLR?
>>>
>>> I know how I do it, I wondered how others do it, ie, what docs do you
>>> follow?
>>>
>>> Cheers
>>>
>>> Tom
>>> **
>>> Electronic Mail is not secure, may not be read every day, and should not
>>> be used for urgent or sensitive issues
>>>
>>

Re: Deploying SOLR (was:Re: Fail to ingest a test file to file manager on SuSe Linux)

2016-02-09 Thread Tom Barber 
Okay cool. I'm not familiar with that part of the code base, but I'll prod
around and see what I can come up with.

Tom

On Wed, Feb 10, 2016 at 12:11 AM, Shi, Wei  wrote:

> Hi Tom,
> The installation went very well. I tested ingestion and deletion, both
> worked as expected.
>
> The only thing I noticed is ³Received Time² displayed as ³UNKNOWN² after
> the file is ingested.
>
> Thanks,
>
> Wei
>
> On 2/9/16, 6:08 PM, "Tom Barber"  wrote:
>
> >Okay Wei, Jordan
> >
> >Can you guys test this for me whilst I pass out:
> >
> >mvn -DarchetypeGroupId=org.apache.oodt
> >-DarchetypeArtifactId=radix-archetype -DarchetypeVersion=0.12-SNAPSHOT
> >-Doodt=0.12-SNAPSHOT -DgroupId=com.mycompany -DartifactId=oodt
> >-Dversion=0.1 -DarchetypeRepository=
> >https://repository.apache.org/content/groups/snapshots/
> archetype:generate
> >-Pfm-solr-catalog
> >
> >mv oodt oodt-src; cd oodt-src; mvn clean package -Pfm-solr-catalog
> >
> >mkdir ../oodt; tar -xvf
> >distribution/target/oodt-distribution-0.1-bin.tar.gz -C ../oodt
> >
> >cd ../oodt; ./bin/oodt start
> >
> >
> >Its 0.12 RADIX with the start script patched so SOLR starts.
> >
> >Notice the -P profile flag for solr, it should deploy your solr config
> >with
> >no extra work.
> >
> >Let me know how it goes, I've not tested ingestion but I have verified
> >that
> >solr and the filemgr are running.
> >
> >Tom
> >
> >On Tue, Feb 9, 2016 at 9:17 PM, Tom Barber 
> >wrote:
> >
> >> You don't need vagrant if you don't want it and you can use maven 3 BTW
> >> On 9 Feb 2016 22:13, "Tom Barber"  wrote:
> >>
> >>> Blimey!
> >>>
> >>> Okay you guys are mostly working.  I'm gonna fix the solr maven profile
> >>> before I cut 0.12 because it mostly works and it's a lot easier than
> >>>that
> >>> solr tutorial! :)
> >>> On 9 Feb 2016 22:06, "Shi, Wei"  wrote:
> >>>
>  Here is a list I compiled:
> 
>  1.  Download and Install VirtualBox 5.0
>  2.  Install Vagrant on Windows 7. It will be installed in
> VirtualBox
> 
> 
> 
> http://www.seascapewebdesign.com/blog/part-1-getting-started-vagrant-wi
> ndows-7-and-8
>  3.  Install Java
> 
> 
> 
> https://www.digitalocean.com/community/tutorials/how-to-install-java-on
> -ubuntu-with-apt-get
>  4.  Install Maven 2.2.1 (download from maven site cause the blog
>  provided link is not working)
> 
> 
> 
> http://archive.apache.org/dist/maven/binaries/apache-maven-2.2.1-bin.ta
> r.gz
> 
> 
> 
> https://saeedkhattak.wordpress.com/2013/03/05/install-maven-in-ubuntu-1
> 2-04/
>  5.  Install OODT
> 
> https://cwiki.apache.org/confluence/display/OODT/RADiX+Powered+By+OODT
>  6.  You may need to open port 8080 to allow guest to access
> 
> 
> 
> http://serverfault.com/questions/248568/how-to-open-a-8080-port-for-an-
> application-with-iptables
>  7.  Recompile filemgr in 0.12 and copy over, Note: logs folder is
>  missing. Create logs folder under filemgr
>  8.  File Manger User Guide:
> 
> 
> https://cwiki.apache.org/confluence/display/OODT/OODT+Filemgr+User+Guid
> e
>  9.  Solr
> 
> 
> 
> https://cwiki.apache.org/confluence/display/OODT/Solr+File+Manager+Quic
> k+Start+Guide
>  10. Curator Setup
> 
> 
> 
> http://svn.apache.org/repos/asf/oodt/site/components/maven/curator/user
> /basic.html
> 
> 
> 
>  -Original Message-
>  From: Tom Barber [mailto:tom.bar...@meteorite.bi]
>  Sent: Tuesday, February 09, 2016 3:28 PM
>  To: dev@oodt.apache.org
>  Subject: Deploying SOLR (was:Re: Fail to ingest a test file to file
>  manager on SuSe Linux)
> 
>  Out of curiosity, Wei and Jordan if he checks this thread, what
>  instructions/hacks are you using to deploy OODT & SOLR?
> 
>  I know how I do it, I wondered how others do it, ie, what docs do you
>  follow?
> 
>  Cheers
> 
>  Tom
>  **
>  Electronic Mail is not secure, may not be read every day, and should
> not
>  be used for urgent or sensitive issues
> 
> >>>
>
> **
> Electronic Mail is not secure, may not be read every day, and should not
> be used for urgent or sensitive issues
>
>