Re: FTS on Virtual Machines - 7.6.04
We did do this configuration - and had sketchy results. BMC did update this document though - there's a new version. We just got it from support yesterday and we will look at the recommended changes and go from there. From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Simon Ellis Sent: Monday, February 04, 2013 1:36 PM To: arslist@ARSLIST.ORG Subject: Re: FTS on Virtual Machines - 7.6.04 ** We implemented the attached recommendations from BMC for FTS in our Linux Server Group. Could barely get FTS to last more than a couple of weeks and now since implementing the recommendations it's been stable for 2 months. Simon From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of William Rentfrow Sent: Tuesday, 5 February 2013 8:28 a.m. To: arslist@ARSLIST.ORG Subject: FTS on Virtual Machines - 7.6.04 ** I've spent a LOT of time on this with BMC support and I wanted to know if anyone else had similar problems and how they fixed it. Essentially we can not get FTS to remain stable. It will always eventually crash and need to be restarted, which essentially means restarting ARS since its' a plugin. We have Suse linux servers in the server group that are VM's. The mount points where the application is installed is pretty fast NAS (SAN? one of the two) and the index files live here as well. BMC has told us - by way of Lucene, which is the underlying product - that the actual mechanism that writes to SAN/NAS drives is not good for the types of file operations which FTS does in order to do it's work. Essentially we always end up with some form of file lock or read error. In short, you have to have an actual physical drive hooked up the box to make this work. That's NOT happening in our environment. Essentially there's a problem - BMC is saying they support VM's, but FTS can use virtual disks - and it's not really BMC's fault so much as the fault of the underlying engine. Anyone else run into this? Heck, we are getting FTS errors at times when it's been turned OFF for weeks. William Rentfrow wrentf...@stratacominc.com Office: 715-204-3061 Cell: 715-398-5056 _ARSlist: Where the Answers Are and have been for 20 years_ No virus found in this message. Checked by AVG - www.avg.comhttp://www.avg.com Version: 2013.0.2890 / Virus Database: 2639/6063 - Release Date: 01/28/13 Internal Virus Database is out of date. _ARSlist: Where the Answers Are and have been for 20 years_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Where the Answers Are, and have been for 20 years
FTS on Virtual Machines - 7.6.04
I've spent a LOT of time on this with BMC support and I wanted to know if anyone else had similar problems and how they fixed it. Essentially we can not get FTS to remain stable. It will always eventually crash and need to be restarted, which essentially means restarting ARS since its' a plugin. We have Suse linux servers in the server group that are VM's. The mount points where the application is installed is pretty fast NAS (SAN? one of the two) and the index files live here as well. BMC has told us - by way of Lucene, which is the underlying product - that the actual mechanism that writes to SAN/NAS drives is not good for the types of file operations which FTS does in order to do it's work. Essentially we always end up with some form of file lock or read error. In short, you have to have an actual physical drive hooked up the box to make this work. That's NOT happening in our environment. Essentially there's a problem - BMC is saying they support VM's, but FTS can use virtual disks - and it's not really BMC's fault so much as the fault of the underlying engine. Anyone else run into this? Heck, we are getting FTS errors at times when it's been turned OFF for weeks. William Rentfrow wrentf...@stratacominc.com Office: 715-204-3061 Cell: 715-398-5056 ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Where the Answers Are, and have been for 20 years
Re: FTS on Virtual Machines - 7.6.04
We have used FTS on virtual AR 7.5 servers before without an issue. You are using a hard server for your DB, aren't you? Because that's a known issue for things apart from FTS. Rick On Mon, Feb 4, 2013 at 11:28 AM, William Rentfrow wrentf...@stratacominc.com wrote: ** I've spent a LOT of time on this with BMC support and I wanted to know if anyone else had similar problems and how they fixed it. ** ** Essentially we can not get FTS to remain stable. It will always eventually crash and need to be restarted, which essentially means restarting ARS since its' a plugin. ** ** We have Suse linux servers in the server group that are VM's. The mount points where the application is installed is pretty fast NAS (SAN? one of the two) and the index files live here as well. ** ** BMC has told us - by way of Lucene, which is the underlying product - that the actual mechanism that writes to SAN/NAS drives is not good for the types of file operations which FTS does in order to do it's work. Essentially we always end up with some form of file lock or read error. In short, you have to have an actual physical drive hooked up the box to make this work. ** ** That's NOT happening in our environment. ** ** Essentially there's a problem - BMC is saying they support VM's, but FTS can use virtual disks - and it's not really BMC's fault so much as the fault of the underlying engine. ** ** Anyone else run into this? Heck, we are getting FTS errors at times when it's been turned OFF for weeks. ** ** William Rentfrow wrentf...@stratacominc.com Office: 715-204-3061 Cell: 715-398-5056 ** ** _ARSlist: Where the Answers Are and have been for 20 years_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Where the Answers Are, and have been for 20 years
Re: FTS on Virtual Machines - 7.6.04
We implemented the attached recommendations from BMC for FTS in our Linux Server Group. Could barely get FTS to last more than a couple of weeks and now since implementing the recommendations it's been stable for 2 months. Simon From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of William Rentfrow Sent: Tuesday, 5 February 2013 8:28 a.m. To: arslist@ARSLIST.ORG Subject: FTS on Virtual Machines - 7.6.04 ** I've spent a LOT of time on this with BMC support and I wanted to know if anyone else had similar problems and how they fixed it. Essentially we can not get FTS to remain stable. It will always eventually crash and need to be restarted, which essentially means restarting ARS since its' a plugin. We have Suse linux servers in the server group that are VM's. The mount points where the application is installed is pretty fast NAS (SAN? one of the two) and the index files live here as well. BMC has told us - by way of Lucene, which is the underlying product - that the actual mechanism that writes to SAN/NAS drives is not good for the types of file operations which FTS does in order to do it's work. Essentially we always end up with some form of file lock or read error. In short, you have to have an actual physical drive hooked up the box to make this work. That's NOT happening in our environment. Essentially there's a problem - BMC is saying they support VM's, but FTS can use virtual disks - and it's not really BMC's fault so much as the fault of the underlying engine. Anyone else run into this? Heck, we are getting FTS errors at times when it's been turned OFF for weeks. William Rentfrow wrentf...@stratacominc.com Office: 715-204-3061 Cell: 715-398-5056 _ARSlist: Where the Answers Are and have been for 20 years_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Where the Answers Are, and have been for 20 years Configuring FTS for performance in a server group.docx.docx Description: Configuring FTS for performance in a server group.docx.docx
FTS on Virtual Machines - 7.6.04
William The FTS engine is Lucense, an open source project, from what I recall. Sticking lucene san storage into Google reveals a set of results that suggest is should be fine, and if I recall, Lucene uses file based locking (correct me if I'm wrong) and hence it shouldn't care about the underlying physical storage. Indeed, for a small set of documents to index, I'd expect the index to be loaded into memory and disc access to be relatively light. But I don't think we know enough to tell. You'd need to post stack traces/etc, or perhaps join the Lucene forums and ask the experts? John ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Where the Answers Are, and have been for 20 years
Re: FTS on Virtual Machines - 7.6.04
**
Hi,We also had some problems with FTS on 7.6.04 sp2 and on Windows environment.At a time, search wasn't working anymore (for example in MFS) and you had a plugin error (can't remember the arerror).I left the project before BMC support found a solution but I gave the admins a script that killed the FTS plugin (java process) and armonitor relaunched it immediately (less than 2 seconds) and search worked again right away.Not perfect but it's a way to fast resolve this problem. Perhaps it should be linked to a "live" log analysis (?).Anyway, the thing is that FTS is a Java process, the way I identify it is via the command line where you can find "pluginsvr/fts" (or something like that), you know it's that java process.Then the script killed it and let armonitor do his job.Here is the script, it's in powershell for Windows but perhaps it'll give you a hint for your environment if it's not windows (or a kill should do the trick at least for testing)://#Killing FTS plugin 0.1#lm...@me.com#Object:#This script will detect and kill FTS plugin (will be launched again#automatically by armonitor service).#History:#0.1, 31/01/2012:#First version#Use:#Powershell Script#Note:#Distant script needs to be allowed#Launch powershell as administrator and type#Set-ExecutionPolicy RemoteSigned##-#Parameter##Log file path$Log_File ="C:\tmp\log.log"#Don't change anything below##Log functionfunction Log_Me([string]$level,[string]$msg){ #Out-File -filepath $Log_File -append -inputObject $a "$(Get-Date):: $($level) :: $($msg)" | Out-File -filepath $Log_File -append}##ScriptClear-host###FTS plugin handle$p=Get-WmiObject Win32_Process -Filter "Name like '%java%' AND CommandLine like '%\\pluginsvr\\fts;%'" | select-Object Handle###Testing query resultif($p -eq $null){ Log_Me "WARNING" "No plugin detected..." exit}###Handle$my_handle=$p.Handle$nb_found=@($p).count###Test if only one plugin detectedif ($nb_found -eq 1){ Log_Me "OK" "Stopping FTS plugin handle $($my_handle)." Stop-Process -Id $my_handle -Force Log_Me "OK" "Plugin FTS handle $($my_handle) stopped." }else{ Log_Me "ERROR" "Several plugins detected..."}exit//Laurent.On 04 Feb, 2013,at 08:28 PM, William Rentfrow wrentf...@stratacominc.com wrote:I've spent a LOT of time on this with BMC support and I wanted to know if anyone else had similar problems and how they fixed it.Essentially we can not get FTS to remain stable. It will always eventually crash and need to be restarted, which essentially means restarting ARS since its' a plugin.We have Suse linux servers in the server group that are VM's. The mount points where the application is installed is pretty fast NAS (SAN? one of the two) and the index files live here as well.BMC has told us - by way of Lucene, which is the underlying product - that the actual mechanism that writes to SAN/NAS drives is not good for the types of file operations which FTS does in order to do it's work. Essentially we always end up with some form of file lock or read error. In short, you have to have an actual physical drive hooked up the box to make this work.That's NOT happening in our environment.Essentially there's a problem - BMC is saying they support VM's, but FTS can use virtual disks - and it's not really BMC's fault so much as the fault of the underlying engine.Anyone else run into this? Heck, we are getting FTS errors at times when it's been turned OFF for weeks.William Rentfrowwrentf...@stratacominc.comOffice: 715-204-3061Cell: 715-398-5056_ARSlist: "Where the Answers Are" and have been for 20 years_**_ARSlist: "Where the Answers Are" and have been for 20 years_
FTS on Virtual Machines - 7.6.04
William I note MT8.0 contains Lucene version 2.9.2. As far as I can tell, this is at least two major releases behind the current release. Version 2.6.2 was released in February 2010 and has been superseded by two minor releases. Perhaps you should download 2.9.4 from an ftp site, or even try 3.6.2. I'm not sure what came between 2.9 and 3.6. Ref: ftp://ftp.mirrorservice.org/sites/ftp.apache.org/lucene/java/2.9.4/ Ref: ftp://ftp.mirrorservice.org/sites/ftp.apache.org/lucene/java/3.6.2/ Simply delete the lucene-*.jar files from Mid Tier WEB-INF/lib and copy the replacement jars from the relevant download. John -- JSS SSO Plugin for BMC ITS http://www.javasystemsolutions.com/jss/ssoplugin ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Where the Answers Are, and have been for 20 years
OT: FTS on Virtual Machines - 7.6.04 (RE ADDM)
Regarding That's NOT happening in our environment. We have had the same trouble with ADDM. BMC's ideal design is to have virtual disks for ADDMhowever a 300gb VM disk is not welcome in our environment so we use NFS. In 9.0 an disk management UI was introduced and remove the need for a manual command line process to change disk configuration. Apparently this only works for VMdisks and since we are using NFS we still need to do the manual process. Our ADDM primary admin has been working with BMC support and I think the documentation is being updated to reflect this shortcoming. Jason On Mon, Feb 4, 2013 at 11:28 AM, William Rentfrow WRentfrow@stratacominc .com wrote: ** I've spent a LOT of time on this with BMC support and I wanted to know if anyone else had similar problems and how they fixed it. ** ** Essentially we can not get FTS to remain stable. It will always eventually crash and need to be restarted, which essentially means restarting ARS since its' a plugin. ** ** We have Suse linux servers in the server group that are VM's. The mount points where the application is installed is pretty fast NAS (SAN? one of the two) and the index files live here as well. ** ** BMC has told us - by way of Lucene, which is the underlying product - that the actual mechanism that writes to SAN/NAS drives is not good for the types of file operations which FTS does in order to do it's work. Essentially we always end up with some form of file lock or read error. In short, you have to have an actual physical drive hooked up the box to make this work. ** ** That's NOT happening in our environment. ** ** Essentially there's a problem - BMC is saying they support VM's, but FTS can use virtual disks - and it's not really BMC's fault so much as the fault of the underlying engine. ** ** Anyone else run into this? Heck, we are getting FTS errors at times when it's been turned OFF for weeks. ** ** William Rentfrow wrentf...@stratacominc.com Office: 715-204-3061 Cell: 715-398-5056 ** ** _ARSlist: Where the Answers Are and have been for 20 years_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Where the Answers Are, and have been for 20 years
Re: FTS on Virtual Machines - 7.6.04
William, Rick,
Just curious, can you please tell us if you are/were mounting your SAN FS
via NFS (which version) or iSCSI (on ethernet or fiber) ?
Thanks.
Sylvain
On Mon, Feb 4, 2013 at 8:48 PM, laurent matheo lm...@me.com wrote:
**
Hi,
We also had some problems with FTS on 7.6.04 sp2 and on Windows
environment.
At a time, search wasn't working anymore (for example in MFS) and you had
a plugin error (can't remember the arerror).
I left the project before BMC support found a solution but I gave the
admins a script that killed the FTS plugin (java process) and armonitor
relaunched it immediately (less than 2 seconds) and search worked again
right away.
Not perfect but it's a way to fast resolve this problem. Perhaps it should
be linked to a live log analysis (?).
Anyway, the thing is that FTS is a Java process, the way I identify it is
via the command line where you can find pluginsvr/fts (or something like
that), you know it's that java process.
Then the script killed it and let armonitor do his job.
Here is the script, it's in powershell for Windows but perhaps it'll give
you a hint for your environment if it's not windows (or a kill should do
the trick at least for testing):
//
#Killing FTS plugin 0.1
#lm...@me.com
#Object:
#This script will detect and kill FTS plugin (will be launched again
#automatically by armonitor service).
#History:
#0.1, 31/01/2012:
#First version
#Use:
#Powershell Script
#Note:
#Distant script needs to be allowed
#Launch powershell as administrator and type
#Set-ExecutionPolicy RemoteSigned
##-
#Parameter
##Log file path
$Log_File =C:\tmp\log.log
#Don't change anything below
##Log function
function Log_Me([string]$level,[string]$msg)
{
#Out-File -filepath $Log_File -append -inputObject $a
$(Get-Date):: $($level) :: $($msg) | Out-File -filepath $Log_File -append
}
##Script
Clear-host
###FTS plugin handle
$p=Get-WmiObject Win32_Process -Filter Name like '%java%' AND CommandLine
like '%\\pluginsvr\\fts;%' | select-Object Handle
###Testing query result
if($p -eq $null)
{
Log_Me WARNING No plugin detected...
exit
}
###Handle
$my_handle=$p.Handle
$nb_found=@($p).count
###Test if only one plugin detected
if ($nb_found -eq 1)
{
Log_Me OK Stopping FTS plugin handle $($my_handle).
Stop-Process -Id $my_handle -Force
Log_Me OK Plugin FTS handle $($my_handle) stopped.
}
else
{
Log_Me ERROR Several plugins detected...
}
exit
//
Laurent.
On 04 Feb, 2013,at 08:28 PM, William Rentfrow wrentf...@stratacominc.com
wrote:
I've spent a LOT of time on this with BMC support and I wanted to know if
anyone else had similar problems and how they fixed it.
Essentially we can not get FTS to remain stable. It will always
eventually crash and need to be restarted, which essentially means
restarting ARS since its' a plugin.
We have Suse linux servers in the server group that are VM's. The mount
points where the application is installed is pretty fast NAS (SAN? one of
the two) and the index files live here as well.
BMC has told us - by way of Lucene, which is the underlying product - that
the actual mechanism that writes to SAN/NAS drives is not good for the
types of file operations which FTS does in order to do it's work.
Essentially we always end up with some form of file lock or read error. In
short, you have to have an actual physical drive hooked up the box to make
this work.
That's NOT happening in our environment.
Essentially there's a problem - BMC is saying they support VM's, but FTS
can use virtual disks - and it's not really BMC's fault so much as the
fault of the underlying engine.
Anyone else run into this? Heck, we are getting FTS errors at times when
it's been turned OFF for weeks.
William Rentfrow
wrentf...@stratacominc.com
Office: 715-204-3061
Cell: 715-398-5056
_ARSlist: Where the Answers Are and have been for 20 years_
**
_ARSlist: Where the Answers Are and have been for 20 years_
___
UNSUBSCRIBE or access ARSlist Archives at www.arslist.org
Where the Answers Are, and have been for 20 years
