Re: Load-balancing an SSL-based server farm?
Jarod Wilson writes: > Yes, but it was 4+ years ago. :) Of course it was :) > I assume you've found http://www.linuxvirtualserver.org/Documents.html I have. Frank DiPrete writes: > yes - lvs will forward https / 443 requests just fine. The only tricky > bit is the certificate itself has to be identified as "www.foo.com" > and the extra Organizational Unit: text field has the name of the > actual machine on which the certificate is installed. This is not lvs > specific. Hmm, okay, I haven't run across this piece of information yet... > http://www.austintek.com/LVS/LVS-HOWTO/ Yes, I was just concerned that it is about 4 years old, and possibly out of date. >> The basic scope of the project is this: >> >> - we have about 10 apache servers handling 10,000 sites over both http >>and https (for a total of ~20K sites) >> > > This is really about throughput, which is more a function of traffic / > bandwidth and ultimately the hardware lvs is running on. Right, we've got Dell R610s with 4GBs of RAM, and multiple GigE nics, so we shouldn't have a problem there. >> My questions at this point are: >> >> - Is LVS the right tool, or is there something better (OSS) ? > > or is a commercial load balancer (f5) a better choice ? Must be OSS at this point. f5s are no an option for several reasons. >> - How many sites can LVS scale to serving? > > are these 10,000 IP based virtaual hosts or name based virtual hosts? > I'm guessing that you don't really have 10,000 ip address here. No, we really have 10,000 ip addresses here, and it's expected to grow significantly. >> - Can the LVS config be updated dynamically, on-the-fly, without >> restarting ldirectord ? > > for LVS, yes (see the 3 packages described above) the user space tool > ipvsadm can setup new rules, add/delete forward rules without > reloading anything. I am not sure about ldirectord. I used mon and had > to restart it when I made a change to its config. Okay, cool, so we can script around ipvsadm fairly easily, then. >> - Is there any recent (w/in the last 2 years) documentation or are there >> any books on building such an environment with LVS ? > > couldn't find anything myself either ;) Okay, as long as it's not only me, I feel better ;) And, as I said before: >> Many thanks for any information, URLs, pointers, references, etc. Thanks guys! -- Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Openfire Jabber server
My apologies for the delayed response. It's been one fire after another lately :) kevin_d_cl...@comcast.net (Kevin D. Clark) writes: > 1: It sounds like you're experiencing a memory leak in >your Openfire server. It was indeed a memory leak, exacerbated by one particular client. We're attempting to upgrade to a newer version of the code for which there is a fix. Thanks to all who responded and pointed me in the right direction! -- Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Load-balancing an SSL-based server farm?
Hi all, Has anyone here set up LVS (or something equivalent) to load balance across a set of apache servers serving up SSL-protected sites? I've googled around, and all the docs I've come up with are at least 4+ years old, and somewhat incomplete. Interestingly, I can't even find a single book about the topic! The examples I've found tend to be concerned with a basic apache config without SSL being involved, and don't address the scalability of the LVS configuration. The things I'm most concerned with :) The basic scope of the project is this: - we have about 10 apache servers handling 10,000 sites over both http and https (for a total of ~20K sites) - we need a scalable HA load-balancing solution to sit in front of these servers and load balance across them dealing with both http and https traffic. My questions at this point are: - Is LVS the right tool, or is there something better (OSS) ? - Can LVS handle this size of a load ? - How many sites can LVS scale to serving? - Can the LVS config be updated dynamically, on-the-fly, without restarting ldirectord ? - Is there any recent (w/in the last 2 years) documentation or are there any books on building such an environment with LVS ? Many thanks for any information, URLs, pointers, references, etc. -- Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: The MySQL petition
Stephen Ryan writes:
> On Fri, 2010-01-08 at 10:50 -0500, Paul Lussier wrote:
>
>> That being said, I can only hope for the quick, and painful demise of
>> both MySql and PHP.
>>
>> --
>> Paul - who is trapped in a company with close to 1 million MySql
>> databases being accessed by really bad PHP code.
>
> ...because having close to 1 million {PostgreSQL, Interbase, CouchDB,
> SQLite} databases being accessed by really bad {Java, Python, Ruby, C++,
> assembler, shell} code would be so much better.
Ben Scott writes:
> {Microsoft, Oracle, IBM} guy: Having 1 million {MS-SQL, Oracle, DB2}
> databases being accessed by really bad {C#, PL/SQL, PL/I} code would
> of course be better!
Exactly! :)
I'm glad my post was taken with exactly the intent in which
it was meant... Of course, Ben, et al, know me entirely too well to take
anything I say in such a vain without the largest grain salt available
:)
--
Paul - who still dislikes both MySQL and PHP, but has come to
understand neither is going to be universally replaced by something
better anytime soon.
___
gnhlug-discuss mailing list
gnhlug-discuss@mail.gnhlug.org
http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: The MySQL petition
"Jon 'maddog' Hall" writes: > On the other hand, I wonder how many government installations are > running MySQL at this pointnot that it would or should influence > anything. Most MediaWiki installs use MySql by default. Most WordPress installs use MySql by default. Most Joomla installs use MySql by default. And, sadly, almost all FOSS software that requires a back-end database turns to MySql as it's default. There is a lot of government use of said software. MySql isn't going anywhere anytime soon, and based on the fact that Oracle has kept BerkeleyDB alive and well since they bought Sleepycat, I have no reason to believe they'll do anything bad to MySql. That being said, I can only hope for the quick, and painful demise of both MySql and PHP. -- Paul - who is trapped in a company with close to 1 million MySql databases being accessed by really bad PHP code. ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Openfire Jabber server
Ed Robbins writes: > From a Java perspective, have you utilized any of the JMX tools to > connect to it while it's running to view it's vitals? You can also > force it to dump it's heap and then analyze it to see what's using all > of the memory, that may be helpful in determining what the culprit is. Ed, No, I haven't. Sadly (or fortunately?) I'm not a Java developer, and really no nothing about it, how to debug it, etc. But, if there's something out there that will give me more insight to our problem, I'd certainly be willing to learn how :) Can you point me to docs on JMX tools and how to use them for such things, especially with respect to connecting to openfire? (also note, I do not have console access to the server, only ssh/command line access, so such methods should be consistent and usable with such an environment). Thanks! -- Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Openfire Jabber server
Hi all, Is anyone here using the Openfire Jabber server with large numbers of users? I have a server running Debian 4 with 2GB RAM on a Dell PowerEdge 850 with 2 cores. This is a fairly decent machine, and ought to be more than enough power for running a Jabber server. However, we are finding that it needs to be whacked fairly frequently. We've seen Java OOM errors, etc. We've got about 1400 users, all of which could be connected simultaneously. Currently we're running with -Xmx=1800, which I believe is doggone near the max for a single process under Linux. Our Java command line options (set in /etc/default/openfire) are: DAEMON_OPTS="-Xmx1800m -XX:-UseGCOverheadLimit" Openfire docs don't seem to have a lot of information on performance tuning, does anyone here have any experience with tuning this thing for use in large environments with lots of users ? Thanks in advance for any ideas! -- Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Digital Voice Recorders and Linux
Arc Riley writes: > http://www.sandisk.com/products/sansa-music-and-video-players/sandisk-sansa-clipplus-mp3-player-.aspx > > Voice recording and plays MP3, WMA, Ogg Vorbis, and FLAC. Inexpensive too. Arc, Thanks a lot! This is far more feature-rich than any of the devices I was looking at. And, it's got an FM-tuner with timer-record option so I could record things and listen in the car later! I think the 2GB model will be just fine, especially given that it supports expandable storage via SD cards! Thanks again, so much better than what I was looking at! -- Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Digital Voice Recorders and Linux
Hi folks, I'm looking for a decent digital voice recorder. Can anyone recommend a good one that allows for PC connectivity and can be accessed from Linux ? I've seen several which are "PC Compatible". All the ones from Sony mention special software, which I assume comes with the recorder and runs only on Windows or Mac OS. Some of the Olympus models mention being "PC Compatible", but don't mention anything about any software. I take this to mean that the recorder probably shows up as a removable storage device with direct access to the files. Though, there's no mention what format they're in, one description of the device mentioned WMA-compatible files. Obviously it would be great if the device recorded directly to MP3, but I'll settle for anything I deal with under Linux. I'd appreciate any input anyone may have -- Thanks, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Facebook-like apps?
"Roger H. Goun" writes: > Except for the caveat about the privacy of events mentioned in the > article, what is it about the actual Facebook that fails to meet your > family's requirements? It may be that it already does, I just wasn't aware of it. Thanks! Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Facebook-like apps?
Kenny Lussier writes: > On Fri, Aug 28, 2009 at 10:53 PM, Paul Lussier wrote: >> >> >> Drupal does some of this, but not all, as does Joomla. Bascially, I >> want a mash-up of LinkedIN and Facebook, with a little bit of Flikr and >> a side of YouTube! :) >> >> > Facebook already does everything that you want. You could just use the FB > platform which is already OSS: http://developers.facebook.com/opensource.php. > There is also a a clone that was completely developed with Drupal: > http://drupal.org/node/339148 Oh, cool, I didn't know that! Thanks. ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Facebook-like apps?
Kenny Lussier writes: > With such vague requirements, I would suggest looking at Drupal: > http://drupal.org. Yeah, I'm familiar with drupal, I'm just not entirely sure it's what I want. Of course, I'm not entirely sure I know what I want, though, I'm fairly certain it doesn't exist :) My basic idea started out with some kind of social networking software loosely based on family tree connections where each person could log into their own account and connect to other people along relationship lines. Each would have their own little world inside this site, but could then also be connected to others. They would then be able to jump from person to person. Kind of like LinkedIN connections, except you can just see everyone's connections because you're all related. Additionally, I wanted each account to have the ability to post stuff relevant to the family connections, pictures, letters, audio/video etc. Much like Facebook. Drupal does some of this, but not all, as does Joomla. Bascially, I want a mash-up of LinkedIN and Facebook, with a little bit of Flikr and a side of YouTube! :) Anyone want to work on building a social networking site like this? :) I haven't the faintest idea on how to get started on something like that, but I'd certainly be up for getting together to work on hacking it together! -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Facebook-like apps?
Hi folks, Does anyone know of anything 'Facebook' like in the OSS world ? I'm thinking of setting up a community site for my wife's quite extended family. We really want it restricted to only family, which is why the real facebook won't do :) Thanks, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
strange system clock issues
Hi folks, I just noticed that my system clock doesn't seem to be working correctly all of a sudden. I wasn't running ntpd, but now I am. And when I run it, it keeps things up to date for a bit, but watching the "seconds" tick by seems very slow, I can actually count 5 "mississippi"s between "seconds" on the clock. After the clock gets about an hour (maybe it's 2) out of sync, ntpd fails to sync and gives up. Is this a system clock battery problem ? The system in question is about 10 years old... -- Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Listen to your log files
Mark Ellison writes: > I am interested in hearing from folks on this list- Is the Log4JFugue > tool useful on an ongoing regular basis? Or, is it more of a novelty > item? I think it entirely depends upon the environment in which it's used. This isn't a new idea, I remember using something 10-12 years ago which would allow you to do something similar. You run this tool over something like /var/log/messages or whatever, and using perl regexps it would play certain sounds of your choosing. We had failed sudo and root access play a flushing toilet sound :) If you're a small group and need to be monitoring security or watching for certain transient events, having something like this play in the background can be helpful, since you don't need to do anything. You'll "hear" an event and instantly know you need to interupt what you're doing and address is. I can certainly see, however, where if could be overly annoying and unhelpful if your filters are not well designed. You'll either hear too much or not enough, or if certain events happen too often, you'll tune out the sounds and they'll become background noise that you ignore. -- Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Google App Engine
Thomas Charron writes: > I was totally floored by the fact that I can deploy a servlet into > Googles server farm, store data up there, and the 'free' limits are > higher then many pay sites. Granted, no direct database access, but > with JDO objects, they store it. Can you explain to us non-Java devs what this means exactly ? > I'm just totally floored by how much their offering for free. It's not for free. It's costing you something, and they're getting something. You just haven't figured out what those costs are yet :) -- Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: melodrama at CentOS?
Ben Scott writes: > Debian zealots, note that APT has the same problem. Please explain how so. I've maintained internal Debian mirrors for years which all my internal systems pointed to for package updates. The master, internal mirror server pointed at MIT's Debian repository, not debian.org. There was no connection to the internet from the internal network, and I never had a problem with debian.org being unreachable. -- Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: OT: green vehicles
Ben Scott writes: > On Fri, Jul 31, 2009 at 3:50 PM, Joshua Judson Rosen > wrote: >> I'll figure out how this is related to Linux in a minute ;) > > It's okay, somebody put "OT" in the subject line. That means you > can post about whatever you want. Wait, so, we need to put OT in the subject line for any Off-Topic post now? Perhaps we should change that rule put OT in the subject line for any On-Topic post, that way we'll see far fewer posts with the OT label :) -- Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Perl vs. Python question...
Lloyd Kvam writes: > If the value will be computed on demand, __getattr__ is one way to go. > def __getattr__(self, attr): > if attr == 'foo': > return self.compute_foo() > elif > else: > raise AttributeError( attr + ' is invalid name') > > This is the 'traditional' approach. __getattr__ is *only* called when > an attribute is not found. If you wanted to save the computed value, so > that __getattr__ was no longer used: > self.__dict__['foo'] = self.compute_foo() > return self.foo > > HTH Very much so! -- Thanks, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Perl vs. Python question...
Lloyd Kvam writes: > You've already gotten two useful responses. I'd just like to add that > typically, the object attributes are referenced directly: > rect.length * rect.width Lloyd, thanks. But what if the attribute isn't set yet? If I have self.foo, and self.foo hasn't yet been set, I want it to go and get set, then return the correct value. I get the impression the __getattr__() method helps here, I just don't quite get it yet. -- Thanks, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Perl vs. Python question...
Hi Folks,
How do I create dynamically created methods in python classes?
For example, if I have a number of member variables which I want to get
or set, I don't want to have to create getters and setters for each
attribute, since the code would largely be the same, just the variable
I'm dealing with would be different.
In perl, I can use the AUTOLOAD feature to dynamically create methods,
something like this:
sub AUTOLOAD {
my ($self, @args) = @_;
my $method = $AUTOLOAD;
$method =~ s/.*:://;
if ($method ne 'DESTROY') {
# Return the structure/value pointed to by $self->{KEY}, or, set it
# if it's not a ref to something else.
if (exists $self->{"_$method"} && !ref($self->{"_$method"})) {
eval("*$AUTOLOAD = "
. "sub {"
. " my (\$self, \$value) = assertMinMaxArgs(1, 2, \...@_);"
. " if (\$value) {"
. "\$self->{\"_\$method\"} = \$value;"
. " }"
. " return \$self->{\"_\$method\"}"
. "}");
}
goto &$AUTOLOAD;
}
}
What this AUTOLOAD sub does is this:
- First, it strips everything before the :: leaving just the methodname
(in perl, method names look like: CLASS::method() )
- Then, it looks to see if there exists a member variable
$self->{_}, and that it's not a reference to something
- Then, it creates an anonymous sub (== a lambda in python I think)
Each anonymous sub looks like this:
sub {
my ($self, $value) = assertMinMaxArgs(1, 2, @_);
if ($value) {
$self->{_$method} = $value;
}
return $self->{_$method}
Essentially, it works like this. If I have a member variable _foo, and
I want to either set or get _foo, I call a method $self->foo(). If I
call it as $self->foo(bar), the _foo gets set to bar, otherwise, I get
back the current value of _foo. So, the anonymous sub above, gets
re-written as:
sub foo {
my ($self, $value) = assertMinMaxArgs(1, 2, @_);
if ($value) {
$self->{_foo} = $value;
}
return $self->{_foo}
I can basically create 1 method which will automagically create for me,
getter and setter methods for any member variable I create in my class.
(this is extremely similar, if not identical, to lisp macros!)
For some reason I didn't think python had this capability, but someone
mentioned to me it did, but I'm not quite sure how I'd write it.
Does anyone have any ideas?
--
Thanks,
Paul
___
gnhlug-discuss mailing list
gnhlug-discuss@mail.gnhlug.org
http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Rootkit signatures?
Seth Cohn writes: > Kenny, you've answered your own question why the rootkit detectors are > all aged badly: Tripwire does this, without the need for updating > rootkit signatures. > > You need to just go back and answer the initial request with: > > This was already implemented on XX/XX/200X by the installation of > Tripwire on our system(s), which performs checks on all major files on > all servers in question. In addition, I would add something like: "Additionally, we have redirected all Tripwire reports to your group so that you can personally keep an eye on the security of these systems." And make sure to have tripwire alert on all logs in /var/log ;) -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Donations for the Library
I have two beginner-level books from Addison Wesley's "Spring into..." series, "Spring into Linux" and "Spring into HTML and CSS". The GNHLUG library (or whatever) is welcome to them (tell me where to send them, or I can meet you for a beer sometime :) Let me know if the Library is interested. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Old LJ and SysAdmin issues
Anyone want them ? I've got Linux Journal going back to probably 1995 or so, and SysAdmin maybe about the same time. If not, they're destined for the recycle bin. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: HTML scraping in python
So, I have the tables from the page in a list. Taking a hint from
Shawn's example, I can get this:
(Pdb) tables[0].input
I need to now parse this input tag into it's separate elements so I
can get at 'name' and 'value'.
Ooh, it appears I can do this:
tables[0].input.get('name')
tables[0].input.get('value')
Excellent!
Thanks everyone ;)
--
Seeya,
Paul
___
gnhlug-discuss mailing list
gnhlug-discuss@mail.gnhlug.org
http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: HTML scraping in python
Lloyd Kvam writes: > easy_install mechanize > should simply do the right thing. If it does not, you're > probably better off doing a distutils install: This is what all the docs said, however, I couldn't find easy_install. It turns out that when I installed python, python created symlinks from the Mac /Library/... path to /usr/local/. The latter of which is in my path, the former is not. When I installed setup_tools, it didn't create similar symlinks, which confused the heck out of me. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: HTML scraping in python
"Shawn O'Shea" writes:
> There is. The BeautifulSoup docs/examples page has been invaluable to me
Hmm, I didn't find that page quite as helpful as you seem to have.
Perhaps I spend more time with it...
> the past for learning BS. Anyway, here's an example that should help.
>
> $ python
> Python 2.5.1 (r251:54863, Jan 13 2009, 10:26:13)
> [GCC 4.0.1 (Apple Inc. build 5465)] on darwin
> Type "help", "copyright", "credits" or "license" for more information.
from BeautifulSoup import BeautifulSoup as BS
html = "data"
soup = BS(html)
soup
> data
soup.td
> data
soup.td.contents
> [u'data']
Hmm, that's an interesting approach. I ended up with:
doc = open('foo.html')
htmlData = BeautifulSoup(doc.read())
tables = htmlData.findAll(name='table')
rows = tables[1].findAll(name='tr')
(I happen to just need data from the second table on the page).
'rows' ends up as list of every row in the table.
>From there, I can loop over them like this:
for row in rows:
currentRow = row.findAll(name='td')
Then, for each element in the currentRow, it appears I can do this:
for element in currentRow:
data = element.string
>From there it's a simple matter to insert that data into the database
where I want it. Though, it strikes me that there ought to be a less
manual way of doing this. Perhaps that assumes perfectly structured
html, but it seems that extracting tables is a common thing to do, and
that there ought to be something equivalent to Perl's
HTML::TableExtract module.
Of course, looking back at some of the code I wrote a while back using
HTML::TableExtract makes me cringe, so maybe this is a better way, or,
maybe, html sucks so badly that there just isn't a good general way of
doing this.
--
Seeya,
Paul
___
gnhlug-discuss mailing list
gnhlug-discuss@mail.gnhlug.org
http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: HTML scraping in python
Paul Lussier writes: > I stumbled up BeautifulSoup and am now trying to get that and the > mechanize module installed. Okay, I've got that installed. I've figured out enough BS to get me a single row of the table into a list comprised of elements like: 'data' Now I just need to figure out how to strip the html off of the data. I could do it by writing a regexp, I suppose, but I'm hoping there's a method which already does this. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: HTML scraping in python
Lloyd Kvam writes: > I assume you want a dict for each row. Yes, with the column headers as the keys. > I have not seen a table extract module. BeautifulSoup is a third party > module that is usually effective in dealing with any HTML. Hopefully > the table is reasonably simple with no colspan/rowspan attributes and > funny data mixed in. I stumbled up BeautifulSoup and am now trying to get that and the mechanize module installed. However, mechanize seems dependant upon ClientForm, and I can't figure out how to get the ClientForm*.egg installed. I placed it in sys.path, but it's not getting picked up, I tried to manually test that it would work using pkg_resources and require(), but got this: $ python Python 2.6.2 (r262:71600, Apr 16 2009, 09:17:39) [GCC 4.0.1 (Apple Computer, Inc. build 5250)] on darwin Type "help", "copyright", "credits" or "license" for more information. >>> import pkg_resources Traceback (most recent call last): File "", line 1, in ImportError: No module named pkg_resources When I look at sys.path, it seems as if it knows about mechanize, but not ClientForm, despite having copied ClientForm there: $ ls -1 /Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/site-packages/ ClientForm-0.2.10-py2.6.egg README easy-install.pth mechanize-0.1.12.dev_r62424-py2.6.egg > Are the column headers in th tags? Can you use the headers to create > field names? (e.g. fieldname = '_'.join( head.lower().split() ) I think so. I'll try that as soon as I can get mechanize, BeautifulSoup, and ClientForm installed and working correctly :) > I've got to run (a funeral), but am happy to help. I'll check my email > when I get back. Thanks! -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
HTML scraping in python
Hi Folks, I would like to extract a table from an HTML document and break it down to a dict for further processing. I've googled around a bit and found about 4 different modules that do html processing, but nothing on dealing explicitly with tables (something like Perl's HTML::TableExtract module). Can someone more knowledgable please point me in the right direction ? -- Thanks, Paul P.S. I'm also looking for a job if anyone knows of anything, or needs a sysadmin with great perl skills and growing python experience :) ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: [OT] Re: UNIX license plate
jk...@kinz.org writes: > On Fri, May 22, 2009 at 10:35:04AM -0400, Paul Lussier wrote: >> I too, had one of those plates on the front of my car. Recently when >> I brought in for it's every-13-month re-inspection, the mechanic >> performing the inspection informed me afterwards that he is required >> to remove vanity plates from cars, as they are "now illegal". > > Just out of curiosity, does the mechanic keep the plates or > return the property to its owner? He left the Linux plate on the front seat of my car for me to "do whatever you want with" :) Of course, the laziness which has prevented me from looking up the law has also interfered with it's reappearance on the front of my car :-\ -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: NH Linux Users Map
Arc Riley writes: > I've started a google map to show where the linux users are in NH > > Here's the map - And here's a more user-friendly tinyurl :) http://tinyurl.com/qd5zz8 -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: [OT] Re: UNIX license plate
"Michael ODonnell" writes: > I was recently parked for just a few moments in downtown Lowell and > came back outside to find a meter lady writing me a ticket. I asked > her what the violation was and she mumbled something incoherent > about the plates being different. I pressed for an explanation > about specificially what the problem was and after much additional > incoherence she finally tore up the citation and wandered away > muttering. For all I know there may indeed be some (interpretation > of some sort of) regulation that I'm violating with my plates, and > even if not she probably still had the power to tangle me up by > issuing the citation out of spite, so I guess I got lucky... I too, had one of those plates on the front of my car. Recently when I brought in for it's every-13-month re-inspection, the mechanic performing the inspection informed me afterwards that he is required to remove vanity plates from cars, as they are "now illegal". I don't know if they're really illegal (nor have I bothered to find out). And if they are, I have no idea when they became so, as I've had that plate on there for several years. I've even been stopped for speeding and never had the officer comment on it (of course, he was always behind me looking at the one valid plate). -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: python unittest question
Lloyd Kvam writes: > On Tue, 2009-04-28 at 19:46 -0400, Paul Lussier wrote: >> Is anyone here familiar with unit testing in python using the unittest >> module? If so, I'm rather stumped on something. >> > The nosetests module (package probably named python-nose) will do what > you want though it supports a different naming convention for your test > modules. > > Essentially it looks for test*.py modules and runs them. It provides > consistent ordering and reasonably smart reporting. You can use command > line options to control essential aspects of your test runs. > > Highly recommended. Fascinating. How does nosetest differ from unittest ? Is it a built-in python module? Or do I have to download it from somewhere? Pointers? -- Thanks, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
python unittest question
Is anyone here familiar with unit testing in python using the unittest module? If so, I'm rather stumped on something. I have a directory with several seperate unit test suites $ ls testcases/ foo_t.py bar_t.py baz_t.py The _t is a local convention indicating this file is a suite of unit tests for module name which precedes the '_t'. Currently I run each moduld manually as: $ python foo_t.py Test foo() method. ... ok --- Ran 1 test in 0.027s OK But I'd really like a way to do a couple things: 1. run all tests in all suites 2. run any given test or set of tests within a single suite. Obviously I can already accomplish #1 with a crude shell script: $ for i in *_t.py ; do python $i; done And I believe there's a way to get #2 as well, but I'm not sure what it is. Ideally, I'd like a single python script which accomplishes both: $ runtests.py # would run all tests in all suites $ runtests.py --suite=foo# would run all tests in foo_t1.py $ runtests.py --suite=foo --test=Bar # would run the foo_t1.testBar() test Now, the caveat is that I should be able to create testcases/fii_t.py and then instantly run 'runtests.py' and it should automagically pick up the new fii_t.py and run all it's tests without me having to modify runtests.py. Any ideas ? Thanks. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: OT: Way off topic - Latest in password cracking software
Greg Rundlett writes: > I knew it was bound to happen someday > > Whole Foods Market is now selling Air !! > http://www.wholefoodsmarket.com/home.php Hey, if people will by water... -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Very important information!
I just came across this very important fact: The modern rack unit used in computing, i.e. the U in 1U, is by pure coincidence exactly equal to the vershok, an obsolete Russian measurement of length. Just thought y'all should know ;) -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Python, Windows, and Cygwin
virgins...@vfemail.net writes: >> Re Py3, the issue at hand is that the community has been planning Py3 for >> years and has agreed to move to it. This migration is like a slinky, and > > And by what authority do you claim to know the will of the "community"? > >> Any new Python-based projects should be Py3 based. It's self-defeating to >> do anything else. > > Of course your way is the only way. (I already knew that...) > >> Any new Python programmers should learn Py3 to start with so they don't have >> to unlearn the poor programming practices that are no longer supported in >> Py3. I'm not sure why you have a problem with what Arc said. I found no problem with it at all. It's entirely consistent with the way open source frameworks have been developed for years. When Perl4 was mainstream and Perl5 was release, it was often recommended that new people learn Perl5 over Perl4 for exactly the reasons Arc cited. I also don't believe he was espousing "his" way either, rather making a suggestion based on the current state of the language. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Python, Windows, and Cygwin
Arc Riley writes: > Python downloads for windows are right on the website. Unless you have a > pressing need to use the 3rd party cygwin version you should just download > it from python.org I'm not comfortable going with 3.x yet. We have vast amounts of legacy python from 2.x which needs to work across platforms. Until I can upgrade all the Unix systems to 3.x and ensure everything will build under 3.x, I need to stick with 2.5. Can you explain to me what is different about the Cygwin version ? Why is it not the same as the Windows version ? -- Thanks, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Python, Windows, and Cygwin
Thanks for the response, Walter! Walter Mundt writes: > For what it's worth, if you just associate .py files with a Python > installation in C:\Python via the standard Windows mechanism for > specifying what application loads a particular extension, it doesn't > matter that the path at the top of the script files is wrong. After > all, Windows doesn't generally pay any attention to such things anyway. You assume I have a clue to what you're talking about :) I have no idea how to do that... Also, given that I want to be able to ssh into the windows system and exec a python script directly, will that make a difference ? I'm not sure how different the cygwin environment is from the normal Windows environment. And when I ssh into the Windows system, I'm definitely under the Cygwin influence. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Python, Windows, and Cygwin
Arc, Thanks for the response! Arc Riley writes: > Why are you using Cygwin's Python? Why not? First, a disclaimer. I'm a complete newbie to both Python and Windows. So anything you know to be broken with the idea, I'm completely open to learning how to do differently :) My rationale was simply that Cygwin has a version of python new enough to suit my purposes (2.5.2), and it runs on Windows. And, it's better to have 1 version of python installed than more than one, which could possibly sow confusion amongst others who don't know better. Also, the Cygwin version of python uses a normal UNIX-style path of /usr/bin/python, which makes it simpler to run the same python programs on both UNIX and Windows, which is one of my requirements. If you think going with the native Windows version of python is better than the the Cygwin version, I'm good with that. I just need to figure out how to map the C:\Python path to something more UNIXy or, change where it gets installed. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Python, Windows, and Cygwin
Hi Folks, I'm trying to use the version of python which comes with Cygwin (2.5.2) to deal with stuff written for Python for Windows (2.5.1 and older). These older versions of pyton depended on seperately installing the pywin extension, which I though had been since rolled into the core distro of python. But I can't seem to find it under the cygwin version... Does anyone have any ideas? The code I'm looking at does this: import _winreg Thanks. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: :-) Please use [OT] for Re: FYI: The Unix philosophy
jk...@kinz.org writes: > The example of GNOME choosing to have non-human-editable > configuration files is but a single instance in this waterfall of > movement. GNOME forced me to abandoned it when I was *required* to install a sound library because of a dependancy upon it by the printing library. Why I need sound to print is still, to this day, a mystery to me! > Another is GNOME requiring all changes to the > configuration information be done through the gconf program. And this is why I abandoned GnuCash. The ability for me to use standard Unix command line tools on my data, config, and mail files, among others, is absolutely huge to me. I understand Aunt Tillie won't want or know how to do this, but I do. And I don't want to lose this ability! -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: linux accounting software or cheap winxp
virgins...@vfemail.net writes: > Ah. I thought, by "ledger", you were referring to part of Gnucash. > "ledger" is the name of one of Gnucash's components (the part in which > the transactions are entered). It seems "ledger" is also a the name > of an altogether different accounting package... Indeed. Sorry for the confusion. Ledger is a command-line, double entry accounting package by John Wiegely (of emacs fame). It's written in c++, is super fast, super simple, and super powerful. http://www.newartisans.com/software/ledger.html There's a Google Group here: http://groups.google.com/group/ledger-cli -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: linux accounting software or cheap winxp
Bruce Dawson writes: > OK. I'll ask the obvious next question - where did this 'ledger' command > come from? Err, apt-get install ledger ? Though I tend to compile from source. It's a John Wiegley production, so it should be available from his website, www.newartisans.com. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: linux accounting software or cheap winxp
Bill McGonigle writes: > On 02/24/2009 02:55 PM, Paul Lussier wrote: >> My goal is to track the gasoline usage, not the cost of the gasoline I >> use. The former doesn't vary much, whereas the latter varies >> drastically. > > Can you just enter gallons as dollars? No, because I want to track both my costs and my usage. In Ledger I can simply do this: 08/08 BJ's Wholesale Club Expenses:Auto:Fuel GAL 13.569 @ $ 3.669 Assets:BankAccounts:Checking$ -49.78 Then I can run a report like this to see total gas consumption: $ ledger -f ledger.dat -p 2008 bal fuel GAL 316.516 Expenses:Auto:Fuel GAL 316.516 p...@whozit - /Users/pll/personal/finance/ledger#[949] Or this when I want to report actual costs for gas: $ ledger -f usaack.dat -p 2008 -V bal fuel $ 1,161.30 Expenses:Auto:Fuel $ 1,161.30 I use this to track heating oil, gasoline, electricity, and pretty much anything else that has a frequently fluctuating dollar value. I haven't yet figured out how to track things like this in GnuCash. Other things I've done with ledger, not easily recreated in GnuCash (or any other finance package that I know of) is to track my commuting costs between driving, taking the T and the Commuter Rail. For example when I ride my bike to work during the summer months, I drive more and take the T less, but I also have to purchase separate Commuter Rail and T passes since I didn't get monthly passes during that time. I can easily track my T and Commuter Rail rides as a currency: 05/31 MBTA Liabilities:CreditCards:USAA $ -93.00 Assets:Commute:Train CR 12.00 06/04 Train to North Station Assets:Commute:Train CR -1.00 Expenses:Commute:Train 06/04 Green Line to Lechmere Assets:Commute:Train T -1.00 Expenses:Commute:Train 06/06 Commute Home to Bedford Assets:Auto:Fuel GAL -1.414 @ $2.999 Expenses:Commute:Fuel 06/06 Commute Bedford to Home Assets:Auto:Fuel GAL -1.414 @ $2.999 Expenses:Commute:Fuel Now I can track my commuting only costs: $ ledger -f BikeCommute.dat bal $ -135.23436 CR 5.00 GAL -132.812 T 1.50 Assets $ 662.708 CR 43.00 T 5.00 Expenses $ -480.500 Liabilities $ 46.973893224 CR 48.00 GAL -132.812 T 6.50 Which tells me I've put 480.50 on my credit card, I've got 1.5 T rides left, and 5 Commuter Rail rides left, and I've used 132 Gallons of gas. And I can quickly figure out the cost basis: $ ledger -f BikeCommute.dat -VB bal $ -663.15 CR 19.00 T -5.00 Assets $ 662.71 CR 43.00 T 5.00 Expenses Telling me I've spent a total of $662.71 in commuting thus far: consisting of 43 Commuter Rail rides, and 5 T rides. The other thing I *really* like about ledger is that it's file is a simple ascii text file. I have over 8 years of financial data across more than 12 different accounts in a total of 4MB. For comparisson, the last time I seriously used GnuCash (2000/2001ish), which was right after they decided to move from plain ascii text to an XML-based file. My Y2000 GnuCash.xac data file, for only the year 2000 weighs in at 1.7M. Ledger is both smaller, more flexible, and suits my needs for the wacky things I like to do better than GnuCash, which, like most graphical applications, traps you into fairly restrictive interface, and takes significantly more time to load up. Please don't take this a slight towards GnuCash. It's not. I think it's a fantastic app if what you require is a GUI like thing that replaces something similar in the Windows world like MSM or Quicken. My requirements are significantly different than most people. My two biggest reasons for preferring ledger are: - I need to be able to simply, quickly enter lots of transactions. A GUI is seldom going to allow me to work at the speed I desire. Ledger allows me to enter data from within emacs, from the command line, via e-mail/procmail/shell-script (admittedly, I've never done the latter, though I've thought about setting such a hook up many times). - I need to be able enter data from multiple locations without waiting for a GUI. I tend to enter data from my laptop and from work. Since I can ssh into my server from both locations and access emacs within my screen session, it's simple to enter my data in one location and not worry about sync'ing things up. Also, being able to run things like perl, sed/awk, and grep on my data files and have it spit out something meaningful is a huge win for me most peop
Re: linux accounting software or cheap winxp
virgins...@vfemail.net writes: > There's a GTK-based (gnome-based glade-based guile-based...) > accounting package called Gnucash (www.gnucash.org). My latest current complaint with GnuCash is the lack of support for commodities purchased outside of a commodity exchange. What I want to do is enter my receipts for gas for my car, both for me and my wife, then run a report on some periodic basis comparing gasoline usage. I can't just ask: "How much did I spend on gas compared to last year?" That is an insufficient question with the volatility in oil prices. I don't purchase gasoline from an exchange either, something GnuCash seems to want me to enter in order to track commodities. My goal is to track the gasoline usage, not the cost of the gasoline I use. The former doesn't vary much, whereas the latter varies drastically. This is a simple concept which can be applied to anything which can have a fluctuating currency value. FWIW, 'ledger' makes this fairly simple. And it uses emacs as an interface to boot, which makes it even better in my mind ;) -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Ubuntu NH Remix 9.04
Bill McGonigle writes: > On 2009-01-20 4:05 PM, Paul Lussier wrote: >> Ooh, could we have a card-board kiosk at Home Depot like AOL used to >> do with free CDs;) > > Retail folk tend to not value free stuff. If, on the other hand it's > massively profitable (at $2.50 to manufacture and selling for $13 at > Amazon ... say sell it to Staples for $5 to cover shipping and > slapping on a 'NH Edition' sticker, and set the MSRP at $19.99, > discounted to $14.99) then the stores will take care of promotion. You realize I was being completely facetious and sarcastic, right? -- Seeya, Paul - who is seldom taken seriously about anything... ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Ubuntu NH Remix 9.04
Arc Riley writes: > These places double as distribution points along with organizations with an > interest in promoting it as well (ie, libraries who we've setup search of > their catalog on). Ooh, could we have a card-board kiosk at Home Depot like AOL used to do with free CDs ;) -- Seeya, Paul P.S. Arc, I think this a great idea! Kudos to you for promoting it! ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Postfix authentication to ComCast port 587
Bayard Coolidge writes: > Michael, you're not being singled out - I got the same nastygram a month > or two ago I got the same nastygram several months ago claiming I was sending spam, when I'm fairly certain I wasn't. They claimed my computer might be infected with a virus and that I should download their free anti-virus software. Since my wife is on Windows, I didn't discount the possibility that her system was infected, and attempted to follow their directions. To make a long story short, their anti-virus software required me to re-install my wife's system... She never had a problem until I installed that anti-virus package from Comcast... I've sadly needed to use port 587 ever since :( -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
sftp and chroot?
Has anyone set up sftp in a chroot environment before? My IT guy is trying and having a helluva time on Centos 5... If anyone knows of any gotchas or tricks I could pass over to him, I'm sure he'd very much appreciate it. Thanks, -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Blackduck Software and IP
Bill McGonigle writes: > Are they fixing the debs too? I don't know. They may be submitting bug reports against them, but to my knowledge, they're not. One of the difficulties they help solve is the derivative-works licenseing issue. For example, if I release something under the GPL, but I depend upon libs released under the BSD, Apache, and some share-ware-send-me-a-postcard-or-pizza license, which one is *really* in effect, legally speaking. Of course the answer to that is, it depends. They, I believe, can assist with that problem, in the sense that they have audited the packages and know which licenses affect things. Sadly, it's not a case of simply saying, "Oh, this package is under the GPL.". If you're redistributing that package and it's dependancies, you need to know what licenses all of those packages are under. It can get very, very messy. So, no, I doubt they're fixing the problem. It's too widespread and convoluted, and "not their job". But that's purely speculation on my part. I don't know for a fact whether or not they are. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Blackduck Software and IP
"Jeff Macdonald" writes: > Hi all, > > This isn't strictly Linux related, but a pointy-hair boss here > mentioned to a peer of mine the desire to bring these folks in. I'm at > a loss why any company would actually need such a service, so I'm > wondering if any of you have anyinsight. My view is that since open > source software is publicly available, an organization that would > claim IP (intellectual property) rights would simply be better off > sending cease and desist orders to the author of code. I do understand > that wouldn't be as profitable as going after a company with deep > pockets. The company I work for doesn't ship any code. We simply use > open source in house to provide services. I would also think that once > some sort of IP infringement is found, that would make the company > more liable until such infringing code is removed/recoded. A good friend of mine worked at BlackDuck for a bit before moving to California. One of the things they do is help you audit your code so you know what licenses the software falls under if you re-distributing it. Not all of what is avaliable for Linux is GPL'ed. There are several different FOSS licenses, and several "free-ware" licenses, etc. For example, my last company build a product on top of a Debian base. We needed to provide a copy of each and every license for each piece of software (well, that's the lawyers told us). In order to do that, we needed to know what license each package fell under. Sadly, many, many packages don't have the License field of the .deb package manifest file filled in. BlackDuck (i.e. specifically my friend) has spent months painstakingly researching each and every package for Debian (and probably RH, others) and created a database correlating versions with packages with licenses, etc. Additionally, they've created checksums of everything such that they can scan large repositories and detect these signatures to help you determine if what your shipping falls under certain licenses. They are in fact a legit company, consisting of people who hold FOSS very near and dear. They have just found a way to monetize a service around FOSS as well. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: For all you outspoken people....and some of you quiet ones...
"Arc Riley" writes: > - Best Open Source Programming Language > > Python 3, released this Fall it makes programming even more intuitive and > easy to learn Did they get rid of that silly whitespace rule? -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Thots on evolution vs t'bird.
So, Is it possible to use an external editor with Tbird? Is something like "It's All Text" for Firefox also available for thunderbird ? I couldn't find it on the Thunderbird page. I want to click on reply and have the text sent to emacs via emacsclient Thanks, -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Python question
"John Abreau" writes: > Um, that's completely meaningless -- "end - begin" is not a clock > value, it's the number of seconds that "long wait here" took. > Since it's not a clock value, it makes no sense to use it as > a parameter to time.localtime(). I understand that. Which is why I was asking for help :) -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Python question
"Steven W. Orr" writes: > Guys, don't use time! Use the datetime interface I previously > described. That's what it was made for. :-) > > #! /usr/bin/python > import datetime > import time > > then = datetime.datetime.now() > print "then = ", then > > time.sleep(5) > > now = datetime.datetime.now() > print "now = ", now > > print "Elapsed = ", now - then Doh! I saw this in the modules reference, but simply didn't grok it at the time. This is *exactly* what I want to do! Thanks! -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Thots on evolution vs t'bird.
"Jon 'maddog' Hall" writes: > Evolution supports IMAP, POP and local mail. > > It also supports multiple identities. pll> Which is important for those of us who have these! fred> Shhh, no we don't, you're not supposed to give away our secrets pll> oh be quiet, it's not like they don't already know! fred> Fine! Have it your way! But don't blame me when those nice men fred> in white coats come to take you away! pll> They're coming to take me away?! fred> Ha, Hah! -- Seeya, Paul - who goes back to lurking mode... ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Python question
"Thomas Charron" writes:
> Example:
>
strftime("HH:MM:SS ", localtime())
> '14:17:15'
Ah, I see. So, if I do this:
>>> begin = time.time()
[... long wait here ... ]
>>> end = time.time()
>>> time.strftime("%H:%M:%S", time.localtime(end - begin))
'19:16:07'
so, the MM:SS are correct, but the 19 for hours is incorrect. It
should be 00, because "long wait here" was 16:07.
>>> end - begin
967.31416082382202
>>> time.localtime(end - begin)
(1969, 12, 31, 19, 16, 7, 2, 365, 0)
So far, it seems my best bet is to do the math on the difference
between end, begin myself; something like this:
def ElapsedTime (time):
"""Convert a float into HH:MM:SS string"""
days = time / 60 / 60 / 24
if days < 1:
days = 0
mins = int(time / 60)
if mins > 60:
hours = int(mins / 60)
mins = int(time % 60)
else:
hours = 0
secs = int(((time % 60) - int(mins)) * 60)
days = (days < 10) and ("0%s" % days) or days
hours = (hours < 10) and ("0%s" % hours) or hours
mins = (mins < 10) and ("0%s" % mins ) or mins
secs = (secs < 10) and ("0%s" % secs ) or secs
return "%s:%s:%s:%s" % (days, hours, mins, secs)
I'm certainly appreciative of better ways to do this :)
Thanks.
--
Seeya,
Paul
___
gnhlug-discuss mailing list
gnhlug-discuss@mail.gnhlug.org
http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Python question
"Thomas Charron" writes: > On Tue, Jan 6, 2009 at 4:26 PM, Paul Lussier wrote: >> Hi Folks, >> Is there a python way to get HH:MM:SS from time.localtime() ? > > time.strptime? One would have thought... >>> time.strptime(time.localtime()) Traceback (most recent call last): File "", line 1, in File "/opt/local/lib/python2.5/_strptime.py", line 327, in strptime found = format_regex.match(data_string) TypeError: expected string or buffer -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: GNHLUG in 2008, a retrospective by the numbers
virgins...@vfemail.net writes: > That "both alive AND dead" part was a reference to a famous thought > experiment known as "Schroedinger's Cat". Yes, I was quite well aware of that, hence my response... -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: GNHLUG in 2008, a retrospective by the numbers
virgins...@vfemail.net writes: >> From: Paul Lussier >> Date: Tue, 06 Jan 2009 14:47:06 -0500 > >> My question is this: >> >> What did his Administrator do to deserve being put in a box, and was >> he (or she) ever let out? > > The Administrator in the Box both alive AND dead until the box is > opened, right? One could assume that, yes. But we presume, for sake of being a somewhat humanitarian group, that he did place a live Administrator in the box. Therefore, we suspect the Administrator is still alive. Though, he (or she) could have since died. But, until we open the box, we won't know. Therefore, you're right :) -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Python question
Hi Folks, Is there a python way to get HH:MM:SS from time.localtime() ? I'm trying to time how long it takes a python script to run and have thus done: BEGIN = time.time() END = time.time() ELAPSED = END - BEGIN So, now I have a number like 1231265125.36 Which is great, and I can write the code necessary to convert it, but figured that this wheel is probably already invented. And, since I'm just learning python, all better ideas are welcome :) -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: GNHLUG in 2008, a retrospective by the numbers
jk...@kinz.org writes: > On Sun, Jan 04, 2009 at 05:59:02PM -0500, Ted Roche wrote: >> * James Fogg's Administrator in a Box (DLSLUG, 17), > > Hey that one looks really interesting. I see it was back in > August? My question is this: What did his Administrator do to deserve being put in a box, and was he (or she) ever let out? -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: http://www.sysresccd.org
"Michael ODonnell" <[EMAIL PROTECTED]> writes: > After being disappointed by the CentOS5.2 LiveCD > kit I'm pleased to report that the Gentoo-based > SystemRescueCD does not suck. I found it remarkably > easy to customize to our needs and the same CD > (well, DVD in our case) can boot either a 32- or > 64-bit kernel (particularly useful in our case) and, > so far, it exhibits no rude behaviors like auto-mounting > my raw RAID mirrors or failing to find my drives... Fwiw, there's a great distro, Finnix, which is a LiveCD for sysadmins, which is also fairly easy to customize. http://www.finnix.org/ -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: ethtool/nic question
"Darrell Michaud" <[EMAIL PROTECTED]> writes: > Sometimes (with Wake on LAN) the NICs will be fully powered as long > as there's electricity on the motherboard, regardless of whether the > system is on or not. If you turn off WOL in the BIOS, does the NIC still stay fully powered? We discovered a bug in the Linux kernel e1000 drivers that will hork the firmware and the only fix was to remove the power cord and do a cold boot of the system. It's especially annoying when the chassis you need to yank power on is a single chassis with 2 seperate systems sharing a power supply, and you can't power off the other half! I'm wondering if we could avoid yanking power to these systems by shutting off WOL ? -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Querying bios settings from Linux
"Ben Scott" <[EMAIL PROTECTED]> writes: > Okay, so what's the make and model of motherboard, then? :) dmidecode reveals: # dmidecode --type 2 # dmidecode 2.8 SMBIOS 2.4 present. Handle 0x0002, DMI type 2, 8 bytes Base Board Information Manufacturer: Supermicro Product Name: X7DBT Version: PCB Version Serial Number: 0123456789 > So far, I've found this, which looks like it might be promising: > > http://linux.dell.com/libsmbios/main/index.html Maybe. It doesn't look so strong on the querying side yet aside from some standard stuff like vendor strings. Long-term it could be quite promising though. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: automatic hard linking
William Stearns <[EMAIL PROTECTED]> writes: > Good afternoon, all, > (Sorry for the late reply! :-) > > On Wed, 23 Jul 2008, [EMAIL PROTECTED] wrote: > >> One of the cool features it offered was a series of hourly, nightly and >> a monthly backup of files. We kind of surmised that it was some sort of >> hard linking of the same file name in a different directory... i.e. >> >> ~/foo.txt >> >> hourly.0/~/foo.txt >> > This is exactly the approach I used in rsync-backup: > > http://www.stearns.org/rsync-backup/ > > The script is currently set up to do nightly snapshots, but could > be tuned without too much trouble to do hourly snapshots if that was > needed. If memory serves, there's a linux-based backup utility which does this as well, also using rsync. I vaguely remember it mentioned in Linux Journal a few years back. Check out either dirvish or bacula. I think it's dirvish. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Querying bios settings from Linux
"Ben Scott" <[EMAIL PROTECTED]> writes: > Are these all one brand/model of machine? Or motherboard, if > they're whitebox? Yes, and yes. > If so, what is it? Do you happen to know who > OEM'ed the BIOS on it (AMI, Phoenix, etc.)? Phoenix. > Sometimes there are manufacturer-specific tricks. Not that I know > any off the top of my head, but it's an avenue worth pursuing. Great, if you know of any, please let me know. hwinfo and lshw seem to be promising. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Querying bios settings from Linux
[EMAIL PROTECTED]> rites: > Not access to BIOS perhaps, but something can be deduced by grepping > through the output of, e.g. lshw, hwinfo and dmesg as well. grepping dmesg is insufficient. What is this lshw and hwinfo you speak of? My systems seem to be lacking those commands. farm-404: apt-cache search lshw lshw - information about hardware configuration lshw-common - information about hardware configuration lshw-gtk - information about hardware configuration farm-404: apt-cache search hwinfo hwinfo - Hardware identification system libhd13 - Hardware identification system library libhd13-dev - Hardware identification system library and headers libhd13-doc - Hardware identification system library documentation Ahh, perhaps those will be useful! Thanks, -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Querying bios settings from Linux
Jarod Wilson <[EMAIL PROTECTED]> writes: > One crude option that might work, depending on the age of the kernels > and the drivers in said kernel: > > $ dmesg | grep -i ahci The problem isn't to figure out which have SATA drives, but to figure out if the BIOS is set correctly. dmesg isn't reliable for this. If the machine boots with the kernel correctly, then the ahci module loaded correctly. That doesn't tell me if the BIOS is set correctly, or guarantee it will happen correctly in the future. For example, I have 2 systems which are identical hardware, identical kernels, same BIOS settings, where both had SATA set to IDE. - farm-339 booted just fine and loaded the ahci module. - farm-444 hung at boot because it didn't load the ahci module and attempted to address the drives as IDE. I've got systems at remote locations which need to be upgraded to a new kernel in a lights-out scenario. I can't afford to reboot them and have them not come back up. I need to know what that BIOS setting is *before* upgrading the kernel so I can know which ones *NOT* to upgrade until someone can get on site and handle it correctly. Does explanation clarify things any? Thanks, and please keep the ideas coming... -- Seeya, Paul P.S. One idea presented was to query /dev/mem and /dev/nvram, since in theory all BIOS settings are stored there. I haven't checked yet, though. ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Querying bios settings from Linux
mark <[EMAIL PROTECTED]> writes: > You can try dmidecode: > > http://linux.die.net/man/8/dmidecode I did that: > On Tue, Sep 30, 2008 at 10:23 AM, Paul Lussier <[EMAIL PROTECTED]>wrote: >> dmidecode doesn't seem to give me this depth of information either >> (though it does tell me an awful lot of useful information). Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Querying bios settings from Linux
Hi all, Does anyone know a way to query BIOS settings from the command line in Linux? I need to find out if the SATA settings are set to IDE or AHCI on 100+ systems. It will really suck if I have to connect a console to each one and reboot into the BIOS... I don't care if I can't change it, actually, that might be scary :) dmidecode doesn't seem to give me this depth of information either (though it does tell me an awful lot of useful information). And, sadly, I don't have IPMI cards in the machines... Thanks. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Linux network behavior wierdness
Neil Joseph Schelly <[EMAIL PROTECTED]> writes: >> Fascinating, so how does this work? >> >> $ ssh farm-519 ping -b 10.95.255.255 -c 1 >> 64 bytes from 10.95.34.112: icmp_seq=1 ttl=64 time=0.074 ms >> 1 packets transmitted, 1 received, 0% packet loss, time 0ms >> >> $ ssh farm-519 cat /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts >> 1 > > ping -b "farm-519's broadcast" ...ought to have no response from > farm-519. It won't respond to them, but it can still send broadcast > pings. Right, but by that rational, when I'm on farm-519 and I 'ping -b 10.95.255.255', and assuming all hosts on that /16 subnet are configure similarly (such that /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts == 1) shouldn't I see no response at all ? I can almost guarantee that all hosts have this set, as it's the default for the kernel we're running. Thanks. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Linux network behavior wierdness
Paul Lussier <[EMAIL PROTECTED]> writes: >> Watch out for /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts. The >> default was changed between 2.6.13 and 2.6.14 to ignore by default. > > Ooh, I didn't know that, thanks! Fascinating, so how does this work? $ ssh farm-519 ping -b 10.95.255.255 -c 1 64 bytes from 10.95.34.112: icmp_seq=1 ttl=64 time=0.074 ms 1 packets transmitted, 1 received, 0% packet loss, time 0ms $ ssh farm-519 cat /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts 1 -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Linux network behavior wierdness
"Ben Scott" <[EMAIL PROTECTED]> writes: > On Fri, Sep 5, 2008 at 10:04 AM, Paul Lussier <[EMAIL PROTECTED]> wrote: >> Any insights would be most appreciated. > > In addition to the other (probably better) things people have > suggested, are any of these hosts running an iptables firewall with > connection tracking? Definitely not. > State table overflow can lead to weird behaviors like what you > describe. I've found that just running Linux "can lead to weird behaviors like what you describe." :-/ -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Linux network behavior wierdness
Dave Johnson <[EMAIL PROTECTED]> writes: > 10.95.0.0 is an unusual broadcast address, how did you end up with > that? It's a /16 network. 10.95.255.255 exhibits identical behavior fwiw. > Watch out for /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts. The > default was changed between 2.6.13 and 2.6.14 to ignore by default. Ooh, I didn't know that, thanks! -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Linux network behavior wierdness
Hi all, I have a wierd problem where some hosts respond to a broadcast ping packet and others don't. I have some hosts which, when I do a ping -b 10.95.0.0 everything answers. On other hosts, doing exactly the same thing, I get no response. A reboot resets a "broken" host, but over time it will re-develop the problem. And I can't seem to figure out how to make the problem occur... I can't figure out if it's something we're doing which is causing this change, or if it's a kernel thing where some threshold is reached and it just stops. Fwiw, we're running Debian/Etch with a 2.6.18 kernel. Most NICs are Intel e1000, though some are broadcom. In general, I've seen it happen across our lab on different hardware platforms with different motherboards and nics. Any insights would be most appreciated. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: IMAP URLs
"Michael ODonnell" <[EMAIL PROTECTED]> writes: > I just noticed that for any of my email folders Thunderbird will > report an URL of the form: > >imap://[EMAIL PROTECTED]/pathName > > ...and I wonder if there's a Linux tool like wget that I can use > to pull email folders and such from an Exchange server, hopefully > into a local hierarchy whose layout reflects that of the Exchange > server's and, ideally (I can dream!) one file per msg, MH-style. As others have said, fetchmail+procmail work superbly against an IMAP server, regardless of whether it's Exchange or otherwise. Procmail is more than happy to create MH mail stores for you. I did this for over 10 years while using (ex)mh and before switching to Gnus. Oh, and there's no need to know about imap:// URLs with fetchmail. You just point it at the correct server and port and it does it's thing. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Kernel parameters... X86_TSC
"Thomas Charron" <[EMAIL PROTECTED]> writes: > Do you have the hangcheck-timer module running? No, not to my knowledge. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Kernel parameters... X86_TSC
"Thomas Charron" <[EMAIL PROTECTED]> writes: > But it crashes with hpet and jiffies? Yes. > Was it a crash or a hang? What's your definition of either ? The terminal window is unresponsive, the console is un-responsive (magic-sysReq does nothing), and one needs to power-cycle. You can call that a crash or hang. Maybe it's more of a hang... Regardless, my system is dead and I can't get at my data -- Seeya, Paul (longing for the stability of 1.12.x right about now...) ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Free Runner Phone
Bruce Labitt <[EMAIL PROTECTED]> writes: > Sigh. I need to replace my gsm phone. I was hoping it was close. > Right now, I'd pay the $375 or so for the phone - if it was working. [...] > Does anyone make a gsm phone that doesn't suck? Something that is > usable on any carrier and can browse reasonably? GPS that works > wouldn't be bad either. Pipe dream? Anyone know of any Chinese phones > that might be ok? My daughter is going to spend some time in China, > maybe she can pick up something for me. I just heard today that T-Mobile is going to be the first to start shipping an Android-based phone. http://tinyurl.com/5cy87l T-Mobile is all GSM, which I expect means that the Android phones will be as well. It doesn't say how much the phone will be though :( -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Kernel parameters... X86_TSC
Thanks Thom! We've also discovered a simple and interesting test to break systems :( Run this, and at some point, if your clocksources are unstable, your system will hang, and eventually crash: while true; do sudo hwclock ; sleep 1 ; done We've run this across 2.6.18, 2.6.2[45] and set the clocksource in menu.lst to each of: tsc, hpet, acpi_pm, jiffies. We can crash them all :( -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Kernel parameters... X86_TSC
Hi all, Is anyone here familiar enough with the 'Clocksource tsc unstable' problem in recent 2.6 kernels to discuss the characteristics and manifestations of this bug? I'm looking to understand things like: - When the clocksource goes unstable, what happens from a userspace perspective? - Does time move at all? If so, which way, forwards, backwards, either? - If the TSC clocksource is registered unstable, and the another clocksource is chosen, can it too become unstable? - If so, how will I know? Will it log a similar error to the TSC error? Something like 'Clocksource [hpet,acpi_pm,jiffies] unstable' ? - What happens if the next clocksource goes unstable? Please note, I'm NOT looking for a solution to the TSC problem, that's readily available on the net. I'm looking to understand the problem thoroughly. -- Thanks, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Kernel parameters...
Hi all, I need to compile a kernel such that it doesn't load the 'tsc' clocksource. Everything I've found from googling says 'set the clocksource parameter to X on the command line" usually in the grub menu.lst file. I don't want that. I want the kernel image compiled to not use TSC. I've found CONFIG_X86_TSC=y in my kernel config file, but how do I verify that's the correct parameter or not? -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
NFS bug with 2.6.25 ?
Hi all, We've encountered a bug in 2.6.25 with sunrpc and the nfs-kernel-server package. In short, stopping/starting the nfs-kernel-server daemon results in an over-decrement of the module use count for sunrpc. Here's an example: $ lsmod|grep sunrpc sunrpc172672 35 nfsd,auth_rpcgss,nfs,lockd,nfs_acl $ sudo /etc/init.d/nfs-kernel-server stop $ lsmod|grep sunrpc sunrpc172672 30 nfsd,auth_rpcgss,nfs,lockd,nfs_acl $ sudo /etc/init.d/nfs-kernel-server stop $ lsmod|grep sunrpc sunrpc172672 30 nfsd,auth_rpcgss,nfs,lockd,nfs_acl $ sudo /etc/init.d/nfs-kernel-server start $ lsmod|grep sunrpc sunrpc172672 33 nfsd,auth_rpcgss,nfs,lockd,nfs_acl $ sudo /etc/init.d/nfs-kernel-server stop $ lsmod|grep sunrpc sunrpc172672 28 nfsd,auth_rpcgss,nfs,lockd,nfs_acl $ sudo /etc/init.d/nfs-kernel-server start $ lsmod|grep sunrpc sunrpc172672 31 nfsd,auth_rpcgss,nfs,lockd,nfs_acl $ sudo /etc/init.d/nfs-kernel-server stop $ lsmod|grep sunrpc sunrpc172672 26 nfsd,auth_rpcgss,nfs,lockd,nfs_acl This is on Debian/Etch for whatever that's worth. This ends up eventually causing a negative use count. We encountered it when the use count hit -15: sunrpc 172928 4294967281 nfsd,auth_rpcgss,nfs,lockd,nfs_acl, Live 0xf8a94000 One of our programs tries to parse /proc/modules, and the field containing 4294967281 was expected to be a 32bit int. Oops. Has anyone seen this before? Googling seems to reveal nothing. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: How do you determine the amount of system memory?
Bill McGonigle <[EMAIL PROTECTED]> writes:
> As Steve mentioned, dmidecode provides information on physical
> memory. Here's a quickie to dump memory sizes:
>
>sudo dmidecode -t 6 | grep Installed | grep -v Not | cut -f 2 -d :
> | cut -f 2,3 -d ' '
Interestingly, I have to use -t 17, not 6...
And this:
dmidecode -t 17 -q |\
awk '/Size: / && !/No Module/ {total = total + $2} END {print total}'
gets me total physMem...
> Sending that output into Frink should be quite easy, given an extra
> 10 minutes of work.
What's Frink ?
--
Seeya,
Paul
___
gnhlug-discuss mailing list
gnhlug-discuss@mail.gnhlug.org
http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: How do you determine the amount of system memory?
"Thomas Charron" <[EMAIL PROTECTED]> writes: > On 7/29/08, Paul Lussier <[EMAIL PROTECTED]> wrote: >> "Thomas Charron" <[EMAIL PROTECTED]> writes: >> > Are you talking about a real bug, or the fact that meminfo only >> > reports non kernel memory? >> A real bug. > > A bug in that /proc/meminfo doesn't report the amount of physical > memory uder MemTotal? Yes, and that possibly, over time, the amount of memory in /proc/meminfo actually decreases. I know there's an official, known-to-be-a-problem bug on this somewhere in the kernel bug tracking. I just don't know the exact details. I was given the task of "figure out how we can test this". And, just being back from vacation, my mind is rather fuzzy on just about everything, including the time of day and day of week... -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: How do you determine the amount of system memory?
Dave Johnson <[EMAIL PROTECTED]> writes: > $ sensors > eeprom-i2c-0-52 > Adapter: SMBus I801 adapter at e8a0 > Memory type:DDR2 SDRAM DIMM > Memory size (MB): 2048 > > eeprom-i2c-0-50 > Adapter: SMBus I801 adapter at e8a0 > Memory type:DDR2 SDRAM DIMM > Memory size (MB): 2048 I can't get this output... I, for some reason, only see things like this: w83627hf-i2c-0-2d ERROR: Can't get adapter or algorithm?!? VCore 1: +4.08 V (min = +4.08 V, max = +4.08 V) VCore 2: +4.08 V (min = +4.08 V, max = +4.08 V) +3.3V: +4.08 V (min = +4.08 V, max = +4.08 V) +5V: +6.85 V (min = +6.85 V, max = +6.85 V) +12V: +15.50 V (min = +15.50 V, max = +15.50 V) (beep) -12V: +6.06 V (min = +6.06 V, max = +6.06 V) (beep) -5V: +5.10 V (min = +5.10 V, max = +5.10 V) (beep) V5SB: +6.85 V (min = +6.85 V, max = +6.85 V) (beep) VBat: +4.08 V (min = +4.08 V, max = +4.08 V) (beep) fan1:0 RPM (min =0 RPM, div = 128) fan2:0 RPM (min =0 RPM, div = 128) fan3:0 RPM (min =0 RPM, div = 128) (beep) temp1:-1 C (high = -1 C , hyst = -1 C) sensor = thermistor temp2: +0.0 C (high =+0 C, hyst = +0 C) sensor = thermistor temp3: +0.0 C (high =+0 C, hyst = +0 C) sensor = thermistor (beep) vid: +1.419 V (VRM Version 11.0) alarms: beep_enable: Sound alarm enabled -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: How do you determine the amount of system memory?
"Thomas Charron" <[EMAIL PROTECTED]> writes: > Are you talking about a real bug, or the fact that meminfo only > reports non kernel memory? A real bug. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: How do you determine the amount of system memory?
"Kenny Lussier" <[EMAIL PROTECTED]> writes: > Where you have 400+ servers, it's well worth the investment. Ahh, the cost-sensitivity isn't for out 400+ systems in-house. The cost-sensitivity is "what's the customer willing to pay for our solution". Adding one of these cards into each system the customer purchases increases the costs of providing the solution to the end-customer. And, given that our customers are purchasing clusters of systems (usually 8 or more) the cost adds up very quickly. This seemingly negligible cost can actually end up being a deal-breaker to a lot of customers... :-\ -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: How do you determine the amount of system memory?
"Ben Scott" <[EMAIL PROTECTED]> writes: > On Wed, Jul 16, 2008 at 11:11 PM, Paul Lussier <[EMAIL PROTECTED]> wrote: >> I believe free reads /proc/meminfo. > > Yah, and so, apparently, does the sysconf(3) POSIX library function. :-/ > > Why are you looking to find out how much memory there is? Hardware > asset inventory, system requirements check, system health monitoring, > something else... ? There may be an alternative approach for some > things. I'm trying to write a regression test that will fail if the amount of memory reported is not equal to the amount of memory physcicall in the system. Since this is a known kernel bug, I'm looking for some reliable means of determining the amount of memory in the system to which I can compare the amount of memory reported by the kernel. If they don't match, the test fails, and we know we have a bad kernel. In the long run, our goal is to have an automated kernel testing framework that will download the latest kernel tarball, apply some number of patches, build the kernel, build the kernel package, install it on some number of systems of slightly differing hardware types, reboot, then run a bunch of tests against that kernel. Ironically, the hardest part of this whole thing has been reliably determining the amount of memory in the system :) -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: How do you determine the amount of system memory?
Thanks for all the responses so far. Once I've gotten back from vacation, I'll write up a summary on which approaches were tried, used/discarded and why. If you have any more idea, please keep them coming, and I'll check them when I get back this webinet interclicky thing connected to my computer... -- Seeya, Paul (who's off to a land without this fancy 'lectricity and cell phone signals) ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: How do you determine the amount of system memory?
"Kenny Lussier" <[EMAIL PROTECTED]> writes: > What kind of systems are these? Most systems today have some sort of > IPMI-based interface that is independent of the OS and can give you a > physical hardware inventory (and usually a whole lot more). Yes, there's an IPMI interface, but no IPMI module... So, no IPMI :( These are basically white (black?) box units from some vendor (name escapes me) but they're a fairly well known company which makes a variety of "custome" chassis for whomever wants to buy them and re-brand. The IPMI module is an option available to us, but one which until now, we've had no need for at the current cost. Of course, this might change :) -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: How do you determine the amount of system memory?
"Ben Scott" <[EMAIL PROTECTED]> writes: > On Wed, Jul 16, 2008 at 3:20 PM, Paul Lussier <[EMAIL PROTECTED]> wrote: >> Recent Linux kernels have had a minor bug in that the amount of memory >> reported in /proc/meminfo is incorrect. > > Got details? Not currently, and given I'm going on vacation in a couple hours, I won't have details for another week or so :) > Depending on how the bug manifests, it might be enough to compare > with the output of free(1). If they disagree significantly, bug > exists. If the bug effects more than /proc/meminfo, that won't work, > of course. I believe free reads /proc/meminfo. And I believe the bug does affect more than just /proc/meminfo. It's rumored that the bug also leaks memory such that watching /proc/meminfo over time will display a decrease in the amount of memory available. But that's not confirmed. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
How do you determine the amount of system memory?
Hi all, Recent Linux kernels have had a minor bug in that the amount of memory reported in /proc/meminfo is incorrect. I'm trying to find a way to determine whether the amount reported is correct or not. I need some means of reliably knowing whether this value is accurate or not. Does anyone have any ideas? "Physically looking" is insufficient, given that I a) need to test 400+ systems, and b) I may need to run this test on boxes to which I have no physical access. Thanks. -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Redhat 5 Cluster suite
"Kenny Lussier" <[EMAIL PROTECTED]> writes: > As soon as you stray a little bit outside of what > the packaged product considers the norm, you are on your own So, how is that different from any other software package, commercial *or* open source ? :) -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Redhat 5 Cluster suite
"Kenny Lussier" <[EMAIL PROTECTED]> writes: > Hi All, > > Sorry if this is a re-post, but I sent it yesterday, and I haven't seen it > come through yet You're sending this from gmail, check their filter settings. I've this a lot with gmail, where if you send to a list you're subscribed to, gmail eats it. > I have been tasked with some clustering work, and I have run into a few > snags. Is anyone familiar with the RHEL 5 clustering suite? You should find someone who used to work for MCLX whooh, wait. Never mind. ;) -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Firefox 3 AwesomeBar
Bill McGonigle <[EMAIL PROTECTED]> writes: > On Jun 19, 2008, at 15:11, Ben Scott wrote: > >> And don't even get me started about FidoNet addresses! > > Hey, I wonder if the spammers know how to parse bangpaths. No, but sendmail does... :) -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
Re: Firefox 3 AwesomeBar
"Tom Buskey" <[EMAIL PROTECTED]> writes: > I also turn off the left sidebar. There's a left sidebar? -- Seeya, Paul ___ gnhlug-discuss mailing list gnhlug-discuss@mail.gnhlug.org http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
