Re: plotting large datasets (DJ Delorie)

2009-08-22 Thread Rick Walker

Hi DJ,

 I can send you a pdplot input if you want to see what I'm up against.
 I got it to work, and the results are somewhat more usable that
 gnuplot in some ways, but less in other ways.  Some first impressions:

Please do, and then we can probably take this discussion into private email.

 1. The Time axis should have an option for time(2) format, converting
to day/hours/sec etc.  Currently, it shows the ten digit values in
scientific format, which overlap.

I usually send my data through some other program to manipulate the
data.  I have a 3 line idiom in awk to process UNIX time into decimal
dates like 2009.345 for plotting purposes. 

 2. It doesn't label the individual graphs, so you can't tell which
graph is which.

You can label each graph with the yscale command.  nextygraph takes
you to the next graph and yscale factor label gives it a yscale
label. 

You can also put legends in the graph itself with label x y
string, taking care to make sure it fits. 

 3. The zooming is different than everyone else - should be click-drag
rectangle (with outline), release to zoom.  The second point should
be allowed to be just outside the plot so you can reliably grab the
zero axis. 

It is different than gnuplot, but it is the same as HP's post processor
which is what the initial target audience was used to.  However, it's
not hard to change the zooming, and I think your suggestion is a good
one. 

 4. Dude, scrollbars :-)

What did you want to scroll?

 5. The git clone command fails.

Thanks.  I just fixed that.

 6. The homepage link opens the homepage within a frame, need to
  re-target the top window.

Thanks.  I'll fix that.

 7. If it had the ability to enable/disable the various graphs through
the GUI, it'd be nearly prefect for me, caveat the above.

This feature can be done nicely with a page of Tcl/Tk, customized to
your particular need.  Sometimes I use pdplot for multiple graphs,
sometimes as simply a vector plotter.  It's mostly optimized for driving
through stdin from a script.  That's why I suggest a front-end wrapper
to handle your application-specific data munging and formatting.  I use
awk() perl() or Tk(). 

You could even write a super simple bash or ksh script that let you do
something like:

plot 1 2 3  ; plot datapoints 1,2 and 3
plot 3-6; plot datasets 3 through 6

The plot script would read the arguments, parse the data file 
with grep or awk, label the plot and spit the ascii
representation to pd which would update the pdplot window.

If you want to send me the details of your data storage format, I can
make you a simple tool to select your plots on the fly.  Every
application is different, so I usually build this kind of stuff
as part of the problem setup for each different investigation.

Thanks for taking a look, and for the nice suggestions.

kind regards,
--
Rick Walker


-- 
fedora-list mailing list
fedora-list@redhat.com
To unsubscribe: https://www.redhat.com/mailman/listinfo/fedora-list
Guidelines: http://fedoraproject.org/wiki/Communicate/MailingListGuidelines


Re: plotting large datasets

2009-08-21 Thread Rick Walker

  I've got a need to plot value vs time data for 32 channels
  simultaneously.  Gnuplot isn't up to the task (not enough uniqueness,
  even mixing lines and points, or control - the graph is just a mess).
  What else is there?

You might try the pdplot program at
http://www.omnisterra.com/walker/linux/pdplot/intro.htm

It takes ascii datafiles and plots them to X11, postscript or
PNG.  The file format is x,y ascii data interspersed with
commands like:

title my plot
xscale 1 time
yscale 1 voltage
0 0
1 1
3 3
nextygraph
yscale 1 current
0 8
2 2
3 4
nextygraph
yscale 1 pressure
0 -1
3 3.99

the pdplot program is a daemon associated with a persistant
plot window.  You communicate with the daemon by sending data
to it with pd.  For instance, to plot the above file you'd save
it as myplot and do one of the following:

pd myplot
cat myplot | pd

If you want to add new data to an already existing plot you cat
do it with cat newdata | pd -n.

The general style and format works extremely well with awk(1) or
perl(1) for massaging ascii data files.

It's got a few rough edges because it is a brand new program, but
I promise to jump on any bug reports if you want to give it a try.

  Ideally, I'd like something I can interact with - enable/disable
  channels, highlight channels, change the time range, etc.  The data
  comes from processed log files, so either file or API input is OK.

Sounds like a good use for Tcl/Tk.  Write a front end to pd()
with lots of options.  Each time you make a change, Tk runs
through the data a replots it with the desired format.

kind regards,
--
Rick Walker


-- 
fedora-list mailing list
fedora-list@redhat.com
To unsubscribe: https://www.redhat.com/mailman/listinfo/fedora-list
Guidelines: http://fedoraproject.org/wiki/Communicate/MailingListGuidelines


Re: Funny mailer problem - BAD MSG^M

2009-06-15 Thread Rick Walker

 On 06/14/2009 02:51 PM, Rick Walker wrote:^M
  BAD MSG:^M
 ^M
   Could it be your .procmailrc or some anti-spam filter gone awry  ?^M

We'll it only started immediately after the upgrade.  I don't think an
upgrade can cause off-site problems, so something probably changed in
Fedora functionality or default modes of operation. 

I did a find on /usr/bin/ and found that the nmh inc program contains
the BAD MSG string.  Another hint is that all incoming messages are
now terminated with carriage returns (^M). 

I fixed the problem by adding stripcr to fetchmail's rc file..  I used
to have forcecr in the .fetchmailrc and it never caused a problem. 
I'm guessing that inc(1) has changed it's behavior and is no longer
happy with carriage return delimiters. 

--
Rick


-- 
fedora-list mailing list
fedora-list@redhat.com
To unsubscribe: https://www.redhat.com/mailman/listinfo/fedora-list
Guidelines: http://fedoraproject.org/wiki/Communicate/MailingListGuidelines


Funny mailer problem - BAD MSG

2009-06-14 Thread Rick Walker

Hi,

I just upgraded from Fedora 8 - 9 - 10.

Most everything is working or even improved, except for a
puzzling mailer bug.  All my incoming mail has the the line:
BAD MSG: inserted before body of the message.

I sent a message to my offsite mail server that looks like this:

cut here
Return-Path: wal...@omnisterra.com
Delivery-Date: Sun, 14 Jun 2009 11:25:11 -0700
Received: from chi (localhost.localdomain [127.0.0.1])
by chi.omnisterra.com (8.14.3/8.14.3) with ESMTP id n5EIP9mx028012;
Sun, 14 Jun 2009 11:25:10 -0700 Message-Id:
200906141825.n5eip9mx028...@chi.omnisterra.com
X-Mailer: exmh version 2.7.2 01/07/2005 with nmh-1.3
To: wal...@omnisterra.com
cc: wal...@chi.omnisterra.com
Subject: test message
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Date: Sun, 14 Jun 2009 11:25:08 -0700
From: Rick Walker wal...@omnisterra.com


test,
1-- 2-- 3-- 4-- 5---
--
Rick
cut here

and it was correctly delivered to my local machine.  However,
the mail sent to my server through sendmail, and returning via
fetchmail looks like:

cut here
Return-Path: root
Delivery-Date: Sun Jun 14 11:26:49 2009
Return-path: wal...@omnisterra.com
Envelope-to: wal...@omnisterra.com
Delivery-date: Sun, 14 Jun 2009 14:20:48 -0400
Received: from vps.omnisterra.com [xxx.xxx.xxx.247]
by chi with IMAP (fetchmail-6.3.8)
for wal...@localhost (single-drop); Sun, 14 Jun 2009
11:26:49 -0700 (PDT)
Received: from xxx-xxx-xxx-66.dsl.dynamic.sonic.net
([xxx.xxx.xxx.66] helo=chi.omnisterra.com)
by vps.omnisterra.com with esmtpsa (TLSv1:AES256-SHA:256)
(Exim 4.69) (envelope-from wal...@omnisterra.com)
id 1MFuK0-0006Vm-6h
for wal...@omnisterra.com; Sun, 14 Jun 2009 14:20:48 -0400
Received: from chi (localhost.localdomain [127.0.0.1])
by chi.omnisterra.com (8.14.3/8.14.3) with ESMTP id n5EIP9mx028012;
Sun, 14 Jun 2009 11:25:10 -0700
Message-Id: 200906141825.n5eip9mx028...@chi.omnisterra.com
X-Mailer: exmh version 2.7.2 01/07/2005 with nmh-1.3
To: wal...@omnisterra.com
cc: wal...@chi.omnisterra.com
Subject: test message
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Date: Sun, 14 Jun 2009 11:25:08 -0700
From: Rick Walker wal...@omnisterra.com


BAD MSG:


test,
1-- 2-- 3-- 4-- 5---
--
Rick
cut here


Who is inserting the BAD MSG: string, and why?

This is happening to all incoming mail, and started immediately
after the upgrade.

I'm using sendmail, fetchmail, and running slocal, nmh and exmh for the
mail reader and input processing. 

Here's the relevant /var/log/maillog entry:

Jun 14 11:25:10 chi sendmail[28012]: n5EIP9mx028012:
   from=wal...@chi, size=281, class=0, nrcpts=2,
   msgid=200906141825.n5eip9mx028...@chi.omnisterra.com, proto=E
SMTP, daemon=MTA, relay=localhost.localdomain [127.0.0.1]
Jun 14 11:25:11 chi sendmail[28014]: n5EIP9mx028012: to=|
/usr/libexec/nmh/slocal -user walker, ctladdr=walker (500/500),
/delay=00:00:01,
xdelay=00:00:01, maile r=prog, pri=60533, dsn=2.0.0, stat=Sent Jun 14
11:25:14 chi sendmail[28014]: STARTTLS=client,
relay=mail.omnisterra.com., version=TLSv1/SSLv3, verify=FAIL,
cipher=AES256-SHA, bits=256/256 Jun 14 11:25:15 chi sendmail[28014]:
n5EIP9mx028012: to=wal...@omnisterra.com, c tladdr=wal...@chi
(500/500), delay=00:00:05, xdelay=00:00:04, mailer=relay, pri= 60533,
relay=mail.omnisterra.com.  [xxx.xxx.xxx.247], dsn=2.0.0, stat=Sent (OK
id=1M FuK0-0006Vm-6h) Jun 14 11:26:45 chi sendmail[28039]:
n5EIQcIh028039: from=walker, size=0, class=0, nrcpts=0, 
relay=r...@localhost

I've googled BAD MSG: and have not found any other complaints
of this nature.

--
Rick Walker


-- 
fedora-list mailing list
fedora-list@redhat.com
To unsubscribe: https://www.redhat.com/mailman/listinfo/fedora-list
Guidelines: http://fedoraproject.org/wiki/Communicate/MailingListGuidelines


Re: How to mesure the inactivity time

2009-03-03 Thread Rick Walker

 I am developping a tool with java and I want to know the inactivity time of
 the user, i.e, the duration of the time that the keybord and mouse were not
 used.

You can check out my typing/mousing activity monitor written in
Tcl/Tk for helping people with RSI to take programmed rest
breaks: http://www.omnisterra.com/walker/linux/tm-1.2.tar

Here's the core code:

 proc get_idle {t m d} {
upvar $m midle  ;# mouse idle time
upvar $t tidle  ;# typing idle time
upvar $d delta_time

global now
global x
global y
global xold
global yold

set then $now
set now [clock seconds]

set delta_time [expr $now-$then]

set f [open {| cat /proc/interrupts}]
while {[gets $f line] = 0} {
   if [regexp  12: $line] {
   set xold $x
   set x [lindex $line 1]
   } elseif [regexp  1: $line] {
   set yold $y
   set y [lindex $line 1]
   }
}
close $f

if {$yold == $y} {
   set tidle [expr $tidle + $delta_time]
} else {
   set tidle 0
}

if {$xold == $x} {
   set midle [expr $midle + $delta_time]
} else {
   set midle 0
}
}

It basically looks for the mouse interrupt count (12:) and the keyboard
interrupt (1:).  If you have keyboard or mouse on USB you'll need
to look at (5:) instead.  cat /proc/interrupts returns a list
of interrrupt numbers and a running count.  If the count hasn't
changed since the last poll, then I consider this an idle
condition and increment the idle counters by the difference in
time between the last polling event and now.

--
Rick Walker


-- 
fedora-list mailing list
fedora-list@redhat.com
To unsubscribe: https://www.redhat.com/mailman/listinfo/fedora-list
Guidelines: http://fedoraproject.org/wiki/Communicate/MailingListGuidelines


Re: talk about your gEDA/pcb (Robin Laing)

2009-02-06 Thread Rick Walker

Dan,

  My basic problem is: where do I start?  I installed this with the
  hopes of testing out my version of a X10 like circuit (active and
  discrete components), and yet I look at the Circuit menu and I get
  flabergasted - because I was not sure what to do. 

I agree that the Geda suite is not very well integrated and hard to
break into.  However, I have used SPICE at work for decades and found
the Ngspice simulator fairly easy to use.  I'm developing my own
waveform viewer which allows arbitrary math to be performed on the
simulation waveforms:

http://www.omnisterra.com/walker/linux/post/intro.htm

For PCB layout (I'm also doing some X10 stuff!) I've been very
happy with Kicad:

http://kicad.sourceforge.net/wiki/index.php/Main_Page

I've done about 10 printed circuit boards with this GPL'd tool (some 2
layer, some 4 layer) with no problems.  It includes a schematic capture
tool, a footprint editor, and a PCB layout tool.  The layout can be
design rule checked and compared with the schematic.  Output is standard
Gerber.  You can even get a 3d view of the finished board. 

--
Rick Walker


-- 
fedora-list mailing list
fedora-list@redhat.com
To unsubscribe: https://www.redhat.com/mailman/listinfo/fedora-list
Guidelines: http://fedoraproject.org/wiki/Communicate/MailingListGuidelines