Re: proposed change to getty

2021-10-12 Thread matthew sporleder
On Tue, Oct 12, 2021 at 4:33 AM Robert Elz  wrote:
>
> Date:Mon, 11 Oct 2021 18:09:23 -0300 (ADT)
> From:Jared McNeill 
> Message-ID:  <5ab793c9-8cab-2e79-e6ba-8017d924b...@invisible.ca>
>
>   | There's a 2 second sleep in getty before opening the tty
>   | that has been there since before NetBSD
>
> I don't recall if that was there when this
> version of getty was created or not -- probably,
> in which case it was probably also in the 7th
> edition getty.   That all got done about 40
> years ago, far too long to remember.
>
> 2 secs back then was the smallest sleep that
> was guaranteed to be > 0 (the delay for sleep(n)
> was between n-1 and n secs).  Since that is
> no longer true, the smallest change that should
> happen is s/2/1/, or use usleep() or nanosleep()
> and make the delay even smaller, 200ms should
> be enough for any modem.
>
> Doing it in the driver is OK as well, but
> probably needs to remain in getty until we are
> sure that all drivers do this correctly.
> Since you are handling this by blocking open
> until long enough after the close had passed,
> also delaying the open in getty should have
> no real effect.
>
> kre

Do you mean modem like a telephone modem or modem like a serial port?


Re: A proposal for code explanation sessions

2021-08-18 Thread matthew sporleder
This is a really fun idea.  Twitch and youtube make the most sense for sure.

On Wed, Aug 18, 2021 at 7:15 AM Rocky Hotas  wrote:
>
> Hello!
>
> During this year's NetBSD Annual General Meeting on IRC (May 22nd),
> several participants suggested the activation of some code tutorial
> sessions performed by the developers.
>
> NetBSD sourcecode is in fact still a mysterious place for the new
> users, or just for those who read it for the first time. According
> to the chat, it would be great if some developer could show how they
> work on the sourcecode, for example with a live session, with any
> mean: a Youtube live, or even just an IRC live session.
>
> This arouse several difficulties: not only as regards the lack of
> time, but also the difficulties involved in understanding what a
> developer is doing (some automated operations, with obvious meaning
> for a skilled developer, are meaningless for someone else).
>
> I would like to re-open this discussion and, in particular, I would
> like to suggest something maybe simpler. Instead of explaining why
> some portion of code is being updated and how, it would be very
> useful to show and explain the code just as it is. For example, a
> volunteer developer could take an important, well known sourcecode
> file, and explain it line by line; as a starting trivial file,
> something like src/bin/hostname/hostname.c can be considered, then
> moving to something more complicated like src/sbin/init/init.c.
>
> While I'm sure it's not possible to actually explain every line,
> the principles used to write the code "that way", to place that
> function in that point, to call that function with those argument
> values, could be shown.
>
> I believe that some gentle introduction to kernel code would be
> extremely useful to the whole community, giving anyone more means
> to craft the code by himself, to improve it, to learn and eventually
> (why not?) to become a developer. It would be a huge enhancement
> for an "open-source" community, because the code would not only be
> available, but also comprehensible.
>
> What do you think about it? Would some developer be available for
> this?
>
> Bye!
>
> Rocky


Re: Scripting for /bin/ksh

2021-08-02 Thread matthew sporleder
On Mon, Aug 2, 2021 at 8:23 AM Todd Gruhn  wrote:
>
> I am attempting to write some ksh-scripts that invoke "borg" .
> How does one tell ksh to cat the 2 vars together and invoke the
> resulting command?
>
> $foo  <--> /umass1/BORG-REPOS
> $FIRSThalf <--> borg-3.8 list
> $cmd= $FIRSThalf  . $foo  #thats how it is coded in PERL
>
> execute $cmd
>
> I never learned much about /bin/ksh -- I jumped straight into PERL.
> Anyone know of some good PDFs regarding this?
>
> Any help will be appreciated.


foo="ls"
bar="/tmp"
cmd="${foo} ${bar}"
${cmd} #runs ls /tmp
---
output=$(${foo} ${bar}) #captures the output

not sure what "execute" is here

Your perl code wouldn't work because you don't have spaces using the `.`

working perl (looks just like the shell script):
perl -e '$foo = "ls"; $bar = "/tmp"; $cmd = "${foo} ${bar}"; print qx#$cmd#;'


Re: getting pkgsrc-wip with CVS

2021-06-14 Thread matthew sporleder
You unzip it and rename the directory to 'wip' under pkgsrc/ as if it
were a category

On Mon, Jun 14, 2021 at 6:36 PM Todd Gruhn  wrote:
>
> I got pkgsrc-wip, and unzipped it. I get the error:
>
> line 16: could not find ../../graphics/gd/buildlink3.mk
>
> Where do I unzip  pkgsrc-wip?
>
> On Mon, Jun 14, 2021 at 5:38 PM matthew sporleder  
> wrote:
> >
> > You may use: 
> > https://github.com/NetBSD/pkgsrc-wip/archive/refs/heads/master.zip
> >
> > On Mon, Jun 14, 2021 at 1:34 PM Todd Gruhn  wrote:
> > >
> > > Thats fine. I just dont care to learn git.
> > >
> > > On Mon, Jun 14, 2021 at 1:30 PM Greg Troxel  wrote:
> > > >
> > > >
> > > > Todd Gruhn  writes:
> > > >
> > > > > On Sun, Jun 13, 2021 at 6:04 PM Benny Siegert  
> > > > > wrote:
> > > > >>
> > > > >> On Sun, 13 Jun 2021, Todd Gruhn wrote:
> > > > >>
> > > > >> > Is it possible to get  pkgsrc-wip using cvs ?
> > > > >>
> > > > >> No. You have to use git.
> > > >
> > > > > Rats
> > > >
> > > > If there's an actual problem using git, I'd be interested in hearing
> > > > about it.  If you just choose not to use it, or haven't spent the few
> > > > hours to be able to start, then that's of course your call, but I don't
> > > > see it as a pkgsrc-wip problem.   Lots of people have been getting
> > > > pkgsrc-wip and contributing and overall things seem fine, as far as I
> > > > can tell.


Re: getting pkgsrc-wip with CVS

2021-06-14 Thread matthew sporleder
You may use: https://github.com/NetBSD/pkgsrc-wip/archive/refs/heads/master.zip

On Mon, Jun 14, 2021 at 1:34 PM Todd Gruhn  wrote:
>
> Thats fine. I just dont care to learn git.
>
> On Mon, Jun 14, 2021 at 1:30 PM Greg Troxel  wrote:
> >
> >
> > Todd Gruhn  writes:
> >
> > > On Sun, Jun 13, 2021 at 6:04 PM Benny Siegert  wrote:
> > >>
> > >> On Sun, 13 Jun 2021, Todd Gruhn wrote:
> > >>
> > >> > Is it possible to get  pkgsrc-wip using cvs ?
> > >>
> > >> No. You have to use git.
> >
> > > Rats
> >
> > If there's an actual problem using git, I'd be interested in hearing
> > about it.  If you just choose not to use it, or haven't spent the few
> > hours to be able to start, then that's of course your call, but I don't
> > see it as a pkgsrc-wip problem.   Lots of people have been getting
> > pkgsrc-wip and contributing and overall things seem fine, as far as I
> > can tell.


Re: getting pkgsrc-wip with CVS

2021-06-14 Thread matthew sporleder
How did you get it?  They should be generated on the fly (although
possibly cached at cdn)

On Mon, Jun 14, 2021 at 7:31 AM Todd Gruhn  wrote:
>
> How often do the snapshots update? I got one last night.
>
> On Mon, Jun 14, 2021 at 12:02 AM Martin Husemann  wrote:
> >
> > On Sun, Jun 13, 2021 at 02:46:28PM +, Todd Gruhn wrote:
> > > Rats
> >
> > You can download a snapshot with your browser though.
> >
> > Martin


Re: Daemonizing processes in NetBSD

2021-02-16 Thread matthew sporleder
On Tue, Feb 16, 2021 at 1:37 PM Bartek Krawczyk
 wrote:
>
> Hi,
> is there any program in base which allows to daemonize programs which
> don't detach from console, don't have any "-daemon" option etc.? There
> are sysutils/daemond and sysutils/daemonize in pkgsrc of course but do
> we have anything like "daemon" in FreeBSD base?
>
> As a workaround I'm using "&" from /bin/sh at the moment.
>


Classic nohup ./prog 2>&1 & should be an upgrade to what you are
currently doing, then :)


Re: sponsor NetBSD for 2020 https://github.com/sponsors/NetBSD

2020-11-10 Thread matthew sporleder
Indeed -- casting a wide net is in our interest.  I hope you are able
to use one of our many potential donation offerings -- paypal, stripe,
amazon smile, github sponsorship.. any I am missing?

On Tue, Nov 10, 2020 at 7:55 AM Sad Clouds  wrote:
>
> On Tue, 10 Nov 2020 12:31:26 +0100
> Matthias Petermann  wrote:
>
> > Hallo Matthew,
> >
> > Am 10.11.2020 um 05:35 schrieb matthew sporleder:
> > > Hey -- the end of the year is coming up fast.  Wouldn't you feel
> > > better about yourself if you added a github sponsorship to balance
> > > out your incredible year? :)
> > How does this type of donation compare to a Paypal Monthly
> > Subscription? Is it just a different way of transport, or are there
> > advantages / disadvantages to Paypal?
> >
> > Kind regards
> > Matthias
>
> It looks to me like github sponsorship is geared towards small
> developers who don't have their own project web page, with
> payment submission links, etc. The irritating thing about github is
> that they don't allow you to submit bug reports or donations unless you
> setup an account on their platform. Last thing I want to do is to create
> various social media accounts on competing platform - GitHub, GitLab,
> SourceForge, Bitbucket, GNU Savannah, ... and the list goes on. Life is
> too short for that nonsense. Luckily NetBSD accept bug reports and
> donations on their official web site, and you don't have to sign up for
> anything.


Re: sponsor NetBSD for 2020 https://github.com/sponsors/NetBSD

2020-11-10 Thread matthew sporleder
On Tue, Nov 10, 2020 at 6:31 AM Matthias Petermann  wrote:
>
> Hallo Matthew,
>
> Am 10.11.2020 um 05:35 schrieb matthew sporleder:
> > Hey -- the end of the year is coming up fast.  Wouldn't you feel
> > better about yourself if you added a github sponsorship to balance out
> > your incredible year? :)
> How does this type of donation compare to a Paypal Monthly Subscription?
> Is it just a different way of transport, or are there advantages /
> disadvantages to Paypal?
>
> Kind regards
> Matthias

It is my understanding, although it hasn't been confirmed by
finance-exec@, that microsoft is absorbing the fees for us.

I am also intrigued by the potential network effects of sponsors
encouraging more sponsors, etc.


sponsor NetBSD for 2020 https://github.com/sponsors/NetBSD

2020-11-09 Thread matthew sporleder
Hey -- the end of the year is coming up fast.  Wouldn't you feel
better about yourself if you added a github sponsorship to balance out
your incredible year? :)

Do you live in one of these places?

Australia
Austria
Belgium
Canada
Cyprus
Czech Republic
Denmark
Estonia
Finland
France
Germany
Greece
Hong Kong SAR
Ireland
Italy
Japan
Latvia
Lithuania
Luxembourg
Malta
Mexico
Netherlands
New Zealand
Norway
Poland
Portugal
Singapore
Slovakia
Slovenia
Spain
Sweden
Switzerland
United Kingdom
United States of America

then sign up: https://github.com/sponsors/NetBSD

A little while ago we added some very low tiers so it's not a lot of
money at all!


Re: Checking out src with Mercurial

2020-06-21 Thread matthew sporleder
On Sun, Jun 21, 2020 at 12:36 PM Mayuresh  wrote:
>
> On Sun, Jun 21, 2020 at 11:56:20AM -0400, matthew sporleder wrote:
> > > 
> > > the way git works (tracking whole trees at a time, never single files),
> > > that ends up being very painful, because it's an "all or nothing"
> > > approach.
> > >
> > > So I'm hoping that if you guys are seriously considering git, you'd also
> > > split up the KDE repository so that it's not one single huge one, but with
> > > multiple smaller repositories
> > > 
>
> Just so that above point is not missed. Above point is not out of date. It
> applies to both hg and git - splitting a large repository when using
> distributed ones.
>
> > This is out of date.  FreeBSD is moving to git.
>
> Interesting... I could not find that in official documents as yet. Yes,
> there have been git mirrors.

The last two status reports:
"The Core-initiated Git Transition Working Group continued to meet
over the last quarter of 2019. Their report is still forthcoming. "

https://www.freebsd.org/news/status/report-2020-01-2020-03.html


Re: Checking out src with Mercurial

2020-06-21 Thread matthew sporleder
On Sun, Jun 21, 2020 at 11:33 AM Mayuresh  wrote:
>
> On Sat, Jun 20, 2020 at 11:35:53AM +0530, Mayuresh wrote:
> > On Fri, Jun 19, 2020 at 10:01:35PM -0700, Greg A. Woods wrote:
> > > (c) modern change tracking tools try to track changes to whole sets of
> > > files at once, so if you have lots of files, and lots of history,
> > > this combinatorial problem can sometimes bite at a bad time for the
> > > user of a tool trying to manage it all.
> >
> > In one of the talks by Linus on git I heard him recommending breaking very
> > large repositories into some smaller units to get better performance.
> >
> > Would it be something feasible in NetBSD? A single user requires
> > approximately what % of code from what he or she checks out to be actually
> > compiled and can there be 1 core and several optional repositories that
> > would increase this percentage.
>
> Just quoting the correct reference[1]:
>
> 
> the way git works (tracking whole trees at a time, never single files),
> that ends up being very painful, because it's an "all or nothing"
> approach.
>
> So I'm hoping that if you guys are seriously considering git, you'd also
> split up the KDE repository so that it's not one single huge one, but with
> multiple smaller repositories
> 
>
> I think, before we adopt a centralized repository (whether hg or git) this
> needs to be thought through.
>
> FreeBSD has been there done that when adopting SVN[2],[3]
>
> [1] https://lwn.net/Articles/246381/
> [2] https://wiki.freebsd.org/VCSWhy
> [3] https://wiki.freebsd.org/GitDrawbacks

This is out of date.  FreeBSD is moving to git.


Re: cvs better than git?

2020-06-21 Thread matthew sporleder



> On Jun 21, 2020, at 10:32 AM, g...@duzan.org wrote:
> 
> 
>> 
>>> On 2020-06-21 16:07, Rhialto wrote:
>>> On Sun 21 Jun 2020 at 15:20:39 +0200, Johnny Billquist wrote:
 I am still curious about how to manage well in git the scenario where
 you do
 have a central repository that holds the actual source of truth, and
 where
 you want to review and approve anything that gets committed.
>>> 
>>> Let me point you to the hell that is called "Gerrit"...
>>> Example: https://review.opendev.org/
>> 
>> Like I said. We are using gerrit. It's not without a bunch of issues all
>> on its own... :-)
>> 
>> Any other options around with similar functionality?
>> 
>>   Johnny
> 
>   Our group at work uses Gerrit. We have had some trouble maintaining it,
> so we have been considering moving to Bitbucket, which already exists
> in the company. Bitbucket seems nice enough, though of course it is
> commercial. If I were looking for a solution today I would consider
> Phabricator/Differential, as it is open source, supports Mercurial, and
> appears decent enough.
> 
>  Gary Duzan
> 
> 



People like gitlab 
> 


Re: Checking out src with Mercurial

2020-06-19 Thread matthew sporleder



> On Jun 19, 2020, at 3:51 PM, Johnny Billquist  wrote:
> 
> On 2020-06-19 20:19, matthew sporleder wrote:
>> git clone with --depth 1, over http (instead of ssh), and with a few
>> simple settings changes will make it work inside of 128M.
> 
> Well, the whole point of virtual memory and demand paging is that you don't 
> have to have enough physical memory. I would hope that still applies... My 
> comment about have 128M (which, by the way, can be considered a lot, when we 
> talk about VAXen), was just about the potential speed I possibly could 
> expect. If git really requires that people have at least 128M of physical 
> memory to work, then I'd first ask when did NetBSD break so badly that the 
> amount of physical memory becomes a limitation in this way, and second, why 
> would a tool like this require that much memory in the first place?
> 
>  Johnny
> 
> -- 
> Johnny Billquist  || "I'm on a bus
>  ||  on a psychedelic trip
> email: b...@softjar.se ||  Reading murder books
> pdp is alive! ||  tryin' to stay hip" - B. Idol


I don’t know what to tell you.  It works. 

I personally think running such an old and inefficient computer is, literally, 
immoral when a modern $30 machine can emulate it perfectly using as much 
electricity as a small CFL light bulb and leave over 700mb of memory to spare. 

Re: "hg clone https://anonhg.netbsd.org/src/" still aborts, but...

2020-06-19 Thread matthew sporleder



> On Jun 19, 2020, at 3:03 PM, Chavdar Ivanov  wrote:
> 
> On Fri, 19 Jun 2020 at 16:27, Steffen Nurpmeso  wrote:
>> 
>> Chavdar Ivanov wrote in
>> :
>> |I've been watching the discussion with interest, as I am not
>> |particularly verse in these topics; perhaps I've done something not
>> |correctly, but on my 6 years old laptop (4c8t, 20GB memory, core-i7
>> |3820-qm) the full ' hg clone https://anonhg.netbsd.org/src/' (on a ZFS
>> |placed on an mSATA device) took some 45-50 minutes; the resulting repo
>> |takes about 5GB. I am cloning xsrc right now and will go through a
>> 
>> More of that stuff please.  This is for you who make their money
>> with managing/creating internet infrastructure!
>> And for all the bored black, white, yellow and red teenagers,
>> their first world internet connection, consuming also while in
>> their Upper East Side apartment.
> 
> I beg your pardon, but I could not quite comprehend this remark.  My
> Internet connection is reasonably fast - cable 350mb/s - but the
> laptop is beyond a powerline adapter, so that limits the speed to
> about 130mb/s; there is no WiFi involved though.
> 
> Anyway, xrsc was also cloned, in three hours and two minutes the build
> from scratch was completed.
> 
> I'll retest on my cvs repo on the same machine - but on a SATA SSD - a
> clean build, just to compare the speed difference between zfs and ufs.
> 
>> 
>> |full build.
>> 
>> --steffen
>> |
>> |Der Kragenbaer,The moon bear,
>> |der holt sich munter   he cheerfully and one by one
>> |einen nach dem anderen runter  wa.ks himself off
>> |(By Robert Gernhardt)
> 
> Chavdar
> 
> 
> -- 
> 

I appreciate these works/don’t work but we would need more details from 
everyone to make it useful for troubleshooting and finding patterns. 

Re: Checking out src with Mercurial

2020-06-19 Thread matthew sporleder
On Fri, Jun 19, 2020 at 10:29 AM Johnny Billquist  wrote:
>
> On 2020-06-19 13:45, Matthias Petermann wrote:
> > Hi,
> >
> > some closing words from someone whose arguments in the previous thread
> > were more for Git...
> >
> > I have tried several times during the week to clone the NetBSD
> > repository using Mercurial. I had observed a high CPU load and an
> > apparently unfinished checkout. I tried again and now the experiences
> > have shifted somewhat positively.
> >
> > First a tip for everyone who has an unstable internet connection: The
> > effects appear more clearly with Mercurial, because in the current
> > constellation (internet bandwidth, speed of the anonhg server?, ) it
> > takes a few operations longer than Git and this increases the likelihood
> > of becoming a victim of network fluctuations during an operation. My
> > observation is that sometimes an error message (timeout) occurs and the
> > transaction is rolled back. In this case, everything called up to that
> > point is invalid and you have to start over. Depending on the phase, the
> > process does not seem to notice this when a network fluctuation occurs
> > and instead is stuck in a state in which 100% CPU is used without
> > noticeable progress. That was obviously also the cause of my original
> > experience, in which the cloning of src did not come to an end even
> > after 11 hours on a relatively modern i5 PC.
>
> [...]
>
> Considering that a cvs update on my VAX takes roughly 24 hours, I do not
> look forward to trying hg or git... :-)
>
> Anyone who dares take a bet on how long it will take, assuming things
> don't just timeout and die in the meantime?
>
> (It's a 4000/90 with 128M of ram, so nothing extremely slow, I doubt
> I'll ever try on the 8650 with 60M of ram and RA73 disks...)
>
>Johnny
>
> --
> Johnny Billquist  || "I'm on a bus
>||  on a psychedelic trip
> email: b...@softjar.se ||  Reading murder books
> pdp is alive! ||  tryin' to stay hip" - B. Idol


git clone with --depth 1, over http (instead of ssh), and with a few
simple settings changes will make it work inside of 128M.

I did it a few years ago.


Re: "hg clone https://anonhg.netbsd.org/src/" still aborts, but...

2020-06-19 Thread matthew sporleder
On Sat, Jun 13, 2020 at 7:14 PM matthew sporleder  wrote:
>
> On Fri, Jun 12, 2020 at 6:22 PM Greg A. Woods  wrote:
> >
> > At Thu, 11 Jun 2020 20:41:58 -0700, bch  wrote:
> > Subject: Re: "hg clone https://anonhg.netbsd.org/src/"; still aborts, but...
> > >
> > > Nb: you’ll want to have an .hg/hgrc w a line:
> > > default = https://anonhg.netbsd.org/src
> > >
> > > ...so that in the future you can just “hg pull” from w/i that repo.
> >
> > Thanks for the tip -- I figured something would have to be set like that.
> >
> > Looks like it's not quite right though:
> >
> > $ cat .hg/hgrc
> > default = https://anonhg.netbsd.org/src
> >
> > $ hg incoming
> > abort: repository default not found!
> >
> > The manual section for "hg clone" does say:
> >
> >The location of the source is added to the new repository's .hg/hgrc
> >file, as the default to be used for future pulls.
> >
> > However hgrc(5) suggests the syntax might have to be a bit different,
> > more like a .git/config.
> >
> > Ah ha!  It looks like this has to be in the "[paths]" section, and MUST
> > NOT be proceeded by a tab or other whitespace (which .git/config allows):
> >
> > $ cat .hg/hgrc
> > [paths]
> > default = https://anonhg.netbsd.org/src
> >
> > $ hg incoming | head
> > comparing with https://anonhg.netbsd.org/src
> > searching for changes
> > changeset:   931876:26c8f37631b6
> > branch:  trunk
> > user:maxv 
> > date:Sat May 02 11:12:49 2020 +
> > summary: Remove unused.
> >
> > changeset:   931877:42596ac89b6e
> > branch:  trunk
> >
> > --
> > Greg A. Woods 
> >
> > Kelowna, BC +1 250 762-7675   RoboHack 
> > Planix, Inc.  Avoncote Farms 
>
> I have just updated the bundle manifest to use anonhg instead of cdn
> and *I* get the same issue.
>
> I am interested in other peoples' experiences but am glad that I've
> eliminated fastly from the equation.
>
> I've also tried making some changes to the apache config, trying a
> gzip bundle, and a few other variants.
>
> In the end I land on:
>
> files [>
>  ]  59368/440465 3h47mdestination
> directory: src
> applying clone bundle from https://anonhg.NetBSD.org/_bundles/src/matt-gzip.hg
> adding changesets
> adding manifests
> adding file changes
> transaction abort!
> rollback completed
> (sent 2 HTTP requests and 434 bytes; received 806 bytes in responses)
> abort: stream ended unexpectedly  (got 12392 bytes, expected 32768)
>
>
> Why would there be any network activity in the "files" stage at all?
> This entire bundles extension appears poorly architected or,
> ironically, poor for less performant systems.
>
> I think the curl + extract + pull is probably the only way forward.


one more datapoint is that I can't clone the mozilla source repo (also
a big one and also a big user of the built-in clone extension)

hgtest $ hg clone https://hg.mozilla.org/mozilla-central/ firefox-source -Uv
applying clone bundle from
https://hg.cdn.mozilla.net/mozilla-central/fa0afb4328103e7e61b98b3b2706891334eb2926.zstd-max.hg
adding changesets
adding manifests
adding file changes
transaction abort!
rollback completed
(sent 2 HTTP requests and 452 bytes; received 4673 bytes in responses)

So anyway I think it is safe to assume that it might just be hg clone
not working on small or slow hardware

--

FWIW I *was* able to do a clone without a bundle with this command:
hg clone --rev $(hg identify https://anonhg.netbsd.org/src/|awk '{
print $1 }') https://anonhg.netbsd.org/src/

I *think* that does a "shallow"(?) clone as I'm choosing to start at
the --rev from the last "identify" although I actually don't know what
I got except that the command finished.
This is probably much more work on the server side but I didn't measure.


Re: "hg clone https://anonhg.netbsd.org/src/" still aborts, but...

2020-06-13 Thread matthew sporleder
On Fri, Jun 12, 2020 at 6:22 PM Greg A. Woods  wrote:
>
> At Thu, 11 Jun 2020 20:41:58 -0700, bch  wrote:
> Subject: Re: "hg clone https://anonhg.netbsd.org/src/"; still aborts, but...
> >
> > Nb: you’ll want to have an .hg/hgrc w a line:
> > default = https://anonhg.netbsd.org/src
> >
> > ...so that in the future you can just “hg pull” from w/i that repo.
>
> Thanks for the tip -- I figured something would have to be set like that.
>
> Looks like it's not quite right though:
>
> $ cat .hg/hgrc
> default = https://anonhg.netbsd.org/src
>
> $ hg incoming
> abort: repository default not found!
>
> The manual section for "hg clone" does say:
>
>The location of the source is added to the new repository's .hg/hgrc
>file, as the default to be used for future pulls.
>
> However hgrc(5) suggests the syntax might have to be a bit different,
> more like a .git/config.
>
> Ah ha!  It looks like this has to be in the "[paths]" section, and MUST
> NOT be proceeded by a tab or other whitespace (which .git/config allows):
>
> $ cat .hg/hgrc
> [paths]
> default = https://anonhg.netbsd.org/src
>
> $ hg incoming | head
> comparing with https://anonhg.netbsd.org/src
> searching for changes
> changeset:   931876:26c8f37631b6
> branch:  trunk
> user:maxv 
> date:Sat May 02 11:12:49 2020 +
> summary: Remove unused.
>
> changeset:   931877:42596ac89b6e
> branch:  trunk
>
> --
> Greg A. Woods 
>
> Kelowna, BC +1 250 762-7675   RoboHack 
> Planix, Inc.  Avoncote Farms 

I have just updated the bundle manifest to use anonhg instead of cdn
and *I* get the same issue.

I am interested in other peoples' experiences but am glad that I've
eliminated fastly from the equation.

I've also tried making some changes to the apache config, trying a
gzip bundle, and a few other variants.

In the end I land on:

files [>
 ]  59368/440465 3h47mdestination
directory: src
applying clone bundle from https://anonhg.NetBSD.org/_bundles/src/matt-gzip.hg
adding changesets
adding manifests
adding file changes
transaction abort!
rollback completed
(sent 2 HTTP requests and 434 bytes; received 806 bytes in responses)
abort: stream ended unexpectedly  (got 12392 bytes, expected 32768)


Why would there be any network activity in the "files" stage at all?
This entire bundles extension appears poorly architected or,
ironically, poor for less performant systems.

I think the curl + extract + pull is probably the only way forward.


Re: "hg clone https://anonhg.netbsd.org/src/" still aborts, but...

2020-06-12 Thread matthew sporleder
On Thu, Jun 11, 2020 at 11:34 PM Greg A. Woods  wrote:
>
> Just a wee while ago it was again mentioned that 'hg clone' would be a
> suitable way to download NetBSD sources, but I've been trying this off
> and on for over a month now and always end up with a failure and abort
> just like this attempt today:
>
> $ hg clone https://anonhg.netbsd.org/src/ h-NetBSD-src
> applying clone bundle from 
> https://cdn.NetBSD.org/_bundles/src/77d2a2ece3a06d837da45acd0fda80086ab4113c.zstd.hg
> adding changesets
> adding manifests
> manifests [> ] 751718/931876 
> 48m52s
> transaction abort!
> rollback completed
> abort: stream ended unexpectedly  (got 32754 bytes, expected 32768)
>
> So after reading the line of output again and noticing it's a URL I
> decided to try downloading th bundle directly.  This worked fine, taking
> about 3 minutes for me.
>
> I then did:  "hg init src && cd src && hg unbundle $bundle"
>
> The unbundle finally finished the first step (unpacking all 931,876
> changesets) after about 15 minutes and began on the manifests, just as
> with the clone operation did.
>
> The manifests then completed, unlike the attempts via the network,
> though I don't know how long that took, and now it's checking out
> 439,702 "file changes", saying it will be taking over 2hrs to complete.
> HG has the world's second-worst task time estimator though -- it's been
> waffling between 10 to 30 mins for the past hour or more (on the "files"
> step).
>
> Overall that's _STUNNINGLY SLOW_ compared to a "git clone" of the same
> NetBSD source tree -- especially since I've eliminated the network for
> the HG test case!
>
> I'll have to try an up-to-date "git clone" again to be compareing more
> apples-to-apples, but IIRC the "git clone" of the src tree works at
> least an order of magnitude faster on the same platform, and direct from
> the network.
>
> Perhaps this slowness is because even the initial clone attempt is/was
> working from the one big complete bundle-format file?  Does HG have any
> more efficient way to supply a clone?
>
> And also, why does the network clone fail, but a fetch+unbundle work?
>
> --
> Greg A. Woods 
>
> Kelowna, BC +1 250 762-7675   RoboHack 
> Planix, Inc.  Avoncote Farms 


curl 
'https://cdn.NetBSD.org/_bundles/src/77d2a2ece3a06d837da45acd0fda80086ab4113c.zstd.hg'
|md5
394158db5733b878963e9d6a5eb721d5

what did you get?  why does that clone fail?


Re: Where do I get the source tree tarball from?

2020-06-11 Thread matthew sporleder
https://github.com/netbsd/src/

On Thu, Jun 11, 2020 at 8:50 AM mayur...@kathe.in  wrote:
>
> On Thursday, June 11, 2020 05:34 PM IST, xpetrl  wrote:
>
> >
> >
> > On 6/11/20 1:27 PM, mayur...@kathe.in wrote:
> > > i wish to try-out martin huseman's response to my query and get down to 
> > > compiling the netbsd source tree under a gnu/linux distribution.
> > > where do i point my web browser to get the netbsd source tree?
> > >
> >
> > NetBSD guide, Chapter 30. Obtaining the sources:
> >
> > https://www.netbsd.org/docs/guide/en/chap-fetch.html
>
> i understand that "cvs" is the preferred mechanism for version control for 
> netbsd, but do you provide a "git" interface too?
>


Re: Postfix and local mail delivery - still relevant in 2020?

2020-06-06 Thread matthew sporleder
On Sat, Jun 6, 2020 at 6:31 PM Sad Clouds  wrote:
>
> On Sat, 06 Jun 2020 14:55:54 -0700
> "Greg A. Woods"  wrote:
>
> > I would suggest it is still very relevant to have a network capable
> > MTA in the base system distribution, and for that purpose Postfix is
> > a most excellent choice.
>
> What are the use-cases for it? Is it only for emailing occasional
> reports to sysadmins?

postfix is relatively small, needs very little config, and gets the
job done.  It just happens to also work at scale.
I would prefer (postfix can probably run like this but I haven't
tried) something that can exist either as a simple cron or as a
named-pipe so it can run without any running daemon to handle flushing
the local mail queue to local users or my remote aliases.

Now bind9 on the other hand... ;)


Re: pkgin error (possible workaround)

2020-05-22 Thread matthew sporleder
Thanks for the report.

On Thu, May 21, 2020 at 12:38 PM Greg Troxel  wrote:
>
> Lars-Johan Liman  writes:
>
> > I've found that the x86_64 and amd64 directories seem to be out of sync
> > on cdn.netbsd.org. In short, pkg_summary seems to be updated in x86_64
> > but not in amd64. For me the following simple workaround worked:
>
> Thanks for the specific report.
>
> > I modified the repository pointer in
> >
> > /usr/pkg/etc/pkgin/repositories.conf
> >
> > from:
> >
> > http://cdn.netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/9.0/All
> >
> > to:
> >
> > http://cdn.netbsd.org/pub/pkgsrc/packages/NetBSD/x86_64/9.0/All
>
> amd64 is the name of the port, which is about specific hardware aas well
> as the instruction set, and packages are generally shared among all
> ports with the same instruction set and ABI.   So arguably x86_64 is
> preferred anyway -- even if x86_64 appears only on the amd64 port!
>
> For your info, on ftp.netbsd.org, in /pub/pkgsrc/packages/NetBSD, doing
> ls -l (and skipping the other lines) one gets:
>
>   lrwxrwxr-x   1 joerg netbsd 6 May 28  2008 amd64 -> x86_64
>   drwxrwxr-x  16 pkgmastr  netbsd  1024 May 15 02:57 x86_64
>
> I can confirm the bad behavior.  Fetching
>
>wget 
> http://cdn.netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/9.0/All/pkg_summary.bz2
>wget 
> http://cdn.netbsd.org/pub/pkgsrc/packages/NetBSD/x86_64/9.0/All/pkg_summary.bz2
>
> I get the following: (.1 is 2nd fetch):
>
>   -rw-r--r--  1 gdt  users3270343 May 17 16:03 pkg_summary.bz2
>   -rw-r--r--  1 gdt  users3258465 May 21 10:54 pkg_summary.bz2.1


Re: Python flask app behind bozohttpd vs separate webserver for app

2020-05-16 Thread matthew sporleder
On Sat, May 16, 2020 at 11:30 PM Mayuresh  wrote:
>
> On Sat, May 16, 2020 at 03:56:47PM -0400, matthew sporleder wrote:
> > Just use apache :)  bozo has no proxy capabilities.
>
> I can invoke a Flask service from a cgi script using wget/curl - no?
> (Haven't yet tried.)
>
> Apache looks a monster to me and I don't need majority of what it offers.
>
> Mayuresh

FWIW I wrote the initial version of this:
https://cwiki.apache.org/confluence/display/HTTPD/Minimal+Config  and
at my job will run zero config apache on docker with just appending
-c's to the CMD..

With mpm_event, the minimal config, and whatever you need
(mod_proxy_uwsgi etc) you can live, easily, inside of a few MB and run
high performance.


Re: Python flask app behind bozohttpd vs separate webserver for app

2020-05-16 Thread matthew sporleder
On Sat, May 16, 2020 at 1:24 PM Mayuresh  wrote:
>
> I have a setup where NetBSD's native bozohttpd serves certain static
> contents. It uses https and basic auth and the setup is pretty stable.
>
> There are some small pieces of requirements to add some python web apps
> developed using Flask. The app needs to use the same authentication data
> used by the basic setup above. Fortunately that turns out to be easy.
>
> Now I have two options:
>
> Option 1: Run a separate instance of a python based web server such as
> gunicorn on a separate port for the apps and use bozohttpd for static
> contents.
>
> I have to start gunicorn as root so that it can get access to certificate
> files, but run the worker process as a non root user which is an option
> provided by gunicorn.
>
> One problem with this is, I don't get the environment variables right this
> way. There are ways to feed those into gunicorn, but that would amount to
> replicating my rc scripts that elaborately define the environment.
>
> Option 2: Run python web server on localhost and via bozohttpd cgi route
> the requests/responses to/from it. There may be slight overhead of this,
> but it's not a performance critical application.
>
> I can also use a simple http and Flask's simple builtin server internally
> as it is not exposed to the internet.
>
> Would appreciate any comments / pros and cons etc.
>
> Mayuresh

Just use apache :)  bozo has no proxy capabilities.


Re: pkgin error

2020-05-16 Thread matthew sporleder
On Sat, May 16, 2020 at 8:42 AM Martin Neitzel
 wrote:
>
> ill> Same here.
> ill>
> ill> $ echo "select file_size from remote_pkg where pkgname like
> ill> 'xmlcatmgr%'" | sqlite3 pkgin.db
> ill> 25004
> ill>
> ill> $ ftp
> ill> 
> https://cdn.netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/8.0/All/xmlcatmgr-2.2nb1.tgz
> ill> 24864 bytes retrieved in 00:00 (16.63 MiB/s)
>
> Some observations on this:
>
> % echo 0 1 2 | xargs -n1 -I XX lynx -head -dump 
> http://cdn.netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/8.XX/All/xmlcatmgr-2.2nb1.tgz
>  | grep Length
> Content-Length: 24864
> Content-Length: 24864
> Content-Length: 25004
>
> This actually figures with my(!, see below) long "select" info:
>
> sqlite> select *  from remote_pkg where pkgname like 'xmlcat%' ;
>   PKG_ID = 21533
>  FULLPKGNAME = xmlcatmgr-2.2nb1
>  PKGNAME = xmlcatmgr
>  PKGVERS = 2.2nb1
>   BUILD_DATE = 2020-03-28 20:22:48 +
>  COMMENT = XML and SGML catalog manager
>  LICENSE = modified-bsd
> PKGTOOLS_VERSION = 20091115
> HOMEPAGE = http://xmlcatmgr.sourceforge.net/
>   OS_VERSION = 8.0
>  DESCRIPTION =
>  PKGPATH = textproc/xmlcatmgr
>  PKG_OPTIONS =
>   CATEGORIES = textproc
> SIZE_PKG = 50583
>FILE_SIZE = 25004
>OPSYS = NetBSD
>   REPOSITORY = 
> http://cdn.Netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/8.2/All
>
>
> Looks like Roland is rather using the 8.0 repo?
>
> I essentially noticed the same problem here, too, after...
>
> - an update on the netbsd-8 branch on May 2nd and
> - moving my /usr/pkg/etc/pkgin/repositories.conf
>   from http://cdn.NetBSD.org/pub/pkgsrc/packages/NetBSD/amd64/8.1/All
>   to   http://cdn.Netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/8.2/All
> - having nothing at all happen on "pkgin update" until
>   May 11 00:52 /var/db/pkgin/pkgin.db
>
> For "pkgin upgrade", this resulted in:
>
> 31 packages to refresh:  (xmlcatmgr-2.2nb1 ... ... ...)
> 19 packages to upgrade:
> 2 packages to install:  heimdal-1.5.3nb24 openssl-1.1.1e
>
> (I was mostly surprised about the "refresh" section.  Where does this
> come from, what is this supposed to mean?)
>
> Since I'm referring to 8.2 pkg repository, details differ for me,
> I guess I am seeing the same problem but maybe from the other side.
>
> I can still confirm the problem / the error message seen from
> my side, albeit with other packages.
>
> I get the error message with:
> download error: p5-Authen-SASL-2.16nb7 size does not match pkg_summary
>
> and [abridged]:
>
> sqlite> select *  from remote_pkg where pkgname like 'p5-Authen-SASL' ;
>   PKG_ID = 6173
>  FULLPKGNAME = p5-Authen-SASL-2.16nb7
>   BUILD_DATE = 2020-04-01 03:57:23 +
>   OS_VERSION = 8.0
> SIZE_PKG = 119267
>FILE_SIZE = 24892
>   REPOSITORY = 
> http://cdn.Netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/8.2/All
>
> % echo 0 1 2 | xargs -n1 -I XX lynx -head -dump 
> http://cdn.netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/8.XX/All/p5-Authen-SASL-2.16nb7.tgz
>  | grep Length
> Content-Length: 24900
> Content-Length: 24892
> Content-Length: 24900
>
> D'oh!
>
>
> This is not the first time this madness happens.  The last time was around
> last summer and some kind fellow on the ircnet #netbsd pointed out to me
> that the URLs
>
> http://cdn.Netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/...
> http://cdn.netbsd.org/pub/pkgsrc/packages/NetBSD/amd64/...
>^
>|
>
> yielded different data.  Both hostnames resolved to the same IP addresses
> (as they should) but the Fastly CDN servers were apparently treating the
> requests in different ways depending on the case in the Host: headers.
>
> Martin Neitzel

I fixed the host header thing when that was pointed out.

Anyway try it now.


Re: Changes to PERL

2020-04-13 Thread matthew sporleder


> On Apr 13, 2020, at 5:11 PM, Todd Gruhn  wrote:
> 
> Where is a good place to look for current PERL syntax and examples?
> (been about 10yrs).
> 
> Which books should be updated first?
> (I have 4 of the O'Reilly PERL books)


http://modernperlbooks.com/books/modern_perl_2016/index.html

https://mojolicious.org/perldoc

CPAN is now metacpan 

Use perlcritic and perltidy 




Re: Hundreds of crypto file descriptors for Apache httpd

2020-03-10 Thread matthew sporleder
On Tue, Mar 10, 2020 at 10:59 AM Michael van Elst  wrote:
>
> fr...@phoenix.owl.de (Frank Wille) writes:
>
> >> Something is using /dev/crypto. openssl would do that, but only if
> >> you configure it.
>
> >Yes, our web-server is also listening on port 443 for several virtual hosts,
> >so SSL is configured.
>
> It's not just SSL. openssl has its own crypto routines and you would only
> use /dev/crypto when you want to use some accelerator hardware that can only
> be accessed by a kernel driver.
>
> The problem here seems to be that the devcrypto engine is builtin and openssl
> just loads every builtin engine with no knob to control that behaviour.
>
> I think the only option you have now is to prevent access to /dev/crypto.
>


https://httpd.apache.org/docs/current/mod/mod_ssl.html#sslcryptodevice
 could potentially override the use of that engine (if I'm
understanding things correctly).

The 200+ FDs might be one per apache child (if running prefork)?


Re: Alternative DVCS to git: hg?

2019-04-19 Thread matthew sporleder
On Fri, Apr 19, 2019 at 2:07 AM Sad Clouds  wrote:
>
> On Thu, 18 Apr 2019 12:29:32 -0400
> Andrew Cagney  wrote:
>
> > When two fully tested commits hit the repo at the same time, and the
> > result is broken, who do I blame? Subversion?  We can hardly wave a
> > finger at the developer who had the simple misfortune of being second
> > with their push?
>
> This alleged design flaw in Subversion, is it something that you can
> actually reproduce or are you just repeating something that you heard
> from someone somewhere? You seem to be the only person to come across
> the issue. Many people use Subversion concurrently and they don't
> seem to be reporting such problems. So if the issue does exist, as
> you claim, can you please give us a demonstration and show us exactly
> how and when your files get corrupted?
>

What's all this talk about ACID and conflicts when all of them still
suffer from 3-way-merge bugs anyway? ;)

https://tahoe-lafs.org/~zooko/badmerge/concrete-good-semantics.html


Re: concurrencykit in the kernel!

2019-04-12 Thread matthew sporleder
On Fri, Apr 12, 2019 at 8:05 AM Mayuresh Kathe  wrote:
>
> heard about freebsd guys using the concurrency kit (concurrencykit.org)
> in their kernel. anyone has any idea about how it could be useful from
> a netbsd perspective too? i was under the impression that the kit would
> be useful only for userland projects, wonder what role it would play at
> the kernel level.

Hey I added that pkg!  I think anywhere we have similar algorithms it
would be useful to, at least, compare the concurrencykit
implementation if not use it.

I'm sure the kernel and userland both do tons of this stuff:
http://concurrencykit.org/man.html


Re: Can not Download NetBSD 8.0 i386 USB Install Image

2019-02-04 Thread matthew sporleder
Okay fastly support has reported that the issue was related to the
beta.  Basically if a file changes but the name does not we *MUST*
PURGE that file or this can happen (parts of the files are cache-HIT
and other parts are cache-MISS, so mixing them up won't work if the
file has changed half-way).

I will try to figure out how to get the build system to do the right thing.


On Mon, Feb 4, 2019 at 1:30 PM matthew sporleder  wrote:
>
> On Mon, Feb 4, 2019 at 1:23 PM Andrei M.  wrote:
> >
> > чт, 31 янв. 2019 г. в 18:14, JingYuan Chen :
> > >
> > > AhhI forgot to describe more detail about my problem.
> > > I used Firefox to download i386 USB install image form NetBSD's download 
> > > page.
> > >
> > > The URL is as follows :
> > > https://cdn.netbsd.org/pub/NetBSD/NetBSD-8.0/images/NetBSD-8.0-i386-install.img.gz
> > >
> > > After clicking the link, firefox shows that the source file can not be
> > > read. So that I try to download
> > >  i386 ISO image. But the error message is the same.
> > >
> > > There may be something wrong with amd64 ISO image. I had downloaded
> > > amd64 ISO image last Sunday.
> > > But I can not download it now. Firefox responds File not found. :(
> > >
> > > Is there something wrong with cdn.netbsd.org ???
> > >
> >
> > Has been happening to me today too.
> > I've tried to download the following file 5 or 6 times:
> > http://nycdn.netbsd.org/pub/NetBSD-daily/netbsd-8/latest/images/NetBSD-8.0_STABLE-amd64-install.img.gz
> >
> > When download is 99,99% completed, it says 'Download failed' and
> > cannot be resumed. Experienced in Firefox and Chrome, Ubuntu 64bit
> > versions.
> >
> > Andrei
>
> Hi everyone.  A little while ago fastly asked if we could be test
> subjects for a new feature and this is *very likely* fallout from
> that.
>
> I will raise an issue with them and send this thread.


Re: Can not Download NetBSD 8.0 i386 USB Install Image

2019-02-04 Thread matthew sporleder
On Mon, Feb 4, 2019 at 1:23 PM Andrei M.  wrote:
>
> чт, 31 янв. 2019 г. в 18:14, JingYuan Chen :
> >
> > AhhI forgot to describe more detail about my problem.
> > I used Firefox to download i386 USB install image form NetBSD's download 
> > page.
> >
> > The URL is as follows :
> > https://cdn.netbsd.org/pub/NetBSD/NetBSD-8.0/images/NetBSD-8.0-i386-install.img.gz
> >
> > After clicking the link, firefox shows that the source file can not be
> > read. So that I try to download
> >  i386 ISO image. But the error message is the same.
> >
> > There may be something wrong with amd64 ISO image. I had downloaded
> > amd64 ISO image last Sunday.
> > But I can not download it now. Firefox responds File not found. :(
> >
> > Is there something wrong with cdn.netbsd.org ???
> >
>
> Has been happening to me today too.
> I've tried to download the following file 5 or 6 times:
> http://nycdn.netbsd.org/pub/NetBSD-daily/netbsd-8/latest/images/NetBSD-8.0_STABLE-amd64-install.img.gz
>
> When download is 99,99% completed, it says 'Download failed' and
> cannot be resumed. Experienced in Firefox and Chrome, Ubuntu 64bit
> versions.
>
> Andrei

Hi everyone.  A little while ago fastly asked if we could be test
subjects for a new feature and this is *very likely* fallout from
that.

I will raise an issue with them and send this thread.


Re: choosing a lightweight database

2019-01-16 Thread matthew sporleder
On Wed, Jan 16, 2019 at 1:12 PM Greg Troxel  wrote:
>
> John Nemeth  writes:
>
> > } If it turns out your data size or query/update rate is too much, I would
> > } use postgres.  I know you said you don't want a process, but unlike
> > } mysql postgres is really easy to set up.
> >
> >  It would be nice to get rid of some of the FUD around here.
> > MySQL is quite simple to setup, especially if you're installing it
> > from pkgsrc.  mysql-cluster is complex to setup, but that is for
> > master-master replication with redundancy.  The regular mysql-server
> > is just pkgin mysql-server, set the "root" password and you're off
> > to the races.
>
> That wasn't my experience.  WIth pgsql, I was able to just 'createuser'
> the username matching the one the daemon that wants to use it.  With
> mysql, there was a bunch of stuff about creating username/password pairs
> and for a particular db-using application, it was a lot more work to get
> things to actually run correctly.   My memory, which could be off, is
> that I also had to configure it not to listen beyond localhost.
>
> But, the pkgsrc package was indeed first class, and things were only
> annoying at the 30-minute level.

As a long time mysql user I had the exact difficulty you describe
trying to grok postgres when I could be up-and-running with mysql
inside of a minute.

Funny how that all works, isn't it?


Re: choosing a lightweight database

2019-01-16 Thread matthew sporleder
On Wed, Jan 16, 2019 at 11:32 AM John Nemeth  wrote:
>
> On Jan 16, 11:03am, Greg Troxel wrote:
> } r...@reedmedia.net writes:
> }
> } > Around 200 attributes, but not all for each.
> } >
> } > Also I have key/values like
> } >  FOO-notes="for supplementing text for FOO"
> } > And description and direction fields with sentences.
> } >
> } > The values may be free form text, numbers, boolean yes/no (some values
> } > are links to other files).
> } >
> } > I generate static webpages easily from this (and can dynamically
> } > generate webpages easily).
> } >
> } > Storing this in Berkeley DB would be easy.
> } >
> } > But I want an easy way to search everything like:
> } >
> } > country=ca
> } > province=alberta
> } > elevation>=1524 meters
> } > cost<=5
> } >
> } > or keyword searches against description fields.
> }
> } If you don't want a db process, I would try sqlite and as long as it
> } holds up stick with it.
> }
> } If it turns out your data size or query/update rate is too much, I would
> } use postgres.  I know you said you don't want a process, but unlike
> } mysql postgres is really easy to set up.
>
>  It would be nice to get rid of some of the FUD around here.
> MySQL is quite simple to setup, especially if you're installing it
> from pkgsrc.  mysql-cluster is complex to setup, but that is for
> master-master replication with redundancy.  The regular mysql-server
> is just pkgin mysql-server, set the "root" password and you're off
> to the races.
>
> } And, it sounds like you should be contributing to openstreetmap :-)
> }-- End of excerpt from Greg Troxel


Just for fun I will tell you to write your site in erlang or elixir
and use mnesia, which is built in to OTP :)

Although, obviously, you are probably just looking for sqlite.  Be
sure to use the WAL and various PRAGMA to make it faster and safer.


Re: pkgin

2018-10-19 Thread matthew sporleder
On Thu, Oct 18, 2018 at 3:24 AM Pedro Pinho  wrote:
>
> Hi all,
> I'm rather new to NetBSD, been using it on a laptop for about 3 months now, 
> amd64 8.0. I'm really enjoying this OS and everything is working fine. So, 
> sorry if this has already been answered...
>
> Why does http://pkgin.net/ points to https://github.com/NetBSDfr/pkgin ?
> This github repo has not seen any commit for the last two years.
> Wouldn't be better if it would point to https://github.com/joyent/pkgin , 
> just like pkgsrc.se does?
> Is there a reason for it?
>
> Thanks!

I'm guessing it has something to do with the text you can find here:
https://github.com/iMilnb  :)

Anyway good suggestion.


Re: git https issue

2018-08-19 Thread matthew sporleder
On Sun, Aug 19, 2018 at 4:26 AM, Riccardo Mottola
 wrote:
> Hi,
>
>
> On 19/08/2018 02:26, Matt Sporleder wrote:
>>
>>
>> Can you do curl -vvv to GitHub?
>
>
> hmm, if you mean just to the homepage like below, we have an issue :(
>
> narsil$ curl -vvv https://github.com/
> *   Trying 192.30.253.113...
> * TCP_NODELAY set
> * Connected to github.com (192.30.253.113) port 443 (#0)
> * ALPN, offering http/1.1
> * Cipher selection:
> ALL:!EXPORT:!EXPORT40:!EXPORT56:!aNULL:!LOW:!RC4:@STRENGTH
> * successfully set certificate verify locations:
>   CAfile: none
>   CApath: /etc/openssl/certs
> * TLSv1.2 (OUT), TLS header, Certificate Status (22):
> * TLSv1.2 (OUT), TLS handshake, Client hello (1):
> * TLSv1.2 (IN), TLS handshake, Server hello (2):
> * TLSv1.2 (IN), TLS handshake, Certificate (11):
> * TLSv1.2 (IN), TLS handshake, Server key exchange (12):
> * TLSv1.2 (IN), TLS handshake, Server finished (14):
> * TLSv1.2 (OUT), TLS handshake, Client key exchange (16):
> * TLSv1.2 (OUT), TLS change cipher, Client hello (1):
> [1]   Illegal instruction (core dumped) curl -vvv https://github.com/
>
> gdb tells me:
> * TLSv1.2 (OUT), TLS change cipher, Client hello (1):
>
> Thread 1 received signal SIGILL, Illegal instruction.
> 0xb66f3d50 in gcm_ghash_4bit_mmx () from /usr/lib/libcrypto.so.12
>
>
> (gdb) bt
> #0  0xb66f3d50 in gcm_ghash_4bit_mmx () from /usr/lib/libcrypto.so.12
> #1  0x in ?? ()
>
> very nice :)
>
> now I don't remember if this CPU has MMX or not...
> cpu0 at mainbus0
> cpu0: Intel 586-class, 232MHz, id 0x581
> cpu0: package 0, core 0, smt 0
>
> It should though, according to: https://www.thinkwiki.org/wiki/Category:600
>
>
> Riccardo

Looks like you found the issue.


Re: git https issue

2018-08-10 Thread matthew sporleder
On Fri, Aug 10, 2018 at 6:01 PM, Riccardo Mottola
 wrote:
> Hi Matthew,
>
>
> On 05/08/2018 19:44, matthew sporleder wrote:
>>
>> On Sun, Aug 5, 2018 at 7:57 AM, Riccardo Mottola
>>  wrote:
>>>
>>> Hi Matthew,
>>>
>>>
>>> On 30/07/2018 22:18, matthew sporleder wrote:
>>>>
>>>> Does it hang or finish?  GIT_CURL_VERBOSE or --verbose ?
>>>
>>>
>>> it finishes without doing anything, I added --verbose:
>>>
>>> $ git clone --verbose https://github.com/github/debug-repo
>>> /tmp/debug-repo-http
>>> Cloning into '/tmp/debug-repo-http'...
>>> $
>>>
>>> no output... the variable helps though:
>>>
>>> narsil$ git clone --verbose https://github.com/github/debug-repo
>>> /tmp/debug-repo-http
>>> Cloning into '/tmp/debug-repo-http'...
>>> * Couldn't find host github.com in the .netrc file; using defaults
>>> *   Trying 192.30.253.113...
>>> * TCP_NODELAY set
>>> * Connected to github.com (192.30.253.113) port 443 (#0)
>>> * ALPN, offering http/1.1
>>> * Cipher selection:
>>> ALL:!EXPORT:!EXPORT40:!EXPORT56:!aNULL:!LOW:!RC4:@STRENGTH
>>> * successfully set certificate verify locations:
>>>CAfile: none
>>>CApath: /etc/openssl/certs
>>>
>>>
>>> where is the issue?? a missing cert? can I force reinstalling
>>> certificates?
>>>
>>> Riccardo
>>>
>>>
>>
>>
>> When I do it:
>> tmp $ GIT_CURL_VERBOSE=1 git clone --verbose
>> https://github.com/github/debug-repo
>> Cloning into 'debug-repo'...
>> * Couldn't find host github.com in the .netrc file; using defaults
>> *   Trying 192.30.253.112...
>> * TCP_NODELAY set
>> * Connected to github.com (192.30.253.112) port 443 (#0)
>> * Cipher selection:
>> ALL:!EXPORT:!EXPORT40:!EXPORT56:!aNULL:!LOW:!RC4:@STRENGTH
>> * successfully set certificate verify locations:
>> *   CAfile: none
>>CApath: /etc/openssl/certs
>> * SSL connection using TLSv1.2 / ECDHE-RSA-AES128-GCM-SHA256
>> * Server certificate:
>> *  subject: businessCategory=Private Organization;
>> 1.3.6.1.4.1.311.60.2.1.3=US; 1.3.6.1.4.1.311.60.2.1.2=Delaware;
>> serialNumber=5157550; C=US; ST=California; L=San Francisco; O=GitHub,
>> Inc.; CN=github.com
>> *  start date: May  8 00:00:00 2018 GMT
>> *  expire date: Jun  3 12:00:00 2020 GMT
>> *  subjectAltName: host "github.com" matched cert's "github.com"
>> *  issuer: C=US; O=DigiCert Inc; OU=www.digicert.com; CN=DigiCert SHA2
>> Extended Validation Server CA
>> *  SSL certificate verify ok.
>>>
>>> GET /github/debug-repo/info/refs?service=git-upload-pack HTTP/1.1
>>
>> Host: github.com
>> User-Agent: git/2.14.1
>> Accept: */*
>> Accept-Encoding: gzip
>> Accept-Language: en-US, *;q=0.9
>> Pragma: no-cache
>>
>> < HTTP/1.1 200 OK
>> < Server: GitHub Babel 2.0
>> < Content-Type: application/x-git-upload-pack-advertisement
>> < Transfer-Encoding: chunked
>> < Expires: Fri, 01 Jan 1980 00:00:00 GMT
>> < Pragma: no-cache
>> < Cache-Control: no-cache, max-age=0, must-revalidate
>> < Vary: Accept-Encoding
>> < X-GitHub-Request-Id: C495:6D8D:17611E4:288C91B:5B673724
>> < X-Frame-Options: DENY
>> <
>> * Connection #0 to host github.com left intact
>> POST git-upload-pack (165 bytes)
>> * Couldn't find host github.com in the .netrc file; using defaults
>> * Found bundle for host github.com: 0x7f7ff7b2e200 [can pipeline]
>> * Re-using existing connection! (#0) with host github.com
>> * Connected to github.com (192.30.253.112) port 443 (#0)
>>>
>>> POST /github/debug-repo/git-upload-pack HTTP/1.1
>>
>> Host: github.com
>> User-Agent: git/2.14.1
>> Accept-Encoding: gzip
>> Content-Type: application/x-git-upload-pack-request
>> Accept: application/x-git-upload-pack-result
>> Content-Length: 165
>>
>> * upload completely sent off: 165 out of 165 bytes
>> < HTTP/1.1 200 OK
>> < Server: GitHub Babel 2.0
>> < Content-Type: application/x-git-upload-pack-result
>> < Transfer-Encoding: chunked
>>
>>
>
> indeed, quite a different output, but where is the issue? I do wonder?
>
> Just to be sure, I installed
> http://ftp.netbsd.org/pub/pkgsrc/packages/NetBSD/i386/8.0_2018Q1/All/mozilla-rootcerts-openssl-2.1.tgz
> so I have fresh certificates (the old one remained in /etc/openssl/certs
> after upgrade)
>
> but it did not help. What else could I missing? I bet it is a configuration
> issue
>
> Thank you
>
> Riccardo

I think the GIT_CURL_VERBOSE=1 is going to give you the answer.


Re: git https issue

2018-07-30 Thread matthew sporleder
On Mon, Jul 30, 2018 at 4:13 PM, Riccardo Mottola
 wrote:
> Hi All,
>
> I have some strange happening after I upgraded to 8.0 with 8.0_2018Q1
> packages (I removed  all packages before and reinstalled)
>
> I cannot git clone or git pull over https anymore!
> Even existing repositories do not pull! And I see no errors, like:
>
> $ git clone https://github.com/github/debug-repo /tmp/debug-repo-http
> Cloning into '/tmp/debug-repo-http'...
>
> and "nothing" happens and no repository.
> How can I debug more??
>
> However if I use ssh it works!
>
> $ git clone g...@github.com:github/debug-repo /tmp/debug-repo-ssh
> Cloning into '/tmp/debug-repo-ssh'...
> The authenticity of host 'github.com (192.30.253.112)' can't be established.
> RSA key fingerprint is SHA256:nThbg6kXUpJWGl7E1IGOCspRomTxdCARLviKw6E5SY8.
> Are you sure you want to continue connecting (yes/no)? yes
> Warning: Permanently added 'github.com,192.30.253.112' (RSA) to the list of
> known hosts.
> remote: Counting objects: 1649, done.
> remote: Total 1649 (delta 0), reused 0 (delta 0), pack-reused 1649
> Receiving objects: 100% (1649/1649), 324.17 KiB | 246.00 KiB/s, done.
> Resolving deltas: 100% (1063/1063), done.
>
> why? What changed? configurations should have remained the same, since I
> upgraded. mozilla certificates are installed.
>
> Riccardo
>


Does it hang or finish?  GIT_CURL_VERBOSE or --verbose ?


Re: Some Updates from man-k.org

2017-10-17 Thread matthew sporleder
nice

On Sun, Oct 15, 2017 at 2:30 AM, Abhinav Upadhyay
 wrote:
> Hi,
>
> A couple of small updates from man-k.org which I did recently:
>
> The man pages now contain anchor tags for individual sections and
> subsections in the man page. For example
> http://man-k.org/man/NetBSD-current/1/awk#EXAMPLES. This was a new
> feature that came out with mandoc-1.14.2.
>
> Many people asked for a way to directly access a man page without
> having to go through the search. So I've added direct URLs, which is
> inspired from how mdoc.su does it. You can directly use URLs of the
> following form to directly access man pages:
>
> http://man-k.org/n/ls(1) --> ls(1) for NetBSD-current
> http://man-k.org/f/ls(1) --> ls(1) for FreeBSD-current
> http://man-k.org/o/ls(1) --> ls(1) for OpenBSD
>
> --
> Abhinav


Fwd: nyftp.netbsd.org outage 2017-07-24 through 2017-07-25

2017-07-24 Thread matthew sporleder
In case anyone was wondering why the various ny* servers are down right now..


-- Forwarded message --
From: Thor Lancelot Simon 
Date: Mon, Jul 24, 2017 at 1:38 AM
Subject: nyftp.netbsd.org outage 2017-07-24 through 2017-07-25


Due to urgent construction, nyftp.netbsd.org and other NetBSD resources
hosted at Columbia University will be offline beginning mid-day (New York
time) today, the 24th of July, and will come back online some time late in
the day tomorrow, the 25th.



Re: NetBSD on a Soekris net4801

2017-02-10 Thread matthew sporleder
On Fri, Feb 10, 2017 at 2:26 PM,   wrote:
> Hi all,
> I'm thinking of running NetBSD on a Soekris net4801. It has 128 MB RAM and 1 
> GB CF card.
> Does anybody have experience running NetBSD on these machines? Do I need a 
> custom kernel for the AMD Geode CPU on the machines?
> Is there a good way to reduce wear (for example swap use) to increase the CF 
> card's life?
> Thanks,
> udon


I wrote this while running netbsd on my net4801 to save the CF card:
http://mspo.com/how-to/netbsdreadmostly.html
and also this for netbooting, etc:
http://www.mspo.com/how-to/soekris.html


Re: The old wiki.netbsd.se

2016-12-02 Thread matthew sporleder
On Fri, Dec 2, 2016 at 1:48 PM, Swift Griggs  wrote:
>
>
> https://web.archive.org/web/20100527034652/http://wiki.netbsd.se/Main_Page
>
> "Dear Users, Thank you for your patience and your contributions over the
> last 4 years. The time has come to shut down this wiki. Please refer to the
> official NetBSD wiki in the future."
>
> I'm just being nosy. Anyone remember what happened that made the site
> operator ditch the site? "The time has come" Why did it come ?
>
> Personally, I found it far more useful and rewarding than the TNF wiki (not
> knocking TNF). Plus, I had an account and could edit pages etc..
>
> I'm considering snarfing all my content back outta the wayback machine and
> resurrecting my own version of it. However, I'd first like to understand the
> original story if anyone knows it. Was it hackers beating on the site?
> Spammers take over the mail relay? Did the guy just get a divorce and his
> ex-wife's alimony take away the bandwidth fees?
>
> The answer I'd dread to hear is "It was too open and not dryly clinical or
> academically pedantic enough. So, we shut it down. Too many people had
> access." Unfortunately, due to the meta-refresh to wiki.netbsd.org appearing
> right afterward, it's an open question in my mind. Thus, I don't want to end
> up fussing with TNF if I stood something like it back up. That's the main
> reason why I'm so curious.
>
> Please don't take my speculation the wrong way, it's just guessing/fear.
>
> Maybe I was the only one who liked it and I'm just wasting my time.
>
> Thanks,
>   Swift


I imported things I thought were useful into wiki.netbsd.org, mostly
here: http://wiki.netbsd.org/tutorials/


Re: bozohttpd support for SNI

2016-09-30 Thread matthew sporleder
On Fri, Sep 30, 2016 at 4:43 PM, Alistair Crooks  wrote:

> Personally, I'd love to have support for SNI (and multiple -Z paths
> per site too) - I'd use it daily.
>
> In fact, I was just bemoaning that fact yesterday, but am not
> best-placed to do anything about it right now (yes, I suck :()
>
> Best,
> Alistair
>
> On 30 September 2016 at 13:37, J. Lewis Muir  wrote:
> > Hello!
> >
> > Does bozohttpd in NetBSD (7 or current) support SNI (Server Name
> > Identification) such that multiple SSL sites can be served from one
> > HTTPS server?  If not, what is NetBSD's position on the feature: is it
> > "we're open to accepting a quality patch," or is it more "we'd rather
> > not add the feature; it's better to just use separate server instances
> > on separate IP addresses; we're trying to keep with bozohttpd's main
> > feature as stated on its website which is 'the lack of features,
> > reducing the code size and improving verifiability'"?
> >
> > Thanks!
> >
> > Lewis
> >
>

bozo is growing features pretty quickly as netbsd keeps trying to use it to
do actual stuff(tm).  :)


Re: System fails to start dhclient at boot after upgrade 6.1.5 -> 7.0.1

2016-07-06 Thread matthew sporleder
On Wed, Jul 6, 2016 at 9:05 AM,   wrote:
> I have just upgraded my server from 6.1.5 to 7.0.1 and I'm having
> trouble with dhclient.  My expectation is that the rc system will launch
> dhclient early in the boot process and wait for it to finish before
> moving on.  This does not happen.  Instead it rushes right into
> launching daemons (which fills my logs with named complaints).
> Sometimes it will complete acquisition after boot, but half the time it
> fails completely and a "/etc/rc.d/dhclient restart" says that the
> service is already stopped.  This is a headless server so watching the
> console is difficult.  It has two interfaces, with only the external
> using dhclient.  The working rc.conf was not changed during the 7.0.1
> upgrade.
>
> A quick look over the NetBSD-7 and 7.0.1 release notices doesn't show me
> any obvious reason for a change in behavior.  Does anyone know what is
> going on?
>
> thanks,
> -d


Can you run rcorder and find out what rc might be doing?

rcorder -s nostart /etc/rc.d

also check for things that might have snuck into /etc/rc.conf.d


Re: https://nxr.netbsd.org/ memory errors?

2016-06-18 Thread matthew sporleder
On Sat, Jun 18, 2016 at 10:24 AM, Constantine A. Murenin
 wrote:
> On 17 June 2016 at 16:50,   wrote:
>> When searching, I'm gettings errors on that site such as:
>>
>>   There was an error!
>>
>>   java.lang.OutOfMemoryError: Java heap space
>>
>>   Java heap space
>>
>> Can someone investigate?
>>
>> Just out of curiosity, what other sites for code web-browsing do people
>> like?  For FreeBSD, I like to use http://fxr.watson.org/ now, but I'm
>> not sure if its NetBSD section is up to date anymore.
>>
>> Thanks
>
> Have you tried BXR.SU?
>
> http://BXR.SU/NetBSD/
>
> I still run it on a memory filesystem, so, a NetBSD search would only
> take 20ms, vs. 200--600ms+ on other OpenGrok-based sites.
>
> C.

Adding Zafer to the thread, since he runs the system.  It probably
just needs a bounce.


Re: Rumpkernel comments by Linus

2016-04-27 Thread matthew sporleder
He hasn't looked at it so I don't think he's giving a real critique.
As far as I can tell he's talking about things like NDISwrapper or
softmodem and fails to grasp what rump is about.

On Wed, Apr 27, 2016 at 2:40 PM, Swift Griggs  wrote:
>
> Linus seems to frown on the rumpkernel efforts since he believes it'll put
> the OS into a straight jacket (my words, not his). The original post is
> below. However, what say you folks? Is he reacting to something he doesn't
> know anything about based on his general instincts or is he making a
> legitimate critique? Is it a value-system judgment or is he missing some
> fact about the AnyKernel approach that negates his preconceptions? Is it
> simply a case that Linux already gets lots of DriverLove[tm] from the
> vendors and they just don't have to care or is that too cynical?
>
> -Swift
>
>
> ---[ Slashdot Snippet ]---
> https://linux.slashdot.org/story/15/06/30/0058243/interviews-linus-torvalds-answers-your-question
>
> "anykernel"-style portable drivers?
> by staalmannen
>
> What do you think about the "anykernel" concept (invented by another Finn
> btw) used in NetBSD? Basically, they have modularized the code so that a
> driver can be built either in a monolithic kernel or for user space
> without source code changes ( rumpkernel.org ). The drivers are highly
> portable and used in Genode os (L4 type kernels), minix etc... Would this
> be possible or desirable for Linux? Apparently there is one attempt called
> "libos"...
>
> Linus: So I have bad experiences with "portable" drivers. Writing drivers
> to some common environment tends to force some ridiculously nasty
> impedance matching abstractions that just get in the way and make things
> really hard to read and modify. It gets particularly nasty when everybody
> ends up having complicated - and differently so - driver subsystems to
> handle a lot of commonalities for a certain class of drivers (say a
> network driver, or a USB driver), and the different operating systems
> really have very different approaches and locking rules etc.
>
> I haven't seen anykernel drivers, but from past experience my reaction to
> "portable device drivers" is to run away, screaming like little girl. As
> they say in Swedish "Brnt barn luktar illa".
>



Re: non-ASCII support?

2016-02-23 Thread matthew sporleder
On Tue, Feb 23, 2016 at 3:46 PM, Malcolm Herbert  wrote:
> Folks - I use a combination of bash, screen, irssi (all on NetBSD) at
> the remote end and putty (on Windows) or Terminal (on Ubuntu) at the
> local end and haven't been able to get utf-8 working end-to-end ...
>
> Are there tips or pointers on getting more-than-merely-ASCII working
> with this combination? Are there testing tools I can use to work out
> which bit might be dropping the ball?
>
> Given the world-wide nature of development on NetBSD, I don't believe
> it isn't supported, I'm very probably just not doing it right ... :)
>
> Regards,
> Malcolm
>
> --
> Malcolm Herbert
> m...@mjch.net


I recently got all of this working thanks to:
http://docs.perl6.org/language/unicode_entry

and settings in my terminal (osx)
advanced -> text encoding -> utf-8
my lang:
~ $ echo $LANG
en_US.UTF-8

(that's local and remote after ssh)


in screenrc:
defutf8 on
utf8 on

/SET term_charset utf-8 in irssi

start screen with -U

and now I can finally use perl6 characters in irc. «like this»


Re: History behind pkgsrc 'biology' category

2016-02-06 Thread matthew sporleder
On Fri, Feb 5, 2016 at 6:09 PM, Swift Griggs  wrote:
>
> I am curious (only curious - this is not a complaint): Does anyone know why
> there ended up being a pretty well-fleshed-out 'biology' section in pkgsrc
> but there isn't "chemistry", "physics", "engineering" etc...
>
> Was there some prodigious pkgsrc maintainer/hacker who was a biologist or is
> it just that there happen to be more biology-related programs which justify
> the discrete category?
>
> Again, not complaining. I think it's quirky and cool. I'm just curious.
>
> Thanks,
>   Swift


I wasn't around then but the cvs history pretty much confirms my suspicions:

René Hexel  (rh@)  started the category in 1999 with the message:
"Enable bioperl."

If you recall, the late 90's and early 2000's saw a big push in
bioinformatics, and especially with perl as a processing language.

Matt

p.s. I have cc'ed René to see if more details can be shared.


Re: filesystem change monitoring

2015-08-13 Thread matthew sporleder
On Thu, Aug 13, 2015 at 3:15 PM, Emmanuel Dreyfus  wrote:
> matthew sporleder  wrote:
>
>> Syncing dirs rsync-style is served well by unison
>> http://www.cis.upenn.edu/~bcpierce/unison/
>
> That does not seem to perform near-time sync, does it?
>

No, it's trigger manually (like with cron).


Re: filesystem change monitoring

2015-08-13 Thread matthew sporleder
On Thu, Aug 13, 2015 at 5:51 AM, Emmanuel Dreyfus  wrote:
> On Tue, Aug 11, 2015 at 02:44:10PM +, Emmanuel Dreyfus wrote:
>> Do we have a smart way to monitor a whole filesystem hierarchy for
>> changes?
>
> Replying to myself: the short answer is no. kqueue will not scale to
> thousands of nodes because it needs to open a filedescriptor for each.
>
> lsyncd has been mentionned in the thread. On NetBSD, it uses kqueue
> and therefore suffers the sclaing limitation.
>
> An ongoing project to fix kqueue was mentionned:
> https://wiki.netbsd.org/projects/project/kqueue-dirnotify/
>
> That situation begs for an interm solution. Since my problem is to mirror
> a file hierarchy from an host to another, I crafter an utility called
> fsssyncd as an attempt to address the problem without lenghlty kernel
> hacking (that will be necessary, but not this week!):
> http://ftp.espci.fr/pub/syncffsd/syncffsd-0.1.tgz
>
> Basic usage:
> syncfssd /usr/local/source host:/usr/local/destination
>
> From the man page:
>> syncfssd uses rsync(1) to replicate a directory tree to another host.
>> This involves detecting changes, something NetBSD is not well prepared to
>> handle. The kqueue(2) interface can detect changes, but it needs to use a
>> file descriptor for every node monitored, and this does not scales very
>> well for huge directories trees.
>>
>> syncfssd attempts to improve the situation until kqueue(2) gets better,
>> by using FFS superblock's fs_time field, which is updated on every
>> filesystem change. This lets syncfssd detects a change immediatly if the
>> filesystem is mounted synchronous, or after a few seconds if mounted with
>> WAPBL(4) enabled.
>>
>> Once a change is detected, the relevant nodes are found by walking source
>> looking for files that changed since the previous filesystem modifica-
>> tion.  The resulting nodes are deduped (i.e.: we do not retain a node in
>> a directory if the directory itself changed), and are fed to rsync(1).
>
> This logic could be embedded into lsyncd but I am not sure such work makes
> sense. Improving kqueue seems a better, more general goal.
>
> Feedbacks on this version 0.1 are welcome.
>
> --
> Emmanuel Dreyfus
> m...@netbsd.org

Syncing dirs rsync-style is served well by unison
http://www.cis.upenn.edu/~bcpierce/unison/


Re: filesystem change monitoring

2015-08-12 Thread matthew sporleder
On Wed, Aug 12, 2015 at 7:35 AM, Emmanuel Dreyfus  wrote:
> Ryo ONODERA  wrote:
>
>> I have no idea about large hierarchy,
>
> Simple: try to mirror a hiearchy with more than kern.maxfiles nodes, you
> loose.
>
> --
> Emmanuel Dreyfus
> http://hcpnet.free.fr/pubz
> m...@netbsd.org

https://wiki.netbsd.org/projects/project/kqueue-dirnotify/

Linux has inotify, which can do a single directory and windows has a
more advanced system.

I don't know if solaris or others had yet-another interface.


Re: NetBSD 7.0_RC1

2015-06-24 Thread matthew sporleder
On Sun, Jun 21, 2015 at 11:26 AM, Soren Jacobsen  wrote:
> On behalf of the NetBSD project, it is my pleasure to announce the first
> release candidate of NetBSD 7.0.
>
> Many changes have been made since 6.0.  Here are a few highlights:
> - Greatly improved support for modern Intel and Radeon graphics hardware
>   through a port of the Linux DRM/KMS code.  Most X.Org components have
>   been updated as well.
> - ARM multiprocessor support
> - Support for new ARM boards, some of which are listed below:
>   * Raspberry Pi 2
>   * ODROID-C1
>   * BeagleBoard-xM
>   * BeagleBone
>   * BeagleBone Black
>   * Banana Pi
>   * Cubieboard 2
>   * Cubietruck
>   * Merii Hummingbird
>   * Marvell ARMADA XP
>   * GlobalScale MiraBox
>   * Kobo
>   * Sharp Netwalker PC-Z1
> - GPT support in sysinst
> - Lua kernel scripting
> - Multiprocessor USB stack
> - Many improvements to NPF, the NetBSD packet filter
> - GCC 4.8.4 (and optionally, LLVM/Clang 3.6.1)
>
> Binaries of NetBSD 7.0_RC1 are available for download at:
>
> ftp://ftp.netbsd.org/pub/NetBSD/NetBSD-7.0_RC1/
>
> Those who prefer to build from source can either use the netbsd-7-0-RC1
> tag or follow the netbsd-7 branch.
>
> Please help us out by testing 7.0_RC1.  We love any and all feedback.
> Report problems through the usual channels (submit a PR or write to the
> appropriate list).  More general feedback is welcome at
> rel...@netbsd.org.  Your input will help us put the finishing touches on
> what promises to be a great release!
>
> Enjoy,
> Soren

Is there a timeline for RC2 or final release in mind?

Thanks,
Matt


Re: using /etc/cron.d

2015-01-16 Thread matthew sporleder
On Fri, Jan 16, 2015 at 12:10 PM, matthew sporleder
 wrote:
> I was attempting to put a cron file in /etc/cron.d today and could not
> figure out how to not get this message:
> (*system*) BAD FILE MODE (/etc/cron.d/github-pull)
>
>
> That appears to be coming from
> if ((eqmode && (statbuf->st_mode & 07577) != eqmode) ||
> (badmode && (statbuf->st_mode & badmode) != 0))
>
> Isn't 07577 too many digits?
>
> ---
>
> Also I was having trouble getting crond to pick up my changes unless I
> did a touch of the /etc/cron.d directory (not just the file I was
> editing);
>
> Any ideas?
>
> Thanks,
> Matt

Okay it looks like modes 400 and 600 work


using /etc/cron.d

2015-01-16 Thread matthew sporleder
I was attempting to put a cron file in /etc/cron.d today and could not
figure out how to not get this message:
(*system*) BAD FILE MODE (/etc/cron.d/github-pull)


That appears to be coming from
if ((eqmode && (statbuf->st_mode & 07577) != eqmode) ||
(badmode && (statbuf->st_mode & badmode) != 0))

Isn't 07577 too many digits?

---

Also I was having trouble getting crond to pick up my changes unless I
did a touch of the /etc/cron.d directory (not just the file I was
editing);

Any ideas?

Thanks,
Matt


Re: ntpd not correcting system time, offset keeps increasing

2015-01-13 Thread matthew sporleder
On Tue, Jan 13, 2015 at 9:59 PM, scar  wrote:
> Christos Zoulas wrote on 01/13/2015 06:57 PM:
>> Did you run ntpdate first to sync the time?
>
> well ntpdate runs when system boots but i haven't run it since; the time
> is so far off i didn't want to mess up anything on the system
>
>

It's very rare that this causes problems in reality.


Re: how to protect sd card on rpi

2014-09-23 Thread matthew sporleder
On Mon, Sep 22, 2014 at 11:20 AM, Zoran Kolic  wrote:
> After installing on raspberry pi, I found few articles,
> how to help sd card to live longer. What is neccessary
> to put in conf files for that?
>
> I.e. to have in fstab:
>
>/dev/ld0a/ffs rw,noatime,nodevmtime 1 1
>
> Then to put into /etc/rc.conf:
>
>   syslogd=NO
>   manpagedb=NO
>   savecore=NO
>   virecover=NO
>   fsck_flags="-P -p -y"
>
> Also, how would apmd and powerd behave on rpi?
> Best regards
>
>Zoran
>


This is probably out of date.. but:
http://mspo.com/how-to/netbsdreadmostly.html


Re: Create a file with history in sh

2014-06-18 Thread matthew sporleder
On Wed, Jun 18, 2014 at 9:51 AM, Ottavio Caruso
 wrote:
> On 18 June 2014 15:09, matthew sporleder  wrote:
>> ksh will have all of the features you want and is installed in base.
>
> Interesting. I definitely need bash as a normal user but I would
> gladly use ksh as root.
>
> Why is this not in the docs and in INSTALL.html? That would have saved
> me some valuable time.
>

I thought it was an option in the installer to select the shell.  (sh,
csh, or ksh)

Obviously each could be described better.


Re: Create a file with history in sh

2014-06-18 Thread matthew sporleder
On Wed, Jun 18, 2014 at 8:51 AM, Greg Troxel  wrote:
>
> "Rocky Hotas"  writes:
>
>> I am quite new with this mailing-list.
>
> I've redirected followups to netbsd-users.  tech-userlevel is for
> arguing about complicated bugs or proposed changes ;-)
>
>> During the installation of NetBSD, I choose /bin/sh as the default root and 
>> user shell.
>> In the users' home directories there are not files like .sh_history or
>> similar and no "history-like" files are updated when I log in or log
>> out. But I would like to keep trace of all the commands typed in the
>> terminal, the last 100 or 1000, and not only the ones typed in the
>> current login session, accessible with the up arrow.
>> Reading the sh manual I didn't find the possibility to create a permanent 
>> file with history like in bash or ksh.
>> Is it true or there exist some possibility to do this? Or where I can look 
>> for this option?
>
> There's no reason you have to use /bin/sh for users.  You can install
> bash from pkgsrc, and set the user's shell to /usr/pkg/bin/bash.  Many
> people do this (or some other shell in pkgsrc).  I suggest keeping root
> as /bin/sh for avoiding problems, but best practice is to use the actual
> root account sparingly anyway.  (sudo -E will give you a uid 0 version
> of your own shell, sourcing dotfiles.)
>
> /bin/sh in NetBSD is intentionally minimalist:
>
>textdata bss dec hex filename
>  11622912685832  123329   1e1c1 /bin/sh
>
>textdata bss dec hex filename
>  817301   18820   12272  848393   cf209 /usr/pkg/bin/bash
>
> (Of course, one has to look at libraries, too, but in general our sh has
> a lot less UI complexity.)


ksh will have all of the features you want and is installed in base.


Re: any netbsd hosting providers?

2014-06-17 Thread matthew sporleder
On Tue, Jun 17, 2014 at 12:39 PM, Mayuresh Kathe  wrote:
> hello,
>
> are there any web hosting providers specializing in netbsd?
> would like to evalute some for my client who's expressed
> interest in moving away from linux (centos).
>
> thanks,
>
> ~mayuresh
>


VPS work at amazon and I also use a company called panix.


building ruby21-base on netbsd 6.0.2

2014-06-08 Thread matthew sporleder
I end up in a bad situation building ruby21-base on netbsd 6.0.2

the
checking for broken backtrace...

just hangs during configure.
Here's a ktrace of what happens:
https://gist.github.com/msporleder/ab2a4e5f1bd0db3f1034

I've also tried prefer pkgsrc for libexecinfo.

Any other hints?

Thanks,
Matt


Re: NetBSD as a TimeCapsule?

2014-03-18 Thread matthew sporleder
On Tue, Mar 18, 2014 at 11:50 AM, Fredrik Pettai  wrote:
>
>> Just a reflection on NetBSD's mdnsd(8):
>>
>> NetBSD's mdnsd(8) (version 212.1) was imported into NetBSD in September 2009.
>> My old Snow Leopard (which is probably one of few left) is running version 
>> 258.21, so the version imported into NetBSD originates from Leopard. So 
>> mdnsd in NetBSD seems more than obsolete. If no one plan to upgrade it, 
>> maybe it should be removed from the next major release of NetBSD ?
>
> I was informed that a newer version of mdnsd(8) is available in 
> pkgsrc/net/mDNSresponder, so I installed that to see if that would help, but 
> it fails to start with the message:
>
> Mar 18 14:56:53 xsrv1 mDNSResponder: mDNSResponder (Engineering Build) (Mar 
> 18 2014 14:43:05) starting
> Mar 18 14:56:53 xsrv1 mDNSResponder: ERROR: bind(listenfd, (struct sockaddr 
> *) &laddr, sizeof(laddr)); failed: 48 (Address already in use)
> Mar 18 14:56:53 xsrv1 mDNSResponder: ERROR: udsserver_init: 48 (Address 
> already in use)



Address already in use.  Did you shutdown mdnsd?  Check netstat/lsof, etc









> Mar 18 14:56:53 xsrv1 mDNSResponder: mDNS_AddDNSServer: Lock not held! 
> mDNS_busy (0) mDNS_reentrancy (0)
> Mar 18 14:56:53 xsrv1 mDNSResponder: mDNS_AddDNSServer: Lock not held! 
> mDNS_busy (0) mDNS_reentrancy (0)
> Mar 18 14:56:53 xsrv1 mDNSResponder: mDNSResponder (Engineering Build) (Mar 
> 18 2014 14:43:05) stopping
>
> and the bundled dns-sd doesn't seem to work well either:
>
> xsrv1# /usr/pkg/bin/dns-sd -V
> DNSServiceGetProperty failed -65563
>
> (still testing on the NetBSD 6.1.3/amd64 host...)
>
> So to iterate over this again, is anybody using mDNSresponder successfully on 
> NetBSD? (either the bundled in NetBSD, or the pkgsrc version...)
>
> /P


Re: Muddled wrt pkgsrc

2014-03-12 Thread matthew sporleder
On Wed, Mar 12, 2014 at 5:46 AM, Brett Lymn  wrote:
> On Tue, Mar 11, 2014 at 12:52:05PM +0100, Rhialto wrote:
>>
>> Do you use pkg_comp for that or did you roll your own? And if so, any
>> particular thing missing from pkg_comp?
>>
>
> hey guys, I have this round thing, you can put it on the bottom of stuff
> and it makes things move easier... you sort of say whee when using it so
> I called it a wheel... oh wait.
>
> But seriously, only my ignorance stopped me using pkg_comp.  The one I
> rolled was pretty simple and suits my needs.  The only thing I can offer
> as recompense is I do have a script that creates a meta-pkg makefile
> from a simple list of packages.  It queries the installed packages and
> writes the DEPENDS so that the meta-pkg depends on >= the current
> version in pkgsrc so it forces a refresh.
>
> --
> Brett Lymn
> Staple Guns: because duct tape doesn't make that KerCHUNK sound - xkcd.com


http://mail-index.netbsd.org/tech-pkg/2013/05/11/msg011296.html

That patch + make replace would have done the job.


Re: CDE on NetBSD

2014-03-11 Thread matthew sporleder
On Tue, Mar 11, 2014 at 6:54 AM, Lucius Rizzo  wrote:
> So I happened across the latest CDE release and very pleasantly found
> NetBSD as now one of the supported platforms.
>
> http://sourceforge.net/p/cdesktopenv/wiki/NetBSD/
>
> So the ones who haven't choked on their breakfast thinking back of the
> CDE hating days, are you on this list? I am planning to try this soon and
> if there is anyone I can a) thank for actually something so awesome to be
> on NetBSD and b) actually have a working DE with CDE and can share your
> thoughts on how it runs etc.
>
> I <3 CDE. :)
>
> --
>
> | _o_ |_)o_ _  _
> |_|_|(_||_|_> | \|/_/_(_) - Lucius.Tel
> --
> ++ transfer, n.: ++
> ++  A promotion you receive on the condition that you leave town. ++
>


I remember the announcement for this and was pleased to see it
(although I'll take xfce these days).

http://pkgsrc.se/wip/cde exists.  Maybe it could use an update to
2.2.1 (currently 2.2.0).


Re: TCP/IP outbound connection "routing"

2014-02-23 Thread matthew sporleder
On Fri, Feb 21, 2014 at 11:31 AM, Scott Burns  wrote:
> We are attempting to build a customized monitoring solution for a customer.
>
> The customer would like us to access his remote server over the in facility
> Wi-Fi to basically monitor both the Wi-Fi infrastructure is up and the
> server we are connecting to is working properly.
>
> To facilitate notification we need to have a wired lan connection on the
> same network to dispatch email etc. when a problem is detected.
>
> I know we can easily create a TCP/IP listener that listens only on the WiFi
> NIC interface but is there a way to make a connect() call so that this call
> is only routed over the Wi-Fi NIC connection? We can obviously play with
> Metrics and have the Wi-Fi NIC preferred but if it is down the connect call
> will take the wired NIC path since it is on the same network.
>
> Ie.
> Monitored Server
> ---
> Wired NIC - 200.1.1.100
>
>
> Monitoring Appliance - NetBSD/amd64
> ---
> Wi-Fi NIC - 200.1.1.1
> Wired NIC - 200.1.1.2
>
> I want an application on the Monitoring Appliance to connect to the
> Monitored Server (200.1.1.100) only over the Wi-Fi NIC (200.1.1.1).
> If that connection fails (Monitored Server down, Wi-Fi NIC offline, Access
> Point unplugged, switch broken etc.) I want to make a connection over the
> Wired NIC (200.1.1.2) to send email and other notification types.
>
> With NetBSD/amd64 6.x is there any way to force the connect() call to only
> use one interface as it's connect path much like you make the bind() call
> only listen on one NIC?
>
> Thanks
> Scott.
>
>


nc has:
-s addr Local source address

would that work?  It might take some scripting to figure out which
interface is using which address.


Re: httpd + php on ec2 constant crash

2013-12-10 Thread matthew sporleder
On Tue, Dec 10, 2013 at 5:43 PM, el kalin  wrote:
>
>
> hi all…
>
> i have an netbsd instance on amazon's ec2 ws. it has pretty standard
> php+mysql+httpd installation on it. everything was build from pkgs. today a
> lot of people who were accessing it got the "connection reset" message. many
> times.
>
>
> my https error log looks like this:
>
> [Tue Dec 10 17:21:56.060797 2013] [core:notice] [pid 5380] AH00052: child
> pid 22012 exit signal Segmentation fault (11)
> [Tue Dec 10 17:22:05.239618 2013] [core:notice] [pid 5380] AH00052: child
> pid 6222 exit signal Segmentation fault (11)
> [Tue Dec 10 17:22:06.257665 2013] [core:notice] [pid 5380] AH00052: child
> pid 16224 exit signal Segmentation fault (11)
> [Tue Dec 10 17:22:06.451431 2013] [core:notice] [pid 5380] AH00052: child
> pid 14182 exit signal Segmentation fault (11)
> [Tue Dec 10 17:22:10.498240 2013] [core:notice] [pid 5380] AH00052: child
> pid 8846 exit signal Segmentation fault (11)
> [Tue Dec 10 17:22:13.639382 2013] [core:notice] [pid 5380] AH00052: child
> pid 15447 exit signal Segmentation fault (11)
> [Tue Dec 10 17:22:52.149443 2013] [core:notice] [pid 5380] AH00052: child
> pid 11396 exit signal Segmentation fault (11)
> [Tue Dec 10 17:22:56.189382 2013] [core:notice] [pid 5380] AH00052: child
> pid 19213 exit signal Segmentation fault (11)
> [Tue Dec 10 17:23:19.458501 2013] [core:notice] [pid 5380] AH00052: child
> pid 1812 exit signal Segmentation fault (11)
> [Tue Dec 10 17:23:22.479650 2013] [core:notice] [pid 5380] AH00052: child
> pid 7702 exit signal Segmentation fault (11)
>
> i tried to attach a current httpd process to gdb but gdb dies with this:
>
> /usr/src/external/gpl3/gdb/dist/gdb/thread.c:81: internal-error:
> inferior_thread: Assertion `tp' failed.
> A problem internal to GDB has been detected,
> further debugging may prove unreliable.
> Quit this debugging session? (y or n)
>
> i was hoping somebody here can point in me in the right direction to figure
> out what exactly is happening and how can i get rid off it..
>
> the instance is 6.0 NetBSD 6.0 (XEN3_DOMU) amd64
>
> thanks..
>


You'll need ot rebuild with -g, but:
http://mspo.com/how-to/apache-php-gdb.html


Re: fuse ntfs-3g on USB poor performances

2013-12-08 Thread matthew sporleder
On Thu, Nov 7, 2013 at 8:53 AM,   wrote:
> Hello,
>
> I need to do a back-up of files served by an amd64 NetBSD node (5.2.0),
> and, in case of problem, this back-up has to be readable directly by
> Windows nodes. So I use external USB connected disks (USB 3.0; the
> server has USB 3.0 ports too), formatted as NTFS, and I use
> fuse/ntfs-3g.
>
> But the write performance is quite poor (1.5 Mb/s).
>
> Is there anyway of speeding things up? From searching around, it seems
> that the bottleneck is with the driver by itself.
>
> TIA
> --
> Thierry Laronde 
>   http://www.kergis.com/
>   http://www.renaissance-francaise.fr/
> Key fingerprint = 0FF7 E906 FBAF FE95 FD89  250D 52B1 AE95 6006 F40C


are you referencing specific links from "searching around"?

I believe you that it's slow, but I'm sure it would take some research
to make any improvements.


Re: Bug in fluxbox-generate_menu?, was: Which lightweight window manager with menu auto-update?

2013-11-15 Thread matthew sporleder
On Fri, Nov 15, 2013 at 4:22 AM, Ottavio Caruso <
ottavio2006-usenet2...@yahoo.com> wrote:

> On 14 November 2013 16:36, Hauke Fath  wrote:
> > On Thu, 14 Nov 2013 16:11:05 +, Ottavio Caruso wrote:
> >> I am looking for a recommendation for a lightweight manager that can
> >> update itself after installing new packages and doesn't list non
> >> existent applications.
> >
> > icewm does that.
>
> Installed icewm, no man page, odd!
>
> The only application listed was xterm. I am not sure how to configure
> this wm now.
>
> > for all I know, pkgsrc does not maintain a list of (X11
> > GUI) applications for window managers to peruse.
>
> Yes, can you expand on this. I suspect window managers won't expect to
> find applications in /usr/pkg, although it's in the $PATH.
>
> Going to back to fluxbox, I had this error when trying to generate a menu:
>
> fluxbox-generate_menu
> touch: ${HOME}/.fluxbox/menuconfig: No such file or directory
> Warning: I couldn't create ${HOME}/.fluxbox/menuconfig
> Fatal error: can't create or write to ${HOME}/.fluxbox/menu
>
> I researched on many forums and I thought it was a bug,
>
> I then found this old bug report:
> http://sourceforge.net/p/fluxbox/bugs/835/
>
> I believe the version of fluxbox shipped with pkgscr is an update of
> older one and it's possible that a broken fluxbox-generate_menu has
> been carried over.
>
> Has anybody got a working copy of fluxbox and check if this is still
> the case, before filling a bug report?
>

I just did a make extract and don't see your issue.

Try putting a -x on the /bin/sh in that script and get some more info.


Re: netbsd 6 instance on amazon

2013-11-02 Thread matthew sporleder
Can you push the php log into a different facility as a first step?


On Sat, Nov 2, 2013 at 1:12 PM, el kalin  wrote:

> not really. this machine it's pretty busy and the php log is dumped in the
> syslog too. there are no other system messages - except php warnings.
>
> i do have a pre-problem image of this machine which i did put up and now
> monitoring too. but there has been a lot of work done since then and i
> rather resolve this because moving everything over will be a very
> problematic at this point
>
> the strange thing is that it always happens pretty much exactly at the
> same time. and there are no cron jobs that are scheduled for that time. but
> it's always a few minutes before the default daily cron at 3:15. like i
> said it doesn't happened every day but this week happened twice and it gets
> to be annoying since i don't get to know about it until later in the
> morning...
>
> thanks...
>
>
>
>
>
> On Sat, Nov 2, 2013 at 11:20 AM, matthew sporleder 
> wrote:
>
>> On Sat, Nov 2, 2013 at 7:10 AM, el kalin  wrote:
>> >
>> >
>> > hi all...
>> >
>> > i'm running an netbsd 6 (6.0 NetBSD 6.0 (XEN3_DOMU) amd64) instance on
>> > amazon since december last year. everything was working nicely until
>> about 2
>> > months ago when the system sporadically started rebooting itself. it
>> happens
>> > once a week on average. sometimes twice. the last line in the messages
>> log
>> > always looks like this:
>> >
>> >
>> ^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@
>> > ^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@Nov  2
>> > 07:21:55 ip-10-62-123-59 syslogd[310]: restart
>> >
>> >
>> > it always happens right before the default daily cron (which is set for
>> 3:15
>> > am by default). around 3:12 am.
>> >
>> > the only things the machine runs are httpd and mysqld..
>> >
>> > has anybody experienced this? i would greatly appreciate any thoughts
>> that
>> > can resolve this problem...
>> >
>> > thanks...
>>
>>
>> Is there anything further up in the log to indicate a sender of that
>> message?
>>
>> Also, have you tried terminating and rebuilding (caveat data loss,
>> etc) to get onto another amazon host?
>>
>
>


Re: netbsd 6 instance on amazon

2013-11-02 Thread matthew sporleder
On Sat, Nov 2, 2013 at 7:10 AM, el kalin  wrote:
>
>
> hi all...
>
> i'm running an netbsd 6 (6.0 NetBSD 6.0 (XEN3_DOMU) amd64) instance on
> amazon since december last year. everything was working nicely until about 2
> months ago when the system sporadically started rebooting itself. it happens
> once a week on average. sometimes twice. the last line in the messages log
> always looks like this:
>
> ^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@
> ^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@Nov  2
> 07:21:55 ip-10-62-123-59 syslogd[310]: restart
>
>
> it always happens right before the default daily cron (which is set for 3:15
> am by default). around 3:12 am.
>
> the only things the machine runs are httpd and mysqld..
>
> has anybody experienced this? i would greatly appreciate any thoughts that
> can resolve this problem...
>
> thanks...


Is there anything further up in the log to indicate a sender of that message?

Also, have you tried terminating and rebuilding (caveat data loss,
etc) to get onto another amazon host?


Re: Apache with VitualHost ?

2013-10-26 Thread matthew sporleder
Put your new config and the output from 'httpd -S' on a paste bin and
I will take a look.

Also try asking for some real time help in irc.freenode.net #httpd


On Sat, Oct 26, 2013 at 8:59 AM, Maurizio Caloro  wrote:
> Hello Dear Matt
> Thanks for your Quick Answer!
>
> I have done all the changes but stil the same the HomeShine site are not
> Available
> the Path to this folder are all Ok and i don't know why this error allso
> ocure.
> Thanks for your help
> Regards
> Mauri
>
> Am 26.10.2013 14:11, schrieb Maurizio Caloro:
>> Am 26.10.2013 13:39, schrieb Matt Sporleder:
>>
>>> hometime is not homeshine
>>> Yes this mod now i have change, but stil the same, no Webpage appair
>>>
>>>
>>> On Oct 26, 2013, at 7:14 AM, Maurizio Caloro  wrote:
>>>
 Hello Together
 After try to configure Apache with virtualhost, i have the problem that
 the second link "homeshine" are not available.
 -Caloro are Browsable = OK
 -HomeShine
 ony for local Network, but are not Available.
 For any Help iam Happy
 Regards
 Mauri

 [Snip-http.conf]
 # Virtual hosts
 Include etc/httpd/httpd-vhosts.conf

 [Snip-http-Vhost.conf]
 NameVirtualHost *:80

 
 ServerAdmin webmas...@caloro.ch
 DocumentRoot "/usr/pkg/share/httpd/htdocs/caloro.ch/"
 ServerName caloro.ch
 ServerAlias www.caloro.ch
 
Options Indexes FollowSymLinks
AllowOverride None
Order allow,deny
Allow from all
 

DirectoryIndex index.html

 ErrorLog /var/log/httpd/caloro_error.logs
 TransferLog /var/log/httpd/caloro_trans.logs
 

 
 ServerAdmin webmas...@homeshine.ch
 DocumentRoot "/usr/pkg/share/httpd/htdocs/homeshine.ch/"
 ServerName homeshine.ch
 ServerAlias www.homeshine.ch
 
Options Indexes FollowSymLinks
AllowOverride None
Order allow,deny
Allow from all
 

DirectoryIndex index.html

 ErrorLog /var/log/httpd/homeshine_error.logs
 TransferLog /var/log/httpd/homeshine_trans.logs
 

 [Snip-Error.conf]
 [Sat Oct 26 13:03:36 2013] [notice] Digest: generating secret for digest
 authentication ...
 [Sat Oct 26 13:03:36 2013] [notice] Digest: done
 [Sat Oct 26 13:03:37 2013] [notice] Apache/2.2.25 (Unix) DAV/2
 configured -- resuming normal operations

 [Snip-hosts]
 192.168.0.103   homeshine.ch caloro.ch



>


Re: Few notes&questions on NetBSD building and on wedges included by default

2013-10-22 Thread matthew sporleder
On Tue, Sep 24, 2013 at 2:33 PM, scft  wrote:
> Hi, NetBSD mailing lists.
>
> I'm intending to cross-build NetBSD to try it out. I very much liked project 
> goals, as well as emphasis on code clarity and portability.
> Minimalism and perfectionism are attractive.
> However, i have one practical question (which is 2.) and a few 
> suggestions\fixes on building process.
>
> 1. I'm actually do cross-building because installer fails with "wd0: device 
> busy" (googling for further info i found out that it's because of some thing 
> called wedges.).
> Then why to include this unnecessary whistle by default? The goal of defaults 
> is by definition to fit to most users. Either fix sysinst, or kernel config!
>

I'm not sure this is necessarily the case, but why not?


> 2. The only value for x86 architecture is i386. Which obviously means that 
> new features from >i486 are not included, sse is (i guess) not included, amd 
> k8 & opteron optimizations are not included... It is possible to fine-tune 
> these settings in FreeBSD (see: 
> http://svnweb.freebsd.org/base/head/share/mk/bsd.cpu.mk?view=co). Judging by 
> absence of such in /usr/share/mk of NetBSD, it is not possible to get this 
> without DIY there. Why not to implement and document this?
> It is not even explained anywhere, what's the difference between MACHINE and 
> MACHINE_ARCH. BUILDING says that MACHINE_ARCH should always be an exact 
> architecture, MACHINE may be not. And it says that by saying that first is 
> "architecture", second is "type" Very straightforward.
>


You may not want to make so many assumptions about x86/i386.
FreeBSD build system is not the same as NetBSD.  The make files are different.



> 3. I've also found a bug in BUILDING documentation file. It says that 
> HOST_CXX is a C++ compiler. Yet setting HOST_CXX to g++ makes build,sh fail 
> with messages like "C preprocessor fails sanity check". By setting HOST_CXX 
> to c preproc, i have no such messages.
>
> 4. There is no option to actually set c++ compiler then. Groff needs it and 
> fails without it. So i have a choice between hacking makefiles and setting 
> MKGROFF=no. I chose second - nobody loves to hack makefiles. Especially those 
> makefiles that are written by other people.
> I suggest you to implement HOST_CPLUS feature.
> CPLUS, not CPP. So that nobody'll be confused with cpp\cxx.
>

I'm willing to bet this is more of an issue with how you executed the build.


> 5. mk.conf is somewhat badly documented. E.g. i've found new mk.conf options 
> in makefiles, which are not listed in documentation. Some options listed in 
> mk.conf(5) are not listed in BUILDING or handbook, and vice versa.
>


true


> 6. libc fails to build with MKPICLIB=no, saying that '-lgcc is not found'. 
> Even though i've found that i actually need MKPICLIB set to yes, seem as a 
> bug. (This happened when i tried to crossbuild it on both FreeBSD and on an 
> unpopular Ubuntu Linux derivative.)

how are you executing build.sh?


Re: dovecot again/still

2013-10-08 Thread matthew sporleder
On Tue, Oct 8, 2013 at 12:53 PM, Steve Blinkhorn  wrote:
> So I grabbed your tarball, moved everything under /usr/pkg/etc/dovecot
> into a subdirector, and replaced with your tarball contents.   Small
> changes to the pathname and filenames for the cert and the key and -
> same error message.
>
> It's clearly the case that dovecot is providing at least some
> services, for instance what appear to be successful logins.  But my
> postmaster mailbox is filling up with error reports, including
> transcripts that look like this:
>
>  In:  STARTTLS
>  Out: 454 4.3.0 TLS not available due to local problem
>  In:  MAIL FROM:<> SIZE=6613
>  Out: 250 2.1.0 Ok
>  In:  RCPT TO:
>  Out: 450 4.1.1 : Recipient address rejected: User
> unknown
>  in local recipient table
>  In:  QUIT
>  Out: 221 2.0.0 Bye
>
> I'm doing all this on a NetBSD 4.0.1 system that is destined to be
> replaced soon, so I thought I would get familiar with dovecot on a
> machine whose configuration I know well.   I'm wondering whether this
> is maybe a bug in dovecot2 that has been corrected since the tarball I
> started from (off the NetBSD.org site) was created.
>
> --
> Steve Blinkhorn 
>
> You wrote:
>>
>> On Tue, Oct 8, 2013 at 11:43 AM, Steve Blinkhorn  wrote:
>> > I am gradually getting dovecot to work with my established postfix
>> > configuration, but can't find a way past this error (from
>> > /var/log/maillog):
>> >
>> > Oct  8 16:26:52 body dovecot: master: Error: Error reading
>> > configuration: Invalid settings: No services defined
>> >
>> > I'm assuming that I should be looking in conf.d/10-master.conf for the
>> > error, but lack of familiarity with the syntax of the conf files is
>> > making it hard to see what's wrong.
>> >
>> > Is there a way of getting a report of which services are defined so I
>> > can test without exposing my live system to errors?
>> > --
>> > Steve Blinkhorn 
>> >
>>
>>
>> Hey I was just thinking about your previous email last night when I
>> had to re-do my dovecot install from scratch!  :)
>>
>> Just to be 100% sure, you have mail/dovecot2 installed and not
>> mail/dovecot, right?
>> Anyway, you can find my entire config here:
>> www.mspo.com/nc/dovecot.tar.gz
>>
>> Also my postfix config has this kind of stuff:
>> #accepting mail - auth to dovecot
>> smtpd_sasl_type = dovecot
>> smtpd_sasl_path = private/auth
>> smtpd_sasl_auth_enable = yes
>> smtpd_sasl_security_options = noanonymous
>> smtpd_recipient_restrictions = permit_mynetworks,
>> permit_sasl_authenticated, reject_unauth_destination
>>
>
>
> --
> Steve Blinkhorn 
>
> 
> This email is for the addressee only.   If you are not the addressee
> you should immediately delete this email from your system(s) and
> inform us.   It may contain information that is confidential or
> otherwise privileged, and should not be copied or redistributed to
> recipients not originally specified as addressees without permission.
>
> S F Blinkhorn MA PhD CPsychol FBPsS, Managing Director,
> Psychometric Research & Development Ltd.
> PO Box 1143, St Albans, Herts, AL1 9UT, UK
> Registered in England No. 1909571
> Registered Office: 47 Holywell Hill, St Albans, Herts, AL1 1HD
> Phone: +44 (0)1727 841455
> http://www.prd.co.uk
> 


Okay,  I think you are firmly into postfix config problems now.

Also I am attempting to deliver mail to my locally defined users (as
in /etc/passwd).

I have a feeling my postfix TLS settings are less strict than yours..

postconf -c /usr/pkg/etc/postfix
smtpd_enforce_tls = no
smtpd_sasl_type = dovecot


Re: dovecot again/still

2013-10-08 Thread matthew sporleder
On Tue, Oct 8, 2013 at 11:43 AM, Steve Blinkhorn  wrote:
> I am gradually getting dovecot to work with my established postfix
> configuration, but can't find a way past this error (from
> /var/log/maillog):
>
> Oct  8 16:26:52 body dovecot: master: Error: Error reading
> configuration: Invalid settings: No services defined
>
> I'm assuming that I should be looking in conf.d/10-master.conf for the
> error, but lack of familiarity with the syntax of the conf files is
> making it hard to see what's wrong.
>
> Is there a way of getting a report of which services are defined so I
> can test without exposing my live system to errors?
> --
> Steve Blinkhorn 
>


Hey I was just thinking about your previous email last night when I
had to re-do my dovecot install from scratch!  :)

Just to be 100% sure, you have mail/dovecot2 installed and not
mail/dovecot, right?
Anyway, you can find my entire config here:
www.mspo.com/nc/dovecot.tar.gz

Also my postfix config has this kind of stuff:
#accepting mail - auth to dovecot
smtpd_sasl_type = dovecot
smtpd_sasl_path = private/auth
smtpd_sasl_auth_enable = yes
smtpd_sasl_security_options = noanonymous
smtpd_recipient_restrictions = permit_mynetworks,
permit_sasl_authenticated, reject_unauth_destination


Re: dovecot/postfix fconfiguration

2013-10-01 Thread matthew sporleder
On Tue, Oct 1, 2013 at 1:22 PM, Steve Blinkhorn  wrote:

> Perhaps someone with experience of this would offer  some advice - the
> various wikis and helpful howtos I have found so far all start with
> different assumptions, and there's the occasional "here's a sample
> script, but it's in an obsolete format, so don;t expect it to be of
> much help".
>
> The basic aim, as before, is to graft dovecot on to an existing email
> server to allow remote mail access from smartphones.   I'm trying to
> get dovecot running, but when I start it up I get:
>
> Fatal: Error reading configuration: Invalid settings: No services
> defined
>
> Because the configuration files are legion, it's no easy matter to
> track down where the offending (lack of?) settings are located.
>
> From postfix I get:
>
> Oct  1 18:14:53 body postfix/smtpd[25677]: warning: SASL: Connect to
> /var/spool/ postfix/private/auth failed: No such file or directory
>
> this is, I presume, a Unix socket that is not getting created.
>
> I'm hoping these two errors are sufficiently diagnostic for me not to
> have to bother the list with what I take to be consequential errors.
>
>
> --
> Steve Blinkhorn 
>
>
I have this in my postfix config:

main.cf:queue_directory = /var/spool/postfix
main.cf:smtpd_sasl_path = private/auth
main.cf:smtpd_sasl_auth_enable = yes

I don't seem to have anything changed from the defaults in dovecot except
in /usr/pkg/etc/dovecot/conf.d/10-master.conf

I don't remember exactly what I did, but ihave this:
  # Postfix smtp-auth
  unix_listener /var/spool/postfix/private/auth {
mode = 0666
  }


Re: Various size of (Project) ideas for NetBSD and pkgsrc

2013-09-30 Thread matthew sporleder
On Sun, Sep 29, 2013 at 6:27 PM, Justin Cormack <
jus...@specialbusservice.com> wrote:

> On Sun, Sep 29, 2013 at 6:41 PM, matthew sporleder 
> wrote:
> >> (23) Lua support for kernel and userland
> >> Lua is imported to NetBSD base, but nothing uses it.
> >> And update is not done.
> >> Lua kernel support should be imported, or remove it from base.
> >>
> >
> > http://wiki.netbsd.org/projects/project/lua_bindings_chicken_and_egg/
> >
>
> I am working on this, with some caveats as to the current state.
> Mainly so far it is system call bindings, but the aim is to expand it.
> It has extensive tests, and also runs on the rump kernel, which has
> been the main focus so far as rump doesn't have a normal userspace so
> it is useful to be able to script it
>
> The main caveat is it currently runs on the LuaJIT version of Lua not
> the one in core, which has (even) easier interfacing to C which was
> useful for getting it going. The aim is to fix this soonish.
>
> If anyone has particular things they would like Lua interfaces to let
> me know, or other ideas of what they want to see Lua used for and how
> it might fit in, let me know, otherwise will take a look at the stuff
> on the wiki.
>
> Code is here https://github.com/justincormack/ljsyscall - feel free to
> raise issues there or contact me directly.
>
> Justin
>


Thanks, I've added a link.


Re: Various size of (Project) ideas for NetBSD and pkgsrc

2013-09-29 Thread matthew sporleder
On Sun, Sep 29, 2013 at 2:52 PM, Ryo ONODERA  wrote:

> From: matthew sporleder , Date: Sun, 29 Sep 2013
> 14:03:29 -0400
>
> > On Sun, Sep 29, 2013 at 1:58 PM, Ryo ONODERA 
> wrote:
> >
> >> Hi,
> >>
> >> From: matthew sporleder , Date: Sun, 29 Sep 2013
> >> 13:41:55 -0400
> >>
> >> >
> >> > I have noted some places where you might find similar projects.
> >> >
> >> > Also you should not feel intimidated to add these yourself to the
> wiki.
> >> > It's very easy to fix spellings, etc, as needed.
> >> > It's more difficult to express your ideas beyond how you state them.
>  :)
> >> >
> >> > The project template is very easy to use!
> >>
> >> Thanks for your links.
> >>
> >> I feel that some ideas may not be relevant to
> >> http://wiki.netbsd.org/projects/ .
> >> How do you think threshold of adding ideas to projects wiki page?
> >>
> >> Thank you.
> >>
> >> --
> >> Ryo ONODERA // ryo...@yk.rim.or.jp
> >> PGP fingerprint = 82A2 DC91 76E0 A10A 8ABB  FD1B F404 27FA C7D1 15F3
> >>
> >
> >
> > As I read it, projects are enhancements and new ideas.  Fixes, on the
> other
> > hand, are fixes.  :)
> >
> > In your case the broken MIPS stuff seems out of scope for the projects
> page
> > even though it is likely a large "project" in the sense that it requires
> a
> > lot of work.
> >
> > I'm not the gatekeeper, but that's how I see the current projects page.
>
> Thank you.
>
> Important fixes should be written somewhere, and should be managed.
> I feel MIPS problem should be fixed with management.
> GNATS bug tracker is not functional in this case, I feel.
>
> But projects page is not the place for this kind of issue, I understand.
>
> --
> Ryo ONODERA // ryo...@yk.rim.or.jp
> PGP fingerprint = 82A2 DC91 76E0 A10A 8ABB  FD1B F404 27FA C7D1 15F3
>


In this case, the wiki *can* be a decent project management tool, just to
coordinate stuff.

There are some examples of this already under people's user/ dirs
http://wiki.netbsd.org/users/haad/porting_zfs/
http://wiki.netbsd.org/users/haad/todo/
http://wiki.netbsd.org/users/dholland/mercurial/
http://wiki.netbsd.org/users/asau/desktop/


other examples seem to be just in the top namespace:
http://wiki.netbsd.org/opensoundsystem/  (you might find this one
interesting)
http://wiki.netbsd.org/konqueror/

or feel free to make a new directory (hacks/ sounds about right :) ) and
give it a shot!
  - a list of PR's, key players, status tracking, maybe we can find/write
plugins
http://ikiwiki.info/tips/ikiwiki_as_a_requirements_management_tool/


--

an alternative would be to setup a chili/redmine server, but it would be
nice to have these things integrated.

Matt


Re: Various size of (Project) ideas for NetBSD and pkgsrc

2013-09-29 Thread matthew sporleder
On Sun, Sep 29, 2013 at 1:58 PM, Ryo ONODERA  wrote:

> Hi,
>
> From: matthew sporleder , Date: Sun, 29 Sep 2013
> 13:41:55 -0400
>
> >
> > I have noted some places where you might find similar projects.
> >
> > Also you should not feel intimidated to add these yourself to the wiki.
> > It's very easy to fix spellings, etc, as needed.
> > It's more difficult to express your ideas beyond how you state them.  :)
> >
> > The project template is very easy to use!
>
> Thanks for your links.
>
> I feel that some ideas may not be relevant to
> http://wiki.netbsd.org/projects/ .
> How do you think threshold of adding ideas to projects wiki page?
>
> Thank you.
>
> --
> Ryo ONODERA // ryo...@yk.rim.or.jp
> PGP fingerprint = 82A2 DC91 76E0 A10A 8ABB  FD1B F404 27FA C7D1 15F3
>


As I read it, projects are enhancements and new ideas.  Fixes, on the other
hand, are fixes.  :)

In your case the broken MIPS stuff seems out of scope for the projects page
even though it is likely a large "project" in the sense that it requires a
lot of work.

I'm not the gatekeeper, but that's how I see the current projects page.


Re: Various size of (Project) ideas for NetBSD and pkgsrc

2013-09-29 Thread matthew sporleder
On Sat, Sep 28, 2013 at 9:09 PM, Ryo ONODERA  wrote:

> Hi,
>
> I have (or have heard) some ideas for NetBSD and pkgsrc.
> Can someone add them to http://wiki.netbsd.org/projects/all-flat/
> with good English and proper classification, if it seems ok?
> I cannot be mentor, because of lack of ability sadly.
>
>
> (1) Add UEFI boot support for NetBSD/amd64
> I do not have newer PC, but I have heard newer PC uses UEFI to boot OSes
> instead of BIOS.
> Boot with UEFI should be added to NetBSD/amd64 (I do not know whether UEFI
> is
> available for i386 or not).
> I have seen EFI support option in Oracle VirtualBox.
> No newer PC may not be needed for development.
>
> (2) Create multiple packages from one pkgsrc package directory
> For example, pkgsrc/fonts/harfbuzz has icu option and theoretically
> non-icu part and icu part can be separate package, but splitting
> only icu part from harfbuzz is difficult in configure/build stage.
> In rpm (Red Hat package manager) case, "build once and multiple packages is
> created" is realized with custom do-install target.
> "build once" means reduce of build time.
>
> (3) Restore MIPS support for NetBSD 6 and current
> Sadly all my MIPS device is not usable with NetBSD 6 and current.
> If NetBSD 7 is released, NetBSD 5 support is dropped, and
> I cannot use supported NetBSD/mips on any MIPS hardware.
> In this case, I have spare NetBSD/cobalt machine (Cobalt raq), and
> I can send it to project worker worldwide.
>
> (4) Add OSS4 support to NetBSD
> I want to use newer wine (pkgsrc/emulators/wine). But according to
> pkgsrc/doc/TODO, OSS3 support is dropped and I cannot use newer wine
> anymore.
> Adding OSS4 support makes me happy.
>
> (5) Add XFS support to NetBSD
> I have heard Red Hat Enterprise Linux will use XFS as standard filesystem.
> Accessing Linux's filesystem is useful and important feature.
> At least I am not sticky to BSD licensed version.
> I feel treating like ZFS is good idea.
>
>
http://wiki.netbsd.org/projects/project/xfs/




> (6) Porting Chromium web browser to NetBSD
> I have not tested build of Chromium (open source edition of Google Chrome),
> and I have a few experience about Google Chrome.
> Chromium may be useful web browser for NetBSD.
>
> (7) Apache OpenOffice for NetBSD
> I have completely no idea about Apache OpenOffice.
> It may be one of the most important application.
>
> (8) Porting NetBSD to some FPGA CPU board
> OpenCores' OpenRISC 1200, Xilinx's MicloBlaze, Altera NIOS II is
> available for FPGA board.
> At least OpenRISC 1200 and MicroBlaze have Linux support.
> Supporting these architecture is interesting for NetBSD.
> (I have no idea about NetBSD/nios2 status.)
>
> (9) Add Microsoft's Hyper-V support to NetBSD
> There is two types of Hyper-V, Windows Server 2012's Hyper-V
> and Windows Server 2012R2's Hyper-V.
> I have heard Windows Server 2012's Hyper-V is supported on
> FreeBSD. But I cannot find the code for it.
> Similar to NetBSD/azure?
> http://wiki.netbsd.org/projects/project/netbsd_on_microsoft_azure/
>
> (10) Porting Broadcom's brcmfmac and brcmsmac WiFi driver to NetBSD
> brcmfmac and brcmsmac are ISC licensed Linux driver for Broadcom's
> WiFi adapter.
> My MacBook Air mid 2012 has brcmfmac or brcmsmac device.
> Supporting the device makes me happy.
> Web page is in 500 - Internal Server Error now sadly.
> http://wireless.kernel.org/en/users/Drivers/brcm80211
>
> (11) Improve NetBSD/evbearm support
> As you know, NetBSD/evbearm has some problems.
> http://gnats.netbsd.org/48130 , for Kirkwood
> http://gnats.netbsd.org/48193 and http://gnats.netbsd.org/48215 for
> pkg_add
>
> (14) commit mail of www.pkgsrc.org wiki
> I have heard some difficulties, but I do not know it in detail.
>
> (15) user-editable wiki site
> If wiki.NetBSD.org is not suitable for this purpose.
> Different URL (even non-NetBSD.org domain name) should be considered.
>
> (16) Updating compat_linux
> I cannot run firefox's Linux binary with compat_linux.
>
> (17) DTrace's syscall provider
> I cannot test riz@'s DTrace syscall provider patch.
> But syscall provider support should be added to NetBSD.
>
> (18) Porting valgrind to NetBSD
> I have heard only old version is available.
>
> (19) Support some Linux infrastructure that is used by Gnome
> systemd or other mechanism is used by Gnome related software.
> I do not know much about them, but sometimes I encounter systemd or
> similar mechanism are not found error when creating pkgsrc packages.
> I am discouraged with the error.
>
> (20) Add inotify interface to NetBSD
> Some software that targets Linux use inotify, I have heard
> *BSD has kqueue support and it should be used.
> But implementing Linux compatible inotify with kqueue or similar is useful
> for using some software on NetBSD.
>

http://wiki.netbsd.org/projects/project/kqueue-dirnotify/


>
> (21) Enable Firefox's WebRTC support
> Something is wrong and I cannot enable Firefox's WebRTC support.
> Problem is in SCTP (what is it?) code and lib

Re: netbsd-6.1: squid from pkgsrc-2013-Q2 uses too much CPU time

2013-09-15 Thread matthew sporleder
ktrace is a command, look it up.

also testing dns time was a very good suggestion, as well.


On Sun, Sep 15, 2013 at 7:12 AM, Adrian Immanuel Kieß wrote:

> Dear List, Metthew and Matthias,
>
> I don't know how to trace a application within NetBSD -- and yes it must
> be cache related. After migrating, if I remeber right, I even tried to
> rebuild the cache by hand to check if everything is OK.
>
> I guess it loops around somewhere with wrong OPENDEV command for the
> network interface. My second guess it is busy scanning the HTML file or
> something. I just can guess. :-)
>
> I even added max_filedescriptors 4096 in squid.conf because I've
> stumbled across something with the open file limit in NetBSD already.
> ^_^
>
> As I already noted it worked under Debian.
>
> But under NetBSD 6.1 I now have the high CPU usage.
>
> I attached my squid.conf file.
>
> Adrian Immanuel KIESS
>
> On Sat, 2013-09-14 at 14:24 -0400, matthew sporleder wrote:
> >
> > On Thu, Sep 12, 2013 at 11:22 PM, Adrian Immanuel Kieß
> >  wrote:
> > Dear list,
> >
> > since several months and upgrades I encountered the problem
> > that squid
> > uses too much CPU time under NetBSD 6.1 and my proxy server is
> > nearly to
> > unusable now.
> >
> > I installed the default squid from /usr/pkgsrc/www/squid using
> > pkgsrc-2013-Q2. Every HTTP webpage request lets squid meditate
> > for
> > several seconds until the page is served. The network download
> > itself
> > seems comparatively fast.
> >
> > Maybe someone seen this behavior of squid too and give me a
> > hint? I
> > moved my squid installation from GNU/Debian to this NetBSD box
> > and I
> > remember -- there I did not have this problem with nearly the
> > same
> > configuration.
> >
> > Thank you very much!
> >
> > Sincerely,
> >
> > Adrian Immanuel KIESS
> >
> > --
> > With greetings from Leipzig, Germany.
> > Adrian Immanuel Kieß
> >
> > Administrator & programmer
> > Unix / Perl / LaTeX
> >
> > mail: 
> > www: http://www.kiess.at
> >
> >
> >
> > Have you tried ktrace-ing squid to see what it's doing during these
> > pauses?
> >
> > It sounds like it's probably scanning/writing the cache?
> >
>
> --
> With greetings from Leipzig, Germany.
> Adrian Immanuel Kieß
>
> Administrator & programmer
> Unix / Perl / LaTeX
>
> mail: 
> www: http://www.kiess.at
>


Re: netbsd-6.1: squid from pkgsrc-2013-Q2 uses too much CPU time

2013-09-14 Thread matthew sporleder
On Thu, Sep 12, 2013 at 11:22 PM, Adrian Immanuel Kieß wrote:

> Dear list,
>
> since several months and upgrades I encountered the problem that squid
> uses too much CPU time under NetBSD 6.1 and my proxy server is nearly to
> unusable now.
>
> I installed the default squid from /usr/pkgsrc/www/squid using
> pkgsrc-2013-Q2. Every HTTP webpage request lets squid meditate for
> several seconds until the page is served. The network download itself
> seems comparatively fast.
>
> Maybe someone seen this behavior of squid too and give me a hint? I
> moved my squid installation from GNU/Debian to this NetBSD box and I
> remember -- there I did not have this problem with nearly the same
> configuration.
>
> Thank you very much!
>
> Sincerely,
>
> Adrian Immanuel KIESS
>
> --
> With greetings from Leipzig, Germany.
> Adrian Immanuel Kieß
>
> Administrator & programmer
> Unix / Perl / LaTeX
>
> mail: 
> www: http://www.kiess.at
>


Have you tried ktrace-ing squid to see what it's doing during these pauses?

It sounds like it's probably scanning/writing the cache?


Re: pkgsrc use curl or wget

2013-07-10 Thread matthew sporleder
On Wed, Jul 10, 2013 at 10:04 PM, Victor Aurélio Santos
 wrote:
> Hi,
>
> Is possible make use curl or wget in make ?
>
> fetch is terrible here, it have 2 bugs, first in files larger than 1mb
> it hangs on +/- 99% and ETA say "stalled" I've searched about this and
> apparently this occur when using a proxy, but the problem is that I'm
> behind a transparent proxy (ISP's transparent proxy).
> the second bug is the speed of downloads in fetch, it's speed is half
> of wget or curl.
>
> and finally, I personally prefer curl!


Try FETCH_USING= curl in mk.conf

I know you can use it in individual packages so maybe it will just work.


Re: wpa_cli can't connect with wpa_supplicant

2013-07-06 Thread matthew sporleder
On Sat, Jul 6, 2013 at 9:47 AM, Mayuresh  wrote:
> This is on NetBSD 6.1 i386 using the base wpa_supplicant. (I haven't
> installed pkg wpa_supplicant, though vaguely remember even it gave this
> error.)
>
> Earlier (and I can't figure out before doing WHAT) wpa_cli used to work
> fine for me.
>
>
> Now wpa_cli gives the following error and hangs:
>
> Could not connect to wpa_supplicant - re-trying
>
>
> wpa_supplicant is actually running fine as the encrypted network is
> functioning and "/etc/rc.d/wpa_supplicant status" also shows it running.
>
> How to go about diagnosing this? I used to rely on it to switch the
> wifi network quickly.
>
> Mayuresh


The most common cause of this is wpa_cli not finding the ctrl socket.


Re: Please help Apache Segmentation fault

2013-04-26 Thread matthew sporleder
On Fri, Apr 26, 2013 at 9:08 AM, Mihai Chelaru
 wrote:
>
> Hello,
>
> I am seeing "[notice] child pid 16566 exit signal Segmentation fault (11)"
> in my apache error_log. There is something like 66790 in maybe 1 or 2 days.
> I think this problem is being caused by php. Also, I am getting many core
> dumps from apache. I wonder if this could be causing the issue that I am
> having with sokva. Since the child process does not exit cleanly, could it
> be leaving things in the kernel, eventually filling the kernel's sokva area?
> I now have my kern.somaxkva = 100663296. This is not helping. If I don't
> reboot the system everyday, then all apache processes go into a stat of
> sokva. I am desperate to find a solution!
>
> Thanks,
> Al
>
>
> For Google archiving - happened to me also after a pkgin full-upgrade to
> pkgsrc-2012Q4 binaries on a 6.0 system. pkgin updated apache and apr-util
> but didn't updated apr (version was unchanged). Executing "pkgin -F install
> apr" fixed the problem for me.
>
> --
> Mihai


Can you rebuild with debugging symbols?  It's easier to confirm who is
crashing apache that way.

You might also be able to examine the core files you already have.


Re: About the project's organization

2013-04-14 Thread matthew sporleder
On Sun, Apr 14, 2013 at 6:40 AM, Daniel Ziltener  wrote:
> Hi,
>
> I'm a new user of NetBSD and as that I wanted to share with you what I
> experienced until I got my system running as I wanted.
> First, when I wanted to download it: It was weird. It the folder structure
> seems to somehow depend on the ftp server it's on.
> On most, for the final release, it's kinda direct that one lands on a page 
> with
> all ISO and IMG files; that's fine. But there's that other confusing folder
> structure, especially if one wants to get an RC. It's nowhere described. First
> there is a folder for every architecture with a confusing subfolder structure.
> One might end up in a folder containing a "boot.iso" and a "boot-com.iso" 
> file.
> boot.iso seems to be a boot-only iso getting all stuff from the servers during
> installation; I did not try out the boot-com.iso file. Especially, there's
> nowhere any description about them. But even worse is when one wants the
> actual installation iso file. No, it's not in the architecture folder - it's 
> in
> the hard-to-find "images" folder hidden in the mess of architecture folders.
> That definitely was confusing.
> Unfortunately I had to use one of those RCs since 6.0.1 was unable to detect
> the installation media (usb and cd), which is solved in 6.1-RC2 (a bug that,
> weird enough, also is in FreeBSD 9.1 when booting from usb, but solved in
> CURRENT).
>


I agree with most of this.  I've been using netbsd for 10 years and
still have trouble finding stuff on the website.


> Then, as a second thing, there's your pkgsrc system. It's a nice system like
> the other ports-like systems. BUT: If one, like a newbie does, starts with the
> "NetBSD Guide", there's hardly any information about it to be found. At least
> there should be a link to the official pkgsrc documentation at pkgsrc.org.
> Once again, that's a bad thing especially since BSDs are usually known for
> their good documentation.
>
> If you've read until down here thank you, and thank you to the IRC channel
> people for helping me out so far.
> 
> Daniel Ziltener


There are a few links to docs on pkgsrc.org-
if you click on "docs"

or also "using pkgsrc on NetBSD" from the "Supported platforms" section.

What did you not find on there that you needed?  If it's not already
there, I'll add it.


Re: rss2email - keeps cron instances open on timeout

2013-04-11 Thread matthew sporleder
On Thu, Apr 11, 2013 at 7:20 AM, herbert langhans <
herbert.raim...@langhans.com.pl> wrote:

> On Thu, Apr 11, 2013 at 09:08:19AM +0200, Niels Dettenbach wrote:
> > Am Donnerstag, 11. April 2013, 08:38:07 schrieben Sie:
> > > Is there anything I can do about it? Probably rss2email doesnt exit in
> a
> > > correct way.
> > hmm,
> > did not worked with rss2email byself yet, but can you try to start the
> script
> > from shell and look if rss2email exists properly back to shell when run
> into
> > such a situation?
> > If not, you have to correct rss2email (it seems to be written in Python)
> i.e.
> > by putting a
> >   sys.exit(1)
> > or similiar there where the script seem to "hang" (or ask the rss2email
> devels
> > for it).
> > hth
> > best regards,
> >
> > Niels.
>
> Thanks Niels,
> now I have wait and look for such a timeout-error - just in that case it
> keeps the cron open. Other errors or no error behave correct.
>
> Is there some easy way to make cron and sh show the pid it just has
> opened? So that I can invoke rss2email and know for sure on what
> occasion it keeps the process? With top I just get a list of some more
> 'crons' opened ...
>
> Best
> herb langhans
>
>

Check the cron.log to tie back the cron pids to individual commands.

Do you just see cron open, or are there still rss2email/python procs
hanging around?