Re: Unicode USB strings conversion

2008-11-19 Thread Hans Petter Selasky
On Wednesday 19 November 2008, Nick Hibma wrote:
 In the USB code (and I bet it is the same in the USB4BSD code) unicode
 characters in strings are converted in a very crude way to ASCII. As I have
 a user on the line who sees rubbish in his logs and when using
 usbctl/usbdevs/etc., I bet this is the problem.

 I'd like to try and fix this problem by using libkern/libiconv.

 1) Is this the right approach to convert UTF8 to printable string in  the
 kernel?

 2) Is this needed at all in the short term future? I remember seeing
 attempts at making the kernel use UTF8.

 3) Does anyone know of a good example in the code without me having to hunt
 through the kernel to find it?

 For reference: The code that needs replacing is:

 usbd_get_string():

 s = buf;
 n = size / 2 - 1;
 for (i = 0; i  n  i  len - 1; i++) {
 c = UGETW(us.bString[i]);
 /* Convert from Unicode, handle buggy strings. */
 if ((c  0xff00) == 0)
 *s++ = c;
 else if ((c  0x00ff) == 0  swap)
 *s++ = c  8;
 else
 *s++ = '?';
 }
 *s++ = 0;

 I haven't got the USB specs handy, but I believe that this is a simple way
 of converting LE and BE UTF8 to ASCII.

Or you could try to search for a better language ID. Currently the USB stack 
(old and new) selects the first language ID in the language string. Probably 
there is an english language ID, but not as the first selection.

--HPS
___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Unicode USB strings conversion

2008-11-19 Thread Nick Hibma
 Or you could try to search for a better language ID. Currently the USB
 stack (old and new) selects the first language ID in the language string.
 Probably there is an english language ID, but not as the first selection.

The first part of the string is correct, so I assume that they added some 
strange characters (like copyright) at the end. Besides, even in the 
English character set there might be strange characters, for example 
scandinavian characters in names.

Nick
___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: cosum: Checkout verification PoC

2008-11-19 Thread Vadim Goncharov
Hi Max Laier! 

On Mon, 22 Sep 2008 22:33:25 +0200; Max Laier wrote about 'cosum: Checkout 
verification PoC':

 the attached script will generate md5 and sha256 checksums of a checkout and 
 try to find the corresponding svn-revision.  This can help to verify that 
 your 
 checkout from cvsupX.yy.freebsd.org is authentic.  Not that there is reason 
 to 
 believe that we have compromised cvsup-servers.  This is just something I've 
 been toying with and wanted to let you know to see if people find the idea 
 interesting.  I'd also be interested in reviews of the concept (note that I 
 know that https would be a good idea, I just cba to setup a certificate).

 The coverage currently is head and stable/{6,7} svn revision 179451:183186 
 (i.e. since the first svn commit up to 2008-09-19 16:51:41 +0200.  I don't 
 yet have a cronjob in place to generate new checksums, so this will become 
 less useful quick.  If people do find it interesting, however, I could 
 certainly roll something.

 As you can see, the script is ready to checksum cvs and svn checkouts.  If 
 you 
 obtain your checkout from some local git/hg/svk/... mirror you must modify 
 the 
 find excludes accordingly.

 Let me know what you think.

This is a good solution for our users caring about security. I think such
definitely should be incorporated into base system and server-side support be
provided at freebsd.org on official basis.

-- 
WBR, Vadim Goncharov. ICQ#166852181   mailto:[EMAIL PROTECTED]
[Moderator of RU.ANTI-ECOLOGY][FreeBSD][http://antigreen.org][LJ:/nuclight]

___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: [Testers wanted] /dev/console cleanups

2008-11-19 Thread Carlos A. M. dos Santos
On Tue, Nov 18, 2008 at 7:34 PM, Ed Schouten [EMAIL PROTECTED] wrote:
 Hello Carlos, others,

 * Ed Schouten [EMAIL PROTECTED] wrote:
 About the /dev/console issues: Robert Watson and I discussed this some
 time ago on IRC and what I did in HEAD (not RELENG_7) was that I changed
 TIOCCONS not to take a look at the permissions of /dev/console, but we
 changed it to use priv_check(). This means that right now you can only
 call TIOCCONS as root. I can't really understand why the problem exists
 on RELENG_7.

 About making xconsole setuid: I've read the messages you mentioned, but
 I think we could just alter console to call TIOCCONS and just drop
 privileges. An even better solution would be to just get rid of TIOCCONS
 and invent a better solution to capture syslog messages. I can't really
 understand why we want to abuse TTY's to do this.

 So I can't say we're working on this, but at least I can confirm the
 issue.

 One solution would be to let xconsole just display /var/log/messages.
 There shouldn't be a valid reason to let syslogd print messages to
 /dev/console and capture them again using TIOCCONS. We could just
 instruct xconsole to read its data from the log files.

 If you save the attached patch as /usr/ports/x11/xconsole/files/
 patch-xconsole.c (create directory first) and recompile xconsole, it
 will use the log file.

 I'll discuss this with others to decide if we should take such an
 approach.

It is not necessary to patch xconsole to accomplish this. Using the
-file command line argument would be enough. Be warned, however, that

1. messages sent straight to /dev/console will not show up at the
xconsole window;

2. with large files it will become slow and consume lots of memory,
because it will load the entire contents of /mar/log/messages to its
text buffer;

3. it will show *all* messages, not only the urgent ones, which is not
necessarily the desired behavior;

4. it will stop working upon log rotation.

-- 
cd /usr/ports/sysutils/life
make clean
___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Core i7 anyone else?

2008-11-19 Thread Jeremy Chadwick
On Wed, Nov 19, 2008 at 08:44:03PM +0900, Takanori Watanabe wrote:
 Hi, I recently bought Core i7 machine(for 145,000JPY: about $1500)
 and sometimes hangs up oddly.
 When in the state, some specific process only works and 
 replys ping, but not reply any useful information.
 
 I suspect it may caused by CPU power management, so I cut 
 almost all CPU power management feature on BIOS parameter.
 
 Are there any people encouterd such trouble?
 And on this machine build world in SCHED_ULE(15min.) is slower 
 than SCHED_4BSD(12min.).
 
 
 ===dmesg===
 http://www.init-main.com/corei7.dmesg
 or
 http://pastebin.com/m187f77aa
 (if host is down)
 
 =DSDT
 http://www.init-main.com/corei7.asl
 or
 http://pastebin.com/m6879984a
 
 ==some sysctls==
 hw.machine: i386
 hw.model: Intel(R) Core(TM) i7 CPU 920  @ 2.67GHz
 hw.ncpu: 8
 hw.byteorder: 1234
 hw.physmem: 3202322432
 hw.usermem: 2956083200
 hw.pagesize: 4096
 hw.floatingpoint: 1
 hw.machine_arch: i386
 hw.realmem: 3211264000
 ==
 machdep.enable_panic_key: 0
 machdep.adjkerntz: -32400
 machdep.wall_cmos_clock: 1
 machdep.disable_rtc_set: 0
 machdep.disable_mtrrs: 0
 machdep.guessed_bootdev: 2686451712
 machdep.idle: acpi
 machdep.idle_available: spin, mwait, mwait_hlt, hlt, acpi, 
 machdep.hlt_cpus: 0
 machdep.prot_fault_translation: 0
 machdep.panic_on_nmi: 1
 machdep.kdb_on_nmi: 1
 machdep.tsc_freq: 2684011396
 machdep.i8254_freq: 1193182
 machdep.acpi_timer_freq: 3579545
 machdep.acpi_root: 1024240
 machdep.hlt_logical_cpus: 0
 machdep.logical_cpus_mask: 254
 machdep.hyperthreading_allowed: 1
 ==
 kern.sched.preemption: 0
 kern.sched.topology_spec: groups
  group level=1 cache-level=0
   cpu count=8 mask=0xff0, 1, 2, 3, 4, 5, 6, 7/cpu
   flags/flags
  /group
 /groups
 
 kern.sched.steal_thresh: 3
 kern.sched.steal_idle: 1
 kern.sched.steal_htt: 1
 kern.sched.balance_interval: 133
 kern.sched.balance: 1
 kern.sched.affinity: 1
 kern.sched.idlespinthresh: 4
 kern.sched.idlespins: 1
 kern.sched.static_boost: 160
 kern.sched.preempt_thresh: 0
 kern.sched.interact: 30
 kern.sched.slice: 13
 kern.sched.name: ULE
 ===

When building world/kernel, do you see odd behaviour (on CURRENT) such
as the load average being absurdly high, or processes (anything; sh,
make, mutt, etc.) getting stuck in bizarre states?  These things are
what caused my buildworld/buildkernel times to increase (compared to
RELENG_7).  I was using ULE entirely (on CURRENT and RELENG_7), but
did not try 4BSD.  I documented my experience.

http://wiki.freebsd.org/JeremyChadwick/Bizarre_CURRENT_experience

I have no idea if your problem is the same as mine.  This is purely
speculative on my part.  (And readers of that Wiki article should
note that the problem was not hardware-related)

-- 
| Jeremy Chadwickjdc at parodius.com |
| Parodius Networking   http://www.parodius.com/ |
| UNIX Systems Administrator  Mountain View, CA, USA |
| Making life hard for others since 1977.  PGP: 4BD6C0CB |

___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: [Testers wanted] /dev/console cleanups

2008-11-19 Thread Jeremy Chadwick
On Wed, Nov 19, 2008 at 02:02:42AM -0800, Garrett Cooper wrote:
 On Tue, Nov 18, 2008 at 1:49 PM, David Wolfskill [EMAIL PROTECTED] wrote:
  On Tue, Nov 18, 2008 at 10:34:10PM +0100, Ed Schouten wrote:
  ...
  One solution would be to let xconsole just display /var/log/messages.
 
  Errr... it may be rather a pathological case, but you might want to
  check the content of /etc/syslog.conf on the local machine before
  getting too carried away with that approach.
 
  For example, on my firewall box at home (where I really do not want to
  log anything to local disk files, though I do have a serial console on it):
 
  janus(6.4-P)[1] grep -v '^#' /etc/syslog.conf
  *.* @bunrab.catwhisker.org
  janus(6.4-P)[2]
 
  And then consider the fate of bunrab -- with stuff getting logged to
  /var/log/messages from various machines
 
  ...
  I'll discuss this with others to decide if we should take such an
  approach.
 
  I'm not trying to be obstructionist, here.  If the above case is really
  too pathological to consider -- or if it's a case of me bringing that
  fate upon myself, I suppose -- that's actually something I can live
  with.  It would be nice to be forwarned about it, though.  :-}
 
  Peace,
  david
 
 Uh, I second that. /var/log/messages shouldn't necessarily be
 accessible by non-root users. Also, OSX 10.5 protects against non-root
 access to dmesg. Not saying we should go that far, but it's already
 being implemented, so I don't see any harm in hiding the contents of
 `messages', as required by the sysadmin.

Footnote (not really applicable to the thread, but I want to point it
out to users/admins reading): inhibiting users viewing the kernel
message buffer (dmesg) can be accomplished by setting the
security.bsd.unprivileged_read_msgbuf sysctl to 0.

However, note that this can piss users off.  We have numerous users
on our system who rely on this information to see if anything weird is
going on with the box.  I set that sysctl one day (see below for why),
and I got flames in my mailbox within 48 hours.  Just something to keep
in mind if you have technically-savvy users.

There's a known issue with the kernel message buffer though: it's not
NULL'd out upon reboot.  Meaning, in some cases (depends on the BIOS or
system), the kernel message buffer from single-user mode is retained
even after a reboot!  A user can then do dmesg and see all the nifty
stuff you've done during single-user, which could include unencrypted
passwords if mergemaster was tinkering with passwd/master.passwd, etc..
I've brought this up before, and people said Yeah, we know, moving on.
Rink Springer created a patch where the kernel message buffer will start
with NULL to keep this from happening, but it needs to be made into a
loader.conf tunable.

Also, /var/log/messages is explicitly set to 0644 in newsyslog.conf.  If
people want to debate that, be my guest.  I'm not sure what security
hole we'd be plugging if it was set to 0600, especially given that many
userland programs use the LOG_NOTICE facility in syslog.  If people want
to debate those default perms, be my guest.  I would rather people
debate the default syslog.conf layout altogether; I'm surprised we
haven't moved to syslog-ng (as part of the base system) by now.  :-)

-- 
| Jeremy Chadwickjdc at parodius.com |
| Parodius Networking   http://www.parodius.com/ |
| UNIX Systems Administrator  Mountain View, CA, USA |
| Making life hard for others since 1977.  PGP: 4BD6C0CB |

___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Core i7 anyone else?

2008-11-19 Thread Takanori Watanabe
Hi, I recently bought Core i7 machine(for 145,000JPY: about $1500)
and sometimes hangs up oddly.
When in the state, some specific process only works and 
replys ping, but not reply any useful information.

I suspect it may caused by CPU power management, so I cut 
almost all CPU power management feature on BIOS parameter.

Are there any people encouterd such trouble?
And on this machine build world in SCHED_ULE(15min.) is slower 
than SCHED_4BSD(12min.).


===dmesg===
http://www.init-main.com/corei7.dmesg
or
http://pastebin.com/m187f77aa
(if host is down)

=DSDT
http://www.init-main.com/corei7.asl
or
http://pastebin.com/m6879984a

==some sysctls==
hw.machine: i386
hw.model: Intel(R) Core(TM) i7 CPU 920  @ 2.67GHz
hw.ncpu: 8
hw.byteorder: 1234
hw.physmem: 3202322432
hw.usermem: 2956083200
hw.pagesize: 4096
hw.floatingpoint: 1
hw.machine_arch: i386
hw.realmem: 3211264000
==
machdep.enable_panic_key: 0
machdep.adjkerntz: -32400
machdep.wall_cmos_clock: 1
machdep.disable_rtc_set: 0
machdep.disable_mtrrs: 0
machdep.guessed_bootdev: 2686451712
machdep.idle: acpi
machdep.idle_available: spin, mwait, mwait_hlt, hlt, acpi, 
machdep.hlt_cpus: 0
machdep.prot_fault_translation: 0
machdep.panic_on_nmi: 1
machdep.kdb_on_nmi: 1
machdep.tsc_freq: 2684011396
machdep.i8254_freq: 1193182
machdep.acpi_timer_freq: 3579545
machdep.acpi_root: 1024240
machdep.hlt_logical_cpus: 0
machdep.logical_cpus_mask: 254
machdep.hyperthreading_allowed: 1
==
kern.sched.preemption: 0
kern.sched.topology_spec: groups
 group level=1 cache-level=0
  cpu count=8 mask=0xff0, 1, 2, 3, 4, 5, 6, 7/cpu
  flags/flags
 /group
/groups

kern.sched.steal_thresh: 3
kern.sched.steal_idle: 1
kern.sched.steal_htt: 1
kern.sched.balance_interval: 133
kern.sched.balance: 1
kern.sched.affinity: 1
kern.sched.idlespinthresh: 4
kern.sched.idlespins: 1
kern.sched.static_boost: 160
kern.sched.preempt_thresh: 0
kern.sched.interact: 30
kern.sched.slice: 13
kern.sched.name: ULE
===
___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: [Testers wanted] /dev/console cleanups

2008-11-19 Thread Garrett Cooper
On Tue, Nov 18, 2008 at 1:49 PM, David Wolfskill [EMAIL PROTECTED] wrote:
 On Tue, Nov 18, 2008 at 10:34:10PM +0100, Ed Schouten wrote:
 ...
 One solution would be to let xconsole just display /var/log/messages.

 Errr... it may be rather a pathological case, but you might want to
 check the content of /etc/syslog.conf on the local machine before
 getting too carried away with that approach.

 For example, on my firewall box at home (where I really do not want to
 log anything to local disk files, though I do have a serial console on it):

 janus(6.4-P)[1] grep -v '^#' /etc/syslog.conf
 *.* @bunrab.catwhisker.org
 janus(6.4-P)[2]

 And then consider the fate of bunrab -- with stuff getting logged to
 /var/log/messages from various machines

 ...
 I'll discuss this with others to decide if we should take such an
 approach.

 I'm not trying to be obstructionist, here.  If the above case is really
 too pathological to consider -- or if it's a case of me bringing that
 fate upon myself, I suppose -- that's actually something I can live
 with.  It would be nice to be forwarned about it, though.  :-}

 Peace,
 david

Uh, I second that. /var/log/messages shouldn't necessarily be
accessible by non-root users. Also, OSX 10.5 protects against non-root
access to dmesg. Not saying we should go that far, but it's already
being implemented, so I don't see any harm in hiding the contents of
`messages', as required by the sysadmin.
-Garrett
___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Core i7 anyone else?

2008-11-19 Thread Ivan Voras
Takanori Watanabe wrote:
 Hi, I recently bought Core i7 machine(for 145,000JPY: about $1500)
 and sometimes hangs up oddly.
 When in the state, some specific process only works and 
 replys ping, but not reply any useful information.
 
 I suspect it may caused by CPU power management, so I cut 
 almost all CPU power management feature on BIOS parameter.
 
 Are there any people encouterd such trouble?
 And on this machine build world in SCHED_ULE(15min.) is slower 
 than SCHED_4BSD(12min.).


I don't know but this:

 ===dmesg===
 http://www.init-main.com/corei7.dmesg
 or
 http://pastebin.com/m187f77aa
 (if host is down)

CPU: Intel(R) Core(TM) i7 CPU 920  @ 2.67GHz (2684.00-MHz
686-class CPU)
  Origin = GenuineIntel  Id = 0x106a4  Stepping = 4

Features=0xbfebfbffFPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE

Features2=0x98e3bdSSE3,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,POPCNT
  AMD Features=0x2810NX,RDTSCP,LM
  AMD Features2=0x1LAHF
  Cores per package: 8
  Logical CPUs per core: 2
real memory  = 3211264000 (3062 MB)
avail memory = 3143983104 (2998 MB)
ACPI APIC Table: 7522MS A7522100
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
 cpu2 (AP): APIC ID:  2
 cpu3 (AP): APIC ID:  3
 cpu4 (AP): APIC ID:  4
 cpu5 (AP): APIC ID:  5
 cpu6 (AP): APIC ID:  6
 cpu7 (AP): APIC ID:  7

is a bit in conflict with this:

 kern.sched.topology_spec: groups
  group level=1 cache-level=0
   cpu count=8 mask=0xff0, 1, 2, 3, 4, 5, 6, 7/cpu
   flags/flags
  /group
 /groups

From what I know of its architecture i7 has hyperthreading - i.e. the
CPU has 4 real cores which are hyperthreaded, so you get 8 cores
total. It probably also includes a different way of enumerating its
topology which might have caused wrong topology detection and your
slowdown in buildworld. (the CPU also has L3 cache, but I think it's not
looked up in topology detection).

I don't know it this particular error could be responsible for your
lockups - probably not. The CPU also introduces some big changes in
power management (dynamic powerdown of individual cores) which could
cause them - but I can't help you there.

Are you sure it's not something trivial like overheating?



signature.asc
Description: OpenPGP digital signature


Re: ide with DMA and ram 4GB

2008-11-19 Thread Marc Lörner
On Thursday 13 November 2008 21:02, John Baldwin wrote:
 On Wednesday 12 November 2008 12:23:14 pm Marc Lörner wrote:
  Hello,
  I just stepped over a problem with my IDE disk running in DMA-mode
  and having more than 4GB of RAM.
  It seems that the whole way down GEOM, ata-disk, ata-dma never is checked
  whether physical address of buffer is less than 4GB an so fits in 32bits.
  = when PRD is set the address is rigorously truncated to fit into 32bit,
 with buffer  4GB all is quite fine.

 bus_dmamap_load() in ata-dma.c should result in bounce pages being
 allocated and having the data copied to pages below 4GB and having those
 addresses passed to the callback and stored in the PRD.

Thanks for pointing this out!

So it seems that bounce-pages are counted with helper-function run_filter.
But this function does never return 1 with dma-pages not lying in range (e.g. 
paddr  4GB) but being aligned. 

Did nobody else have problems on 64bit ide-dma, or is it already working, but 
I didn't grasp functionality, yet?

For now, I came around this by adding a flag in /sys/bus_dma.h and setting 
this flag on tag-creation. So I now can check in run_filter whether I'm doing 
an ide-dma, relying on this and on check whether I got paddr  4GB, I then 
can tell bus_dmamap_load to use bounce-pages.

Any thoughts or comments?

Regards,
Marc Loerner
___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


RE: What are proper install.cfg for configuring multiple slices?

2008-11-19 Thread Peter Steele
I want to do an automated sysinstall through an install.cfg script and
the script partition the install disk into three slices. I've been
going
through various tests trying to figure out what the proper directives
are but I haven't had much luck, and I can't find any good examples.

After a lot of experimenting, my impression is that sysinstall simply
doesn't support multiple slice installations. It works to a point, but I
get some unexpected errors, e.g.

Unable to make device node for /dev/ad0s1a in /dev

and after the partitioning is complete, there are funky entries under
/dev:

/dev/ad0c
/dev/ad0cs1
/dev/ad0cs2
/dev/ad0cs3
/dev/ad0s1
/dev/ad0s2
/dev/ad0s3

There should be entries such as /dev/ad0s1a and so on, but these do not
get created. I've been unable to find even one example of how to
formulate multiple partitions in install.cfg, but I'm pretty sure I'm
doing it right, based on the sysinstall docs. Does anyone have any
experience with this?

___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Reccomendation for tools to use on FreeBSD for a wiki ?

2008-11-19 Thread Julian Stacey
Hi hackers,
Maybe Some of you might suggest some software I might install, Wiki I guess. ?
I got zero response from ports@,  I could use some reccomendations please.
PS From http://wiki.freebsd.org/HelpContents I tried 
cd /usr/ports/www ; vi *iki*/pkg-descr
or is /usr/ports/www/moinmoin  the way to go ?
Thanks.
---

Subject: Reccomendation for ports for web based club events forthcoming diary ?

Can anyone reccomend some ports to install on a FreeBSD web server,
for a club of mostly non technical people, to support:
  - All club members can add events to a forthcoming calendar,
  - All club members can request server to prepare a listing 
of next next upcoming events, to download (probably in PDF,
or perhaps tbl to a pipe or ?
  - A list of moderators can delete fake events from robots  the malicious.
  - Preferably moderators should not themselves be capable of
deleting logged event submission, but only capable of deleting
events formatted to the ouput printable programme sheet. (To
autopsy for suspect rogue moderators)
  - I guess first entry criteria might be a fuzzy picture for human
to decode password from). 2nd might be mail return for confirm password,
  -  3rd, A majordomo (later mailman) maintained list of club members  
moderators etc is available for automated validation.
  - I hope there will be some packages available,
http  probably wiki based etc, that will come close enough ?
I'm hoping this has been done often enough that people can suggest
names of ports already existing ? If not I dont mind creating a
port if I have to, but dont want to write something from scratch.

PS
- - I've had apache up for years, but no wiki yet, so if any tips,
  shout please, even if just RTFM URL= :-)
- - Web based forums I don't care about, but others may, so I suppose if some
  software does  does not support web forums, it'd be good to know.

Suggestions welcome please ! Thanks in advance.

Cheers,
Julian
- --
Julian Stacey: BSDUnixLinux C Prog Admin SysEng Consult Munich www.berklix.com
  Mail plain ASCII text.  HTML  Base64 text are spam. www.asciiribbon.org
___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Reccomendation for tools to use on FreeBSD for a wiki ?

2008-11-19 Thread Garrett Cooper
On Wed, Nov 19, 2008 at 9:24 AM, Julian Stacey [EMAIL PROTECTED] wrote:
 Hi hackers,
 Maybe Some of you might suggest some software I might install, Wiki I guess. ?
 I got zero response from ports@,  I could use some reccomendations please.
 PS From http://wiki.freebsd.org/HelpContents I tried
cd /usr/ports/www ; vi *iki*/pkg-descr
or is /usr/ports/www/moinmoin  the way to go ?
 Thanks.
 ---

 Subject: Reccomendation for ports for web based club events forthcoming diary 
 ?

 Can anyone reccomend some ports to install on a FreeBSD web server,
 for a club of mostly non technical people, to support:
  - All club members can add events to a forthcoming calendar,
  - All club members can request server to prepare a listing
of next next upcoming events, to download (probably in PDF,
or perhaps tbl to a pipe or ?
  - A list of moderators can delete fake events from robots  the malicious.
  - Preferably moderators should not themselves be capable of
deleting logged event submission, but only capable of deleting
events formatted to the ouput printable programme sheet. (To
autopsy for suspect rogue moderators)
  - I guess first entry criteria might be a fuzzy picture for human
to decode password from). 2nd might be mail return for confirm password,
  -  3rd, A majordomo (later mailman) maintained list of club members 
moderators etc is available for automated validation.
  - I hope there will be some packages available,
http  probably wiki based etc, that will come close enough ?
 I'm hoping this has been done often enough that people can suggest
 names of ports already existing ? If not I dont mind creating a
 port if I have to, but dont want to write something from scratch.

 PS
 - - I've had apache up for years, but no wiki yet, so if any tips,
  shout please, even if just RTFM URL= :-)
 - - Web based forums I don't care about, but others may, so I suppose if some
  software does  does not support web forums, it'd be good to know.

 Suggestions welcome please ! Thanks in advance.

 Cheers,
 Julian

Julian,
 FWIW, ports@ or questions@ would be better lists than [EMAIL PROTECTED]
Thanks,
-Garrett
___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Reccomendation for tools to use on FreeBSD for a wiki ?

2008-11-19 Thread Jeremy Chadwick
On Wed, Nov 19, 2008 at 10:08:03AM -0800, Garrett Cooper wrote:
 On Wed, Nov 19, 2008 at 9:24 AM, Julian Stacey [EMAIL PROTECTED] wrote:
  Hi hackers,
  Maybe Some of you might suggest some software I might install, Wiki I 
  guess. ?
  I got zero response from ports@,  I could use some reccomendations please.
  PS From http://wiki.freebsd.org/HelpContents I tried
 cd /usr/ports/www ; vi *iki*/pkg-descr
 or is /usr/ports/www/moinmoin  the way to go ?
  Thanks.
  ---
 
  Subject: Reccomendation for ports for web based club events forthcoming 
  diary ?
 
  Can anyone reccomend some ports to install on a FreeBSD web server,
  for a club of mostly non technical people, to support:
   - All club members can add events to a forthcoming calendar,
   - All club members can request server to prepare a listing
 of next next upcoming events, to download (probably in PDF,
 or perhaps tbl to a pipe or ?
   - A list of moderators can delete fake events from robots  the malicious.
   - Preferably moderators should not themselves be capable of
 deleting logged event submission, but only capable of deleting
 events formatted to the ouput printable programme sheet. (To
 autopsy for suspect rogue moderators)
   - I guess first entry criteria might be a fuzzy picture for human
 to decode password from). 2nd might be mail return for confirm password,
   -  3rd, A majordomo (later mailman) maintained list of club members 
 moderators etc is available for automated validation.
   - I hope there will be some packages available,
 http  probably wiki based etc, that will come close enough ?
  I'm hoping this has been done often enough that people can suggest
  names of ports already existing ? If not I dont mind creating a
  port if I have to, but dont want to write something from scratch.
 
  PS
  - - I've had apache up for years, but no wiki yet, so if any tips,
   shout please, even if just RTFM URL= :-)
  - - Web based forums I don't care about, but others may, so I suppose if 
  some
   software does  does not support web forums, it'd be good to know.
 
  Suggestions welcome please ! Thanks in advance.
 
  Cheers,
  Julian
 
 Julian,
  FWIW, ports@ or questions@ would be better lists than [EMAIL PROTECTED]

He asked this on -ports only 2 days ago and received no response.  So he
appears to be going from list to list hoping someone will answer him.

-- 
| Jeremy Chadwickjdc at parodius.com |
| Parodius Networking   http://www.parodius.com/ |
| UNIX Systems Administrator  Mountain View, CA, USA |
| Making life hard for others since 1977.  PGP: 4BD6C0CB |

___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Reccomendation for tools to use on FreeBSD for a wiki ?

2008-11-19 Thread L Campbell
On Wed, Nov 19, 2008 at 12:24 PM, Julian Stacey [EMAIL PROTECTED] wrote:

 Hi hackers,
 Maybe Some of you might suggest some software I might install, Wiki I guess. ?
 I got zero response from ports@,  I could use some reccomendations please.

 - - I've had apache up for years, but no wiki yet, so if any tips,
  shout please, even if just RTFM URL= :-)

http://en.wikipedia.org/wiki/List_of_wiki_software
http://en.wikipedia.org/wiki/Comparison_of_wiki_software
___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Reccomendation for tools to use on FreeBSD for a wiki ?

2008-11-19 Thread Julian Stacey
  - - I've had apache up for years, but no wiki yet, so if any tips,
   shout please, even if just RTFM URL= :-)
 
 http://en.wikipedia.org/wiki/List_of_wiki_software
 http://en.wikipedia.org/wiki/Comparison_of_wiki_software

Great ! Thanks a lot !

Cheers,
Julian
-- 
Julian Stacey: BSDUnixLinux C Prog Admin SysEng Consult Munich www.berklix.com
  Mail plain ASCII text.  HTML  Base64 text are spam. www.asciiribbon.org
___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


build problems with gptzfsboot (AMD64) 8.0-CURRENT

2008-11-19 Thread Pegasus Mc Cleaft
Hi everyone, 

I am having difficulties rebuilding the world after some patches were made 
today. I was wondering if anyone else is experiencing the same troubles?

ld -static -N --gc-sections -nostdlib -m elf_i386_fbsd -Ttext 0x0 -o 
gptzfsboot.out /usr/obj/usr/src/sys/boot/i386/gptzfsboot/../btx/lib/crt0.o 
zfsboot.o sio.o gptzfsboot.o
ld: gptzfsboot.o: No such file: No such file or directory
*** Error code 1

Stop in /usr/src/sys/boot/i386/gptzfsboot.
*** Error code 1

Stop in /usr/src/sys/boot/i386.
*** Error code 1

Stop in /usr/src/sys/boot.
*** Error code 1

Stop in /usr/src/sys.
*** Error code 1

Stop in /usr/src.
*** Error code 1

Stop in /usr/src.
*** Error code 1

Stop in /usr/src.
feathers#
___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: [Testers wanted] /dev/console cleanups

2008-11-19 Thread Peter Jeremy
On 2008-Nov-19 02:47:31 -0800, Jeremy Chadwick [EMAIL PROTECTED] wrote:
There's a known issue with the kernel message buffer though: it's not
NULL'd out upon reboot.

This is deliberate.  If the system panics, stuff that was in the
message buffer (and might not be on disk) can be read when the system
reboots.  If there is no crashdump, this might be the only record of
what happened.

  Meaning, in some cases (depends on the BIOS or
system), the kernel message buffer from single-user mode is retained
even after a reboot!  A user can then do dmesg and see all the nifty
stuff you've done during single-user, which could include unencrypted
passwords if mergemaster was tinkering with passwd/master.passwd, etc..

There shouldn't be unencrypted passwords, though there might be encrypted
passwords visible.

Rink Springer created a patch where the kernel message buffer will start
with NULL to keep this from happening, but it needs to be made into a
loader.conf tunable.

I hope that never gets committed - it will make debugging kernel
problems much harder.  There is already a kern.msgbuf_clear sysctl and
maybe people who are concerned about msgbuf leakage need to learn to
use it.

-- 
Peter Jeremy
Please excuse any delays as the result of my ISP's inability to implement
an MTA that is either RFC2821-compliant or matches their claimed behaviour.


pgp13Q2HNhDcL.pgp
Description: PGP signature


Re: [Testers wanted] /dev/console cleanups

2008-11-19 Thread Jeremy Chadwick
On Thu, Nov 20, 2008 at 05:39:36PM +1100, Peter Jeremy wrote:
 On 2008-Nov-19 02:47:31 -0800, Jeremy Chadwick [EMAIL PROTECTED] wrote:
 There's a known issue with the kernel message buffer though: it's not
 NULL'd out upon reboot.
 
 This is deliberate.  If the system panics, stuff that was in the
 message buffer (and might not be on disk) can be read when the system
 reboots.  If there is no crashdump, this might be the only record of
 what happened.

That doesn't sound deliberate at all -- it sounds like a quirk that
people (you?) are relying on.  I do not think any piece of the FreeBSD
system (e.g. savecore, etc.) relies on this behaviour.

You're under the mentality that the information is *always* available
after a panic/reboot -- it isn't.  I have 4 different Supermicro
motherboards (all from different years) which will most of the time
lose the msgbuf after rebooting from single-user -- but sometimes the
msgbuf is retained.  And no, bad hardware is not responsible for the
randomness of the problem.

I think it's been discussed in the past how/why this can happen.  It has
to do with what each BIOS manufacturer chooses to do with some parts of
memory during start-up.  I'm sure the Quick Boot (e.g. no extensive
memory test, which really doesn't test anything these days) option plays
a role, and that option is enabled by default on all motherboards I've
used in the past 10 years.

   Meaning, in some cases (depends on the BIOS or
 system), the kernel message buffer from single-user mode is retained
 even after a reboot!  A user can then do dmesg and see all the nifty
 stuff you've done during single-user, which could include unencrypted
 passwords if mergemaster was tinkering with passwd/master.passwd, etc..
 
 There shouldn't be unencrypted passwords, though there might be encrypted
 passwords visible.

Sorry, that's what I meant.

The point is that a lot of things can go on in single-user mode which
can/will disclose information or data in files which users do not have
access to.  Once the system is rebooted, a non-root user can do dmesg
-a and see this buffer, getting access to data he/she normally does not
have access to.

Do you and I agree that this is in fact a security risk/problem?

 Rink Springer created a patch where the kernel message buffer will start
 with NULL to keep this from happening, but it needs to be made into a
 loader.conf tunable.
 
 I hope that never gets committed - it will make debugging kernel
 problems much harder.  There is already a kern.msgbuf_clear sysctl and
 maybe people who are concerned about msgbuf leakage need to learn to
 use it.

And this sysctl is only usable *after* the kernel loads, which means
you lose all of the messages shown from the time the kernel loads to
the time the sysctl is set (e.g. hardware detected/configured).  This is
even less acceptable, IMHO.

I would like to see Rink's patch committed, as long as the loader
tunable defaults to *off* (e.g. current/historic behaviour).  I'll also
ask Rink to chime in here with his thoughts/opinions.

-- 
| Jeremy Chadwickjdc at parodius.com |
| Parodius Networking   http://www.parodius.com/ |
| UNIX Systems Administrator  Mountain View, CA, USA |
| Making life hard for others since 1977.  PGP: 4BD6C0CB |

___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Unicode USB strings conversion

2008-11-19 Thread Tim Kientzle

Nick Hibma wrote:
In the USB code (and I bet it is the same in the USB4BSD code) unicode 
characters in strings are converted in a very crude way to ASCII. As I have 
a user on the line who sees rubbish in his logs and when using 
usbctl/usbdevs/etc., I bet this is the problem.


I'd like to try and fix this problem by using libkern/libiconv.

1) Is this the right approach to convert UTF8 to printable string in  the 
kernel?


2) Is this needed at all in the short term future? I remember seeing 
attempts at making the kernel use UTF8.


3) Does anyone know of a good example in the code without me having to hunt 
through the kernel to find it?


For reference: The code that needs replacing is:

usbd_get_string():

s = buf;
n = size / 2 - 1;
for (i = 0; i  n  i  len - 1; i++) {
c = UGETW(us.bString[i]);
/* Convert from Unicode, handle buggy strings. */
if ((c  0xff00) == 0)
*s++ = c;
else if ((c  0x00ff) == 0  swap)
*s++ = c  8;
else
*s++ = '?';
}
*s++ = 0;

I haven't got the USB specs handy, but I believe that this is a simple way 
of converting LE and BE UTF8 to ASCII.


First, get your terminology straight.  It looks
like UGETW() is returning 16-bit Unicode code points.
That would be UTF-16, not UTF-8.  UTF-8 is a popular
multibyte encoding which uses 1 to 4 bytes per character.
ASCII values (less than 128) get preserved, anything else
gets encoded.

There are two problems with UTF-16:  First is determining
the byte order.  Second is that nobody displays UTF-16
directly.  (Well, almost nobody.)

The code above is fine if you're sure you're getting ASCII
(it looks at each character and guesses the byte order)
but is otherwise pretty lame.  You didn't show the code
that set the 'swap' variable.

If you really want legible output, your best option by
far is to really convert it to UTF8 and emit that.  That
still preserves ASCII, but gives a chance of viewing
non-ASCII in a suitable terminal program.  (And there
are even a couple of folks looking into UTF8 support for
syscons.)

rolling up sleeves  The basic UTF-16 to UTF-8
conversion is pretty simple:

 if (c  0x7f) { *s++ = c; }
 else if (c  0x7ff) {
*s++ = 0xc0 | ((c  6)  0x1f);
*s++ = 0x80 | (c  0x3f);
 } else if (c  0x) {
*s++ = 0xe0 | ((c  12)  0x0f);
*s++ = 0x80 | ((c  6)  0x3f);
*s++ = 0x80 | (c  0x3f);
 } else {
*s++ = 0xf0 | ((c  18)  0x07);
*s++ = 0x80 | ((c  12)  0x3f);
*s++ = 0x80 | ((c  6)  0x3f);
*s++ = 0x80 | (c  0x3f);
 }

This assumes that 'c' is a UTF-16 Unicode character
in native byte order.  If you really don't know the
byte order, you'll need to find some way to guess.

One way to guess is to assume that ASCII characters
are common, in which case, you'll see things with the
high order byte 0.  In some environments, a Byte-order mark
is used as the first character.  This is character 0xFEFF.
(The byte-swapped 0xFFFE is illegal, so if you see that,
you know you've got the wrong byte order.)

Good luck!

Tim

___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: [Testers wanted] /dev/console cleanups

2008-11-19 Thread Nate Eldredge

On Wed, 19 Nov 2008, Jeremy Chadwick wrote:


On Thu, Nov 20, 2008 at 05:39:36PM +1100, Peter Jeremy wrote:



I hope that never gets committed - it will make debugging kernel
problems much harder.  There is already a kern.msgbuf_clear sysctl and
maybe people who are concerned about msgbuf leakage need to learn to
use it.


And this sysctl is only usable *after* the kernel loads, which means
you lose all of the messages shown from the time the kernel loads to
the time the sysctl is set (e.g. hardware detected/configured).  This is
even less acceptable, IMHO.


But surely you can arrange that the contents are written out to 
/var/log/messages first?


E.g. a sequence like

- mount /var
- write buffer contents via syslogd
- clear buffer via sysctl
- allow user logins

This way the buffer is cleared before any unprivileged users get to do 
anything.  No kernel changes needed, just a little tweaking of the init 
scripts at most.


If you should have a crash and suspect there is useful data in the buffer, 
you can boot to single-user mode (avoiding the clear) and retrieve it 
manually.


Seems like this should make everyone happy.

--

Nate Eldredge
[EMAIL PROTECTED]
___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Reccomendation for tools to use on FreeBSD for a wiki ?

2008-11-19 Thread Danny Braniss
   - - I've had apache up for years, but no wiki yet, so if any tips,
shout please, even if just RTFM URL= :-)
  
  http://en.wikipedia.org/wiki/List_of_wiki_software
  http://en.wikipedia.org/wiki/Comparison_of_wiki_software
 
 Great ! Thanks a lot !

Will you tell us which one you selected?

danny

 
 Cheers,
 Julian
 -- 
 Julian Stacey: BSDUnixLinux C Prog Admin SysEng Consult Munich www.berklix.com
   Mail plain ASCII text.  HTML  Base64 text are spam. www.asciiribbon.org
 ___
 freebsd-hackers@freebsd.org mailing list
 http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
 To unsubscribe, send any mail to [EMAIL PROTECTED]
 


___
freebsd-hackers@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]