Re: CAM I/O Scheduler (was Re: FreeBSD Quarterly Status Report - First Quarter 2016 (fwd))

2016-05-03 Thread Warner Losh 

> On May 3, 2016, at 8:05 AM, Warren Block  wrote:
> 
> On Tue, 3 May 2016, Johan Hendriks wrote:
> 
>> Op 02/05/16 om 02:49 schreef Warren Block:
>>  CAM I/O Scheduler
>> 
>> Links
>> I/O Scheduling in FreeBSD's CAM Subsystem (PDF) URL:
>> https://people.freebsd.org/~imp/bsdcan2015/iosched-v3.pdf
>> The BSDCan 2015 Talk URL: https://www.youtube.com/watch?v=3WqOLolj5EU
>> 
>> Contact: Warner Losh 
>> 
>> An enhanced CAM I/O scheduler has been committed to the tree. By
>> default, this scheduler implements the old behavior. In addition, an
>> advanced adaptive scheduler is available. Along with the scheduler,
>> SATA disks can now use Queued Trims with devices that support them.
>> Details about the new scheduler are available in the I/O Scheduling 
>> in
>> FreeBSD's CAM Subsystem article (PDF) or from the BSDCan 2015 talk.
>> I updated my source today, but CAM_ADAPTIVE_IOSCHED yields an error about an 
>> unknown option.
>> If I use CAM_NETFLIX_IOSCHED the kernel compiles.
>> Is the name CAM_NETFLIX_IOSCHED changing to CAM_ADAPTIVE_IOSCHED?
> 
> That is my understanding, yes.  Warner can certainly explain it better than I 
> can, so CCed.

I’m changing it to CAM_ADAPTIVE_IOSCHED, but haven’t yet due to “work flow” 
issues
in making sure that the Netflix repo doesn’t see a large number of conflicts 
when this
is merged. I’ll see if I can finish today, but CAM_NETFLIX_IOSCHED is the old 
name.

Warner



signature.asc
Description: Message signed with OpenPGP using GPGMail

CAM I/O Scheduler (was Re: FreeBSD Quarterly Status Report - First Quarter 2016 (fwd))

2016-05-03 Thread Warren Block 

On Tue, 3 May 2016, Johan Hendriks wrote:


Op 02/05/16 om 02:49 schreef Warren Block:
  CAM I/O Scheduler

     Links
     I/O Scheduling in FreeBSD's CAM Subsystem (PDF) URL:
     https://people.freebsd.org/~imp/bsdcan2015/iosched-v3.pdf
     The BSDCan 2015 Talk URL: https://www.youtube.com/watch?v=3WqOLolj5EU

     Contact: Warner Losh 

     An enhanced CAM I/O scheduler has been committed to the tree. By
     default, this scheduler implements the old behavior. In addition, an
     advanced adaptive scheduler is available. Along with the scheduler,
     SATA disks can now use Queued Trims with devices that support them.
     Details about the new scheduler are available in the I/O Scheduling in
     FreeBSD's CAM Subsystem article (PDF) or from the BSDCan 2015 talk.

I updated my source today, but CAM_ADAPTIVE_IOSCHED yields an error about an 
unknown option.
If I use CAM_NETFLIX_IOSCHED the kernel compiles.
Is the name CAM_NETFLIX_IOSCHED changing to CAM_ADAPTIVE_IOSCHED?


That is my understanding, yes.  Warner can certainly explain it better 
than I can, so CCed.


Thanks!
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Re: FreeBSD Quarterly Status Report - First Quarter 2016 (fwd)

2016-05-03 Thread Johan Hendriks 


Op 02/05/16 om 02:49 schreef Warren Block:
> CAM I/O Scheduler
>
>Links
>I/O Scheduling in FreeBSD's CAM Subsystem (PDF) URL:
>https://people.freebsd.org/~imp/bsdcan2015/iosched-v3.pdf
>The BSDCan 2015 Talk URL: https://www.youtube.com/watch?v=3WqOLolj5EU
>
>Contact: Warner Losh 
>
>An enhanced CAM I/O scheduler has been committed to the tree. By
>default, this scheduler implements the old behavior. In addition, an
>advanced adaptive scheduler is available. Along with the scheduler,
>SATA disks can now use Queued Trims with devices that support them.
>Details about the new scheduler are available in the I/O Scheduling in
>FreeBSD's CAM Subsystem article (PDF) or from the BSDCan 2015 talk.
>
>The adaptive I/O scheduler is disabled by default, but can be enabled
>with options CAM_ADAPTIVE_IOSCHED in the kernel config file. This
>scheduler allows favoring reads over writes (or vice versa),
>controlling the IOPs, bandwidth, or concurrent operations (read,
> write,
>trim), and permits the selection of static or dynamic control of these
>operations. In addition, a number of statistics are collected for
> drive
>operations that are published via sysctl. One advanced use for the
>adaptive I/O scheduler is to compensate for deficiencies in some
>consumer-grade SSDs. These SSDs exhibit a performance cliff if too
> much
>data is written to them too quickly due to internal garbage
> collection.
>Without the I/O scheduler, read and write performance drop
>substantially once garbage collection kicks in. The adaptive I/O
>scheduler can be configured to monitor read latency. As read latency
>climbs, the I/O scheduler reduces the allowed write throughput, within
>limits, to attempt to maximize read performance. A simple use of the
>adaptive I/O scheduler would be to limit write bandwidth, IOPs or
>concurrent operations statically.
>
>Future work on the I/O scheduler will be coupled with improvements to
>the upper layers. The upper layers will be enhanced to communicate how
>urgent I/O requests are. The I/O scheduler will inform the upper
> layers
>of how full the I/O queues are, so less urgent I/O can be submitted to
>the lower layers as quickly as possible without overwhelming the lower
>layers or starving other devices of requests.
>
>This project was sponsored by Netflix.
>  __
I updated my source today, but CAM_ADAPTIVE_IOSCHED yields an error
about an unknown option.
If I use CAM_NETFLIX_IOSCHED the kernel compiles.
Is the name CAM_NETFLIX_IOSCHED changing to CAM_ADAPTIVE_IOSCHED?

regards
Johan

___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Re: FreeBSD Quarterly Status Report - First Quarter 2016 (fwd)

2016-05-02 Thread Greg 'groggy' Lehey 
[line lengths recovered]

On Sunday,  1 May 2016 at 20:16:38 -0700, Jordan Hubbard wrote:
>
>> On May 1, 2016, at 5:49 PM, Warren Block  wrote:
>>
>>   The first quarter of 2016 showed that FreeBSD retains a strong sense of
>>   ipseity. Improvements were pervasive, lending credence to the concept
>>   of meliorism. [ ??? ]
>
>
> I, for one, learned at least 4 new words in that announcement, 3 of
> which were actually real.

And the other is int?  OK, I'll bite.  Which one is unreal?

Greg
--
Sent from my desktop computer.
Finger g...@freebsd.org for PGP public key.
See complete headers for address and phone numbers.
This message is digitally signed.  If your Microsoft mail program
reports problems, please read http://lemis.com/broken-MUA


signature.asc
Description: PGP signature

Re: FreeBSD Quarterly Status Report - First Quarter 2016 (fwd)

2016-05-02 Thread Jordan Hubbard 

> On May 1, 2016, at 5:49 PM, Warren Block  wrote:
> 
>   The first quarter of 2016 showed that FreeBSD retains a strong sense of
>   ipseity. Improvements were pervasive, lending credence to the concept
>   of meliorism. [ … ]

I, for one, learned at least 4 new words in that announcement, 3 of which were 
actually real.  May we all strive for greater meloristic ipseity!

I also applaud both your recent acquisition of a thesaurus and your keen 
appreciation of when to discard it and simply rely on your imagination.  it 
made an otherwise prosaic status report more provocative!  Plaudits.

- Jordan

___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Re: FreeBSD Quarterly Status Report - First Quarter 2016 (fwd)

2016-05-02 Thread Chris H 
On Sun, 1 May 2016 23:14:11 -0400 Brandon Allbery  wrote

> On Sun, May 1, 2016 at 10:25 PM, Kurt Buff  wrote:
> >
> > That's just good old fun with words, and driving people to the
> > thesaurus
> 
> 
> So what's it say about those of us who didn't need one?
That you're more likely to need glasses, than those that did? ;)

--Chris
> 
> -- 
> brandon s allbery kf8nh   sine nomine associates
> allber...@gmail.com  ballb...@sinenomine.net
> unix, openafs, kerberos, infrastructure, xmonadhttp://sinenomine.net
> ___
> freebsd-current@freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-current
> To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Re: FreeBSD Quarterly Status Report - First Quarter 2016 (fwd)

2016-05-01 Thread Glen Barber 
Despite my dissatisfaction with this status update, I'll reply to an
email in public...

On Sun, May 01, 2016 at 08:16:38PM -0700, Jordan Hubbard wrote:
> 
> > On May 1, 2016, at 5:49 PM, Warren Block  wrote:
> > 
> >   The first quarter of 2016 showed that FreeBSD retains a strong sense of
> >   ipseity. Improvements were pervasive, lending credence to the concept
> >   of meliorism. [ … ]
> 
> I, for one, learned at least 4 new words in that announcement, 3
> of which were actually real.  May we all strive for greater meloristic
> ipseity!
> 
> I also applaud both your recent acquisition of a thesaurus and
> your keen appreciation of when to discard it and simply rely on
> your imagination.  it made an otherwise prosaic status report more

 ^^ Should be capitalized, as start of sentence.

> provocative!  Plaudits.
> 

Glen



signature.asc
Description: PGP signature

Re: FreeBSD Quarterly Status Report - First Quarter 2016 (fwd)

2016-05-01 Thread Brandon Allbery 
On Sun, May 1, 2016 at 10:25 PM, Kurt Buff  wrote:
>
> That's just good old fun with words, and driving people to the
> thesaurus


So what's it say about those of us who didn't need one?

-- 
brandon s allbery kf8nh   sine nomine associates
allber...@gmail.com  ballb...@sinenomine.net
unix, openafs, kerberos, infrastructure, xmonadhttp://sinenomine.net
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Re: FreeBSD Quarterly Status Report - First Quarter 2016 (fwd)

2016-05-01 Thread Kurt Buff 
Further deponent sayeth not...

Kurt

On Sun, May 1, 2016 at 8:14 PM, Brandon Allbery  wrote:
> On Sun, May 1, 2016 at 10:25 PM, Kurt Buff  wrote:
>>
>> That's just good old fun with words, and driving people to the
>> thesaurus
>
>
> So what's it say about those of us who didn't need one?
>
> --
> brandon s allbery kf8nh   sine nomine associates
> allber...@gmail.com  ballb...@sinenomine.net
> unix, openafs, kerberos, infrastructure, xmonadhttp://sinenomine.net
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Re: FreeBSD Quarterly Status Report - First Quarter 2016 (fwd)

2016-05-01 Thread Kurt Buff 
Trolling? Oh heck no.

That's just good old fun with words, and driving people to the
thesaurus. After all, immediate following that was this:

 Please submit status reports for the second quarter of 2016 by July 7.
   A thesaurus will be provided for submitters who do not have one of
   their own. We will need them back afterwards, preferably with no new
   teeth marks on the covers. Thank you!

Kurt

On Sun, May 1, 2016 at 6:37 PM, Michelle Sullivan  wrote:
> Warren Block wrote:
>>
>> Introduction
>>
>>The first quarter of 2016 showed that FreeBSD retains a strong sense of
>>ipseity. Improvements were pervasive, lending credence to the concept
>>of meliorism.
>>
>>Panegyrics are relatively scarce, but not for lack of need. Perhaps
>>this missive might serve that function in some infinitesimal way.
>>
>>There was propagation, reformation, randomization, accumulation,
>>emulation, transmogrification, debuggenation, and metaphrasal during
>>this quarter.
>>
>>In the financioartistic arena, pork snout futures narrowly edged out
>>pointilism, while parietal art remained fixed.
>>
>>In all, a discomfiture of abundance. View the rubrics below, and marvel
>>at their profusion and magnitude! Marvel!
>
>
> You're trolling right?
>
> --
> Michelle Sullivan
> http://www.mhix.org/
>
>
> ___
> freebsd-sta...@freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-stable
> To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

Re: FreeBSD Quarterly Status Report - First Quarter 2016 (fwd)

2016-05-01 Thread Michelle Sullivan 

Warren Block wrote:

Introduction

   The first quarter of 2016 showed that FreeBSD retains a strong 
sense of

   ipseity. Improvements were pervasive, lending credence to the concept
   of meliorism.

   Panegyrics are relatively scarce, but not for lack of need. Perhaps
   this missive might serve that function in some infinitesimal way.

   There was propagation, reformation, randomization, accumulation,
   emulation, transmogrification, debuggenation, and metaphrasal during
   this quarter.

   In the financioartistic arena, pork snout futures narrowly edged out
   pointilism, while parietal art remained fixed.

   In all, a discomfiture of abundance. View the rubrics below, and 
marvel

   at their profusion and magnitude! Marvel!


You're trolling right?

--
Michelle Sullivan
http://www.mhix.org/

___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

FreeBSD Quarterly Status Report - First Quarter 2016 (fwd)

2016-05-01 Thread Warren Block 

Introduction

   The first quarter of 2016 showed that FreeBSD retains a strong sense of
   ipseity. Improvements were pervasive, lending credence to the concept
   of meliorism.

   Panegyrics are relatively scarce, but not for lack of need. Perhaps
   this missive might serve that function in some infinitesimal way.

   There was propagation, reformation, randomization, accumulation,
   emulation, transmogrification, debuggenation, and metaphrasal during
   this quarter.

   In the financioartistic arena, pork snout futures narrowly edged out
   pointilism, while parietal art remained fixed.

   In all, a discomfiture of abundance. View the rubrics below, and marvel
   at their profusion and magnitude! Marvel!

   --Warren Block
 __

   Please submit status reports for the second quarter of 2016 by July 7.
   A thesaurus will be provided for submitters who do not have one of
   their own. We will need them back afterwards, preferably with no new
   teeth marks on the covers. Thank you!
 __

FreeBSD Team Reports

 * Cluster Admin
 * The FreeBSD Core Team

Projects

 * Address Space Layout Randomization
 * Ceph on FreeBSD
 * Process-Shared Locks for libthr
 * RCTL Disk IO Limits
 * The Graphics Stack on FreeBSD

Kernel

 * ARM Allwinner SoC Support
 * CAM I/O Scheduler
 * FDT Overlay Support in UBLDR
 * Filemon Performance/Stability Improvements
 * FreeBSD Integration Services (BIS)
 * Infiniband
 * MMC Stack Under CAM Framework
 * NFS Server
 * Static Analysis of the FreeBSD Kernel with PVS Studio

Architectures

 * AmigaOne X5000 Support
 * FreeBSD on Cavium ThunderX (arm64)
 * powerpcspe Target

Userland Programs

 * ELF Tool Chain Tools
 * Native PCI-express HotPlug
 * Updates to GDB
 * Using lld, the LLVM Linker, to Link FreeBSD

Ports

 * GitLab Port
 * GNOME on FreeBSD
 * KDE on FreeBSD
 * Obsoleting Rails 3
 * Ports Collection

Documentation

 * New FreeBSD Mastery Books
 * Spanish FAQ and Chinese Porter's Handbook Translations

Miscellaneous

 * FreeBSD Build
 * Qt 5.6 on Raspberry Pi
 * The FreeBSD Foundation
 __

FreeBSD Team Reports

Cluster Admin

   Contact: 

   This quarter, we:
 * migrated services out of the hosting space in ISC (peter, sbruno)
 * began migration of services into the RootBSD hosting space (peter,
   sbruno)
 * collaborated with the phabricator admin team to migrate to a new
   and improved host in NYI. (allanjude, peter, sbruno)
 * installed a new and beefier Jenkins machine (gnn, lwshu, sbruno)
 * are still looking for more Asian mirrors for pkg, svn, and ftp
   (Japan, India). (sbruno)
 * completed the migration of the Taiwanese mirror to its new
   location. (lwshu)
 * started hosting a clang/llvm buildbbot in the FreeBSD cluster at
   NYI (sbruno, emaste)
 * resolved a UK mirror outage with Bytemark (gavin, peter)
 __

The FreeBSD Core Team

   Contact: FreeBSD Core Team 

   During the first quarter of 2016, the most important business of the
   FreeBSD Core Team has been to respond to the harassment incident last
   year. Core's actions were to assemble a timeline of the events and in
   the light of that to review Core's actions at the time; and to make
   recommendations about how better to handle such cases in future. During
   this process, draft reports were reviewed by people concerned in the
   case and in addition a number of interested members of the FreeBSD
   community. Core would like to thank everyone involved for their
   contributions.

   The report was published to the FreeBSD developer community in
   mid-February, and contained six recommendations for the community to
   consider.

   Core is also coordinating with the committee headed by Anne Dickison
   who are reviewing the Code of Conduct. A corpus of case studies is
   being assembled, which will be re-examined to see what impact changes
   to the Code of Conduct would have had.

   Core, together with John Baldwin, are working on a plan to create a
   separate repository containing GPLv3 toolchain components. This will
   allow modernization of code within base beyond what the existing GPLv2
   toolchain can handle, and permit support of certain new architectures
   where a copyfree licensed alternative (i.e., LLVM) is not yet
   available. A position paper will soon be circulated to developers for
   comment.

   During this quarter three new commit bits were issued, and one was
   returned for safekeeping. Please welcome Wojciech Macek, Jared McNeil
   and Stanislav Galabov, and bid farewell to