[swinog] Fun with Fiber

2013-03-18 Diskussionsfäden Andre Oppermann

The Netflix guys wiring up a fully loaded ASR9010 with 118 single
mode fibers:

 http://www.youtube.com/watch?v=tyb-nnRNwfw

For those who don't know yet, Netflix is an online movie rental company
and uses so much bandwidth that they had to push out their own CDN boxes
to ISPs and IXPs.

Their CDN boxes are almost stock FreeBSD 9.1 based, contain some
35 HDDs at 4TB plus a couple of SSDs and push about 15Gbit/s *each*
during the evening hours.  They are limited by HDD (seek) bandwidth.

--
Andre


___
swinog mailing list
swinog@lists.swinog.ch
http://lists.swinog.ch/cgi-bin/mailman/listinfo/swinog


Re: [swinog] Fun with Fiber

2013-03-18 Diskussionsfäden Pim van Pelt
Hoi,

2013/3/18 Andre Oppermann opperm...@networx.ch:
 The Netflix guys wiring up a fully loaded ASR9010 with 118 single
 mode fibers:

  http://www.youtube.com/watch?v=tyb-nnRNwfw
Cool!
 Their CDN boxes are almost stock FreeBSD 9.1 based, contain some
 35 HDDs at 4TB plus a couple of SSDs and push about 15Gbit/s *each*
 during the evening hours.  They are limited by HDD (seek) bandwidth.
Do you think they use ZFS+L2ARC as the filesystem of their content push system?

groet,
Pim

-- 
Pim van Pelt p...@ipng.nl
PBVP1-RIPE - http://www.ipng.nl/


___
swinog mailing list
swinog@lists.swinog.ch
http://lists.swinog.ch/cgi-bin/mailman/listinfo/swinog


Re: [swinog] Fun with Fiber

2013-03-18 Diskussionsfäden Andre Oppermann

On 18.03.2013 14:48, Pim van Pelt wrote:

Hoi,

2013/3/18 Andre Oppermann opperm...@networx.ch:

The Netflix guys wiring up a fully loaded ASR9010 with 118 single
mode fibers:

  http://www.youtube.com/watch?v=tyb-nnRNwfw

Cool!

Their CDN boxes are almost stock FreeBSD 9.1 based, contain some
35 HDDs at 4TB plus a couple of SSDs and push about 15Gbit/s *each*
during the evening hours.  They are limited by HDD (seek) bandwidth.



Do you think they use ZFS+L2ARC as the filesystem of their content push system?


IIRC they use plain UFS2 on the disks.  They don't care about disks
dying, so no RAID.  The availability of the content is controlled
from upper layers.  So if a disk dies requests for that content get
redirected to another box with the same content.  Only the popular
movies and shows are stored on the CDN boxes.  The long tail is
served from AWS S3.

--
Andre



___
swinog mailing list
swinog@lists.swinog.ch
http://lists.swinog.ch/cgi-bin/mailman/listinfo/swinog


Re: [swinog] Fun with Fiber

2013-03-18 Diskussionsfäden Rainer Duffner
Am Mon, 18 Mar 2013 14:59:08 +0100
schrieb Andre Oppermann opperm...@networx.ch:

 On 18.03.2013 14:48, Pim van Pelt wrote:
  Hoi,
 
  2013/3/18 Andre Oppermann opperm...@networx.ch:
  The Netflix guys wiring up a fully loaded ASR9010 with 118 single
  mode fibers:
 
http://www.youtube.com/watch?v=tyb-nnRNwfw
  Cool!
  Their CDN boxes are almost stock FreeBSD 9.1 based, contain some
  35 HDDs at 4TB plus a couple of SSDs and push about 15Gbit/s *each*
  during the evening hours.  They are limited by HDD (seek)
  bandwidth.
  
  Do you think they use ZFS+L2ARC as the filesystem of their content
  push system?
 
 IIRC they use plain UFS2 on the disks.  They don't care about disks
 dying, so no RAID.  The availability of the content is controlled
 from upper layers.  So if a disk dies requests for that content get
 redirected to another box with the same content.  Only the popular
 movies and shows are stored on the CDN boxes.  The long tail is
 served from AWS S3.
 



Described in more detail here:


http://lists.freebsd.org/pipermail/freebsd-stable/2012-June/068129.html


___
swinog mailing list
swinog@lists.swinog.ch
http://lists.swinog.ch/cgi-bin/mailman/listinfo/swinog