Re: [squid-users] Reverse cache for HLS streaming

2013-01-31 Thread Scott Baker
On 01/31/2013 01:41 PM, Eliezer Croitoru wrote:
> I have seen your logs and it seems like you have user CURL to fetch a
> simple get while the clients are requesting a partial content of the
> video and squid in any version dosn't cache them yet.
> You can try other alternatives that can offer you this kind of feature
> or reassess the way your application works.

It appears my issues was time related. The origin server I was using was
about 2 minutes ahead of my squid server. I think this was causing it
not to cache anything. When I put NTP on both of them, the issue went away.

-- 
Scott Baker - Canby Telcom 
System Administrator - RHCE - 503.266.8253



Re: [squid-users] Reverse cache for HLS streaming

2013-01-31 Thread Eliezer Croitoru
I have seen your logs and it seems like you have user CURL to fetch a 
simple get while the clients are requesting a partial content of the 
video and squid in any version dosn't cache them yet.
You can try other alternatives that can offer you this kind of feature 
or reassess the way your application works.


Eliezer

On 1/31/2013 8:14 PM, Scott Baker wrote:

I'm trying to setup Squid as a reverse proxy to cache HLS segments. We
have a very controlled environment, so I'd like it to cache every .ts
file it sees, and not cache every .m3u8 file it sees. I have a pretty
generic configuration (I think) and it seems that it's not caching anything?

I don't see any reason it WOULDN'T cache the files. The headers all
indicate that it's cacheable I think.

-

http_port 80 accel defaultsite=hls2.domain.tv no-vhost ignore-cc
cache_peer master-streamer.domain.tv parent 80 0 no-query originserver
name=myAccel no-digest

acl our_sites dstdomain hls2.domain.tv
http_access allow our_sites
cache_peer_access myAccel allow our_sites
cache_peer_access myAccel deny all

# Uncomment and adjust the following to add a disk cache directory.
cache_dir ufs /var/spool/squid 2000 16 256
cache_mem 1024 MB

-

1359655780.097 45 65.182.224.20 TCP_MISS/206 1607080 GET
http://hls2.domain.tv/katu/katu_996_92564.ts -
FIRSTUP_PARENT/65.182.224.89 video/MP2T
1359655787.167 41 65.182.224.20 TCP_MISS/206 1607080 GET
http://hls2.domain.tv/katu/katu_996_92564.ts -
FIRSTUP_PARENT/65.182.224.89 video/MP2T
1359655792.110 42 65.182.224.20 TCP_MISS/206 1563276 GET
http://hls2.domain.tv/katu/katu_996_92565.ts -
FIRSTUP_PARENT/65.182.224.89 video/MP2T
1359655799.181 40 65.182.224.20 TCP_MISS/206 1563276 GET
http://hls2.domain.tv/katu/katu_996_92565.ts -
FIRSTUP_PARENT/65.182.224.89 video/MP2T
1359655804.114 37 65.182.224.20 TCP_MISS/206 1565532 GET
http://hls2.domain.tv/katu/katu_996_92566.ts -
FIRSTUP_PARENT/65.182.224.89 video/MP2T
1359655811.188 37 65.182.224.20 TCP_MISS/206 1565532 GET
http://hls2.domain.tv/katu/katu_996_92566.ts -
FIRSTUP_PARENT/65.182.224.89 video/MP2T
1359655816.133 39 65.182.224.20 TCP_MISS/206 1610088 GET
http://hls2.domain.tv/katu/katu_996_92567.ts -
FIRSTUP_PARENT/65.182.224.89 video/MP2T
1359655823.204 37 65.182.224.20 TCP_MISS/206 1610088 GET
http://hls2.domain.tv/katu/katu_996_92567.ts -
FIRSTUP_PARENT/65.182.224.89 video/MP2T
1359655828.139 37 65.182.224.20 TCP_MISS/206 1580948 GET
http://hls2.domain.tv/katu/katu_996_92568.ts -
FIRSTUP_PARENT/65.182.224.89 video/MP2T
1359655835.214 39 65.182.224.20 TCP_MISS/206 1580948 GET
http://hls2.domain.tv/katu/katu_996_92568.ts -
FIRSTUP_PARENT/65.182.224.89 video/MP2T

-

< HTTP/1.1 200 OK
< Date: Thu, 31 Jan 2013 18:11:44 GMT
< Server: Apache/2.2.22 (Fedora)
< Last-Modified: Thu, 31 Jan 2013 18:11:04 GMT
< ETag: "800182-181de4-4d4998cd170d4"
< Accept-Ranges: bytes
< Content-Length: 1580516
< Content-Type: video/MP2T
< X-Cache: MISS from hls2.domain.tv
< X-Cache-Lookup: MISS from hls2.domain.tv:80
< Via: 1.1 hls2.domain.tv (squid/3.2.5)
< Connection: keep-alive



--
Eliezer Croitoru
https://www1.ngtech.co.il
sip:ngt...@sip2sip.info
IT consulting for Nonprofit organizations
eliezer  ngtech.co.il


[squid-users] Reverse cache for HLS streaming

2013-01-31 Thread Scott Baker
I'm trying to setup Squid as a reverse proxy to cache HLS segments. We
have a very controlled environment, so I'd like it to cache every .ts
file it sees, and not cache every .m3u8 file it sees. I have a pretty
generic configuration (I think) and it seems that it's not caching anything?

I don't see any reason it WOULDN'T cache the files. The headers all
indicate that it's cacheable I think.

-

http_port 80 accel defaultsite=hls2.domain.tv no-vhost ignore-cc
cache_peer master-streamer.domain.tv parent 80 0 no-query originserver
name=myAccel no-digest

acl our_sites dstdomain hls2.domain.tv
http_access allow our_sites
cache_peer_access myAccel allow our_sites
cache_peer_access myAccel deny all

# Uncomment and adjust the following to add a disk cache directory.
cache_dir ufs /var/spool/squid 2000 16 256
cache_mem 1024 MB

-

1359655780.097 45 65.182.224.20 TCP_MISS/206 1607080 GET
http://hls2.domain.tv/katu/katu_996_92564.ts -
FIRSTUP_PARENT/65.182.224.89 video/MP2T
1359655787.167 41 65.182.224.20 TCP_MISS/206 1607080 GET
http://hls2.domain.tv/katu/katu_996_92564.ts -
FIRSTUP_PARENT/65.182.224.89 video/MP2T
1359655792.110 42 65.182.224.20 TCP_MISS/206 1563276 GET
http://hls2.domain.tv/katu/katu_996_92565.ts -
FIRSTUP_PARENT/65.182.224.89 video/MP2T
1359655799.181 40 65.182.224.20 TCP_MISS/206 1563276 GET
http://hls2.domain.tv/katu/katu_996_92565.ts -
FIRSTUP_PARENT/65.182.224.89 video/MP2T
1359655804.114 37 65.182.224.20 TCP_MISS/206 1565532 GET
http://hls2.domain.tv/katu/katu_996_92566.ts -
FIRSTUP_PARENT/65.182.224.89 video/MP2T
1359655811.188 37 65.182.224.20 TCP_MISS/206 1565532 GET
http://hls2.domain.tv/katu/katu_996_92566.ts -
FIRSTUP_PARENT/65.182.224.89 video/MP2T
1359655816.133 39 65.182.224.20 TCP_MISS/206 1610088 GET
http://hls2.domain.tv/katu/katu_996_92567.ts -
FIRSTUP_PARENT/65.182.224.89 video/MP2T
1359655823.204 37 65.182.224.20 TCP_MISS/206 1610088 GET
http://hls2.domain.tv/katu/katu_996_92567.ts -
FIRSTUP_PARENT/65.182.224.89 video/MP2T
1359655828.139 37 65.182.224.20 TCP_MISS/206 1580948 GET
http://hls2.domain.tv/katu/katu_996_92568.ts -
FIRSTUP_PARENT/65.182.224.89 video/MP2T
1359655835.214 39 65.182.224.20 TCP_MISS/206 1580948 GET
http://hls2.domain.tv/katu/katu_996_92568.ts -
FIRSTUP_PARENT/65.182.224.89 video/MP2T

-

< HTTP/1.1 200 OK
< Date: Thu, 31 Jan 2013 18:11:44 GMT
< Server: Apache/2.2.22 (Fedora)
< Last-Modified: Thu, 31 Jan 2013 18:11:04 GMT
< ETag: "800182-181de4-4d4998cd170d4"
< Accept-Ranges: bytes
< Content-Length: 1580516
< Content-Type: video/MP2T
< X-Cache: MISS from hls2.domain.tv
< X-Cache-Lookup: MISS from hls2.domain.tv:80
< Via: 1.1 hls2.domain.tv (squid/3.2.5)
< Connection: keep-alive

-- 
Scott Baker - Canby Telcom
System Administrator - RHCE - 503.266.8253