Hey Omid, From what I remember the basics of math to verify the patter of a specific set of numbers have some kind of pattern is to have at-least 3 items. But in the cryptography world it another story. I have not researched playstation downloads and will probably won't do that. Others might offer some help but you must understand what you are trying to predict in these urls and downloads. From what I have seen it seem that this CDN "llnwd.net" is very cache friendly but you need to know how to handle their traffic. They don’t use any form of ETAG headers but they do provide some pieces of information in the url's that can identify something about it. If they use a ticketing system such as couple other CDN providers you would need to know the "ID" of the url before it's being downloaded. You will need more then just the urls but also the response headers for these. I might be able to write an ICAP service that will log requests and response headers and it can assist Cache admins to improve their efficiency but this can take a while.
All The Bests, Eliezer ---- Eliezer Croitoru Linux System Administrator Mobile: +972-5-28704261 Email: elie...@ngtech.co.il -----Original Message----- From: squid-users <squid-users-boun...@lists.squid-cache.org> On Behalf Of Omid Kosari Sent: Tuesday, April 10, 2018 14:20 To: squid-users@lists.squid-cache.org Subject: Re: [squid-users] Ideas for better caching these popular urls Thanks for reply . I assumed the community at different scales from little isp to large ISPs may have common domains like those i highlighted so they may have same issue as mine . So i ignored common parts . One of problems with redbot is it shows timeout for big files like http://gs2.ww.prod.dl.playstation.net/gs2/appkgo/prod/CUSA00900_00/2/f_2df8e321f37e2f5ea3930f6af4e9571144916013ee38893d881890b454b5fed6/f/UP9000-CUSA00900_00-BLOODBORNE000000_4.pkg?downloadId=00000187&du=000000000000018700e2291bda0f868f&country=us&downloadType=ob&q=aa2cd9c8d1f359feb843ae4a6c99cfcdb6569ca9cc60ad6d28b6f8de3b5fac23&threadId=0&serverIpAddr=23.57.69.81&r=00000027 http://gs2.ww.prod.dl.playstation.net/gs2/ppkgo/prod/CUSA07557_00/25/f_053bab8c9dec6fbc68a0bd9fc58793285ae350ccf7dadacb35b5840228a9d802/f/EP4001-CUSA07557_00-F12017EMASTER000-A0113-V0100_0.pkg?downloadId=00000059&du=000000000000005900e22977e62f91a2&downloadType=ob&product=0183&serverIpAddr=8.248.5.254&r=00000032 I assumed anyone with few thousand of users may have same problem and maybe they like to share for example their refresh_pattern or storeid to solve my problem . You better know that playstation is everywhere playstation ;) Here is part of storeid_db file ^http:\/\/.*\.sonycoment\.loris-e\.llnwd\.net\/(.*?\.pkg) http://playstation.net.squidinternal/$1 ^http:\/\/.*\.playstation\.net\/(.*?\.pkg) http://playstation.net.squidinternal/$1 Almost all of the playstation huge downloads are with 206 code but it will download the file from start to end , if i remember correctly in this situation squid will correctly cache the file . -- Sent from: http://squid-web-proxy-cache.1019090.n4.nabble.com/Squid-Users-f1019091.html _______________________________________________ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users _______________________________________________ squid-users mailing list squid-users@lists.squid-cache.org http://lists.squid-cache.org/listinfo/squid-users
