[squid-users] YouTube\GoogleVideo caching is here, tested and verified.
tester100
portalnet2 at outlook.com.br
Sun Apr 14 23:08:11 UTC 2019
Hi Eliezer...
would you mind sharing the scripts, so i can test it on my squid 3.5.28
version?
i have a store-id.pl script already running and caching certain files on
https sites..
but on youtube its only caching images.. not the videos format from local
CDN server from ISP in the region
i only get this on my log
Apr 14 23:06:58 32 172.255.255.1 TCP_MISS/200 6502 GET
https://i.ytimg.com/vi/yqQwH_Qj1x0/hqdefault.jpg? -
HIER_DIRECT/170.254.11.57 image/webp
Apr 14 23:06:58 170 172.255.255.1 TCP_MISS/200 650 GET
https://www.youtube.com/pcs/activeview? - HIER_DIRECT/172.217.30.110
image/gif
Apr 14 23:06:58 97 172.255.255.1 TAG_NONE/200 0 CONNECT i.ytimg.com:443
- HIER_DIRECT/170.254.11.57 -
Apr 14 23:06:58 99 172.255.255.1 TAG_NONE/200 0 CONNECT i.ytimg.com:443
- HIER_DIRECT/170.254.11.57 -
Apr 14 23:06:58 191 172.255.255.1 TCP_MISS/204 515 GET
https://www.youtube.com/api/stats/ads? - HIER_DIRECT/172.217.30.110
text/html
Apr 14 23:06:58 146 172.255.255.1 TCP_MISS/200 618 GET
https://www.google.com/pagead/lvz? - HIER_DIRECT/172.217.28.228 image/gif
Apr 14 23:06:58 55 172.255.255.1 TCP_MISS/200 8997 GET
https://i.ytimg.com/vi/k5Zu898lbVU/hqdefault.jpg? -
HIER_DIRECT/170.254.11.57 image/webp
Apr 14 23:06:58 28 172.255.255.1 TCP_MISS/200 8231 GET
https://i.ytimg.com/vi/z260XtnMJks/hqdefault.jpg? -
HIER_DIRECT/170.254.11.57 image/webp
Apr 14 23:06:58 299 172.255.255.1 TAG_NONE/200 0 CONNECT i.ytimg.com:443
- HIER_DIRECT/170.254.11.57 -
Apr 14 23:06:58 82 172.255.255.1 TAG_NONE/200 0 CONNECT i.ytimg.com:443
- HIER_DIRECT/170.254.11.57 -
Apr 14 23:06:58 2 172.255.255.1 TCP_HIT/200 4697 GET
https://i.ytimg.com/vi/iVEvf-tR1os/hqdefault.jpg? - HIER_NONE/- image/webp
Apr 14 23:06:58 41 172.255.255.1 TCP_MISS/200 6536 GET
https://i.ytimg.com/vi/WqiYXdRNIdM/hqdefault.jpg? -
HIER_DIRECT/170.254.11.57 image/webp
Apr 14 23:06:58 62 172.255.255.1 TAG_NONE/200 0 CONNECT i.ytimg.com:443
- HIER_DIRECT/170.254.11.57 -
Apr 14 23:06:58 59 172.255.255.1 TAG_NONE/200 0 CONNECT i.ytimg.com:443
- HIER_DIRECT/170.254.11.57 -
Apr 14 23:06:58 2 172.255.255.1 TCP_HIT/200 8658 GET
https://i.ytimg.com/vi/E9dls93E6MI/hqdefault.jpg? - HIER_NONE/- image/webp
Apr 14 23:06:58 374 172.255.255.1 TCP_MISS/200 618 GET
https://www.google.com.br/pagead/lvz? - HIER_DIRECT/172.217.28.227 image/gif
Apr 14 23:06:58 26 172.255.255.1 TCP_MISS/200 8509 GET
https://i.ytimg.com/vi/BmoEIyw1HFU/hqdefault.jpg? -
HIER_DIRECT/170.254.11.57 image/webp
Apr 14 23:06:59 164 172.255.255.1 TAG_NONE/200 0 CONNECT
static.doubleclick.net:443 - HIER_DIRECT/172.217.162.102 -
Apr 14 23:06:59 22 172.255.255.1 TCP_MISS/304 283 GET
https://static.doubleclick.net/instream/ad_status.js -
HIER_DIRECT/172.217.162.102 -
Apr 14 23:06:59 164 172.255.255.1 TAG_NONE/200 0 CONNECT
www.youtube.com:443 - HIER_DIRECT/172.217.30.110 -
Apr 14 23:06:59 363 172.255.255.1 TAG_NONE/200 0 CONNECT
www.youtube.com:443 - HIER_DIRECT/172.217.30.110 -
Apr 14 23:06:59 22 172.255.255.1 TCP_MISS/204 250 GET
https://www.youtube.com/generate_204? - HIER_DIRECT/172.217.30.110 -
Apr 14 23:06:59 178 172.255.255.1 TCP_MISS/200 1394 POST
https://www.youtube.com/service_ajax? - HIER_DIRECT/172.217.30.110
application/json
Apr 14 23:07:00 143 172.255.255.1 TAG_NONE/200 0 CONNECT
www.youtube.com:443 - HIER_DIRECT/172.217.30.110 -
Apr 14 23:07:00 147 172.255.255.1 TAG_NONE/200 0 CONNECT
www.youtube.com:443 - HIER_DIRECT/172.217.30.110 -
Apr 14 23:07:01 172 172.255.255.1 TCP_MISS/200 618 GET
https://www.youtube.com/pagead/conversion/? - HIER_DIRECT/172.217.30.110
image/gif
Apr 14 23:07:01 164 172.255.255.1 TCP_MISS/200 618 GET
https://www.youtube.com/pagead/conversion/? - HIER_DIRECT/172.217.30.110
image/gif
Apr 14 23:07:02 139 172.255.255.1 TAG_NONE/200 0 CONNECT
www.youtube.com:443 - HIER_DIRECT/172.217.30.110 -
Apr 14 23:07:02 278 172.255.255.1 TAG_NONE/200 0 CONNECT
r2---sn-uxjioxucg-cnce.googlevideo.com:443 - HIER_DIRECT/170.254.11.45 -
Apr 14 23:07:02 45 172.255.255.1 TCP_MISS/200 1987 GET
https://r2---sn-uxjioxucg-cnce.googlevideo.com/videoplayback? -
HIER_DIRECT/170.254.11.45 video/mp4
Apr 14 23:07:03 64 172.255.255.1 TAG_NONE/200 0 CONNECT
r2---sn-uxjioxucg-cnce.googlevideo.com:443 - HIER_DIRECT/170.254.11.45 -
Apr 14 23:07:03 162 172.255.255.1 TCP_MISS/204 595 POST
https://www.youtube.com/api/stats/qoe? - HIER_DIRECT/172.217.30.110
text/html
Apr 14 23:07:03 39 172.255.255.1 TCP_MISS/200 1414 GET
https://r2---sn-uxjioxucg-cnce.googlevideo.com/videoplayback? -
HIER_DIRECT/170.254.11.45 audio/webm
Apr 14 23:07:03 421 172.255.255.1 TAG_NONE/200 0 CONNECT
www.youtube.com:443 - HIER_DIRECT/172.217.30.110 -
Apr 14 23:07:03 129 172.255.255.1 TCP_MISS/200 6027 GET
https://www.youtube.com/sw.js - HIER_DIRECT/172.217.30.110 text/javascript
Apr 14 23:07:05 162 172.255.255.1 TAG_NONE/200 0 CONNECT
www.youtube.com:443 - HIER_DIRECT/172.217.30.110 -
Apr 14 23:07:05 124 172.255.255.1 TCP_MISS/200 507 POST
https://www.youtube.com/youtubei/v1/log_event? - HIER_DIRECT/172.217.30.110
application/json
Apr 14 23:07:06 164 172.255.255.1 TAG_NONE/200 0 CONNECT
www.youtube.com:443 - HIER_DIRECT/172.217.30.110 -
Apr 14 23:07:06 174 172.255.255.1 TCP_MISS/200 618 GET
https://www.youtube.com/pagead/conversion/? - HIER_DIRECT/172.217.30.110
image/gif
Apr 14 23:07:08 151 172.255.255.1 TAG_NONE/200 0 CONNECT
www.youtube.com:443 - HIER_DIRECT/172.217.30.110 -
Apr 14 23:07:08 8781 172.255.255.1 TAG_NONE/200 0 CONNECT s.ytimg.com:443
- HIER_DIRECT/172.217.162.110 -
Apr 14 23:07:09 1 172.255.255.1 TCP_MEM_HIT/200 904 GET
https://s.ytimg.com/yts/img/favicon-vfl8qSV2F.ico - HIER_NONE/- image/x-icon
Eliezer Croitoru wrote
> Hey All,
>
> After quite some time I have compiled a solution for YouTube videos
> caching
> for PC's.
> The next step would be to cache it for mobile devices but I am looking for
> someone who wants this solution.
> The only drawback is that this solution is designed for
> intercept\transparent proxies and not tproxy but it might work on these
> too.
>
> The installation is pretty simple on a systemd based OS like Debian 8+9,
> Ubuntu 16.04, CentOS\RHEK 7, Oracle Enterprise Linux 7 and OpenSUSE leap
> and
> above.
> It consists of four components:
> - local redis DB
> - ICAP service binary
> - ICAP service system service unit file
> - ruby StoreID script
>
> And of course a special squid.conf with ssl_bump enabled.
>
> For now I will not package it using RPM or DEB and will use a shell script
> or README.md that describes the installation and usage steps.
> Contact me here or by a PM.
>
> Eliezer
>
> ----
> Eliezer Croitoru
> Linux System Administrator
> Mobile: +972-5-28704261
> Email:
> eliezer at .co
>
> _______________________________________________
> squid-users mailing list
> squid-users at .squid-cache
> http://lists.squid-cache.org/listinfo/squid-users
Eliezer Croitoru wrote
> Hey All,
>
> After quite some time I have compiled a solution for YouTube videos
> caching
> for PC's.
> The next step would be to cache it for mobile devices but I am looking for
> someone who wants this solution.
> The only drawback is that this solution is designed for
> intercept\transparent proxies and not tproxy but it might work on these
> too.
>
> The installation is pretty simple on a systemd based OS like Debian 8+9,
> Ubuntu 16.04, CentOS\RHEK 7, Oracle Enterprise Linux 7 and OpenSUSE leap
> and
> above.
> It consists of four components:
> - local redis DB
> - ICAP service binary
> - ICAP service system service unit file
> - ruby StoreID script
>
> And of course a special squid.conf with ssl_bump enabled.
>
> For now I will not package it using RPM or DEB and will use a shell script
> or README.md that describes the installation and usage steps.
> Contact me here or by a PM.
>
> Eliezer
>
> ----
> Eliezer Croitoru
> Linux System Administrator
> Mobile: +972-5-28704261
> Email:
> eliezer at .co
>
> _______________________________________________
> squid-users mailing list
> squid-users at .squid-cache
> http://lists.squid-cache.org/listinfo/squid-users
--
Sent from: http://squid-web-proxy-cache.1019090.n4.nabble.com/Squid-Users-f1019091.html
More information about the squid-users
mailing list