[squid-users] Sudden but sustained high bandwidth usage
Heiler Bemerguy
heiler.bemerguy at cinbesa.com.br
Tue Mar 15 17:51:15 UTC 2016
Hi joe, Eliezer, Amos.. today I saw something different regarding high
bandwidth and caching of windows updates ranged requests..
A client begins a windows update, it does a:
HEAD to check size or something, which is ok..
then a ranged GET, which outputs a TCP_MISS/206,
then the next GET gives a TCP_SWAPFAIL_MISS/206.
Lots of other TCP_MISS/206, then in the end, TCP_MISS_ABORTED/000
A big amount of parallel connections are being made because of each
GET.. ok, I know squid can't do much about it.. but then, why the
content does not get cached in the end?
I mean, the way it is, it will happen every day.. are these
"TCP_MISS_ABORTED" really the client aborting the download? I doubt it...
Take a look and see if you can understand:
[Tue Mar 15 12:36:12 2016].159 95 10.88.100.100 TCP_MISS/200 508
HEAD
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:36:36 2016].321 23798 10.88.100.100 TCP_MISS/206 5441
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:37:00 2016].353 24026 10.88.100.100
TCP_SWAPFAIL_MISS/206 14155 GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:37:39 2016].293 38939 10.88.100.100 TCP_MISS/206 22954
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:38:04 2016].711 25415 10.88.100.100 TCP_MISS/206 31488
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:38:40 2016].959 36243 10.88.100.100 TCP_MISS/206 33880
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:39:19 2016].051 38089 10.88.100.100 TCP_MISS/206 38228
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:39:27 2016].767 8714 10.88.100.100 TCP_MISS/206 38826
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:40:36 2016].177 68404 10.88.100.100 TCP_MISS/206 42085
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:43:01 2016].193 145011 10.88.100.100 TCP_MISS/206 47404
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:44:06 2016].563 65368 10.88.100.100 TCP_MISS/206 52196
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:45:58 2016].017 111451 10.88.100.100 TCP_MISS/206 52577
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:47:18 2016].578 80558 10.88.100.100 TCP_MISS/206 51278
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:49:44 2016].069 145484 10.88.100.100 TCP_MISS/206 52524
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:50:41 2016].665 57594 10.88.100.100 TCP_MISS/206 53211
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:51:50 2016].167 68500 10.88.100.100 TCP_MISS/206 58537
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:52:53 2016].939 63769 10.88.100.100 TCP_MISS/206 56951
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:57:57 2016].547 303606 10.88.100.100 TCP_MISS_ABORTED/206
497 GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/192.221.249.30 application/octet-stream
[Tue Mar 15 13:02:57 2016].710 300097 10.88.100.100 TCP_MISS_ABORTED/206
418 GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/8.253.0.46 application/octet-stream
[Tue Mar 15 13:03:27 2016].687 29942 10.88.100.100 TCP_MISS/206 62378
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/192.221.249.30 application/octet-stream
[Tue Mar 15 13:04:01 2016].689 34000 10.88.100.100 TCP_MISS/206 57075
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/192.221.249.30 application/octet-stream
[Tue Mar 15 13:09:01 2016].738 300046 10.88.100.100 TCP_MISS_ABORTED/206
497 GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/192.221.249.30 application/octet-stream
[Tue Mar 15 13:11:49 2016].704 167900 10.88.100.100 TCP_MISS/206 57270
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 13:15:06 2016].538 196832 10.88.100.100 TCP_MISS/206 57365
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 13:19:22 2016].963 256422 10.88.100.100 TCP_MISS/206 57458
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 13:20:06 2016].187 43222 10.88.100.100 TCP_MISS/206 57483
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/192.221.249.30 application/octet-stream
[Tue Mar 15 13:25:06 2016].054 299865 10.88.100.100 TCP_MISS_ABORTED/206
497 GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/192.221.249.30 application/octet-stream
[Tue Mar 15 13:25:15 2016].625 9490 10.88.100.100 TCP_MISS/206 57707
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 13:25:32 2016].250 16624 10.88.100.100 TCP_MISS/206 58530
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 13:30:33 2016].158 300906 10.88.100.100 TCP_MISS_ABORTED/206
571 GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 13:41:26 2016].875 42 10.88.100.100 TCP_MISS_ABORTED/000
0 GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/8.253.0.46 -
Best Regards,
--
Heiler Bemerguy - (91) 98151-4894
Assessor Técnico - CINBESA (91) 3184-1751
Em 14/03/2016 11:32, Heiler Bemerguy escreveu:
>
> Hi Eliezer and Joe!!!
>
> Thank you very much for your support.
>
> I have done a test here too. I've replaced 3.5.15 with 3.5.14 and the
> high bandwidth (associated with SWAPFAIL) is GONE.
>
> I've checked twice the sources diffs between 14 and 15 and can't tell
> what break this.. but I'm running 3.5.14 for 3 days without any
> download-loop sucking all our bandwidth.
>
> I'm still having a SWAPFAIL here and there, and a lot of MISSES for
> files that should have been cached... but no high bandwidth !!
>
> access.log:
> 1457958469.926 152 10.101.1.163 TCP_MISS/206 6674 GET
> http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
> - HIER_DIRECT/13.107.4.50 application/octet-stream
> 1457958474.598 356 10.101.1.163 TCP_SWAPFAIL_MISS/206 9142 GET
> http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
> - HIER_DIRECT/13.107.4.50 application/octet-stream
> 1457958478.292 676 10.101.1.163 TCP_MISS/206 10509 GET
> http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
> - HIER_DIRECT/13.107.4.50 application/octet-stream
> 1457958481.165 220 10.101.1.163 TCP_MISS/206 11681 GET
> http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
> - HIER_DIRECT/13.107.4.50 application/octet-stream
> 1457958483.012 958 10.101.1.163 TCP_MISS/206 14003 GET
> http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
> - HIER_DIRECT/13.107.4.50 application/octet-stream
> 1457958484.334 1155 10.101.1.163 TCP_MISS/206 19973 GET
> http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
> - HIER_DIRECT/13.107.4.50 application/octet-stream
> 1457958485.967 1630 10.101.1.163 TCP_MISS/206 33511 GET
> http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
> - HIER_DIRECT/13.107.4.50 application/octet-stream
> 1457958488.804 2835 10.101.1.163 TCP_MISS/206 37266 GET
> http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
> - HIER_DIRECT/13.107.4.50 application/octet-stream
> 1457958492.630 3824 10.101.1.163 TCP_MISS/206 43918 GET
> http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
> - HIER_DIRECT/13.107.4.50 application/octet-stream
> 1457958498.908 6274 10.101.1.163 TCP_MISS/206 93504 GET
> http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
> - HIER_DIRECT/13.107.4.50 application/octet-stream
> 1457958505.432 6523 10.101.1.163 TCP_MISS/206 72478 GET
> http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
> - HIER_DIRECT/13.107.4.50 application/octet-stream
>
> conf:
> cache_mem 4 GB
> maximum_object_size_in_memory 512 KB
> memory_replacement_policy heap GDSF
> cache_replacement_policy heap LFUDA
> maximum_object_size 10 GB
>
> cache_dir rock /cache2/rock1 90000 min-size=0 max-size=32768
> cache_dir rock /cache/rock1 150000 min-size=32769 max-size=5368725504
> cache_dir rock /cache/rock2 150000 min-size=5368725505
> max-size=10737418240
>
> acl wupdatecachable url_regex -i
> (microsoft|windowsupdate)\.com.*\.(cab|exe|ms[i|u|f]|dat|zip|psf|appx|appxbundle|esd)
> range_offset_limit -1 wupdatecachable
> quick_abort_pct 90
> refresh_pattern -i
> (microsoft|windowsupdate)\.com.*\.(cab|exe|ms[i|u|f]|dat|zip|psf|appx|appxbundle|esd)
> 483840 80% 483840 override-expire ignore-private ignore-no-store
>
> Best Regards,
>
More information about the squid-users
mailing list