<html>
<head>
<meta content="text/html; charset=utf-8" http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<br>
<br>
I know what is happening. I just don't know how to fix it without
breaking windows updates caching.<br>
The "extra" traffic is coming from windows updates mirrors.<br>
<br>
<i>acl wupdatecachable url_regex -i
(microsoft|windowsupdate)\.com.*\.(cab|exe|ms[i|u|f]|dat|zip|psf|appx|appxbundle|esd)</i><i><br>
</i><i>range_offset_limit none wupdatecachable</i><br>
<br>
Commenting this second line is enough to put an end to the insane
downloads. But then all the RANGE requests of windows updates won't
be cached.<br>
<br>
I don't know how to explain these FD numbers. I'm using EXT4 and I
don't know what are vmware cache disks.<br>
<br>
Oh, and it seems not only windows updates' range requests are giving
trouble:<br>
<br>
1457381845.725 241 10.101.1.23 TCP_SWAPFAIL_MISS/206 33123 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381846.036 293 10.101.1.23 TCP_SWAPFAIL_MISS/206 151352 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381846.120 66 10.101.1.23 TCP_SWAPFAIL_MISS/206 33129 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381846.310 66 10.101.1.23 TCP_SWAPFAIL_MISS/206 33129 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381846.397 60 10.101.1.23 TCP_SWAPFAIL_MISS/206 33129 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381846.514 63 10.101.1.23 TCP_SWAPFAIL_MISS/206 33129 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381846.633 65 10.101.1.23 TCP_SWAPFAIL_MISS/206 33129 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381846.747 63 10.101.1.23 TCP_SWAPFAIL_MISS/206 33129 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381846.839 63 10.101.1.23 TCP_SWAPFAIL_MISS/206 33129 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381846.949 81 10.101.1.23 TCP_SWAPFAIL_MISS/206 33129 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381847.041 61 10.101.1.23 TCP_SWAPFAIL_MISS/206 33129 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381847.192 118 10.101.1.23 TCP_SWAPFAIL_MISS/206 65897 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381847.447 207 10.101.1.23 TCP_SWAPFAIL_MISS/206 121720 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381862.824 639 10.101.1.23 TCP_SWAPFAIL_MISS/206 33122 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381865.720 2879 10.101.1.23 TCP_SWAPFAIL_MISS/206 221234 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381866.078 343 10.101.1.23 TCP_SWAPFAIL_MISS/206 33130 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381867.107 995 10.101.1.23 TCP_SWAPFAIL_MISS/206 33128 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381867.523 400 10.101.1.23 TCP_SWAPFAIL_MISS/206 33128 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381867.830 291 10.101.1.23 TCP_SWAPFAIL_MISS/206 33128 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381868.082 238 10.101.1.23 TCP_SWAPFAIL_MISS/206 33128 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381868.318 219 10.101.1.23 TCP_SWAPFAIL_MISS/206 33128 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381868.503 171 10.101.1.23 TCP_SWAPFAIL_MISS/206 33128 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381868.695 174 10.101.1.23 TCP_SWAPFAIL_MISS/206 33128 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381868.880 170 10.101.1.23 TCP_SWAPFAIL_MISS/206 33128 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381869.179 286 10.101.1.23 TCP_SWAPFAIL_MISS/206 65896 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381869.424 231 10.101.1.23 TCP_SWAPFAIL_MISS/206 65896 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381869.761 322 10.101.1.23 TCP_SWAPFAIL_MISS/206 65896 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381870.008 232 10.101.1.23 TCP_SWAPFAIL_MISS/206 65896 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381870.236 214 10.101.1.23 TCP_SWAPFAIL_MISS/206 65896 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381870.429 178 10.101.1.23 TCP_SWAPFAIL_MISS/206 65896 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381870.609 174 10.101.1.23 TCP_SWAPFAIL_MISS/206 65896 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381870.805 180 10.101.1.23 TCP_SWAPFAIL_MISS/206 65897 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
1457381871.008 189 10.101.1.23 TCP_SWAPFAIL_MISS/206 65898 GET
<a class="moz-txt-link-freetext" href="http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf">http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2016-02/1022313/sumario.pdf</a>
- HIER_DIRECT/201.49.144.135 application/pdf<br>
<br>
Best Regards,<br>
<br>
<pre class="moz-signature" cols="72">--
Heiler Bemerguy - (91) 98151-4894
Assessor Técnico - CINBESA (91) 3184-1751</pre>
<br>
<div class="moz-cite-prefix">Em 07/03/2016 18:00, Eliezer Croitoru
escreveu:<br>
</div>
<blockquote cite="mid:56DDEBEF.90109@ngtech.co.il" type="cite">On
07/03/2016 22:08, Yuri Voinov wrote:
<br>
<blockquote type="cite">90 Gb first, 300 Gb second.
<br>
</blockquote>
Thanks but...
<br>
Wouldn't it be much simpler and cheaper to just use WSUS instead
all of the hassle??(if it's a closed business environment)
<br>
And when does the TCP_SWAPFAIL_MISS happens? always?
<br>
And a little tweak for the squid.conf
<br>
read_ahead_gap 4096 KB
<br>
<br>
The above doesn't match your environment bandwidth.
<br>
You are just spending too much bandwidth on requests that might
not be fulfilled.
<br>
Try changing the settings to:
<br>
read_ahead_gap 128 KB
<br>
<br>
and see if it helps with something.
<br>
Also since your issue is bandwidth and users are not allowed to
the Internet without the proxy I would try to dump the pfsense pf
states to see what happens in the network layer, what src IP is
consuming all this bandwidth.(or get a wider picture)
<br>
Also squid would not be the answer for a fully reasonable network
usage, it only comes to help with couple specific things and not
to mirror the whole Internet or even just MS as it is.(not saying
that your case is a trial such as this)
<br>
MS has more then one API that can be mistaken as a download and it
can consume more then actually required caching.
<br>
<br>
I do not know exactly what this means from the info page:
<br>
Maximum number of file descriptors: 81920
<br>
Largest file desc currently in use: 6157
<br>
Number of file desc currently in use: 8216
<br>
<br>
If the number of FD currently in use is 8216 then the largest file
desc currently in use doesn't match.
<br>
This specific question might be a bug or expected result but I do
not know and Amos or Alex or others might know the answer for this
specific info page issue.
<br>
<br>
Another question I have which might be related(I have experienced
such issues with GlusterFS in the past), how is the VM cache
disk\s are connected? Is it connected directly to the VM or in the
hypervisor level?
<br>
How do you mount them(fstab)? are these on the root disk or do you
have couple disks mounted?
<br>
Did you had the chance to try to use other FS then EXT4? reiserFS?
XFS? other?
<br>
<br>
The above questions are related to the TCP_SWAPFAIL_MISS.
<br>
Since there is an issue and you are probably only on the
"buffering" testing stage of the cache_dir I would try to somehow
reproduce the issue but it's not clear to me what is the exact way
to replicate the issue.
<br>
<br>
Thanks,
<br>
Eliezer
<br>
</blockquote>
<br>
</body>
</html>