[squid-users] Sudden but sustained high bandwidth usage

[Heiler Bemerguy]

Hi Eliezer,

We usually don't restart it ever. Only recently I've been restarting it 
because of these issues. The shutdown_lifetime is set to 5 seconds only.

We are still getting SWAPFAIL_MISS without any apparent reason, and if 
it is for a RANGE request, it would multiply it to many parallel 
connections.... I'd like to track it down but I'm afraid I don't have 
the knowledge to do it...

root at proxy:/var/log/squid# tail -f access.log |grep SWAPF
1457703376.593    383 10.88.100.100 TCP_SWAPFAIL_MISS/206 533 GET 
http://vdownloader.com/wp-content/uploads/multiwebsite-570x321.png - 
HIER_DIRECT/104.25.245.28 image/png
1457703376.942    726 10.88.100.100 TCP_SWAPFAIL_MISS/206 530 GET 
http://vdownloader.com/wp-content/uploads/social-media-share-570x321.jpg 
- HIER_DIRECT/104.25.244.28 image/jpeg
1457703376.964    746 10.88.100.100 TCP_SWAPFAIL_MISS/206 529 GET 
http://vdownloader.com/wp-content/uploads/Cnet-logo.png - 
HIER_DIRECT/104.25.244.28 image/png
1457703540.685 106669 10.101.1.50 TCP_SWAPFAIL_MISS/200 3342325 GET 
http://www.rarlab.com/rar/wrar531br.exe - HIER_DIRECT/5.135.104.98 
application/octet-stream
1457703631.055   4088 10.101.1.130 TCP_SWAPFAIL_MISS/206 33062 GET 
http://www.cetapnet.com.br/arquivos_cetap/arquivos/pma_001_2015_anexo_03.pdf 
- HIER_DIRECT/200.219.214.204 application/pdf
1457703637.471   6407 10.101.1.130 TCP_SWAPFAIL_MISS/206 352287 GET 
http://www.cetapnet.com.br/arquivos_cetap/arquivos/pma_001_2015_anexo_03.pdf 
- HIER_DIRECT/200.219.214.204 application/pdf
1457703755.673    262 10.72.0.24 TCP_SWAPFAIL_MISS/206 21736 GET 
http://ciac.ufpa.br/phocadownload/EDITAL_018-2016-RET-HOM_REC_2-CH-SISU-2016.pdf 
- HIER_DIRECT/200.239.64.160 application/pdf
1457703755.712     35 10.72.0.24 TCP_SWAPFAIL_MISS/206 65938 GET 
http://ciac.ufpa.br/phocadownload/EDITAL_018-2016-RET-HOM_REC_2-CH-SISU-2016.pdf 
- HIER_DIRECT/200.239.64.160 application/pdf

Best Regards,

-- 
Heiler Bemerguy - (91) 98151-4894
Assessor Técnico - CINBESA (91) 3184-1751


Em 11/03/2016 00:36, Eliezer Croitoru escreveu:
> Hey,
>
> I wanted to ask something very specific, how often do you restart the 
> service if at all? what shutdown_flifetime 
> [http://www.squid-cache.org/Doc/config/shutdown_lifetime/] are you using?
>
> Eliezer
>
> On 09/03/2016 15:17, Heiler Bemerguy wrote:
>>
>> Hi Amos,
>>
>> Now you can help me on tracking it down.. lol... can you? I don't know
>> what debug_options (apart of 88,3) I should enable.
>> I just know that disabling range_offset will eliminate this issue,
>> because it won't even try to cache range requests. Also, it didn't
>> happen when I was using AUFS.
>>
>> Another examples:
>> 2016/03/09 00:27:54.016 kid2| 88,3| client_side_reply.cc(463) cacheHit:
>> clientCacheHit: http://au.download.windowsupdate.com/c/msdownload/upda
>> te/software/secu/2016/02/ie11-windows6.1-kb3139929-x64_55bffa59079eb8da45400d6b0432262f96adb3b0.psf, 
>>
>> 0 bytes
>> 2016/03/09 00:27:54.016 kid2| 88,3| client_side_reply.cc(470) cacheHit:
>> clientCacheHit: swapin failure for http://au.download.windowsupdate.co
>> m/c/msdownload/update/software/secu/2016/02/ie11-windows6.1-kb3139929-x64_55bffa59079eb8da45400d6b0432262f96adb3b0.psf 
>>
>>
>>
>> There are some 0 bytes responses (giving a swapin failure) that won't
>> give me much trouble because files are small, like this:
>> 2016/03/09 09:57:25.107 kid2| 88,3| client_side_reply.cc(463) cacheHit:
>> clientCacheHit:
>> http://www.mte.gov.br/images/Imagens/Noticias/2016/BRICS31.JPG, 0 bytes
>> 2016/03/09 09:57:25.107 kid2| 88,3| client_side_reply.cc(470) cacheHit:
>> clientCacheHit: swapin failure for
>> http://www.mte.gov.br/images/Imagens/Noticias/2016/BRICS31.JPG
>>
>> Looking the source code:
>>          debugs(88, 3, "HIT object being deleted. Ignore the HIT.");
>>          return;
>>      }
>>
>>      StoreEntry *e = http->storeEntry();
>>
>>      HttpRequest *r = http->request;
>>
>>      debugs(88, 3, "clientCacheHit: " << http->uri << ", " <<
>> result.length << " bytes");
>>
>>      if (http->storeEntry() == NULL) {
>>          debugs(88, 3, "clientCacheHit: request aborted");
>>
>> I don't get this "deleted", so the object is not being deleted, and
>> "request aborted" is not being show too..
>>
>> Best Regards,
>>
>>
>
> _______________________________________________
> squid-users mailing list
> squid-users at lists.squid-cache.org
> http://lists.squid-cache.org/listinfo/squid-users