<div dir="ltr">Hi Lukas,<div>Yeah, that is somewhat consistent with what we notice in our setup. The leak appears to grow only when the traffic through the squid approaches the previous day's mid-high request rates, but not during low request rates.</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Dec 24, 2021 at 4:25 AM Lukáš Loučanský <<a href="mailto:loucansky.lukas@kjj.cz">loucansky.lukas@kjj.cz</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div>
<p><font face="Helvetica, Arial, sans-serif">Sorry - maybe I'll post
something irrelevant - but my Squid5.3 is running for 3 days
now. As it seems the number of user's requests declined (xmas
holliday) - the memory consuption stabilized and is not
increasing (seemingly - I check only by mrtg figures - I'dont
sample memory info because it seemed not prooffing) <br>
</font></p>
<p><font face="Helvetica, Arial, sans-serif">Anyway general info
shows:</font></p>
<pre style="color:rgb(0,0,0);font-size:medium;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial"><font face="Helvetica, Arial, sans-serif">Maximum Resident Size: 48399664 KB
Page faults with physical i/o: 171
Memory accounted for:
Total accounted: 2013907 KB
memPoolAlloc calls: 390527804
memPoolFree calls: 395188267
Max resident size 46GB???
Memory allocated total: <span style="color:rgb(0,0,0);font-size:medium;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:nowrap;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">2014463 kB.
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
15487 proxy 20 0 11.6g 11.5g 10344 S 0.0 73.7 103:34.23 (squid-1) --kid squid-1 -YC -f /etc/squid5/squid.conf
Is it something not included in the memory utilization chart? Something tied to connections? requests? ssl contexts?
</span>L</font>
</pre>
<div>Dne 24.12.2021 v 7:59 Praveen Ponakanti
napsal(a):<br>
</div>
<blockquote type="cite">
<div dir="ltr">Hi Alex,
<div><br>
</div>
<div>I have attached a log with about 24 hours of memory stats
from our squid proxy running version 5.3. The memory usage
increased during the first 11-12 hours of the log and then
flatted out. The same pattern repeats itself each day
with about an additional 2-3G being used up. Let me know if
you need any additional logs. I will take another shot at the
test setup with Valgrind later on. Happy holidays!</div>
<div><br>
</div>
<div><a href="https://bugs.squid-cache.org/show_bug.cgi?id=5132" target="_blank">https://bugs.squid-cache.org/show_bug.cgi?id=5132</a><br>
</div>
<div><br>
</div>
<div>Thanks</div>
<div>Praveen</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Thu, Dec 23, 2021 at 6:23
AM Alex Rousskov <<a href="mailto:rousskov@measurement-factory.com" target="_blank">rousskov@measurement-factory.com</a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">On
12/23/21 1:58 AM, Praveen Ponakanti wrote:<br>
> On Wed, Dec 22, 2021 at 6:45 AM Alex Rousskov wrote:<br>
> <br>
> On 12/21/21 7:48 PM, Praveen Ponakanti wrote:<br>
> <br>
> > We are running the squid proxy for servicing
outbound HTTP quests from<br>
> > our network and have observed a significant
memory leak with 5.x<br>
> > versions. While there are several discussions
about memory leaks with<br>
> > recent versions, just wanted to list out what we
have observed in case<br>
> > this is an unknown leak.<br>
> <br>
> I recommend sharing a log with 48+ hourly mgr:mem
snapshots. These<br>
> snapshots help compare your leak with others we know
about and may help<br>
> isolate some of the memory leaks:<br>
> <a href="https://bugs.squid-cache.org/show_bug.cgi?id=5132#c8" rel="noreferrer" target="_blank">https://bugs.squid-cache.org/show_bug.cgi?id=5132#c8</a><br>
<br>
> I will continue collecting these stats hourly.<br>
<br>
I will analyze those logs once you share them. Comparing two
snapshots<br>
from different Squid versions/instances may be useful, but it
is much<br>
more time consuming, and I cannot offer to do that right now.<br>
<br>
<br>
> The output appears to be quite large<br>
<br>
> ... where do I send the files with the memory logs?<br>
<br>
The scripts that track memory usage changes across hourly
snapshots do<br>
not care about the log size. However, you may want to share a
link to<br>
the (compressed) log rather than sharing the log itself. The
best place<br>
to share that info, IMO, is the bug report I referenced above,
but you<br>
can post here, of course.<br>
<br>
<br>
> I might have to fix how it is launched from<br>
> the docker entrypoint script in my test env. <br>
<br>
FWIW, here is one of the valgrind commands I use (with paths
stripped):<br>
<br>
> valgrind -v --trace-children=no
--child-silent-after-fork=yes --num-callers=50
--log-file=valgrind-%p.log --time-stamp=yes --leak-check=full
--leak-resolution=high --show-reachable=no --track-origins=no
--gen-suppressions=all --suppressions=valgrind.supp squid -f
squid.conf ...<br>
<br>
Valgrind reports useful leak info after Squid exits.<br>
<br>
I do not have updated/polished Valgrind suppressions, but I
can share<br>
what I use:<br>
<a href="https://gist.github.com/rousskov/a1f503981b4a3832ab44221b0b615b5a" rel="noreferrer" target="_blank">https://gist.github.com/rousskov/a1f503981b4a3832ab44221b0b615b5a</a><br>
<br>
I do not use gdb/valgrind monitor so I cannot help you there.<br>
<br>
<br>
HTH,<br>
<br>
Alex.<br>
</blockquote>
</div>
<br>
<fieldset></fieldset>
<pre>_______________________________________________
squid-users mailing list
<a href="mailto:squid-users@lists.squid-cache.org" target="_blank">squid-users@lists.squid-cache.org</a>
<a href="http://lists.squid-cache.org/listinfo/squid-users" target="_blank">http://lists.squid-cache.org/listinfo/squid-users</a>
</pre>
</blockquote>
<div id="gmail-m_-8843196809291168515DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2"><br> <table style="border-top:1px solid rgb(211,212,222)">
<tbody><tr>
<td style="width:55px;padding-top:18px"><a href="https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient" target="_blank"><img src="https://ipmcdn.avast.com/images/icons/icon-envelope-tick-round-orange-animated-no-repeat-v1.gif" alt="" width="46" height="29" style="width: 46px; height: 29px;"></a></td>
<td style="width:470px;padding-top:17px;color:rgb(65,66,78);font-size:13px;font-family:Arial,Helvetica,sans-serif;line-height:18px">Bez virů. <a href="https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient" style="color:rgb(68,83,234)" target="_blank">www.avast.com</a> </td>
</tr>
</tbody></table>
<a href="#m_-8843196809291168515_DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2" width="1" height="1"> </a></div></div>
_______________________________________________<br>
squid-users mailing list<br>
<a href="mailto:squid-users@lists.squid-cache.org" target="_blank">squid-users@lists.squid-cache.org</a><br>
<a href="http://lists.squid-cache.org/listinfo/squid-users" rel="noreferrer" target="_blank">http://lists.squid-cache.org/listinfo/squid-users</a><br>
</blockquote></div>