[squid-users] tuning squid memory (aka avoiding the reaper)

[Aaron Turner]

Ok, i'll work on that.  One other thing, is that if I let it run long
enough, squid will crash with errors like the following:

FATAL: Received Bus Error...dying.
2017/09/28 23:28:09 kid4| Closing HTTP port 10.93.3.4:3128
2017/09/28 23:28:09 kid4| Closing HTTP port 127.0.0.1:3128
2017/09/28 23:28:09 kid4| storeDirWriteCleanLogs: Starting...
2017/09/28 23:28:09 kid4|   Finished.  Wrote 0 entries.
2017/09/28 23:28:09 kid4|   Took 0.00 seconds (  0.00 entries/sec).
CPU Usage: 0.541 seconds = 0.466 user + 0.075 sys
Maximum Resident Size: 121440 KB
Page faults with physical i/o: 0

At first I thought the bus error was hardware, but it's happened on
two different EC2 instances now.

--
Aaron Turner
https://synfin.net/         Twitter: @synfinatic
My father once told me that respect for the truth comes close to being
the basis for all morality.  "Something cannot emerge from nothing,"
he said.  This is profound thinking if you understand how unstable
"the truth" can be.  -- Frank Herbert, Dune


On Thu, Sep 28, 2017 at 3:32 PM, Amos Jeffries <squid3 at treenet.co.nz> wrote:
> On 29/09/17 09:19, Aaron Turner wrote:
>>
>> Ok, so did some research and what I'm finding is that:
>>
>> If I set sslflags=NO_DEFAULT_CA for http_port and disable both mem and
>> disk cache then memory is very stable.  It goes up for a little bit
>> and then pretty much stabilizes (it actually goes up and down a
>> little, but doesn't seem to be growing or trending up).
>>
>> I then enabled memory cache (10GB worth) and ran that for a while.  As
>> the cache filled, memory usage obviously went up.  Once the cache
>> filled, memory usage continued to increase, but at a slower rate.
>> Unlike before, it doesn't seem to stabilize.  I'm seeing memory usage
>> increase in top (virtual, resident & shared) as well as in mgr:info's
>> "Total accounted" line.  It's not growing as fast before when I didn't
>> have the sslflags option, but it is growing.
>>
>> What other information would be useful to debug this?
>>
>
> Since the accounted is growing the mgr:mem report should contain some clues.
> It is a TSV spreadsheet of memory allocations, you may need a few snapshots
> of it to see trends.
>
> Amos
> _______________________________________________
> squid-users mailing list
> squid-users at lists.squid-cache.org
> http://lists.squid-cache.org/listinfo/squid-users