[squid-users] squid stops replying
Amos Jeffries
squid3 at treenet.co.nz
Fri Aug 25 09:51:19 UTC 2017
On 25/08/17 20:34, Vieri wrote:
> ________________________________
> From: Amos Jeffries
>>
>> At ALL,9 that is a sign of major trouble. The log data is not going
>
>> where it should be. Please check your squid.conf that it is not sending
>> cache_log directive to /dev/null, a pipe or something.
> I do not define cache_log, so it should take the default value of "/var/log/squid/cache.log".
>
>>> # ps -ae | grep squid
>>> 4439 ? 05:29:57 squid
>>> 9059 ? 00:00:00 squid
>>> 9160 ? 00:00:00 squid
>>> 9162 ? 00:11:42 squid
>>> 9206 ? 00:00:00 squid
>>> 9208 ? 00:02:04 squid
>>> 9254 ? 00:00:00 squid
>>> 9257 ? 00:00:28 squid
>>> 9313 ? 00:00:00 squid
>>> 9315 ? 00:00:55 squid
>>
>> That seems a lot. What exactly are those processes each doing?
>> "ps aux | grep squid" should show the process roles.
>
>
> There are 4 reverse proxies, each one with their own squid conf file, and a caching HTTP/S proxy (tproxy).
> The one failing is the latter.
cache_log is one of the Squid directives which require a unique file
path+name per instance when running multiple instances.
As the wiki page <https://wiki.squid-cache.org/MultipleInstances> says,
it *might* work but the result is *probably* a garbled mess. And in your
case I'm relatively sure that some critical information is being
delivered into nul-space.
Also there will be issues with shared memory and such things on current
Squid if you run multiple instances on one machine without proper
instance naming - this will happen for some things even if you are not
using SMP workers.
Add the -n (lower case) command line option to your startup script(s),
with a unique instance name for each.
First thing to do is fix the above issues. Then whatever the pause is
about will be much easier to track down.
>
> Here's the process list (also includes external processes):
>
> # ps aux | grep squid
> squid 7139 7.9 0.6 276064 200472 ? S 10:10 1:11 (squid-1) -YC -f /etc/squid/squid.conf
> squid 7156 0.0 0.0 4012 640 ? S 10:10 0:00 (unlinkd)
> squid 7157 0.0 0.0 13904 3292 ? S 10:10 0:00 diskd 7310340 7310341 7310342
> squid 17857 0.0 0.0 4156 736 ? S 10:20 0:00 (logfile-daemon) /var/log/squid/access.log
> squid 17858 5.2 0.0 41780 7804 ? S 10:20 0:15 (ssl_crtd) -s /var/lib/squid/ssl_db -M 16MB
> squid 17859 0.6 0.0 41792 8000 ? S 10:20 0:01 (ssl_crtd) -s /var/lib/squid/ssl_db -M 16MB
> squid 17860 0.0 0.0 41780 7800 ? S 10:20 0:00 (ssl_crtd) -s /var/lib/squid/ssl_db -M 16MB
> squid 17861 0.0 0.0 41776 7608 ? S 10:20 0:00 (ssl_crtd) -s /var/lib/squid/ssl_db -M 16MB
> squid 17862 0.0 0.0 41776 7612 ? S 10:20 0:00 (ssl_crtd) -s /var/lib/squid/ssl_db -M 16MB
> squid 17863 0.0 0.0 27204 9120 ? S 10:20 0:00 /usr/bin/perl -w /usr/libexec/squid/ext_wbinfo_group_acl -K
> squid 17864 0.0 0.0 27140 8872 ? S 10:20 0:00 /usr/bin/perl -w /usr/libexec/squid/ext_wbinfo_group_acl -K
> squid 17865 0.0 0.0 27140 8872 ? S 10:20 0:00 /usr/bin/perl -w /usr/libexec/squid/ext_wbinfo_group_acl -K
> squid 17866 0.0 0.0 27140 8912 ? S 10:20 0:00 /usr/bin/perl -w /usr/libexec/squid/ext_wbinfo_group_acl -K
> squid 17867 0.0 0.0 27140 8912 ? S 10:20 0:00 /usr/bin/perl -w /usr/libexec/squid/ext_wbinfo_group_acl -K
> squid 17868 0.8 0.0 68920 15488 ? S 10:20 0:02 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
> squid 17869 0.1 0.0 68916 15380 ? S 10:20 0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
> squid 17870 0.0 0.0 68904 15400 ? S 10:20 0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
> squid 17871 0.0 0.0 68904 15484 ? S 10:20 0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
> squid 17872 0.0 0.0 68792 15292 ? S 10:20 0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
> squid 17873 0.0 0.0 19852 1812 ? S 10:20 0:00 (pinger)
> squid 18274 0.0 0.0 68792 15288 ? S 10:20 0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
> squid 18405 0.0 0.0 68792 15288 ? S 10:20 0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
> root 19737 0.0 0.0 87440 5856 ? Ss Aug23 0:00 /usr/sbin/squid -YC -f /etc/squid/squid.conf
> squid 21262 0.0 0.0 68792 15400 ? S 10:22 0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
> squid 21263 0.0 0.0 68792 15400 ? S 10:22 0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
> squid 21264 0.0 0.0 68792 15400 ? S 10:22 0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
> squid 21265 0.0 0.0 68792 15292 ? S 10:22 0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
> squid 21266 0.0 0.0 68792 15292 ? S 10:22 0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
> squid 21267 0.0 0.0 68792 15384 ? S 10:22 0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
> squid 21268 0.0 0.0 68792 15396 ? S 10:22 0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
> squid 21269 0.0 0.0 68792 15400 ? S 10:22 0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
> squid 21270 0.0 0.0 68792 15400 ? S 10:22 0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
> squid 21276 0.0 0.0 68792 15400 ? S 10:22 0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
> squid 22971 0.0 0.0 41772 7604 ? S 10:24 0:00 (ssl_crtd) -s /var/lib/squid/ssl_db -M 16MB
> root 23964 0.0 0.0 8968 944 pts/0 S+ 10:24 0:00 grep --colour=auto squid
> root 27129 0.0 0.0 84856 5140 ? Ss Aug24 0:00 /usr/sbin/squid -YC -f /etc/squid/squid.http.conf
> squid 27132 0.0 0.0 100980 26652 ? S Aug24 0:04 (squid-1) -YC -f /etc/squid/squid.http.conf
> squid 27134 0.0 0.0 19852 1716 ? S Aug24 0:03 (pinger)
> root 27281 0.0 0.0 86912 5192 ? Ss Aug24 0:00 /usr/sbin/squid -YC -f /etc/squid/squid.https.conf
> squid 27284 0.0 0.0 106484 31408 ? S Aug24 0:13 (squid-1) -YC -f /etc/squid/squid.https.conf
> squid 27290 0.0 0.0 19852 1816 ? S Aug24 0:03 (pinger)
> root 27956 0.0 0.0 86908 5172 ? Ss Aug24 0:00 /usr/sbin/squid -YC -f /etc/squid/squid.owa.conf
> squid 27958 0.0 0.0 99560 25016 ? S Aug24 1:24 (squid-1) -YC -f /etc/squid/squid.owa.conf
> squid 27961 0.0 0.0 19852 1812 ? S Aug24 0:04 (pinger)
> root 28106 0.0 0.0 86908 5188 ? Ss Aug24 0:00 /usr/sbin/squid -YC -f /etc/squid/squid.owa2.conf
> squid 28109 0.0 0.2 141024 66372 ? S Aug24 0:34 (squid-1) -YC -f /etc/squid/squid.owa2.conf
> squid 28113 0.0 0.0 19852 1716 ? S Aug24 0:04 (pinger)
>
>
>> If you run "squid -k shutdown ; squid -k shutdown" do they all fully stop?> (exactly that command, shutdown twice in a row)
>>
>> Once Squid is fully stopped, start it again. Is the problem resolved
>> when it comes back up?
>
>
> I'd have to wait for Squid to stop replying. That usually takes several days, maybe more than a week.
Okay. The above test was to see if the squid processes were all
correctly operating.
Since it is now clear that you have multiple instances stepping over
each others feet in the background please fix the issues with -n and the
multi-instance critical directives. *Then* do the above to ensure that
all instances are fully using the fixed setup.
If/when the problem occurs again you should be better placed to see what
is going on.
* crash recovery can be very slow on caching Squid as the cache_dir
require a full disk scan to load all the objects back in.
* a suddenly overloaded Squid that is using a lot of memory (ie huge
disk cache index) can take a lot of time to startup new dynamic helpers.
Both of the above can result in user-visible service pauses. There is
not much that can be done about it except workaround the cause of the
delay (better peak configuration, or patching the crash not to happen).
> The failing squid process is currently set up with:
> debug_options rotate=1 ALL,1
>
> Should I set a different level BEFORE it "stops working", ie. "now"?
> I'm asking because it's going to take a long while to reproduce this issue, and I just want to make sure I'll have enough info when it happens.
>
Probably not then. ALL,1 is sufficient to show crash issues if they
occur, and if nothing at all appears in the log later you can strace the
paused process to see what it is doing and maybe send it a "squid -n
_instance_name -d 9 " debug level change from the command line (if what
it is doing allows signals to get through before it is finished).
PS; are you using CentOS 6 or an older RHEL with kernel 2.6.x ?
It has recently just come up that they are still actively using those
old kernels containing broken TPROXY implementations. I vaguely recall
the symptoms are not always immediately visible, but triggered by
certain ICMP or TCP conditions.
Amos
More information about the squid-users
mailing list