<div dir="ltr"><div><div><div>Hi all,<br><br></div>So, we've been (slowly) investigating this issue these past days, and have reached some conclusions.<br><br></div>a) First, and sorry for not being clear on that, this only happens on "squid reload", not on full stop/start cycles.</div><div>A full start cycle does not give this error, that's why we are pretty sure the issue is not a bungled ACL, per se.<br></div><div><br></div><div>b) Besides that, it only happens when the proxy has some load on it, we have been unable to reproduce this on</div><div>our test machines, since they do not have a significant load. We've been postponing our ACL's changes for</div><div>early morning/lunch-hour these past days, and we didn't have had a FATAL error since last week.<br></div><div><br></div><div>c) Although we don't have non US-ASCII on the ACL's themselves, we have a lot of them on comments, so</div><div>I've stripped down all the comments of the ACL's files and tried that on our test bed, it didn't generare any</div><div>kind of errors, but since they do not have some load on it, we are not sure if it was the comments stripping <br></div>or the lack of load on the server...<br><br><div><div>So, we are now searching for an "easy" way of generating traffic on a squid server, so we can, at least, be</div><div>able to reproduce the error, so we can try the different solutions.... <br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br><br></div></div></div><div class="gmail_extra"><br><div class="gmail_quote">2017-10-18 1:06 GMT+01:00 Eliezer Croitoru <span dir="ltr"><<a href="mailto:eliezer@ngtech.co.il" target="_blank">eliezer@ngtech.co.il</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Are you validating your config files before committing them??<br>
If you have about 100 clients this is the first thing to do...<br>
Either run a asciii validation script for the whole file(I can write it if you really need it) or maintain two configuration testing node (CentOS 6+7).<br>
You don't even need to apply the configurations into the a running squid, you just need to run a command like "squid -kparse -f /etc/squid/squid.conf" and it will tell you what's wrong.<br>
<br>
Let me know if you need more help.<br>
<br>
Eliezer<br>
<br>
* CC me since I'm not watching the list daily these days.<br>
<br>
----<br>
<a href="http://ngtech.co.il/lmgtfy/" rel="noreferrer" target="_blank">http://ngtech.co.il/lmgtfy/</a><br>
Linux System Administrator<br>
Mobile: <a href="tel:%2B972-5-28704261" value="+972528704261">+972-5-28704261</a><br>
Email: <a href="mailto:eliezer@ngtech.co.il">eliezer@ngtech.co.il</a><br>
<br>
<br>
From: squid-users [mailto:<a href="mailto:squid-users-bounces@lists.squid-cache.org">squid-users-bounces@<wbr>lists.squid-cache.org</a>] On Behalf Of Francisco Amaro<br>
Sent: Thursday, October 12, 2017 19:25<br>
To: <a href="mailto:squid-users@lists.squid-cache.org">squid-users@lists.squid-cache.<wbr>org</a><br>
Subject: [squid-users] Squid 3.5.20 and 3.1.23 getting re-started with bogus "FATAL: Bungled" acls<br>
<div><div class="h5"><br>
Hello all,<br>
<br>
We are running stock CentOS 6 and CentOS 7 Squid builds, patched to the latest version, 3.1.23 and 3.5.20.<br>
We have several machines, running on separate locations, with an ACL file unique to all, that get's pushed to all machines using an homemade script. So local configuration (interfaces, cache locations, etc) is one file, and the bulk of the ACL's are included on<br>
a separate file, that is the same on all servers.<br>
<br>
For some time now, but getting more frequent on the last couple of weeks, we have been getting errors on our cache.log about bogus ACL's, forcing a squid restart. This happens on configuration reloads, which we do very frequently, maybe 10-20 times a day.<br>
<br>
On CentOS 6, the most frequent error is :<br>
<br>
FATAL: Bungled (null) line 203: icap_retry deny all<br>
<br>
We do not use icap_retry, it is missing from the config file, but this seems to be fixed on 3.2.4:<br>
<br>
Changes to squid-3.2.4 (03 Dec 2012):<br>
- Remove 'Bungled' warning on missing component directives<br>
<br>
On CentOS 7, the most frequent error is :<br>
<br>
FATAL: Bungled (null) line 3: sslproxy_cert_sign signTrusted all<br>
<br>
Now this one even has a bug entry, and was fixed on 3.3.5:<br>
<br>
Changes to squid-3.3.5 (20 May 2013):<br>
- Bug 3744: squid terminated: FATAL: Bungled (null) line 3: sslproxy_cert_sign signTrusted all<br>
<br>
But we are still seeing it on 3.5.20...<br>
<br>
Now what is even more weird is that besides that, we are getting what seem complete random bogus entries, like this ones:<br>
<br>
FATAL: Bungled /etc/squid/squid_acls line 11796: acl xyz_allow_url<br>
FATAL: Bungled /etc/squid/squid_acls line 10905: acl abc_url108 dstdomai<br>
<br>
FATAL: Bungled squid_acls line 10033: http_access allow def_<br>
FATAL: Bungled squid_acls line 9605: http_access allow ms_src_teste ms_t<br>
FATAL: Bungled squid_acls line 11025: http_access allow xpto<br>
<br>
The problem is that these lines are 100% correct , they are not "bungled" at all, it seems the parser as some issue with it.<br>
<br>
Each time we get an error like this, Squid does a full restart, and that on CentOS 6 is time consuming, maybe 2-3 minutes, time enough for our users reaching for the Helpdesk tickets... On CentOS 7, since the restart is very fast, we do not have many complaints...<br>
<br>
Our ACL file is currently 7500 lines, mostly comprising of dstdomain and url_regex entries. We support a lot of costumers (about 100) and each one has a specific configuration. Mostly have while lists, and there are a few blacklists in the middle... so, not very big in terms of line numbers, but somewhat complex regarding site/VLAN entries...<br>
<br>
For security/privacy reasons I cannot share my complete configuration, namely the ACL's part, since they contain client information, but I am able to get detailed logging and/or redacted information...<br>
<br>
So... anyone has any clue what is happenning ?<br>
<br>
<br>
<br>
--<br>
<br>
<br>
Francisco Amaro<br>
</div></div>Email: mailto:<a href="mailto:famaro@gmail.com">famaro@gmail.com</a><br>
<br>
</blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature" data-smartmail="gmail_signature">Francisco Amaro <br>Email: <a href="mailto:famaro@gmail.com" target="_blank">famaro@gmail.com</a></div>
</div>