<html><head></head><body><div style="font-family: Verdana;font-size: 12.0px;"><div> </div>
<div>Hi Eliezer,<br/>
<br/>
I hope your doing ok. Thanks for the reply. Yeah currently what I am doing is:<br/>
<br/>
include /etc/squid/blockedsites.list<br/>
and adding the ACL's and the denies in the list file. What version do you recommend I upgrade to, and is this a known issue? The list is actually pretty small, probably no more than 50 sites or so, and thats split across 4 or 5 groups (different ACL's). I'll look into ufdbguard and the other projects as well, does this sound familiar though? If you think that the best path forward is to alleviate the burden off of squid to some external tool, I could probably think up a few hacks to for that, but would obviously prefer to keep it all within squid. Is this occurance common with squid -k reconfigure and dstdomain matching? Thanks for your time. Stay safe.
<div>
<div name="quote" style="margin:10px 5px 5px 10px; padding: 10px 0 10px 10px; border-left:2px solid #C3D9E5; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;">
<div style="margin:0 0 10px 0;"><b>Sent:</b> Sunday, March 28, 2021 at 4:42 AM<br/>
<b>From:</b> "Eliezer Croitoru" <ngtech1ltd@gmail.com><br/>
<b>To:</b> squid-users@lists.squid-cache.org<br/>
<b>Subject:</b> Re: [squid-users] [SPAM] Squid stops serving requests after squid -k reconfigure</div>
<div name="quoted-content"><!--p.MsoNormal, li.MsoNormal, div.MsoNormal {
margin: 0.0in;
font-size: 11.0pt;
font-family: Calibri , sans-serif;
}
a:link, span.MsoHyperlink {
color: blue;
text-decoration: underline;
}
span.EmailStyle20 {
font-family: Calibri , sans-serif;
color: windowtext;
}
*.MsoChpDefault {
font-size: 10.0pt;
}
div.WordSection1 {
page: WordSection1;
}
-->
<div>
<div class="WordSection1">
<p class="MsoNormal">Hey Acid,</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">Haven’t seen you here for a very long time.</p>
<p class="MsoNormal">The first thing is to upgrade squid if possible…</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">It’s better that you won’t use squid -kreconf for big blacklists.</p>
<p class="MsoNormal">Instead you should use some external software to match the blacklists.</p>
<p class="MsoNormal">The most recommended software these days is ufdbguard.</p>
<p class="MsoNormal">Depends on the size of your blacklist your might need to find the right solution.</p>
<p class="MsoNormal">The best solution would be to store the list in ram somehow.</p>
<p class="MsoNormal">Have you tried some kind of rbl server?</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">At the time I wrote some code to and some of it was merged into:</p>
<p class="MsoNormal"><a href="https://github.com/looterz/grimd" target="_blank">https://github.com/looterz/grimd</a></p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">It has a reload url so you can update the files on disk and send a reload.</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">Another service I am using is:</p>
<p class="MsoNormal"><a href="https://github.com/andybalholm/redwood" target="_blank">https://github.com/andybalholm/redwood</a></p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">Which has a “Classification Service” function.</p>
<p class="MsoNormal">It’s pretty easy to write a json http client that can run queries against this classification service.</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">Also you’d better use a file In the dstdomain ac ie:</p>
<p class="MsoNormal"><span style="font-size: 9.0pt;font-family: Verdana , sans-serif;">acl Blacklist dstdomain “/var/blacklists/xyx.list”</span></p>
<p class="MsoNormal"><span style="font-size: 9.0pt;font-family: Verdana , sans-serif;">http_access deny Blacklist</span></p>
<p class="MsoNormal"><span style="font-size: 9.0pt;font-family: Verdana , sans-serif;"> </span></p>
<p class="MsoNormal"><span style="font-size: 9.0pt;font-family: Verdana , sans-serif;">and inside the xyx.list file just add lines of domains like</span></p>
<p class="MsoNormal"><span style="font-size: 9.0pt;font-family: Verdana , sans-serif;">.blacklisted-domain.com</span></p>
<p class="MsoNormal"><span style="font-size: 9.0pt;font-family: Verdana , sans-serif;">.example.com</span></p>
<p class="MsoNormal"><span style="font-size: 9.0pt;font-family: Verdana , sans-serif;"> </span></p>
<p class="MsoNormal"><span style="font-size: 9.0pt;font-family: Verdana , sans-serif;">Etc..</span></p>
<p class="MsoNormal"><span style="font-size: 9.0pt;font-family: Verdana , sans-serif;"> </span></p>
<p class="MsoNormal"><span style="font-size: 9.0pt;font-family: Verdana , sans-serif;"> </span></p>
<p class="MsoNormal"><span style="font-size: 9.0pt;font-family: Verdana , sans-serif;">All The Bests,</span></p>
<p class="MsoNormal"><span style="font-size: 9.0pt;font-family: Verdana , sans-serif;">Eliezer</span></p>
<p class="MsoNormal"> </p>
<div>
<p class="MsoNormal">----</p>
<p class="MsoNormal">Eliezer Croitoru</p>
<p class="MsoNormal">Tech Support</p>
<p class="MsoNormal">Mobile: +972-5-28704261</p>
<p class="MsoNormal">Email: <a href="mailto:ngtech1ltd@gmail.com" onclick="parent.window.location.href='mailto:ngtech1ltd@gmail.com'; return false;" target="_blank"><span style="color: blue;">ngtech1ltd@gmail.com</span></a></p>
<p class="MsoNormal">Zoom: Coming soon</p>
<p class="MsoNormal"> </p>
</div>
<p class="MsoNormal"> </p>
<div>
<div style="border: none;border-top: solid rgb(225,225,225) 1.0pt;padding: 3.0pt 0.0in 0.0in 0.0in;">
<p class="MsoNormal"><b>From:</b> squid-users <squid-users-bounces@lists.squid-cache.org> <b>On Behalf Of </b>acidflash acidflash<br/>
<b>Sent:</b> Saturday, March 27, 2021 10:55 AM<br/>
<b>To:</b> squid-users@lists.squid-cache.org<br/>
<b>Subject:</b> [SPAM] [squid-users] Squid stops serving requests after squid -k reconfigure</p>
</div>
</div>
<p class="MsoNormal"> </p>
<div>
<p><span style="font-size: 12.0pt;font-family: "Times New Roman" , serif;">I have gone through the forums, and I haven't found an answer to the question, although it has been asked more than once.</span></p>
<p><span style="font-size: 12.0pt;font-family: "Times New Roman" , serif;">I am running squid 3.5.X on Centos 7, the compile options are:<br/>
"configure options: '--build=x86_64-redhat-linux-gnu' '--host=x86_64-redhat-linux-gnu' '--program-prefix=' '--prefix=/usr' '--exec-prefix=/usr' '--bindir=/usr/bin' '--sbindir=/usr/sbin' '--sysconfdir=/etc' '--datadir=/usr/share' '--includedir=/usr/include' '--libdir=/usr/lib64' '--libexecdir=/usr/libexec' '--sharedstatedir=/var/lib' '--mandir=/usr/share/man' '--infodir=/usr/share/info' '--disable-strict-error-checking' '--exec_prefix=/usr' '--libexecdir=/usr/lib64/squid' '--localstatedir=/var' '--datadir=/usr/share/squid' '--sysconfdir=/etc/squid' '--with-logdir=$(localstatedir)/log/squid' '--with-pidfile=$(localstatedir)/run/squid.pid' '--disable-dependency-tracking' '--enable-eui' '--enable-follow-x-forwarded-for' '--enable-auth' '--enable-auth-basic=DB,LDAP,MSNT-multi-domain,NCSA,NIS,PAM,POP3,RADIUS,SASL,SMB,SMB_LM,getpwnam' '--enable-auth-ntlm=smb_lm,fake' '--enable-auth-digest=file,LDAP,eDirectory' '--enable-auth-negotiate=kerberos' '--enable-external-acl-helpers=file_userip,LDAP_group,time_quota,session,unix_group,wbinfo_group,kerberos_ldap_group' '--enable-cache-digests' '--enable-cachemgr-hostname=localhost' '--enable-delay-pools' '--enable-epoll' '--enable-ident-lookups' '--enable-linux-netfilter' '--enable-removal-policies=heap,lru' '--enable-snmp' '--enable-ssl-crtd' '--enable-storeio=aufs,diskd,rock,ufs' '--enable-wccpv2' '--enable-esi' '--enable-ecap' '--with-aio' '--with-default-user=squid' '--with-dl' '--with-openssl' '--with-pthreads' '--disable-arch-native' 'build_alias=x86_64-redhat-linux-gnu' 'host_alias=x86_64-redhat-linux-gnu' 'CFLAGS=-O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -fpie' 'LDFLAGS=-Wl,-z,relro -pie -Wl,-z,relro -Wl,-z,now' 'CXXFLAGS=-O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -fpie' 'PKG_CONFIG_PATH=:/usr/lib64/pkgconfig:/usr/share/pkgconfig'"</span></p>
<p><span style="font-size: 9.0pt;font-family: Verdana , sans-serif;"> </span></p>
<p><span style="font-size: 9.0pt;font-family: Verdana , sans-serif;">I have a service which adds domains to a blacklist file, and then calls squid -k reconfigure.<br/>
Instead of writing to the file, this service updates the file completely with new rules,<br/>
by deleting the old file, and creating a new one in its place, and then calling squid -k reconfigure.<br/>
After doing this, on odd occasions, squid will stop serving traffic completely,<br/>
until you do a squid stop, and squid start. After shutting down squid,<br/>
and starting squid up with the same rules, squid will continue to work normally.<br/>
Its probably worth mentioning that during the time that these events are taking place,<br/>
the server is under quite a bit of load, and clients don't stop sending requests via the server.<br/>
What these directives look like:<br/>
<br/>
acl Porn dstdomain .xnxx.com .sex.com <br/>
acl Drugs dstdomain .drugs.com .silkroad.eu <br/>
http_access deny Porn<br/>
http_access deny Drugs</span></p>
<p><span style="font-size: 9.0pt;font-family: Verdana , sans-serif;"> </span></p>
<p><span style="font-size: 9.0pt;font-family: Verdana , sans-serif;">This also seems to be amplified when there are several squid workers (child processes) running.<br/>
In regards to order, these ACL's are above any other ACL's in the list. We have a very basic squid conf file that looks like this:<br/>
## START OF FILE<br/>
http_port 3128<br/>
cache deny all<br/>
#<br/>
access_log /var/log/squid/access.log <br/>
cache_store_log none<br/>
cache_log /dev/null<br/>
logfile_rotate 4<br/>
#<br/>
auth_param basic program /usr/lib64/squid/basic_db_auth --dsn "DBI:mysql:host=XX.XX.XX.XX;port=XXXX;database=XXXXX" --user XXXXXX --password XXXXXXXX --plaintext --persist<br/>
# <br/>
acl db-auth proxy_auth REQUIRED<br/>
auth_param basic credentialsttl 2 hours<br/>
auth_param basic casesensitive on<br/>
#<br/>
connect_timeout 55 minutes<br/>
#<br/>
request_header_access Allow allow all<br/>
request_header_access Authorization allow all<br/>
request_header_access WWW-Authenticate allow all<br/>
request_header_access Proxy-Authorization allow all<br/>
request_header_access Proxy-Authenticate allow all<br/>
request_header_access Cache-Control allow all<br/>
request_header_access Content-Encoding allow all<br/>
request_header_access Content-Length allow all<br/>
request_header_access Content-Type allow all<br/>
request_header_access Date allow all<br/>
request_header_access Expires allow all<br/>
request_header_access Host allow all<br/>
request_header_access If-Modified-Since allow all<br/>
request_header_access Last-Modified allow all<br/>
request_header_access Location allow all<br/>
request_header_access Pragma allow all<br/>
request_header_access Accept allow all<br/>
request_header_access Accept-Charset allow all<br/>
request_header_access Accept-Encoding allow all<br/>
request_header_access Accept-Language allow all<br/>
request_header_access Content-Language allow all<br/>
request_header_access Mime-Version allow all<br/>
request_header_access Retry-After allow all<br/>
request_header_access Title allow all<br/>
request_header_access Connection allow all<br/>
request_header_access Proxy-Connection allow all<br/>
request_header_access User-Agent allow all<br/>
request_header_access Cookie allow all<br/>
request_header_access All deny all<br/>
dns_v4_first on<br/>
via off<br/>
forwarded_for off<br/>
follow_x_forwarded_for deny all<br/>
dns_nameservers 8.8.8.8 8.8.4.4<br/>
## END OF FILE</span></p>
<p><span style="font-size: 9.0pt;font-family: Verdana , sans-serif;"> </span></p>
<p style="margin-bottom: 3.75pt;"><span style="font-size: 9.0pt;font-family: Verdana , sans-serif;">Your help is greatly appreciated, maybe there has been some insight into this issue after 10+ years since the last time it was asked.</span></p>
<p style="margin-bottom: 9.75pt;"><span style="font-size: 9.0pt;font-family: Verdana , sans-serif;"> </span></p>
</div>
</div>
_______________________________________________ squid-users mailing list squid-users@lists.squid-cache.org <a href="http://lists.squid-cache.org/listinfo/squid-users" target="_blank">http://lists.squid-cache.org/listinfo/squid-users</a></div>
</div>
</div>
</div>
</div></div></body></html>