<div dir="ltr"><div><div>Hi List/Amos,<br><br></div>I am facing an using squid in production. <br><br></div>I get these messages in cache.log, and service stop for a period of time (like 14 seconds). During this period, users get panic as they get "proxy server resfusing connections". And automatically the service starts functioning again. But this happens very frequently whole day. <br><div><br>2015/04/29 10:34:10| WARNING: All redirector processes are busy.<br>2015/04/29 10:34:10| WARNING: 15 pending requests queued<br>2015/04/29 10:34:10| storeDirWriteCleanLogs: Starting...<br>2015/04/29 10:34:10| WARNING: Closing open FD 3327<br>2015/04/29 10:34:10| 65536 entries written so far.<br>2015/04/29 10:34:10| 131072 entries written so far.<br>2015/04/29 10:34:10| 196608 entries written so far.<br>2015/04/29 10:34:10| 262144 entries written so far.<br>2015/04/29 10:34:10| 327680 entries written so far.<br>2015/04/29 10:34:10| 393216 entries written so far.<br>2015/04/29 10:34:10| 458752 entries written so far.<br>2015/04/29 10:34:10| 524288 entries written so far.<br>2015/04/29 10:34:10| 589824 entries written so far.<br>2015/04/29 10:34:10| 655360 entries written so far.<br>2015/04/29 10:34:10| Finished. Wrote 716101 entries.<br>2015/04/29 10:34:10| Took 0.22 seconds (3266168.90 entries/sec).<br>FATAL: Too many queued redirector requests<br>Squid Cache (Version 3.1.10): Terminated abnormally.<br>CPU Usage: 4206.393 seconds = 3778.049 user + 428.344 sys<br>Maximum Resident Size: 2599760 KB<br>Page faults with physical i/o: 0<br>Memory usage for squid via mallinfo():<br> total space in arena: 750272 KB<br> Ordinary blocks: 717419 KB 6620 blks<br> Small blocks: 0 KB 1 blks<br> Holding blocks: 23020 KB 11 blks<br> Free Small blocks: 0 KB<br> Free Ordinary blocks: 32852 KB<br> Total in use: 740439 KB 99%<br> Total free: 32852 KB 4%<br>fgets() failed! dying..... errno=1 (Operation not permitted)<br clear="all"><div><div>2015/04/29 10:34:19| Starting Squid Cache version 3.1.10 for x86_64-redhat-linux-gnu...<br>2015/04/29 10:34:19| Process ID 4326<br>2015/04/29 10:34:19| With 100000 file descriptors available<br>2015/04/29 10:34:19| Initializing IP Cache...<br>2015/04/29 10:34:19| DNS Socket created at [::], FD 8<br>2015/04/29 10:34:19| DNS Socket created at 0.0.0.0, FD 9<br>2015/04/29 10:34:19| Adding nameserver 172.16.3.34 from squid.conf<br>2015/04/29 10:34:19| Adding nameserver 10.1.2.91 from squid.conf<br>2015/04/29 10:34:19| helperOpenServers: Starting 5/5 'squidGuard' processes<br>2015/04/29 10:34:19| helperOpenServers: Starting 1500/1500 'ntlm_auth' processes<br>2015/04/29 10:34:24| helperOpenServers: Starting 150/150 '<a href="http://wbinfo_group.pl" target="_blank">wbinfo_group.pl</a>' processes<br><br><br></div><div>ntlm helpers count is 1500 and external "<a href="http://wbinfo_group.pl">wbinfo_group.pl</a>" helpers are 150.<br></div><div><br></div><div>squid.conf<br>###################################################<br></div><div><br>max_filedesc 100000<br>acl manager proto cache_object<br>acl localhost src 172.16.50.61<br>http_access allow manager localhost<br>dns_nameservers 172.16.3.34 10.1.2.91<br>acl allowips src 172.16.58.187 172.16.16.192 172.16.58.113 172.16.58.63 172.16.58.98 172.16.60.244 172.16.58.165 172.16.58.157<br>http_access allow allowips<br>#acl haproxy src 172.16.50.61<br>#follow_x_forwarded_for allow haproxy<br>#follow_x_forwarded_for deny all<br>#acl manager proto cache_object<br>acl localnet src <a href="http://172.16.0.0/16">172.16.0.0/16</a><br>acl manager proto cache_object<br>acl localhost src 127.0.0.1<br>acl localnet src fc00::/7 # RFC 4193 local private network range<br>acl localnet src fe80::/10 # RFC 4291 link-local (directly plugged) machines<br>acl office dstdomain "/etc/squid/officesites"<br>http_access allow office<br>log_ip_on_direct off<br>#debug_options ALL,3<br>#logformat squid %9d.%03d %6d %s %s/%03d %d %s %s %s %s%s/%s %s<br>logformat squid %ts.%03tu %tl %3tr %3dt %3un %>a %Ss/%>Hs %<st %rm %ru %Sh/%<A %mt<br>access_log /var/log/squid/access1.log squid<br>auth_param basic realm Squid proxy-caching web server<br>auth_param basic credentialsttl 2 hours external_acl_type nt_group ttl=0 children=60 %LOGIN /usr/lib64/squid/<a href="http://wbinfo_group.pl">wbinfo_group.pl</a><br>#auth_param ntlm program /etc/squid/<a href="http://helper-mux.pl">helper-mux.pl</a> /usr/bin/ntlm_auth --diagnostics --helper-protocol=squid-2.5-ntlmssp --domain=<a href="http://HTMEDIA.NET">HTMEDIA.NET</a> <br>auth_param ntlm program /usr/bin/ntlm_auth --diagnostics --helper-protocol=squid-2.5-ntlmssp --domain=<a href="http://HTMEDIA.NET">HTMEDIA.NET</a><br>auth_param ntlm children 1500<br>#auth_param ntlm children 500<br>auth_param ntlm keep_alive off<br>auth_param ntlm program /usr/bin/ntlm_auth --helper-protocol=squid-2.5-ntlmssp --domain=<a href="http://HTMEDIA.NET">HTMEDIA.NET</a><br>external_acl_type wbinfo_group_helper ttl=600 children=150 %LOGIN /usr/lib64/squid/<a href="http://wbinfo_group.pl">wbinfo_group.pl</a> -d<br>acl localnet src <a href="http://172.16.0.0/12">172.16.0.0/12</a> # RFC1918 possible internal network<br>cl Safe_ports port 8080 #https<br>acl SSL_ports port 443<br>acl Safe_ports port 80 # http<br>acl Safe_ports port 21 # ftp<br>acl Safe_ports port 443 # https<br>acl Safe_ports port 70 # gopher<br>acl Safe_ports port 210 # wais<br>acl Safe_ports port 1025-65535 # unregistered ports<br>acl Safe_ports port 280 # http-mgmt<br>acl Safe_ports port 488 # gss-http<br>acl Safe_ports port 591 # filemaker<br>acl Safe_ports port 777 # multiling http<br>acl CONNECT method CONNECT<br>acl auth proxy_auth REQUIRED<br><br><br></div><div>and rest of acls and http_access rules configured ...............<br><br><br><br></div><div>It seems the helper programs are not closing automatically after serving and causes this issue. Could anyone help resolving this issue. <br><br>[root@GGNPROXY01 squid]# rpm -qa | grep squid<br>squid-3.1.10-19.el6_4.x86_64<br><br>[root@GGNPROXY01 squid]# rpm -qa | grep winbind<br>samba-winbind-clients-3.6.9-164.el6.x86_64<br>samba-winbind-3.6.9-164.el6.x86_64<br><br>[root@GGNPROXY01 squid]# lsb_release -a<br>LSB Version: :base-4.0-amd64:base-4.0-noarch:core-4.0-amd64:core-4.0-noarch:graphics-4.0-amd64:graphics-4.0-noarch:printing-4.0-amd64:printing-4.0-noarch<br>Distributor ID: RedHatEnterpriseServer<br>Description: Red Hat Enterprise Linux Server release 6.5 (Santiago)<br>Release: 6.5<br>Codename: Santiago<br><br><br></div><div>-- <br><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr">Thanks & Regards<br><br><span>B Jagannath</span><br><div>Keen & Able Computers Pvt. Ltd.<br></div><div></div><div>+919871324006<br></div></div></div></div></div></div></div>
</div></div></div></div>