[squid-users] Squid freeze each hour.

David Touzeau david at articatech.com
Tue Dec 20 15:04:42 UTC 2016 

Proxy has freezed again and when doing squid -k debug

Many refresh.cc, store_digest.cc, store_dir.cc

After finishing these tasks, proxy will return to be responsive 

2016/12/20 15:27:41.470 kid1| 71,6| store_digest.cc(288) storeDigestAdd: storeDigestAdd: added entry, key: A035B81FB42C32A106E4384A2F17F4B4
2016/12/20 15:27:41.470 kid1| 71,6| store_digest.cc(226) storeDigestAddable: storeDigestAddable: checking entry, key: A07598353220500410873ECDA474BE05
2016/12/20 15:27:41.470 kid1| 22,3| refresh.cc(291) refreshCheck: checking freshness of 'http://pagead2.googlesyndication.com/activeview?avi=Bddpfgi1ZWMuzC9OS3gOp9KzwCAAAAAAQATgByAEJwAIC4AIA4AQBoAYg&cid=CAASFeRoE1xZjx5ogoC0cxxshgMXQzuIPQ&id=osdim&ti=1&adk=2863166925&p=0,0,0,0&tos=0,0,0,0,0&mtos=0,0,0,0,0&rs=3&ht=0&mc=0&lte=-1&bas=1&bac=1&fp=correlator%3D3261868290981518%26eid%3D108809080%26iu%3D%252F128139881%252FLM_lemonde%252Fa_la_une%252Fa_la_une%252Fhp%252Fbanniere_haute%26oid%3D3%26url%3Dhttp%253A%252F%252Fwww.lemonde.fr%252F&afp=%26output%3Djson_html%26impl%3Dfif%26dt%3D1482239361000%26adx%3D0%26ady%3D216%26ifi%3D4%26flash%3D24.0.0.186&r=u&bs=904,618&bos=160,27&ps=1000,18109&ss=1920,1200&tt=16433&pt=1166&deb=1-7-7-3-8-9&tvt=0&ms=geo&uc=1&tgt=nf&cl=0'
2016/12/20 15:27:41.531 kid1| 22,3| refresh.cc(312) refreshCheck: Matched '. 0 75%% 2592000'
2016/12/20 15:27:41.531 kid1| 22,3| refresh.cc(314) refreshCheck: 	age:	8280
2016/12/20 15:27:41.531 kid1| 22,3| refresh.cc(316) refreshCheck: 	check_time:	Tue, 20 Dec 2016 15:27:41 GMT
2016/12/20 15:27:41.531 kid1| 22,3| refresh.cc(318) refreshCheck: 	entry->timestamp:	Tue, 20 Dec 2016 13:09:41 GMT
2016/12/20 15:27:41.531 kid1| 22,3| refresh.cc(173) refreshStaleness: STALE: expires 631152000 < check_time 1482247661 
2016/12/20 15:27:41.531 kid1| 22,3| refresh.cc(338) refreshCheck: Staleness = 851095661
2016/12/20 15:27:41.531 kid1| 22,3| refresh.cc(362) refreshCheck: YES: Must revalidate stale object (origin set no-cache or private)
2016/12/20 15:27:41.531 kid1| 71,6| store_digest.cc(259) storeDigestAddable: storeDigestAdd: entry expires within 3600 secs, ignoring
2016/12/20 15:27:41.531 kid1| 71,6| store_digest.cc(226) storeDigestAddable: storeDigestAddable: checking entry, key: A035C0F65A81E715DA653BDE6632A99E
2016/12/20 15:27:41.531 kid1| 22,3| refresh.cc(291) refreshCheck: checking freshness of 'http://img.2ememain.be/f/listthumb/323814646.jpg'
2016/12/20 15:27:41.531 kid1| 22,3| refresh.cc(312) refreshCheck: Matched '\.(jpeg|jpg|jpe|jp2|gif|tiff?|pcx|png|bmp|pic|ico|bif|ver|pict)(\?.*|$) 36000 80%% 604800'
2016/12/20 15:27:41.532 kid1| 22,3| refresh.cc(314) refreshCheck: 	age:	18430
2016/12/20 15:27:41.532 kid1| 22,3| refresh.cc(316) refreshCheck: 	check_time:	Tue, 20 Dec 2016 15:27:41 GMT
2016/12/20 15:27:41.532 kid1| 22,3| refresh.cc(318) refreshCheck: 	entry->timestamp:	Tue, 20 Dec 2016 10:20:31 GMT
2016/12/20 15:27:41.532 kid1| 22,3| refresh.cc(168) refreshStaleness: FRESH: expires 1643826450 >= check_time 1482247661 
2016/12/20 15:27:41.532 kid1| 22,3| refresh.cc(338) refreshCheck: Staleness = -1
2016/12/20 15:27:41.532 kid1| 22,3| refresh.cc(461) refreshCheck: Object isn't stale..
2016/12/20 15:27:41.532 kid1| 22,3| refresh.cc(463) refreshCheck: returning FRESH_EXPIRES
2016/12/20 15:27:41.532 kid1| 71,6| store_digest.cc(288) storeDigestAdd: storeDigestAdd: added entry, key: A035C0F65A81E715DA653BDE6632A99E
2016/12/20 15:27:41.532 kid1| 47,3| store_dir.cc(1352) copyBucket: StoreSearchHashIndex::copyBucket #13729
2016/12/20 15:27:41.532 kid1| 47,3| store_dir.cc(1366) copyBucket: got entries: 4
2016/12/20 15:27:41.532 kid1| 71,6| store_digest.cc(226) storeDigestAddable: storeDigestAddable: checking entry, key: A1F528E3C02DAB25C5FB18C8D2EDACEE
2016/12/20 15:27:41.532 kid1| 22,3| refresh.cc(291) refreshCheck: checking freshness of 'http://static1.hln.be/images/logos/hln_logo.png?6.16.0.20161219'
2016/12/20 15:27:41.532 kid1| 22,3| refresh.cc(312) refreshCheck: Matched '\.(jpeg|jpg|jpe|jp2|gif|tiff?|pcx|png|bmp|pic|ico|bif|ver|pict)(\?.*|$) 36000 80%% 604800'
2016/12/20 15:27:41.532 kid1| 22,3| refresh.cc(314) refreshCheck: 	age:	13612
2016/12/20 15:27:41.532 kid1| 22,3| refresh.cc(316) refreshCheck: 	check_time:	Tue, 20 Dec 2016 15:27:41 GMT
2016/12/20 15:27:41.532 kid1| 22,3| refresh.cc(318) refreshCheck: 	entry->timestamp:	Tue, 20 Dec 2016 11:40:49 GMT
2016/12/20 15:27:41.532 kid1| 22,3| refresh.cc(168) refreshStaleness: FRESH: expires 1487346358 >= check_time 1482247661 
2016/12/20 15:27:41.532 kid1| 22,3| refresh.cc(338) refreshCheck: Staleness = -1
2016/12/20 15:27:41.532 kid1| 22,3| refresh.cc(461) refreshCheck: Object isn't stale..
2016/12/20 15:27:41.532 kid1| 22,3| refresh.cc(463) refreshCheck: returning FRESH_EXPIRES
2016/12/20 15:27:41.532 kid1| 71,6| store_digest.cc(288) storeDigestAdd: storeDigestAdd: added entry, key: A1F528E3C02DAB25C5FB18C8D2EDACEE
2016/12/20 15:27:41.532 kid1| 71,6| store_digest.cc(226) storeDigestAddable: storeDigestAddable: checking entry, key: A1F5E4243AA2BD14C147D180CBD5022F
2016/12/20 15:27:41.532 kid1| 22,3| refresh.cc(291) refreshCheck: checking freshness of 'http://cdn.embedly.com/js/all.c353026a.js'
2016/12/20 15:27:41.533 kid1| 22,3| refresh.cc(312) refreshCheck: Matched '\.js$ 84000 80%% 604800'
2016/12/20 15:27:41.533 kid1| 22,3| refresh.cc(314) refreshCheck: 	age:	11727
2016/12/20 15:27:41.533 kid1| 22,3| refresh.cc(316) refreshCheck: 	check_time:	Tue, 20 Dec 2016 15:27:41 GMT
2016/12/20 15:27:41.533 kid1| 22,3| refresh.cc(318) refreshCheck: 	entry->timestamp:	Tue, 20 Dec 2016 12:12:14 GMT
2016/12/20 15:27:41.533 kid1| 22,3| refresh.cc(168) refreshStaleness: FRESH: expires 1545307934 >= check_time 1482247661 
2016/12/20 15:27:41.533 kid1| 22,3| refresh.cc(338) refreshCheck: Staleness = -1
2016/12/20 15:27:41.533 kid1| 22,3| refresh.cc(461) refreshCheck: Object isn't stale..
2016/12/20 15:27:41.533 kid1| 22,3| refresh.cc(463) refreshCheck: returning FRESH_EXPIRES
2016/12/20 15:27:41.533 kid1| 71,6| store_digest.cc(288) storeDigestAdd: storeDigestAdd: added entry, key: A1F5E4243AA2BD14C147D180CBD5022F


-----Message d'origine-----
De : Eliezer Croitoru [mailto:eliezer at ngtech.co.il] 
Envoyé : mardi 20 décembre 2016 14:30
À : 'David Touzeau' <david at articatech.com>; squid-users at lists.squid-cache.org
Objet : RE: [squid-users] Squid freeze each hour.

Hey David,

Some things are missing and we need you to fill the picture for us.
What OS are you running squid ontop?
Are you running it in intercept or tproxy mode?
Are you using ssl-bump?
Are you using it with multiple cores?
Can you attach the squid.conf( removing the confidential details) to this email?

Thanks,
Eliezer

----
Eliezer Croitoru
Linux System Administrator
Mobile: +972-5-28704261
Email: eliezer at ngtech.co.il


-----Original Message-----
From: squid-users [mailto:squid-users-bounces at lists.squid-cache.org] On Behalf Of David Touzeau
Sent: Tuesday, December 20, 2016 1:53 PM
To: squid-users at lists.squid-cache.org
Subject: [squid-users] Squid freeze each hour.

Hi

I'm using the 3.5.23, each hour, the proxy port did not respond for 3 to 10 minutes.
During the freeze have made a -k debug to see whats happening.
Here a piece of log of the log during the freeze:

Is there something relevant ?:

2016/12/20 12:09:09.072 kid1| 71,6| store_digest.cc(226) storeDigestAddable:
storeDigestAddable: checking entry, key: 877FE61D1641BCA926338890AF1478D2
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(291) refreshCheck: checking freshness of '<none>'
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(312) refreshCheck: Matched '.
0 75%% 2592000'
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(314) refreshCheck:       age:
1024129
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(316) refreshCheck:
check_time:     Tue, 20 Dec 2016 12:09:09 GMT
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(318) refreshCheck:
entry->timestamp:       Thu, 08 Dec 2016 15:40:20 GMT
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(168) refreshStaleness: FRESH:
expires 1486393228 >= check_time 1482235749
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(338) refreshCheck: Staleness = -1
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(461) refreshCheck: Object isn't stale..
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(463) refreshCheck: returning FRESH_EXPIRES
2016/12/20 12:09:09.072 kid1| 71,6| store_digest.cc(288) storeDigestAdd:
storeDigestAdd: added entry, key: 877FE61D1641BCA926338890AF1478D2
2016/12/20 12:09:09.072 kid1| 71,6| store_digest.cc(226) storeDigestAddable:
storeDigestAddable: checking entry, key: 87BF2568F0A7D71F1E567579CCC216F7
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(291) refreshCheck: checking freshness of '<none>'
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(312) refreshCheck: Matched '.
0 75%% 2592000'
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(314) refreshCheck:       age:
1019863
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(316) refreshCheck:
check_time:     Tue, 20 Dec 2016 12:09:09 GMT
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(318) refreshCheck:
entry->timestamp:       Thu, 08 Dec 2016 16:51:26 GMT
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(173) refreshStaleness: STALE:
expires 1481215886 < check_time 1482235749
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(338) refreshCheck: Staleness = 1019863
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(362) refreshCheck: YES: Must revalidate stale object (origin set no-cache or private)
2016/12/20 12:09:09.072 kid1| 71,6| store_digest.cc(259) storeDigestAddable:
storeDigestAdd: entry expires within 3600 secs, ignoring
2016/12/20 12:09:09.072 kid1| 71,6| store_digest.cc(226) storeDigestAddable:
storeDigestAddable: checking entry, key: 873F5089579B6B7E351555B77F98259A
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(291) refreshCheck: checking freshness of '<none>'
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(312) refreshCheck: Matched '.
0 75%% 2592000'
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(314) refreshCheck:       age:
956460
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(316) refreshCheck:
check_time:     Tue, 20 Dec 2016 12:09:09 GMT
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(318) refreshCheck:
entry->timestamp:       Fri, 09 Dec 2016 10:28:09 GMT
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(173) refreshStaleness: STALE:
expires 1481279289 < check_time 1482235749
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(338) refreshCheck: Staleness = 956460
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(362) refreshCheck: YES: Must revalidate stale object (origin set no-cache or private)
2016/12/20 12:09:09.072 kid1| 71,6| store_digest.cc(259) storeDigestAddable:
storeDigestAdd: entry expires within 3600 secs, ignoring
2016/12/20 12:09:09.072 kid1| 71,6| store_digest.cc(226) storeDigestAddable:
storeDigestAddable: checking entry, key: 87FFFEA8EBEFAE0DBC21EBC97D405839
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(291) refreshCheck: checking freshness of '<none>'
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(312) refreshCheck: Matched '.
0 75%% 2592000'
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(314) refreshCheck:       age:
948473
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(316) refreshCheck:
check_time:     Tue, 20 Dec 2016 12:09:09 GMT
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(318) refreshCheck:
entry->timestamp:       Fri, 09 Dec 2016 12:41:16 GMT
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(179) refreshStaleness: No explicit expiry given, using heuristics to determine freshness
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(198) refreshStaleness: Last modified 19509132 sec before we cached it, L-M factor 75.00% = 14631849 sec freshness lifetime
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(205) refreshStaleness: FRESH:
age 948473 <= stale_age 14631849
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(338) refreshCheck: Staleness = -1
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(461) refreshCheck: Object isn't stale..
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(470) refreshCheck: returning FRESH_LMFACTOR_RULE
2016/12/20 12:09:09.072 kid1| 71,6| store_digest.cc(288) storeDigestAdd:
storeDigestAdd: added entry, key: 87FFFEA8EBEFAE0DBC21EBC97D405839
2016/12/20 12:09:09.072 kid1| 71,6| store_digest.cc(226) storeDigestAddable:
storeDigestAddable: checking entry, key: 873F5CB8872FFC57B8D32027D4DC8174
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(291) refreshCheck: checking freshness of '<none>'
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(312) refreshCheck: Matched '.
0 75%% 2592000'
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(314) refreshCheck:       age:
520259
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(316) refreshCheck:
check_time:     Tue, 20 Dec 2016 12:09:09 GMT
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(318) refreshCheck:
entry->timestamp:       Wed, 14 Dec 2016 11:38:10 GMT
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(173) refreshStaleness: STALE:
expires 631151999 < check_time 1482235749
2016/12/20 12:09:09.072 kid1| 22,3| refresh.cc(338) refreshCheck: Staleness = 851083750
2016/12/20 12:09:09.073 kid1| 22,3| refresh.cc(362) refreshCheck: YES: Must revalidate stale object (origin set no-cache or private)
2016/12/20 12:09:09.073 kid1| 71,6| store_digest.cc(259) storeDigestAddable:
storeDigestAdd: entry expires within 3600 secs, ignoring
2016/12/20 12:09:09.073 kid1| 71,6| store_digest.cc(226) storeDigestAddable:
storeDigestAddable: checking entry, key: 87FF2043810CAE2CE015C43DBC3E1004
2016/12/20 12:09:09.073 kid1| 22,3| refresh.cc(291) refreshCheck: checking freshness of '<none>'
2016/12/20 12:09:09.073 kid1| 22,3| refresh.cc(312) refreshCheck: Matched '.
0 75%% 2592000'
2016/12/20 12:09:09.073 kid1| 22,3| refresh.cc(314) refreshCheck:       age:
594643
2016/12/20 12:09:09.073 kid1| 22,3| refresh.cc(316) refreshCheck:
check_time:     Tue, 20 Dec 2016 12:09:09 GMT
2016/12/20 12:09:09.073 kid1| 22,3| refresh.cc(318) refreshCheck:
entry->timestamp:       Tue, 13 Dec 2016 14:58:26 GMT
2016/12/20 12:09:09.073 kid1| 22,3| refresh.cc(173) refreshStaleness: STALE:
expires 1481727507 < check_time 1482235749
2016/12/20 12:09:09.073 kid1| 22,3| refresh.cc(338) refreshCheck: Staleness = 508242
2016/12/20 12:09:09.073 kid1| 71,6| store_digest.cc(259) storeDigestAddable:
storeDigestAdd: entry expires within 3600 secs, ignoring

_______________________________________________
squid-users mailing list
squid-users at lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-users

More information about the squid-users mailing list