[squid-users] squid cpu usage
Vieri
rentorbuy at yahoo.com
Thu Oct 26 21:58:27 UTC 2017
Thanks for all the tips.
I should've done this before, but I just took a second look at cache.log and found the following message repeated a few times before the 100% CPU issue:
"Your cache is running out of filedescriptors"
I have no more info because the debug level was low.
If this is the cause then I'm even more worried now because:
# ulimit -a
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 127521
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 16384
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 127521
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
# cat /etc/security/limits.d/01_squid.conf
* hard nofile 65535
* soft nofile 16384
It just so happens I ran mgr:filedescriptors while the CPU was at 100%.
Here's the output (stripped of domains and IP addresses):
HTTP/1.1 200 OK
Server: squid
Mime-Version: 1.0
Date: Thu, 26 Oct 2017 08:35:16 GMT
Content-Type: text/plain;charset=utf-8
Expires: Thu, 26 Oct 2017 08:35:16 GMT
Last-Modified: Thu, 26 Oct 2017 08:35:16 GMT
X-Cache: MISS from inf-fw2
X-Cache-Lookup: MISS from inf-fw2:3128
Connection: close
Active file descriptors:
File Type Tout Nread * Nwrite * Remote Address Description
---- ------ ---- -------- -------- --------------------- ------------------------------
5 Log 0 0 0 /var/log/squid/cache.log
6 Pipe 0 0 0 IPC UNIX STREAM Parent
9 Socket 28796 0 0 x.x.x.x:3199 client https start
11 Socket 8 1829* 174558 x.x.x.x:62569 Idle client: Waiting for next request
12 Socket 0 77571 243300 x.x.x.x:1344 x.x.x.x
13 Socket 28798 0 0 x.x.x.x:1428 client https start
14 Socket 113 201* 3316 x.x.x.x:49847 Idle client: Waiting for next request
15 Socket 7614 0* 0 x.x.x.x:56204 client https start
16 Socket 0 70492 72860 x.x.x.x:1344 x.x.x.x
17 Socket 0 184736 412668 x.x.x.x:1344 x.x.x.x
18 Socket 0 269207 467337 x.x.x.x:1344 x.x.x.x
19 Socket 0 70386 70846 x.x.x.x:1344 x.x.x.x
20 Socket 56 319* 452 x.x.x.x:59366 Idle client: Waiting for next request
21 Socket 0 74155 160454 x.x.x.x:1344 x.x.x.x
22 Socket 0 70373 184389 x.x.x.x:1344 x.x.x.x
23 Socket 0 321566 418429 x.x.x.x:1344 x.x.x.x
24 Socket 28783 1633* 0 x.x.x.x:60033 Reading next request
25 Socket 895 1809* 37539 x.x.x.x:1344 x.x.x.x
26 Socket 0 171606 765947 x.x.x.x:1344 x.x.x.x
27 Socket 0 505651 936639 x.x.x.x:1344 x.x.x.x
28 Socket 0 77690 579865 x.x.x.x:1344 x.x.x.x
29 Socket 893 1120129* 1356723 x.x.x.x:1344 x.x.x.x
30 Socket 99 1409* 1067 x.x.x.x:51458 Idle client: Waiting for next request
31 Socket 0 697084 991951 x.x.x.x:1344 x.x.x.x
32 Socket 0 72740 380302 x.x.x.x:1344 x.x.x.x
33 Socket 0 133319 4018875 x.x.x.x:1344 x.x.x.x
34 Socket 885 365084* 418439 x.x.x.x:1344 x.x.x.x
35 Socket 0 230550 976940 x.x.x.x:1344 x.x.x.x
36 Socket 0 72085 159051 x.x.x.x:1344 x.x.x.x
37 Socket 0 142361 344294 x.x.x.x:1344 x.x.x.x
38 Socket 0 1008147 1644576 x.x.x.x:1344 x.x.x.x
39 Socket 0 861819 1334921 x.x.x.x:1344 x.x.x.x
40 Socket 28800 2851* 344 x.x.x.x:60799 Reading next request
41 Socket 0 0 0 [::]:39163 DNS Socket IPv6
42 Socket 0 152497 327514 x.x.x.x:1344 x.x.x.x
43 Socket 0 1139088 1516707 x.x.x.x:1344 x.x.x.x
44 Socket 0 237721 398977 x.x.x.x:1344 x.x.x.x
45 Socket 0 91801 114000 x.x.x.x:1344 x.x.x.x
46 Socket 0 0 0 x.x.x.x:3233 HTTP Request
47 Socket 0 131675 695360 x.x.x.x:1344 x.x.x.x
48 Socket 0 159372 179649 x.x.x.x:1344 x.x.x.x
49 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (187)
50 Socket 0 161* 1378 x.x.x.x:443 https://domain.org
52 Socket 69 286* 1430 x.x.x.x:55771 Idle client: Waiting for next request
53 Socket 8 397* 48788 x.x.x.x:62572 Idle client: Waiting for next request
54 Socket 0 341879 480589 x.x.x.x:1344 x.x.x.x
55 Socket 91 201* 3315 x.x.x.x:56787 Idle client: Waiting for next request
56 Socket 0 726999 1336667 x.x.x.x:1344 x.x.x.x
57 Socket 113 201* 3316 x.x.x.x:51036 Idle client: Waiting for next request
58 Socket 119 556* 3723 x.x.x.x:51851 Idle client: Waiting for next request
59 Socket 99 1322* 766 x.x.x.x:1968 Idle client: Waiting for next request
60 Socket 0 78554 216848 x.x.x.x:1344 x.x.x.x
61 Socket 0 70211 717853 x.x.x.x:1344 x.x.x.x
62 Socket 0 78361 182762 x.x.x.x:1344 x.x.x.x
63 Socket 0 1945692 4239277 x.x.x.x:1344 x.x.x.x
64 Socket 66 1092* 1117 x.x.x.x:50080 Idle client: Waiting for next request
65 Socket 62 202* 286 x.x.x.x:55769 Idle client: Waiting for next request
66 Socket 0 17396* 904 x.x.x.x:443 https://domain.org
67 Socket 0 3536* 1166 x.x.x.x:443 https://domain.org
68 Socket 28798 3038* 797 x.x.x.x:65116 Reading next request
69 Socket 28798 0* 0 x.x.x.x:1426 client https start
70 Socket 28780 0* 0 x.x.x.x:60791 client https start
71 Socket 0 70387 70867 x.x.x.x:1344 x.x.x.x
72 Socket 0 254449 502590 x.x.x.x:1344 x.x.x.x
73 Socket 9 11524* 1152 x.x.x.x:54067 Idle client: Waiting for next request
74 Socket 0 96195 103010 x.x.x.x:1344 x.x.x.x
75 Socket 28 1516* 1291 x.x.x.x:3023 Idle client: Waiting for next request
76 Socket 0 205806 602151 x.x.x.x:1344 x.x.x.x
77 Socket 115 2195* 1248 x.x.x.x:59024 Idle client: Waiting for next request
78 Socket 0 352877 444820 x.x.x.x:1344 x.x.x.x
79 Socket 6 384* 612 x.x.x.x:80 Idle server: x.x.x.x:80/some_path
80 Socket 0 71272 230010 x.x.x.x:1344 x.x.x.x
81 Socket 5 1490* 168706 x.x.x.x:54376 Idle client: Waiting for next request
82 Socket 0 4403371 651548 x.x.x.x:47443 DNS Socket IPv4
83 Socket 0 782173 984402 x.x.x.x:1344 x.x.x.x
84 Pipe 0 0 0 unlinkd -> squid
85 Socket 28798 433* 0 x.x.x.x:1423 Reading next request
86 Socket 5 2211* 1249 x.x.x.x:49400 Idle client: Waiting for next request
87 Pipe 0 0 0 squid -> unlinkd
88 Pipe 0 0 0 squid -> diskd
89 Socket 28792 4914* 2557 x.x.x.x:3381 Reading next request
90 Socket 66 598* 712 x.x.x.x:2262 Idle client: Waiting for next request
91 Socket 0 486500 1052648 x.x.x.x:1344 x.x.x.x
92 Socket 0 84149 459690 x.x.x.x:1344 x.x.x.x
93 Socket 0 446707 703970 x.x.x.x:1344 x.x.x.x
94 Socket 28797 1744* 0 x.x.x.x:49666 Reading next request
95 Socket 0 196505 1356207 x.x.x.x:1344 x.x.x.x
96 Socket 0 71430 747104 x.x.x.x:1344 x.x.x.x
97 Pipe 0 55385864* 83254354 ssl_crtd #1
98 Socket 99 4720* 74394 x.x.x.x:51833 Idle client: Waiting for next request
99 Socket 0 80191 352164 x.x.x.x:1344 x.x.x.x
100 Socket 0 831352 1205057 x.x.x.x:1344 x.x.x.x
101 Socket 0 67263 68047 x.x.x.x:1344 x.x.x.x
102 Socket 28734 0* 0 x.x.x.x:56784 client https start
103 Socket 0 90037 239742 x.x.x.x:1344 x.x.x.x
104 Socket 0 86557 182854 x.x.x.x:1344 x.x.x.x
105 Socket 0 74680 272842 x.x.x.x:1344 x.x.x.x
106 Socket 0 82432 182773 x.x.x.x:1344 x.x.x.x
107 Socket 0 91159 110508 x.x.x.x:1344 x.x.x.x
108 Socket 0 74341 182862 x.x.x.x:1344 x.x.x.x
109 Socket 58 354520* 417712 x.x.x.x:1344 x.x.x.x
110 Socket 896 110923* 238345 x.x.x.x:1344 x.x.x.x
111 Socket 0 367211 830710 x.x.x.x:1344 x.x.x.x
112 Socket 0 799681 2454675 x.x.x.x:1344 x.x.x.x
113 Socket 0 174639 526254 x.x.x.x:1344 x.x.x.x
114 Socket 0 224143 626713 x.x.x.x:1344 x.x.x.x
115 Socket 0 825* 4338 x.x.x.x:443 https://domain.org
116 Socket 50 0 0* x.x.x.x:80 domain.org
117 Socket 28799 0 0 x.x.x.x:3208 client https start
118 Socket 0 29387* 3248 x.x.x.x:443 https://domain.org
119 Socket 69 13796* 1117 x.x.x.x:64434 Idle client: Waiting for next request
120 Socket 0 401186 536770 x.x.x.x:1344 x.x.x.x
121 Socket 0 70420 72431 x.x.x.x:1344 x.x.x.x
122 Socket 0 1248701 2243251 x.x.x.x:1344 x.x.x.x
123 Pipe 0 12387700* 18425650 ssl_crtd #2
124 Socket 0 74579 186204 x.x.x.x:1344 x.x.x.x
125 Socket 0 147688 317832 x.x.x.x:1344 x.x.x.x
126 Socket 0 157570 1000064 x.x.x.x:1344 x.x.x.x
127 Socket 0 484039 932396 x.x.x.x:1344 x.x.x.x
128 Socket 0 72709 204331 x.x.x.x:1344 x.x.x.x
129 Socket 0 121209 121541 x.x.x.x:1344 x.x.x.x
130 Socket 0 89678 203510 x.x.x.x:1344 x.x.x.x
131 Socket 0 1096513 1775872 x.x.x.x:1344 x.x.x.x
132 Socket 28774 1636* 0 x.x.x.x:65117 Reading next request
133 Socket 53 378* 1542 x.x.x.x:80 Idle server: x.x.x.x:80/some_path
134 Socket 108 482* 654 x.x.x.x:59022 Idle client: Waiting for next request
135 Socket 0 67261 67977 x.x.x.x:1344 x.x.x.x
136 Socket 0 353852 1257798 x.x.x.x:1344 x.x.x.x
137 Socket 120 3820* 3424 x.x.x.x:64559 Idle client: Waiting for next request
138 Socket 8 829* 1280 x.x.x.x:3040 Idle client: Waiting for next request
139 Socket 6069 0* 0 x.x.x.x:56177 client https start
140 Socket 0 75215 314184 x.x.x.x:1344 x.x.x.x
141 Socket 0 72428 421624 x.x.x.x:1344 x.x.x.x
142 Socket 0 205459 279606 x.x.x.x:1344 x.x.x.x
143 Socket 0 983140 1528993 x.x.x.x:1344 x.x.x.x
144 Socket 0 72254 128634 x.x.x.x:1344 x.x.x.x
145 Socket 108 470* 654 x.x.x.x:2259 Idle client: Waiting for next request
146 Socket 28798 0 0 x.x.x.x:1839 client https start
147 Socket 28754 6505* 2748 x.x.x.x:2121 Reading next request
148 Socket 0 94387 437023 x.x.x.x:1344 x.x.x.x
149 Socket 112 526* 636 x.x.x.x:54464 Idle client: Waiting for next request
150 Socket 0 291712 418901 x.x.x.x:1344 x.x.x.x
151 Socket 0 260125 466643 x.x.x.x:1344 x.x.x.x
152 Socket 0 75500 192364 x.x.x.x:1344 x.x.x.x
153 Socket 91 6720* 31850 x.x.x.x:51199 Idle client: Waiting for next request
154 Socket 0 340510 3310843 x.x.x.x:1344 x.x.x.x
155 Socket 28799 0 0 x.x.x.x:3206 client https start
156 Socket 0 74500 184502 x.x.x.x:1344 x.x.x.x
157 Socket 888 208562* 377059 x.x.x.x:1344 x.x.x.x
158 Pipe 0 5872190* 8607084 ssl_crtd #3
159 Socket 0 103064 525215 x.x.x.x:1344 x.x.x.x
160 Socket 98 482* 654 x.x.x.x:60031 Idle client: Waiting for next request
161 Socket 62 516* 675 x.x.x.x:51195 Idle client: Waiting for next request
162 Socket 28799 0 0 x.x.x.x:3209 client https start
163 Socket 66 2211* 2150 x.x.x.x:54426 Idle client: Waiting for next request
164 Socket 28798 3348* 798 x.x.x.x:2255 Reading next request
165 Socket 0 222093 321752 x.x.x.x:1344 x.x.x.x
166 Socket 0 126144 442862 x.x.x.x:1344 x.x.x.x
167 Socket 62 16353* 41096 x.x.x.x:3235 Idle client: Waiting for next request
168 Socket 0 67365 68179 x.x.x.x:1344 x.x.x.x
169 Socket 0 9195* 2294 x.x.x.x:443 https://domain.org
170 Socket 113 201* 3316 x.x.x.x:51037 Idle client: Waiting for next request
171 Socket 28800 0 0 x.x.x.x:55497 client https connect
172 Socket 0 126735 522798 x.x.x.x:1344 x.x.x.x
173 Socket 0 27366* 6978 x.x.x.x:443 https://domain.org
174 Socket 28779 3231* 870 x.x.x.x:2142 Reading next request
175 Socket 0 1214190 1308440 x.x.x.x:1344 x.x.x.x
176 Socket 28745 3983* 0 x.x.x.x:1365 Reading next request
177 Socket 27422 0* 0 x.x.x.x:56749 client https start
178 Socket 0 71305 194143 x.x.x.x:1344 x.x.x.x
179 Socket 66 306* 452 x.x.x.x:1353 Idle client: Waiting for next request
180 Socket 28774 1758* 0 x.x.x.x:59375 Reading next request
181 Socket 28798 3618* 609* x.x.x.x:55780 Reading next request
182 Socket 0 463907 4817276 x.x.x.x:1344 x.x.x.x
183 Socket 0 366549 818689 x.x.x.x:1344 x.x.x.x
184 Pipe 0 3597805* 5272955 ssl_crtd #4
185 Socket 0 330910 964399 x.x.x.x:1344 x.x.x.x
186 Socket 113 645* 1205 x.x.x.x:4116 Idle client: Waiting for next request
187 Socket 28800 876* 0* x.x.x.x:62588 Reading next request
188 Socket 0 1484456 1616112 x.x.x.x:1344 x.x.x.x
189 Socket 0 902153 1747543 x.x.x.x:1344 x.x.x.x
190 Socket 99 13466* 1117 x.x.x.x:64687 Idle client: Waiting for next request
191 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (505)
192 Socket 58 277899* 415305 x.x.x.x:1344 x.x.x.x
193 Socket 19 838* 739 x.x.x.x:62578 Idle client: Waiting for next request
194 Socket 58 32594* 53867 x.x.x.x:1344 x.x.x.x
195 Socket 0 74412 748176 x.x.x.x:1344 x.x.x.x
196 Socket 0 294684 832445 x.x.x.x:1344 x.x.x.x
197 Socket 876 431920* 668818 x.x.x.x:1344 x.x.x.x
198 Socket 28744 2487* 0 x.x.x.x:3267 Reading next request
199 Socket 113 201* 3316 x.x.x.x:51238 Idle client: Waiting for next request
200 Socket 0 1043* 886 x.x.x.x:443 https://domain.org
201 Socket 28779 3150* 870 x.x.x.x:2134 Reading next request
202 Socket 104 361* 3527 x.x.x.x:3173 Idle client: Waiting for next request
203 Socket 0 0 0 x.x.x.x:3234 HTTP Request
204 Socket 8 1450* 1308 x.x.x.x:65097 Reading next request
205 Socket 19 566* 784 x.x.x.x:54405 Idle client: Waiting for next request
206 Socket 0 1018301 1251632 x.x.x.x:1344 x.x.x.x
207 Socket 0 243460 725933 x.x.x.x:1344 x.x.x.x
208 Pipe 0 2674774* 3914935 ssl_crtd #5
209 Socket 115 610* 712 x.x.x.x:64689 Idle client: Waiting for next request
210 Socket 0 764* 7298 x.x.x.x:443 https://domain.org
211 Socket 105 1277* 344 x.x.x.x:2283 Idle client: Waiting for next request
212 Socket 0 131679 1220103 x.x.x.x:1344 x.x.x.x
213 Socket 876 30969* 222063 x.x.x.x:1344 x.x.x.x
214 Socket 0 191177 438150 x.x.x.x:1344 x.x.x.x
215 Socket 0 78829 290995 x.x.x.x:1344 x.x.x.x
216 Socket 112 1002* 1328 x.x.x.x:51197 Idle client: Waiting for next request
217 Socket 0 174193* 3658 x.x.x.x:443 https://domain.org
218 Socket 28781 0* 0 x.x.x.x:60795 client https start
219 Pipe 0 1969670* 2885654 ssl_crtd #6
220 Socket 67 5709* 13745 x.x.x.x:1366 Idle client: Waiting for next request
221 Socket 0 570053 628689 x.x.x.x:1344 x.x.x.x
222 Socket 28790 308* 0 x.x.x.x:2899 Reading next request
223 Socket 28798 704* 267112 x.x.x.x:1827 Reading next request
224 Pipe 0 1464643* 2151275 ssl_crtd #7
225 Socket 107 3463* 26520 x.x.x.x:51202 Idle client: Waiting for next request
226 Socket 28799 433* 0 x.x.x.x:1425 Reading next request
227 Socket 118 1424* 344 x.x.x.x:1826 Idle client: Waiting for next request
228 Socket 0 321598 669611 x.x.x.x:1344 x.x.x.x
229 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (686)
230 Socket 87 909* 718 x.x.x.x:1389 Idle client: Waiting for next request
231 Socket 0 70445 89872 x.x.x.x:1344 x.x.x.x
232 Socket 28797 0* 0 x.x.x.x:3389 client https start
233 Socket 0 145988 147306 x.x.x.x:1344 x.x.x.x
234 Socket 0 586261 1258275 x.x.x.x:1344 x.x.x.x
235 Socket 0 285602 466348 x.x.x.x:1344 x.x.x.x
236 Socket 0 131679 3752672 x.x.x.x:1344 x.x.x.x
237 Socket 0 447059 1790353 x.x.x.x:1344 x.x.x.x
238 Socket 0 87910 2010315 x.x.x.x:1344 x.x.x.x
239 Socket 5812 0* 0 x.x.x.x:56171 client https start
240 Socket 28 48115* 1178 x.x.x.x:80 Idle server: x.x.x.x:80/some_path
241 Socket 66 4466* 18377 x.x.x.x:3268 Idle client: Waiting for next request
242 Socket 0 596879 1296258 x.x.x.x:1344 x.x.x.x
243 Socket 0 568370 987503 x.x.x.x:1344 x.x.x.x
244 Pipe 0 1150405* 1697637 ssl_crtd #8
245 Socket 56 485* 682630 x.x.x.x:62580 Idle client: Waiting for next request
246 Socket 0 175607 1683506 x.x.x.x:1344 x.x.x.x
247 Socket 16 1424* 17194 x.x.x.x:54395 Idle client: Waiting for next request
248 Socket 28798 829* 12831* x.x.x.x:2308 Reading next request
249 Socket 56 318* 452 x.x.x.x:62585 Idle client: Waiting for next request
250 Socket 875 1734* 5924 x.x.x.x:443 https://domain.org
251 Socket 5 518* 70059 x.x.x.x:54373 Idle client: Waiting for next request
252 Socket 0 149322 313136 x.x.x.x:1344 x.x.x.x
253 Socket 0 589520 836807 x.x.x.x:1344 x.x.x.x
254 Socket 28797 0 0* x.x.x.x:54932 client https start
255 Socket 28771 1660* 0 x.x.x.x:51201 Reading next request
256 Pipe 0 916891* 1351785 ssl_crtd #9
257 Socket 60 22466* 111364 x.x.x.x:1344 x.x.x.x
258 Socket 28796 3294* 1180 x.x.x.x:59020 Reading next request
259 Socket 0 1055* 872 x.x.x.x:443 https://domain.org
260 Socket 0 14835* 624 x.x.x.x:443 https://domain.org
261 Socket 875 289287* 581694 x.x.x.x:1344 x.x.x.x
262 Socket 7 2437* 10773 x.x.x.x:65303 Idle client: Waiting for next request
263 Socket 28796 0 0 x.x.x.x:3197 client https start
264 Pipe 0 729453* 1059077 ssl_crtd #10
265 Socket 66 4370* 5763 x.x.x.x:3269 Idle client: Waiting for next request
266 Socket 107 3233* 4119 x.x.x.x:64586 Idle client: Waiting for next request
267 Socket 0 212472 431063 x.x.x.x:1344 x.x.x.x
268 Pipe 0 578076* 850440 ssl_crtd #11
269 Socket 113 407* 613 x.x.x.x:51460 Idle client: Waiting for next request
270 Socket 0 1101* 4474 x.x.x.x:443 https://domain.org
271 Socket 0 2563693 3830336 x.x.x.x:1344 x.x.x.x
272 Socket 0 828859 1380776 x.x.x.x:1344 x.x.x.x
273 Socket 0 71319 259076 x.x.x.x:1344 x.x.x.x
274 Socket 105 609* 435 x.x.x.x:3171 Idle client: Waiting for next request
275 Socket 28799 433* 0 x.x.x.x:1427 Reading next request
276 Socket 0 74500 185574 x.x.x.x:1344 x.x.x.x
277 Socket 0 189973 564948 x.x.x.x:1344 x.x.x.x
278 Socket 60 129925* 458165 x.x.x.x:1344 x.x.x.x
279 Socket 28783 0* 0 x.x.x.x:60797 client https start
280 Socket 28797 731* 0 x.x.x.x:54488 Reading next request
281 Socket 0 70962 98876 x.x.x.x:1344 x.x.x.x
282 Socket 0 77789 334559 x.x.x.x:1344 x.x.x.x
283 Socket 115 649* 623 x.x.x.x:54482 Idle client: Waiting for next request
284 Socket 0 131737 182857 x.x.x.x:1344 x.x.x.x
285 Socket 28799 0 0 x.x.x.x:3216 client https start
286 Socket 74 469* 555 x.x.x.x:60744 Idle client: Waiting for next request
287 Pipe 0 85247* 124165 ssl_crtd #1
288 Socket 0 996913 1509983 x.x.x.x:1344 x.x.x.x
289 Pipe 0 466480* 700518 ssl_crtd #12
290 Socket 0 70702 74868 x.x.x.x:1344 x.x.x.x
291 Socket 88 518* 43112 x.x.x.x:60756 Idle client: Waiting for next request
292 Socket 9 10213* 1158 x.x.x.x:54068 Idle client: Waiting for next request
293 Socket 900 269761* 431423* x.x.x.x:1344 x.x.x.x
294 Socket 0 88023 296477 x.x.x.x:1344 x.x.x.x
295 Socket 113 201* 3316 x.x.x.x:51038 Idle client: Waiting for next request
296 Socket 28800 0 0 x.x.x.x:2385 client https start
297 Socket 0 1409562 1861582 x.x.x.x:1344 x.x.x.x
298 Socket 0 74282 713086 x.x.x.x:1344 x.x.x.x
299 Socket 0 74290 182774 x.x.x.x:1344 x.x.x.x
300 Socket 97 2215* 1301 x.x.x.x:51848 Idle client: Waiting for next request
301 Socket 0 85396 343984 x.x.x.x:1344 x.x.x.x
302 Socket 0 78177 143882 x.x.x.x:1344 x.x.x.x
303 Socket 66 5881* 6604 x.x.x.x:1367 Idle client: Waiting for next request
304 Socket 0 2942297 3069551 x.x.x.x:1344 x.x.x.x
305 Pipe 0 364706* 534055 ssl_crtd #13
306 Socket 28758 0 0 x.x.x.x:55095 client https start
307 Socket 118 410* 1231 x.x.x.x:2311 Idle client: Waiting for next request
308 Socket 0 503380 1071795 x.x.x.x:1344 x.x.x.x
309 Socket 0 96839 350661 x.x.x.x:1344 x.x.x.x
310 Socket 0 556795 5837880 x.x.x.x:1344 x.x.x.x
311 Socket 112 254* 787 x.x.x.x:50711 Idle client: Waiting for next request
312 Socket 28800 0 0 x.x.x.x:3220 client https start
313 Socket 0 72449 172781 x.x.x.x:1344 x.x.x.x
314 Socket 0 185849 1747378 x.x.x.x:1344 x.x.x.x
315 Socket 0 0 0 x.x.x.x:3232 HTTP Request
316 Socket 87 201* 3316 x.x.x.x:56871 Idle client: Waiting for next request
317 Socket 9 888* 1066 x.x.x.x:2976 Idle client: Waiting for next request
318 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (269)
319 Socket 0 73737 86419 x.x.x.x:1344 x.x.x.x
320 Socket 0 648346 962465 x.x.x.x:1344 x.x.x.x
321 Socket 0 151927 449211 x.x.x.x:1344 x.x.x.x
322 Socket 0 275* 2398 x.x.x.x:443 https://domain.org
323 Socket 2 354* 466 x.x.x.x:80 Idle server: x.x.x.x:80/some_path
324 Socket 108 470* 654 x.x.x.x:2257 Idle client: Waiting for next request
325 Pipe 0 68850* 103401 ssl_crtd #2
326 Socket 0 0 0 x.x.x.x:3230 client https connect
327 Socket 28773 0* 0 x.x.x.x:56789 client https start
328 Socket 0 242751 910187 x.x.x.x:1344 x.x.x.x
329 Socket 28730 1146* 0 x.x.x.x:2150 Reading next request
330 Pipe 0 309147* 463388 ssl_crtd #14
331 Socket 28783 1366* 0 x.x.x.x:64173 Reading next request
332 Socket 0 531* 1360 x.x.x.x:443 https://domain.org
333 Socket 0 467739 655208 x.x.x.x:1344 x.x.x.x
334 Socket 0 0 0 x.x.x.x:55499 client https connect
335 Socket 10 2143* 880 x.x.x.x:54391 Idle client: Waiting for next request
336 Socket 113 10176* 1157 x.x.x.x:31352 Idle client: Waiting for next request
337 Socket 0 520857 1758549 x.x.x.x:1344 x.x.x.x
338 Socket 0 232302 359424 x.x.x.x:1344 x.x.x.x
339 Socket 59 164364* 422776 x.x.x.x:1344 x.x.x.x
340 Socket 0 1459622 1885753 x.x.x.x:1344 x.x.x.x
341 Socket 28800 0 0 x.x.x.x:60102 client https start
342 Socket 16 201* 3316 x.x.x.x:54400 Idle client: Waiting for next request
343 Socket 28799 433* 0 x.x.x.x:1429 Reading next request
344 Socket 0 170597 572080 x.x.x.x:1344 x.x.x.x
345 Pipe 0 256576* 380163 ssl_crtd #15
346 Socket 16 399* 286 x.x.x.x:61194 Idle client: Waiting for next request
347 Pipe 0 59571* 89389 ssl_crtd #3
348 Socket 19 563* 784 x.x.x.x:54402 Idle client: Waiting for next request
349 Socket 28800 0 0 x.x.x.x:3219 client https start
350 Socket 0 381663 1005072 x.x.x.x:1344 x.x.x.x
351 Socket 28799 2283* 0 x.x.x.x:49667 Reading next request
352 Socket 112 964* 1306 x.x.x.x:51189 Idle client: Waiting for next request
353 Pipe 0 218850* 321361 ssl_crtd #16
354 Socket 106 526* 276 x.x.x.x:51461 Idle client: Waiting for next request
355 Socket 19 573* 784 x.x.x.x:54403 Idle client: Waiting for next request
356 Socket 66 490* 8229 x.x.x.x:3144 Idle client: Waiting for next request
357 Pipe 0 179339* 269018 ssl_crtd #17
358 Socket 28800 0 0 x.x.x.x:3217 client https start
359 Socket 28798 0 0 x.x.x.x:1840 client https start
360 Socket 0 1080220 1947420 x.x.x.x:1344 x.x.x.x
361 Socket 0 0 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (46)
362 Socket 0 217293 913828 x.x.x.x:1344 x.x.x.x
363 Socket 44 630* 2746 x.x.x.x:80 Idle server: x.x.x.x:80/some_path
364 Socket 0 12335* 15764 x.x.x.x:443 https://domain.org
365 Socket 28800 0 0 x.x.x.x:3221 client https start
366 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (479)
367 Socket 0 343536 972237 x.x.x.x:1344 x.x.x.x
368 Socket 0 1138072 1520823 x.x.x.x:1344 x.x.x.x
369 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (254)
370 Socket 19 563* 784 x.x.x.x:54404 Idle client: Waiting for next request
371 Socket 98 537* 1246 x.x.x.x:54444 Idle client: Waiting for next request
372 Socket 0 860350 1104913 x.x.x.x:1344 x.x.x.x
373 Socket 0 1060* 23048 x.x.x.x:443 https://domain.org
374 Socket 0 1066* 20478 x.x.x.x:443 https://domain.org
375 Socket 28799 0 0 x.x.x.x:3210 client https start
376 Socket 900 0* 4618 x.x.x.x:443 https://domain.org
377 Pipe 0 55913* 81124 ssl_crtd #4
378 Socket 113 201* 3316 x.x.x.x:51039 Idle client: Waiting for next request
379 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (263)
380 Socket 113 201* 3316 x.x.x.x:51040 Idle client: Waiting for next request
381 Socket 46 3906* 24391 x.x.x.x:1344 x.x.x.x
382 Socket 28798 0 0 x.x.x.x:2320 client https start
383 Socket 0 72481 157154 x.x.x.x:1344 x.x.x.x
384 Pipe 0 133145* 199159 ssl_crtd #18
385 Socket 28776 7538* 1630 x.x.x.x:54399 Reading next request
386 Pipe 0 7025* 10746 ssl_crtd #1
387 Socket 86 482* 654 x.x.x.x:49662 Idle client: Waiting for next request
388 Socket 91 1173* 343 x.x.x.x:60760 Idle client: Waiting for next request
389 Socket 0 1560783 3101138 x.x.x.x:1344 x.x.x.x
390 Socket 28796 0 0 x.x.x.x:3198 client https start
391 Socket 0 580399 792546 x.x.x.x:1344 x.x.x.x
392 Socket 0 78307 198904 x.x.x.x:1344 x.x.x.x
393 Socket 28737 0* 0 x.x.x.x:51806 client https start
394 Socket 18 470* 3778 x.x.x.x:3088 Idle client: Waiting for next request
395 Socket 28800 0 0 x.x.x.x:3223 client https start
396 Socket 0 0 0 x.x.x.x:3235 HTTP Request
397 Socket 7 1934* 615 x.x.x.x:54066 Idle client: Waiting for next request
398 Pipe 0 113172* 166273 ssl_crtd #19
399 Socket 893 195206* 214787 x.x.x.x:1344 x.x.x.x
400 Socket 28754 10860* 10436 x.x.x.x:4100 Reading next request
401 Socket 17 201* 1324 x.x.x.x:80 Idle server: x.x.x.x:80/some_path
402 Socket 0 2234270 2503172 x.x.x.x:1344 x.x.x.x
403 Socket 28800 5134* 2537 x.x.x.x:1834 Reading next request
404 Socket 28772 1637* 0 x.x.x.x:51847 Reading next request
405 Socket 54 306* 452 x.x.x.x:31306 Idle client: Waiting for next request
406 Socket 63 819* 1961 x.x.x.x:52887 Idle client: Waiting for next request
407 Socket 28 253* 2550 x.x.x.x:3093 Idle client: Waiting for next request
408 Socket 28793 536* 8935* x.x.x.x:60800 Reading next request
409 Socket 0 67261 67880 x.x.x.x:1344 x.x.x.x
410 Pipe 0 7959* 12590 ssl_crtd #2
411 Pipe 0 37269* 56216 ssl_crtd #5
412 Socket 0 76888 138606 x.x.x.x:1344 x.x.x.x
413 Socket 28800 0 0 x.x.x.x:3225 client https start
414 Socket 98 549* 1141 x.x.x.x:54445 Idle client: Waiting for next request
415 Socket 0 873728 1316366 x.x.x.x:1344 x.x.x.x
416 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (390)
417 Socket 97 482* 654 x.x.x.x:49408 Idle client: Waiting for next request
418 Socket 0 4690935 6430992 x.x.x.x:1344 x.x.x.x
419 Pipe 0 7549* 11042 ssl_crtd #3
420 Socket 0 1058661 1673219 x.x.x.x:1344 x.x.x.x
421 Socket 28796 10874* 125020* x.x.x.x:54421 Reading next request
422 Socket 0 619900 1893341 x.x.x.x:1344 x.x.x.x
423 Socket 0 484497 639048 x.x.x.x:1344 x.x.x.x
424 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (497)
425 Socket 28798 0 0 x.x.x.x:3200 client https start
426 Socket 0 217686 282356 x.x.x.x:1344 x.x.x.x
427 Socket 0 171843 2226884 x.x.x.x:1344 x.x.x.x
428 Socket 0 742382 1291857 x.x.x.x:1344 x.x.x.x
429 Socket 104 249* 776 x.x.x.x:61437 Idle client: Waiting for next request
430 Socket 876 338749* 449700 x.x.x.x:1344 x.x.x.x
431 Socket 0 638966 976750 x.x.x.x:1344 x.x.x.x
432 Socket 0 67626 109037 x.x.x.x:1344 x.x.x.x
433 Socket 28799 0 0 x.x.x.x:3207 client https start
434 Socket 0 539438 762345 x.x.x.x:1344 x.x.x.x
435 Socket 0 529527 740350 x.x.x.x:1344 x.x.x.x
436 Socket 0 133828 244486 x.x.x.x:1344 x.x.x.x
437 Socket 91 273* 3437 x.x.x.x:55776 Idle client: Waiting for next request
438 Socket 28799 0 0 x.x.x.x:3212 client https start
439 Socket 0 175285 360548 x.x.x.x:1344 x.x.x.x
440 Socket 28800 0 0 x.x.x.x:55498 client https connect
441 Socket 900 866564* 1274512* x.x.x.x:1344 x.x.x.x
442 Socket 0 104615 259266 x.x.x.x:1344 x.x.x.x
443 Socket 0 767495 1513964 x.x.x.x:1344 x.x.x.x
444 Socket 113 557* 3604 x.x.x.x:3187 Idle client: Waiting for next request
445 Socket 0 589528 777412 x.x.x.x:1344 x.x.x.x
446 Pipe 0 99772* 143323 ssl_crtd #20
447 Socket 0 51392* 5692 x.x.x.x:443 https://domain.org
448 Socket 0 622* 3326 x.x.x.x:443 https://domain.org
449 Socket 0 178130 479705 x.x.x.x:1344 x.x.x.x
450 Socket 0 75335 249026 x.x.x.x:1344 x.x.x.x
451 Socket 0 584110 1041464 x.x.x.x:1344 x.x.x.x
452 Socket 0 5989855 7840009 x.x.x.x:1344 x.x.x.x
453 Socket 0 70378 183780 x.x.x.x:1344 x.x.x.x
454 Socket 9 397* 817 x.x.x.x:60714 Idle client: Waiting for next request
455 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (615)
456 Socket 0 67473 70236 x.x.x.x:1344 x.x.x.x
457 Socket 113 647* 811 x.x.x.x:54477 Idle client: Waiting for next request
458 Socket 106 277* 3421 x.x.x.x:55778 Idle client: Waiting for next request
459 Socket 0 80521 283037 x.x.x.x:1344 x.x.x.x
460 Socket 98 598* 712 x.x.x.x:50085 Idle client: Waiting for next request
461 Socket 0 167275 298854 x.x.x.x:1344 x.x.x.x
462 Socket 28781 0* 0 x.x.x.x:60792 client https start
463 Socket 115 281* 3428 x.x.x.x:55779 Idle client: Waiting for next request
464 Socket 0 10405* 4874 x.x.x.x:443 https://domain.org
465 Socket 0 1025* 27592 x.x.x.x:443 https://domain.org
466 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (9)
467 Socket 98 555* 2252 x.x.x.x:60770 Idle client: Waiting for next request
468 Socket 0 9354* 2314 x.x.x.x:443 https://domain.org
469 Socket 0 91540 325953 x.x.x.x:1344 x.x.x.x
470 Socket 0 762551 1389788 x.x.x.x:1344 x.x.x.x
471 Socket 74 7830* 12535 x.x.x.x:4097 Idle client: Waiting for next request
472 Socket 0 380016 476604 x.x.x.x:1344 x.x.x.x
473 Socket 885 15670* 85733 x.x.x.x:1344 x.x.x.x
474 Socket 0 406074 456587 x.x.x.x:1344 x.x.x.x
475 Socket 28800 1335* 253 x.x.x.x:3180 Reading next request
476 Socket 46 315* 4617 x.x.x.x:1344 x.x.x.x
477 Socket 58 32530* 49384 x.x.x.x:1344 x.x.x.x
478 Socket 0 172630 242324 x.x.x.x:1344 x.x.x.x
479 Socket 118 387* 3558 x.x.x.x:2316 Idle client: Waiting for next request
480 Socket 0 74290 182781 x.x.x.x:1344 x.x.x.x
481 Socket 0 80770 197294 x.x.x.x:1344 x.x.x.x
482 Socket 0 75048 281261 x.x.x.x:1344 x.x.x.x
483 Socket 0 74554 185351 x.x.x.x:1344 x.x.x.x
484 Socket 97 482* 654 x.x.x.x:49409 Idle client: Waiting for next request
485 Socket 60 1302* 11029 x.x.x.x:1344 x.x.x.x
486 Socket 86 4856* 5810 x.x.x.x:4112 Idle client: Waiting for next request
487 Socket 105 250* 779 x.x.x.x:56421 Idle client: Waiting for next request
488 Socket 0 2063* 4526 x.x.x.x:443 https://domain.org
489 Pipe 0 30386* 47145 ssl_crtd #6
490 Socket 28756 0 0 x.x.x.x:55093 client https start
491 Socket 28800 5190* 1214 x.x.x.x:1835 Reading next request
492 Socket 878 105* 4307 x.x.x.x:1344 x.x.x.x
493 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (232)
494 Socket 900 429 866 x.x.x.x:443 https://domain.org
495 Socket 900 160740* 529879* x.x.x.x:1344 x.x.x.x
496 Socket 0 474171 673500 x.x.x.x:1344 x.x.x.x
497 Socket 113 331* 3485 x.x.x.x:54480 Idle client: Waiting for next request
498 Socket 74 1595* 730 x.x.x.x:49696 Idle client: Waiting for next request
499 Socket 0 559618 865116 x.x.x.x:1344 x.x.x.x
500 Socket 898 595* 3540 x.x.x.x:443 https://domain.org
501 Socket 0 75127 273504 x.x.x.x:1344 x.x.x.x
502 Socket 0 171003 603908 x.x.x.x:1344 x.x.x.x
503 Socket 0 377031 835100 x.x.x.x:1344 x.x.x.x
504 Socket 0 67366 69093 x.x.x.x:1344 x.x.x.x
505 Socket 88 520* 675 x.x.x.x:51841 Idle client: Waiting for next request
506 Socket 0 70420 71693 x.x.x.x:1344 x.x.x.x
507 Socket 0 71047 275124 x.x.x.x:1344 x.x.x.x
508 Socket 0 196158* 23334 x.x.x.x:443 https://domain.org
509 Socket 0 0* 0 ::1:48239 ext_wbinfo_group_acl #1
510 Socket 0 136980 194711 x.x.x.x:1344 x.x.x.x
511 Socket 898 9550* 41835 x.x.x.x:1344 x.x.x.x
512 Socket 0 921556 1321574 x.x.x.x:1344 x.x.x.x
513 Socket 98 537* 1068 x.x.x.x:54446 Idle client: Waiting for next request
514 Socket 0 70273 182857 x.x.x.x:1344 x.x.x.x
515 Socket 0 0 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (315)
516 Socket 74 507* 1559 x.x.x.x:60741 Idle client: Waiting for next request
517 Socket 87 1531* 29663 x.x.x.x:54429 Idle client: Waiting for next request
518 Socket 87 1085* 9379 x.x.x.x:54430 Idle client: Waiting for next request
519 Socket 0 36043* 842 x.x.x.x:443 https://domain.org
520 Socket 0 156225 280780 x.x.x.x:1344 x.x.x.x
521 Socket 87 1095* 9538 x.x.x.x:54431 Idle client: Waiting for next request
522 Socket 0 1090575 1456044 x.x.x.x:1344 x.x.x.x
523 Socket 0 67263 67988 x.x.x.x:1344 x.x.x.x
524 Socket 0 133693 347078 x.x.x.x:1344 x.x.x.x
525 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (69)
526 Socket 898 311676* 510052 x.x.x.x:1344 x.x.x.x
527 Socket 900 425 866 x.x.x.x:443 https://domain.org
528 Socket 0 0* 0 ::1:59459 ext_wbinfo_group_acl #2
529 Socket 0 78353 989595 x.x.x.x:1344 x.x.x.x
530 Socket 0 1096* 1782 x.x.x.x:443 https://domain.org
531 Socket 28800 0 0 x.x.x.x:3222 client https start
532 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (764)
533 Socket 0 71390 110141 x.x.x.x:1344 x.x.x.x
534 Socket 0 1203421 1809900 x.x.x.x:1344 x.x.x.x
535 Socket 0 70832 76525 x.x.x.x:1344 x.x.x.x
536 Socket 118 417* 1219 x.x.x.x:2310 Idle client: Waiting for next request
537 Socket 77 662* 275 x.x.x.x:1392 Idle client: Waiting for next request
538 Socket 0 76434 486358 x.x.x.x:1344 x.x.x.x
539 Socket 898 445876* 531378 x.x.x.x:1344 x.x.x.x
540 Socket 0 0 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (203)
541 Socket 0 69878* 1098 x.x.x.x:443 https://domain.org
542 Socket 46 384* 612 x.x.x.x:80 Idle server: x.x.x.x:80/some_path
543 Socket 0 636* 794 x.x.x.x:443 https://domain.org
544 Socket 0 2182761 2218810 x.x.x.x:1344 x.x.x.x
545 Socket 46 150988* 321272 x.x.x.x:1344 x.x.x.x
546 Socket 0 68503 78530 x.x.x.x:1344 x.x.x.x
547 Socket 896 1598* 6692 x.x.x.x:443 https://domain.org
548 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (13)
549 Socket 900 0* 866 x.x.x.x:443 https://domain.org
550 Socket 28799 0 0 x.x.x.x:3203 client https start
551 Socket 59 302774* 595817 x.x.x.x:1344 x.x.x.x
552 Socket 0 515* 1112 x.x.x.x:443 https://domain.org
553 Socket 7 395* 286 x.x.x.x:61191 Idle client: Waiting for next request
554 Socket 0 438847 475815 x.x.x.x:1344 x.x.x.x
555 Socket 0 1666817 2225879 x.x.x.x:1344 x.x.x.x
556 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (625)
557 Socket 0 87652 250185 x.x.x.x:1344 x.x.x.x
558 Socket 0 888616 1629204 x.x.x.x:1344 x.x.x.x
559 Socket 878 2012* 15232 x.x.x.x:443 https://domain.org
560 Socket 85 201* 3316 x.x.x.x:49698 Idle client: Waiting for next request
561 Socket 28774 2910* 1058 x.x.x.x:64166 Reading next request
562 Socket 898 1211* 6180 x.x.x.x:443 https://domain.org
563 Socket 97 940* 1308 x.x.x.x:3376 Idle client: Waiting for next request
564 Socket 0 275* 4748 x.x.x.x:443 https://domain.org
565 Socket 15 1446* 1306 x.x.x.x:51817 Reading next request
566 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (324)
567 Socket 0 594802 827936 x.x.x.x:1344 x.x.x.x
568 Socket 0 303279 409733 x.x.x.x:1344 x.x.x.x
569 Socket 117 1849* 615 x.x.x.x:2304 Idle client: Waiting for next request
570 Socket 0 3110* 7764 x.x.x.x:443 https://domain.org
571 Socket 0 75913* 9544 x.x.x.x:443 https://domain.org
572 Socket 57 198* 286 x.x.x.x:55768 Idle client: Waiting for next request
573 Socket 27 2763* 51668 x.x.x.x:62577 Idle client: Waiting for next request
574 Socket 0 1025* 2184 x.x.x.x:443 https://domain.org
575 Socket 99 11511* 192197 x.x.x.x:50483 Idle client: Waiting for next request
576 Socket 0 0* 0 ::1:37181 ext_wbinfo_group_acl #3
577 Socket 113 1181* 629 x.x.x.x:51203 Idle client: Waiting for next request
578 Socket 0 125227 327390 x.x.x.x:1344 x.x.x.x
579 Socket 0 80821 222391 x.x.x.x:1344 x.x.x.x
580 Socket 28798 0 0 x.x.x.x:1841 client https start
581 Socket 28798 0 0 x.x.x.x:2321 client https start
582 Socket 0 0 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (396)
583 Socket 0 0* 0 ::1:39025 ext_wbinfo_group_acl #4
584 Socket 28798 0 0 x.x.x.x:2322 client https start
585 Socket 0 67261 67974 x.x.x.x:1344 x.x.x.x
586 Socket 900 192830* 7818 x.x.x.x:443 https://domain.org
587 Socket 0 464123 1899880 x.x.x.x:1344 x.x.x.x
588 Socket 0 74290 182755 x.x.x.x:1344 x.x.x.x
589 Socket 0 647* 1728 x.x.x.x:443 https://domain.org
590 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (145)
591 Socket 28799 0 0 x.x.x.x:2323 client https start
592 Socket 28799 0 0 x.x.x.x:3201 client https start
593 Pipe 0 18335* 25554 ssl_crtd #7
594 Socket 91 292* 452 x.x.x.x:52893 Idle client: Waiting for next request
595 Socket 0 302843 1136496 x.x.x.x:1344 x.x.x.x
596 Socket 28800 0 0 x.x.x.x:2386 client https start
597 Socket 0 86639 207373 x.x.x.x:1344 x.x.x.x
598 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (279)
599 Socket 0 0* 0 ::1:51769 ext_wbinfo_group_acl #5
600 Socket 0 71364 312248 x.x.x.x:1344 x.x.x.x
601 Socket 0 919397 1075737 x.x.x.x:1344 x.x.x.x
602 Socket 0 180943 1358113 x.x.x.x:1344 x.x.x.x
603 Socket 28799 0 0 x.x.x.x:3214 client https start
604 Socket 0 692* 1178 x.x.x.x:443 https://domain.org
605 Socket 62 7966* 12814 x.x.x.x:1230 Idle client: Waiting for next request
606 Socket 0 638* 7316 x.x.x.x:443 https://domain.org
607 Socket 23 306* 452 x.x.x.x:1767 Idle client: Waiting for next request
608 Socket 28799 0 0 x.x.x.x:3205 client https start
609 Socket 0 85591 164291 x.x.x.x:1344 x.x.x.x
610 Socket 0 692* 1198 x.x.x.x:443 https://domain.org
611 Socket 28785 0* 0 x.x.x.x:3183 client https start
612 Socket 0 692* 1178 x.x.x.x:443 https://domain.org
613 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (134)
614 Socket 900 28870* 195741* x.x.x.x:1344 x.x.x.x
615 Socket 28754 0 0 x.x.x.x:55092 client https start
616 Socket 118 390* 36111 x.x.x.x:2319 Idle client: Waiting for next request
617 Socket 98 555* 2252 x.x.x.x:60769 Idle client: Waiting for next request
618 Socket 299 0* 0 x.x.x.x:1828 client http connect
619 Socket 0 473529 793634 x.x.x.x:1344 x.x.x.x
620 Socket 900 450715* 716503 x.x.x.x:1344 x.x.x.x
621 Socket 28799 0 0 x.x.x.x:3202 client https start
622 Socket 0 692* 1184 x.x.x.x:443 https://domain.org
623 Socket 874 16754* 21876 x.x.x.x:443 https://domain.org
624 Socket 28788 4986* 1596 x.x.x.x:49406 Reading next request
625 Socket 98 482* 654 x.x.x.x:64171 Idle client: Waiting for next request
626 Pipe 0 14687* 22194 ssl_crtd #8
627 Socket 59 210* 2635 x.x.x.x:1344 x.x.x.x
628 Socket 0 134507 1462114 x.x.x.x:1344 x.x.x.x
629 Socket 0 108885* 2533583* ::1:34453 squid_url_lookup.pl #1
630 Socket 0 72439 150972 x.x.x.x:1344 x.x.x.x
631 Socket 28799 0 0 x.x.x.x:3204 client https start
632 Socket 879 734* 6486 x.x.x.x:443 https://domain.org
633 Socket 0 1051410 1201280 x.x.x.x:1344 x.x.x.x
634 Socket 28799 0 0 x.x.x.x:3211 client https start
635 Socket 879 734* 6648 x.x.x.x:443 https://domain.org
636 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (611)
637 Socket 0 163962 604624 x.x.x.x:1344 x.x.x.x
638 Socket 0 48696* 856 x.x.x.x:443 https://domain.org
639 Socket 0 729827 1196381 x.x.x.x:1344 x.x.x.x
640 Socket 0 232516 347567 x.x.x.x:1344 x.x.x.x
641 Socket 28798 3754* 128113 x.x.x.x:2303 Reading next request
642 Socket 0 325777 602015 x.x.x.x:1344 x.x.x.x
643 Socket 28799 0 0 x.x.x.x:3213 client https start
644 Socket 18 397* 265 x.x.x.x:1258 Idle client: Waiting for next request
645 Socket 99 3596* 822 x.x.x.x:54417 Idle client: Waiting for next request
646 Pipe 0 14180* 21549 ssl_crtd #9
647 Socket 0 571668 1758812 x.x.x.x:1344 x.x.x.x
648 Socket 0 252* 3372 x.x.x.x:443 https://domain.org
649 Socket 0 68228 116478 x.x.x.x:1344 x.x.x.x
650 Socket 0 582* 1818 x.x.x.x:443 https://domain.org
651 Pipe 0 7520* 11022 ssl_crtd #10
652 Socket 90 435* 285 x.x.x.x:3386 Idle client: Waiting for next request
653 Socket 28799 0 0 x.x.x.x:3215 client https start
654 Socket 99 1110* 2214 x.x.x.x:60771 Idle client: Waiting for next request
655 Socket 28800 0 0 x.x.x.x:3218 client https connect
656 Socket 0 882* 1880 x.x.x.x:443 https://domain.org
657 Socket 59 0 0* x.x.x.x:80 domain.org
658 Socket 0 1283* 4442 x.x.x.x:443 https://domain.org
659 Socket 0 0 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (807)
660 Socket 90 435* 285 x.x.x.x:3384 Idle client: Waiting for next request
661 Socket 28800 0 0 x.x.x.x:3224 client https start
662 Socket 0 365673 608482 x.x.x.x:1344 x.x.x.x
663 Socket 0 81625 110628 x.x.x.x:1344 x.x.x.x
664 Socket 28800 156* 0* ::1:35046 Reading next request
665 Socket 97 2215* 1279 x.x.x.x:51849 Idle client: Waiting for next request
666 Socket 90 435* 285 x.x.x.x:3385 Idle client: Waiting for next request
667 Socket 0 620* 1220 x.x.x.x:443 https://domain.org
668 Socket 28800 201* 0* x.x.x.x:50010 Reading next request
669 Socket 0 136145 440062 x.x.x.x:1344 x.x.x.x
670 Socket 0 17564* 323089* ::1:33603 squid_url_lookup.pl #2
671 Socket 91 2348* 343 x.x.x.x:60757 Idle client: Waiting for next request
672 Socket 118 421* 17488 x.x.x.x:51046 Idle client: Waiting for next request
673 Socket 28800 0 0 x.x.x.x:3228 client https start
674 Socket 0 168525* 3042 x.x.x.x:443 https://domain.org
675 Socket 0 449451 1179110 x.x.x.x:1344 x.x.x.x
676 Socket 0 81705 176401 x.x.x.x:1344 x.x.x.x
677 Socket 28800 0 0 x.x.x.x:3229 client https connect
678 Socket 0 607338 804760 x.x.x.x:1344 x.x.x.x
679 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (417)
680 Socket 0 7879* 141662 ::1:59195 squid_url_lookup.pl #3
681 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (387)
682 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (393)
683 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (70)
684 Socket 28800 5112* 2235 x.x.x.x:1838 Reading next request
685 Socket 0 586* 990 x.x.x.x:443 https://domain.org
686 Socket 99 482* 654 x.x.x.x:60032 Idle client: Waiting for next request
687 Socket 0 1065* 20404 x.x.x.x:443 https://domain.org
688 Socket 0 4874* 61424 ::1:48333 squid_url_lookup.pl #4
689 Socket 0 225785 342266 x.x.x.x:1344 x.x.x.x
690 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (484)
691 Socket 0 247595 638177 x.x.x.x:1344 x.x.x.x
692 Socket 0 544* 1104 x.x.x.x:443 https://domain.org
693 Socket 0 70387 70862 x.x.x.x:1344 x.x.x.x
694 Socket 27680 0* 0 x.x.x.x:56755 client https start
695 Socket 300 0* 0 x.x.x.x:60802 client http connect
696 Socket 0 0 0 x.x.x.x:3231 HTTP Request
697 Socket 0 67261 67986 x.x.x.x:1344 x.x.x.x
698 Socket 0 1129* 2870 x.x.x.x:443 https://domain.org
700 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (462)
702 Socket 18 402* 266 x.x.x.x:1262 Idle client: Waiting for next request
703 Socket 9 1338* 634 x.x.x.x:80 Idle server: x.x.x.x:80/some_path
704 Socket 58 491* 682630 x.x.x.x:62581 Idle client: Waiting for next request
705 Socket 0 67626 91631 x.x.x.x:1344 x.x.x.x
706 Socket 0 67780 149096 x.x.x.x:1344 x.x.x.x
707 Socket 0 93177 639083 x.x.x.x:1344 x.x.x.x
708 Socket 0 875386 1172221 x.x.x.x:1344 x.x.x.x
709 Socket 876 588* 3324 x.x.x.x:443 https://domain.org
710 Socket 19 444* 384 x.x.x.x:1265 Idle client: Waiting for next request
711 Socket 19 425* 384 x.x.x.x:1266 Idle client: Waiting for next request
712 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (218)
716 Socket 57 420* 158 x.x.x.x:62586 Idle client: Waiting for next request
717 Socket 0 1491* 1066 x.x.x.x:443 https://domain.org
719 Socket 0 169746* 21748 x.x.x.x:443 https://domain.org
720 Socket 0 17102* 2910 x.x.x.x:443 https://domain.org
721 Socket 0 3279* 43331 ::1:42983 squid_url_lookup.pl #5
722 Socket 0 256289 269402 x.x.x.x:1344 x.x.x.x
723 Socket 0 7714* 2384 x.x.x.x:443 https://domain.org
724 Socket 0 1830* 24920 ::1:47149 squid_url_lookup.pl #6
725 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (327)
726 Socket 0 1063154 1790141 x.x.x.x:1344 x.x.x.x
727 Socket 0 616* 13608 ::1:48873 squid_url_lookup.pl #7
729 Socket 18 329* 3506 x.x.x.x:1267 Idle client: Waiting for next request
730 Socket 0 67260 67952 x.x.x.x:1344 x.x.x.x
731 Socket 0 32251* 13544 x.x.x.x:443 https://domain.org
732 Socket 0 12614* 16036 x.x.x.x:443 https://domain.org
733 Socket 0 298* 5090 ::1:59995 squid_url_lookup.pl #8
734 Socket 0 638* 3252 x.x.x.x:443 https://domain.org
735 Socket 0 252* 2900 x.x.x.x:443 https://domain.org
736 Socket 900 2405* 10516 x.x.x.x:443 https://domain.org
737 Socket 0 241* 2542 ::1:44247 squid_url_lookup.pl #9
738 Socket 0 256065 1016479 x.x.x.x:1344 x.x.x.x
740 Socket 0 69188 114543 x.x.x.x:1344 x.x.x.x
741 Socket 97 940* 1308 x.x.x.x:3379 Idle client: Waiting for next request
742 Socket 900 41281* 1514 x.x.x.x:443 https://domain.org
743 Socket 0 681278 1185273 x.x.x.x:1344 x.x.x.x
744 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (306)
745 Socket 900 1082* 10628 x.x.x.x:443 https://domain.org
746 Socket 0 5718* 9764 x.x.x.x:443 https://domain.org
747 Socket 0 620* 1196 x.x.x.x:443 https://domain.org
748 Socket 0 207* 2293 ::1:33591 squid_url_lookup.pl #10
749 Socket 0 0 0 [::]:3128 HTTP Socket
750 Socket 876 592* 3568 x.x.x.x:443 https://domain.org
751 Socket 0 0 0 [::]:3129 HTTP Socket
752 Socket 0 71255 145856 x.x.x.x:1344 x.x.x.x
753 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (569)
754 Socket 0 0 0 [::]:3130 HTTPS Socket
755 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (490)
756 Socket 0 70375 184071 x.x.x.x:1344 x.x.x.x
758 Socket 0 68918 187587 x.x.x.x:1344 x.x.x.x
760 Socket 0 132072 189220 x.x.x.x:1344 x.x.x.x
762 Socket 0 367* 1280 x.x.x.x:443 https://domain.org
763 Socket 0 74474 206574 x.x.x.x:1344 x.x.x.x
764 Socket 87 482* 654 x.x.x.x:49665 Idle client: Waiting for next request
765 Socket 0 0 0 ::1:50813 pinger
766 File 0 0 993744 /var/cache/squid/swap.state
767 Socket 893 2800* 9984 x.x.x.x:443 https://domain.org
769 Socket 0 537* 2414 x.x.x.x:443 https://domain.org
770 Socket 0 628* 3372 x.x.x.x:443 https://domain.org
771 Socket 0 306851 815547 x.x.x.x:1344 x.x.x.x
772 Socket 56 516* 676 x.x.x.x:54415 Idle client: Waiting for next request
773 Socket 0 620* 1196 x.x.x.x:443 https://domain.org
774 Socket 0 43044* 1098 x.x.x.x:443 https://domain.org
775 Socket 0 2458* 568 x.x.x.x:443 https://domain.org
776 Socket 0 173* 794 x.x.x.x:443 https://domain.org
777 Socket 0 131967 194732 x.x.x.x:1344 x.x.x.x
778 Socket 0 30285* 1720 x.x.x.x:443 https://domain.org
780 Socket 898 1213* 6800 x.x.x.x:443 https://domain.org
781 Socket 900 2103* 10472 x.x.x.x:443 https://domain.org
782 Socket 0 3627* 14436 x.x.x.x:443 https://domain.org
783 Socket 0 174* 804 x.x.x.x:443 https://domain.org
784 Socket 0 199486 463497 x.x.x.x:1344 x.x.x.x
785 Socket 0 1099* 4762 x.x.x.x:443 https://domain.org
787 Socket 0 316* 888 x.x.x.x:443 https://domain.org
790 Socket 0 2078* 2324 x.x.x.x:443 https://domain.org
791 Socket 0 316* 850 x.x.x.x:443 https://domain.org
792 Socket 0 2184* 1162 x.x.x.x:443 https://domain.org
793 Socket 0 2184* 1162 x.x.x.x:443 https://domain.org
794 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (202)
796 Socket 0 1290186 1774914 x.x.x.x:1344 x.x.x.x
797 Socket 0 67263 67949 x.x.x.x:1344 x.x.x.x
798 Socket 0 0* 0 x.x.x.x:443 x.x.x.x pinned connection for x.x.x.x (160)
799 Socket 99 7140* 3811 x.x.x.x:54406 Idle client: Waiting for next request
800 Socket 0 70622 74503 x.x.x.x:1344 x.x.x.x
801 Socket 27 2355* 1251 x.x.x.x:54407 Idle client: Waiting for next request
802 Socket 0 1154* 1136 x.x.x.x:443 https://domain.org
803 Socket 0 69578 75080 x.x.x.x:1344 x.x.x.x
804 Socket 0 1049* 1160 x.x.x.x:443 https://domain.org
805 Socket 0 976* 1136 x.x.x.x:443 https://domain.org
806 Socket 0 1261* 4482 x.x.x.x:443 https://domain.org
808 Socket 885 589* 3318 x.x.x.x:443 https://domain.org
809 Socket 0 1317* 4482 x.x.x.x:443 https://domain.org
810 Socket 900 82342* 866 x.x.x.x:443 https://domain.org
811 Socket 0 719* 1346 x.x.x.x:443 https://domain.org
812 Socket 0 1113* 1342 x.x.x.x:443 https://domain.org
814 Socket 855 2387* 13320 x.x.x.x:443 https://domain.org
815 Socket 27 500* 286 x.x.x.x:55764 Idle client: Waiting for next request
816 Socket 0 1080317 1867520 x.x.x.x:1344 x.x.x.x
820 Socket 66 1192* 7898 x.x.x.x:4110 Idle client: Waiting for next request
821 Socket 0 1025* 26932 x.x.x.x:443 https://domain.org
822 Socket 0 86033 89065 x.x.x.x:1344 x.x.x.x
823 Socket 59 326800* 558361 x.x.x.x:1344 x.x.x.x
824 Socket 893 5922* 5026 x.x.x.x:443 https://domain.org
826 Socket 0 1317411 1355916 x.x.x.x:1344 x.x.x.x
827 Pipe 0 7431* 9205 ssl_crtd #4
828 Socket 895 6112* 8018 x.x.x.x:443 https://domain.org
829 Socket 0 67263 68003 x.x.x.x:1344 x.x.x.x
830 Socket 0 13653* 11470 x.x.x.x:443 https://domain.org
831 Pipe 0 4461* 5937 ssl_crtd #5
832 Socket 0 98682 230913 x.x.x.x:1344 x.x.x.x
833 Socket 0 18285* 8984 x.x.x.x:443 https://domain.org
834 Socket 0 2769082 3379609 x.x.x.x:1344 x.x.x.x
835 Socket 0 5671* 8792 x.x.x.x:443 https://domain.org
837 Socket 0 6512* 11814 x.x.x.x:443 https://domain.org
838 Pipe 0 4461* 5937 ssl_crtd #6
839 Socket 0 252* 2606 x.x.x.x:443 https://domain.org
840 Socket 0 67366 74962 x.x.x.x:1344 x.x.x.x
842 Socket 0 71312 221653 x.x.x.x:1344 x.x.x.x
846 Pipe 0 4461* 5937 ssl_crtd #7
847 Socket 0 225360 346218 x.x.x.x:1344 x.x.x.x
849 Pipe 0 4461* 5937 ssl_crtd #8
850 Socket 0 8137* 1042 x.x.x.x:443 https://domain.org
851 Socket 885 591* 2784 x.x.x.x:443 https://domain.org
852 Pipe 0 0* 0 ssl_crtd #9
854 Socket 0 3983* 6570 x.x.x.x:443 https://domain.org
857 Pipe 0 0* 0 ssl_crtd #10
869 Socket 0 40620* 32966 x.x.x.x:443 https://domain.org
870 Socket 0 4328494 4704878 x.x.x.x:1344 x.x.x.x
878 Socket 0 70812 1451399 x.x.x.x:1344 x.x.x.x
885 Socket 0 646465 1098283 x.x.x.x:1344 x.x.x.x
891 Socket 0 949722 1844840 x.x.x.x:1344 x.x.x.x
904 Socket 888 1837* 10128 x.x.x.x:443 https://domain.org
909 Socket 0 85268 151920 x.x.x.x:1344 x.x.x.x
911 Socket 831 0* 2354 x.x.x.x:443 https://domain.org
913 Socket 0 70315 70855 x.x.x.x:1344 x.x.x.x
I don't get it. There aren't that many active file descriptors (less than 1000).
Also, on low traffic (late evening) with no CPU or mem issues at all, mgr:filedescriptors shows that there are about 2500 active file descriptors.
The only two things I can think of that could mess with Squid are:
- squid_url_lookup.pl which is an external_acl_type perl script that does a MySQL lookup (ttl=86400 negative_ttl=86400 children-max=80 children-startup=10 children-idle=3 concurrency=8)
- c-icap content scanning with clamav and libarchive
If push comes to shove I might consider temporarily disabling one or both just to see what happens, but I'm not sure if that can really be the cause of a Squid process coming down to a crawl.
Thanks,
Vieri
More information about the squid-users
mailing list