<html>
<head>
<meta content="text/html; charset=utf-8" http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<br>
Hi Alex, Eliezer, Yuri, Amos..<br>
<br>
So, to start from the start, after seeing squid was totally stable
and fast, running with NO cache_dirs, I tried to add only 2
rockstore cache_dirs to test.<br>
<br>
conf:<br>
<i>cache_dir rock /cache2/rock1 20000 min-size=0 max-size=4096
slot-size=2048</i><i><br>
</i><i>cache_dir rock /cache2/rock2 30000 min-size=4097
max-size=16384 slot-size=4096</i><br>
(ps.: I know it would be nice to use one store PER
partition/disk/lun whatever.. but I'm trying to lessen disk wasting
by using small slot-sizes for small files.. am I wrong?)<br>
<br>
Then squid -z:<br>
<i>2016/02/25 13:42:00 kid2| Creating Rock db: /cache2/rock1/rock</i><i><br>
</i><i>2016/02/25 13:42:00 kid3| Creating Rock db:
/cache2/rock2/rock</i><br>
<br>
Then running squid for the first time with these newly created rock
stores....<br>
<br>
<i>2016/02/25 13:42:09 kid3| Loading cache_dir #1 from
/cache2/rock2/rock</i><i><br>
</i><i>2016/02/25 13:42:09 kid2| Loading cache_dir #0 from
/cache2/rock1/rock</i><i><br>
</i><i>2016/02/25 13:42:09 kid3| Store rebuilding is 0.01% complete</i><i><br>
</i><i>2016/02/25 13:42:09 kid2| Store rebuilding is 0.01% complete</i><br>
<br>
Rebuilding what? just creating the huge files I think...<br>
<br>
Then:<br>
<i>2016/02/25 13:42:19 kid1| WARNING: swapfile header inconsistent
with available data<br>
2016/02/25 13:42:21 kid2| WARNING: cache_dir[0]: Ignoring
malformed cache entry meta data at 6943832064<br>
2016/02/25 13:42:22 kid2| WARNING: cache_dir[0]: Ignoring
malformed cache entry meta data at 7424217088<br>
2016/02/25 13:42:22 kid2| WARNING: cache_dir[0]: Ignoring
malformed cache entry meta data at 7616405504<br>
2016/02/25 13:42:22 kid2| WARNING: cache_dir[0]: Ignoring
malformed cache entry meta data at 7813527552<br>
2016/02/25 13:42:22 kid2| WARNING: cache_dir[0]: Ignoring
malformed cache entry meta data at 8124858368<br>
2016/02/25 13:42:24 kid3| Store rebuilding is 42.67% complete<br>
2016/02/25 13:42:24 kid2| Store rebuilding is 42.57% complete<br>
2016/02/25 13:42:24 kid1| WARNING: swapfile header inconsistent
with available data<br>
2016/02/25 13:42:24 kid1| WARNING: swapfile header inconsistent
with available data<br>
2016/02/25 13:42:25 kid1| WARNING: swapfile header inconsistent
with available data<br>
2016/02/25 13:42:26 kid1| WARNING: swapfile header inconsistent
with available data<br>
2016/02/25 13:42:27 kid1| WARNING: swapfile header inconsistent
with available data<br>
2016/02/25 13:42:27 kid1| WARNING: swapfile header inconsistent
with available data<br>
2016/02/25 13:42:27 kid1| WARNING: swapfile header inconsistent
with available data<br>
2016/02/25 13:42:28 kid2| WARNING: cache_dir[0]: Ignoring
malformed cache entry meta data at 11881381888<br>
2016/02/25 13:42:29 kid2| WARNING: cache_dir[0]: Ignoring
malformed cache entry meta data at 12680894464<br>
2016/02/25 13:42:29 kid2| WARNING: cache_dir[0]: Ignoring
malformed cache entry meta data at 12737179648<br>
2016/02/25 13:42:31 kid1| WARNING: swapfile header inconsistent
with available data<br>
2016/02/25 13:42:31 kid2| WARNING: cache_dir[0]: Ignoring
malformed cache entry meta data at 14243010560<br>
2016/02/25 13:42:32 kid2| WARNING: cache_dir[0]: Ignoring
malformed cache entry meta data at 14443577344<br>
2016/02/25 13:42:34 kid2| WARNING: cache_dir[0]: Ignoring
malformed cache entry meta data at 15603302400<br>
2016/02/25 13:42:35 kid2| WARNING: cache_dir[0]: Ignoring
malformed cache entry meta data at 16192946176<br>
2016/02/25 13:42:37 kid1| WARNING: swapfile header inconsistent
with available data<br>
2016/02/25 13:42:37 kid1| WARNING: swapfile header inconsistent
with available data<br>
2016/02/25 13:42:38 kid1| WARNING: swapfile header inconsistent
with available data<br>
2016/02/25 13:42:39 kid3| Store rebuilding is 86.02% complete<br>
2016/02/25 13:42:39 kid2| Store rebuilding is 88.28% complete<br>
2016/02/25 13:42:39 kid1| WARNING: swapfile header inconsistent
with available data<br>
2016/02/25 13:42:39 kid1| WARNING: swapfile header inconsistent
with available data<br>
2016/02/25 13:42:40 kid1| ctx: enter level 0:
'<a class="moz-txt-link-freetext" href="http://static.bn-static.com/pg/0plcB0QjJpBbwN7rMMDjKKO5Z63Nhu3zfPw==.gif">http://static.bn-static.com/pg/0plcB0QjJpBbwN7rMMDjKKO5Z63Nhu3zfPw==.gif</a>'<br>
2016/02/25 13:42:40 kid1| WARNING: swapfile header inconsistent
with available data<br>
2016/02/25 13:42:40 kid2| WARNING: cache_dir[0]: Ignoring
malformed cache entry meta data at 19581075456<br>
2016/02/25 13:42:41 kid2| WARNING: cache_dir[0]: Ignoring
malformed cache entry meta data at 19757760512<br>
2016/02/25 13:42:43 kid2| Finished rebuilding storage from disk.<br>
2016/02/25 13:42:43 kid2| 10239992 Entries scanned<br>
2016/02/25 13:42:43 kid2| 14 Invalid entries.</i><i></i><br>
<br>
What entry? why malformed? Wasn't it just a empty store?! it just
created it.......<br>
<br>
Best Regards,<br>
<br>
<pre class="moz-signature" cols="72">--
Heiler Bemerguy - (91) 98151-4894
Assessor Técnico - CINBESA (91) 3184-1751</pre>
<br>
<div class="moz-cite-prefix">Em 24/02/2016 19:00, Alex Rousskov
escreveu:<br>
</div>
<blockquote cite="mid:56CE280C.8050707@measurement-factory.com"
type="cite">
<pre wrap="">On 02/24/2016 12:44 PM, Heiler Bemerguy wrote:
</pre>
<blockquote type="cite">
<pre wrap="">I don't think I had a bottleneck on I/O itself,
</pre>
</blockquote>
<pre wrap="">
In general, I/O bottlenecks with rock or ufs cache_dirs do not result in
sustained 100% CPU utilization. I do not know enough about aufs to say
whether that cache_dir type can have those symptoms during overload.
</pre>
<blockquote type="cite">
<pre wrap="">maybe the hash/search of cache indexes was too much for a single thread?
</pre>
</blockquote>
<pre wrap="">
See my earlier response regarding Squid bugs when handling huge files.
Nothing you have posted so far disproves that working theory.
Cheers,
Alex.
</pre>
</blockquote>
<br>
</body>
</html>