[squid-users] Optimizing squid

Yuri Voinov yvoinov at gmail.com
Thu Feb 25 18:49:30 UTC 2016


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256
 
Hm. What array does itself this time?

26.02.16 0:44, Heiler Bemerguy пишет:
>
> Since it started with both cache_dirs...
>
>
> Em 25/02/2016 15:32, Yuri Voinov escreveu:
>>
> Don't think so.
>
> This messages floods all time?
>
> 26.02.16 0:17, Heiler Bemerguy пишет:
>
>
>       > I waited squid -z to finish.. did a "ps auxw |grep squid" a
>       dozen times to check.. THEN I started it.
>
>       > It may have tried to serve something, as lots of users we're
>       already conecting to it right after it started, but I'm still
>       seeing a flood of warnings on error.log:
>
>
>
>
>
>       > /2016/02/25 15:06:38 kid1| WARNING: swapfile header
>       inconsistent with available data//
>
>       > //2016/02/25 15:06:38 kid1| WARNING: swapfile header
>       inconsistent with available data//
>
>       > //2016/02/25 15:06:38 kid1| WARNING: swapfile header
>       inconsistent with available data//
>
>       > //2016/02/25 15:06:39 kid1| WARNING: swapfile header
>       inconsistent with available data/
>
>
>
>       > It's curious that with only one cache_dir (the first one), I
>       didn't receive any of these errors...
>
>       > Maybe the non-rounded "4097" value is causing an issue?
>
>
>
>       > Best Regards,
>
>
>
>       > --
>
>       > Heiler Bemerguy - (91) 98151-4894
>
>       > Assessor Técnico - CINBESA (91) 3184-1751
>
>
>
>
>
>       > Em 25/02/2016 14:18, Amos Jeffries escreveu:
>
>       >> On 26/02/2016 5:58 a.m., Heiler Bemerguy wrote:
>
>       >>> Hi Alex, Eliezer, Yuri, Amos..
>
>       >>>
>
>       >>> So, to start from the start, after seeing squid was
>       totally stable and
>
>       >>> fast, running with NO cache_dirs, I tried to add only
>       2 rockstore
>
>       >>> cache_dirs to test.
>
>       >>>
>
>       >>> conf:
>
>       >>> /cache_dir rock /cache2/rock1 20000 min-size=0
>       max-size=4096
>
>       >>> slot-size=2048//
>
>       >>> //cache_dir rock /cache2/rock2 30000 min-size=4097
>       max-size=16384
>
>       >>> slot-size=4096/
>
>       >>> (ps.: I know it would be nice to use one store PER
>       partition/disk/lun
>
>       >>> whatever.. but I'm trying to lessen disk wasting by
>       using small
>
>       >>> slot-sizes for small files.. am I wrong?)
>
>       >>>
>
>       >>> Then squid -z:
>
>       >>> /2016/02/25 13:42:00 kid2| Creating Rock db:
>       /cache2/rock1/rock//
>
>       >>> //2016/02/25 13:42:00 kid3| Creating Rock db:
>       /cache2/rock2/rock/
>
>       >>>
>
>       >>> Then running squid for the first time with these
>       newly created rock
>
>       >>> stores....
>
>       >>>
>
>       >>> /2016/02/25 13:42:09 kid3| Loading cache_dir #1 from
>       /cache2/rock2/rock//
>
>       >>> //2016/02/25 13:42:09 kid2| Loading cache_dir #0 from
>       /cache2/rock1/rock//
>
>       >>> //2016/02/25 13:42:09 kid3| Store rebuilding is 0.01%
>       complete//
>
>       >>> //2016/02/25 13:42:09 kid2| Store rebuilding is 0.01%
>       complete/
>
>       >>>
>
>       >>> Rebuilding what? just creating the huge files I
>       think...
>
>       >> The cache index for those rock DB.
>
>       >>
>
>       >> Unlike UFS which stores a swap.state file, rock rebuilds
>       its index on
>
>       >> each startup.
>
>       >>
>
>       >>> Then:
>
>       >>> /2016/02/25 13:42:19 kid1| WARNING: swapfile header
>       inconsistent with
>
>       >>> available data
>
>       >>> 2016/02/25 13:42:21 kid2| WARNING: cache_dir[0]:
>       Ignoring malformed
>
>       >>> cache entry meta data at 6943832064
>
>       >> <snip repeats>
>
>       >>> 2016/02/25 13:42:40 kid1| ctx: enter level  0:
>
>       >>>
> 'http://static.bn-static.com/pg/0plcB0QjJpBbwN7rMMDjKKO5Z63Nhu3zfPw==.gif'
>
>       >>> 2016/02/25 13:42:40 kid1| WARNING: swapfile header
>       inconsistent with
>
>       >>> available data
>
>       >>> 2016/02/25 13:42:40 kid2| WARNING: cache_dir[0]:
>       Ignoring malformed
>
>       >>> cache entry meta data at 19581075456
>
>       >>> 2016/02/25 13:42:41 kid2| WARNING: cache_dir[0]:
>       Ignoring malformed
>
>       >>> cache entry meta data at 19757760512
>
>       >>> 2016/02/25 13:42:43 kid2| Finished rebuilding storage
>       from disk.
>
>       >>> 2016/02/25 13:42:43 kid2|   10239992 Entries scanned
>
>       >>> 2016/02/25 13:42:43 kid2|        14 Invalid
>       entries.///
>
>       >>>
>
>       >>> What entry? why malformed? Wasn't it just a empty
>       store?! it just
>
>       >>> created it.......
>
>       >>>
>
>       >>
>
>       >> Did you wait for the -z background processes to finish
>       creating the 50GB
>
>       >> of disk allocation before starting the main Squid process
>       ?
>
>       >>
>
>       >> Are your workers trying to serve up traffic to or from
>       the cache before
>
>       >> the rebuild has completed?
>
>       >>
>
>       >>
>
>       >> As you can see from the log timestamps on startup it will
>       take ~30-60
>
>       >> sec for the rock caches of that size to be loaded in your
>       system.
>
>       >>
>
>       >>
>
>       >> Amos
>
>       >>
>
>       >> _______________________________________________
>
>       >> squid-users mailing list
>
>       >> squid-users at lists.squid-cache.org
>
>       >> http://lists.squid-cache.org/listinfo/squid-users
>
>
>
>
>
>
>
>       > _______________________________________________
>
>       > squid-users mailing list
>
>       > squid-users at lists.squid-cache.org
>
>       > http://lists.squid-cache.org/listinfo/squid-users
>
>>
>>
>>
>> _______________________________________________
>> squid-users mailing list
>> squid-users at lists.squid-cache.org
>> http://lists.squid-cache.org/listinfo/squid-users
>
> --
> Heiler Bemerguy - (91) 98151-4894
> Assessor Técnico - CINBESA (91) 3184-1751
>
>
> _______________________________________________
> squid-users mailing list
> squid-users at lists.squid-cache.org
> http://lists.squid-cache.org/listinfo/squid-users

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2
 
iQEcBAEBCAAGBQJWz0y5AAoJENNXIZxhPexGNWIIAMyIhCWXnFfmOxZUtViQGvqp
SNgdjYHjc5yCBsu4IdjlUTeYxwtp/wmn8u4K934oM00kzHw1aAnMUHHc9sRkiNlj
oWKfejsHCxlEZyhuIvJ6qlRE/+EkFW35/rubKxHYH22aQ/R9hQaeb+mCW847bSNu
qOaKyPG6NUj9+mHxhdg86XhG946+JXSHg0ALQjIPYAfrLAKPLGnPrxwc9KxMCQyZ
wfhCDA9rS9GqUF0bOfbeO26ruJt0Y0fXpaC3Uuh/TCCTQlvg5mHXsFgq13kDSJta
QPdyDaB9mroq/twocn6fe0/J0gAwi29pXISF1AmkcKEdoyIViMix/fykarMm7l4=
=86Sx
-----END PGP SIGNATURE-----

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.squid-cache.org/pipermail/squid-users/attachments/20160226/26a8f17a/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 0x613DEC46.asc
Type: application/pgp-keys
Size: 2437 bytes
Desc: not available
URL: <http://lists.squid-cache.org/pipermail/squid-users/attachments/20160226/26a8f17a/attachment-0001.key>


More information about the squid-users mailing list