[squid-users] Optimizing squid
Heiler Bemerguy
heiler.bemerguy at cinbesa.com.br
Thu Feb 25 19:32:53 UTC 2016
Hi guys.
Sorry, Yuri, I didn't understand your question...
BTW, I just wiped out the caches again, put only one cache_dir and
started it again.. (killed everything, squid -z, then ./squid.rc start)
*cache_dir rock /cache2/rock1 20000 min-size=0 max-size=4096 slot-size=2048*
/2016/02/25 16:23:52 kid2| Store rebuilding is 0.01% complete//
//2016/02/25 16:23:52 kid2| WARNING: cache_dir[0]: Ignoring malformed
cache entry meta data at 124223488//
//2016/02/25 16:23:53 kid1| storeLateRelease: released 0 objects//
//2016/02/25 16:23:53 kid2| WARNING: cache_dir[0]: Ignoring malformed
cache entry meta data at 707231744//
//2016/02/25 16:23:57 kid2| WARNING: cache_dir[0]: Ignoring malformed
cache entry meta data at 2716303360//
//2016/02/25 16:23:57 kid2| WARNING: cache_dir[0]: Ignoring malformed
cache entry meta data at 3097096192//
//2016/02/25 16:23:57 kid2| WARNING: cache_dir[0]: Ignoring malformed
cache entry meta data at 3183704064//
//2016/02/25 16:23:58 kid2| WARNING: cache_dir[0]: Ignoring malformed
cache entry meta data at 3371225088//
//2016/02/25 16:24:00 kid2| WARNING: cache_dir[0]: Ignoring malformed
cache entry meta data at 4721772544//
//2016/02/25 16:24:01 kid2| WARNING: cache_dir[0]: Ignoring malformed
cache entry meta data at 5304958976//
//2016/02/25 16:24:02 kid2| WARNING: cache_dir[0]: Ignoring malformed
cache entry meta data at 5809602560//
//2016/02/25 16:24:03 kid2| WARNING: cache_dir[0]: Ignoring malformed
cache entry meta data at 6067552256//
//2016/02/25 16:24:03 kid2| WARNING: cache_dir[0]: Ignoring malformed
cache entry meta data at 6331369472//
//2016/02/25 16:24:06 kid2| WARNING: cache_dir[0]: Ignoring malformed
cache entry meta data at 7896072192//
//2016/02/25 16:24:06 kid2| WARNING: cache_dir[0]: Ignoring malformed
cache entry meta data at 7939930112//
//2016/02/25 16:24:07 kid2| Store rebuilding is 39.38% complete/
And now, between all those "/WARNING: swapfile header inconsistent with
available data/", which won't stop, I'm having this too:
/2016/02/25 16:30:50 kid1| assertion failed: FwdState.cc:654:
"!Comm::IsConnOpen(serverConn)"/
(3.5.15 bug, right?)
Best Regards,
--
Heiler Bemerguy - (91) 98151-4894
Assessor Técnico - CINBESA (91) 3184-1751
Em 25/02/2016 15:49, Yuri Voinov escreveu:
>
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA256
>
> Hm. What array does itself this time?
>
> 26.02.16 0:44, Heiler Bemerguy пишет:
> > > Since it started with both cache_dirs... > > > Em 25/02/2016 15:32,
> Yuri Voinov escreveu: >> > Don't think so. > > This messages floods
> all time? > > 26.02.16 0:17, Heiler Bemerguy пишет: > > > > I
> waited squid -z to finish.. did a "ps auxw |grep squid" a >
> dozen times to check.. THEN I started it. > > > It may have
> tried to serve something, as lots of users we're > already
> conecting to it right after it started, but I'm still > seeing a
> flood of warnings on error.log: > > > > > > > /2016/02/25
> 15:06:38 kid1| WARNING: swapfile header > inconsistent with
> available data// > > > //2016/02/25 15:06:38 kid1| WARNING:
> swapfile header > inconsistent with available data// > > >
> //2016/02/25 15:06:38 kid1| WARNING: swapfile header >
> inconsistent with available data// > > > //2016/02/25 15:06:39
> kid1| WARNING: swapfile header > inconsistent with available
> data/ > > > > > It's curious that with only one cache_dir (the
> first one), I > didn't receive any of these errors... > >
> > Maybe the non-rounded "4097" value is causing an issue? > > >
> > > Best Regards, > > > > > -- > > > Heiler Bemerguy
> - (91) 98151-4894 > > > Assessor Técnico - CINBESA (91)
> 3184-1751 > > > > > > > Em 25/02/2016 14:18, Amos Jeffries
> escreveu: > > >> On 26/02/2016 5:58 a.m., Heiler Bemerguy wrote:
> > > >>> Hi Alex, Eliezer, Yuri, Amos.. > > >>> > >
> >>> So, to start from the start, after seeing squid was >
> totally stable and > > >>> fast, running with NO cache_dirs, I
> tried to add only > 2 rockstore > > >>> cache_dirs to
> test. > > >>> > > >>> conf: > > >>> /cache_dir rock
> /cache2/rock1 20000 min-size=0 > max-size=4096 > > >>>
> slot-size=2048// > > >>> //cache_dir rock /cache2/rock2 30000
> min-size=4097 > max-size=16384 > > >>> slot-size=4096/ >
> > >>> (ps.: I know it would be nice to use one store PER >
> partition/disk/lun > > >>> whatever.. but I'm trying to lessen
> disk wasting by > using small > > >>> slot-sizes for small
> files.. am I wrong?) > > >>> > > >>> Then squid -z: >
> > >>> /2016/02/25 13:42:00 kid2| Creating Rock db: >
> /cache2/rock1/rock// > > >>> //2016/02/25 13:42:00 kid3|
> Creating Rock db: > /cache2/rock2/rock/ > > >>> > >
> >>> Then running squid for the first time with these > newly
> created rock > > >>> stores.... > > >>> > > >>>
> /2016/02/25 13:42:09 kid3| Loading cache_dir #1 from >
> /cache2/rock2/rock// > > >>> //2016/02/25 13:42:09 kid2| Loading
> cache_dir #0 from > /cache2/rock1/rock// > > >>>
> //2016/02/25 13:42:09 kid3| Store rebuilding is 0.01% >
> complete// > > >>> //2016/02/25 13:42:09 kid2| Store rebuilding
> is 0.01% > complete/ > > >>> > > >>> Rebuilding
> what? just creating the huge files I > think... > > >> The
> cache index for those rock DB. > > >> > > >> Unlike UFS
> which stores a swap.state file, rock rebuilds > its index on >
> > >> each startup. > > >> > > >>> Then: > >
> >>> /2016/02/25 13:42:19 kid1| WARNING: swapfile header >
> inconsistent with > > >>> available data > > >>>
> 2016/02/25 13:42:21 kid2| WARNING: cache_dir[0]: > Ignoring
> malformed > > >>> cache entry meta data at 6943832064 > >
> >> <snip repeats> > > >>> 2016/02/25 13:42:40 kid1| ctx: enter
> level 0: > > >>> >
> 'http://static.bn-static.com/pg/0plcB0QjJpBbwN7rMMDjKKO5Z63Nhu3zfPw==.gif'
> > > >>> 2016/02/25 13:42:40 kid1| WARNING: swapfile header
> > inconsistent with > > >>> available data > > >>>
> 2016/02/25 13:42:40 kid2| WARNING: cache_dir[0]: > Ignoring
> malformed > > >>> cache entry meta data at 19581075456 > >
> >>> 2016/02/25 13:42:41 kid2| WARNING: cache_dir[0]: > Ignoring
> malformed > > >>> cache entry meta data at 19757760512 > >
> >>> 2016/02/25 13:42:43 kid2| Finished rebuilding storage > from
> disk. > > >>> 2016/02/25 13:42:43 kid2| 10239992 Entries
> scanned > > >>> 2016/02/25 13:42:43 kid2| 14 Invalid
> > entries./// > > >>> > > >>> What entry? why
> malformed? Wasn't it just a empty > store?! it just > >
> >>> created it....... > > >>> > > >> > > >> Did you
> wait for the -z background processes to finish > creating the
> 50GB > > >> of disk allocation before starting the main Squid
> process > ? > > >> > > >> Are your workers trying to
> serve up traffic to or from > the cache before > > >> the
> rebuild has completed? > > >> > > >> > > >> As you
> can see from the log timestamps on startup it will > take ~30-60
> > > >> sec for the rock caches of that size to be loaded in your
> > system. > > >> > > >> > > >> Amos > >
> >> > > >> _______________________________________________ >
> > >> squid-users mailing list > > >>
> squid-users at lists.squid-cache.org > > >>
> http://lists.squid-cache.org/listinfo/squid-users > > > > > > >
> > > _______________________________________________ > > >
> squid-users mailing list > > > squid-users at lists.squid-cache.org
> > > > http://lists.squid-cache.org/listinfo/squid-users > >> >>
> >> >> _______________________________________________ >> squid-users
> mailing list >> squid-users at lists.squid-cache.org >>
> http://lists.squid-cache.org/listinfo/squid-users > > -- > Heiler
> Bemerguy - (91) 98151-4894 > Assessor Técnico - CINBESA (91) 3184-1751
> > > > _______________________________________________ > squid-users
> mailing list > squid-users at lists.squid-cache.org >
> http://lists.squid-cache.org/listinfo/squid-users
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v2
>
> iQEcBAEBCAAGBQJWz0y5AAoJENNXIZxhPexGNWIIAMyIhCWXnFfmOxZUtViQGvqp
> SNgdjYHjc5yCBsu4IdjlUTeYxwtp/wmn8u4K934oM00kzHw1aAnMUHHc9sRkiNlj
> oWKfejsHCxlEZyhuIvJ6qlRE/+EkFW35/rubKxHYH22aQ/R9hQaeb+mCW847bSNu
> qOaKyPG6NUj9+mHxhdg86XhG946+JXSHg0ALQjIPYAfrLAKPLGnPrxwc9KxMCQyZ
> wfhCDA9rS9GqUF0bOfbeO26ruJt0Y0fXpaC3Uuh/TCCTQlvg5mHXsFgq13kDSJta
> QPdyDaB9mroq/twocn6fe0/J0gAwi29pXISF1AmkcKEdoyIViMix/fykarMm7l4=
> =86Sx
> -----END PGP SIGNATURE-----
>
>
>
> _______________________________________________
> squid-users mailing list
> squid-users at lists.squid-cache.org
> http://lists.squid-cache.org/listinfo/squid-users
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.squid-cache.org/pipermail/squid-users/attachments/20160225/bc3fd454/attachment-0001.html>
More information about the squid-users
mailing list