[squid-users] https bug slow browsing

Amos Jeffries squid3 at treenet.co.nz
Sat Dec 27 02:29:01 UTC 2014


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 27/12/2014 12:38 a.m., HackXBack wrote:
> 
> 
> 5 hdd = 3 terra western digital red edition

These 5 HDD is what we refer to as "spindles" when planning and
calculating cache arrangement.

* You have 5 disk "spindles".
* UFS/AUFS/diskd can only handle one cache_dir per spindle.
 - doing more will make their I/O operations collide and drastically
reduce disk speeds.

Therefor you can have 5x AUFS cache_dir on this machine.

BUT that does not exactly mean only 5 cache_dir. You can have a COSS
or Rock cache_dir alongside the UFS based on on the same spindle.
Making a total of 10 cache_dir for these disks.


> 1 hdd = 250 ssd ( system )

SSD can technically handle more than one of each type of cache_dir.
But Rock/COSS align much better with the drives internal design. So
IMO, you can have up to 5 AUFS cache_dir, and up to 6 Rock cache_dir
on this machine...


> cpu = core i7 extreme ram = 32 GB
> 

In your squid.conf you have 30 cache_dir of size 400000 MB.

At an average memory requirement of 15MB per GB of cache that means
your machine requires approx. 171 GB of RAM for fast performance when
its caches are full.

That is also just for the HTTP object cache index, no room for any
active transactions or traffic, or other caches Squid needs to operate.


With 32GB your machine is probably able to comfortably use around 2000
GB of disk cache. In otherwords only 5 of those 400GB cache_dir
directories you have given it. (Co-incidence that matches the HDD count.)


In your place I would assign a 50GB Rock cache_dir to each of the 5
HDD (for objects up to 31KB), and a 400 GB or so UFS/AUFS cache_dir on
each as well (for objects over 31KB).

Using the SSD for system swap space, so in case things get overloaded
in memory the swap is at least fast you could probably expand the
UFS/AUFS cache_dir sizes. But that requires experimentation to find
the right balance, and using the swap for reagular traffic is not a
good idea, just emergency peak loads.

Amos

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.22 (MingW32)

iQEcBAEBAgAGBQJUnhltAAoJELJo5wb/XPRjtLAH/AkBDPwLuTJmimvbujuX70FW
8KlqKanXXRIYiawoORNGqIQ7g2vxcW4l5vmpdO2gAQ/RZeedEoyojbhtx87JKXL2
zqnV+irtLkIxOrt6uBHqT4W3UB/8G7DAsA1A/HL5c4Ce7LTXxV2uNG31/EvEMRKG
GLlmyFMkEC8vVF2PwkWT0RUpi7sIA1ywHrlWxA3JlyNLVXs1UlXP5xs2b8mJeM0Z
bymuQYi5qdlqVOqrRDF+gappGJsXoSFbZcKud7G9bNFTvi+VVsTe9lYc5jxBmaIp
8dtMCMK5n6WFYqK+cLw4Dz7ux+5Eqgiu7qRNnm5507v6lk63aUjzeHODAMY7EtY=
=Bh1L
-----END PGP SIGNATURE-----


More information about the squid-users mailing list