<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:453713908;
mso-list-type:hybrid;
mso-list-template-ids:460331280 1186786216 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;}
@list l0:level1
{mso-level-text:"\(%1\)";
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link="#0563C1" vlink="#954F72"><div class=WordSection1><p class=MsoNormal>Greetings Squid users,<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>With 3.5.14 out and activating CFLAGS, I am getting into trouble. Funny too, I spent a lot of time wondering why it wasn’t adding CFLAGS in earlier builds. In any event, I have a 3.5.13 instance configured as follows:<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>./configure --prefix=/usr --localstatedir=/var --libexecdir=/usr/lib/squid --srcdir=. --datadir=/usr/share/squid --sysconfdir=/etc/squid --with-default-user=proxy --with-logdir=/var/log --with-pidfile=/var/run/squid.pid --enable-linux-netfilter --enable-cache-digests --enable-storeio=ufs,aufs,diskd,rock --enable-async-io=30 --enable-http-violations --enable-zph-qos --with-netfilter-conntrack --with-filedescriptors=65536 --with-large-files<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>It has a quartet of cache-dirs (I’m still testing and monkeying) as follows:<o:p></o:p></p><p class=MsoNormal>cache_dir rock /var/spool/squid/rock/1 64000 swap-timeout=600 max-swap-rate=600 min-size=0 max-size=128KB<o:p></o:p></p><p class=MsoNormal>cache_dir rock /var/spool/squid/rock/2 102400 swap-timeout=600 max-swap-rate=600 min-size=128KB max-size=256KB<o:p></o:p></p><p class=MsoNormal>cache_dir aufs /var/spool/squid/aufs/1 200000 16 128 min-size=256KB max-size=4096KB<o:p></o:p></p><p class=MsoNormal>cache_dir aufs /var/spool/squid/aufs/2 1500000 16 128 min-size=4096KB max-size=8196000KB<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Permissions are all proxy.proxy for the cache dirs and everything is happily running. When I read that the CFLAGS bug was solved, I thought “hey, didn’t I do some terrible thing to determine what cflags are correct on a vmware virtual instance?” and dug up the cflags that I came up with. I then compiled 3.5.14 as follows:<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal> ./configure CFLAGS="-march=core2 -mcx16 -msahf -mno-movbe -mno-aes -mno-pclmul -mno-popcnt -mno-sse4 -msse4.1" CXXFLAGS="${CFLAGS}" --with-pthreads --prefix=/usr --localstatedir=/var --libexecdir=/usr/lib/squid --srcdir=. --datadir=/usr/share/squid --sysconfdir=/etc/squid --with-default-user=proxy --with-logdir=/var/log --with-pidfile=/var/run/squid.pid --enable-linux-netfilter --enable-cache-digests --enable-storeio=ufs,aufs,diskd,rock --enable-async-io=30 --enable-http-violations --enable-zph-qos --with-netfilter-conntrack --with-filedescriptors=65536 --with-large-files<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>This leads to the following in the cache log, and a crash.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><<<SNIP<o:p></o:p></p><p class=MsoNormal>FATAL: Ipc::Mem::Segment::open failed to shm_open(/squid-var.spool.squid.rock.1_spaces.shm): (2) No such file or directory<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Squid Cache (Version 3.5.14): Terminated abnormally.<o:p></o:p></p><p class=MsoNormal>CPU Usage: 5.439 seconds = 2.581 user + 2.858 sys<o:p></o:p></p><p class=MsoNormal>>>>SNIP<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>This looks similar to a bug <a href="http://bugs.squid-cache.org/show_bug.cgi?id=3880#c1">http://bugs.squid-cache.org/show_bug.cgi?id=3880#c1</a> that was already reported, but I don’t know enough to say with certainty. It does look like these compile options are allowing squid to launch with multiple processes and do other things that I think I might want, but I can’t tell for sure. So, it does lead me to a few questions:<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoListParagraph style='text-indent:-.25in;mso-list:l0 level1 lfo1'><![if !supportLists]><span style='mso-list:Ignore'>(1)<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>Do these flags make sense? I only half know what half of them do, but they appear to basically just be supported flags on a ESXi virtual machine given my hardware. I have googled, just not a lot of light shed on this instance, thoughts and insights are appreciated.<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-.25in;mso-list:l0 level1 lfo1'><![if !supportLists]><span style='mso-list:Ignore'>(2)<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>Are my rock stores lagging out, and how would you recommend tuning them if so?<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-.25in;mso-list:l0 level1 lfo1'><![if !supportLists]><span style='mso-list:Ignore'>(3)<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>Does the strategy above make sense? My thinking is to segregate the small cache items into a rock datastore, and the big items into an aufs datastore. <o:p></o:p></p><p class=MsoListParagraph style='text-indent:-.25in;mso-list:l0 level1 lfo1'><![if !supportLists]><span style='mso-list:Ignore'>(4)<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>Do you have any pointers on calculating the size of rocks and aufs stores based on disk performance etc? I’m guessing that there is sort of a logical size to make a specific rock and aufs based on how big of items you store in it and so on. Is there some way I can apply some math and find bottlenecks?<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Finally, 3.5.14 does run fine when compiled with the first set (even with --with-pthreads added) so I think this is probably cflags related. I would like to get multiple disker processes running, I think it would probably help in my environment, but it’s not supremely critical. Anyway, there is a note at the end of the bug saying that this wasn’t seen for a while, and I thought I’d say “I’ve seen it! Maybe!” let me know if I am creating this bug through a creative mistake, or if you have other ideas here. Thanks!<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Jester Purtteman, P.E.<o:p></o:p></p><p class=MsoNormal>OptimERA Inc<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p></div></body></html>