<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
<p>having 3GB memory with a ufdb improves performace<br>
</p>
<div class="moz-cite-prefix">6.08.20 08:28, m k пишет:<br>
</div>
<blockquote type="cite"
cite="mid:CAL-uOnEBxDvYw898DVUZvzwa9dk2uyM2AxX=-tx5VrdTn35nYw@mail.gmail.com">
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
<div>
<div dir="auto">Eliezer,</div>
<div dir="auto"><br>
</div>
<div dir="auto">Squid's default setting is 1 core CPU, 16GB mem.</div>
<div dir="auto">How many URLs(Blacklist) will degrade Squid's
performance?</div>
<div dir="auto"><br>
</div>
<div dir="auto">Also, SSL-Bump.</div>
<div dir="auto"><br>
</div>
<div dir="auto">Thank you,</div>
<div dir="auto">kitamura</div>
<br>
</div>
<div><br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">2020年8月6日(木) 13:38 Eliezer
Croitor <<a href="mailto:ngtech1ltd@gmail.com"
moz-do-not-send="true">ngtech1ltd@gmail.com</a>>:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div link="blue" vlink="purple" lang="EN-US">
<div class="m_8478223664081274394WordSection1">
<p class="MsoNormal">Kitamura,</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">About the tens of thousands of
URLs, Have you considered using a Blacklisting
utility, it might lower the memory footprint.</p>
</div>
</div>
<div link="blue" vlink="purple" lang="EN-US">
<div class="m_8478223664081274394WordSection1">
<p class="MsoNormal"> </p>
<p class="MsoNormal">Eliezer</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">----</p>
<p class="MsoNormal">Eliezer Croitoru</p>
<p class="MsoNormal">Tech Support</p>
<p class="MsoNormal">Mobile: +972-5-28704261</p>
<p class="MsoNormal">Email: <a
href="mailto:ngtech1ltd@gmail.com" target="_blank"
moz-do-not-send="true">ngtech1ltd@gmail.com</a></p>
<p class="MsoNormal"> </p>
<div style="border:none;border-top:solid #e1e1e1
1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> squid-users <<a
href="mailto:squid-users-bounces@lists.squid-cache.org"
target="_blank" moz-do-not-send="true">squid-users-bounces@lists.squid-cache.org</a>>
<b>On Behalf Of </b>m k<br>
<b>Sent:</b> Thursday, August 6, 2020 7:25 AM<br>
<b>To:</b> Amos Jeffries <<a
href="mailto:squid3@treenet.co.nz" target="_blank"
moz-do-not-send="true">squid3@treenet.co.nz</a>><br>
<b>Cc:</b> <a
href="mailto:squid-users@lists.squid-cache.org"
target="_blank" moz-do-not-send="true">squid-users@lists.squid-cache.org</a><br>
<b>Subject:</b> Re: [squid-users] I would like to
know performance sizing aspects.</p>
</div>
<p class="MsoNormal"> </p>
<div>
<div>
<div>
<p class="MsoNormal">Amos,</p>
</div>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">Thank you for your reply.</p>
</div>
<div>
<p class="MsoNormal">It was very helpful.</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">> That number was gained
before HTTPS became so popular. So YMMV depending<br>
> on how many CONNECT tunnels you have to deal
with. That HTTPS traffic can possibly be
decrypted </p>
</div>
<div>
<p class="MsoNormal">> and cached but performance
trade-offs are quite large.</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">Squid uses SSL-Bump.</p>
</div>
<div>
<p class="MsoNormal">I'm very worried about the
internet slowing down due to https decording. and
I'm also worried about the internet slowing down
due to using Blacklist.</p>
</div>
<div>
<p class="MsoNormal">I load tens of thousands of
URL(black list file) every time I set up ACL.</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">How many requests does SSL-Bump
in one second?</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">Thank you,</p>
</div>
<div>
<p class="MsoNormal">kitamura</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<div>
<div>
<p class="MsoNormal">2020<span
style="font-family:"MS Gothic"">年</span>8<span
style="font-family:"MS Gothic"">月</span>5<span
style="font-family:"MS Gothic"">日</span>(<span
style="font-family:"MS Gothic"">水</span>)
10:32 Amos Jeffries <<a
href="mailto:squid3@treenet.co.nz"
target="_blank" moz-do-not-send="true">squid3@treenet.co.nz</a>>:</p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<blockquote style="border:none;border-left:solid
#cccccc 1.0pt;padding:0in 0in 0in
6.0pt;margin-left:4.8pt;margin-right:0in">
<p class="MsoNormal">On 5/08/20 11:28 am, m k
wrote:<br>
>> We are considering to use Squid for
our proxy, and would like to know<br>
>> performance sizing aspects.<br>
>><br>
>> Current web access request averages
per 1 hour are as followings <br>
>> Clients<span
style="font-family:"MS Gothic"">：</span>30,000<span
style="font-family:"MS Gothic"">、</span><br>
>> Page Views:141,741/hour<br>
>> *Requests:4,893,106<br>
>><br>
<br>
Okay. Requests and client count are the
important numbers there.<br>
<br>
The ~1359 req/sec is well within a default
Squid capabilities, which can<br>
extend up to around 10k req/sec before needing
careful tuning.<br>
<br>
That number was gained before HTTPS became so
popular. So YMMV depending<br>
on how many CONNECT tunnels you have to deal
with. That HTTPS traffic<br>
can possibly be decrypted and cached but
performance trade-offs are<br>
quite large.</p>
</blockquote>
<blockquote style="border:none;border-left:solid
#cccccc 1.0pt;padding:0in 0in 0in
6.0pt;margin-left:4.8pt;margin-right:0in">
<p class="MsoNormal"><br>
>> We will install Squid on CentOS 8.1.
Please kindly share your<br>
>> thoughts / advices<br>
<br>
Whatever OS you are most comfortable with
administering. Be aware that<br>
CentOS official Squid packages are very slow
to update - Apparently they<br>
still have only v4.4 (8 months old) despite a
8.2 point release only a<br>
few weeks ago.<br>
<br>
So you may need to be building your own from
sources and/or using other<br>
semi-official packagers such as the ones from
Eliezer at NGTech when he<br>
gets around to CentOS 8 packages.<br>
<<a
href="https://wiki.squid-cache.org/KnowledgeBase/CentOS"
target="_blank" moz-do-not-send="true">https://wiki.squid-cache.org/KnowledgeBase/CentOS</a>><br>
<br>
<br>
FYI; If you find yourself having to use
SSL-Bump, then we highly<br>
recommended to follow the latest Squid
releases with fairly frequent<br>
updates (at minimum a few times per year -
worst case monthly). If you<br>
like CentOS you may find Fedora more suitable
to track the security<br>
environment volatility and update churn.<br>
<br>
<br>
>> Is there sizing methodology and
tools?<br>
<br>
There are a couple of methodologies, depending
on what aspect you are<br>
tuning towards - and one for identifying the
limitation points to begin<br>
a tuning process tuning.<br>
<br>
The info you gave above is the beginning.
Checking to see if your<br>
traffic rate is reasonably within capability
of a single Squid instance.<br>
<br>
Yours is reasonable, so next step is to get
Squid running and see where<br>
the trouble points (if any) are.<br>
<br>
For more see <<a
href="https://wiki.squid-cache.org/SquidFaq/"
target="_blank" moz-do-not-send="true">https://wiki.squid-cache.org/SquidFaq/</a>><br>
<br>
<br>
<br>
>> How much resources are generally
recommended for our environment?<br>
>><span style="font-family:"MS
Gothic""> </span> CPU:<span
style="font-family:"MS Gothic""> </span>
Memory:<span style="font-family:"MS
Gothic""> </span> Disk space : Other
factors to be considered if any:<br>
>> Do you have a generally recommended
performance testing tools? Any<br>
>> suggested guidelines?<br>
>><br>
<br>
<br>
CPU - squid is still mostly single-process.
So prioritize faster GHz<br>
rates over core number. Multi-core can help of
course, but not as much<br>
as cycle speeds do. Hyper-threading is useless
for Squid.<br>
<br>
Memory - Squid will use as much as you can
give it. Let your budget<br>
govern this.<br>
<br>
Disk - Squid will happily run with no disk -
or lots of large ones.<br>
<br>
- Avoid RAID. Squid *will* shorten disk
lifetimes with its unusually<br>
high write I/O pattern. How much shorter
varies by disk type (HDD vs<br>
SSD). So you may find it better to plan budget
towards maintenance costs<br>
of replacing disks in future rather than
buying multiple up-front for<br>
RAID use.<br>
see <<a
href="https://wiki.squid-cache.org/SquidFaq/RAID"
target="_blank" moz-do-not-send="true">https://wiki.squid-cache.org/SquidFaq/RAID</a>>
for details.<br>
<br>
- Up to a few hundred GB per cache_dir can
be good for large caches.<br>
Going up to TB is not (yet) worth the disk
cost as Squid has a per-cache<br>
limit on stored objects.<br>
<br>
- Disk caches can be re-tuned, added,
moved, removed, and/or extended<br>
at any time and will depend on the profile of
object sizes your proxy<br>
handles - which itself likely changes over
time. So general let your<br>
budget decide the initial disks and work from
there.<br>
<br>
<br>
<br>
Load Testing - the tools us dev use to review
performance are listed at<br>
the bottom of the profiling FAQ page. These
are best for testing the<br>
theoretical limits of a particular
installation - real traffic tends to<br>
be somewhat lower. So I personally prefer
taking stats from the running<br>
proxy on real traffic and seeing what I can
observe from those.<br>
<br>
<br>
HTH<br>
Amos<br>
_______________________________________________<br>
squid-users mailing list<br>
<a
href="mailto:squid-users@lists.squid-cache.org"
target="_blank" moz-do-not-send="true">squid-users@lists.squid-cache.org</a><br>
<a
href="http://lists.squid-cache.org/listinfo/squid-users"
target="_blank" moz-do-not-send="true">http://lists.squid-cache.org/listinfo/squid-users</a></p>
</blockquote>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
squid-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:squid-users@lists.squid-cache.org">squid-users@lists.squid-cache.org</a>
<a class="moz-txt-link-freetext" href="http://lists.squid-cache.org/listinfo/squid-users">http://lists.squid-cache.org/listinfo/squid-users</a>
</pre>
</blockquote>
</body>
</html>