<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body text="#464646" bgcolor="#FFFFFF">
<font face="Arial">Hi Elizer<br>
<br>
You are right in a way but when squid loads multiple helpers, each
helper will use its own cache.<br>
Using a shared "base" allows helpers to avoid having to compute a
query already found by another helper who already has the answer.<br>
<br>
Concerning PHP what we find strange is that with our tests, a
simple loop and an "echo OK", php goes faster: 1.5x than python.<br>
</font><br>
<div class="moz-cite-prefix">Le 03/02/2022 à 07:09, Eliezer Croitoru
a écrit :<br>
</div>
<blockquote type="cite"
cite="mid:000001d818c4$a3ddd330$eb997990$@gmail.com">
<pre class="moz-quote-pre" wrap="">Hey Andre,
Every language has a "cost" for it's qualities.
For example, Golang is a very nice language that offers a relatively simple way for concurrency support and cross hardware compilation/compatibility.
One cost in Golang is that the binary is in the size of an OS/Kernel.
In python you must write everything in a specific position and indentation and threading is not simple to implement for a novice.
However when you see what was written in Python you can see that most of OpenStack api's and systems are written in.. python and it means something.
I like very much ruby but it doesn't support threading by nature but supports "concurrency".
Squid doesn't implement threading but implements "concurrency".
Don't touch PHP as a helper!!! (+1 to Alex)
Also take into account that Redis or Memcached is less preferred in many cases if the library doesn't re-use the existing connection for multiple queries.
Squid also implements caching for helpers answers so it's possible to implement the helper and ACL's in such a way that squid caching will
help you to lower the access to the external API and or redis/memcahced/DB.
I also have good experience with some libraries which implements cache that I have used inside a helper with a limited size for "level 1" cache.
It's possible that if you will implement both the helper and server side of the solution like ufdbguard you would be able to optimize the system
to take very high load.
I hope the above will help you.
Eliezer
----
Eliezer Croitoru
NgTech, Tech Support
Mobile: +972-5-28704261
Email: <a class="moz-txt-link-abbreviated" href="mailto:ngtech1ltd@gmail.com">ngtech1ltd@gmail.com</a>
-----Original Message-----
From: squid-users <a class="moz-txt-link-rfc2396E" href="mailto:squid-users-bounces@lists.squid-cache.org"><squid-users-bounces@lists.squid-cache.org></a> On Behalf Of André Bolinhas
Sent: Wednesday, February 2, 2022 00:09
To: 'Alex Rousskov' <a class="moz-txt-link-rfc2396E" href="mailto:rousskov@measurement-factory.com"><rousskov@measurement-factory.com></a>; <a class="moz-txt-link-abbreviated" href="mailto:squid-users@lists.squid-cache.org">squid-users@lists.squid-cache.org</a>
Subject: Re: [squid-users] external helper development
Hi
Thanks for the reply.
I will take a look on Rust as you recommend.
Also, between Python and Go and is the best for multithreading and concurrency?
Rust supports multithreading and concurrency?
Best regards
-----Mensagem original-----
De: squid-users <a class="moz-txt-link-rfc2396E" href="mailto:squid-users-bounces@lists.squid-cache.org"><squid-users-bounces@lists.squid-cache.org></a> Em Nome De Alex Rousskov
Enviada: 1 de fevereiro de 2022 22:01
Para: <a class="moz-txt-link-abbreviated" href="mailto:squid-users@lists.squid-cache.org">squid-users@lists.squid-cache.org</a>
Assunto: Re: [squid-users] external helper development
On 2/1/22 16:47, André Bolinhas wrote:
</pre>
<blockquote type="cite">
<pre class="moz-quote-pre" wrap="">Hi
I’m building an external helper to get the categorization of an
website, I know how to build it, but I need you option about the best
language for the job in terms of performance, bottlenecks, I/O blocking..
The helper will work like this.
1º will check the hot memory for faster response (memcache or redis)
2º If the result not exist in hot memory then will check an external
api to fetch the categorie and saved it in hot memory.
In what language do you recommend develop such helper? PHP, Python, Go..
</pre>
</blockquote>
<pre class="moz-quote-pre" wrap="">
If this helper is for long-term production use, and you are willing to learn new things, then use Rust[1]. Otherwise, use whatever language you are the most comfortable with already (except PHP), especially if that language has good libraries/wrappers for the external APIs you will need to use.
Alex.
[1] <a class="moz-txt-link-freetext" href="https://www.rust-lang.org/">https://www.rust-lang.org/</a>
_______________________________________________
squid-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:squid-users@lists.squid-cache.org">squid-users@lists.squid-cache.org</a>
<a class="moz-txt-link-freetext" href="http://lists.squid-cache.org/listinfo/squid-users">http://lists.squid-cache.org/listinfo/squid-users</a>
_______________________________________________
squid-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:squid-users@lists.squid-cache.org">squid-users@lists.squid-cache.org</a>
<a class="moz-txt-link-freetext" href="http://lists.squid-cache.org/listinfo/squid-users">http://lists.squid-cache.org/listinfo/squid-users</a>
_______________________________________________
squid-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:squid-users@lists.squid-cache.org">squid-users@lists.squid-cache.org</a>
<a class="moz-txt-link-freetext" href="http://lists.squid-cache.org/listinfo/squid-users">http://lists.squid-cache.org/listinfo/squid-users</a>
</pre>
</blockquote>
<br>
</body>
</html>