[squid-users] Regex optimization

[Yuri Voinov]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256
 
By the way, I do not care that there is the relevance of porn sites.
Rummage in this shit and check I somehow do not want to. I am satisfied
that blocked most of which are my users trying to surf.

17.06.2016 3:11, Benjamin E. Nichols пишет:
>
>
>
> On 6/16/2016 3:28 PM, Yuri Voinov wrote:
> I propose to nominate for the second place of the contest "The most
> inefficient use of computing resources - 2016." :-!:-D
>
> Because first place already occuped. :-D 30 millions pornsites in one
> squid's ACL and 7 minutes for squid -k refresh. 8-)
> > Yeah and Ill bet about 27 Million of them are dead, expired, parked
or redirected because your list sucks.
>
> > If you really intend to use blacklists tailored for Squid proxy
Native ACL, we are the leading and only provider of such lists.
> > And we actually query each domain daily with batch updates, dead
domains are placed into a holding pool to be queried again cyclically
and re added
> > as necessary.
>
> > Shallalist is a joke, urlblacklist is garbage, if you are serious
and need a better blacklist, we would be happy to serve you.
>
>
>
> 17.06.2016 1:20, Antony Stone пишет:
> >>> On Thursday 16 June 2016 at 21:11:50, Alfredo Rezinovsky wrote:
> >>>
> >>>> Well.. I tried.
> >>>> I need to ban 8613 URLs. Because a law.
> >>> Have you considered
https://www.urlfilterdb.com/products/ufdbguard.html ?
> >>>
> >>>> If I put one per line in a file and set the filename for an
url_regex acl
> >>>> it works. But when the traffic goes up the cpu load goes 100%
(even using
> >>>> workers) and the proxy turns unusable.
> >>> Er, I'm not surprised.
> >>>
> >>>> I tested and saw my squid can't parse regexes with more than 8192
> >>>> characters.
> >>>> I managed to combine the 8000 uris in 34 regexes using a ruby gem,
> and the
> >>>> cpu load stays almost at the same level it is without any acl (same
> >>>> traffic).
> >>> That must be *way* past anything to be described as "maintainable".
> >>>
> >>>> the regex is:
> >>> Er, thanks, that confirms my suspicions above :)
> >>>
> >>>
> >>> Antony.
> >>>
>>
>>
>>
>> _______________________________________________
>> squid-users mailing list
>> squid-users at lists.squid-cache.org
>> http://lists.squid-cache.org/listinfo/squid-users
>
> --
> Signed,
>
> Benjamin E. Nichols
> http://www.squidblacklist.org
>
> 1-405-397-1360
>
>
> _______________________________________________
> squid-users mailing list
> squid-users at lists.squid-cache.org
> http://lists.squid-cache.org/listinfo/squid-users

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2
 
iQEcBAEBCAAGBQJXY69LAAoJENNXIZxhPexGzbsH/Rjx5G5vP41dPwXAYGqyTEMP
g5uwVn5RLzEB1DOQZBnGp9uSQb9R1ZelNLitUocFdDYZcE9WNbSxrXMl7TfQLgor
UPje/vmONcxLGeNmpgiFQh/qnTouhtwjUN9v/cd55mNOa1KplrRVU9BlucGnzK+1
x9z0icdR3dfS+49LCPiEArysCFnxfINIaKAkYDBGZ4ovdjtegSY0amnG98VI01+J
j9PEeeumjAHI8xn3BgwuAaEZI/B9iPM3LBQRbMkjNfhBbvRqc0/iVLGJiZpjUGSf
Zo4S0BI4kT6p7OzRGqCZZyqLxyNm/onmPvTpW55ZEaeKZMUVaN0MMVtnXynD2lI=
=Mkgm
-----END PGP SIGNATURE-----

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.squid-cache.org/pipermail/squid-users/attachments/20160617/24a75d0f/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 0x613DEC46.asc
Type: application/pgp-keys
Size: 2437 bytes
Desc: not available
URL: <http://lists.squid-cache.org/pipermail/squid-users/attachments/20160617/24a75d0f/attachment.key>