[squid-users] Upper limit on the number of regular expressions in url_regex?

[Marcus Kool]

I have only seen regex failing with such short RE on AIX.
what is your OS, distro, CPU and lib version ?

BTW: why use regular expressions for a list of 10000+ _fixed_ URLs ?

Marcus


On 08/08/17 11:44, Ralf Hildebrandt wrote:
> * Ralf Hildebrandt <Ralf.Hildebrandt at charite.de>:
> 
>> But why is it failing?
> 
> Turns out that I can minimize the failure to a short list of regular
> expressions:
> 
> 2017/08/08 16:35:09.164| 28,2| RegexData.cc(244) parse: new Regex line or file
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zizicamarda.com/7fg3g'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zizzhaida.com/3m6ij'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zizzhaida.com/98g4ubq'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zizzhaida.com/a0s9b'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zjscs.org/oaxqpo4w7'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zlotysalmo.net/0zx0ken3'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zlotysalmo.net/3v8va8ov'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zlotysalmo.net/75vepy6f'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zlotysalmo.net/9v50aob'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://znany-lekarz.pl/wd7zj'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zoekeith.com/qehggefyb'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zona-sezona.com.ua/hj1lsp'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zonabest.atspace.com/353wxy'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zonnit.com/qargy9n'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zoologiczny.cba.pl/okp987g7v'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zoomwalls.com/k8j3tpoe'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zoomwalls.com/zghpzv2f'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zoonhers.net/3oojm4'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zoonhers.net/4susie'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zoonhers.net/5ngvr'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zophotos.com/098tb'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zorgboerderijtzicht.nl/lm3mhz'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zpwang.net/9igbmnn'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zsgxbgj.com/1324w'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zsnbystre.republika.pl/988g765f'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zsp17.y0.pl/jkYTFhb7'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zsz_szyn.republika.pl/G7vuYhjb'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zuerich-gewerbe.ch/mbv58gbv'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zui9reica.web.fc2.com/87hcrn33g'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zurrmax.de/hwajuip'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zwei.audio/87h78rf33g'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zwljfc.com/8765r'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zyasf.com/cir9dl'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zytrade.cn/1324w'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zytrade.cn/aust7a6ik'
> 2017/08/08 16:35:09.164| 28,3| RegexData.cc(253) parse: buffering RE 'http://zzzort10xtest123.com/nin5k3bwo'
> ...
> 2017/08/08 16:35:09.165| 28,2| RegexData.cc(125) compileRE: compiled '(http://zizicamarda.com/7fg3g)|(http://zizzhaida.com/3m6ij)|(http://zizzhaida.com/98g4ubq)|(http://zizzhaida.com/a0s9b)|(http://zjscs.org/oaxqpo4w7)|(http://zlotysalmo.net/0zx0ken3)|(http://zlotysalmo.net/3v8va8ov)|(http://zlotysalmo.net/75vepy6f)|(http://zlotysalmo.net/9v50aob)|(http://znany-lekarz.pl/wd7zj)|(http://zoekeith.com/qehggefyb)|(http://zona-sezona.com.ua/hj1lsp)|(http://zonabest.atspace.com/353wxy)|(http://zonnit.com/qargy9n)|(http://zoologiczny.cba.pl/okp987g7v)|(http://zoomwalls.com/k8j3tpoe)|(http://zoomwalls.com/zghpzv2f)|(http://zoonhers.net/3oojm4)|(http://zoonhers.net/4susie)|(http://zoonhers.net/5ngvr)|(http://zophotos.com/098tb)|(http://zorgboerderijtzicht.nl/lm3mhz)|(http://zpwang.net/9igbmnn)|(http://zsgxbgj.com/1324w)|(http://zsnbystre.republika.pl/988g765f)|(http://zsp17.y0.pl/jkYTFhb7)|(http://zsz_szyn.republika.pl/G7vuYhjb)|(http://zuerich-gewerbe.ch/mbv58gbv)|(http://zui9reica.web.fc2.com/87hcrn33g)|(http://zurrmax.de/hwajuip)|(http://zwei.audio/87h78rf33g)|(http://zwljfc.com/8765r)|(http://zyasf.com/cir9dl)|(http://zytrade.cn/1324w)|(http://zytrade.cn/aust7a6ik)|(http://zzzort10xtest123.com/nin5k3bwo)' with flags 9
> 2017/08/08 16:35:09.165| WARNING: optimisation of regular expressions failed; using fallback method without optimisation
> 
> maybe it's an issue with the regexp library?
>