<html>
<head>
<meta name="generator" content="Windows Mail 17.5.9600.20605">
<style><!--
.EmailQuote {
margin-left:1pt;
padding-left:4pt;
border-left:#800000 2px solid;
}
--></style><style data-externalstyle="true"><!--
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph {
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
}
p.MsoNormal, li.MsoNormal, div.MsoNormal {
margin:0in;
margin-bottom:.0001pt;
}
p.MsoListParagraphCxSpFirst, li.MsoListParagraphCxSpFirst, div.MsoListParagraphCxSpFirst,
p.MsoListParagraphCxSpMiddle, li.MsoListParagraphCxSpMiddle, div.MsoListParagraphCxSpMiddle,
p.MsoListParagraphCxSpLast, li.MsoListParagraphCxSpLast, div.MsoListParagraphCxSpLast {
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
line-height:115%;
}
--></style></head>
<body dir="ltr">
<div data-externalstyle="false" dir="ltr" style="font-family: 'Calibri', 'Segoe UI', 'Meiryo', 'Microsoft YaHei UI', 'Microsoft JhengHei UI', 'Malgun Gothic', 'sans-serif';font-size:12pt;">
<div>I need database to store sanitized websites (cleaned from javascript malicious parts). If CRC changes webpage should be resanitized, otherwise serve proxy version of the website.</div><div><br></div><div style="padding-top: 5px; border-top-color: rgb(229, 229, 229); border-top-width: 1px; border-top-style: solid;"><div><font face=" 'Calibri', 'Segoe UI', 'Meiryo', 'Microsoft YaHei UI', 'Microsoft JhengHei UI', 'Malgun Gothic', 'sans-serif'" style='line-height: 15pt; letter-spacing: 0.02em; font-family: "Calibri", "Segoe UI", "Meiryo", "Microsoft YaHei UI", "Microsoft JhengHei UI", "Malgun Gothic", "sans-serif"; font-size: 12pt;'><b>Von:</b> <a href="mailto:squid-users-request@lists.squid-cache.org" target="_parent">squid-users-request@lists.squid-cache.org</a><br><b>Gesendet:</b> Montag, 21. September 2015 13:59<br><b>An:</b> <a href="mailto:squid-users@lists.squid-cache.org" target="_parent">squid-users@lists.squid-cache.org</a></font></div></div><div><br></div><div dir="">
<div class="PlainText">Send squid-users mailing list submissions to<br>
squid-users@lists.squid-cache.org<br>
<br>
To subscribe or unsubscribe via the World Wide Web, visit<br>
<a href="http://lists.squid-cache.org/listinfo/squid-users" target="_parent">http://lists.squid-cache.org/listinfo/squid-users</a><br>
or, via email, send a message with subject or body 'help' to<br>
squid-users-request@lists.squid-cache.org<br>
<br>
You can reach the person managing the list at<br>
squid-users-owner@lists.squid-cache.org<br>
<br>
When replying, please edit your Subject line so it is more specific<br>
than "Re: Contents of squid-users digest..."<br>
<br>
<br>
Today's Topics:<br>
<br>
1. Squid not following 302 (Ashish Mukherjee)<br>
2. Database dilema (Mumin Coder)<br>
3. Re: Database dilema (Eliezer Croitoru)<br>
4. Re: Squid not following 302 (Antony Stone)<br>
5. Re: Lots of "Vary object loop!" (Eliezer Croitoru)<br>
6. Re: Squid not following 302 (Amos Jeffries)<br>
<br>
<br>
----------------------------------------------------------------------<br>
<br>
Message: 1<br>
Date: Mon, 21 Sep 2015 14:50:56 +0530<br>
From: Ashish Mukherjee <ashish.mukherjee@gmail.com><br>
To: Squid Users <squid-users@lists.squid-cache.org><br>
Subject: [squid-users] Squid not following 302<br>
Message-ID:<br>
<CACgMzfwVAabOrx__YxRJg3VEXda9zY3_7jYNarow+DUHadyckQ@mail.gmail.com><br>
Content-Type: text/plain; charset="utf-8"<br>
<br>
Hello,<br>
<br>
Squid does not follow 302 and sends back the 302 header to the client. I am<br>
aware it is so as it would be bad to hide the ultimate url from the client<br>
and for reasons of cache poisoning etc.<br>
<br>
However, I have a scenario where I need to implement a proxy browsing<br>
pattern for a controlled audience such that I would like Squid to follow<br>
redirections. How can I configure Squid to do so?<br>
<br>
Regards,<br>
Ashish<br>
-------------- next part --------------<br>
An HTML attachment was scrubbed...<br>
URL: <<a href="http://lists.squid-cache.org/pipermail/squid-users/attachments/20150921/f6b51a90/attachment-0001.html" target="_parent">http://lists.squid-cache.org/pipermail/squid-users/attachments/20150921/f6b51a90/attachment-0001.html</a>><br>
<br>
------------------------------<br>
<br>
Message: 2<br>
Date: Tue, 15 Sep 2015 09:23:01 +0000<br>
From: Mumin Coder <mumincoder@outlook.com><br>
To: "=?utf-8?Q?squid-users@lists.squid-cache.org?="<br>
<squid-users@lists.squid-cache.org><br>
Subject: [squid-users] Database dilema<br>
Message-ID: <SNT406-EAS398B813270931CE94F54CCBD1460@phx.gbl><br>
Content-Type: text/plain; charset="utf-8"<br>
<br>
<br>
I want to make some kind of safe transparent proxy using ubuntu, squid, icap or ecap, database (MongoDB or MySql) and XSS prevention module. I want to be able to inspect URL and javascript/xml inside web page with my sandboxed module (javascript engine) which will be connected to squid and database using content adaptation. I want to make it optimal when it comes to processing/analysing of requested webpage. Thus I want to use database in order to store visited safe or unsafe URLs and javascript code. Currently I am using Greasyspoon as ICAP server, which I am adapting to my needs. I am not sure which database should I use to fit my needs and how to connect/configure it?<br>
<br>
<br>
Thank you in advance.<br>
-------------- next part --------------<br>
An HTML attachment was scrubbed...<br>
URL: <<a href="http://lists.squid-cache.org/pipermail/squid-users/attachments/20150915/17737051/attachment-0001.html" target="_parent">http://lists.squid-cache.org/pipermail/squid-users/attachments/20150915/17737051/attachment-0001.html</a>><br>
<br>
------------------------------<br>
<br>
Message: 3<br>
Date: Mon, 21 Sep 2015 12:56:26 +0300<br>
From: Eliezer Croitoru <eliezer@ngtech.co.il><br>
To: squid-users@lists.squid-cache.org<br>
Subject: Re: [squid-users] Database dilema<br>
Message-ID: <55FFD44A.8050901@ngtech.co.il><br>
Content-Type: text/plain; charset=utf-8; format=flowed<br>
<br>
Hey Mumin,<br>
<br>
What do you need from the db?<br>
If you need a blacklist I can offer you to use SquidBlocker which I wrote:<br>
<a href="http://ngtech.co.il/squidblocker/" target="_parent">http://ngtech.co.il/squidblocker/</a><br>
The DB is not fully documented but it works under a very heavy load and <br>
seems to give good results.<br>
<br>
Eliezer<br>
<br>
On 15/09/2015 12:23, Mumin Coder wrote:<br>
><br>
> I want to make some kind of safe transparent proxy using ubuntu, squid, icap or ecap, database (MongoDB or MySql) and XSS prevention module. I want to be able to inspect URL and javascript/xml inside web page with my sandboxed module (javascript engine) which will be connected to squid and database using content adaptation. I want to make it optimal when it comes to processing/analysing of requested webpage. Thus I want to use database in order to store visited safe or unsafe URLs and javascript code. Currently I am using Greasyspoon as ICAP server, which I am adapting to my needs. I am not sure which database should I use to fit my needs and how to connect/configure it?<br>
><br>
><br>
> Thank you in advance.<br>
<br>
<br>
<br>
------------------------------<br>
<br>
Message: 4<br>
Date: Mon, 21 Sep 2015 11:56:43 +0200<br>
From: Antony Stone <Antony.Stone@squid.open.source.it><br>
To: squid-users@lists.squid-cache.org<br>
Subject: Re: [squid-users] Squid not following 302<br>
Message-ID: <201509211156.43947.Antony.Stone@squid.open.source.it><br>
Content-Type: Text/Plain; charset="iso-8859-15"<br>
<br>
On Monday 21 September 2015 at 11:20:56, Ashish Mukherjee wrote:<br>
<br>
> Squid does not follow 302 and sends back the 302 header to the client. I am<br>
> aware it is so as it would be bad to hide the ultimate url from the client<br>
> and for reasons of cache poisoning etc.<br>
> <br>
> However, I have a scenario where I need to implement a proxy browsing<br>
> pattern for a controlled audience such that I would like Squid to follow<br>
> redirections. How can I configure Squid to do so?<br>
<br>
1. Why not just let the browser handle the 302 as normal?<br>
<br>
2. I suggest you look at<br>
<a href="http://squid-web-proxy-cache.1019090.n4.nabble.com/302-td4658091.html" target="_parent">http://squid-web-proxy-cache.1019090.n4.nabble.com/302-td4658091.html</a><br>
<br>
Regards,<br>
<br>
<br>
Antony.<br>
<br>
-- <br>
This email was created using 100% recycled electrons.<br>
<br>
Please reply to the list;<br>
please *don't* CC me.<br>
<br>
<br>
------------------------------<br>
<br>
Message: 5<br>
Date: Mon, 21 Sep 2015 13:03:08 +0300<br>
From: Eliezer Croitoru <eliezer@ngtech.co.il><br>
To: squid-users@lists.squid-cache.org<br>
Subject: Re: [squid-users] Lots of "Vary object loop!"<br>
Message-ID: <55FFD5DC.2020201@ngtech.co.il><br>
Content-Type: text/plain; charset=utf-8; format=flowed<br>
<br>
Is it happening also with ram cahce only? no disk cache?<br>
<br>
Eliezer<br>
<br>
On 04/09/2015 00:02, Sebastián Goicochea wrote:<br>
> But still seeing all those Vary loops all the time<br>
><br>
> :(<br>
><br>
> Thanks,<br>
> Sebastian<br>
<br>
<br>
<br>
------------------------------<br>
<br>
Message: 6<br>
Date: Mon, 21 Sep 2015 23:08:39 +1200<br>
From: Amos Jeffries <squid3@treenet.co.nz><br>
To: squid-users@lists.squid-cache.org<br>
Subject: Re: [squid-users] Squid not following 302<br>
Message-ID: <55FFE537.20307@treenet.co.nz><br>
Content-Type: text/plain; charset=utf-8<br>
<br>
On 21/09/2015 9:20 p.m., Ashish Mukherjee wrote:<br>
> Hello,<br>
> <br>
> Squid does not follow 302 and sends back the 302 header to the client. I am<br>
> aware it is so as it would be bad to hide the ultimate url from the client<br>
> and for reasons of cache poisoning etc.<br>
<br>
Then why do you expect Squid would be allowed to be configured to do that?<br>
<br>
Besides the corruption problems 302 messages contain a payload/body<br>
which some clients need to display and/or process instead of the<br>
Location header.<br>
<br>
<br>
> <br>
> However, I have a scenario where I need to implement a proxy browsing<br>
> pattern for a controlled audience such that I would like Squid to follow<br>
> redirections. How can I configure Squid to do so?<br>
<br>
You would need a ICAP or eCAP RESPMOD adaptor to do that. Since you are<br>
requesting whole-message adaptation.<br>
<br>
<br>
PS. any server which is fooled by the behaviour you are trying to<br>
achieve is violating the HTTP requirenment:<br>
"<br>
server MUST NOT assume that two requests on the same connection are<br>
from the same user agent<br>
"<br>
<br>
Amos<br>
<br>
<br>
<br>
------------------------------<br>
<br>
Subject: Digest Footer<br>
<br>
_______________________________________________<br>
squid-users mailing list<br>
squid-users@lists.squid-cache.org<br>
<a href="http://lists.squid-cache.org/listinfo/squid-users" target="_parent">http://lists.squid-cache.org/listinfo/squid-users</a><br>
<br>
<br>
------------------------------<br>
<br>
End of squid-users Digest, Vol 13, Issue 62<br>
*******************************************<br>
</div>
</div>
</div>
</body>
</html>