[squid-users] squid-users Digest, Vol 13, Issue 62

Tue Sep 22 09:38:26 UTC 2015

I need database to store sanitized websites (cleaned from javascript malicious parts). If CRC changes webpage should be resanitized, otherwise serve proxy version of the website.

Von: squid-users-request at lists.squid-cache.org
Gesendet: ‎Montag‎, ‎21‎. ‎September‎ ‎2015 ‎13‎:‎59
An: squid-users at lists.squid-cache.org

Send squid-users mailing list submissions to
        squid-users at lists.squid-cache.org

To subscribe or unsubscribe via the World Wide Web, visit
        http://lists.squid-cache.org/listinfo/squid-users
or, via email, send a message with subject or body 'help' to
        squid-users-request at lists.squid-cache.org

You can reach the person managing the list at
        squid-users-owner at lists.squid-cache.org

When replying, please edit your Subject line so it is more specific
than "Re: Contents of squid-users digest..."

Today's Topics:

   1. Squid not following 302 (Ashish Mukherjee)
   2. Database dilema (Mumin Coder)
   3. Re: Database dilema (Eliezer Croitoru)
   4. Re: Squid not following 302 (Antony Stone)
   5. Re: Lots of "Vary object loop!" (Eliezer Croitoru)
   6. Re: Squid not following 302 (Amos Jeffries)

----------------------------------------------------------------------

Message: 1
Date: Mon, 21 Sep 2015 14:50:56 +0530
From: Ashish Mukherjee <ashish.mukherjee at gmail.com>
To: Squid Users <squid-users at lists.squid-cache.org>
Subject: [squid-users] Squid not following 302
Message-ID:
        <CACgMzfwVAabOrx__YxRJg3VEXda9zY3_7jYNarow+DUHadyckQ at mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hello,

Squid does not follow 302 and sends back the 302 header to the client. I am
aware it is so as it would be bad to hide the ultimate url from the client
and for reasons of cache poisoning etc.

However, I have a scenario where I need to implement a proxy browsing
pattern for a controlled audience such that I would like Squid to follow
redirections. How can I configure Squid to do so?

Regards,
Ashish
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.squid-cache.org/pipermail/squid-users/attachments/20150921/f6b51a90/attachment-0001.html>

------------------------------

Message: 2
Date: Tue, 15 Sep 2015 09:23:01 +0000
From: Mumin Coder <mumincoder at outlook.com>
To: "=?utf-8?Q?squid-users at lists.squid-cache.org?="
        <squid-users at lists.squid-cache.org>
Subject: [squid-users] Database dilema
Message-ID: <SNT406-EAS398B813270931CE94F54CCBD1460 at phx.gbl>
Content-Type: text/plain; charset="utf-8"

I want to make some kind of safe transparent proxy using ubuntu, squid, icap or ecap, database (MongoDB or MySql) and XSS prevention module. I want to be able to inspect URL and javascript/xml inside web page with my sandboxed module (javascript engine) which will be connected to squid and database using content adaptation. I want to make it optimal when it comes to processing/analysing of  requested webpage. Thus I want to use database in order to store visited safe or unsafe URLs and javascript code. Currently I am using Greasyspoon as ICAP server, which I am adapting to my needs. I am not sure which database should I use to fit my needs and how to connect/configure it?

Thank you in advance.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.squid-cache.org/pipermail/squid-users/attachments/20150915/17737051/attachment-0001.html>

------------------------------

Message: 3
Date: Mon, 21 Sep 2015 12:56:26 +0300
From: Eliezer Croitoru <eliezer at ngtech.co.il>
To: squid-users at lists.squid-cache.org
Subject: Re: [squid-users] Database dilema
Message-ID: <55FFD44A.8050901 at ngtech.co.il>
Content-Type: text/plain; charset=utf-8; format=flowed

Hey Mumin,

What do you need from the db?
If you need a blacklist I can offer you to use SquidBlocker which I wrote:
http://ngtech.co.il/squidblocker/
The DB is not fully documented but it works under a very heavy load and 
seems to give good results.

Eliezer

On 15/09/2015 12:23, Mumin Coder wrote:
>
> I want to make some kind of safe transparent proxy using ubuntu, squid, icap or ecap, database (MongoDB or MySql) and XSS prevention module. I want to be able to inspect URL and javascript/xml inside web page with my sandboxed module (javascript engine) which will be connected to squid and database using content adaptation. I want to make it optimal when it comes to processing/analysing of  requested webpage. Thus I want to use database in order to store visited safe or unsafe URLs and javascript code. Currently I am using Greasyspoon as ICAP server, which I am adapting to my needs. I am not sure which database should I use to fit my needs and how to connect/configure it?
>
>
> Thank you in advance.

------------------------------

Message: 4
Date: Mon, 21 Sep 2015 11:56:43 +0200
From: Antony Stone <Antony.Stone at squid.open.source.it>
To: squid-users at lists.squid-cache.org
Subject: Re: [squid-users] Squid not following 302
Message-ID: <201509211156.43947.Antony.Stone at squid.open.source.it>
Content-Type: Text/Plain;  charset="iso-8859-15"

On Monday 21 September 2015 at 11:20:56, Ashish Mukherjee wrote:

> Squid does not follow 302 and sends back the 302 header to the client. I am
> aware it is so as it would be bad to hide the ultimate url from the client
> and for reasons of cache poisoning etc.
> 
> However, I have a scenario where I need to implement a proxy browsing
> pattern for a controlled audience such that I would like Squid to follow
> redirections. How can I configure Squid to do so?

1. Why not just let the browser handle the 302 as normal?

2. I suggest you look at
http://squid-web-proxy-cache.1019090.n4.nabble.com/302-td4658091.html

Regards,

Antony.

-- 
This email was created using 100% recycled electrons.

                                                   Please reply to the list;
                                                         please *don't* CC me.

------------------------------

Message: 5
Date: Mon, 21 Sep 2015 13:03:08 +0300
From: Eliezer Croitoru <eliezer at ngtech.co.il>
To: squid-users at lists.squid-cache.org
Subject: Re: [squid-users] Lots of "Vary object loop!"
Message-ID: <55FFD5DC.2020201 at ngtech.co.il>
Content-Type: text/plain; charset=utf-8; format=flowed

Is it happening also with ram cahce only? no disk cache?

Eliezer

On 04/09/2015 00:02, Sebastián Goicochea wrote:
> But still seeing all those Vary loops all the time
>
> :(
>
> Thanks,
> Sebastian

------------------------------

Message: 6
Date: Mon, 21 Sep 2015 23:08:39 +1200
From: Amos Jeffries <squid3 at treenet.co.nz>
To: squid-users at lists.squid-cache.org
Subject: Re: [squid-users] Squid not following 302
Message-ID: <55FFE537.20307 at treenet.co.nz>
Content-Type: text/plain; charset=utf-8

On 21/09/2015 9:20 p.m., Ashish Mukherjee wrote:
> Hello,
> 
> Squid does not follow 302 and sends back the 302 header to the client. I am
> aware it is so as it would be bad to hide the ultimate url from the client
> and for reasons of cache poisoning etc.

Then why do you expect Squid would be allowed to be configured to do that?

Besides the corruption problems 302 messages contain a payload/body
which some clients need to display and/or process instead of the
Location header.

> 
> However, I have a scenario where I need to implement a proxy browsing
> pattern for a controlled audience such that I would like Squid to follow
> redirections. How can I configure Squid to do so?

You would need a ICAP or eCAP RESPMOD adaptor to do that. Since you are
requesting whole-message adaptation.

PS. any server which is fooled by the behaviour you are trying to
achieve is violating the HTTP requirenment:
"
   server MUST NOT assume that two requests on the same connection are
   from the same user agent
"

Amos

------------------------------

Subject: Digest Footer

_______________________________________________
squid-users mailing list
squid-users at lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-users

------------------------------

End of squid-users Digest, Vol 13, Issue 62
*******************************************
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.squid-cache.org/pipermail/squid-users/attachments/20150922/028b61b7/attachment-0001.html>