[squid-users] Request/Response sizes for traffic over TCP_TUNNEL

Jeffrey Dunham jeffrey.a.dunham at gmail.com
Wed Nov 8 23:38:34 UTC 2017


I am using squid as a proxy and one of the tasks using the proxy is upload
some large files to S3 in AWS.
I'm trying to later on aggregate how much data was going through to S3 by
looking through the squid access log files.  The reality is, any way I can
tell how much traffic is going through to squid to S3 would be great, I was
going after the access file as it seemed most obvious.  However my logfiles
don't seem to show this information. I'm wondering if it's possible to show
this.  I thought that <st and >st would get me there.  I tried a few
different config settings for logging here's what it's at now:

logformat squid %ts.%03tu %6tr %>a %>A %Ss/%03>Hs %<st %>st %rm %ru %un
%Sh/%<A %mt

And my logs for a 200MB upload look like (this is broken into a multipart
upload):

1510181731.211  53953 <ip> <vpn> TCP_TUNNEL/200 3521 41 CONNECT
s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181731.991  54721 <ip> <vpn> TCP_TUNNEL/200 3865 41 CONNECT
s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181733.884  56646 <ip> <vpn> TCP_TUNNEL/200 3865 41 CONNECT
s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181737.049  59783 <ip> <vpn> TCP_TUNNEL/200 4209 41 CONNECT
s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181737.794  61246 <ip> <vpn> TCP_TUNNEL/200 5592 41 CONNECT
s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181737.796  60537 <ip> <vpn> TCP_TUNNEL/200 4178 41 CONNECT
s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181737.799  60529 <ip> <vpn> TCP_TUNNEL/200 3834 41 CONNECT
s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181737.800  60535 <ip> <vpn> TCP_TUNNEL/200 4178 41 CONNECT
s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181737.801  60531 <ip> <vpn> TCP_TUNNEL/200 4178 41 CONNECT
s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181737.807  60542 <ip> <vpn> TCP_TUNNEL/200 4209 41 CONNECT
s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -

Obviously there's nothing indicating the real size of the file that I can
tell, besides the fact that the connection is open awhile.

Any help would be appreciated!
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.squid-cache.org/pipermail/squid-users/attachments/20171108/b83928d4/attachment-0001.html>


More information about the squid-users mailing list