<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p.MsoPlainText, li.MsoPlainText, div.MsoPlainText
{mso-style-priority:99;
mso-style-link:"Plain Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.PlainTextChar
{mso-style-name:"Plain Text Char";
mso-style-priority:99;
mso-style-link:"Plain Text";
font-family:"Calibri",sans-serif;}
.MsoChpDefault
{mso-style-type:export-only;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link="#0563C1" vlink="#954F72"><div class=WordSection1><p class=MsoPlainText>> On 31/08/2016 11:19 a.m., Shively, Gregory wrote:<o:p></o:p></p><p class=MsoPlainText>> > I'm attempting to get a squid working as a transparent proxy on OSX <o:p></o:p></p><p class=MsoPlainText>> > Yosemite. Every attempt ended with a "Forward loop detected". I <o:p></o:p></p><p class=MsoPlainText>> > initially started with the version from homebrew and moved to just <o:p></o:p></p><p class=MsoPlainText>> > compiling myself to see if I could figure out what was going on.<o:p></o:p></p><p class=MsoPlainText>> > Being new to both pf network and squid, it might be something that I <o:p></o:p></p><p class=MsoPlainText>> > have configured wrong. I configured pf similar to:<o:p></o:p></p><p class=MsoPlainText>> > <o:p></o:p></p><p class=MsoPlainText>> > nat on $ext_if proto {udp, tcp} from $int_if:network to any port domain -> ($ext_if)<o:p></o:p></p><p class=MsoPlainText>> > rdr pass on $int_if proto tcp from $int_if:network to any port <o:p></o:p></p><p class=MsoPlainText>> > {http, https} -> 127.0.0.1 port 3129<o:p></o:p></p><p class=MsoPlainText>> > <o:p></o:p></p><p class=MsoPlainText>> > And my squid.conf for my testing is basically:<o:p></o:p></p><p class=MsoPlainText>> > <o:p></o:p></p><p class=MsoPlainText>> > http_port 3128<o:p></o:p></p><p class=MsoPlainText>> > http_port 3129 intercept<o:p></o:p></p><p class=MsoPlainText>> > http_access allow all<o:p></o:p></p><p class=MsoPlainText>> > <o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>> > I'm not sure if this is more appropriate on this mailing list or the <o:p></o:p></p><p class=MsoPlainText>> > developer mailing list (hoping it is just something I'm doing wrong).<o:p></o:p></p><p class=MsoPlainText>> > The squid that I'm using doesn't have -with-nat-devpf enabled; it <o:p></o:p></p><p class=MsoPlainText>> > fails to compile with that option. I'm wondering if the getsockname() <o:p></o:p></p><p class=MsoPlainText>> > as per comment for PFIntercept (of the !_USE_NAT_DEVPF) in <o:p></o:p></p><p class=MsoPlainText>> > src/ip/Intercept.cc, on OSX is not returning the pre-rdr address and <o:p></o:p></p><p class=MsoPlainText>> > causing the forward loop.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>> Your access.log can show that. It shows up as the server the transaction is being sent to being port 3128/3129 on 127.0.0.1 or another IP assigned to the Squid machine.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>It looks like I get 2 associated TCP_MISS entries in the access.log, followed by entries that looks like they are associated with the access denied error screen. All generate the forwarding loop warning when running squid in debug. I also had the pf logging and see the rdr getting redirected, plus had started netcat listening on 3129 prior to starting squid and saw the HTTP request come in.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>> > <o:p></o:p></p><p class=MsoPlainText>> > As mentioned, the -with-nat-devpf fails to compile on OSX due to a <o:p></o:p></p><p class=MsoPlainText>> > missing header file. And from looking it sounds like the header is for <o:p></o:p></p><p class=MsoPlainText>> > the ioctl() on /dev/pf, which doesn't seem to be public API on OSX. So <o:p></o:p></p><p class=MsoPlainText>> > I'm trying to determine if my issue is due to a misconfiguration - or <o:p></o:p></p><p class=MsoPlainText>> > is this portion of the code not working with OSX.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>> It has been a long time since anyone using MacOS has provided any particular feedback about Squid behaviour on MacOS. So it could be just bugs when running on MacOS.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>> > I looked at the code for mitmproxy, and it seems like they require a <o:p></o:p></p><p class=MsoPlainText>> > sudoers entry to run "pfctl -s state" and parse the state.<o:p></o:p></p><p class=MsoPlainText>> > Would something like that need to be added to squid to support <o:p></o:p></p><p class=MsoPlainText>> > transparent proxy on OSX. I had started to put some code together like <o:p></o:p></p><p class=MsoPlainText>> > mitmproxy, but thought better check if I didn't get something <o:p></o:p></p><p class=MsoPlainText>> > configured correctly.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>> Squid (when built with the /dev/pf support) master process which is run as root [you are running Squid from the root account right?] should be preserving its permission to access the device before it drops down to low privilege levels for handling the network traffic.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>Yeah – I’m running the squid process as root; that is partially what headed me down the road with the /dev/pf – the permissions had changed after a reboot of the Mac and I started getting curious on why squid didn’t give me a permission warning in the same way that mitmproxy was. And from the code, at least in the portion of the code I was looking, since I didn’t have the –use-devpf it doesn’t seem to open the dev file.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>> Some other troubleshooting things to try:<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>> * using the machines public IP addres instead of 127.0.0.1. There are hardware or driver level restrictions on locahost addresses that often prohibit that type of NAT.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>> * using a divert-to rule instead of rdr. If your PF firewall accepts that and the 'tproxy' option in squid.conf works then the /dev/pf is not relevant. rdr sometimes does not work when divert-to is fine.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>> * check the PF version in your MacOS. If it derives from OpenBSD 4.8 or later then the .dev.pf is not relevant - rdr/divert-to failure is then a bug somewhere AFAIK.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>I tried using both the internal and external interface IP addresses on the rdr rule. Both ended in the same forward loop. And it doesn’t look like, at least Yosemite, has the option to use the divert-to in the firewall rules. I can’t seem to find the reference, but I think that the pf in OSX is based around OpenBSD 4.4 or 4.5, but don’t hold me to it. I’m guessing that is the reason that the divert-to is not available. I can look at an El Capt machine, but don’t currently have access.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>Thanks for the help on getting this setup. I had put some code in the PfInterception method to replace the “local” address that I pulled from running the pfctl –s state command and it did change the results. But I’m thinking that I might have gotten the host or port in the “address” object incorrectly – it didn’t seem to work and further connections just errored out. When I get a change will take a more detailed look and verify I’m getting the addresses in the correct form.<o:p></o:p></p><p class=MsoPlainText><o:p> </o:p></p><p class=MsoPlainText>> Amos<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p></div></body></html>