[squid-users] squid with HTTPS and some APPs not working

--Ahmad-- ahmed.zaeem at netstream.ps
Tue Jun 28 07:39:30 UTC 2016


Hi ,
i have squid that is working on 3.5 .
traffic of t 80 and 443 traffic to Squid via IPTables.

Squid then passes traffic to ClamAV via C-ICAP. Squid is configured to intercept all SSL traffic and PKI has been setup and distributed to all clients.

we have a problem in  Skype of Business (Office 365) and Slack (Chat app)  seems its broken from squid intercept.


i tried to do exception for ssl for the domains that shown on the ACCess.log file when i use the APPs , but no luck 

i tried to execlide the websites below :

skype.com
lync.com
todyl.com
fastly\.net
.slack-msgs.com
.amazonaws.com
.slack.com <http://slack.com/>


#########################################################
but  it still not working and the APPS (( Skype of Business (Office 365) and Slack (Chat app))) are not working .

again , here is my nobump file :


 cat /opt/etc/squid.doms.nobump

\.skype\.com$
\.lync\.com$
\.todyl\.com$
\.fastly\.net$
\.slack-msgs\.com$
\.amazonaws\.com$
\.slack\.com$

##############################################################

current versions we have :
·       Squid 3.5.19

·       C-ICAP 0.4.2

·       SquidclamAV 6.15

·       ClamAV 0.99.2

######################################################################

      here is squid.conf :

# Example rule allowing access from your local networks.
# Adapt to list your (internal) IP networks from where browsing
# should be allowed
acl localnet src 10.0.0.0/8	# RFC1918 possible internal network

# Example rule allowing access from your local networks.
# Adapt localnet in the ACL section to list your (internal) IP networks
# from where browsing should be allowed
http_access allow localnet
http_access allow localhost
http_access allow localhost manager
http_access deny manager

# Squid normally listens to port 3128
http_port 3127
http_port 3128 intercept

# Leave coredumps in the first cache dir
coredump_dir /var/cache/squid

visible_hostname shield.TodylInc.shield

cache_log /opt/var/log/squid/cache_log
cache_access_log /opt/var/log/squid/access_log

#user and group
cache_effective_user squid
cache_effective_group squid

acl todyl dstdomain	todyl.com
request_header_add X-TODYL-GUID 1e46dccd2 todyl

#Custom Error Pages
error_directory /opt/www/squid

# Squid listen Port
https_port 3129 intercept ssl-bump generate-host-certificates=on dynamic_cert_mem_cache_size=4MB key=/opt/etc/pki/squid/ca-key.pem cert=/opt/etc/pki/squid/ca.pem options=NO_SSLv2,NO_SSLv3,SINGLE_DH_USE

# SSL Bump Config
always_direct allow all
ssl_bump server-first all 
sslcrtd_program /opt/libexec/ssl_crtd -s /opt/lib/ssl_db -M 4MB
sslcrtd_children 32 startup=5 idle=1

##############################################
acl DiscoverSNIHost at_step SslBump1
acl NoSSLIntercept ssl::server_name_regex -i "/opt/etc/squid.doms.nobump"
 
ssl_bump splice NoSSLIntercept
ssl_bump peek DiscoverSNIHost
ssl_bump bump all
 
##################

#Hardening
sslproxy_options NO_SSLv2,NO_SSLv3,SINGLE_DH_USE,SINGLE_ECDH_USE
sslproxy_cipher EECDH+ECDSA+AESGCM:EECDH+aRSA+AESGCM:EECDH+ECDSA+SHA384:EECDH+ECDSA+SHA256:EECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH+aRSA+RC4:EECDH:EDH+aRSA:!RC4:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!SRP:!DSS

# TUNING
cache_dir aufs /var/cache/squid 40000 16 256
store_dir_select_algorithm round-robin
minimum_object_size 0 KB
maximum_object_size 96 MB
memory_pools off
quick_abort_min 0 KB
quick_abort_max 0 KB
log_icp_queries off
client_db off
cache_mem 1500 MB
buffered_logs on
half_closed_clients off

dns_nameservers 10.192.0.1
##################################################################


here is squid -k parse :

[root at 1e46dccd2 var]# squid -k parse
2016/06/27 08:06:08| Startup: Initializing Authentication Schemes ...
2016/06/27 08:06:08| Startup: Initialized Authentication Scheme 'basic'
2016/06/27 08:06:08| Startup: Initialized Authentication Scheme 'digest'
2016/06/27 08:06:08| Startup: Initialized Authentication Scheme 'negotiate'
2016/06/27 08:06:08| Startup: Initialized Authentication Scheme 'ntlm'
2016/06/27 08:06:08| Startup: Initialized Authentication.
2016/06/27 08:06:08| Processing Configuration File: /opt/etc/squid.conf (depth 0)
2016/06/27 08:06:08| Processing: acl localnet src 10.0.0.0/8 # RFC1918 possible internal network
2016/06/27 08:06:08| Processing: http_access allow localnet
2016/06/27 08:06:08| Processing: http_access allow localhost
2016/06/27 08:06:08| Processing: http_access allow localhost manager
2016/06/27 08:06:08| Processing: http_access deny manager
2016/06/27 08:06:08| Processing: http_port 3127
2016/06/27 08:06:08| Processing: http_port 3128 intercept
2016/06/27 08:06:08| Starting Authentication on port [::]:3128
2016/06/27 08:06:08| Disabling Authentication on port [::]:3128 (interception enabled)
2016/06/27 08:06:08| Processing: coredump_dir /var/cache/squid
2016/06/27 08:06:08| Processing: visible_hostname shield.TodylInc.shield
2016/06/27 08:06:08| Processing: cache_log /opt/var/log/squid/cache_log
2016/06/27 08:06:08| Processing: cache_access_log /opt/var/log/squid/access_log
2016/06/27 08:06:08| Processing: cache_effective_user squid
2016/06/27 08:06:08| Processing: cache_effective_group squid
2016/06/27 08:06:08| Processing: acl todyl dstdomain todyl.com
2016/06/27 08:06:08| Processing: request_header_add X-TODYL-GUID 1e46dccd2 todyl
2016/06/27 08:06:08| Processing: error_directory /opt/www/squid
2016/06/27 08:06:08| Processing: https_port 3129 intercept ssl-bump generate-host-certificates=on dynamic_cert_mem_cache_size=4MB key=/opt/etc/pki/squid/ca-key.pem cert=/opt/etc/pki/squid/ca.pem options=NO_SSLv2,NO_SSLv3,SINGLE_DH_USE
2016/06/27 08:06:08| Starting Authentication on port [::]:3129
2016/06/27 08:06:08| Disabling Authentication on port [::]:3129 (interception enabled)
2016/06/27 08:06:08| Processing: always_direct allow all
2016/06/27 08:06:08| Processing: ssl_bump server-first all
2016/06/27 08:06:08| Processing: sslcrtd_program /opt/libexec/ssl_crtd -s /opt/lib/ssl_db -M 4MB
2016/06/27 08:06:08| Processing: sslcrtd_children 32 startup=5 idle=1
2016/06/27 08:06:08| Processing: acl DiscoverSNIHost at_step SslBump1
2016/06/27 08:06:08| Processing: acl NoSSLIntercept ssl::server_name_regex -i "/opt/etc/squid.doms.nobump"
2016/06/27 08:06:08| Processing: ssl_bump splice NoSSLIntercept
2016/06/27 08:06:08| Processing: ssl_bump peek DiscoverSNIHost
2016/06/27 08:06:08| Processing: ssl_bump bump all
2016/06/27 08:06:08| Processing: sslproxy_options NO_SSLv2,NO_SSLv3,SINGLE_DH_USE,SINGLE_ECDH_USE
2016/06/27 08:06:08| Processing: sslproxy_cipher EECDH+ECDSA+AESGCM:EECDH+aRSA+AESGCM:EECDH+ECDSA+SHA384:EECDH+ECDSA+SHA256:EECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH+aRSA+RC4:EECDH:EDH+aRSA:!RC4:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!SRP:!DSS
2016/06/27 08:06:08| Processing: cache_dir aufs /var/cache/squid 40000 16 256
2016/06/27 08:06:08| Processing: store_dir_select_algorithm round-robin
2016/06/27 08:06:08| Processing: minimum_object_size 0 KB
2016/06/27 08:06:08| Processing: maximum_object_size 96 MB
2016/06/27 08:06:08| Processing: memory_pools off
2016/06/27 08:06:08| Processing: quick_abort_min 0 KB
2016/06/27 08:06:08| Processing: quick_abort_max 0 KB
2016/06/27 08:06:08| Processing: log_icp_queries off
2016/06/27 08:06:08| Processing: client_db off
2016/06/27 08:06:08| Processing: cache_mem 1500 MB
2016/06/27 08:06:08| Processing: buffered_logs on
2016/06/27 08:06:08| Processing: half_closed_clients off
2016/06/27 08:06:08| Processing: dns_nameservers 10.192.0.1
2016/06/27 08:06:08| Initializing https proxy context
2016/06/27 08:06:08| Initializing https_port [::]:3129 SSL context
2016/06/27 08:06:08| Using certificate in /opt/etc/pki/squid/ca.pem
—————————————————————————————————



here is access.log


1467029265.989     50 10.192.0.12 TAG_NONE/200 0 CONNECT 52.84.29.139:443 - ORIGINAL_DST/52.84.29.139 -
1467029265.999     59 10.192.0.12 TAG_NONE/200 0 CONNECT 52.84.29.139:443 - ORIGINAL_DST/52.84.29.139 -
1467029266.070     59 10.192.0.12 TCP_MISS/200 13171 GET https://slack.com/help/test - ORIGINAL_DST/52.84.29.139 text/html
1467029266.222     53 10.192.0.12 TAG_NONE/200 0 CONNECT 172.217.5.14:443 - ORIGINAL_DST/172.217.5.14 -
1467029266.234     66 10.192.0.12 TCP_MISS/200 598 GET https://slack.com/beacon/track/? - ORIGINAL_DST/52.84.29.139 image/gif
1467029266.274     26 10.192.0.12 TCP_MISS/200 557 GET https://www.google-analytics.com/r/collect? - ORIGINAL_DST/172.217.5.14 image/gif
1467029266.314     66 10.192.0.12 TAG_NONE/200 0 CONNECT 169.54.33.172:443 - ORIGINAL_DST/169.54.33.172 -
1467029266.368     21 10.192.0.12 TCP_MISS/200 547 GET https://api.mixpanel.com/track/? - ORIGINAL_DST/169.54.33.172 application/json
1467029266.469     42 10.192.0.12 TAG_NONE/200 0 CONNECT 199.27.76.249:443 - ORIGINAL_DST/199.27.76.249 -
1467029266.722    231 10.192.0.12 TCP_MISS/200 11968 GET https://slack.global.ssl.fastly.net/beacons/boomerang1/image-0.png? - ORIGINAL_DST/199.27.76.249 image/png
1467029267.044    303 10.192.0.12 TAG_NONE/200 0 CONNECT 54.231.161.8:443 - ORIGINAL_DST/54.231.161.8 -
1467029267.231    170 10.192.0.12 TCP_MISS/200 11994 GET https://s3-us-west-2.amazonaws.com/slack-files2/beacons/boomerang1/image-0.png? - ORIGINAL_DST/54.231.161.8 image/png
1467029267.482    145 10.192.0.12 TAG_NONE/200 0 CONNECT 54.172.232.15:443 - ORIGINAL_DST/54.172.232.15 -
1467029267.563     63 10.192.0.12 TCP_MISS_ABORTED/000 0 GET https://mpmulti-y6oq.slack-msgs.com/websocket/_CONNECTION_TEST_TOKEN_ - ORIGINAL_DST/54.172.232.15 -
1467029267.771    167 10.192.0.12 TAG_NONE/200 0 CONNECT 52.91.147.164:443 - ORIGINAL_DST/52.91.147.164 -
1467029267.891    110 10.192.0.12 TCP_MISS_ABORTED/000 0 GET https://mpmulti-f4bz.slack-msgs.com/websocket/_CONNECTION_TEST_TOKEN_ - ORIGINAL_DST/52.91.147.164 -
1467029268.106    153 10.192.0.12 TAG_NONE/200 0 CONNECT 52.23.253.30:443 - ORIGINAL_DST/52.23.253.30 -
1467029268.194     79 10.192.0.12 TCP_MISS_ABORTED/000 0 GET https://mpmulti-zdjz.slack-msgs.com/websocket/_CONNECTION_TEST_TOKEN_ - ORIGINAL_DST/52.23.253.30 -
1467029268.449    160 10.192.0.12 TAG_NONE/200 0 CONNECT 52.201.253.102:443 - ORIGINAL_DST/52.201.253.102 -
1467029268.567    110 10.192.0.12 TCP_MISS_ABORTED/000 0 GET https://mpmulti-2pbf.slack-msgs.com/websocket/_CONNECTION_TEST_TOKEN_ - ORIGINAL_DST/52.201.253.102 -
1467029268.764    149 10.192.0.12 TAG_NONE/200 0 CONNECT 52.91.121.224:443 - ORIGINAL_DST/52.91.121.224 -
1467029268.845     74 10.192.0.12 TCP_MISS_ABORTED/000 0 GET https://mpmulti-x1if.slack-msgs.com/websocket/_CONNECTION_TEST_TOKEN_ - ORIGINAL_DST/52.91.121.224 -
1467029268.967    108 10.192.0.12 TCP_MISS/200 516 GET https://slack.global.ssl.fastly.net/beacons/boomerang1/image-l.gif? - ORIGINAL_DST/199.27.76.249 image/gif
1467029269.169    187 10.192.0.12 TCP_MISS/200 517 GET https://slack.global.ssl.fastly.net/beacons/boomerang1/image-l.gif? - ORIGINAL_DST/199.27.76.249 image/gif
1467029269.285    101 10.192.0.12 TCP_MISS/200 516 GET https://slack.global.ssl.fastly.net/beacons/boomerang1/image-l.gif? - ORIGINAL_DST/199.27.76.249 image/gif
1467029269.467    167 10.192.0.12 TCP_MISS/200 517 GET https://slack.global.ssl.fastly.net/beacons/boomerang1/image-l.gif? - ORIGINAL_DST/199.27.76.249 image/gif
1467029269.643    160 10.192.0.12 TCP_MISS/200 517 GET https://slack.global.ssl.fastly.net/beacons/boomerang1/image-l.gif? - ORIGINAL_DST/199.27.76.249 image/gif
1467029269.824    165 10.192.0.12 TCP_MISS/200 517 GET https://slack.global.ssl.fastly.net/beacons/boomerang1/image-l.gif? - ORIGINAL_DST/199.27.76.249 image/gif
1467029270.004    164 10.192.0.12 TCP_MISS/200 517 GET https://slack.global.ssl.fastly.net/beacons/boomerang1/image-l.gif? - ORIGINAL_DST/199.27.76.249 image/gif
1467029270.186    165 10.192.0.12 TCP_MISS/200 517 GET https://slack.global.ssl.fastly.net/beacons/boomerang1/image-l.gif? - ORIGINAL_DST/199.27.76.249 image/gif
1467029270.295     94 10.192.0.12 TCP_MISS/200 516 GET https://slack.global.ssl.fastly.net/beacons/boomerang1/image-l.gif? - ORIGINAL_DST/199.27.76.249 image/gif
1467029270.489    173 10.192.0.12 TCP_MISS/200 517 GET https://slack.global.ssl.fastly.net/beacons/boomerang1/image-l.gif? - ORIGINAL_DST/199.27.76.249 image/gif
1467029270.656    151 10.192.0.12 TCP_MISS_ABORTED/000 0 GET https://slack.global.ssl.fastly.net/beacons/boomerang1/image-0.png? - ORIGINAL_DST/199.27.76.249 -
1467029273.699     57 10.192.0.12 TCP_MISS/200 951 GET http://lyncdiscover.todyl.com/? - ORIGINAL_DST/131.253.163.205 application/vnd.microsoft.rtc.autodiscover+xml
1467029273.713     72 10.192.0.12 TAG_NONE/200 0 CONNECT 131.253.163.205:443 - ORIGINAL_DST/131.253.163.205 -
1467029273.797     73 10.192.0.12 TAG_NONE/200 0 CONNECT 131.253.161.142:443 - ORIGINAL_DST/131.253.161.142 -
1467029273.874     70 10.192.0.12 TCP_MISS/200 1453 GET https://webdir2a.online.lync.com/Autodiscover/AutodiscoverService.svc/root? - ORIGINAL_DST/131.253.161.142 application/vnd.microsoft.rtc.autodiscover+xml
1467029273.952     74 10.192.0.12 TAG_NONE/200 0 CONNECT 131.253.161.142:443 - ORIGINAL_DST/131.253.161.142 -
1467029273.985     25 10.192.0.12 TCP_MISS/401 2206 GET https://webdir2a.online.lync.com/Autodiscover/AutodiscoverService.svc/root/user? - ORIGINAL_DST/131.253.161.142 text/html
1467029274.077     76 10.192.0.12 TAG_NONE/200 0 CONNECT 131.253.161.142:443 - ORIGINAL_DST/131.253.161.142 -
1467029274.217    132 10.192.0.12 TCP_MISS/200 18842 POST https://webdir2a.online.lync.com/WebTicket/WebTicketService.svc/mex - ORIGINAL_DST/131.253.161.142 application/soap+xml
1467029274.430    152 10.192.0.12 TAG_NONE/200 0 CONNECT 23.96.208.238:443 - ORIGINAL_DST/23.96.208.238 -
1467029274.631    180 10.192.0.12 TCP_MISS/200 16835 POST https://login.microsoftonline.com/RST2.srf - ORIGINAL_DST/23.96.208.238 application/soap+xml
1467029274.720     75 10.192.0.12 TAG_NONE/200 0 CONNECT 131.253.161.142:443 - ORIGINAL_DST/131.253.161.142 -
1467029274.858    131 10.192.0.12 TCP_MISS/200 6107 POST https://webdir2a.online.lync.com/WebTicket/WebTicketAdvancedService.svc/WsFed_bearer - ORIGINAL_DST/131.253.161.142 text/xml
1467029274.936     73 10.192.0.12 TAG_NONE/200 0 CONNECT 131.253.161.142:443 - ORIGINAL_DST/131.253.161.142 -
1467029274.998     55 10.192.0.12 TCP_MISS/200 2507 GET https://webdir2a.online.lync.com/Autodiscover/AutodiscoverService.svc/root/user? - ORIGINAL_DST/131.253.161.142 application/vnd.microsoft.rtc.autodiscover+xml
1467029275.099     72 10.192.0.12 TAG_NONE/200 0 CONNECT 131.253.161.139:443 - ORIGINAL_DST/131.253.161.139 -
1467029275.216     70 10.192.0.12 TAG_NONE/200 0 CONNECT 131.253.161.147:443 - ORIGINAL_DST/131.253.161.147 -
1467029275.524    107 10.192.0.12 TAG_NONE/200 0 CONNECT 134.170.113.218:443 - ORIGINAL_DST/134.170.113.218 -
1467029279.731     24 10.192.0.12 TCP_MISS/200 951 GET http://lyncdiscover.todyl.com/? - ORIGINAL_DST/131.253.163.205 application/vnd.microsoft.rtc.autodiscover+xml
1467029279.778     71 10.192.0.12 TAG_NONE/200 0 CONNECT 131.253.163.205:443 - ORIGINAL_DST/131.253.163.205 -
1467029279.814     76 10.192.0.12 TAG_NONE/200 0 CONNECT 131.253.161.142:443 - ORIGINAL_DST/131.253.161.142 -
1467029279.847     27 10.192.0.12 TCP_MISS/200 1453 GET https://webdir2a.online.lync.com/Autodiscover/AutodiscoverService.svc/root? - ORIGINAL_DST/131.253.161.142 application/vnd.microsoft.rtc.autodiscover+xml
1467029279.922     70 10.192.0.12 TAG_NONE/200 0 CONNECT 131.253.161.142:443 - ORIGINAL_DST/131.253.161.142 -
1467029279.952     24 10.192.0.12 TCP_MISS/401 2206 GET https://webdir2a.online.lync.com/Autodiscover/AutodiscoverService.svc/root/user? - ORIGINAL_DST/131.253.161.142 text/html
1467029280.032     73 10.192.0.12 TAG_NONE/200 0 CONNECT 131.253.161.142:443 - ORIGINAL_DST/131.253.161.142 -
1467029280.092     54 10.192.0.12 TCP_MISS/200 2507 GET https://webdir2a.online.lync.com/Autodiscover/AutodiscoverService.svc/root/user? - ORIGINAL_DST/131.253.161.142 application/vnd.microsoft.rtc.autodiscover+xml
1467029280.180     73 10.192.0.12 TAG_NONE/200 0 CONNECT 131.253.161.139:443 - ORIGINAL_DST/131.253.161.139 -
1467029280.270     73 10.192.0.12 TAG_NONE/200 0 CONNECT 131.253.161.147:443 - ORIGINAL_DST/131.253.161.147 -
1467029280.396    107 10.192.0.12 TAG_NONE/200 0 CONNECT 134.170.113.218:443 - ORIGINAL_DST/134.170.113.218 -
1467029287.555     75 10.192.0.12 TAG_NONE/200 0 CONNECT 157.55.133.204:443 - ORIGINAL_DST/157.55.133.204 -
1467029287.673     92 10.192.0.12 TAG_NONE/200 0 CONNECT 157.55.133.204:443 - ORIGINAL_DST/157.55.133.204 -
1467029287.681     41 10.192.0.12 TCP_MISS/200 607 GET http://login.live.com/ppcrlcheck.srf - ORIGINAL_DST/131.253.61.68 text/html
1467029287.729     41 10.192.0.12 TAG_NONE/200 0 CONNECT 157.55.133.204:443 - ORIGINAL_DST/157.55.133.204 -
1467029287.784     46 10.192.0.12 TAG_NONE/200 0 CONNECT 157.55.133.204:443 - ORIGINAL_DST/157.55.133.204 -
1467029287.801     92 10.192.0.12 TAG_NONE/200 0 CONNECT 131.253.61.68:443 - ORIGINAL_DST/131.253.61.68 -
1467029287.859     61 10.192.0.12 TAG_NONE/200 0 CONNECT 157.55.133.204:443 - ORIGINAL_DST/157.55.133.204 -
1467029287.926     52 10.192.0.12 TAG_NONE/200 0 CONNECT 157.55.133.204:443 - ORIGINAL_DST/157.55.133.204 -
1467029287.964    134 10.192.0.12 TCP_MISS/200 10828 POST https://login.live.com/RST2.srf - ORIGINAL_DST/131.253.61.68 application/soap+xml
1467029287.998     56 10.192.0.12 TAG_NONE/200 0 CONNECT 157.55.133.204:443 - ORIGINAL_DST/157.55.133.204 -
1467029288.051     40 10.192.0.12 TAG_NONE/200 0 CONNECT 157.55.133.204:443 - ORIGINAL_DST/157.55.133.204 -
1467029288.204     46 10.192.0.12 TCP_MISS/302 538 GET http://go.microsoft.com/fwlink/? - ORIGINAL_DST/23.66.120.244 -
1467029288.389    147 10.192.0.12 TCP_MISS/302 1786 GET http://www.microsoft.com/security/encyclopedia/adlpackages.aspx? - ORIGINAL_DST/23.203.90.59 text/html
1467029288.422     48 10.192.0.12 TAG_NONE/200 0 CONNECT 13.90.208.215:443 - ORIGINAL_DST/13.90.208.215 -
1467029288.882    311 10.192.0.12 TAG_NONE/200 0 CONNECT 104.41.32.78:443 - ORIGINAL_DST/104.41.32.78 -












Any Help ????


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.squid-cache.org/pipermail/squid-users/attachments/20160628/c94aca2a/attachment-0001.html>


More information about the squid-users mailing list