[squid-users] Bug: Missing MemObject::storeId value

Mon Sep 25 18:45:48 UTC 2017

Hey Aaron,

Just to clear out the doubt's, what happen when you use squid-cache without rock cache_dir? Is the problem appearing again?
Also, there is a possibility of a bug which is related to squid ssl-bump termination code on 3.5.X.
Testing 4.0.21 would be the best to understand if the issue is 3.5 local or if it was fixed in 4.X+ but, from my memory I think you will need to adapt your squid.conf ssl_bump configurations.
You can get the latest beta and stable binaries from my repo and the beta repo details are at:
https://wiki.squid-cache.org/action/edit/KnowledgeBase/CentOS#Squid_Beta_release

Also, since you are using haproxy in front of squid I would suggest you to use the proxy protocol(v1) which is the best way to pass the source ip addresses to the proxy.
I have tested squid to work with the proxy protocol v1 but yet to test v2.

All The Bests,
Eliezer

----
Eliezer Croitoru
Linux System Administrator
Mobile: +972-5-28704261
Email: eliezer at ngtech.co.il

-----Original Message-----
From: squid-users [mailto:squid-users-bounces at lists.squid-cache.org] On Behalf Of Aaron Turner
Sent: Saturday, September 23, 2017 02:19
To: squid-users at lists.squid-cache.org
Subject: [squid-users] Bug: Missing MemObject::storeId value

Version: 3.5.26 on CentOS 7.3 on AWS EC2 m3.xlarge and 2x 100GB EBS
volumes for rock cache.

Doing some basic system tests and we're seeing a bunch of errors like:

2017/09/22 22:43:15 kid1| Bug: Missing MemObject::storeId value
2017/09/22 22:43:15 kid1| mem_hdr: 0x7f169d0a2a70 nodes.start() 0x7f169c6cc9d0
2017/09/22 22:43:15 kid1| mem_hdr: 0x7f169d0a2a70 nodes.finish() 0x7f169dae4e40
2017/09/22 22:43:15 kid1| MemObject->start_ping: 0.000000
2017/09/22 22:43:15 kid1| MemObject->inmem_hi: 20209
2017/09/22 22:43:15 kid1| MemObject->inmem_lo: 0
2017/09/22 22:43:15 kid1| MemObject->nclients: 0
2017/09/22 22:43:15 kid1| MemObject->reply: 0x7f167ee60db0
2017/09/22 22:43:15 kid1| MemObject->request: 0
2017/09/22 22:43:15 kid1| MemObject->logUri:
2017/09/22 22:43:15 kid1| MemObject->storeId:
2017/09/22 22:43:15 kid1| Bug: Missing MemObject::storeId value
2017/09/22 22:43:15 kid1| mem_hdr: 0x7f16a0388760 nodes.start() 0x7f16a6a4a500
2017/09/22 22:43:15 kid1| mem_hdr: 0x7f16a0388760 nodes.finish() 0x7f16a6a4a4d0
2017/09/22 22:43:15 kid1| MemObject->start_ping: 0.000000
2017/09/22 22:43:15 kid1| MemObject->inmem_hi: 50265
2017/09/22 22:43:15 kid1| MemObject->inmem_lo: 0
2017/09/22 22:43:15 kid1| MemObject->nclients: 0
2017/09/22 22:43:15 kid1| MemObject->reply: 0x7f169f83d7d0
2017/09/22 22:43:15 kid1| MemObject->request: 0
2017/09/22 22:43:15 kid1| MemObject->logUri:
2017/09/22 22:43:15 kid1| MemObject->storeId:

I did some googling and seems like a lot of comments about this with
Rock (we're using) and ICP/HTCP (not using).  Curious if this the same
bug or something new?  Are there config changes we can make to prevent
this (perhaps switching away from rock cache??)

We have a bunch of clients behind haproxy which is load balancing to
4x Squid.  Config of the squids is as:

http_access allow localhost manager
http_access deny manager

external_acl_type client_ip_map_0 %>ha{Our-Client}
/usr/lib64/squid/user_loadbalance.py 0 4
external_acl_type client_ip_map_1 %>ha{Our-Client}
/usr/lib64/squid/user_loadbalance.py 1 4
external_acl_type client_ip_map_2 %>ha{Our-Client}
/usr/lib64/squid/user_loadbalance.py 2 4
external_acl_type client_ip_map_3 %>ha{Our-Client}
/usr/lib64/squid/user_loadbalance.py 3 4

acl client_group_0 external client_ip_map_0
acl client_group_1 external client_ip_map_1
acl client_group_2 external client_ip_map_2
acl client_group_3 external client_ip_map_3

http_access allow client_group_0
http_access allow client_group_1
http_access allow client_group_2
http_access allow client_group_3
http_access deny all

tcp_outgoing_address 10.93.2.41 client_group_0
tcp_outgoing_address 10.93.2.76 client_group_1
tcp_outgoing_address 10.93.2.198 client_group_2
tcp_outgoing_address 10.93.3.178 client_group_3

cache_dir rock /var/lib/squid/cache1 51200
cache_dir rock /var/lib/squid/cache2 51200
coredump_dir /var/spool/squid
maximum_object_size_in_memory 8 MB
maximum_object_size 8 MB

cache_mem 6 GB
memory_cache_shared on
workers 4

refresh_pattern . 0 100% 30

http_port squid0001:3128 ssl-bump generate-host-certificates=on
dynamic_cert_mem_cache_size=400MB cert=/etc/squid/ssl_cert/myCA.pem
http_port localhost:3128
ssl_bump bump all

request_header_access Our-Client deny all
request_header_access Via deny all
forwarded_for delete

visible_hostname squid0001.lab.company.com
logformat adttest %tg %6tr %>a %Ss/%03>Hs %<st %rm %>ru %[un %Sh/%<a %mt %ea
access_log daemon:/var/log/squid/access.${process_number}.log adttest
icon_directory /usr/share/squid/icons

sslcrtd_program /usr/lib64/squid/ssl_crtd -s /var/lib/squid/ssl_db -M 4MB
sslcrtd_children 32 startup=2 idle=2
sslproxy_session_cache_size 100 MB
sslproxy_cert_error allow all
sslproxy_flags DONT_VERIFY_PEER

--
Aaron Turner
https://synfin.net/         Twitter: @synfinatic
My father once told me that respect for the truth comes close to being
the basis for all morality.  "Something cannot emerge from nothing,"
he said.  This is profound thinking if you understand how unstable
"the truth" can be.  -- Frank Herbert, Dune
_______________________________________________
squid-users mailing list
squid-users at lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-users