[squid-users] Squid 3.5.20 rock store and enable-disk-io

FredB fredbmail at free.fr
Thu Sep 1 07:08:07 UTC 2016 

Hi Alex


> Normally, you do not need any ./configure options to enable Rock
> support, including support for a stand-alone disker process. If you
> want
> to enable IpcIo explicitly, you may, but I would first check whether
> it
> was enabled without any --enable-disk-io options:
> 
> > $ fgrep IpcIo config.log
> > configure:21195: Enabling IpcIo DiskIO module
> > configure:21227: IO Modules built:  AIO Blocking DiskDaemon
> > DiskThreads IpcIo Mmapped
> 
> IpcIo requires shared memory support bust most modern build
> environments
> provide that.

Ok 

configure:21150: result:  Blocking DiskThreads IpcIo Mmapped AIO DiskDaemon
configure:21665: Enabling IpcIo DiskIO module
configure:21695: IO Modules built:  Blocking DiskThreads IpcIo Mmapped AIO DiskDaemon


> 
> > Perhaps this process is only created in smp mode ?
> 
> As the documentation tries to imply, the disker process is used when
> all
> of the statements below are true:
> 
> * there are rock cache_dir(s) in squid.conf


cache_dir rock /cache1 130000 
cache_dir rock /cache2 130000 

> * IpcIo disk I/O module is enabled (it usually is by default)

Yes

configure:21150: result:  Blocking DiskThreads IpcIo Mmapped AIO DiskDaemon
configure:21665: Enabling IpcIo DiskIO module
configure:21695: IO Modules built:  Blocking DiskThreads IpcIo Mmapped AIO DiskDaemon

> * Squid was started without the -N command line option.

This is the point ! 
By default, after the compilation the systemd is generated like this 

more ./tools/systemd/squid.service
## Copyright (C) 1996-2016 The Squid Software Foundation and contributors
##
## Squid software is distributed under GPLv2+ license and includes
## contributions from numerous individuals and organizations.
## Please see the COPYING and CONTRIBUTORS files for details.
##

[Unit]
Description=Squid Web Proxy Server
After=network.target

[Service]
Type=simple
ExecStart=/usr/sbin/squid -sYC -N
ExecReload=/bin/kill -HUP $MAINPID
KillMode=process

[Install]
WantedBy=multi-user.target

But I have a new problem, not present without IpcIo or with squid -N 

FATAL: Rock cache_dir at /cache1/rock failed to open db file: (2) No such file or directory
Squid Cache (Version 3.5.20): Terminated abnormally.
CPU Usage: 0.056 seconds = 0.008 user + 0.048 sys
Maximum Resident Size: 104144 KB
Page faults with physical i/o: 0
2016/09/01 09:01:01 kid2| Store rebuilding is 61.69% complete
2016/09/01 09:01:01 kid3| Store rebuilding is 62.03% complete
2016/09/01 09:01:01 kid1| Set Current Directory to /home/squid
2016/09/01 09:01:01 kid1| Starting Squid Cache version 3.5.20 for x86_64-pc-linux-gnu...
2016/09/01 09:01:01 kid1| Service Name: squid
2016/09/01 09:01:01 kid1| Process ID 7454
2016/09/01 09:01:01 kid1| Process Roles: worker
2016/09/01 09:01:01 kid1| With 65535 file descriptors available
2016/09/01 09:01:01 kid1| Initializing IP Cache...
2016/09/01 09:01:01 kid1| DNS Socket created at 0.0.0.0, FD 12
2016/09/01 09:01:01 kid1| Adding nameserver 192.168.115.1 from /etc/resolv.conf
2016/09/01 09:01:01 kid1| Adding nameserver 192.168.115.2 from /etc/resolv.conf
2016/09/01 09:01:01 kid1| helperOpenServers: Starting 50/150 'digest_ldap_auth' processes
2016/09/01 09:01:01 kid1| helperOpenServers: Starting 40/150 'basic_ldap_auth' processes
2016/09/01 09:01:01 kid1| Logfile: opening log stdio:/var/log/squid/access.log
2016/09/01 09:01:01 kid1| Local cache digest enabled; rebuild/rewrite every 3600/3600 sec
2016/09/01 09:01:01 kid1| Store logging disabled
2016/09/01 09:01:01 kid1| WARNING: disk-cache maximum object size is too large for mem-cache: 5242880.00 KB > 5120.00 KB
2016/09/01 09:01:01 kid1| Swap maxSize 0 + 16777216 KB, estimated 1290555 objects
2016/09/01 09:01:01 kid1| Target number of buckets: 64527
2016/09/01 09:01:01 kid1| Using 65536 Store buckets
2016/09/01 09:01:01 kid1| Max Mem  size: 16777216 KB [shared]
2016/09/01 09:01:01 kid1| Max Swap size: 0 KB
2016/09/01 09:01:01 kid1| Using Least Load store dir selection
2016/09/01 09:01:01 kid1| Set Current Directory to /home/squid
2016/09/01 09:01:01 kid1| Finished loading MIME types and icons.
2016/09/01 09:01:01 kid1| HTCP Disabled.
2016/09/01 09:01:01 kid1| Squid plugin modules loaded: 0
2016/09/01 09:01:01 kid1| Adaptation support is on
2016/09/01 09:01:01 kid1| commBind: Cannot bind socket FD 20 to [::]: (2) No such file or directory
2016/09/01 09:01:08 kid1| ERROR: /cache1/rock communication channel establishment timeout
2016/09/01 09:01:08 kid1| Closing HTTP port 0.0.0.0:8080
FATAL: Rock cache_dir at /cache1/rock failed to open db file: (2) No such file or directory
Squid Cache (Version 3.5.20): Terminated abnormally.
CPU Usage: 0.056 seconds = 0.012 user + 0.044 sys
Maximum Resident Size: 103632 KB
Page faults with physical i/o: 0
2016/09/01 09:01:11 kid1| Set Current Directory to /home/squid
2016/09/01 09:01:11 kid1| Starting Squid Cache version 3.5.20 for x86_64-pc-linux-gnu...
2016/09/01 09:01:11 kid1| Service Name: squid
2016/09/01 09:01:11 kid1| Process ID 7550
2016/09/01 09:01:11 kid1| Process Roles: worker
2016/09/01 09:01:11 kid1| With 65535 file descriptors available
2016/09/01 09:01:11 kid1| Initializing IP Cache...
2016/09/01 09:01:11 kid1| DNS Socket created at 0.0.0.0, FD 12
2016/09/01 09:01:11 kid1| Adding nameserver 192.168.115.1 from /etc/resolv.conf
2016/09/01 09:01:11 kid1| Adding nameserver 192.168.115.2 from /etc/resolv.conf
2016/09/01 09:01:11 kid1| helperOpenServers: Starting 50/150 'digest_ldap_auth' processes
2016/09/01 09:01:11 kid1| helperOpenServers: Starting 40/150 'basic_ldap_auth' processes
2016/09/01 09:01:11 kid1| Logfile: opening log stdio:/var/log/squid/access.log
2016/09/01 09:01:11 kid1| Local cache digest enabled; rebuild/rewrite every 3600/3600 sec
2016/09/01 09:01:11 kid1| Store logging disabled
2016/09/01 09:01:11 kid1| WARNING: disk-cache maximum object size is too large for mem-cache: 5242880.00 KB > 5120.00 KB
2016/09/01 09:01:11 kid1| Swap maxSize 0 + 16777216 KB, estimated 1290555 objects
2016/09/01 09:01:11 kid1| Target number of buckets: 64527
2016/09/01 09:01:11 kid1| Using 65536 Store buckets
2016/09/01 09:01:11 kid1| Max Mem  size: 16777216 KB [shared]
2016/09/01 09:01:11 kid1| Max Swap size: 0 KB
2016/09/01 09:01:11 kid1| Using Least Load store dir selection
2016/09/01 09:01:11 kid1| Set Current Directory to /home/squid
2016/09/01 09:01:11 kid1| Finished loading MIME types and icons.
2016/09/01 09:01:11 kid1| HTCP Disabled.
2016/09/01 09:01:11 kid1| Squid plugin modules loaded: 0
2016/09/01 09:01:11 kid1| Adaptation support is on
2016/09/01 09:01:11 kid1| commBind: Cannot bind socket FD 20 to [::]: (2) No such file or directory
2016/09/01 09:01:16 kid3| Store rebuilding is 94.96% complete
2016/09/01 09:01:16 kid2| Store rebuilding is 94.63% complete
2016/09/01 09:01:18 kid3| Finished rebuilding storage from disk.
2016/09/01 09:01:18 kid3|   8319999 Entries scanned
2016/09/01 09:01:18 kid3|         0 Invalid entries.
2016/09/01 09:01:18 kid3|         0 With invalid flags.
2016/09/01 09:01:18 kid3|         0 Objects loaded.
2016/09/01 09:01:18 kid3|         0 Objects expired.
2016/09/01 09:01:18 kid3|         0 Objects cancelled.
2016/09/01 09:01:18 kid3|         0 Duplicate URLs purged.
2016/09/01 09:01:18 kid3|         0 Swapfile clashes avoided.
2016/09/01 09:01:18 kid3|   Took 47.02 seconds (  0.00 objects/sec).
2016/09/01 09:01:18 kid3| Beginning Validation Procedure
2016/09/01 09:01:18 kid3|   Completed Validation Procedure
2016/09/01 09:01:18 kid3|   Validated 0 Entries
2016/09/01 09:01:18 kid3|   store_swap_size = 16.00 KB
2016/09/01 09:01:18 kid2| Finished rebuilding storage from disk.
2016/09/01 09:01:18 kid2|   8319999 Entries scanned
2016/09/01 09:01:18 kid2|         0 Invalid entries.
2016/09/01 09:01:18 kid2|         0 With invalid flags.
2016/09/01 09:01:18 kid2|         0 Objects loaded.
2016/09/01 09:01:18 kid2|         0 Objects expired.
2016/09/01 09:01:18 kid2|         0 Objects cancelled.
2016/09/01 09:01:18 kid2|         0 Duplicate URLs purged.
2016/09/01 09:01:18 kid2|         0 Swapfile clashes avoided.
2016/09/01 09:01:18 kid2|   Took 47.22 seconds (  0.00 objects/sec).
2016/09/01 09:01:18 kid2| Beginning Validation Procedure
2016/09/01 09:01:18 kid2|   Completed Validation Procedure
2016/09/01 09:01:18 kid2|   Validated 0 Entries
2016/09/01 09:01:18 kid2|   store_swap_size = 16.00 KB
2016/09/01 09:01:18 kid1| ERROR: /cache1/rock communication channel establishment timeout
2016/09/01 09:01:18 kid1| Closing HTTP port 0.0.0.0:8080
FATAL: Rock cache_dir at /cache1/rock failed to open db file: (2) No such file or directory
Squid Cache (Version 3.5.20): Terminated abnormally.
CPU Usage: 0.064 seconds = 0.020 user + 0.044 sys
Maximum Resident Size: 103952 KB
Page faults with physical i/o: 0
2016/09/01 09:01:19 kid2| storeLateRelease: released 0 objects
2016/09/01 09:01:19 kid3| storeLateRelease: released 0 objects

If I add -N the problem and restart is gone 

Fred

> 
> 
> HTH,
> 
> Alex.
> 
>

More information about the squid-users mailing list