[squid-users] Transfer-Encoding tag not delivered to c-icap server

[Giray Simsek]

Hi,

I am using squid + c-icap for content adaptation.
On a client machine, I am trying to download a pdf file from docs.google.com. Looks like the google servers are sending the response as chunked as the http headers look like below:

Access-Control-Allow-Credentials:false
Access-Control-Allow-Headers:Accept, Accept-Language, Authorization, Cache-Control, Content-Disposition, Content-Encoding, Content-Language, Content-Length, Content-MD5, Content-Range, Content-Type, Date, GData-Version, Host, If-Match, If-Modified-Since, If-None-Match, If-Unmodified-Since, Origin, OriginToken, Pragma, Range, Slug, Transfer-Encoding, Want-Digest, X-ClientDetails, X-GData-Client, X-GData-Key, X-Goog-AuthUser, X-Goog-PageId, X-Goog-Encode-Response-If-Executable, X-Goog-Correlation-Id, X-Goog-Request-Info, X-Goog-Experiments, x-goog-iam-authority-selector, x-goog-iam-authorization-token, X-Goog-Spatula, X-Goog-Upload-Command, X-Goog-Upload-Content-Disposition, X-Goog-Upload-Content-Length, X-Goog-Upload-Content-Type, X-Goog-Upload-File-Name, X-Goog-Upload-Offset, X-Goog-Upload-Protocol, X-Goog-Visitor-Id, X-HTTP-Method-Override, X-JavaScript-User-Agent, X-Pan-Versionid, X-Origin, X-Referer, X-Upload-Content-Length, X-Upload-Content-Type, X-Use-HTTP-Status-Code-Override, X-YouTube-VVT, X-YouTube-Page-CL, X-YouTube-Page-Timestamp
Access-Control-Allow-Methods:GET,OPTIONS
Access-Control-Allow-Origin:*
Alt-Svc:clear
Cache-Control:private, max-age=0
Connection:keep-alive
Content-Disposition:attachment;filename="obama ve abd d__ poltikas_ her k_tada.pdf";filename*=UTF-8''obama%20ve%20abd%20d%C4%B1%C5%9F%20poltikas%C4%B1%20her%20k%C4%B1tada.pdf
Content-Type:application/pdf
Date:Mon, 14 Dec 2015 14:54:38 GMT
Expires:Mon, 14 Dec 2015 14:54:38 GMT
Server:UploadServer
Transfer-Encoding:chunked
Via:ICAP/1.0 localhost.localdomain (C-ICAP/0.3.5 Antivirus service )
X-Cache:MISS from yssyk-1
X-Cache-Lookup:MISS from yssyk-1:3127
X-Goog-Hash:crc32c=fd1pYw==
X-GUploader-UploadID:AEnB2Ur_sVGeDq9pSrx5PWhUk5OcucS4Eh3hsy6sddLOCAZwjniCCgCCbtFGptms0svl89fX24bj4hktdI9tN-QY95hvJ5n74Q


The problem is when the response comes through squid+icap, the file can not be downloaded. The file appears on the file system with file size = 0.

I listened to the packets that are delivered to icap server from squid and verified that "Transfer-Encoding" header is not delivered to icap server.

So I can't find out at what point the file download is being blocked. File is downloaded successfully when the icap server is stopped. But I guess the problem might be
about squid's way of passing the file content (or headers) to icap server. Is there anything I can do on the icap server side to make the download succeed?


Thanks in advance,
Giray