[chef] Re: 403 "Forbidden" when uploading cookbooks with large files

[Stephen Delano < >]

First of all, I don't recommend that you store files in your cookbooks that are 100-200MB in size, but I'll try and help you debug this a bit.

Do you have any logs from the bookshelf service on the chef server? This is the service that's handling the cookbook storage. It seems odd that a file of this size would take 20 minutes to upload. Do you have a slow connection to the chef server?

On Monday, April 21, 2014, Tomasz Chmielewski < "> > wrote:

On Tue, 22 Apr 2014 02:00:08 +0100
Tomasz Chmielewski < > wrote:

> The file I'm uploading is a static file and is unlikely to change in
> the future.

Or this:

$ time knife cookbook upload mmaww-staging
Uploading mmaww-staging  [1.0.0]
ERROR: Chef::Exceptions::ContentLengthMismatch: Response body length 0
does not match HTTP Content-Length header 206.

real    21m23.216s
user    0m6.249s
sys     0m3.728s


The error seems to be coming from nginx now - I can see the following
in /var/log/chef-server/nginx/error.log:

2014/04/22 01:22:31 [error] 22184#0: *13 readv() failed (104:
Connection reset by peer) while reading upstream, client:
188.37.253.127, server: chef01.sys, request:
"PUT /bookshelf/organization-00000000000000000000000000000000/checksum-95d55edf3a75d5358a424d843c3e8463?AWSAccessKeyId=...&Expires=1398129373&Signature=.../%2B1V2w%3D
HTTP/1.1", upstream:
"http://127.0.0.1:4321/bookshelf/organization-00000000000000000000000000000000/checksum-95d55edf3a75d5358a424d843c3e8463?AWSAccessKeyId=...&Expires=1398129373&Signature=.../%2B1V2w%3D",
host: "chef01.sys.timedoctor.com:443"


What do I need to change so that Chef accepts files which are 100-200
MB in size?

--
Tomasz Chmielewski
http://wpkg.org

-- 
Stephen Delano
Software Development Engineer
Opscode, Inc.
1008 Western Avenue
Suite 601
Seattle, WA 98104