[chef] Re: Re: Re: Large cookbook uploads fail with "unauthorized" after data upload

[AJ Christensen < >]

On 27 March 2012 10:26, Jason J. W. Williams 
<
 >
 wrote:
>> Why are you putting several very large files in Chef? Surely there are
>> more efficient ways to manage these files? It is likely that such
>> files would take a long time to download when required by the client
>> and likewise time out.
>
> Because if we're going to have to run our own mirrors of the files,
> we'd just as well have it in Chef rather than manage an internal
> mirror that's only used by Chef anyway.

This is a false assertion.

The chef-server file server is not just a 'mirror of files'. You
should explicitly avoid loading and streaming large files with the
Signed Header authentication, as many cycles will be used to hash HTTP
headers and body (in my experience).

In your position, I would consider distributing these large files via
BitTorrent or HTTP, potentially from CDN-backed Object Storage such as
S3 depending on geographic proximity.

Warm Regards,

--AJ

>
> -J