[chef] chef-server 11.0.12 tuning guide?

[Joe Nuspl < >]

I know 11.1.0 is right around the corner but I need something sooner…  Running open source chef-server 11.0.12 on CentOS-6.

We’re seeing a bunch of nginx timeouts accessing data bags.  For example:

2014/05/08 23:22:33 [error] 7637#0: *42766 upstream timed out (110: Connection timed out) while connecting to upstream, client: xx.xx.xx.xx, server: yyy.zz.com, request: "GET /data/bag/item HTTP/1.1", upstream: "http://127.0.0.1:8000/data/bag/item", host: “chef.zz.com:4000”

If I’m understanding this correctly, nginx cannot create a connection to erchef.

I’ve found very little on tuning chef-server.  There is erchef['ibrowse_max_sessions’] but that would be for outbound connections, i.e  erchef->solr.  Is there a parameter for the number of incoming connections to erchef?

I have 1500 clients with a 15 minute splay.  So roughly 100 servers/minute with an average end-to-end chef-client run time of 43 seconds.

The same server running chef-10 with 10 merbs was able to keep up without issue.  11.0.8 was an improvement but it seems like 11.0.12 has regressed.

On this server we are not running into the depsolver issue.

Any help would be greatly appreciated.

Thanks.

Joe