[chef] Re: Re: Re: Re: Community Cookbooks Mirror

[Eric Helgeson < >]

Github's API is nice and allows you to do this, we also had a find/replace/pr script across all repos of our cookbook org (for build things, like berks, gemfiles, etc.) It wasn't many, maybe 20-30, so like I said, it kinda worked :) There's likely a more elegant solution.

-Eric Helgeson

@nulleric

On Wed, Aug 27, 2014 at 1:24 PM, Durfee, Bernie (GE Global Research) < " target="_blank"> > wrote:

How many repos are you mirroring? Did you script out the local repo creation somehow or just manually hammer through creating and syncing the repos?

Thanks,
Bernie

From: Eric Helgeson < "> <mailto: "> >>
Reply-To: " "> <mailto: "> >" < "> <mailto: "> >>
Date: Wednesday, August 27, 2014 at 10:38 AM
To: " "> <mailto: "> >" < "> <mailto: "> >>
Cc: " "> <mailto: "> >" < "> <mailto: "> >>
Subject: [chef] Re: Re: Community Cookbooks Mirror

To address this we mirrored community github repos to our internal git repos and had Jenkins jobs push the changes up to our Chef non-prod and prod servers. This allowed us to do code reviews and sign off on cookbooks (these cookbooks are running as root on your servers!) and get around firewall issues, etc. We used the Jenkins Job DSL to easily add jobs. It also gave us a way to have stewards of community cookbooks in a big organization.

It's not perfect though, sometimes community cookbooks don't use tags, some aren't in github, or the binaries in supermarket are not the same as the source code, etc. But it worked pretty OK (TM)

-Eric Helgeson

@nulleric<https://urldefense.proofpoint.com/v2/url?u=https-3A__twitter.com_nulleric&d=AAMFaQ&c=IV_clAzoPDE253xZdHuilRgztyh_RiV3wUrLrDQYWSI&r=xvOtI9Nu-R5ypeA-sLwc8t3rnAOaSBWWWWe1oP_-P9E&m=goad9GV3JpUaYrEoQ4Rbno3z8t1LU0dP7d33UXdasKI&s=a8rFPhDBVaVJgF2ihx1nUBV2YprxX03fsCj4f-PKoe8&e=>

On Wed, Aug 27, 2014 at 9:27 AM, Nathan L Smith < "> <mailto: "> >> wrote:
Bernie,

This is absolutely something we want to get done. It's on the Trello board here: https://trello.com/c/d2ZnGKn4/363-research-dig-into-how-a-supermarket-mirror-would-function<https://urldefense.proofpoint.com/v2/url?u=https-3A__trello.com_c_d2ZnGKn4_363-2Dresearch-2Ddig-2Dinto-2Dhow-2Da-2Dsupermarket-2Dmirror-2Dwould-2Dfunction&d=AAMFaQ&c=IV_clAzoPDE253xZdHuilRgztyh_RiV3wUrLrDQYWSI&r=xvOtI9Nu-R5ypeA-sLwc8t3rnAOaSBWWWWe1oP_-P9E&m=goad9GV3JpUaYrEoQ4Rbno3z8t1LU0dP7d33UXdasKI&s=oy_4eQS09sP-O5WUUGfrfeXx5TCPjULoVo2qci3sFX0&e=>, so please feel free to comment on this and ask questions and follow its progress.

Thanks

On Tue, Aug 26, 2014 at 5:16 PM, Durfee, Bernie (GE Global Research) < "> <mailto: "> >> wrote:
We’re heavily using community cookbooks, which is made difficult by our firewall. Specifically when a cookbook depends on other cookbooks that live inside and outside of our firewall. Ultimately, I want to be able to mirror the community cookbooks internally. Seems like an easy thing to script up, unless someone else has already done so or I’m missing some ‘mirroring’ functionality in Chef Server or Supermarket.

Anyone setup a mirror of the community Chef cookbooks?



--
Nathan L Smith

"> <mailto: "> >
(319) 339-0466