[chef] Re: "Cluster" Management


Chronological Thread 
  • From: Ranjib Dey < >
  • To: " " < >
  • Subject: [chef] Re: "Cluster" Management
  • Date: Thu, 10 Apr 2014 09:47:43 -0700

how you are doing deployment? db:* tasks should be triggered via the same tool. if its chef (using the deploy resource) then yeah, search, sort and use a particular node (as you have mentioned , first node) to trigger the db:* tasks. Following are the things you have to ensure:
0) remember to sort the search results. :-)
1) the first node converges first (tune chef run cron times)
2) other app instances should not invoke deploy resource if the first app node's convergence /deploy resource failed (set an attribute [e.g. last_migration = revision] to detect this).

this is definitely a yak shaving, but it works if your setup is smaller. 
etcd, zookeeper is better way to attain this. As dan has already mentioned, the same scenario is also used for HA, and called as leader election... but here i'll just say a singleton task (leaders generally used in master-slave setups, here all app nodes are similar).
with zk you have to do some more yak shaving on the client side, while with etcd mod_leader, and mod_lock is part of the core, thus its bit easier to use.

btw, rails db migrations are idempotent, so, it should not matter even if you run it from multiple hosts,

p.s. there are zk handler (though i am not sure report handlers are best here), and etcd bindings for chef. You can use them along with the new even handler system to do this cleanly
cheers
ranjib


On Thu, Apr 10, 2014 at 8:47 AM, Stewart, Curtis < " target="_blank"> > wrote:
We’re running a deployment of 3 rails app servers, and we only need one to run the database setup.

What’s the best solution for allowing Chef to determine which app should run the db:setup?

Is it safe to run a search for ‘role:app’, then only run db:setup if current node is first node?  We can even sort the search response to make sure it’s always the same ordered response.

I’d love to hear your suggestions!

Thanks,
Curtis




Archive powered by MHonArc 2.6.16.

§