[chef] Re: Re: search result growth and issues

[Ian Kallen < >]

Yea, the chef project I worked on a few months ago (in the 0.6.x era) 
used the REST API for search to find different types of infrastructure 
and used those results to configure others. Ferret's duplicate docs 
forced me to dedupe in code (PITA). Additionally, I ran a periodic job 
that eviscerated and rebuilt the index. At the time, the only way to 
rebuild it was "converge everything" (that was the fujinese IIRC, in 
English: run chef-client on all of the  nodes). I don't know if it's 
related to doc versioning in couch or what but that ferret shite was 
really irritating. I would think that solr's faceted search is closer to 
what people want but I'm kinduv out of the chef loop ATM.

Joe Williams wrote:
> Anyone have experiences, suggestions, ideas?
>
> Thanks.
>
> -Joe
>
>
> On Wed, 9 Sep 2009 09:50:21 -0700
> Joe Williams 
> <
>  >
>  wrote:
>
>   
> > Over the weekend I experienced an issue where adding a search to the
> > rsyslog client cookbook rather than using a statically set rsyslog
> > server hostname (http://friendpaste.com/53XqkjYJllP7unEXsAiCnO) caused
> > a huge growth in bandwidth
> > (http://img245.yfrog.com/i/deployerifeth0day.png/) and load on my chef
> > server. I spoke with Adam and Barry on IRC regarding it and it was
> > deemed that it was likely something wonky with ferret causing the
> > indexes to grow, results appending to themselves iirc. By the time I
> > cleaned things out and switched back to my original code the index
> > size was 145277. 
> >
> > What I am interested in is figuring out if this is something unusual
> > with ferret and simply to do my set of circumstances or if this has
> > happened to others. Additionally if it's something that I am doing
> > wrong that caused the problem in the first place. I understand there
> > are changes coming to search but would like to know how to best use
> > the current system caveats and all.
> >
> > Advice, comments, suggestions are appreciated.
> >
> > Thanks.
> > -Joe
> >
> >
> >     
>
>
>   


--
Ian Kallen
blog: http://www.arachna.com/roller/spidaman
tweetz: http://twitter.com/spidaman
vox: 925.385.8426