[rudder-users] Agent and No answer status

[Vincent Membré]

Hello Cédric,

Thanks for reporting your error!

Le 22/05/2014 12:44, Prestasit01 a écrit :
>
> *Hi all,*
>
> **
>
> *I found that some of my agents are now seen as « NEVER SEEN » in the 
> root-server and all applicated rules on them are in status « No answer ».*
>
> **
>
> *It seems to be due to our mountpoint : tmpfs on 
> /var/rudder/cfengine-community/state type tmpfs 
> (rw,noexec,nosuid,noatime,nodiratime,size=128M,nr_inodes=2k,mode=0755)*
>
> */NB : This was configured like this to reduce the i/o./*
>
> **
>
> *This « space » came full and the agent turn crazy.*
>
> **
>
> *I have a workaround, on nodes => killall --s 9 cf-agent , umount the 
> point, remount it and restart the rudder agent*
>
> **
>
> *Have you got another solution ? is that still usefull to have this 
> mountpoint ?*
>


I think this might be linked to cf_lock.tcdb file size: 
https://www.rudder-project.org/redmine/issues/4769

This file grow bigger and bigger with time, impacting the performance of 
cf-agent.

When your tmpfs got full, cf-agent cannot run anymore.

This bug has less impact on CFEngine 3.4, so we only fixed it in 2.9 
(using CFEngine 3.5).

To resolve your problem, you can wipe that file regularly using a Cron ( 
/etc/cron.d/clean-rudder-locks)

*/5 * * * * root if [ `ls -l /var/rudder/cfengine-community/state/cf_lock.tcdb | cut -f 5 -d " "` -gt "10485760" ]; then rm -rf /var/rudder/cfengine-community/state/cf_lock.tcdb*; fi


I suggest to share that to your nodes using a 'copy from shared folder' 
Directive, (or a 'cron management' / 'Job Scheduler' ).

Next releases (2.9.5 and 2.10.1, will contain the fix)


> **
>
> **
>
> *Thanks for the answer.*
>
> **
>
> *Cedric*
>
> **
>
> *Rudder-Root : 2.6.12*
>
> *Rudder-Agent : 2.6.12*
>
> **
>
> -------------------------------------------------------------------------
> Les informations ou pieces jointes contenues dans ce message sont 
> confidentielles. Seul le destinataire expressement vise peut en 
> prendre connaissance. Toute autre personne qui en divulguera, 
> diffusera ou prendra des copies sera passible de poursuites. La 
> societe Ouest-France decline en outre, toute responsabilite de quelque 
> nature que ce soit au titre de ce message s'il a ete altere, deforme 
> ou falsifie.
>
>
> _______________________________________________
> rudder-users mailing list
> rudder-users at lists.rudder-project.org
> http://www.rudder-project.org/mailman/listinfo/rudder-users


-- 
------------------------------------------------------------------------
*Vincent Membré*
/Ingénieur R&D/
Normation <http://www.normation.com>
------------------------------------------------------------------------
*87 rue de Turbigo, 75003 Paris, France*
Telephone: 	+33 (0)1 84 16 06 00
Mobile: 	+33 (0)6 10 14 76 78
------------------------------------------------------------------------

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.rudder-project.org/pipermail/rudder-users/attachments/20140522/0fc8829f/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: logo-square.png
Type: image/png
Size: 3503 bytes
Desc: not available
URL: <http://www.rudder-project.org/pipermail/rudder-users/attachments/20140522/0fc8829f/attachment-0001.png>