[rudder-users] Database size seems too big

[Prestasit01]

Hello,

Thanks Francois. All weeks we delete reports from the web interface.

Script has been launched on each of our servers. Please find the information in our bug http://www.rudder-project.org/redmine/issues/4419

BR
Cedric

De : Francois Armand [mailto:francois.armand at normation.com]
Envoyé : vendredi 31 janvier 2014 10:52
À : Prestasit01; 'rudder-users at lists.rudder-project.org'
Cc : 'Nicolas Charles'
Objet : Re: [rudder-users] Database size seems too big

On 30/01/2014 10:07, Prestasit01 wrote:
Hello,

Time to access to the « configuration policy » page takes too much time (few minutes).

Hello,

That's really bad, and was a known problem of Rudder <= 2.6. A lot of effort was done in Rudder 2.7 and latters to reduce that time, and duration should be far less with more recent Rudder version.



[...]
81G     16385
4,0K    pgsql_tmp

I think that it’s not « normal », have you already found a similar issue ?



You can configure the time reports are retain in the DB. Information are provided in Administration -> Reports Database (where you can also clean reports older than a given number of days manually, to gain back space).

You can configure retention time in /opt/rudder/etc/rudder-web.properties with
"rudder.batch.reportscleaner.archive.TTL" and "rudder.batch.reportscleaner.delete.TTL".

Diminishing the TTL means that you won't be able to look for past report messages older than the TTL. Some use find that keeping only a couple of days is sufficient, others prefer to be able to do postmortem analysis even in several weeks old events.

On a related note, could you please run that script on the Rudder server ?

https://github.com/fanf/rudder-tools/blob/rudder_server_metric_reporting_script/scripts/rudder_metrics_reporting.sh

That will help us understand the cause of your problem.

Thanks,

--
________________________________

[cid:image002.png at 01CF1E96.D788D3F0]François ARMAND
Directeur de la R&D
Normation<http://www.normation.com>

________________________________

87 rue de Turbigo, 75003 Paris, France

Telephone:

+33 (0)1 83 62 99 23

Mobile:

+33 (0)6 63 37 60 55

________________________________



-------------------------------------------------------------------------<br>
Les informations ou pieces jointes contenues dans ce message sont
confidentielles. Seul le destinataire expressement vise peut en prendre
connaissance. Toute autre personne qui en divulguera, diffusera ou prendra des copies sera passible de poursuites. La societe Ouest-France decline en outre, toute responsabilite de quelque nature que ce soit au titre de ce message s'il a ete altere, deforme ou falsifie.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.rudder-project.org/pipermail/rudder-users/attachments/20140131/ac9d01f6/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 3503 bytes
Desc: image001.png
URL: <http://www.rudder-project.org/pipermail/rudder-users/attachments/20140131/ac9d01f6/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.png
Type: image/png
Size: 4103 bytes
Desc: image002.png
URL: <http://www.rudder-project.org/pipermail/rudder-users/attachments/20140131/ac9d01f6/attachment-0003.png>