Project

General

Profile

Actions

Bug #4735

closed

Postgresql (8.3, on SLES11) database grows apparently without limits (9.1 too?)

Added by Nicolas CHARLES about 10 years ago. Updated over 7 years ago.

Status:
Rejected
Priority:
N/A
Assignee:
-
Category:
System integration
Target version:
Severity:
UX impact:
User visibility:
Effort required:
Priority:
Name check:
Fix check:
Regression:

Description

On Postgresql 8.3 (the versio of SLES11), the database seems to be always growing, without means to constraint it.

It appears the indexes are the culprit (for a 38 GB table, there are 20 GB extra indexes), as they bloat very fast.
bloating is caused by deletion of rows (which we do often), and vacuum full (which we don't do)

Apparently, there need to be specific tuning in the vacuum strategy on 8.3 to prevent bloating ( see http://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=11&ved=0CCcQFjAAOAo&url=http%3A%2F%2Fwww.nws.noaa.gov%2Foh%2Fhrl%2Fhseb%2FpostgreSQL%2FVACUUM.pdf&ei=QGs-U8aVDc_y7AbAtYCwDQ&usg=AFQjCNEOsYpQ3a5rbSi7CIkbxGf4WvsFNw&sig2=bRCkHteUw0MslhatY2mvug&bvm=bv.64125504,d.ZGU&cad=rja ), with the general recommendation to upgrade to 8.4, as it is more easy

Bloat can be mesured with the following script:
http://wiki.postgresql.org/wiki/Show_database_bloat

An easy step can be to reindex the index, to clean them.

More info can also be found here:
http://gkoenig.wordpress.com/2009/11/24/postgres-and-bloated-table/
http://www.postgresql.org/docs/8.3/static/routine-vacuuming.html

It seems version 9.x are completely safe of this problem, and 8.4 suffers from it, but to a much lesser extent

It seem that we have the same behavior with postgresql 9.1
We have seen 25GB of index for 66GB of data on postgresql 9.1

Actions #1

Updated by Vincent MEMBRÉ about 10 years ago

  • Subject changed from Postgresql database grows apparently without limits to Postgresql (8.3, on SLES11) database grows apparently without limits
Actions #3

Updated by Vincent MEMBRÉ almost 10 years ago

  • Target version changed from 2.6.13 to 2.6.14
Actions #4

Updated by Jonathan CLARKE almost 10 years ago

  • Target version changed from 2.6.14 to 2.6.16
Actions #5

Updated by Jonathan CLARKE almost 10 years ago

  • Target version changed from 2.6.16 to 2.6.17
Actions #6

Updated by Nicolas PERRON over 9 years ago

  • Target version changed from 2.6.17 to 2.6.18
Actions #7

Updated by Benoît PECCATTE over 9 years ago

  • Subject changed from Postgresql (8.3, on SLES11) database grows apparently without limits to Postgresql (8.3, on SLES11) database grows apparently without limits (9.1 too?)
  • Description updated (diff)

It seem that we have the same behavior with postgresql 9.1
We have seen 25GB of index for 66GB of data on postgresql 9.1

Actions #8

Updated by Matthieu CERDA over 9 years ago

  • Target version changed from 2.6.18 to 2.6.19
Actions #9

Updated by Vincent MEMBRÉ over 9 years ago

  • Target version changed from 2.6.19 to 2.6.20
Actions #10

Updated by François ARMAND about 9 years ago

  • Target version changed from 2.6.20 to 2.10.10
Actions #11

Updated by Vincent MEMBRÉ about 9 years ago

  • Target version changed from 2.10.10 to 2.10.11
Actions #12

Updated by Vincent MEMBRÉ about 9 years ago

  • Target version changed from 2.10.11 to 2.10.12
Actions #13

Updated by Vincent MEMBRÉ about 9 years ago

  • Target version changed from 2.10.12 to 2.10.13
Actions #14

Updated by Vincent MEMBRÉ about 9 years ago

  • Target version changed from 2.10.13 to 2.10.14
Actions #15

Updated by Vincent MEMBRÉ almost 9 years ago

  • Target version changed from 2.10.14 to 2.10.15
Actions #16

Updated by Vincent MEMBRÉ almost 9 years ago

  • Target version changed from 2.10.15 to 2.10.16
Actions #17

Updated by Vincent MEMBRÉ over 8 years ago

  • Target version changed from 2.10.16 to 2.10.17
Actions #18

Updated by Vincent MEMBRÉ over 8 years ago

  • Target version changed from 2.10.17 to 2.10.18
Actions #19

Updated by Vincent MEMBRÉ over 8 years ago

  • Target version changed from 2.10.18 to 2.10.19
Actions #20

Updated by Vincent MEMBRÉ over 8 years ago

  • Target version changed from 2.10.19 to 2.10.20
Actions #21

Updated by Vincent MEMBRÉ over 8 years ago

  • Target version changed from 2.10.20 to 277
Actions #22

Updated by Vincent MEMBRÉ over 8 years ago

  • Target version changed from 277 to 2.11.18
Actions #23

Updated by Vincent MEMBRÉ about 8 years ago

  • Target version changed from 2.11.18 to 2.11.19
Actions #24

Updated by Vincent MEMBRÉ about 8 years ago

  • Target version changed from 2.11.19 to 2.11.20
Actions #25

Updated by Vincent MEMBRÉ about 8 years ago

  • Target version changed from 2.11.20 to 2.11.21
Actions #26

Updated by Vincent MEMBRÉ almost 8 years ago

  • Target version changed from 2.11.21 to 2.11.22
Actions #27

Updated by Vincent MEMBRÉ almost 8 years ago

  • Target version changed from 2.11.22 to 2.11.23
Actions #28

Updated by Vincent MEMBRÉ over 7 years ago

  • Target version changed from 2.11.23 to 2.11.24
Actions #29

Updated by Vincent MEMBRÉ over 7 years ago

  • Target version changed from 2.11.24 to 308
Actions #30

Updated by Vincent MEMBRÉ over 7 years ago

  • Target version changed from 308 to 3.1.14
Actions #31

Updated by Vincent MEMBRÉ over 7 years ago

  • Target version changed from 3.1.14 to 3.1.15
Actions #32

Updated by Vincent MEMBRÉ over 7 years ago

  • Target version changed from 3.1.15 to 3.1.16
Actions #33

Updated by Vincent MEMBRÉ over 7 years ago

  • Target version changed from 3.1.16 to 3.1.17
Actions #34

Updated by François ARMAND over 7 years ago

  • Status changed from New to Rejected

This version of Postgres isn't supported since before Rudder 2.11, which isn't supported anymore either. Closing this ticket because it doesn't happen with a more revent version of Postgres.

Actions

Also available in: Atom PDF