Project

General

Profile

Actions

Bug #4831

closed

Reports cannot be inserted into postgresql due to a limit on ids

Added by Vincent MEMBRÉ almost 10 years ago. Updated almost 10 years ago.

Status:
Released
Priority:
1
Category:
Web - Compliance & node report
Target version:
Severity:
UX impact:
User visibility:
Effort required:
Priority:
Name check:
Fix check:
Regression:

Description

All our ids in reports database are based on integer which limits to 2147483647 the number of entries. That can be reached in a 18 month period for a ~250 node installation with around 50 rules, 2 or 3 directives by rules. So we need to use a 64 bits int to not hit that rather low limit.

Since it's a big change, we will not fix it in our stable version but in a latest one (2.10), and give workaound with manual validation for other version.

More precissely, we are going to:

  • Fix Scala code and database schema in 2.10.x (#4831)
    • So new installations will not have the problem anymore
    • That will have no impact on existing installation
  • Add two scripts (#4832):
    • One that will only warn the user that their table is still using int if it's the case, and pointing to possible workaround
    • One that should be ran manually to migrate the database

This scripts will be provided with Rudder 2.10.1, but for other people, we need to have information to guide them toward the workarounds:

  • Add an entry in the FAQ that will explain how to detect it, analyse it, fix the issue.

Note:

command used to get type of column:

psql -U rudder -h localhost -p 15432 -Atc "select data_type from information_schema.columns where table_name='archivedruddersysevents' and column_name='id';"


Subtasks 4 (0 open4 closed)

Bug #4832: Add migration script about table idsReleasedJonathan CLARKE2014-05-07Actions
Bug #4849: Add an entry in the FAQ about limit on idReleasedNicolas CHARLES2014-05-13Actions
Bug #4871: Migration SQL script to change the format of the ids from integer to bigintReleasedFrançois ARMAND2014-05-19Actions
Bug #4887: Reports cannot be inserted due to a limit on ids - change serial sizeRejectedNicolas CHARLES2014-05-23Actions

Related issues 3 (0 open3 closed)

Related to Rudder - Bug #4847: Reports cannot be inserted due to a limit on ids (branch 2.9)RejectedNicolas CHARLES2014-05-13Actions
Related to Rudder - Bug #5235: An error occurs during upgrade because variable OPT_RUDDER is missing in rudder-upgrade-database scriptReleasedJonathan CLARKE2014-07-07Actions
Related to Rudder - Bug #5125: Migration script 'rudder-upgrade-database' displays unwanted logsReleasedNicolas CHARLES2014-06-24Actions
Actions #1

Updated by Vincent MEMBRÉ almost 10 years ago

  • Status changed from New to Pending technical review
  • Assignee changed from Vincent MEMBRÉ to François ARMAND
  • Pull Request set to https://github.com/Normation/rudder/pull/510

PR here: https://github.com/Normation/rudder/pull/510

needs to make one for integration and 2 others for statusupdate on 2.9

Actions #2

Updated by Vincent MEMBRÉ almost 10 years ago

  • Assignee changed from François ARMAND to Nicolas CHARLES
Actions #3

Updated by Vincent MEMBRÉ almost 10 years ago

  • Status changed from Pending technical review to Pending release
  • % Done changed from 0 to 100
Actions #5

Updated by Nicolas CHARLES almost 10 years ago

  • Status changed from Pending release to Pending technical review
  • Assignee changed from Nicolas CHARLES to François ARMAND

Awesome, thank you !

Actions #6

Updated by François ARMAND almost 10 years ago

  • Status changed from Pending technical review to Pending release

The ticket was not closed automaticaly, but the commit message seems ok... Closing by hand, but we will have to verify that something is not broken in our scripts.

Actions #7

Updated by Vincent MEMBRÉ almost 10 years ago

It a bug when Nicolas edited the redmine after the validation of pull request (you can see the change in his comment)

Actions #8

Updated by Vincent MEMBRÉ almost 10 years ago

  • Description updated (diff)
  • Status changed from Pending release to New
  • Assignee changed from François ARMAND to Vincent MEMBRÉ
  • Target version changed from 2.6.13 to 2.10.1

We finally decided that this fix should not be done in our current stable version (2.6).

Since it was already merged, I reverted the commit in 47f9b451

I take back that issue and will fix it in 2.10

Actions #9

Updated by Vincent MEMBRÉ almost 10 years ago

  • Status changed from New to Pending technical review
  • Assignee changed from Vincent MEMBRÉ to François ARMAND
  • Pull Request changed from https://github.com/Normation/rudder/pull/510 to https://github.com/Normation/rudder/pull/514
Actions #10

Updated by François ARMAND almost 10 years ago

  • Description updated (diff)
Actions #11

Updated by Vincent MEMBRÉ almost 10 years ago

  • Status changed from Pending technical review to Pending release
  • % Done changed from 0 to 100
Actions #13

Updated by Vincent MEMBRÉ almost 10 years ago

  • Subject changed from Reports cannot be inserted due to a limit on ids to Reports cannot be inserted into postgresql due to a limit on ids
Actions #14

Updated by Vincent MEMBRÉ almost 10 years ago

  • Status changed from Pending release to Released

This bug has been fixed in Rudder 2.10.1, which was released today.
Check out:

Actions

Also available in: Atom PDF