Project

General

Profile

Actions

User story #8125

closed

Make eventlog migration faster (parallilised)

Added by François ARMAND about 8 years ago. Updated over 7 years ago.

Status:
Rejected
Priority:
4
Assignee:
-
Category:
Web - Maintenance
Target version:
UX impact:
Suggestion strength:
User visibility:
Effort required:
Name check:
Fix check:
Regression:

Description

Since #7524, eventlog migration are parallelized.

Now, the migration process is extremelly sequential, and could accelerated by processing several batch in parallel.

This require to take care of two questions (at least):

- about CPU and I/O load: do we want the migration to use more resource, perhaps impacting more soft real time action like user request
- about on the complexity of the migration process (today, it's dead simple. Here, the migration end is more complexe to assess, because parallel exec, and there is certainly many more things/

The need for that is not very hight, because:

- the migration is a one time event, now async,
- which only impact viewing old eventlogs until the migration ends
- migration file format didn't evolve between 3.0 and 3.2 (and it seems next release).


Related issues 1 (0 open1 closed)

Related to Rudder - Architecture #9202: Clean old fileFormat migration and fileFormat numbering policyReleasedVincent MEMBRÉ2016-10-03Actions
Actions #1

Updated by François ARMAND over 7 years ago

  • Status changed from New to Rejected

Actually, we most likelly don't care, because we most likelly won't migrate event log any further (cf #9202)

Actions #2

Updated by François ARMAND over 7 years ago

  • Related to Architecture #9202: Clean old fileFormat migration and fileFormat numbering policy added
Actions

Also available in: Atom PDF