Project

General

Profile

Actions
Copy link

Bug #9179

closed

Error when restarting rudder-agent during upgrade

Added by Alexis Mousset over 7 years ago. Updated over 6 years ago.

Status:
Rejected
Priority:
N/A
Assignee:
-
Category:
Packaging
Target version:
3.1.25
Pull Request:
Severity:
Minor - inconvenience | misleading | easy workaround
UX impact:
User visibility:
Operational - other Techniques | Technique editor | Rudder settings
Effort required:
Priority:
27
Name check:
Fix check:
Regression:

Description

From 3.1.10 to 3.1.14.

Making sure that the permissions on the CFEngine key directory are correct...
rudder-agent[9703]: [INFO] Using /etc/default/rudder-agent for configuration
rudder-agent[9706]: [INFO] Using /var/rudder/cfengine-community for CFEngine workdir
rudder-agent[9707]: [INFO] Halting CFEngine Community cf-serverd...
rudder-agent[9711]: [OK] CFEngine Community cf-serverd stopped after 2 seconds
rudder-agent[9712]: [INFO] Halting CFEngine Community cf-execd...
rudder-agent[9718]: [OK] CFEngine Community cf-execd stopped after 2 seconds
CFEngine binaries copied to workdir
rudder-agent[10300]: [INFO] Using /etc/default/rudder-agent for configuration
rudder-agent[10306]: [INFO] Using /var/rudder/cfengine-community for CFEngine workdir
rudder-agent[10308]: [INFO] Launching CFEngine Community cf-serverd...
2016-09-29T10:25:21+0200    error: Can't stat file '/var/rudder/cfengine-community/inputs/10_ncf_internals/configuration.cf' for parsing. (stat: No such file or directory)
rudder-agent[10747]: [ALERT] no PID file for cf-serverd after 30 seconds. Trying again...
2016-09-29T10:25:52+0200    error: Can't stat file '/var/rudder/cfengine-community/inputs/10_ncf_internals/configuration.cf' for parsing. (stat: No such file or directory)
rudder-agent[11013]: [ALERT] no PID file for cf-serverd after 60 seconds. Trying again...
2016-09-29T10:26:22+0200    error: Can't stat file '/var/rudder/cfengine-community/inputs/10_ncf_internals/configuration.cf' for parsing. (stat: No such file or directory)
rudder-agent[11199]: [ALERT] no PID file for cf-serverd after 70 seconds
rudder-agent[11200]: [INFO] Launching CFEngine Community cf-execd...
2016-09-29T10:26:33+0200    error: Can't stat file '/var/rudder/cfengine-community/inputs/10_ncf_internals/configuration.cf' for parsing. (stat: No such file or directory)
rudder-agent[11463]: [ALERT] no PID file for cf-execd after 30 seconds. Trying again...
2016-09-29T10:27:04+0200    error: Can't stat file '/var/rudder/cfengine-community/inputs/10_ncf_internals/configuration.cf' for parsing. (stat: No such file or directory)
rudder-agent[11728]: [ALERT] no PID file for cf-execd after 60 seconds. Trying again...
2016-09-29T10:27:35+0200    error: Can't stat file '/var/rudder/cfengine-community/inputs/10_ncf_internals/configuration.cf' for parsing. (stat: No such file or directory)
rudder-agent[11913]: [ALERT] no PID file for cf-execd after 70 seconds
INFO: Scheduling an inventory during next run...

Related issues 1 (0 open — 1 closed)

Is duplicate of Rudder - Architecture #9207: Transient policy error after upgrade, need to improve handling of policies update during server upgrade (rudder-upgrade vs. ncf vs. rudder-techniques)ResolvedActions
Actions
Copy link
 #1

Updated by Alexis Mousset over 7 years ago

Complete install logs (sles11):


Installing: ncf-1398866025:0.201609282330-1.SLES.11 [done]
Installing: rudder-jetty-1398866025:3.1.14.release-1.SLES.11 [done]
Installing: rudder-reports-1398866025:3.1.14.release-1.SLES.11 [done]
Additional rpm output:
INFO: Setting PostgreSQL as a boot service... Done
INFO: Waiting for PostgreSQL to be up... Done

Installing: rudder-agent-1398866025:3.1.14.release-1.SLES.11 [done]
Additional rpm output:
INFO: A back up copy of /etc/init.d/rudder-agent has been created in /var/backups/rudder
INFO: A back up copy of /etc/default/rudder-agent has been created in /var/backups/rudder
INFO: A back up copy of /etc/cron.d/rudder-agent has been created in /var/backups/rudder
Making sure that the permissions on the CFEngine key directory are correct...
rudder-agent[9703]: [INFO] Using /etc/default/rudder-agent for configuration
rudder-agent[9706]: [INFO] Using /var/rudder/cfengine-community for CFEngine workdir
rudder-agent[9707]: [INFO] Halting CFEngine Community cf-serverd...
rudder-agent[9711]: [OK] CFEngine Community cf-serverd stopped after 2 seconds
rudder-agent[9712]: [INFO] Halting CFEngine Community cf-execd...
rudder-agent[9718]: [OK] CFEngine Community cf-execd stopped after 2 seconds
CFEngine binaries copied to workdir
rudder-agent[10300]: [INFO] Using /etc/default/rudder-agent for configuration
rudder-agent[10306]: [INFO] Using /var/rudder/cfengine-community for CFEngine workdir
rudder-agent[10308]: [INFO] Launching CFEngine Community cf-serverd...
2016-09-29T10:25:21+0200    error: Can't stat file '/var/rudder/cfengine-community/inputs/10_ncf_internals/configuration.cf' for parsing. (stat: No such file or directory)
rudder-agent[10747]: [ALERT] no PID file for cf-serverd after 30 seconds. Trying again...
2016-09-29T10:25:52+0200    error: Can't stat file '/var/rudder/cfengine-community/inputs/10_ncf_internals/configuration.cf' for parsing. (stat: No such file or directory)
rudder-agent[11013]: [ALERT] no PID file for cf-serverd after 60 seconds. Trying again...
2016-09-29T10:26:22+0200    error: Can't stat file '/var/rudder/cfengine-community/inputs/10_ncf_internals/configuration.cf' for parsing. (stat: No such file or directory)
rudder-agent[11199]: [ALERT] no PID file for cf-serverd after 70 seconds
rudder-agent[11200]: [INFO] Launching CFEngine Community cf-execd...
2016-09-29T10:26:33+0200    error: Can't stat file '/var/rudder/cfengine-community/inputs/10_ncf_internals/configuration.cf' for parsing. (stat: No such file or directory)
rudder-agent[11463]: [ALERT] no PID file for cf-execd after 30 seconds. Trying again...
2016-09-29T10:27:04+0200    error: Can't stat file '/var/rudder/cfengine-community/inputs/10_ncf_internals/configuration.cf' for parsing. (stat: No such file or directory)
rudder-agent[11728]: [ALERT] no PID file for cf-execd after 60 seconds. Trying again...
2016-09-29T10:27:35+0200    error: Can't stat file '/var/rudder/cfengine-community/inputs/10_ncf_internals/configuration.cf' for parsing. (stat: No such file or directory)
rudder-agent[11913]: [ALERT] no PID file for cf-execd after 70 seconds
INFO: Scheduling an inventory during next run...
INFO: A back up copy of the /opt/rudder/etc/uuid.hive has been created in /var/backups/rudder
INFO: A back up copy of the /var/rudder/cfengine-community/policy_server.dat has been created in /var/backups/rudder
INFO: A back up copy of the /var/cfengine/policy_server.dat has been created in /var/backups/rudder
INFO: A back up copy of the /var/rudder/cfengine-community/ppkeys has been created in /var/backups/rudder

Installing: rudder-inventory-ldap-1398866025:3.1.14.release-1.SLES.11 [done]
Additional rpm output:
INFO: Setting rudder-slapd as a boot service... Done
INFO: Reloading syslogd...  Done
INFO: Stopping rudder-slapd... Done
INFO: Starting rudder-slapd... Done
INFO: OpenLDAP database was successfully upgraded to new format
INFO: You can safely remove the backups in /var/rudder/ldap/openldap-data-backup-upgrade-on-20160929102745/
INFO: and /var/rudder/ldap/backup/openldap-data-pre-upgrade-20160929102745.ldif
INFO: Restarting rudder-slapd... Done

Installing: rudder-techniques-1398866025:3.1.14.release-1.SLES.11 [done]
Installing: ncf-api-virtualenv-1398866025:3.1.14.release-1.SLES.11 [done]
Additional rpm output:
warning: group ncf-api-venv does not exist - using root
INFO: Restarting Apache HTTPd... Done

Installing: rudder-inventory-endpoint-1398866025:3.1.14.release-1.SLES.11 [done]
Additional rpm output:
INFO: Launching script to check if a migration is needed
INFO: End of migration script
INFO: Restarting syslogd ... Done

Installing: rudder-webapp-1398866025:3.1.14.release-1.SLES.11 [done]
Additional rpm output:
warning: /opt/rudder/etc/rudder-passwords.conf created as /opt/rudder/etc/rudder-passwords.conf.rpmnew
warning: /opt/rudder/etc/rudder-web.properties created as /opt/rudder/etc/rudder-web.properties.rpmnew
INFO: Setting Apache HTTPd as a boot service... Done
INFO: Restarting syslog... Done
INFO: Stopping Apache HTTPd... Done
INFO: Starting Apache HTTPd... Done
INFO: Launching script to check if a migration is needed
INFO: Checking if rudder-web.properties database access credentials are all right... LDAP OK,  SQL OK
INFO: Checking if inventory-web.properties database access credentials are all right... LDAP OK,  SQL skipped
INFO: A Technique library reload is needed and has been scheduled.
INFO: Checking PostgreSQL service status... OK
INFO: Checking LDAP service status... OK
INFO: Adding 'api_compatibility_mode' property... Done.
INFO: Disabling 'global quicksearch' feature...adding new entry "propertyName=rudder_featureSwitch_quicksearchEverything,ou=Application Properties,cn=rudder-configuration" 

 Done.
INFO: Disabling 'json node properties' feature...adding new entry "propertyName=rudder_featureSwitch_directiveNodeProperties,ou=Application Properties,cn=rudder-configuration" 

 Done.
INFO: Disabling 'javascript script engine' feature...adding new entry "propertyName=rudder_featureSwitch_directiveScriptEngine,ou=Application Properties,cn=rudder-configuration" 

 Done.

INFO: The migration has completed successfully.
INFO: End of migration script
********************************************************************************
rudder-webapp has been upgraded, but for the upgrade to take effect, please
restart the jetty application server as follows:
# service rudder-jetty restart
********************************************************************************

Actions
Copy link
 #2

Updated by Nicolas CHARLES over 7 years ago

happens also on centos6

Transaction de test réussie
Lancement de la transaction
  Mise à jour   : 1398866025:rudder-jetty-3.1.14.rc1.git201609280248-1.EL.6.noarch                                                                                                                                                       1/20 
  Mise à jour   : 1398866025:ncf-0.201609280248-1.EL.6.noarch                                                                                                                                                                            2/20 
  Mise à jour   : 1398866025:rudder-inventory-ldap-3.1.14.rc1.git201609280248-1.EL.6.x86_64                                                                                                                                              3/20 
INFO: Setting rudder-slapd as a boot service... Done
INFO: Reloading syslogd...  Done
INFO: Stopping rudder-slapd... Done
INFO: Starting rudder-slapd... Done
INFO: OpenLDAP database was successfully upgraded to new format
INFO: You can safely remove the backups in /var/rudder/ldap/openldap-data-backup-upgrade-on-20160929084535/
INFO: and /var/rudder/ldap/backup/openldap-data-pre-upgrade-20160929084535.ldif
INFO: Restarting rudder-slapd... Done
  Mise à jour   : 1398866025:rudder-inventory-endpoint-3.1.14.rc1.git201609280248-1.EL.6.noarch                                                                                                                                          4/20 
INFO: Launching script to check if a migration is needed
INFO: End of migration script
INFO: Restarting syslogd ... Done
  Mise à jour   : 1398866025:rudder-techniques-3.1.14.rc1.git201609280248-1.EL.6.noarch                                                                                                                                                  5/20 
  Mise à jour   : 1398866025:ncf-api-virtualenv-3.1.14.rc1.git201609280248-1.EL.6.noarch                                                                                                                                                 6/20 
INFO: Applying ncf-api-virtualenv selinux policy... Done
  Mise à jour   : 1398866025:rudder-webapp-3.1.14.rc1.git201609280248-1.EL.6.noarch                                                                                                                                                      7/20 
warning: /opt/rudder/etc/rudder-passwords.conf created as /opt/rudder/etc/rudder-passwords.conf.rpmnew
warning: /opt/rudder/etc/rudder-web.properties created as /opt/rudder/etc/rudder-web.properties.rpmnew
INFO: Setting Apache HTTPd as a boot service... Done
INFO: Restarting syslog... Done
INFO: Stopping Apache HTTPd... Done
INFO: Starting Apache HTTPd... Done
INFO: Launching script to check if a migration is needed
INFO: Checking if rudder-web.properties database access credentials are all right... LDAP OK,  SQL OK
INFO: Checking if inventory-web.properties database access credentials are all right... LDAP OK,  SQL skipped
INFO: A Technique library reload is needed and has been scheduled.
INFO: Checking PostgreSQL service status... OK
WARNING: Your PostgreSQL version, 8.4, is getting old and will not offer optimal performance with Rudder 3.0+.
WARNING: Please upgrade to at least 9.1.
INFO: Checking LDAP service status... OK
INFO: Adding 'api_compatibility_mode' property... Done.

INFO: The migration has completed successfully.
INFO: End of migration script
********************************************************************************
rudder-webapp has been upgraded, but for the upgrade to take effect, please
restart the jetty application server as follows:
# service rudder-jetty restart
********************************************************************************
  Mise à jour   : 1398866025:rudder-agent-3.1.14.rc1.git201609280248-1.EL.6.x86_64                                                                                                                                                       8/20 
INFO: A back up copy of /etc/init.d/rudder-agent has been created in /var/backups/rudder
INFO: A back up copy of /etc/default/rudder-agent has been created in /var/backups/rudder
INFO: A back up copy of /etc/cron.d/rudder-agent has been created in /var/backups/rudder
Making sure that the permissions on the CFEngine key directory are correct...
rudder-agent[30316]: [INFO] Using /etc/default/rudder-agent for configuration
rudder-agent[30319]: [INFO] Using /var/rudder/cfengine-community for CFEngine workdir
rudder-agent[30320]: [INFO] Halting CFEngine Community cf-serverd...
rudder-agent[30324]: [OK] CFEngine Community cf-serverd stopped after 2 seconds
rudder-agent[30325]: [INFO] Halting CFEngine Community cf-execd...
rudder-agent[30330]: [OK] CFEngine Community cf-execd stopped after 2 seconds
CFEngine binaries copied to workdir
rudder-agent[30505]: [INFO] Using /etc/default/rudder-agent for configuration
rudder-agent[30508]: [INFO] Using /var/rudder/cfengine-community for CFEngine workdir
rudder-agent[30509]: [INFO] Launching CFEngine Community cf-serverd...
2016-09-29T08:46:58+0000    error: Can't stat file '/var/rudder/cfengine-community/inputs/10_ncf_internals/configuration.cf' for parsing. (stat: No such file or directory)
2016-09-29T08:46:58+0000    error: Policy failed validation with command '"/var/rudder/cfengine-community/bin/cf-promises" -c "/var/rudder/cfengine-community/inputs/promises.cf"'
2016-09-29T08:46:58+0000    error: CFEngine was not able to get confirmation of promises from cf-promises, so going to failsafe
rudder-agent[30656]: [OK] CFEngine Community cf-serverd started after 1 seconds
rudder-agent[30657]: [INFO] Launching CFEngine Community cf-execd...
2016-09-29T08:47:00+0000    error: Can't stat file '/var/rudder/cfengine-community/inputs/10_ncf_internals/configuration.cf' for parsing. (stat: No such file or directory)
2016-09-29T08:47:00+0000    error: Policy failed validation with command '"/var/rudder/cfengine-community/bin/cf-promises" -c "/var/rudder/cfengine-community/inputs/promises.cf"'
2016-09-29T08:47:00+0000    error: CFEngine was not able to get confirmation of promises from cf-promises, so going to failsafe
rudder-agent[30805]: [OK] CFEngine Community cf-execd started after 1 seconds
INFO: Scheduling an inventory during next run...
  Mise à jour   : 1398866025:rudder-reports-3.1.14.rc1.git201609280248-1.EL.6.noarch                                                                                                                                                     9/20 
INFO: Setting PostgreSQL as a boot service... Done
INFO: Waiting for PostgreSQL to be up... Done
  Mise à jour   : 1398866025:rudder-server-root-3.1.14.rc1.git201609280248-1.EL.6.noarch                                                                                                                                                10/20 
  Nettoyage     : 1398866025:rudder-server-root-3.1.10.release-1.EL.6.noarch                                                                                                                                                            11/20 
  Nettoyage     : 1398866025:rudder-webapp-3.1.10.release-1.EL.6.noarch                                                                                                                                                                 12/20 
  Nettoyage     : 1398866025:rudder-inventory-endpoint-3.1.10.release-1.EL.6.noarch                                                                                                                                                     13/20 
  Nettoyage     : 1398866025:ncf-api-virtualenv-3.1.10.release-1.EL.6.noarch                                                                                                                                                            14/20 
  Nettoyage     : 1398866025:rudder-techniques-3.1.10.release-1.EL.6.noarch                                                                                                                                                             15/20 
  Nettoyage     : 1398866025:ncf-0.201605270344-1.EL.6.noarch                                                                                                                                                                           16/20 
  Nettoyage     : 1398866025:rudder-jetty-3.1.10.release-1.EL.6.noarch                                                                                                                                                                  17/20 
  Nettoyage     : 1398866025:rudder-agent-3.1.10.release-1.EL.6.x86_64                                                                                                                                                                  18/20 
INFO: A back up copy of the /opt/rudder/etc/uuid.hive has been created in /var/backups/rudder
INFO: A back up copy of the /var/rudder/cfengine-community/policy_server.dat has been created in /var/backups/rudder
INFO: A back up copy of the /var/cfengine/policy_server.dat has been created in /var/backups/rudder
INFO: A back up copy of the /var/rudder/cfengine-community/ppkeys has been created in /var/backups/rudder

Actions
Copy link
 #3

Updated by Vincent MEMBRÉ over 7 years ago

  • Target version changed from 3.1.15 to 3.1.16
Actions
Copy link
 #4

Updated by Vincent MEMBRÉ over 7 years ago

  • Target version changed from 3.1.16 to 3.1.17
Actions
Copy link
 #5

Updated by Vincent MEMBRÉ over 7 years ago

  • Target version changed from 3.1.17 to 3.1.18
Actions
Copy link
 #6

Updated by Vincent MEMBRÉ about 7 years ago

  • Target version changed from 3.1.18 to 3.1.19
Actions
Copy link
 #7

Updated by Benoît PECCATTE about 7 years ago

  • Severity set to Minor - inconvenience | misleading | easy workaround
  • User visibility set to Operational - other Techniques | Technique editor | Rudder settings
  • Priority set to 16
Actions
Copy link
 #8

Updated by Benoît PECCATTE about 7 years ago

  • Priority changed from 16 to 15
Actions
Copy link
 #9

Updated by Vincent MEMBRÉ about 7 years ago

  • Target version changed from 3.1.19 to 3.1.20
Actions
Copy link
 #10

Updated by Vincent MEMBRÉ almost 7 years ago

  • Target version changed from 3.1.20 to 3.1.21
Actions
Copy link
 #11

Updated by Vincent MEMBRÉ almost 7 years ago

  • Target version changed from 3.1.21 to 3.1.22
Actions
Copy link
 #12

Updated by Benoît PECCATTE almost 7 years ago

  • Priority changed from 15 to 28
Actions
Copy link
 #13

Updated by Vincent MEMBRÉ over 6 years ago

  • Target version changed from 3.1.22 to 3.1.23
Actions
Copy link
 #14

Updated by Vincent MEMBRÉ over 6 years ago

  • Target version changed from 3.1.23 to 3.1.24
  • Priority changed from 28 to 27
Actions
Copy link
 #15

Updated by Vincent MEMBRÉ over 6 years ago

  • Target version changed from 3.1.24 to 3.1.25
Actions
Copy link
 #16

Updated by Vincent MEMBRÉ over 6 years ago

  • Target version changed from 3.1.25 to 387
Actions
Copy link
 #17

Updated by Alexis Mousset over 6 years ago

  • Is duplicate of Architecture #9207: Transient policy error after upgrade, need to improve handling of policies update during server upgrade (rudder-upgrade vs. ncf vs. rudder-techniques) added
Actions
Copy link
 #18

Updated by Alexis Mousset over 6 years ago

  • Status changed from New to Rejected

Another kind of the #9207 class of bugs, closing as it is 3.1-specific.

Actions
Copy link
 #19

Updated by Vincent MEMBRÉ over 6 years ago

  • Target version changed from 387 to 3.1.25
Actions
Copy link

Also available in: Atom PDF