Monday 11 February 2008

[AT RISK 2008/002] February 11th 2008 - emergency kernel upgrade

Maintenance log for February 8th 2008
Attending: dwm
Status: Completed at 1405hrs GMT
Summary:
  • Tastycake.net server kalimdor.tastycake.net being rebooted (at least once) at approximately 1200noon GMT for an emergency kernel upgrade.
  • New kernel needed to patch local root escalation vulnerabilities (CVE-2008-0009, CVE-2008-0010).
  • No Tastycake.net services will be available whilst reboots are occurring.
  • Works to be carried out:
    • Build new linux kernel (2.6.24.2) to replace existing build (2.6.24). (Complete)
    • Install new kernel and set as default. (Complete)
    • Reboot machine to start using new kernel. (Complete)
Transcript:
  • [1405] All tests clear, at-risk period concluded.
  • [1400] Machine rebooted successfully into new kernel. Running final checks..
  • [1357] Machine rebooted.
  • [1353] Believed that I have corrected the booting problem (missing /dev/md0 entry in /etc/mdadm/mdadm.conf) and rebooting again. (Again, with 1-minute grace.)
  • [1347] Successfully rebooted using original kernel; will be fixing raid-auto start, then rebooting again.
  • [1334] Backup kernel not functioning; appears to not be auto-starting /dev/md0; will need to configure manually. This may take a few minutes..
  • [1331] Failed to boot using new kernel, power-cycled via power-switch interface.
  • [1328] Machine reboot.
  • [1326] Reboot triggered with 1-minute grace delay.
  • [1320] New kernel installed, ready to reboot. Warning sent via wall to all logged-in users.
  • [1313] Updated kernel package built, installed in Tastycake package repository.
  • [1107] Initial update of maintenance log.
  • [1010] Determined that 2.6.24.1 kernel that had been built overnight has been superceded by 2.6.24.2, building new kernel image.