Proxmox VE 8から9へのアップグレード手順を記録した作業ログです。Ceph環境を含む3ノードクラスタでの実施例をまとめています。
環境#
- Proxmox VE 8.4
- 3ノードクラスタ
- Ceph 19.2 Squid
- メッシュネットワーク
作業ログ#
Bash
# rootで作業する
sudo -iBash
# Cephフルメッシュセットアップ対策
sed -i '/^[[:space:]]*post-up \/usr\/bin\/systemctl restart frr\.service[[:space:]]*$/d' /etc/network/interfacesBash
# 事前チェック
pve8to9 --full
# Proxmox VE 8の更新
apt update
apt dist-upgrade -y
# Ceph再配置を防ぐ
ceph osd set nooutBash
# リポジトリ更新
sed -i 's/bookworm/trixie/g' /etc/apt/sources.list
# enterpriseリポジトリは無効にする
cat > /etc/apt/sources.list.d/pve-enterprise.sources << EOF
Types: deb
URIs: https://enterprise.proxmox.com/debian/pve
Suites: trixie
Components: pve-enterprise
Signed-By: /usr/share/keyrings/proxmox-archive-keyring.gpg
Enabled: false
EOF
rm /etc/apt/sources.list.d/pve-enterprise.list
cat > /etc/apt/sources.list.d/proxmox.sources << EOF
Types: deb
URIs: http://download.proxmox.com/debian/pve
Suites: trixie
Components: pve-no-subscription
Signed-By: /usr/share/keyrings/proxmox-archive-keyring.gpg
EOF
sed -i '/^deb http:\/\/download\.proxmox\.com\/debian\/pve\//d' /etc/apt/sources.list
cat > /etc/apt/sources.list.d/ceph.sources << EOF
Types: deb
URIs: http://download.proxmox.com/debian/ceph-squid
Suites: trixie
Components: no-subscription
Signed-By: /usr/share/keyrings/proxmox-archive-keyring.gpg
EOF
rm /etc/apt/sources.list.d/ceph.list
apt update
apt policyBash
# Proxmox VE 9にアップグレードする
apt dist-upgradeBash
apt-listchanges: News
→ q
Configuring console-setup
→ Guess optimal character set
Configuration file '/etc/issue'
→ N (keep your currently-installed version)
Configuring libc6:amd64
→ Yes (Restart services during package upgrades)
Modified configuration file '/etc/chrony/chrony.conf'
→ keep the local version currently installed
Configuration file '/etc/lvm/lvm.conf'
→ Y (install the package maintainer's version)
Configuration file '/etc/apt/sources.list.d/pve-enterprise.sources'
→ N (keep your currently-installed version)Bash
# 事後チェック
pve8to9 --full
# systemd-bootを削除する
apt update
apt install systemd-boot-efi systemd-boot-tools
apt remove systemd-boot
rebootBash
# 再起動後
sudo -i
apt modernize-sources
sed -i '/^# Modernized from/d' /etc/apt/sources.list.d/debian.sources
rm /etc/apt/sources.list.bak
# 掃除
apt autoremove
apt clean
apt purge '~o'
apt purge '~c'Bash
# 全ノードの更新が完了してから
ceph osd unset nooutWARN/FAIL対応#
WARN: updates for the following packages are available:#
Bash
apt update
apt dist-upgrade -yWARN: ’noout’ flag not set - recommended to prevent rebalancing during upgrades.#
Bash
ceph osd set nooutWARN: overall version mismatch detected, check ‘ceph versions’ output for details!#
2台目以降のノードで出る警告です。更新が完了すると解消されるので問題ありません。
WARN: multiple running versions detected for daemon type monitor! WARN: multiple running versions detected for daemon type manager! WARN: multiple running versions detected for daemon type MDS! WARN: multiple running versions detected for daemon type OSD! WARN: overall version mismatch detected, check ‘ceph versions’ output for details!
WARN: a suitable kernel (proxmox-kernel-6.14) is installed, but an unsuitable (6.8.12-10-pve) is booted, missing reboot?!#
後で再起動するので放置します。
WARN: ’noout’ flag set, Ceph cluster upgrade seems finished.#
全ノードの更新が完了したらnooutフラグを外します。
Bash
ceph health detail
ceph osd unset nooutFAIL: systemd-boot meta-package installed this will cause issues on upgrades of boot-related packages. Install ‘systemd-boot-efi’ and ‘systemd-boot-tools’ explicitly and remove ‘systemd-boot’#
Bash
apt update
apt install systemd-boot-efi systemd-boot-tools
apt remove systemd-boot既存のCephフルメッシュセットアップが起動に失敗する#
再起動してGRUBメニューで
Advanced options for Proxmox VE GNU/Linuxを選択Proxmox VE GNU/Linux, with Linux 6.14.8-2-pve (recovery mode)を選択パスワードを入力してrootシェルに入る
post-up /usr/bin/systemctl restart frr.serviceの行を削除Bashvim /etc/network/interfaces/etc/network/interfacesiface vmbr0 inet static - post-up /usr/bin/systemctl restart frr.service保存して再起動
Bashreboot
