infrastructure-notes/Salt Upgrade 3001.2 -> 3001.6 Notes.md

Salt Upgrade 3001.2 -> 3001.6 Notes.md

Places where code might need to be updated for a new version ( salt.repo )

• packer/scripts/add-saltstack-repo.sh
• salt/pillar/dev/yumrepos.sls
• salt/pillar/prod/yumrepos.sls ( you can wait until after testing is done in test before deploying to prod )

For your reference....

• packer/scripts/provision-salt-master.sh <- salt master is installed here
• base/salt_master/cloud-init/provision_salt_master.sh <- salt master is configured here

3001.2 -> 3001.6

• dev
• legacy test
• gc test
• legacy prod
• gc prod
• LCP nodes

Prep In the dev environment, the salt minion failed to start up after the upgrade. Might need a cronjob on the LCP nodes.

Ensure the pillar has been updated to the correct version.

salt salt* cmd.run 'salt-run fileserver.update'
salt salt* pillar.get yumrepos:salt:version

Update repo

salt salt* cmd.run 'cat /etc/yum.repos.d/salt.repo'
salt salt* state.sls os_modifications.repo_update test=true --output-diff
salt salt* cmd.run 'cat /etc/yum.repos.d/salt.repo'
salt salt* cmd.run 'yum clean all ; yum makecache fast'
salt salt* cmd.run 'yum check-update | grep salt'
salt salt* pkg.upgrade name=salt-master
sudo salt salt* state.sls salt_master.salt_posix_acl --output-diff

Ack the minions didn't come back! stupid salt! Let's try something different

salt salt* cmd.run 'cat /etc/yum.repos.d/salt.repo'
salt salt* state.sls os_modifications.repo_update test=true --output-diff
salt salt* cmd.run 'cat /etc/yum.repos.d/salt.repo'
salt salt* cmd.run 'yum clean all ; yum makecache fast'
salt salt* cmd.run 'yum check-update | grep salt'
cmd.run_bg 'systemd-run --scope yum update salt-minion -y && sleep 240 && systemctl daemon-reload && sleep 20 && systemctl start salt-minion'

Did you miss any? salt -G saltversion:3001.3 test.ping

BAD DNS for Splunk returner requests.packages.urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='moose-hec.xdr.accenturefederalcyber.com', port=8088): Max retries exceeded with url: /services/collector/event (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out',))