Reproducer single node openshift (SNO)

[danpawlik]

This commit allows reproducer to create OpenShift cluster using Single Node OpenShift (SNO) feature.

[openshift-ci]

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

[softwarefactory-project-zuul]

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.

[softwarefactory-project-zuul]

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/5dc22fa6d6bf4c44bb15fb3bb7940af0

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 35m 59s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 09m 23s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 20m 19s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 7m 38s
❌ cifmw-pod-pre-commit FAILURE in 7m 51s
✔️ build-push-container-cifmw-client SUCCESS in 21m 07s
❌ cifmw-molecule-devscripts FAILURE in 10m 41s
✔️ cifmw-molecule-reproducer SUCCESS in 15m 00s

[danpawlik]

Still WIP, there is an issue with ingress that raises few issues later.
Even export NODES_PLATFORM="none" does not help. Very helpful would be to make reverse engineering of a CI job that uses SNO_IPV4 scenario, but can not find it.

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/7e909c7819764fc3a6ece0e75bd495f0

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 41m 20s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 13m 20s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 26m 00s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 7m 55s
❌ cifmw-pod-pre-commit FAILURE in 7m 55s
✔️ build-push-container-cifmw-client SUCCESS in 15m 36s
✔️ cifmw-molecule-devscripts SUCCESS in 10m 05s
✔️ cifmw-molecule-reproducer SUCCESS in 13m 42s

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/58af74d994354186bc474744505368bc

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 39m 02s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 09m 32s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 23m 18s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 13s
❌ cifmw-pod-pre-commit FAILURE in 7m 53s
✔️ build-push-container-cifmw-client SUCCESS in 16m 41s
✔️ cifmw-molecule-devscripts SUCCESS in 10m 43s
✔️ cifmw-molecule-reproducer SUCCESS in 14m 04s

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/7b7fc5d03ff34d2cb09473f40f04bdaf

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 45m 19s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 10m 25s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 23m 43s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 7m 54s
❌ cifmw-pod-pre-commit FAILURE in 7m 57s
✔️ build-push-container-cifmw-client SUCCESS in 20m 16s
✔️ cifmw-molecule-devscripts SUCCESS in 10m 03s
✔️ cifmw-molecule-reproducer SUCCESS in 14m 37s

[github-actions]

This PR is stale because it has been for over 15 days with no activity.
Remove stale label or comment or this will be closed in 7 days.

[danpawlik]

Seems PoC of SNO is almost working, without using reproducer or devscript role.
Example execution using nightly build:

cat << 'EOF' > pre.sh
sudo sed -i 's@metalink=https://mirrors.centos.org/metalink?repo=centos-baseos-$stream&arch=$basearch&protocol=https,http@baseurl=http://mirror.stream.centos.org/9-stream/
BaseOS/$basearch/os/@g' /etc/yum.repos.d/centos.repo

sudo sed -i 's@metalink=https://mirrors.centos.org/metalink?repo=centos-appstream-$stream&arch=$basearch&protocol=https,http@baseurl=http://mirror.stream.centos.org/9-stre
am/AppStream/$basearch/os/@g' /etc/yum.repos.d/centos.repo

sudo dnf update -y
sudo dnf install -y git make wget jq libvirt qemu-kvm tar
# https://github.com/openshift-metal3/dev-scripts/blob/master/agent/README.md
sudo setfacl -m u:qemu:rx /home/zuul
echo 'user = "+0"' | sudo tee -a /etc/libvirt/qemu.conf

# enable nested virt
sudo sed -i 's/#options kvm_intel nested=1/options kvm_intel nested=1/g' /etc/modprobe.d/kvm.conf

echo "Now reboot the host..."
sudo reboot
EOF

cat << 'EOF' > execute.sh
sudo swapoff -a

git clone https://github.com/openshift-metal3/dev-scripts /home/zuul/src/github.com/openshift-metal3/dev-scripts

# workaround for only 8 vcpus
sed -i 's/MASTER_VCPU=8/MASTER_VCPU=20/g' /home/zuul/src/github.com/openshift-metal3/dev-scripts/common.sh

# it should have: ci_token  pull_secret.json
cp -a ~/secrets/* /home/zuul/src/github.com/openshift-metal3/dev-scripts/


cat << 'EOL' > /home/zuul/src/github.com/openshift-metal3/dev-scripts/config_$(whoami).sh


#!/bin/bash

# OpenShift Container Platform configuration template
# Refer https://github.com/openshift-metal3/dev-scripts/blob/master/config_example.sh
#
set +x
export CI_TOKEN=$(cat /home/zuul/src/github.com/openshift-metal3/dev-scripts/ci_token)
set -x

if [ -z $CI_TOKEN ]; then
    echo "no ci token"
    exit 1
fi

export OPENSHIFT_RELEASE_TYPE="ga"
export OPENSHIFT_VERSION="4.18.3"
export CLUSTER_NAME="ocp"
export BASE_DOMAIN="openstack.lab"
export NTP_SERVERS="ntp.nask.pl"
export AGENT_E2E_TEST_SCENARIO=SNO_IPV4
export NUM_MASTERS=1
export NUM_WORKERS=0

export MASTER_VCPU=20
export MASTER_MEMORY=32000
EOL

curl -LO https://downloads-openshift-console.apps.ci.l2s4.p1.openshiftapps.com/amd64/linux/oc.tar
tar xaf oc.tar
sudo mv oc /usr/local/bin/

cd /home/zuul/src/github.com/openshift-metal3/dev-scripts/

echo "Now run `make agent`"
make agent
EOF

then:

pre.sh
# reboot

execute.sh

NOTE: if you are doing that on VM, make sure that the disk is not Virtio, but SCSI virtio. It will give you a lot more performance.

[openshift-ci]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign danpawlik for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[softwarefactory-project-zuul]

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/ci-framework for 3129,717e839d30b1121fd114ac7e09bebd78b28563c9

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/fdddb7708e5e4dfd810c292392722293

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 14m 19s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 19m 20s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 29m 00s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 2h 01m 18s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 56s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 51s
❌ cifmw-pod-pre-commit FAILURE in 8m 08s
✔️ cifmw-molecule-devscripts SUCCESS in 11m 00s
✔️ cifmw-molecule-dnsmasq SUCCESS in 4m 44s
✔️ cifmw-molecule-libvirt_manager SUCCESS in 39m 29s
✔️ cifmw-molecule-reproducer SUCCESS in 14m 28s

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/d18a922993814190b7b06ab242578905

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 10m 14s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 23m 06s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 32m 41s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 1h 56m 28s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 51s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 58s
❌ cifmw-pod-pre-commit FAILURE in 8m 39s
✔️ cifmw-molecule-devscripts SUCCESS in 11m 20s
✔️ cifmw-molecule-dnsmasq SUCCESS in 4m 54s
✔️ cifmw-molecule-libvirt_manager SUCCESS in 41m 17s
✔️ cifmw-molecule-reproducer SUCCESS in 14m 48s

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/dc24867e68974c31a26e4108b10062f5

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 02m 47s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 23m 04s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 27m 15s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 1h 50m 10s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 44s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 17s
❌ cifmw-pod-pre-commit FAILURE in 8m 55s
✔️ cifmw-molecule-devscripts SUCCESS in 10m 23s
✔️ cifmw-molecule-dnsmasq SUCCESS in 4m 44s
✔️ cifmw-molecule-libvirt_manager SUCCESS in 41m 13s
✔️ cifmw-molecule-reproducer SUCCESS in 15m 37s

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/55b9244f29414df4b88895547d9ebd26

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 16m 48s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 20m 57s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 39m 05s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 2h 04m 52s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 53s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 9m 11s
❌ cifmw-pod-pre-commit FAILURE in 9m 02s
✔️ cifmw-molecule-devscripts SUCCESS in 10m 58s
✔️ cifmw-molecule-dnsmasq SUCCESS in 4m 42s
✔️ cifmw-molecule-libvirt_manager SUCCESS in 40m 21s
✔️ cifmw-molecule-reproducer SUCCESS in 15m 56s

[softwarefactory-project-zuul]

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/ci-framework for 3129,384908c6fa9e09c4e00b5354316ca69dcd070ae4

[softwarefactory-project-zuul]

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/ci-framework for 3129,519d08a00aa82c6404a460e73009cb5a9e919624

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/ef6363362ce846a482cb8fe2ebb39cf2

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 47m 22s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 22m 18s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 33m 46s
❌ cifmw-crc-podified-edpm-baremetal-minor-update RETRY_LIMIT in 26m 52s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 51s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 51s
❌ cifmw-pod-pre-commit FAILURE in 8m 55s
✔️ cifmw-molecule-devscripts SUCCESS in 10m 30s
✔️ cifmw-molecule-dnsmasq SUCCESS in 4m 42s
✔️ cifmw-molecule-libvirt_manager SUCCESS in 40m 18s
✔️ cifmw-molecule-reproducer SUCCESS in 15m 07s

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/04285e97cfeb4e62b9ab2721782c1084

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 03m 38s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 20m 03s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 23m 13s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 1h 51m 46s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 46s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 9m 25s
❌ cifmw-pod-pre-commit FAILURE in 7m 55s
✔️ cifmw-molecule-devscripts SUCCESS in 11m 56s
✔️ cifmw-molecule-dnsmasq SUCCESS in 4m 48s
✔️ cifmw-molecule-libvirt_manager SUCCESS in 42m 41s
✔️ cifmw-molecule-reproducer SUCCESS in 15m 22s

[softwarefactory-project-zuul]

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/ce4784e9bd064ebfb7cdf571e64a14a3

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 19m 02s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 23m 32s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 24m 16s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 2h 04m 48s
✔️ cifmw-pod-zuul-files SUCCESS in 5m 27s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 10m 36s
❌ cifmw-pod-pre-commit FAILURE in 10m 04s
✔️ cifmw-molecule-devscripts SUCCESS in 10m 22s
✔️ cifmw-molecule-dnsmasq SUCCESS in 4m 50s
❌ cifmw-molecule-libvirt_manager FAILURE in 12m 59s
✔️ cifmw-molecule-reproducer SUCCESS in 32m 02s