Tags: aaradhak/coreos-assembler
Tags
There have been 456 commits since the last release! Here are the high… …lights: This release supports changing the serialization of the ostree commit to a `.ociarchive` file. The intention is to make this the default soon. Various tests as well as the Fedora signing server integration were updated to use this. PR: coreos#2216 Several improvements to `cosa run` around error handling and SSH, race condition fixes. Many improvements and fixes have been done to gangplank, culminating in its usage in the FCOS pipeline for building aarch64 artifacts. Tests now support Butane configs. The RAID tests for example were updated to use Butane. Similarly, `cosa run` now supports Butane configs via the `-B` switch. Ignition support was bumped to v3.3.0, and Ignition spec 2 support (as well as some Container Linux only tests) were removed. There is a new `iso-as-disk` scenario in `kola testiso`. `testiso` now skips signature verification for development builds. The `buildprep` command is now considered deprecated in favour of the new `buildfetch` command. Kola now supports test timeouts. The default timeout is 10 minutes. `kola run` will now group "non-exclusive" tests together so that they re-use the same machine. `cosa run` now supports adding multipathed disks using the syntax: `cosa run --add-disk 1G:mpath`. New platform support: Aliyun and PowerVS, as well as uploaded images in IBM Cloud And many more fixes and improvements! Shortlog: ``` Ben Howard <[email protected]> (69): e3a2480 Gangplank: support pushing ostree to registries 7ef3303 Gangplank: fix shorthands for pseudo artifacts 8b7f63f Gangplank: use UUID in pod mode 863e7dd Gangplank: allow for inline definition of repositories c40d7f2 Gangplank: introduce overrides 3fd2ef4 Gangplank fix incorrect lowering of kola test names 6ac16f6 Gangplank: make use of sudo for tarball creation optional 041bbbc Gangplank: move cmd/*.go to cmd/gangplank.go 8673b73 Gangway for cgo free Gangplanks 93c8370 Gangplank: do not return cache by default 87cdcaa Ganglank: re-enable CGO 2f6c690 Gangplank: remove unneeded find shell command 2145a9f Gangplank: remove verbosity on dumb-init f74fa46 Gangplank: add podman vendoring for images and volumes 961782c Gangplank: full remote podman support 9d14097 Gangplank: drop need for CGO devel libraries 82d93a7 Ganglank: add build tags and CGO settings for VSCode 3d69dcc Gangplank: fix standalone minio from always forwarding b7a89f4 Gangplank: always use remote minio backend on origin command 24a2058 Gangplank: REVERT w/ GoLang 1.16: add interface for os.FileInfo 27d0ff0 Gangplank: use bucket and path prefix for remote objects 5b52a12 Docs: update automated Gangplank documentation f9b291b Docs: update Gangplank docs on Minio and Remote Podman 5554954 Gangplank: force compression to/from minio 4c67667 Gangplank: use pure-Go SSH forwarding 0cac034 ocp: Update templates for OCP 3dc000f Mantle: enable race detection for non-s390x arches dec8fbc Mantle: use mutex to fix race in json report d054e25 Mantle/Kola: make qmp.SocketMonitor part of the qemu instance 9de12c1 Mantle: handle race conditions for cross building correctly 4499909 src/cmd-upload-oscontainer: use arch in the push tag 952743f Mantle: rename platform.NewBuilder to NewQemuBuilder 4c9fa29 OCP: updated the Gangplank yaml files to include branch names e9e9aeb Docs: update Gangplank docs c09f937 Gangplank: update vendoring for Kubernetes v1.21.0 1d17b12 Gangplank: update podman vendoring to v3.2.1 95ddfc4 Gangplank: update Kube API calls for v1.21.0 0f52b38 Gangplank: fix remote pod mode c475402 Gangplank: define default bucket 4cf63a5 Mantle: use events for devshell d8711a0 Mantle: devshell fix-up for exit hang from SSH 2b622cd Gangplank: disable tests pending Minio fix 2f63eb2 Gangplank: use internal package layout conventions 1987990 Tools: update Minio and golangci-lint vendoring ca7bce8 Tools: add noop import.go file for making management easier 513a159 Tools: add versioning and fix minio build to use vendoring c2e6d36 Gangplank: fix race for Minio failures in CI 16f09ea Gangplank: add wait and retry logic for Minio calls 903ad75 metal: fix read-race condition when updating metadata de83dca metal: add cosa meta-stamp to meta.json 250bb6a Dockerfiles: add buildroot definition for CI ec341cf Gangplank: fix minio startup problems in CI cc9ad35 Gangplank: fix schema location 1b86719 Gangplank: fix broken URL tests 9f4811e Makefile: re-enable Gangplank CI checks a86c488 Makefile: disable Gangplank, again 0686382 Vendoring: prep work for shared schema c519d69 Schema: introduce shared schema a1bcc44 Gangplank/Mantle: remove internal schemas ec02d82 Tools: move schema generation out of the tools directory 33125d5 Mantle/Gangplank: use shared schema 9185dd0 Move schema definition under src 696ce0b Gangplank: gofmt fixups 084b613 Gangplank: re-enable CI but disable minio checks 27ad2b1 Makefile: fix incorrect build tag for excluding minio 0e8b24d Gangplank: add go-testify for testing a7126a9 Gangplank: understand ostree and qemu as base builds a7e83c1 Gangplank: use log API for logs 59bfacf Gangplank: support opaque secrets for push secrets Ben Howard <[email protected]> (2): fc633e0 Update gangplank/cmd/gangplank/pod.go ede6c62 Update gangplank/internal/spec/jobspec.go Benjamin Gilbert <[email protected]> (57): 8077d9a mantle: drop some boilerplate files from cosa repo merge 7406a18 mantle/README: drop stale tools d30c859 mantle/platform/conf: don't panic on additions to an empty config db56cfe kola: disable fcos.ignition.misc.empty on AWS for Fedora crypto policy c18fb47 kola/tests: ensure Afterburn SSH key tests didn't set keys via Ignition 3e69da1 kola: switch default GCE image to FCOS testing c9d64fe mantle/go.sum: go mod tidy b891601 mantle/go.mod: vendor Butane 87f2ab5 mantle/platform/conf: make the config an argument to renderIgnition f04cb66 mantle/platform/conf: support Butane configs d4c27a2 mantle/kola/tests: update RAID tests to use Butane a954d73 mantle/kola/tests: update some disabled tests to pretend to use Butane 2ce86b7 mantle/kola: accept .bu suffix for Butane config in external test de87cad mantle/kola: pass conf.UserData to registerExternalTest() c5572b3 mantle/kola: don't shell out to render Butane configs for ext tests a7fd9b8 mantle/kola/qemuexec: don't shell out to render Butane configs 77cb57b kola/tests: fix coreos.ignition.ssh.key 87477d3 go.mod: update Ignition to 2.11.0 and Butane to Git main 4b0de85 platform/conf: update for Ignition spec 3.3.0 bcf804c mantle/platform/conf: add tests for additional spec versions d45630f mantle/platform/conf: use Ignition GetConfigVersion() cc013b0 mantle/platform/conf: support wrapping the next stable spec 7ac9698 OWNERS: remove f26e869 cmdlib: support statoverride file in root of an overlay.d directory 4e6e103 mantle: update Butane to 0.13.0 c285406 mantle/go.mod: revendor 3c19cc3 mantle/go.mod: bump xz cc61223 mantle/go.mod: update Butane 46af3f4 mantle/kola/tests: disable RAID tests on aarch64/ppc64le 1170a7e mantle: drop update package 0a3a4da buildextend-live: add stub grub.cfg to efiboot.img 9ea672d buildextend-live: log a message when booting via the stub grub.cfg 09da8af mantle/platform/qemu: always copy the ISO image 8971ef1 mantle/kola/qemu: support attaching ISO as regular disk 97734f4 mantle/kola/testiso: re-enable iso-live-login scenario by default bd6ce18 mantle/kola/testiso: add iso-as-disk scenario 1e0d63a mantle/kola/testiso: remember to log console output from testLiveLogin 74a612c mantle/kola/testiso: split iso-as-disk to separate function 350c1d9 ci: kola basic scenarios are run by default now b499b89 cosalib: add glob helper that checks for at least one match 5bed36f buildextend-live: drop shim fallback.efi from ISO; simplify EFI image bf6d88e mantle/kola/testiso: ensure live ISO doesn't create an EFI boot entry 3c87f22 buildextend-live: add JSON file to the ISO with kargs embed info ebb9258 mantle/platform/machine/unprivqemu: drop unused field aeda010 create_disk: improve help be80390 gf-platformid: simplify a sed command 3774fd8 buildextend-live: fix /run/media/iso mount flake booting from disk 840d6d3 buildextend-live: remove deleted files from kargs.json 0846cfc buildextend-live: fix grub.cfg path in kargs.json on ppc64le 8c1202b mantle: update stream-metadata-go e553713 mantle/plume/cosa2stream: set metadata.generator field 1073bba mantle: run `go mod tidy` in `make vendor` f0e37cf mantle: bump to stream-metadata-go 0.1.4 d45653a buildextend-live: assume bootupd d5c2a54 cmd-artifact-disk: fix typo 248c608 cosalib.vmware: rename to ova 8b5ea96 Enable Dependabot checks for Butane, Ignition, stream-metadata-go Colin Walters <[email protected]> (61): 6bca399 build/gcp: Add uncompressed-checksum 666ec5f digitalocean: Use new `gzip: True` field 2fc862d qemuexec: Make `cosa run foo.qcow2` correctly use snapshots 77c22c8 Dockerfile: Blow out quay.io cache 1e8c62e devshell: Print final SSH error f492ffa devshell: Fix previous commit 72bc6af devshell: Don't close journal pipe on qemu 9f25318 devshell: Break out of pipe loop on error a92cd18 build: Parse image.yaml early on and convert to JSON acf4b94 Drop support for no longer used `ostree-commit.tar` 774d149 tests: Add skip-base-checks tag 72ccc0c build: Clean up internal import_ostree_commit helper function 74df2e7 cmdlib: Export COSA_PRIVILEGED to subprocesses 88efaff Support `ostree-format: oci` in `image.yaml` 6b46952 ci: Clear out tmp/repo to test ostree repo re-import 29706f9 devshell: Fix race with readyReader 480eefe devshell: Fix another Go race 835cd92 buildextend-*: Add `--compress` 14426ec Dockerfile: Invalidate quay.io cache for new rpm-ostree 8a13c56 cmdlib: Fix shellcheck for libguestfish.sh 926168f generate-release-meta: Add azurestack ad266b3 kola: Add RunCmdSync that logs cmd to target journal, use in upgrade test 0ffd17f mantle: Bump coreos/stream-metadata-go a9f2bfb kola: teach upgrades about oci-archive d17ec2a build: Honor ARTIFACT_DIR for supermin 30daa9a Dockerfile: Stop running unit tests 8d63355 build: Add COSA_SUPERMIN_MEMORY env variable 3ba89d5 build: Only artifact console on failure a799a2d kola: Write to ARTIFACT_DIR if set by default 456ff02 ci: Add prow-rhcos.sh ca6beda ci/prow-rhcos.sh: Also map `master` → `master` 5f4149d kola: Move aws arch defaults to generic code 1911c34 buildprep: Print different message between "not found" and "empty" f6d27d3 ci: Blow out quay.io cache again 75a0949 kola: Change RunCmdSync to log command output to journal too c2a6ef8 kola: Replace all non-capturing MustSSH with RunCmdSync 6fde734 build: Keep Dockerfile + ci/Dockerfile in sync, require rpm-ostree v2021.10 0e9071b build: Add a `:latest` tag to ociarchive export b08249c kola: Replace RunCmdSync(fmt.Sprintf()) with RunCmdSyncf 8ad078c kola: Add support for .ociarchive to RHCOS upgrade test f361834 kola: Add an AssertCmdOutputContains f1d9612 mantle: Add `COSA_IGNITION_DEFAULT_VERSION` envvar mainly for `cosa run` 9edd1fb oscontainer: Only use buildah to work around nested `podman push` bug 7c7de62 kola/systemd: Fix regression in previous commit 8c7f528 kola: Port more tests to AssertCmdOutputContains ee62041 kola: Add AssertCmdOutputMatches 50bd41d sign: Add support for ociarchive 989239b ci/Dockerfile: Blow out quay.io cache 88b6c82 build: Default to CMD=/usr/bin/bash in our oscontainers ef27a9d qemu: Bump timeout for qmp connection bb91174 fastbuild: Better namespace for refs 8f189de Use `ostree-unverified-image:` with `rpm-ostree import` 3e6e3dd create_disk: Sprinkle on some `udevadm settle` 5e2d316 create_disk.sh: Also dump `lsblk -f` on failure d21b200 sign: Remove previous oci image before re-exporting f5d003d sign: Actually make output not writable 1abee8b build+metal: Use shared ostree-importing code 602bd2a rhcos/upgrade: Fix regression in previous commit 114d54e ci: Blow out quay.io cache d1eefa4 create_disk: Initialize stateroot earlier faed8f3 Add `deploy-via-container` and `container-imgref` keys for `image.yaml` Dusty Mabe <[email protected]> (91): 56f0575 mantle: delete obsolete Jenkinsfile 32e5546 Updates for master -> main branch renamings 0e43ca2 gangplank: bump podman libraries 558aece gangplank: podman: switch to using containers API for everything 0a2aa0f gangplank: podman: don't start podman.socket e3f2d15 gangplank: podman: support CONTAINER_HOST env var 56d4b3e gangplank: delete extraneous find 635bb80 gangplank: fix arguments to tar for tarball creation 32701d1 gangplank: let tar create the file 4aad819 supermin: bump msize for 9p mounts 8c6051c init: do a shallow clone of git repo 9a358fc gangplank: fix default value for gangplank pod --podman --remote fe43bcc gangplank: ssh: set StrictHostKeyChecking=no on port forward 8a065f4 gangplank: pod --podman --remote: fully support SSH key path 18573e8 gangplank: fixup building of live artifacts dd3225f create_disk: add support for bootfs_metadata_csum_seed image.yaml knob 0a5bb51 create_disk: add spacing in bootargs 539a63b cosalib, ore: add ability to cross upload aarch64 AMIs 2c87b7f cosalib/aws: move `aws upload` before options in ore 52b7975 cosalib/aws: prevent multiple AMIs from same region in meta.json 095df02 cmd-meta: add support for specifying a different architecture f4688eb Dockerfile: tickle Quay.io's cache for new grub2 package abc16a8 cosalib/aws: include architecture in AMI name/description 2f86e34 cosalib: Add compress option for qemuvariants, ibmcloudvariants 390ff82 gangplank: allow for use of a srvDir even for podman remote 92c81b2 gangplank: allow for the case where no builds were created ae9e0b2 gangplank: add a ReturnFiles stage f8a8bb3 mantle/kola: add support for denylisting platforms 62fae82 cmd-sign: update to accept architecture as an argument 73aa131 cmd-sign: conditionalize ostree commit import e0d58f9 cmd-buildprep: handle fetching data for specific architecture c3c1d07 cmd-buildupload: only re-upload images if forced 7eb5527 cmd-buildprep: return early if no artifacts for build+arch 1747ea6 cmd-buildupload: add --artifact for specifying which artifacts to upload 9591a2e cmdlib: modify insert_build to use passed in argument for directory fd149bb cmdlib: add support for arch to insert_build cd1184b cmd-buildprep: allow for --arch=all a151602 cosalib: support parent_build argument to init_build_meta_json 8169c89 cmd-compress,cmd-buildupload: return early if meta.json missing for arch 6796eeb mantle/kola: add --arch argument to specify target architecture aacd1c4 mantle/kola: switch AWS instance type based on arch 64649ca mantle/kola: pick up AMI from the build meta 1d83d9d cmd-sign: fix arch handling in cmd_robosignatory 9296001 cmd-sign: require passing in the build id 46c3591 cmd-sign: switch back to cosalib.meta library 9132327 cmd-generate-hashlist: support passed in --arch 020976e cmd-generate-hashlist: use ostree, not qcow in metadata 7adc7ad mantle/kola: fixup comments about architecture assumption 0155e66 mantle/kola: use os.Executable() when trying to find kolet ca51bb7 mantle/kola: pick up arch from kola options 49faade mantle/build: convert tabs to spaces 0575729 mantle: cross build kolet 133b2fb mantle/build: remove race argument for kolet c912b42 gangplank: grab logs from same location we checked for them at f5ae2ab kola/options: auto pickup GCP image from meta.json 8a86724 ci/Dockerfile: bump Quay.io nocache hack 20210819 f845d4e gangplank: use dynamically selected port for ssh port forwarding 075ca9e gangplank: fix a typo, update a comment a3e6d74 gangplank: take two on ssh port forwarding 57dfdc6 gangplank: fix subtle creation of new remoteSSHport var 06cb3fb mantle: pass in the kola arch for GetCosaBuildURL 6c69ef6 gangplank: fix out of order execution of commands eca8b70 mantle/kola/testiso: fixup comments about signature checking d9be5db mantle/platform: request networking for testiso iso-install 1ea3519 mantle/platform: handle the x86_64 uefi case for PXE 152e1d9 cmd-init: remove -i short option and INSTALLER_DIR comment d08c1cc cmd-init: support --commit 09286a2 gangplank: allow for specifying configs git commit 228383d create_disk: add reserved partition entries to aarch64,ppc64le 3acb664 mantle/kola: set c6g.xlarge default aarch64 aws instance type f9e5a27 mantle/platform/openstack: wait 10 minutes for instances to come up 7a0a7fd mantle/kola: grab AWS images for aarch64 from stream metadata ca12423 Revert "mantle: exclude openstack from coreos.ignition.ssh.key test" 961d74e mantle/openstack: use boot-from-volume when creating instances f349f3a mantle/openstack: support specifying image architecture 978dcf1 mantle/openstack: add ability to mark visibility for uploaded images 3888007 mantle/kola: detect kernel circular locking dep warning 228b78f mantle/ore: openstack: support setting image protection 2737b05 ci/Dockerfile: tickle Quay cache 2021-10-14 cc16001 Dockerfile: update link for creating images docs 5bd2d0d gangplank: allow for specifying extra build meta to copy 0d90ad4 create `cosa buildfetch`; deprecate `cosa buildprep` fcfd0d5 buildfetch: add --stream option, convert url to option 6e42b11 buildfetch: add --artifact argument to download more artifacts 5e9befb buildfetch: also check for if builds/builds.json exists ff48f1d buildfetch: replace --refresh with --force 310ef40 buildfetch: also grab commitmeta.json 34ad5fb Update all references to buildprep 85de215 ci/Dockerfile: tickle Quay cache 2021-10-21 5065904 mantle: bump github.com/gophercloud/gophercloud to 0.22.0 ff7847a mantle/openstack: use ReplaceImageProtected from gophercloud Jakub Čajka <[email protected]> (2): 19ef93e cmdlib: Bump ppc64le memory to 4G, due to page faults on Power 8 6131f7d cmdlib: Disable false positive shellchecks Jan Schintag <[email protected]> (1): bde4b69 Disable shellcheck SC1091 in src/osmet-pack Jonathan Lebon <[email protected]> (71): 00bfc64 Move to Fedora 34! ade6276 cmd-kola: temporarily stop testing on NVMe c19aee6 mantle: delete targen code 3050fb4 testiso: add missing Description= strings c7f02d6 testiso: tweak help text for --console 14f0ce2 testiso: simplify arch-conditional disk logic 464dfef testiso: save Ignition configs in output dir ea20ec8 metal: fix metal & metal4k artifact checking 4da4a30 metal: use bootindex=3 for ISO b1d3834 testiso: handle --qemu-multipath for ISO tests f06aea4 Revert "cmd-kola: temporarily stop testing on NVMe" d64c16f cmd-kola: temporarily skip NVMe testing in basic scenarios 594b844 cmd-buildupload: print progress as we upload 6dfd9b5 cmdlib: always run rpm-ostree composes with umask 0022 e2233e5 cmdlib: strip write bit for group+other on all overlay files 50cfc13 Revert "cmd-kola: temporarily skip NVMe testing in basic scenarios" 06d226d Dockerfile: tickle Quay.io's cache for new seabios package 6cbae73 cmdlib: change perms on overlay dir copy when stripping bits 684f2ee Don't enable `go build -race` by default fb1a571 mantle/build: really don't enable `-race` by default b7b2420 cmd-build-fast: support project git worktrees d0d85b9 create_disk.sh: remove `options` from s390x parmfile a295e94 cmd-build-fast: fix output to $workdir/tmp 6e76c6a testiso: check that /boot/ignition was nuked 96f6a07 platform/qemu: support passing additional kargs to ISO 9393829 ci/Dockerfile: bump Quay.io nocache hack f7b6d46 cmd-build-fast: and getopt loop and seed with --help 6e88b9a cmd-build-fast: add --no-undeploy 24551a9 tests/rhcos.network.*: fix /boot mount handling 396444b kola/qemuexec: add --ssh-command ba6f416 kola/qemuexec: always exit after --ssh-command exits and propagate error 696e452 kola: alias `iso` to `qemu-iso` 6cb46ec mantle/Makefile: keep PHONY targets near rules c4cb151 mantle/Makefile: drop unused `ARCH` variable f8d0cfc mantle/Makefile: factor out some vars b25749e mantle/Makefile: don't trigger a build on install df88f91 Makefile: add mantle binary targets and plumb down 68589e2 ci/Dockerfile: force rebuild of cosa-buildroot:latest f611e15 qemu: drop unused `MultiPathDisk` member 20d4fc5 qemu: add QEMU builder helper for adding disks cf708e9 metal: append `rw` karg when testing multipath 7951702 tests/multipath: factor out helper functions b97e68b tests: add native multipath support 09d5453 tests/multipath: add multipath.day1 test 353269d qemu: add support for additional disk options 0dacb95 qemu: add support for multipathed additional disks 14e47cf tests/multipath: add multipath.partition test 144242d grub.cfg: use `search --no-floppy` bc68d7c qemu: use `-nodefaults` e31bbb4 ci/Dockerfile: clear Quay.io cache for rpm-ostree 2021.10 cf4b1ed qemuexec: allow specifying `--kargs` multiple times bcc8d2b deps: add fedora-repos-ostree 1e1951d tests: squash ro `/var` race in multipath.partition 8fce587 kola/options: don't derive GCP options if build has no GCP image 22a71ab buildextend-live: update variable name and comments for Ignition file 62bacc9 buildextend-live: add --miniso switch 9dc1dfe testiso: add miniso-install scenario 65fc975 kola/util/rpmostree: use c.MustSSH instead of c.SSH to query rpm-ostree 05999e0 kola/tests/ignition/mount: don't use global var for config d587317 kola: set KOLA_TEST and KOLA_TEST_EXE in external tests ccf7d12 qemuexec: also check --qemu-memory for VM memory 650374b mantle/platform/conf: bump 9p mount msize to match supermin 4c8d819 deps: temporarily stop shipping osbuild-composer 1b979bb buildextend-live: add comment about miniso file matching ac02454 cmd-list: print the config branch for each build e59c0eb kola/coretest/helpers: use `DialTimeout` instead of self timeout 327d2f4 kola/coretest: factor out function to run cmd and timeout 117db9b cmdlib: strip any setuid/setgid bits in overlay dirs 0d4caf7 kola/harness: add support for required tags 05005a4 Revert "build.sh: pin to kernel < 5.14 to unblock s390x builds" 226dbc8 platform/metal: update `coreos-installer iso extract minimal-iso` call Julian Wiedmann <[email protected]> (3): f18a0e1 cmd-build: fix a typo in the help text 718ebba docs: fix two typos 4c7d913 mantle/platform/qemu: update deprecated -chardev options Kelvin Fan <[email protected]> (1): 831183d fcos.upgrade.basic: keep metadata in new commit Luca BRUNO <[email protected]> (1): 3c74005 tests/upgrade-basic: speed up Zincati ticks Luke Meyer <[email protected]> (1): edd5028 docs: minor fixups Luke Meyer <[email protected]> (1): b7c03a7 usage.md: minor copyediting Micah Abbott <[email protected]> (5): 2c18e9c mantle: bump coreos/stream-metadata-go fde0401 generate-release-meta: add support for uploaded Aliyun images e0ec7ef ci/Dockerfile: tickle Quay cache 2021-Oct-01 7852f67 build.sh: pin to kernel < 5.14 to unblock s390x builds 88cccf6 cosa2stream: adapt to leading version strings > 2 chars Michael Nguyen <[email protected]> (2): 75d144e cmd-koji-upload: tag brew builds dd63990 kola: add upgrade test from latest ocp rhcos Prashanth Sundararaman <[email protected]> (16): 477f781 cmd-* : multi-arch fixes after f34 move. 081fee7 mantle: vendor in IBMCloud bluemix client and cloud storage object sdk in prep for uploading images to IBMCloud 67e71ce ore: Support uploading images to IBMCloud b9f7c77 platform/qemu: switch boot order for multipath disks 2237d31 ore/ibmcloud: use provided cloud object storage name rather than default d22b98a schema: add powervs platform to schema f18c66f schema: add optional properties bucket and region to cloud artifacts df6bf27 Add PowerVS as a new platform 07abfc7 Update mantle/cmd/ore/ibmcloud/upload.go 19a9d0b cosalib/ibmcloud.py: ad optional option asking for the authorization file 61600b3 cosalib/ibmcloud.py: move force flag inside upload command e2878c5 kola: tests/crio: add namespace_option to container spec 565f5bf ore/ibmcloud: add copy-object command dc40809 schema: change ibmcloud and powervs artifacts from object to array d97c9e6 cosalib/ibmcloud.py: support replication of images across regions f607717 generate-release-meta: add support for uploaded IBMCloud and PowerVS images Prashanth684 <[email protected]> (2): c07bbe4 cosalib/ibmcloud: Compress PowerVS ova image by default f690616 ibmcloud: remove meta file for PowerVS and set ovf id to 80 Ram Lavi <[email protected]> (9): 7fff24c platform/qemu: Add ability to create non privileged secondary-nics 3c426dd kola/qemuexec: Add secondary-nics argument 79e6f78 platform/cluster,qemu: Add secondary-nics option to QemuMachineOptions f0abd35 kola/tests/misc/network: Add ci test for secondary-nics argument 5c2ccce kola/tests/misc/network: Change dhcpConfig name to dhcpClientConfig 62657d0 kola/tests/misc/network: Refactor checkOvsBridge to generic functions 06e108a kola/tests/misc/network: Add test to check dhcp prop. over bond via veth 07b698a kola/tests/misc/network: Rename tests to kebab-case f67120f kola/tests/misc/network: Remove unneeded script from tests Renata Ravanelli <[email protected]> (8): 737b6ef Attach architecture with name in Koji db8e070 Fix reservation name 7dc729c gangplank: Allow gangplank remote to run with custom port 8f97395 gangplank: Add coreos-assembler-config-git.json as default d743641 gangplank: Add secret map c992323 ganplank: Fix secret mount d3c7ec0 gangplank: Fix secret d6c160a gangplank: Add/fix doc information for secrets Saqib Ali <[email protected]> (17): 9ccb98b Added a command to COSA for encrypting files using openssl ea08547 mantle/kola: add support for kola-denylist.yaml 32b6bc6 docs/kola.md: updated documentation to indicate that tests specified in kola-denylist.yaml are skipped 9ef6ef4 mantle/kola/harness.go: added snooze support for tests f5e6842 docs/kola.md: updated example with snooze option 119bc7f kola/harness, kola/register: Added NonExclusive field to tests 7bc4690 platform/conf: Add support for merging multiple configs of different versions 389d0f4 kola/harness: Assign a unique name to each external test's systemd unit 4680bad mantle/kola: Add ability to run non-exclusive tests in one VM 5ab3d70 kola/harness.go: fix panic on non-exclusive test fail 4acc1fd mantle/kola/harness.go: rerun failed tests once ba9fc17 kola/harness.go: fix multiply flag with non-exclusive tests 6210434 mantle/harness, mantle/kola: Add test specific timeouts dbd6c78 harness/test_test, harness_test: Modify tests to adopt new interface for Tests.Add 0f5db36 harness: Added tests for kola timeouts b1f80e5 docs/kola: Add timeoutMin to external test docs 4c8e460 kola/tests: bump timeout to 20 mins Sohan Kunkerkar <[email protected]> (3): bbb172b kola/tests/misc: log device-specific mountpoint information b420102 kola/tests/misc: add Mountpoints member to blockdevice struct 3d79544 mantle: update Ignition to 2.12.0 Stephen Lowrie <[email protected]> (1): 60f675e mantle/vendor: bump Ignition to 2.10.1 Timothée Ravier <[email protected]> (4): ff4e8e4 docs: Add cosa container age check in cosa alias f969535 docs: Update outadated or borken links 40ee5f7 docs: Do not convert -- & --- to en/em-dash 2c81a03 docs: Remove default layout from front matter Timothée Ravier <[email protected]> (25): 0a7da2f cmd-build: Update help text and mention rpm-ostree debug env options 787914b mantle/kola: Remove Container Linux only tests c789cb1 mantle/kola: Remove Ignition spec 2 support in tests 0b4251f mantle/kola: Update network test to Ignition 17862b5 mantle/kola: Remove ign-convert2 sub command 1952a49 mantle/kola: Remove Ignition spec 2 support 805af9d mantle/kola: Remove most V3 suffixes cd18ba7 mantle/ore: Update for Ignition spec 2 support removal 1d01a75 mantle/kola: Update upgrade test to use an Ignition spec 3 image 01bc203 mantle/kola: Remove options to force Ignition spec version 10d3354 gangplank/kola: Update for Ignition spec 2 removal 5136b7b src/cmd-offline-update: Update example for Ignition spec 2 removal f0e4985 mantle/platform: Remove ContainerLinux support 28bf3a3 mantle/platform: Only validate Spec 3 configs 16ebf2b mantle/platform: Only use Ignition v2 errors 6e1064a mantle: Remove getClusterSemVer and Min/EndVersion logic 10a8712 mantle: Remove now depreacted '-i' build flag 5ec172a vendor: Update for Ignition spec 2 removal ab538d2 go.mod: Manually force remove now unused dependencies 6ce71c8 go.mod: Force update github.com/dimchansky/utfbom a542f26 mantle/platform: Ignore some non-fatal unit failures in RHCOS 1f54ac0 src: Remove rojig support ecec12d docs: Improve build-extend section e9e04f4 mantle/platform: Remove unneeded breaks 43b7ee9 mantle/platform: Fix unit failures ignore path dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> (1): df36374 build(deps): bump github.com/coreos/stream-metadata-go in /mantle gursewak <[email protected]> (1): 53ad808 Updated the fcct instances to butane gursewak1997 <[email protected]> (1): d931c81 kola/testiso.go: ignore signature verification on dev builds ``` Git-EVTag-v0-SHA512: 7e606cd4f7108f728daf4dd86efd9000c1bf0d8ae45dad9bd19c37dcb4beabd6fbf1da035b9396167aff61444b6f185c72b0ea476111f9ef497c45ea092adae4
v0.11.0 There have been 244 commits since the last release! Here are the highlights: - A lot more progress on gangplank. We're hoping to soon have it used in upstream CI on openshift/os. Ganplank is now runnable in four modes: Podman, Custom Build Strategy, Pet container mode, and in-cluster pods. - There is a new `buildextend-extensions` command which formalizes OS extensions shipped in RHCOS as part of the oscontainer. Notably, we now use `rpm-ostree compose extensions` to resolve dependencies before fetching extensions. Richer metadata is added in both `meta.json` and the oscontainer itself about included extensions. - There are new `generate-release-meta` and `cosa2stream` commands to allow converting cosa metadata into stream metadata. This is part of the work to eventually have [bootimage updates](openshift/enhancements#201) in OCP. - The `buildextend-live` command now includes information in the System Area of the live ISO which works hand-in-hand with coreos/coreos-installer#341 to allow modifying embedded kernel arguments. This is also used by `kola` itself to make console output go to the serial port when booting the ISO. - Many bugfixes throughout the codebase. - Many improvements to CI; it now more strongly leverages [coreos-ci-lib](https://github.com/coreos/coreos-ci-lib). Git-EVTag-v0-SHA512: 7d5fae3e2d7763faedf266f2fb029ca508ce5f992b6cf4a51162dcde70937b938c1ad37df68fb2547b61502ce27076449ccd5aba140c6ec32e9ec3481c870809
v0.10.0 A *lot* of changes happened since the last release. Some highlights: - There is a new "gangplank" binary which is intended to make building with cosa more OpenShift-native. For more information, see https://github.com/coreos/coreos-assembler/tree/master/gangplank. - The partition table has been re-ordered: the boot partition is now ordered after the BIOS-BOOT partition. For more information, see coreos/fedora-coreos-tracker#669. - OSTree tarballs and containers now include a ref for the matching cosa build ID. This is especially useful for RHCOS, which otherwise doesn't have a ref. - We now build `kolet` statically to allow it to work on any target host, regardless of the runtime mismatch between it and cosa. - Kola now talks directly to the QEMU monitor. This allows for example better handling of boot order switching in tests rather than relying on `bootindex`. - There is an experimental `generate-hashlist` command used to output a hashlist compatible with [Keylime](https://keylime.dev/). - `upload-oscontainer` now supports an `oscontainer.yaml` and `extensions.yaml` from the config repo, pulled from RHCOS There's much more of course, including lots of fixes, cleanups, and CI improvements; see the git log for details. Git-EVTag-v0-SHA512: f8f2104a833b2de469076bfff734599345d4131dcf8dfbcd9f869c701aef49a15574368c4e94a25d764ab69b9c11ca7bb1599eb130add54e5f4f510866ef1b4f
build: Remove local overrides lock when removing RPMs Fixes a failure with: ``` $ cp /path/to/rpm overrides/rpm $ cosa build $ rm -rf overrides/rpm/*.rpm $ cosa build` error: Couldn't find locked package '<package you removed>' (pkgs matching NEVRA: 0; mismatched checksums: 0) ```
Some highlights for this release:
- Many UX improvements to `cosa run`
- A lot of work around enhancing our support for GCP image uploads and manipulations.
- Add support for offline installs
- More multi-arch fixes and improvements
- Support installed tests in `/usr/lib/coreos-assembler/kola`
- There are now two new commands for making it easier to iterate faster
- `cosa build-fast` and `cosa buildinitramfs-fast`. See their help output for more information.
And of course many more fixes and features! Thanks to all the contributors!
```
Ben Howard <[email protected]> (1):
2a92600 Use shutil.move over os.rename in python code.
Benjamin Gilbert <[email protected]> (1):
5a07e8a mantle: bump Ignition to 2.3.0
Colin Walters <[email protected]> (47):
3d51185 qemu: Use a single temporary directory
9aa2d39 qemu: Unlink non-multipath/nbd disks
dd883aa devshell: Print serial console as status line, dump when interrupted
8480daf cmdlib: Don't dump serial console to stdout
087ff23 installer: Inject stamp file /etc/coreos-legacy-installer-initramfs
42773b9 qemu: Ensure tmpdir is allocated for swtpm
3094bfb devshell: More output validation
16f1c55 create_disk: Use ostree admin init-fs --modern
e89b75d qemu: Propagate errors from disk attachment
5a3a464 devshell: Don't print error on EOF from serial console
574b6be mantle/qemu: Set a short hostname
95c3c8e Add qemu API to stream journal, use it in devshell
6b5b86f installer: More code cleanup
e084135 testiso: Print which message we were waiting for if we hit EOF
f2f7af8 testiso: Rename --console to --debug and skip initramfs failures
d5fe653 testiso: Show which scenario failed on error
66807df upload-oscontainer: New command
494d99e kola: Write ignition-virtio-dump.txt to test dir
45807fb Add cosa supermin-shell
6724a4c installer: Refactor initramfs code
44bdfbb installer: Use consistent variable to refer to built initramfs
afeb3c3 mantle: Build binaries in parallel
e1d5c2c kola: Support distros and tags in external test metadata
0e5118e kola: Add option to configure RAM
e54c526 runc: New command
1fef234 buildinitramfs-fast: New command to iterate on initramfs quickly
dc13ace buildextend-live: Squash unused variable
04f94bf Revert "mantle: Build binaries in parallel"
71518ab installer: Put rootfs on ISO
583f7f1 kola: Avoid losing "external" tag
df6fa87 kola: Support loading tests from /usr/lib/coreos-assembler/tests/kola
30a93de qemu: IgnoreOnIsolate=true for journal streaming
e3905fd create_disk: Add known UUIDs for /boot and /root
43c274a testiso: Gather logs
629a22e mantle: Remove setenforce 1 by default
ca6cfed cmdlib: Don't hardcode manifest path in overrides
ca3c5c3 kola: Add RHCOS LUKS upgrade test
4fbc3c7 testiso: Also capture initramfs virtio dumps
e084667 kola: Replace download code with executing coreos-installer
919bd06 cmdlib: Stop parsing rojig/license
26a1cc2 mantle: Move the FCOS stream URL from kola into mantle
419efd2 Remove dead code relating to detecting Ignition version
8003ede testiso: Fix use of global `outputDir`
4f2a1e2 kola: Add --no-net flag
021b6c8 supermin-shell: Support passing through qemu arguments
ca97e50 create_disk: Ensure filesystem journal on rootfs is clean
4c8d41f osmet-pack: Mount RHCOS LUKS rootfs
Dusty Mabe <[email protected]> (20):
6df34a2 mantle: bump google.golang.org/api library to latest
a11197f mantle/ore: glcoud: add --create-image option to upload.go
02653ca cosalib/gcp: remove unused argument
91297ff mantle/ore: gcloud: fix error detection, add some error checking
d9c90ce mantle/ore: gcloud: add ability to attach license to image
7478708 mantle/ore: gcloud: fix --image arg for deprecate-image
f0427bd mantle: switch to v0.alpha for gcloud compute API
6d0ce98 mantle/ore: add ore gcloud update-image
c5e108b cosalib/gcp: attach to image family in separate API call
a131270 mantle/ore: gcloud: fix error detection for deprecate-image
4dedce3 mantle/platform: gcloud: add new getImageAPIEndpoint func
92efaf0 mantle/platform: gcloud: use API endpoint for replacement in DeprecateImage
0cd1771 mantle/platform: gcloud: enhance api.ListImages to filter by image family
d27f297 mantle/ore: gcloud: add promote-image command
f7eebc1 cmd-kola: also detect --platform=
a42a6b0 cosalib/gcp: Add more gcp information to meta.json
b18d76a cosalib/gcp: shchema: make gcp image project optional
6c0c185 kola: don't error if external tests directory doesn't exist
df16148 cosalib/gcp: pass the log level to ore
560c2dc mantle/ore: gcloud: support specifying multiple image licenses
Jakub Čajka <[email protected]> (6):
48805a6 cosalib/builds: Fix get_local_builds for multiarch
cec28aa dockerfile: drop install_tang step, cleanup after PR#1407
df8b074 kola/qemu: Check for errors, when setting up uefi
4584be9 kola/qemu: Add support for uefi on aarch64
c4555fa kola/options: Default to uefi on aarch64
272529a kola/qemu: Pass ignition via blk device on non-fw_cfg platforms by default
Jonathan Lebon <[email protected]> (20):
e81b867 cmd-fetch: add --with-cosa-overrides
4eb19f4 cmdlib: let qemu write command output on its stdout
bf75ff7 cmdlib: silence `supermin --build` in happy path
1e235fd cmdlib: only use index=N for supermin root
a5de52d cmd-buildextend-metal: use `serial=` to mark target disk
e1cf1b0 kola: rename --tags to --tag and tweak help
07af35f Add support for osmet packing
0af9ac7 kola/testiso: add support for offline testing
246862c kola/testiso: test that default path is fully offline
349ca20 fcos.upgrade.basic: only force updates on if required
c22df7e cmdlib: default to JSON for base lockfile
474b45b buildextend-live: turn on osmet packing by default
4e60560 cmdlib: Lower cost of cosa RPM overrides repo
975eaa1 oscontainer: use workdir as temporary directory if provided
5eecc4c cmd-oscontainer: put workdir in cache qcow2 in unprivileged path
5299045 kola: fix error-handling for --find-parent-image
3b691fb kola: add gce support for --find-parent-image
7c66e46 buildextend-live: check exit code of cpio/find/gzip
289accb buildextend-live: drop unused function `mkinitrd`
a2d79ac buildextend-live: use `find . -mindepth 1` for cpio
Luca BRUNO <[email protected]> (4):
d01301d schema: add vultr artifacts
0462a0f mantle/cosa: regenerate after schema changes
5f2e11e grub: de-hardcode firstboot network configuration
c90027b disk/s390x: inject firstboot kargs (ignition-network-kcmdline)
Micah Abbott <[email protected]> (1):
f3b34bc sdk/distros: update TargetIgnitionVersionFromName for RHCOS 4.6
Michael Nguyen <[email protected]> (2):
33becda platform/qemu: Enable forwarding multiple ports
389ec4f kola/tests/luks: Use separate machine as Tang server
Prashanth Sundararaman <[email protected]> (2):
d90d465 testiso: Fix iso-install and iso-live-login for ppc64le
33d5484 testiso: Prune test scenarios for ppc64le/s390x
Sohan Kunkerkar <[email protected]> (2):
4e2ffda Add test for checking journald logs
4bc8994 Exclude rhcos distro from the journaldEntry test
Stephen Lowrie <[email protected]> (2):
1b68370 kola/harness: log external test journal output to file
25fcec3 kola/harness: tag external tests with the external tag
```
Git-EVTag-v0-SHA512: baf3ad8942dcb67dfd2eaffec22a815b2324a564e89275e72306f4fee2f6f47f1f1fc837d04e25850fe0fb600e36ac73bd25b5462dedad0dcbcc7b38149d6919
A ton more changes in this release! - `cosa run` now shares code with `kola` and has a new user experience that logs in over `ssh` by default, ensuring the terminal works sanely. - Improved support for newer GCP APIs, enabling the upload of FCOS and RHCOS into GCP. - We gained support for creating images compatible with DigitalOcean. - Drastic improvements to the ability to test ISOs that are produced by `coreos-assembler`. - Gained support for creating 4K metal images. - `kola` now supports executing tests defined in external projects, and this is used by our config repository as well as ostree/rpm-ostree. - Improvements to rpm-ostree lockfile handling, used by FCOS. - Improvements to support for ppc64le and s390x - New `--kargs` switch which allows setting kernel arguments in `cosa run` And **many** more fixes and improvements! Thanks to all the contributors! ``` $ git shortlog --no-merges v0.7.2..908158b Ben Howard (3): mantle: support COSA_META_SCHEMA env var for schema enforcement Kola: add support for multipath devices Qemu: use nbd sockets for multipath disks Benjamin Gilbert (14): Add digitalocean artifact mantle/vendor: update godo mantle/ore: teach "do create-image" to create a custom image mantle: bump Ignition to 2.2.1 mantle: go mod tidy fcos: support fetching and parsing stream metadata mantle/*/packet: rework for FCOS mantle/plume: delete dead function mantle/plume: drop support for PV AMIs mantle/ore: drop PV support from "ore aws upload" mantle/platform/aws: drop PV support mantle/ore: drop deprecated sdk.VersionsFromDir() from aws upload mantle/ore: don't default aws upload --file to path from CL SDK mantle/platform/gcloud: drop SECURE_BOOT GuestOsFeature Colin Walters (81): ci: Test `kola testiso` kola: Add run-ext-bin command Bump vendor mantle: Adjust testiso/metal for ptr values in cosa.Build mantle/sdk: Remove unused SDK creation bits mantle/sdk: Remove unused download bits mantle/sdk: Remove unused repo verify bits Move distribution detection into mantle kola: Replace run-ext-bin with `kola run -E/--exttest` mantle/cosa: Regenerate schema for 4knative mantle/system: Add RpmArch API mantle/sdk: Clean out version.go kola: Automatically add src/config/tests/kola if it exists mantle: Rework various bits to use new RpmArch() API Move the "4k implies uefi" logic into kola buildextend-installer: Remove unnecessary kargs exclusions Support `cosa run --kargs` platform/metal: Unify PXE code for legacy/live a bit more mantle/metal: Refactor code in prep for ISO install path kola: Fix Ignition version from disk image (no cosa build) Drain autologin bits into mantle mantle: Remove cloudconfig support mantle: Remove coreos-cloudinit and update vendor kola: Avoid SEGV if no qemu image ci: Run testiso before test_pruning.sh mantle/conf: Remove Ignition spec 1 support system/arch: Fix ppc64le arch mapping Teach mantle/kola how to automatically find cosa builds metal/testiso: Also support installs via `coreos-installer iso embed` metal/testiso: Don't inherit console by default, log cp errors cmdlib: Use -hda/-hdb instead of virtio-scsi incantations Move Ignition conversion into qemu API mantle/qemu: Rework API to allow setting Config after creation Move 9p mount logic into QemuBuilder/qemuexec Revert "cmdlib: Use -hda/-hdb instead of virtio-scsi incantations" kola: Minor arch cleanup qemuexec: Support providing no config build-sys: Only build schema if source changed buildextend-live: Also filter out rhcos.root kernel argument build: Fix race in generating schema Move "detect host CPUs" into mantle build-sys: Require explicit `make schema-update` to regenerate mantle: Rework testiso/metal to use new qemu channel API qemuexec: Support --ignition-direct run: Become a thin wrapper around qemuexec mantle/qemu: Support catching initramfs failures cmdlib: Remove workdir/tmp/rc before/after qemu qemu: Use new channel API for initramfs failure run: Set hostname to `cosarun` buildroot: Add rustfmt testiso: Add --scenarios argument Use an explicit `cosa-cache` label for cache2.qcow2 kola: Test interactive ISO login without networking Drain more logic from cmd-kola into kola prune: Support --prune=<id> build: Fix case with privileges and no cache testiso: If iso-install is excluded, also exclude iso-live-login compress: Add support for --artifact qemu: Ignore journal fd closure in WaitIgnitionError Handle Ignition spec2x conversion for metal metal: Also enable autologin in PXE case testiso: Don't run iso-live-login scenario by default Introduce kola qemuexec --devshell, make `cosa run` use it testiso: Time out after 15 minutes virt-install: Support --image too create_disk: Hoist fixed GPT UUID to a documented constant qemu: Fix bugs in WaitIgnitionError Add RUNVM_NONET which skips dhclient in helper VM devshell: Print status as we're booting qemu: Lazily convert passed Ignition config qemu: Generate primary disk lazily build: Require an explicit fetch stage build: Run udevd in supermin appliance build: Identify target disk by wwn cmdlib: Use kola qemuexec build: Don't auto-load qemu image when building offline-update: Make use of udev now cmd-build-fast: New command to iterate on content quickly Support passing kernel args to PXE installs testiso: Accept zero args devshell: Fatally error if there's no disk Dusty Mabe (17): kola/tests: Swith to expecting Networkmanager vs dhclient cosalib: fix --build= argument passing cmd-koji-upload: update to all kargs for _Build from cosalib mantle/ore: gcloud: clean up a lot of CL specific bits in upload.go mantle/ore: gcloud: remove bucket subpath from GCE image name cosalib/gcp: add ability to pass through --fcos arg to ore mantle: Add ability to specify Image Family for GCP uploads mantle/api: gcloud: don't mutate Image arg if not provided mantle/ore: add ore gcloud deprecate-image mantle/ore: glcoud: gofmt -w mantle/cmd/ore/gcloud/upload.go cosalib/gcp: make call to ore pass through provided bucket argument cosalib/gcp: add compat code for callers providing --bucket gs://* mantle/ore: glcoud: add Family to second invocation of api.CreateImage in upload.go mantle/ore: glcoud: add ability to specify image description for gcp uploads cosalib/gcp: remove compat code for callers providing --bucket gs://* mantle/api: gcloud: remove FCOS specific image GuestOSFeatures cmd-fetch: add --strict for fetching in strict mode Jakub Čajka (6): kola/qemu: Use max supported gic version on the aarch64 host Switching to version "max" will pick the highest correct version, allowing running test suite on wider range of aarch64 hosts. deps: Handle empty/no archful deps files correctly If no line is selected by grep, non-zero code is returned. Skip that deps file if is not needed on that arch, missing or zero lenght. kola/qemu: Fix swtpm device for aarch64 and ppc64le kola/qemu: Revert swtpm for ppc64le for now kola/qemu: disable emulated tpm on aarch64 for now kola/qemu: Get rid of float conversions for getting smp for qemu Jonathan Lebon (37): create_disk.sh: drop -- handling create_disk.sh: drop unused BIOSPN var Add support for 4k metal images mantle/schema: use `schematyper --ptr-for-omit` build.sh: use f32-coreos-continuous for libguestfs cmd-{build,fetch}: fix log message referencing wrong lockfile kola/fcos.users.shells: work-around root user NSS bug cmd-build: Add hack for composing across refs kola: promote concept of sdk.LocalBuild throughout kola/qemu: fix automatically using UEFI for 4k images platform/qemu: don't add -fw_cfg if injecting config platform/metal: print image name we're compressing kola/testiso: support --qemu-native-4k ci: test native 4k ISO install too kola/testiso: add --no-iso flag platform/{metal,qemu}: use bootindex=N instead of `-boot once=d` kola/testiso: include more details in "Success" string cmd/build: allow `cosa build metal4k` cmd-buildprep: also treat HTTP 403 as ENOENT fcos.upgrade.basic: sync after untarring OSTree tarball kola: fall back to upgrade testing from testing-devel for new streams fcos.upgrade.basic: support rebasing to different stream Stop building fcct, add it as a dep instead test_pruning: clarify comment re. dummy builds cmd-prune: fix use of add_mutually_exclusive_group cmd-prune: rename --prune to --build kola/cluster: upload files to temporary path and rename kola/cluster: add DropLabeledFile for SELinux relabeling cmd-build: add --strict for building in strict mode cmd-fetch: fix handling relative --write-lockfile-to paths Dockerfile: invalidate Quay.io cache for new --strict switch devshell: make -c a shortcut for --devshell-console Makefile: run `pylint -E` as part of `pycheck` src: fix Python errors found by pylint deps: add python3-libvirt cmd-koji-upload: set dummy platform attribute cmd-fetch: include overrides when updating lockfile Micah Abbott (3): mantle/build: explicitly specify schematyper binary name aws: provide way to select source-region cosalib/aws: check for 'amis' key in buildmeta Michael Nguyen (4): Add tang server for encryption tests mantle/kola/tests: Add Tang and SSS encryption tests kola/tests/tang: force xinetd to only open ipv4 sockets kola/tests/luks: fix xinetd pid file race Prashanth Sundararaman (4): schema: add metal4k to the schema gf-platformid: Mount a temporary /dev needed for s390x when running zipl in chroot kola: Use RpmArch() instead of architecture() testiso: Do not add disk as primary disk for s390x pXE test Sohan Kunkerkar (1): Add test for systemd instantiated units Stephen Lowrie (3): cli: always call startLogging in WrapPreRun kola: add tags to test structure kola/tests: add tags ``` Git-EVTag-v0-SHA512: a3cfbab9ee304b67963e48d712357ce4b36b2f9763062b9a630790f37f525b89eb3b51d1c40d00a873664f0e0fcbbebc165615febf9d909c0296361ca9f4b7ae
Release 0.7.2 This release is a lot of continuing followup from the merge of coreos-assembler and mantle; we have some new tests, CI and build fixes. ``` $ git shortlog v0.7.1..ff55a38 Allen Bai (2): kola/switch-kernel: test for switching between rt and default kernel Merge pull request coreos#1218 from coreos/test-switch-kernel Ben Howard (4): schema: update FCOS test data to include exoscale schema: add definition for exoscale vendor: add dependencies for schema validation mantle/cosa: base support for writing and validating meta.json Colin Walters (18): testiso: Validate that we have a `metal` image build-sys: Also run mantle unit tests in `make check` mantle/tests: Print out mismatched mode on error mantle/qemu: gofmt mantle: Alias `check` for `test` mantle/test: Don't test schematyper --help mantle/*: Add SilenceUsage to all CLI entrypoints mantle/qemu: Don't directly setenv() kola/qemu: Support injecting kernel network arguments mantle/*: Use errors.Wrapf() in more places mantle: Generate ssh-config in output dir sdk: Trim away lots of CL stuff kola: Use --cosa-build for Ignition version inference automatically mantle: Don't crash if there's no port in spawned machine mantle: Really avoid crashing if no port is set for SSH kola/switchkernel: Add SilenceUsage mantle: Actually display schema errors mantle: Move core metal logic into platform/, use for testiso Dusty Mabe (1): Revert "libguestfish.sh: actually use --ro for read-only runs" Jonathan Lebon (8): kola/spawn: restrict --reconnect to qemu platform libguestfish.sh: actually use --ro for read-only runs kola/qemu: handle errors from Add[Primary]Disk kola/qemu: pass stderr to guestfish kola/qemuexec: add --inject-ignition buildextend-metal: fix reference to wrong OSTree repo Allow having only an overrides lockfile cmd-run: print kola qemuexec command before running Prashanth Sundararaman (1): kola: Use by-partlabel for mount tests except on s390x ``` Git-EVTag-v0-SHA512: 4260d609919d8494ebf54bc37c401df1f65f4cb82e28aa82fbae01e402cb34905c6dda1585c5f238da357224ebdb6659476a2a71dfec0869542fd34c112f1c81
v0.7.1
This is a minor release; not a lot changed in cosa itself
since the last release. However, a major change is that the
mantle codebase is now part of cosa itself. This simplifies
a bunch of things and will make it easier to hack on the
codebase going forward.
Otherwise, there are some tweaks to schema generation to
make it cleaner, more removals of CL-specific things, a new
`kola testiso` command, a new `kola spawn --reconnect`
switch, support for `exoscale`, and a bunch more fixes and
tweaks.
```
Ben Howard (4):
schema: simplify and drop patterns and "anyOf"
mantle: add vendor dependencies for schematyper
mantle: use vendored schematyper for generate command
mantle/schematyper: harden for `go mod` commands
Colin Walters (25):
Use `kola ign-convert2` instead of `incomplete-hack-ign-3to2`
mantle/vendor: Update
mantle: Tweak schema generation script to use local cosa
Use sdk.TargetIgnitionVersionFromName() from mantle
Adopt mantle's (orig CoreOS) code of conduct
kola: Use runE
mantle: Bump to the latest cobra
mantle: Add .gitattributes for vendor/
kola: Cleanup scpKolet a bit
plume: Remove unused CL code
kola: Add testiso command
kola: Rework scpKolet and dropFile to be generic APIs
mantle: Don't delete agent dir if MANTLE_SSH_DIR is specified
kola: Port more main functions to Run*E*
kola/testiso: Port to Run*E*
build-sys: Remove SKIPMANTLE environment variable
schema: Add live-{kernel,initramfs,iso}
schema: Fix duplicate key in overrides-active
ci: Remove .travis.yml
run: Explicitly enable usermode networking
mantle: Stop cleaning every build
gf-mksquashfs: Use API to run+mount to fix RHCOS case
testiso: Add support for testing live path too
run/kola-qemuexec: Add DHCP hostname support
schema: Strip absolute filename
Jonathan Lebon (8):
Drop ostree-releng-scripts git submodule
README-devel.md: drop mantle bump instructions
tree: delete Dependabot config
Revert "Revert "grub.cfg: set ip=dhcp,dhcp6""
kola/{run,spawn}: use SilenceUsage
platform/util: use errors.Wrapf instead of fmt.Errorf
platform/util: strengthen WaitForMachineReboot
kola/spawn: add --reconnect switch
Micah Abbott (1):
mantle: update Ignition spec detection for RHCOS 4.5
Prashanth Sundararaman (2):
cosa:Generate bootable installer iso for ppc64le
mantle: kola: use by-partuuid instead of by-partlabel for mount partitions test
```
Git-EVTag-v0-SHA512: 34513e53106dfdc5bdb6f6c249d637a91ea441f333b26c6f0da9546893bda2e92e2fb5e6632164b995293ecb15d0e21dbbb4b431c354e7199b3a263631b0a1d2
Lots of changes in this release. We've gone through a major refactor … …to help generalize and deduplicate how artifacts are generated. We also now have a schema defined for `meta.json`. The CI integration for coreos-assembler now uses [CoreOS CI](coreos/fedora-coreos-tracker#263). Other noteworthy items: - a lot more work has gone into draining code from `cosa` into `mantle`, especially around launching QEMU VMs - support was added for [Vultr](https://www.vultr.com/) and IBM Cloud (Generation 2) - `cosa kola` now supports `--upgrades` to perform upgrade testing - there's a new `cosa virt-install` command which wraps `virt-install` - `aws-replicate` now performs replications in parallel, which now makes it faster by one order of magnitude - there's a new `list` command to easily view local builds And of course, there have been *a lot of fixes* throughout the codebase! ``` Ben Howard (27): cmd-buildupload: do not create the boto.s3 client when using dry-run Use cosalib for build and publish of Qemu-like and VMware targets. cosalib: fix ore command wrappers - reraise exceptions with the @Retry wrapper - use arg.region since '--region' and '--regions' are synonyms - use the old meta.json 'amis' instead of 'aws' cosalib/gcp.py: check the name for an upload against GCP's regex. offline-update-impl: change file mode to 755 cosalib/aliyun.py: re-add --name-suffix and correct meta_write. koji-upload: Replace `-` with `.` in versions cosalib/build.py: Make commitmeta.json and COSA information optional. cosalib/azure.py: fix missing ore command cosalib/gcp.py: commit meta-data for GCP cosalib/aliyun.py: region name should be a string, not list cosalib/build.py: use cosalib.meta.GenericiBuildMeta for meta.json cosalib/meta.py: fix GenericBuildMeta set/get functions cosalib/meta.py: Introduce and enforce Schema validation for meta.json OWNERS: add OWNERS file for PROW integration OWNERS: add OWNERS file for PROW integration schema/v1.json: support conditional schema requirements qemuvariants: fix regression in GCP tarball format cmdlib: Add logic for default meta.json schema or skipping validation schema: add missing coreos-assembler-overrides-active key create_disk: fix UEFI secure boot qemuvariants: simplify VMware OVA generation by using callback schema: use liberal pattern for FCOS parent version. qemuvariants: produce fixed disks for Azure schema: add missing dasd definitions as optional cosalib/build.py: fix invalid sha256sum to sha256 cosalib/vmware.py: fix OVA generation to meet spec Benjamin Gilbert (4): vmware: enable tar dereferencing symlinks for consistency vmware: make the OVF the first member of the OVA vmware: rename some things vmware: Fix References/File size for OVA disk Colin Walters (18): offline-update: Fix shellcheck warnings run: Support --user root Don't enable verity for /boot by default create_disk: Fix conflicting "rootfs" variables gcp: Fix invalid URL in metadata create_disk: Update to use ex-fsverity OSTree option cmd-virt-install: New wrapper for virt-install schema: Mark container-{config,image}-git keys as optional oscontainer: Add support for --display-name ore,koji: Remove timestamps from Python log formats ci: Run --basic-qemu-scenarios disk,cli: Remove timestamp from logging Dockerfile: Blow out quay.io cache cmdlib: Require automatic-version-prefix in manifest test-coreos-installer: Use kola qemuexec run: Use kola qemuexec, drop ssh support deps: Add coreos-installer cmd-meta: Add --ignition-version Dalton Hubble (2): Add cmd-buildextend-vultr to prepare a Vultr raw image Raise an Exception in Vultr ore upload functions Dusty Mabe (3): cmd-sign: implement request_id for fedmsg passing refactor fedora message sending into cosalib/fedora_messaging_request.py create_disk: put $ignition_firstboot last on kernel command line Jakub Čajka (1): build.sh: Contents of /etc/sudoers.d need not to be world writable To avoid hitting "sudo: /etc/sudoers.d/wheel-nopasswd is world writable" in cosa. Jonathan Lebon (18): cmd-ore-wrapper: fix using basename to auto-detect command cmd-ore-wrapper: pass through default replicate action cmd-ore-wrapper: rename variables for clarity aws-replicate: run in parallel cmd-kola: transparently pass unknown flags to kola grub.cfg: set ip=dhcp,dhcp6 cmd-kola: automatically pass `--cosa-build` cmd-kola: tweak default positional args cmd-kola: add --upgrades for upgrade testing ci: run upgrade tests aliyun: fix passing '' to `ore aliyun copy-image` cmd-kola: drop duplicate --qemu-image-dir cmd-kola: change default output dir for upgrade testing cosalib/build: Use workdir tmp/ as tempdir README.md: link to README-devel.md for testing patches Add `cosa list` to list basic info of local builds qemuvariants: always ship tarfiles with uid/gid=0 Revert "grub.cfg: set ip=dhcp,dhcp6" Luca BRUNO (2): artifact-disk: fix variable name qemuvariants: add ibmcloud Prashanth Sundararaman (4): Make PreP partition the first partition for ppc64le Fix efsck on boot partition for ppc64le Support coreos installer test for non-x86 arches starting with ppc64le gf-platformid: Add firstboot options before zipl rerun for s390x Stephen Lowrie (1): src/cosalib: don't always force uploads for aws & aliyun dependabot-preview[bot] (16): build(deps): bump mantle from `4e73f98` to `55e8cf4` build(deps): bump mantle from `55e8cf4` to `ebb3426` build(deps): bump mantle from `383bdf5` to `77cd6d9` build(deps): bump mantle from `77cd6d9` to `b88c369` build(deps): bump mantle from `b88c369` to `628621c` build(deps): bump mantle from `628621c` to `d68ae69` build(deps): bump mantle from `d68ae69` to `b9ad41e` build(deps): bump mantle from `b9ad41e` to `e7b3cc6` build(deps): bump mantle from `e7b3cc6` to `1bbbad4` build(deps): bump mantle from `1bbbad4` to `9b2cd82` build(deps): bump mantle from `9b2cd82` to `10bbffa` build(deps): bump mantle from `10bbffa` to `919769a` build(deps): bump mantle from `919769a` to `5ced8e5` build(deps): bump mantle from `5ced8e5` to `d17c87d` build(deps): bump mantle from `d17c87d` to `a765070` build(deps): bump mantle from `a765070` to `74efb05` ``` Git-EVTag-v0-SHA512: 2c924cacb79d5d73aa4326f3ab918e0ddf3062bb89ea6ef7da33dbbed22734a0aff4ffa9bdeb54ff811d22099d4f2d053baa7fcacf3366265bfa1066a837b8c2
create_disk.sh: Query the host page size when fs-verity is enabled ext4 fs-verity requires the fs block size to be the same as the kernel page size, and different architectures use different page sizes. So, we have to query the host page size and use that as the block size when fs-verity is enabled. We also have to take the block size into account in the rootfs size estimation, since larger blocks waste more disk space with internal fragmentation.
PreviousNext