- Zuul-announce - lists.opendev.org

Zuul 10.1.0 released
by James E. Blair 25 Apr '24

25 Apr '24

The Zuul team is pleased to announce the release of Zuul 10.1.0. Download it from PyPI: https://pypi.org/project/zuul Find container images at: https://quay.io/organization/zuul-ci The release notes, included below, are also available in the documentation with hyperlink references: https://zuul-ci.org/docs/zuul/10.1.0/releasenotes.html New Features ============ * The executor now monitors filesystem inode usage as well as storage usage. The threshold for accepting jobs can be configured independenty with executor.min_avail_inodes. Inode usage is also reported separately with the zuul.executor.<executor>.pct_used_inodes metric. * The topic of a change (if any) is now reported in the zuul.topic job variable. * Zuul now supports substring searches on the Builds and Buildsets pages on its web UI. This is supported by placing asterisk (*) placeholders anywhere in the search term, representing any characters. This is enabled for job name, branch, project, and pipeline filters. * Information about all of the changes (refs) associated with a circular dependency queue item is now available in the zuul.buildset_refs variable. * When a remote host in a job is found to be unreachable, Zuul will automatically add it to a new group named zuul_unreachable for all subsequent playbooks. This can be used to avoid running certain post-run steps on hosts already known to be unreachable. Deprecation Notes ================= * Specifying pipeline.trigger.<github source>.event as a list is deprecated. Update any instances to specify multiple triggers each with a single associated event instead. * The use of requested has been deprecated for some time already. Its use will now produce a configuration syntax warning, and in a future version of Zuul, an error. * The use of pipeline.trigger.<github source>.require-status has been deprecated for some already. Its use will now produce a configuration syntax warning, and in a future version of Zuul, an error. Bug Fixes ========= * Fixes a bug where Zuul would incorrectly enqueue a Gerrit change that could not be submitted due to missing labels in a dependent pipeline. Specifically, if change had a score for any label that would provided by Zuul, all other missing labels would be incorrectly ignored. * Monitoring stats for per-branch queues are now distinct from shared-branch queues. Shared branch queue stats are at: zuul.tenant.<tenant>.pipeline.<pipeline>.queue. Per-branch queue stats are now at: zuul.tenant.<tenant>.pipeline.<pipeline>.queue.<queue>.branch. Prior to this change, per-branch queue stats for one branch queue may have overwritten the stats from another queue resulting in incomplete or incorrect data. * In 10.0.0, supercedent pipelines could raise exceptions when enqueing changes that were part of a dependency cycle (regardless of whether the changes merged or not). This has been corrected, and the documentation has been updated to clarify that circular dependencies are ignored in supercedent pipelines. * The value of zuul.items.project.src_dir did not take into account the job’s workspace scheme and was always constructed using the golang scheme. That has been corrected so that it now reflects the job’s scheme.

1 0

Nodepool 10.0.0 released
by James E. Blair 01 Mar '24

01 Mar '24

The Zuul team is pleased to announce the release of Nodepool 10.0.0. Download it from PyPI: https://pypi.org/project/nodepool Find container images at: https://quay.io/organization/zuul-ci The release notes, included below, are also available in the documentation with hyperlink references: https://zuul-ci.org/docs/nodepool/10.0.0/releasenotes.html New Features ============ * Support for requiring IMDSv2 in AWS is now available using these options: providers.[aws].pools.labels.imdsv2 and providers.[aws].diskimages.imds-support * The metastatic driver now includes the providers.[metastatic].pools.host-key-checking and providers.[metastatic].pools.labels.host-key-checking options. This can be used to verify that a backing node is still functioning correctly before allocating new metastatic nodes to it. * It is now possible to provide an custom pod definition for the Kubernetes and OpenShift drivers using the providers.[kubernetes].pools.labels.spec, providers.[openshift].pools.labels.spec and providers.[openshiftpods].pools.labels.spec attributes. These can be used to supply parameters not otherwise supported by Nodepool, or to create complex pods with multiple containers. Upgrade Notes ============= * The default providers.[aws].diskimages.volume-type for AWS diskimages has been changed from gp2 to gp3. * The hostname-format option, previously available for the OpenStack and AWS drivers, but unused for some time, has been removed. Remove any uses of it from nodepool config files before upgrading; otherwise they will fail config validation.

1 0

Zuul-Client 10.0.0 released
by James E. Blair 23 Feb '24

23 Feb '24

The Zuul team is pleased to announce the release of Zuul-Client 10.0.0. Download it from PyPI: https://pypi.org/project/zuul-client Find container images at: https://quay.io/organization/zuul-ci The release notes, included below, are also available in the documentation with hyperlink references: https://zuul-ci.org/docs/zuul-client/10.0.0/releasenotes.html New Features ============ * Add freeze-job subcommand to display information about jobs as they would be run in a project’s pipeline. * Support for freezing and displaying the job graph has been added via the zuul-client job-graph subcommand. * Zuul-client is now compatible with the data format used by Zuul version 10, as well as older versions.

1 0

Zuul 10.0.0 released
by James E. Blair 22 Feb '24

22 Feb '24

The Zuul team is pleased to announce the release of Zuul 10.0.0. Download it from PyPI: https://pypi.org/project/zuul Find container images at: https://quay.io/organization/zuul-ci The release notes, included below, are also available in the documentation with hyperlink references: https://zuul-ci.org/docs/zuul/10.0.0/releasenotes.html Prelude ======= This release includes a significant refactoring of the internal handling of circular dependencies. This requires some changes for consumers of Zuul output (via some reporters or the REST API) and requires special care during upgrades. In the case of a dependency cycle between changes, Zuul pipeline queue items will now represent multiple changes rather than a single change. This allows for more intuitive behavior and information display as well as better handling of job deduplication. New Features ============ * Ansible version 9 is now available. The default Ansible version is still 8, but version 9 may be selected by using job.ansible-version. Upgrade Notes ============= * Support for Ansible version 6 has been removed. Migrate any existing jobs which rely on this version to Ansible version 8 before upgrading. * Zuul can not be upgraded to this version while running. To upgrade: * Stop all Zuul components running the previous version (stopping Nodepool is optional). * On a scheduler machine or image (with the scheduler stopped) and the new version of Zuul, run the command: zuul-admin delete-state –keep-config-cache This will delete all of the pipeline state from ZooKeeper, but it will retain the configuration cache (which contains all of the project configuration from zuul.yaml files). This will speed up the startup process. * Start all Zuul components on the new version. * The MQTT reporter now includes a job_uuid field to correlate retry builds with final builds. Deprecation Notes ================= * The syntax of string substitution in pipeline reporter messages has changed. Since queue items may now represent more than one change, the {change} substitution in messages is deprecated and will be removed in a future version. To maintain backwards compatability, it currently refers to the arbitrary first change in the list of changes for a queue item. Please upgrade your usage to use the new {changes} substitution which is a list. * The syntax of string substitution in SMTP reporter messages has changed. Since queue items may now represent more than one change, the {change} substitution in messages is deprecated and will be removed in a future version. To maintain backwards compatability, it currently refers to the arbitrary first change in the list of changes for a queue item. Please upgrade your usage to use the new {changes} substitution which is a list. * The MQTT and Elasticsearch reporters now include a changes field which is a list of dictionaries representing the changes included in an item. The correspending scalar fields describing what was previously the only change associated with an item remain for backwards compatability and refer to the arbitrary first change is the list of changes for a queue item. These scalar values will be removed in a future version of Zuul. Please upgrade yur usage to use the new changes entries. * The zuul.bundle_id variable is deprecated and will be removed in a future version. For backwards compatability, it currently duplicates the item uuid.

1 0

Zuul 9.5.0 released
by James E. Blair 13 Feb '24

13 Feb '24

The Zuul team is announces the release of Zuul 9.5.0. Download it from PyPI: https://pypi.org/project/zuul Find container images at: https://quay.io/organization/zuul-ci The release notes, included below, are also available in the documentation with hyperlink references: https://zuul-ci.org/docs/zuul/9.5.0/releasenotes.html Upgrade Notes ============= * Ansible versions 6 is now deprecated in Zuul since it is unmaintaned, and it will be removed from a future version of Zuul. Ansible 8 is now the default version in Zuul.

1 0

Zuul 9.4.0 released
by James E. Blair 08 Feb '24

08 Feb '24

The Zuul team is announces the release of Zuul 9.4.0. Download it from PyPI: https://pypi.org/project/zuul Find container images at: https://quay.io/organization/zuul-ci The release notes, included below, are also available in the documentation with hyperlink references: https://zuul-ci.org/docs/zuul/9.4.0/releasenotes.html New Features ============ * The Gerrit driver now supports the hashtags-changed event as a trigger as well as using hashtags as trigger or pipeline requirements. Bug Fixes ========= * The MQTT reporter now sets the log_url for retried builds correctly. The link to the build result page is reported in a dedicated web_url field.

1 0

Nodepool 9.1.0 released
by James E. Blair 14 Dec '23

14 Dec '23

The Zuul team is pleased to announce the release of Zuul 9.1.0. Download it from PyPI: https://pypi.org/project/nodepool Find container images at: https://quay.io/organization/zuul-ci The release notes, included below, are also available in the documentation with hyperlink references: https://zuul-ci.org/docs/nodepool/9.1.0/releasenotes.html New Features ============ * The AWS driver now supports an providers.[aws].image-import-timeout option to control automatic retries and timeouts when AWS import task resource limits are reached. * The AWS driver now supports volume quota. It will automatically register the limits from the cloud and ensure that labels that specify EBS volume attributes stay under the limit. * The Azure driver now supports specifying the size of the OS disk. * The Kubernetes and OpenShift drivers now support adding dynamic metadata, i.e. Pod and Namespace labels, with information about the corresponding node request. This is analogous to the existing dynamic tags of the OpenStack, AWS, and Azure drivers. See providers.[kubernetes].pools.labels.dynamic-labels, providers.[openshift].pools.labels.dynamic-labels, and providers.[openshiftpods].pools.labels.dynamic-labels for details. * The Azure driver now support specifying community and shared gallery images. * The metastatic driver will now automatically use the node-attributes from backing nodes as default values for node-attributes of metastatic nodes. Any node-attribute values specified in the metastatic pool config will override those from the backing node. * An upload timeout can be configured on OpenStack providers for use in the case that image uploads to a provider take longer than the default of one hour. Upgrade Notes ============= * The Azure driver now uses the "Standard" SKU for all public IP addresses. Previously it would chose either "Standard" or "Basic" depending on the selection of IPv4 or IPv6 addresses. Pricing for public IP addresses may differ between the SKU levels. Standard IP addresses block all incoming traffic by default, therefore the use of a Network Security Group is required in order to allow incoming traffic. If you are not currently using a Network Security Group, then before upgrading Nodepool it is recommended to create one, add any required rules, and attach it to the subnet that Nodepool uses. * The Azure driver no longer creates and deletes Disks, Network Interfaces, or Public IP Addresses as separate steps. Nodepool and user-supplied tags will no longer be applied to Network Interfaces, or Public IP Addresses. This also limits Nodepool's ability to detect leaks of these resources (however this is unlikely since Azure is now responsible for deleting them).

1 0

Zuul 9.3.0 released
by James E. Blair 07 Dec '23

07 Dec '23

The Zuul team is announces the release of Zuul 9.3.0. Download it from PyPI: https://pypi.org/project/zuul Find container images at: https://quay.io/organization/zuul-ci The release notes, included below, are also available in the documentation with hyperlink references: https://zuul-ci.org/docs/zuul/9.3.0/releasenotes.html New Features ============ * Monitoring stats for builds are now emitted for more results. Previously they were emitted for some build results such as SUCCESS, FAILURE, and ERROR but now include NODE_FAILURE and other result values. * Support for using Google Cloud Pub/Sub as an event source has been added to the Gerrit driver. Upgrade Notes ============= * A significant SQL schema migration is included which requires extra care when upgrading. It is recommended to make a database backup before upgrading in case of problems. It is also recommended to test the migration with a copy of the database in a development environment first in order to ascertain expected runtime and detect any data integrity problems early. Zuul is unable to operate as normal during the schema upgrade. The following procedure is recommended: * Perform a database backup * Stop all Zuul components * Start one scheduler and wait for it to complete the migration and initialization * Start the rest of Zuul If the migration fails and the backing database is PostgreSQL, the migration will be rolled back and Zuul may be restarted on the previous version. If the backing database is MySQL, if the error happens early enough the migration may be rolled back (look for "Early error in schema migration, rolling back" in scheduler logs). If an error happens late in the migration, manual intervention may be required. * Zuul's GitHub driver has updated the default merge mode to better align with GitHub's default behavior. This change requires Git 2.33.0 or newer unless you explicitly override Zuul's default merge mode for a project. Additionally, if you aren't overriding the merge mode then the merge algorithm chosen may change depending on your Git and GitHub versions. This is expected to provide more deterministic results. * Input data from a parent job (return data or artifacts) no longer influences whether a child job can be deduplicated or not. Bug Fixes ========= * Correct the behavior of the timer driver to not trigger for branches configured as always-dynamic.

1 0

Zuul 9.2.0 released
by James E. Blair 27 Sep '23

27 Sep '23

The Zuul team is announces the release of Zuul 9.2.0. Download it from PyPI: https://pypi.org/project/zuul Find container images at: https://quay.io/organization/zuul-ci The release notes, included below, are also available in the documentation with hyperlink references: https://zuul-ci.org/docs/zuul/9.2.0/releasenotes.html New Features ============ * Gerrit and GitHub repositories will now automatically use the default branch as specified in their respective systems as the project’s default branch. This may still be overridden in zuul using the project.default-branch setting. * A new job configuration option, job.failure-output, has been added to allow users to specify regular expressions which, when seen in the streaming job output, will trigger the early failure detection in Zuul so that dependent pipeline gate resets may begin before the completion of a failed job. * Two new settings are available to protect Zuul from resource exhaustion from processing too many dependencies among changes. The Gerrit driver supports setting <gerrit connection>.max_dependencies to limit internal dependency processing during event processing, and a new tenant setting of tenant.max-dependencies is available to limit tenant processing while enqueing changes in pipelines. * Additional pipeline stats for individual project queues are available at zuul.tenant.<tenant>.pipeline.<pipeline>.queue. * Configuration options which accept regular expressions have been updated to accept a new syntax which allows specifying that the regular expression should be treated as a negative match. * An upper limit on the dependent pipeline actionable window can now be specified using the pipeline.window-ceiling setting. The default of no upper limit remains. Upgrade Notes ============= * If using the GitHub driver in app mode, you should consider also generating and adding an api_token. The option is not strictly required but will increase rate limits and add functionality for projects the app is not installed in. Deprecation Notes ================= * Regular expressions using Python syntax are deprecated in favor of RE2 syntax instead, for additional speed and safety. Negative lookahead assertions may be replaced using the negate keyword. See Regular Expressions for more information. If Zuul detects a regular expression using Python syntax that is not supported by RE2, it will register a configuration syntax warning. These may be viewed on the configuration errors page in the web interface. A future version of Zuul will remove Python regex support completely and these warnings will become errors.

1 0

[zuul-jobs] Dropping support for ensure-cabal and ensure-haskell-stack
by Tristan Cacqueray 23 Aug '23

23 Aug '23

Dear Zuulers, Since ghcup is the new recommended installer for the Haskell toolchain, I propose to remove the legacy roles in this change: https://review.opendev.org/c/zuul/zuul-jobs/+/847111 This only affects external playbooks using the ensure-cabal and ensure-haskell-stack roles directly. These tasks are now performed by the ensure-ghc role. The change is scheduled to land in two weeks from now, on 2023-09-05. With regards, -Tristan

1 0