December 2020 - Zuul-discuss - lists.opendev.org

install and use ansible collections in zuul v3 ansible native job?
by Marios Andreou 23 Nov '21

23 Nov '21

hi folks long story short: can we install and use ansible collections in a zuul v3/ansible native job? In the tripleo-ci squad we are trying to use the tripleo_overcloud_image_build role from the tripleo-operator-ansible collection [1]. We are already using other roles from this collection - e.g. there [2]. This is possible because in that case we have zuul calling bash calling ansible... which means we get to configure collections in the bash bit setting ANSIBLE_COLLECTIONS_PATHS [3] before invoking ansible. For the case I'm having trouble with - what i refer to as ansible native - here https://review.opendev.org/#/c/733818/33/roles/oooci-build-images/tasks/mai… we have a zuul job playbook directly trying to install and use a collection. Currently it fails because instead of collections: (doesn't work " 'collections' is not a valid attribute? [4] ) I am trying to use include_role but then it can't find the collection's modules "ERROR! no action detected in task" [5]. I tried to set it in ansible.cfg but that won't work and anyway it is surely the wrong approach. The one thing left to try is to explicitly require ansible 2.9 for the job - but wanted to reach out and see if anyone else has any problems trying to install and use ansible collections (with modules importantly) as part of a zuul v3/ansible native job. thanks for reading and for any comments, marios [1] https://github.com/openstack/tripleo-operator-ansible/tree/master/roles/tri… [2] https://opendev.org/openstack/tripleo-quickstart-extras/src/commit/55e74bb8… [3] https://opendev.org/openstack/tripleo-quickstart/src/commit/299131bcc6dca86… [4] https://23fd78c0f6b01b9c4209-59c294b8f46eb75cda2bd004e2a1c97f.ssl.cf1.rackc… [5] https://2063b7e2bb67f86f8ec5-87fe67c942382c6ee875c514bffa4f21.ssl.cf2.rackc…

3 8

teaming up with patternfly team on building a generic ANSI/terminal component
by Sorin Sbarnea 16 Jan '21

16 Jan '21

As we had lots of discussions recently around ANSI processing in zuul, with multiple approaches for enabling ANSI in zuul I realized that maybe we should aim to resolve this at patternfly level, so any application using it may benefit from it. They have very good UX designers, something that we kinda miss around here. Few days ago I raised https://github.com/patternfly/patternfly-design/issues/955 and they want some extra feedback on this. I would like to invite those interested to watch and reply on this ticket, maybe we can end-up with an awesome solution. Cheers, -- /sorin

1 1

Re: Gerrit: tags on changes not merged do not trigger builds
by Åsmund Østvold 18 Dec '20

18 Dec '20

Very sorry, this should have been sent to zuul-discuss(a)lists.zuul-ci.org. Will post to that list. On Fri, Dec 18, 2020, 13:25 Åsmund Østvold <asmundo(a)gmail.com> wrote: > hi, > > I assume the below request is a bit strange so I will give a short > background: > My company produces some libraries that are used in different versions in > our products. The distribution is done by publishing to https://myget.org/. > To enable testing of pre-merge commits our previous build system did > get triggered even on tags pointing to unmerged gerrit changes. > > > The issue: > The tag pipeline defined like this: > > - pipeline: > name: tag > description: This pipeline runs jobs in response to any tag event. > manager: independent > precedence: high > post-review: True > trigger: > gerrit: > - event: ref-updated > ref: ^refs/tags/.*$ > success: > mysql: > failure: > mysql: > > Our Zuul instans do not start builds when tags pointing to change that is > not merged. Builds do start when tags point to merged commits. I believe > the relevant log is: > > 2020-12-18 10:12:03,656 INFO zuul.Pipeline.resoptima.tag: [e: > 4435a9ca5b92495086f3083cf41e62fd] Adding change <Tag 0x7f3174086070 > resoptima/irma.databaseextensions creates refs/tags/1.3.0-beta.1 on > 8d0bdb76b5122402cc66d9f2b53bdf65d3409e7b> to queue <ChangeQueue tag: > resoptima/irma.databaseextensions> in <Pipeline tag> > 2020-12-18 10:12:03,657 INFO zuul.Pipeline.resoptima.tag: Reporting > enqueue, action [] item <QueueItem 0x7f31542667f0 for <Tag 0x7f3174086070 > resoptima/irma.databaseextensions creates refs/tags/1.3.0-beta.1 on > 8d0bdb76b5122402cc66d9f2b53bdf65d3409e7b> in tag> > 2020-12-18 10:12:03,657 WARNING zuul.GerritConnection: Unable to get > change for <GerritTriggerEvent ref-replication-scheduled > review.resoptima.net/resoptima/irma.databaseextensions> > 2020-12-18 10:12:03,851 INFO zuul.MergeClient: [e: > 4435a9ca5b92495086f3083cf41e62fd] Merge <gear.Job 0x7f31542fd8b0 handle: > b'H:172.18.0.8:765' name: merger:refstate unique: > 54a22a170b1a439c82acbb9948c8a109> complete, merged: False, updated: True, > commit: None, branches: [''] > 2020-12-18 10:12:22,555 WARNING zuul.GerritConnection: Unable to get > change for <GerritTriggerEvent ref-replicated > review.resoptima.net/resoptima/irma.databaseextensions> > 2020-12-18 10:12:22,555 WARNING zuul.GerritConnection: Unable to get > change for <GerritTriggerEvent ref-replication-done > review.resoptima.net/resoptima/irma.databaseextensions> > > > Is there something I can do to get this to work? > > Cheers, > Åsmund > >

1 0

what am I doing wrong
by Åsmund Østvold 18 Dec '20

18 Dec '20

hi Again, I like Zuul but it is a bit hard to get it correct. Sorry for the amount of text. A project has zuul.d/job.yaml: --- - job: name: build-and-integration-test parent: base run: - playbooks/build_project.yaml - zuul.d/run_testing.yaml required-projects: - zuul/irma-common-jobs and zuul.d/run_resting.yaml - hosts: all tasks: - name: asdf shell: cmd: | echo testing set -ex cd {{ zuul.project.src_dir }} ./integrationtests.sh feedback form Zuul is: Zuul encountered a syntax error while parsing its configuration in the repo ######/????.BARE master. The error was: Configuration item has more than one key. Each zuul.yaml configuration file must be a list of dictionaries with a single key, for example: - job: name: foo - project: name: bar Ensure that every item in the list is a dictionary with only one key (in this example, 'job' and 'project'). This error may be caused by insufficient indentation of the keys under the configuration item ('name' in this example). The incorrect values are around: hosts: all tasks: - name: asdf shell: Acording to https://zuul-ci.org/docs/zuul/reference/job_def#attr-job.run 'run' alow a list. I am sure I am making a newbie mistake but I can not spot it. Could you please help? cheers, Åsmund

4 5

new projects without restart
by Åsmund Østvold 18 Dec '20

18 Dec '20

hi, Number of projects wanting to use my Zuul setup is increasing. I am looking for a way to tell the Zuul setup that the number of 'untrusted_projects' have increased without having interrupted running builds. Can not find a solution in the documentation. I have tried the zuul German client and was not able to find a solution. Is this possible? Cheers, Åsmund

2 2

[all][SDK][zuul][DIB] CentOS-8
by Artem Goncharov 14 Dec '20

14 Dec '20

Hi everybody, Over around a week we have patches in SDK being blocked by functional test of the nodepool (https://123b844dd0bc940cd071-d2975a8f065f970ca29e743c021b8a36.ssl.cf1.rackc… <https://123b844dd0bc940cd071-d2975a8f065f970ca29e743c021b8a36.ssl.cf1.rackc…>) trying to build CentOS-8 image blocked by https://review.opendev.org/c/openstack/diskimage-builder/+/765963 <https://review.opendev.org/c/openstack/diskimage-builder/+/765963> caused by CentOS rename their packages (the DIB change helps to fix the issue - just verified locally). Normally I would say OK, let’s merge DIB fix and everything is fine, but due to a recent announcement of RedHat (IBM) to discontinue CentOS (non stream) I wonder, whether the DIB change as such is useful at all. At least for the moment I see a perhaps more appropriate fix in nodepool to build some other image (or Fedora or at least to use CentOS stream). DIB should be fixed as well, that’s clear, but maybe differently. Any way we need to come up with solution quickly, since our CI is blocked affecting quite some projects. P.S. Actually that issue is not only affecting our tests, but every Zuul installation trying to build CentOS-8 images. Any opinions? Artem

2 1

[zuul-ci.org website] Adding info re: managed hosting
by Jimmy McArthur 10 Dec '20

10 Dec '20

Hi - I've just requested a review to add Vexxhost Managed hosting, as well as some additional "Get Started" info. This would bypass the current redirect and go to a new section /get-started. Ideally, /start would redirect to /get-started once we all agree on language. https://review.opendev.org/c/zuul/zuul-website/+/766520 I just cobbled this together from a few sources, so please don't consider any verbiage finale. Please leave comments and thoughts in review. Thanks :) Jimmy

1 0

SQL reporters (how many is too many?)
by corvus＠inaugust.com 10 Dec '20

10 Dec '20

As you may recall, the v4/v5 plan is, briefly: * Make SQL connections required and default in every pipeline * release v4.0.0 * Make explicit SQL use in pipelines an error * release v4.1.0 * Do more HA stuff * release v5.0.0 See [1] for the plan in more detail. While reviewing the patch for the first step[2], I wondered if we want to think about changing the config file syntax for SQL connections. Currently the plan is to keep the existing style: [connection mydatabase] driver=sql dburi=... I'm wondering if we should change that to something more like: [database] dburi=... Essentially the question at hand is: is there a case for supporting more than one SQL connection? This will be true no matter which method we choose: * Per-pipeline sql connections are out. At the very least, a given tenant needs exactly one SQL connection in order for the web and other newer features to work. * Seamless upgrades will be supported through the v4.0/4.1 release process (there will be at least a release where both syntaxes are supported). A brief case for "[database]": * It is simpler to have a single database section in the config file. * Zuul already supports complete tenant isolation in its API and db schema, so there should be no need to separate data between different tenants via different connections. Truly paranoid users can run a separate Zuul for different tenants. * SQL databases scale really well, with a little bit of attention to our indexes and queries, we shouldn't need multiple connections for scalability purposes. A brief case for "[connection mydatabase]": * It's not difficult for us to assign a different SQL connection to a tenant. If we find a need to shard data for scalability reasons, this would be the best place to do it. Does anyone else have thoughts about this? Other reasons to prefer one over the other? Thanks, Jim [1] http://lists.zuul-ci.org/pipermail/zuul-discuss/2020-March/001158.html [2] https://review.opendev.org/630472

4 3

[Diversity] Diversity and Inclusion WG Meeting Change for January
by Amy Marrich 07 Dec '20

07 Dec '20

Due to the end of year holidays and the fact some people may still be out we will be moving our January meeting. As our backup meeting date is on Martin Luther King Day, the WG has selected January 11 to meet in IRC. As always I'll send out a reminder in the days leading up to the meeting. Thanks, Amy (spotz)

1 0

Steps to install Zuul ci using helm charts
by sitakanta hotta 05 Dec '20

05 Dec '20

Could you please refer to me if there are any zuul ci install steps using helm charts for kubernetes? Thanks Hotta

2 2