- Zuul-discuss - lists.opendev.org

Zuul-runner spec
by corvus＠inaugust.com 03 Dec '20

03 Dec '20

Hi Zuul Maintainers, The zuul-runner spec[1] has gone through quite a bit of review and changes and is ready for us to make a final determination. I would appreciate it if all interested maintainers would take a look and leave a vote by December 11; we'll merge it if there are no objections by then. If you need more time to review, please say so and we can defer. [1] https://review.opendev.org/c/zuul/zuul/+/681277 Thanks, Jim

1 0

Improving "This change or one of its cross-repo dependencies was unable ..." message
by Fabien Boucher 30 Nov '20

30 Nov '20

Hi, I'd like to get your feeling about this error message that Zuul reports to end users: A user of Fedora Zuul CI, raised a concern about it. --- Merge Failed. This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset. --- I've attempted to explain it like this: --- This is a PR, so the content of <the-branch> is going to be merged (or rebased) onto the <target-branch>. Thus, Zuul tried it and reported that this change cannot be merged with the current state of the repository. This un-mergeable state makes Zuul stop processing and not run the jobs. --- The user raised that comment: --- Why it cannot say at least something like: "Attempt to rebase on top of master failed. This repository is not in a mergeable state". Why does it say "Merge failed", when it does not provide any context at all. Why does it mention "cross-repo dependencies" without any reference? --- It seems that the "Merge Failed" is ambiguous because it can be interpreted as "the final merge of the PR to the target branch". The user's proposal seems better. I think this "This change or one of its cross-repo dependencies" should be improved to give the repositories names that were unable to be "merged". Let me know what you think, I'll be happy to provide a change to Zuul to update this error message. Fabien

2 1

Question about integration with gerrit
by Rikimaru Honjo 25 Nov '20

25 Nov '20

Hi, I have a zuul instance in my environment. It is integrated with review.opendev.org as a 3rd party CI. It fails to post comment recently. There aren't error messages in log files. It used to be successful to post. My zuul version is 3.10.1. Should I upgrade it? I already checked release notes of zuul. But there aren't descriptions about it. Zuul-executor's log about posting comment: 2020-11-24 12:05:23,547 DEBUG zuul.AnsibleJob: [e: 6304c4d6a2a047b8ba2e05abf4b2907f] [build: 094b3be9dea64b1ead6a49886cf04cf2] Ansible complete, result RESULT_NORMAL code 0 2020-11-24 12:05:23,548 DEBUG zuul.AnsibleJob: [e: 6304c4d6a2a047b8ba2e05abf4b2907f] [build: 094b3be9dea64b1ead6a49886cf04cf2] Sending result: {"warnings": [], "data": {"zuul": {"log_url": "http://153.156.76.189:8000/641174/13/20201124110905"}}, "result": "SUCCESS"} 2020-11-24 12:05:23,571 DEBUG zuul.ExecutorServer: [e: 6304c4d6a2a047b8ba2e05abf4b2907f] [build: 094b3be9dea64b1ead6a49886cf04cf2] Sent SIGTERM to SSH Agent, {'SSH_AGENT_PID': '22823', 'SSH_AUTH_SOCK': '/tmp/ssh-1879qAA2fLYm/agent.22822'} Best regards, -- _/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/_/ Rikmaru Honjo E-mail:honjo.rikimaru@ntt-tx.co.jp

3 3

Proposed Zuul UI changes for build summary page
by Sorin Sbarnea 16 Nov '20

16 Nov '20

As a result of the irc discussions from this week, I would like to propose some UI changes as described in the image below: https://sbarnea.com/ss/zuul-summary-ui-2020v2.png Each change has a letter so we can refer to them and implement them separately / gradually. zuul-cores are encouraged to reply and state if you support or disapprove any of these changes as this would avoid spending good amount of implementation and reviews. At least if any of the changes is problematic I can avoid working on it. When done we will have more space to display the "tabs", so less to scroll to see data, avoid hiding useful artifacts from the default UI by removing the extra click, overall a more compressed page, but not less readable. Please let me know what you think and how we can make it better. -- /sorin

5 6

Help with making a Zuul job wait for another job
by A richist 16 Nov '20

16 Nov '20

Hi everyone, I have what I feel like should be a basic use-case for Zuul, which I can't seem to get right. I have a project with 2 jobs set up as: *- job:* * name: job1* * run: <playbook> * * provides: build* * nodeset: nodeset1* *- job:* * name: job2* * run: <playbook> * * requires: build* * nodeset: nodeset2* *- project:* * check:* * jobs:* * - job1* * - job2* As you might have guessed, job1 builds the project and saves an artifact, while job2 requires that artifact and does something with it. I expected job1 to complete before job2 starts, however both jobs start simultaneously, which makes job2 unable to fulfill its purpose. I tried setting job2 to inherit job1: *- job:* * name: job1* * run: <playbook>* * nodeset: nodeset1* *- job:* * name: job2* * parent: job1* * post-run: <playbook> * * nodeset: nodeset2* *- project:* * check:* * jobs:* * - job2* However this seems to make job1's "run" playbook use "nodeset2", which is incompatible. job1 must run on nodeset1 and job2 must run on nodeset2. (Is there a way to make the "run" and "post-run" playbooks use different nodesets?) I might be missing something obvious here, would really appreciate your assistance. Regards, Arichist

2 2

AttributeError: 'Thread' object has no attribute 'isAlive' on Fedora 33 build VMs
by Jan Kundrát 13 Nov '20

13 Nov '20

Hi, I'm trying to add some Fedora 33 VMs to our setup with Zuul 3.18, however the very first job failed with this trace in the job log: [Zuul] Log Stream did not terminate w | MODULE FAILURE: w | <stdin>:18: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses w | Traceback (most recent call last): w | File "<stdin>", line 114, in <module> w | File "<stdin>", line 106, in _ansiballz_main w | File "<stdin>", line 49, in invoke_module w | File "/usr/lib64/python3.9/imp.py", line 234, in load_module w | return load_source(name, filename, file) w | File "/usr/lib64/python3.9/imp.py", line 169, in load_source w | module = _exec(spec, sys.modules[name]) w | File "<frozen importlib._bootstrap>", line 613, in _exec w | File "<frozen importlib._bootstrap_external>", line 790, in exec_module w | File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed w | File "/tmp/ansible_command_payload_zcmflb0m/__main__.py", line 675, in <module> w | File "/tmp/ansible_command_payload_zcmflb0m/__main__.py", line 651, in main w | File "/tmp/ansible_command_payload_zcmflb0m/__main__.py", line 498, in zuul_run_command w | AttributeError: 'Thread' object has no attribute 'isAlive' Older Fedoras work well. I think this code comes from Zuul, it is triggering a deprecated method in Python's threading which got removed in Python 3.9. I see that Zuul commit 758ba823f22366fe9da834612586b5f7c1829984 should probably fix it, but it is not included in any release. I can deploy from git just fine, but I'm sending it here as a suggestion to tag a release with a fix because this is not about the version of Python on the scheduler/executor, but on the VMs themselves. Or perhaps I'm wrong and it's code that origins in Ansible? With kind regards, Jan

3 3

zuul enqueue-ref issue with tenant value
by Åsmund Østvold 12 Nov '20

12 Nov '20

hi Again, Fantastic help I have received by this group! Still have some issues and I am wondering what I am doing wrong now. root@0374d1dcdc52:/# zuul enqueue-ref --tenant 192.168.167.126 --trigger gerrit --pipeline tag --project test/ensemble.service --ref refs/tags/v0.5.0-beta.7 --newrev 6b5efcf96a3ec713c991fc13b95f0d16385e85b8 Traceback (most recent call last): File "/usr/local/bin/zuul", line 8, in <module> sys.exit(main()) File "/usr/local/lib/python3.8/site-packages/zuul/cmd/client.py", line 750, in main Client().main() File "/usr/local/lib/python3.8/site-packages/zuul/cmd/client.py", line 399, in main if self.args.func(): File "/usr/local/lib/python3.8/site-packages/zuul/cmd/client.py", line 526, in enqueue_ref r = client.enqueue_ref( File "/usr/local/lib/python3.8/site-packages/zuul/rpcclient.py", line 110, in enqueue_ref return not self.submitJob('zuul:enqueue_ref', data).failure File "/usr/local/lib/python3.8/site-packages/zuul/rpcclient.py", line 50, in submitJob raise RPCFailure(job.exception) zuul.rpcclient.RPCFailure: Invalid tenant: 192.168.167.126 Tenant config is like this: labels: - name: ubuntu-bionic providers: - name: static-vms driver: static pools: - name: main nodes: - name: 192.168.167.126 # stenant01 labels: ubuntu-bionic host-key-checking: False python-path: /usr/bin/python3 username: newton - name: 192.168.167.106 # stenant02 labels: ubuntu-bionic host-key-checking: False python-path: /usr/bin/python3 username: newton I am probably doing something wrong but what I do not know... If anybody see what I am doing wrong please let me know. Cheers, Åsmund

2 2

help reading logs
by Åsmund Østvold 10 Nov '20

10 Nov '20

hi I have an issue with a commit that will not trigger the jobs I expected. While investigating this I am trying to understand a log. The change I am trying to get in is e03b45eae13d35f65b6b111240d4638dea4fa9e2 it is on top of merge branch on project test/es. 2020-11-09 11:02:15,414 INFO zuul.Pipeline.resoptima.check_comment: Reporting enqueue, action [] item <QueueItem 0x7ff3203eed00 for <Change 0x7ff3204a6f10 test/es 2568,2> in check_comment> 2020-11-09 11:02:15,810 INFO zuul.MergeClient: [e: 92db9fd9a2e54c0dafcddb1959985c03] Merge <gear.Job 0x7ff3203ee310 handle: b'H:172.18.0.7:2123' name: merger:merge unique: d50b768a8e604d549647724bf939107a> complete, merged: True, updated: False, commit: e03b45eae13d35f65b6b111240d4638dea4fa9e2, branches: [] 2020-11-09 11:02:16,214 INFO zuul.MergeClient: [e: 92db9fd9a2e54c0dafcddb1959985c03] Merge <gear.Job 0x7ff3203ee7f0 handle: b'H:172.18.0.7:2124' name: merger:merge unique: 5ce30216a8aa41ecba7cbd653f62ddbf> complete, merged: True, updated: False, commit: e03b45eae13d35f65b6b111240d4638dea4fa9e2, branches: [] Nothing is logged to the gerrit change. Any hint on what is going one is of value Zuul version is: 3.19.1.dev390 f73434e4 Cheers, Åsmund

2 4

Zuul's test framework
by Matthieu Huin 05 Nov '20

05 Nov '20

Hello, Yesterday a discussion came up on IRC about using zuul's test framework in other projects [1]. Basically the framework greatly simplifies running zuul processes, and sets up projects and simulates a gerrit for testing. It is used for zuul, nodepool and zuul-client tests. The problem is that the framework lib is not available through a zuul import. That means that tests specific to nodepool, zuul-client and potentially other projects need to be defined within that framework, in the zuul project repo. This is not ideal, and in the case of zuul-client, it leads to tests being written in follow-up patches to the zuul repo, which is a bit backward [2]. Let's use this thread to suggest improvements on the situation, and weigh pros and cons. We could: 1. Copy the bootstrapping code to other projects that need it - this represents a significant amount of code, and it's going to be painful to ensure there are no divergences in the code base. 2. Split the test framework into its own package. You'll still need to invoke zuul's tox job to set it up, but at least the tests could live in their relevant project's repository. Any other alternatives? Cheers, [1] http://eavesdrop.openstack.org/irclogs/%23zuul/%23zuul.2020-09-28.log.html#… [2] see for example https://review.opendev.org/#/c/750709/ and testing in https://review.opendev.org/#/c/754103/ -- Matthieu Huin Senior Software Developer Red Hat <https://www.redhat.com> <https://red.ht/sig>

2 2

[Diversity] Diversity & Inclusion WG Meeting 11/2 - Removing Divisive Language
by Amy Marrich 31 Oct '20

31 Oct '20

The Diversity & Inclusion WG will continue working on the OSF's stance on the removal of Divisive Language within the OSF projects. We will be focusing on the creation of possible words to focus on as well as possible replacements[0] as was requested during our Forum session[1]. The WG invites members of all OSF projects to participate in this effort and to join us at our next meeting Monday, November 2nd, at 17:00 UTC which will be held at https://meetpad.opendev.org/osf-diversity-and-inclusion. <https://meetpad.opendev.org/osf-diversity-and-inclusion> If you have any questions please let me and the team know here, on #openstack-diversity on IRC, or you can email me directly. Thanks, Amy Marrich (spotz) 0 - https://etherpad.opendev.org/p/wallaby-ptg-diversity 1- https://etherpad.opendev.org/p/vSummit2020__DivisiveLanguage

1 0

[PTG] [Diversity] Extra session for Divisive Language discussions
by Amy Marrich 27 Oct '20

27 Oct '20

During the Monday session there were some questions in regards to technical writing and how things should be worded. I have invited Joanne O'Flynn, a Technical Writer from Red Hat to join us on Thursday at 17:00 UTC to help address these questions. This is not a normal PTG time slot but it was the only option due to time zones and already booked sessions for some of the participants from Monday. Thanks, Amy Marrich (spotz)

1 1

Re: [service-announce] October 20 Gerrit Outage Update
by James E. Blair 23 Oct '20

23 Oct '20

Hi, You may have seen the message to the opendev service-announce list about the recent Gerrit compromise and outage. If you haven't, I've included a copy below. If you are a Zuul maintainer or a regular contributor, you may want to subscribe to that list. As a project, we have an action item to review some commits which merged during the vulnerable window to verify that they have not been maliciously altered (see the message below for full information and context). Clark has reviewed the zuul-jobs and zuul-website repos, and I have reviewed the zuul repo and we have found nothing amiss. It would not hurt for others to review these as well. Further, if you are the author of any of these commits and still have the versions you pushed to Gerrit in a tree which you are sure has not been updated or has only been fast-forwarded, it would be useful for you to verify the commit sha is the same. All of the relevant commits can be found in individual patch files here: https://static.opendev.org/project/opendev.org/gerrit-diffs/zuul/ Barring any last-minute discoveries of something Clark or I overlooked, I think we can call this task complete. -Jim On 10/20/20 5:33 PM, Ian Wienand wrote: > As of this mail, Gerrit access has been restored. Please read on for > important information, especially around change verification. > > Background > ----------- > > On 2020-10-20 at 01:30 a user unexpectedly added a workflow approval > to a change that they were not expected to have access to. At 02:06 > UTC an alert was raised via IRC. Administrators found the account had > added themselves to a core group and made the +W vote. The account > was disabled, and removed from the groups it had added itself to by > 02:55 UTC. Administrators began to analyse the situation and Gerrit > was taken offline at 04:02 UTC to preserve state and allow for > analysis. > > From this time, administrators were working on log collection and > analysis, along with restoring backups for comparison purposes. > > By around 08:45 UTC it was clear that the privilege escalation had > been achieved by gaining control of a Launchpad SSO account with > Gerrit administrator privileges. By this time, we had ruled out > software vulnerabilities. Logs showed the first unauthorized access > of the administrator account in Gerrit on 2020-10-06. Communication > with Launchpad admins agrees with this analysis. We saw one session > opened as the administrator user to StoryBoard on this same day, but > logs show no data was modified or hidden stories viewed. > > Analysis has been performed on the Gerrit database and git trees from > October 1st, pre-dating any known unauthorized access. > > Access was restored at around 2020-10-21 00:00 UTC > > Outcomes > ----------- > > The following has been verified: > > The administrator account used has been disabled and credentials > updated > > We have verified that all group and user addition/removals since > Oct 1 are valid. The only invalid additions were made by the > compromised administrator account to add a single user account to > the Administrators group; and then that account added itself to > another known group. > > The account given administrator privilege has been removed from > the groups it added itself to and is disabled. > > There is no evidence of any unauthorized access via methods other > than Gerrit HTTP and Gerrit SSH access. > > No commits have been pushed to git trees bypassing code review. > Every git tree has been compared to the Oct 1 version and all > commits have been correctly inserted via Gerrit changes. > > The version of Gerrit we use stores HTTP API passwords in > plain-text. We know that a limited number of passwords were > gathered via the HTTP API and it is possible passwords were > gathered via the database. We thus have assumed that all HTTP API > passwords have been disclosed. This password needs to be > explicitly enabled by users, and many users do not have it > enabled. > > Remediation > ----------- > > This leaves us with the following remediation actions: > > Users should double-check their Launchpad recent activity at > https://login.launchpad.net/activity for any suspicious logins. If > found, please notify the OpenDev admins in Freenode #opendev and > Launchpad admins in #launchpad immediately. > > All HTTP API passwords have been cleared. If you push changes via > HTTPS (instead of typical SSH), are a gertty user, or run a CI > system or something else that communicates with the Gerrit HTTP > API, you will need to regenerate a password. > > Any SSH keys added to accounts since 2020-10-01 have been removed. > This affects only a limited number of accounts. This is done in > an abundance of caution, and we do not believe any accounts had > unauthorized SSH keys added > > We should audit all changes for projects since 2020-10-01. > > We have no evidence that any account had its ssh keys compromised, > thus we can rule out any unauthorized changes being uploaded via SSH. > However we can not conclusively rule out that compromised HTTP API > passwords were used to push a change through Gerrit. For example, a > change could be uploaded that looks like it came from a user, or the > API key of a core team member may have been used to approve a change > without authorization. > > Given our extensive analysis we consider it exceedingly unlikely that > this vector was used. We have had no notifications of users seeing > unexpected changes either uploaded by them, or approved by them in > projects they work on. This said, we believe it is important to > inform the community of this very unlikely, but still possible, > vulnerability of the source code. > > To this end, we have prepared a list of all changes from the known > affected period which should be audited for correctness. These are > available at > > https://static.opendev.org/project/opendev.org/gerrit-diffs/ > > Team members should browse these changes and make sure they were > correctly approved in Gerrit. If any change looks suspicious you > should notify OpenDev administrators in Freenode #opendev immediately. > > Further actions > ---------------- > > We are planning the following for the short term future: > > The Opendev administrators will be looking at alternative models > for Gerrit admin account management. > > We are already well into planning and testing a coming upgrade to > a version of Gerrit which does not store plain-text API keys. > > Longer term, we've written a spec for replacing Launchpad SSO as > our authentication provider. > > We thank you for your patience during this trying time, and we look > forward to returning to supporting the community doing what it does > best -- working together to create great things. > > > _______________________________________________ > service-announce mailing list > service-announce(a)lists.opendev.org > http://lists.opendev.org/cgi-bin/mailman/listinfo/service-announce >

2 1

[Diversity][PTG] Diversity and Inclusion WG at the PTG - Divisive Language
by Amy Marrich 23 Oct '20

23 Oct '20

The Diversity and Inclusion WG will be holding a PTG session Monday from 15:00-17:00 UTC. We will be using Meetpad[0] atleast to start but will change to Zoom if needed. Based on feedback [2] during the Forum session we will be working on providing a more comprehensive list of words and possible alternatives vs the original plan to leave this aspect within the technical groups. Thanks, Amy Marrich (spotz) 0 - https://meetpad.opendev.org/wallaby-ptg-diversity 1 - https://etherpad.opendev.org/p/wallaby-ptg-diversity 2 - https://etherpad.opendev.org/p/vSummit2020__DivisiveLanguage

1 0

client issue
by Åsmund Østvold 20 Oct '20

20 Oct '20

hi, I want to run a zuul client command and get into issues. $ zuul --version Zuul version: 3.19.1 $ zuul --zuul-url http://zuul-ci.######.net/openapi autohold-list Traceback (most recent call last): File "/home/aos/.local/share/virtualenvs/zuul-config-Lr8Y6QyF/bin/zuul", line 8, in <module> sys.exit(main()) File "/home/aos/.local/share/virtualenvs/zuul-config-Lr8Y6QyF/lib/python3.8/site-packages/zuul/cmd/client.py", line 736, in main Client().main() File "/home/aos/.local/share/virtualenvs/zuul-config-Lr8Y6QyF/lib/python3.8/site-packages/zuul/cmd/client.py", line 385, in main if self.args.func(): File "/home/aos/.local/share/virtualenvs/zuul-config-Lr8Y6QyF/lib/python3.8/site-packages/zuul/cmd/client.py", line 473, in autohold_list client = self.get_client() File "/home/aos/.local/share/virtualenvs/zuul-config-Lr8Y6QyF/lib/python3.8/site-packages/zuul/cmd/client.py", line 393, in get_client client = ZuulRESTClient(self.args.zuul_url, File "/home/aos/.local/share/virtualenvs/zuul-config-Lr8Y6QyF/lib/python3.8/site-packages/zuul/cmd/client.py", line 42, in __init__ self.session = requests.Session( TypeError: __init__() got an unexpected keyword argument 'verify' It is a http and not a https server and I suspect that it could cause the issue. Anybody know if I am doing something wrong? Cheers, Åsmund

2 5

Introducing the Open Infrastructure Foundation
by Jeremy Stanley 19 Oct '20

19 Oct '20

Hi everyone, If you’re not watching the Open Infrastructure Summit keynotes right now, you just missed some big news (and it’s not too late to tune in! https://www.youtube.com/watch?v=wNNOFfDBB0o ). Jonathan Bryce just announced the Open Infrastructure Foundation (OIF) https://openinfra.dev/ as the successor to the OpenStack Foundation (OSF). The name change reflects all of our community’s work building open infrastructure with dozens of open source components, and we could not have done it without your help. We look forward to continuing to collaborate with you over the next decade to build open source communities that write software for production. The Summit keynotes are still going, so jump on https://www.youtube.com/watch?v=wNNOFfDBB0o now to hear more about this announcement and how Zuul and other open source projects fit into the next decade of open infrastructure. You can also watch Johannes Foufas and Albin Vass from Volvo present an update tomorrow on what the community is doing and support them in the chat as they encourage Summit attendees to participate. And if you haven’t already, join as an individual member https://openinfra.dev/join/ so you can get involved! Let’s get started! -- Jeremy Stanley

1 0

Divisive Language stance final(?) draft and Forum session
by Amy Marrich 17 Oct '20

17 Oct '20

Hi everyone, Below is what we hope is the final draft of the OSF's stance on Divisive Language. If you have any comments please place them on the etherpad[0] and/or join us this Tuesday during the forum[1]. Please note that decisions related to what words should be replaced with are being left with the project's technical leadership with the knowledge that context is important to determine the best alternative. That said, the Diversity and Inclusion WG will be available to assist these groups. Thanks, Amy Marrich (spotz) 0 - https://etherpad.opendev.org/p/divisivelanguage 1- https://www.openstack.org/summit/2020/summit-schedule/events/24778/divisive… 1a - https://zoom.us/j/94295083896?pwd=VmZCTFN3eERDK1ltRHRyWDl0eG1hZz09 1b - https://etherpad.opendev.org/p/vSummit2020__DivisiveLanguage ------------------ The OpenStack Foundation (OSF) Board of Directors supports removal of wording identified as oppressive, racist and sexist by members of our communities from the software and documentation they produce. While we know there will be challenges, both technical and non-technical, this is an action we feel is important. These efforts are the responsibility of the various technical leadership groups within our communities, and we trust them to make appropriate decisions about applicability, timelines, minimizing impact to users and operators, and choosing the changes that make the most sense for their projects. Contributors will take care to make changes to software in the least disruptive way possible. While standardized wording is a laudable goal, we recognize that different implementation contexts might require different solutions. In many cases the work is also complicated by external dependencies for these projects, and their capacity to make necessary changes before we can implement ours. Terminology to which special attention should be paid includes: 1. The use of "slave," or "master" in reference to slavery-oriented relationships, as is currently found in databases, the domain name system, etc. 1. The terms "blacklist" and "whitelist" in various contexts (which might require a variety of different replacements to make sense for those contexts) 1. The use of "master" in non-slavery-related contexts such as revision control branches and documentation builds (pending feedback from our community members) We shall continue to be vigilant for other language areas that cause challenges and work with the community to evolve this policy.

1 0

how pass git tag value to build script
by Åsmund Østvold 13 Oct '20

13 Oct '20

Hi, Still a newbie ;-) I have a very simple playbook where I want to run a script with a tag argument that just was pushed or let the value be empty: - hosts: all tasks: - shell: cmd: ./build.sh {{ scm_tag }} I have tried: cmd: ./build.sh {{ zuul.tag }} This fail with variants of: The task includes an option with an undefined variable. The error was: 'dict object' has no attribute 'tag....' I was hoping to have a value that was empty if the ref-update event was not a tag. What am I doing wrong? If there exists a public zuul config for a project that I could study I would love to be pointed to it! I have spent some hours reading the OpenStack config but currently it is too complex for me to understand. A pointer to the relevant parts may help. Cheers, Åsmund

2 2

Missing doc content?
by Åsmund Østvold 10 Oct '20

10 Oct '20

Hi I am very excited to finally have convinced my company to test out Zuul. I strongly believe it is the right move. I am attempting to set up my first Zuul CI and reading doc. In page https://zuul-ci.org/docs/zuul/howtos/pti.html at the bottom it states: This is called sibbling installation, and it is critical piece to ensure cross project gating. Check out the recommended practices Cross Project Gating <https://zuul-ci.org/docs/zuul/howtos/cross-project-gating.html#cross-projec…> . With my VERY limited knowledge https://zuul-ci.org/docs/zuul/howtos/cross-project-gating.html#cross-projec… did not help me much. Is it just my very limited Zuul knowledge or is there a change that has not been merged somewhere with more content? If you know of a doc/post/howto to set up a cross project gating I would be very interested. Zuul version: 3.19.1.dev390 f73434e4 Best regards, Åsmund

2 2

zuul-client packaging for Fedora
by Matthieu Huin 09 Oct '20

09 Oct '20

Hello list, Just to let you know that the zuul-client CLI will be packaged for Fedora systems under the package "python3-zuul-client". The spec review request [1] was approved yesterday. The next step is to create the actual spec repository on Pagure. I will contribute to maintaining the package. Cheers, MHU [1] https://bugzilla.redhat.com/show_bug.cgi?id=1886485 -- Matthieu Huin Senior Software Developer Red Hat <https://www.redhat.com> <https://red.ht/sig>

1 0

Multiple executors on static node
by Vitaliy Lotorev 08 Oct '20

08 Oct '20

Hi, I'm trying to adopt Zuul. Zuul is hooked to internally hosted Gerrit and static nodes. I'm using Zuul 3.19.1. My slaves are static nodes on powerful PCs (no VM on static nodes). I feel like I'm blocked with further Zuul expansion as number of node workers is reduced (4x) compared to number of workers while we were using the same PCs on Jenkins: * Jenkins supports multiple executors on one node: it runs concurrent jobs in different directories. Increasing number of executor is just a matter of clicks in UI. * Nodepool: ** doesn't allow registering multiple nodes/workers on the same IP (Hostname/IP must be unique across all nodes defined within the configuration file). ** has max-parallel-jobs parameter [1] but still all jobs will be run in the same working directory. ** zuul/zuul-jobs @ opendev are not compatible with such scenario. I would not like to go with creating VM on PCs and registering VMs in Nodepool: * I expect 10-20% decrease in compilation speed, * I'll have to statically allocate RAM size for each VMs, this would end up in inefficient resource usage. I could go with creating multiple Docker containers on static node, but I apprehend issues with Docker in Docker scenarios. Am I missing something obvious in Nodepool static nodes, Zuul jobs? [1] https://zuul-ci.org/docs/nodepool/configuration.html#attr-providers.[static… Regards, Vitaliy

5 7

Zuul1 vs Zuul 2
by Vaishali Ghanwat (vaghanwa) 04 Oct '20

04 Oct '20

Hello, We are planning to use Zuul as an api-gateway in our project. I need more details on Zuul1 vs Zuul 2 Which one should we be using. What is recommended? If we choose Zuul1, will be able to migrate to Zuul2. Does Zuul1 support websocket and streaming APIs? Thanks Vaishali

2 1

Re: [Airship-discuss] [Diversity] Community feedback on Divisive Language stance
by Amy Marrich 30 Sep '20

30 Sep '20

Bob, Thanks for the feedback and the link. At this time we're leaving the new wording to the individual projects vs saying all OSF projects must use Y instead of X. In part it's because projects have found that words have different meanings in the context of where they're located within their code, at least in the case of blacklist/whitelist. Ultimately we're hoping to have a list of suggested replacements but realize what may work for one project may not for another. Thanks again! Amy Marrich (spotz) On Tue, Sep 29, 2020 at 5:09 PM Monkman, Bob <bob.monkman(a)intel.com> wrote: > Amy, et al, > > Thanks for sharing this and I think Draft 5 seems like a > good statement to build from. I am working on a Linux Foundation Networking > (LFN) task force looking at this issue for the projects under that > umbrella. > > As a part of that process, on our wiki page for this task > force, we have compiled some links and a table of example recommended > replacement terms that could be of interest to your OSF work as well. > > Please see this reference at > https://wiki.lfnetworking.org/display/LN/Inclusive+Language+Initiative > > If this is of interest. > > Best regards, > > Bob Monkman > > LFN Contributor, Strategic Planning Committee member, Marketing Chair > CNTT/OPNFV > > > > > > > > *From:* Amy Marrich <amy(a)demarco.com> > *Sent:* Monday, September 21, 2020 11:36 AM > *To:* starlingx-discuss(a)lists.starlingx.io; > airship-discuss(a)lists.airshipit.org; kata-dev(a)lists.katacontainers.io; > zuul-discuss(a)lists.zuul-ci.org; openstack-discuss < > openstack-discuss(a)lists.openstack.org>; foundation(a)lists.openstack.org > *Subject:* [Airship-discuss] [Diversity] Community feedback on Divisive > Language stance > > > > The OSF Diversity & Inclusion WG has been working on creating the OSF's > stance concerning divisive language. We will be holding one more meeting > before sending the stance to the OSF Board for any changes before bringing > it back to the Community. > > > > Our goal however is to get your input now to reduce any concerns in the > future! Please check out Draft 4 on the etherpad[0] and place your comments > there and join us on October 5th (meeting information will be sent out > closer to the meeting) > > > > Thanks, > > > > Amy (spotz) > > 0 - https://etherpad.opendev.org/p/divisivelanguage >

1 0

Increasing Zuul and Nodepool metrics
by Daniel Pawlik 25 Sep '20

25 Sep '20

Hi, I would like to ask for the opinion, if there are some metrics/states missing in Zuul or Nodepool metrics for you? I'm curious, if someone will be interested for getting metrics like: - zuul change are not in queued state for more than 5 hour - report queue status - provider delete node in less than 15 min (nodes are in deleting state longer than 15 min) - add into nodepool metric start time when state was changed - nodepool node creation takes longer than 15 min Thanks for feedback and other propositions. Cheers, Dan

2 2

[zuul-community] Community voting for the 2020 Open Infrastructure Summit Superuser Awards is now open!
by Jimmy McArthur 23 Sep '20

23 Sep '20

Hi everyone, It’s time for the community to help determine the winner of the 2020 Open Infrastructure Summit (https://link.getmailspring.com/link/1ED299A6-4E75-473A-A4FE-DB4234707731@ge…) Superuser Awards. The Superuser Editorial Advisory Board (https://link.getmailspring.com/link/1ED299A6-4E75-473A-A4FE-DB4234707731@ge…) will review the nominees and determine the finalists and overall winner after the community has had a chance to review and rate nominees. Now, it’s your turn. Review the nominees (https://link.getmailspring.com/link/1ED299A6-4E75-473A-A4FE-DB4234707731@ge…) and rate them (https://link.getmailspring.com/link/1ED299A6-4E75-473A-A4FE-DB4234707731@ge…) before the deadline September 28 at 11:59 p.m. PDT (https://link.getmailspring.com/link/1ED299A6-4E75-473A-A4FE-DB4234707731@ge…) Make sure to check out the Leboncoin nomination highlighting their Zuul use case! Share your top pick for the Superuser Awards on Twitter (https://link.getmailspring.com/link/1ED299A6-4E75-473A-A4FE-DB4234707731@ge…) Facebook (https://link.getmailspring.com/link/1ED299A6-4E75-473A-A4FE-DB4234707731@ge…) and LinkedIn (https://link.getmailspring.com/link/1ED299A6-4E75-473A-A4FE-DB4234707731@ge…) with #OpenInfraSummit. Cheers, Jimmy

1 0

Fwd: Forum schedule is now LIVE!
by Kendall Nelson 22 Sep '20

22 Sep '20

Hello Everyone! The forum schedule is now live: https://www.openstack.org/summit/2020/summit-schedule/global-search?t=forum Please let myself or Jimmy McArthur know as soon as possible if you see any conflicts. Speakers will be contacted shortly (if not already) with more details about the event and your sessions. Thanks! -Kendall Nelson (diablo_rojo)

1 0

[Diversity] Community feedback on Divisive Language stance
by Amy Marrich 21 Sep '20

21 Sep '20

The OSF Diversity & Inclusion WG has been working on creating the OSF's stance concerning divisive language. We will be holding one more meeting before sending the stance to the OSF Board for any changes before bringing it back to the Community. Our goal however is to get your input now to reduce any concerns in the future! Please check out Draft 4 on the etherpad[0] and place your comments there and join us on October 5th (meeting information will be sent out closer to the meeting) Thanks, Amy (spotz) 0 - https://etherpad.opendev.org/p/divisivelanguage

1 0

[Diversity] Diversity & Inclusion WG Meeting 9/21 - Removing Divisive Language
by Amy Marrich 17 Sep '20

17 Sep '20

The Diversity and Inclusion WG will be holding a meeting to continue drafting the OSF's stance on the removal of Divisive Language within the OSF projects. The WG invites members of all OSF projects to participate in this effort and to join us at our next meeting Monday, September 21, at 17:00 UTC which will be held at https://meetpad.opendev.org/osf-diversity-and-inclusion. <https://meetpad.opendev.org/osf-diversity-and-inclusion> Drafts for the stance can be found at https://etherpad.opendev.org/p/divisivelanguage If you have any questions please let me and the team know here, on #openstack-diversity on IRC, or you can email me directly. Thanks, Amy Marrich (spotz)

1 0

Farewell Party for Monty
by corvus＠inaugust.com 10 Sep '20

10 Sep '20

Hi, Monty is starting a new gig and won't be spending as much time with us. Since we all haven't seen each other in a while, let's have one more beer[1] together and say farewell. Join us for a virtual going-away party on meetpad tomorrow (Friday) at 21:00 UTC at this URL: https://meetpad.opendev.org/farewell-mordred Stop by and chat for old time's sake. -Jim [1] Bring your own beer.

1 0

[summit] CFP Deadline Soon! - Virtual Open Infrastructure Summit
by Jimmy McArthur 10 Sep '20

10 Sep '20

Hi everyone, It’s time to submit your Open Infrastructure virtual Summit presentations[1]! The CFP deadline is tomorrow. Submit sessions featuring open source projects including Airship, Ansible, Ceph, Kata Containers, Kubernetes, ONAP, OpenStack, OPNFV, StarlingX and Zuul. As a reminder, these are the 2020 Tracks: 5G, NFV & Edge AI, Machine Learning & HPC CI/CD Container Infrastructure Getting Started Hands-on Workshops Open Development Private & Hybrid Cloud Public Cloud Security Get your presentations, panels, and workshops in before August 4 at 11:59 pm PT (August 5 at 6:59 am UTC). The content submission process for the Forum and Project Teams Gathering (PTG) will be managed separately in the upcoming months. The Summit Programming Committee has shared topics by Track for community members interested in speaking at the upcoming Summit. Check out the submission tips[2]! Then don’t forget to register[3] for the virtual Open Infrastructure Summit taking place October 19-23 at no cost to you. Need more time? Reach out to speakersupport(a)openstack.org with any questions or concerns. Cheers, Jimmy [1] https://cfp.openstack.org/ [2] https://superuser.openstack.org/articles/virtual-open-infrastructure-summit… [3] https://openinfrasummit2020.eventbrite.com

1 1

Moving on
by Monty Taylor 09 Sep '20

09 Sep '20

Hi everybody, After 10 years of OpenStack, the time has come for me to move on to the next challenge. Actually, the time came a few weeks ago, but writing farewells has always been something I’m particularly bad at. My last day at Red Hat was actually July 31 and I’m now working in a non-OpenStack job. I’m at a loss for words as to what more to say. I’ve never done anything for 10 years before, and I’ll be very surprised if I do anything else for 10 years again. While I’m excited about the new things on my plate, I’ll obviously miss everyone. As I am no longer being paid by an OpenStack employer, I will not be doing any OpenStack things as part of my day job. I’m not sure how much spare time I’ll have to be able to contribute. I’m going to hold off on resigning core memberships pending a better understanding of that. I think it’s safe to assume I won’t be able to continue on as SDK PTL though. I wish everyone all the best, and I hope life conspires to keep us all connected. Thank you to everyone for an amazing 10 years. Monty

4 3

Schedule is Live for the 2020 Virtual Open Infrastructure Summit
by Jimmy McArthur 09 Sep '20

09 Sep '20

The schedule (https://www.openstack.org/summit/2020/summit-schedule) for the virtual 2020 Open Infrastructure Summit (https://www.openstack.org/summit/2020/) is now live featuring keynotes and sessions from users like Volvo, Workday, Société Générale and Ant Group. View the schedule for the 2020 virtual Open Infrastructure Summit (https://www.openstack.org/summit/2020/summit-schedule) The virtual event takes place October 19-23 and includes more than 100 sessions and thousands of attendees are expected to participate, representing 30+ open source communities from more than 100 countries. Sessions for the virtual summit are led by users from global enterprises and research institutions building and operating open infrastructure at scale. The Summit includes: Sessions spanning 30+ open source projects from technical community leaders and organizations including Alibaba Cloud, AT&T, China Mobile, CERN, European Weather Cloud, GE Digital and Volvo Cars and many more. Collaborative sessions with project leaders and open source communities, including Airship, Ansible, Ceph, Docker, Kata Containers, Kubernetes, ONAP, OpenStack, Open vSwitch, OPNFV, StarlingX, and Zuul. Hands on workshops around open source technologies led by the developers and operators building the software. The updated Certified OpenStack Administrator (COA) (https://www.openstack.org/coa) exam will be available where you can test your OpenStack knowledge at the COA sessions, sponsored by the OpenStack Foundation, in collaboration with Mirantis. Now what? Register for your free virtual Summit pass (https://www.eventbrite.com/e/open-infrastructure-summit-2020-tickets-969672…) and meet the users, developers, and vendors who are building and operating open infrastructure on October 19-23! Thank you to our Summit Headline, Premier and Exhibitor sponsors: Huawei, Cisco, InMotion Hosting, Trilio and ZTE. Event sponsors gain visibility with a wide array of open source infrastructure developers, operators and decision makers. Download the Open Infrastructure Summit sponsor prospectus (https://www.openstack.org/summit/2020/sponsors/) for more information. Questions? Reach out to summit(a)openstack.org (mailto:summit@openstack.org) “See you” in October! Cheers, Jimmy

1 0

2020 Virtual Summit: Forum Submissions Now Accepted
by Jimmy McArthur 01 Sep '20

01 Sep '20

Hello Everyone! We are now accepting Forum [1] submissions for the 2020 Virtual Open Infrastructure Summit [2]. Please submit your ideas through the Summit CFP tool [3] through September 14th. Don't forget to put your brainstorming etherpad up on the Shanghai Forum page [4]. This is not a classic conference track with speakers and presentations. OSF community members (participants in development teams, operators, working groups, SIGs, and other interested individuals) discuss the topics they want to cover and get alignment on and we welcome your participation. The Forum is your opportunity to help shape the development of future project releases. More information about the Forum [1]. The timeline for submissions is as follows: Aug 31st | Formal topic submission tool opens: https://cfp.openstack.org. Sep 14th | Deadline for proposing Forum topics. Scheduling committee meeting to make draft agenda. Sep 21st | Draft Forum schedule published. Crowd sourced session conflict detection. Forum promotion begins. Sept 28th | Forum schedule final Oct 19th | Forum begins! If you have questions or concerns, please reach out to speakersupport(a)openstack.org. Cheers, Jimmy [1] https://wiki.openstack.org/wiki/Forum [2] https://www.openstack.org/summit/2020/ [3] https://cfp.openstack.org [4]https://wiki.openstack.org/wiki/Forum/Virtual2020

1 0

[Diversity] Diversity & Inclusion WG Meeting 8/31 - Removing Divisive Language
by Amy Marrich 27 Aug '20

27 Aug '20

The Diversity & Inclusion WG has taken on the task from this week's Board meeting to assist with the development of the OSF's stance on the removal of Divisive Language within the OSF projects. The WG invites members of all OSF projects to participate in this effort and to join us at our next meeting Monday, August 31, at 17:00 UTC which will be held at https://meetpad.opendev.org/osf-diversity-and-inclusion. <https://meetpad.opendev.org/osf-diversity-and-inclusion> The agenda can be found at https://etherpad.openstack.org/p/diversity-wg-agenda. If you have any questions please let me and the team know here, on #openstack-diversity on IRC, or you can email me directly. Thanks, Amy Marrich (spotz)

1 0

Enabling ANSI output display in zuul
by Sorin Sbarnea 26 Aug '20

26 Aug '20

I initially proposed the first version for ANSI support about 6 months ago, but still we do have native ANSI display for output. Please take a look at review below, I even included screenshots. https://review.opendev.org/#/c/739444/ I fact I do have a longer list of changes ready for review that aim to improve the web UX experience: https://review.opendev.org/#/q/topic:zuul-ux+(status:open+OR+status:merged) Thanks Sorin

1 0

Addressing users needs via the CLI
by Matthieu Huin 20 Aug '20

20 Aug '20

Hello, I would like to discuss the current state of Zuul's CLI, especially from a user's point of view. We can identify two types of Zuul users, as reflected in its documentation: service administrators, and project contributors. The admins perform maintenance tasks on the services. The projects contributors, or users to make it simple, check the status of their builds, encrypt secrets to be used in jobs, and retrieve jobs artifacts. Historically the Zuul client CLI was meant to be used by admins to perform maintenance tasks. It assumed access to Zuul's gearman server; so usually it would be run directly on Zuul's instance by operators. Some other admin scripts also live in the tools directory of the zuul repository, like zuul-changes.py and zuul-clear-refs.py. As for users, there's encrypt_secret.py for secrets, and everything else happens in the GUI. However since v3 landed, many Zuul deployments implement multitenancy, and JWT authentication was added a while ago along with the tenant-scoped admin REST API, which covers most of the available gearman RPC commands. This introduces a third type of users: the tenant admins, who should be allowed to perform base maintenance tasks related to their tenant. I believe this is a request most of us Zuul operators have heard from our users. Until authentication lands in the web UI, the only way for tenant admins to perform their tasks is to use the REST API with an admin-issued token. This is why I have added support for the REST API in the admin CLI a while ago. As the REST API coverage increases, I imagined adding functionalities to the admin CLI that would fit more the needs of regular users, such as the possibility to stream a job's console log in a terminal. The problem is that it denatures the primary purpose of this CLI as a tool for operators. Thus I am proposing a split in the CLI, as in this review: https://review.opendev.org/#/c/729236/ The zuul-web-cli would address the use cases of tenant admins, and provide automation tools to regular users outside of the GUI. I would like for example to integrate the encrypt-secret.py tool in it, to streamline the user experience. Now the question is, should this "non-op" CLI live in the Zuul repository, or have its own dedicated project? Should it exist at all, or should we instead let users develop their own custom-tailored tools around the REST API? On the other hand, should admin tools like zuul-changes.py be integrated into the admin CLI? Let me know what you think! Cheers, -- Matthieu Huin Senior Software Developer Red Hat <https://www.redhat.com> <https://red.ht/sig>

3 3

Re: Zuul POC : Facing issues while configuring pipeline in Zuul;.
by Divya sopan Hole 19 Aug '20

19 Aug '20

Hi James, I have configured the same in /etc/zuul/ and /etc/nodepool/ as per documentations given http://zuul-ci.org/ in my ubuntu-server system and the same configuration of zuul.conf, main.yaml and nodepool.yaml in respective folders etc_zuul and etc_nodepool can be found in given GitHub repo link https://github.com/zuul-org/zuul-test I have configured jobs.yaml, project.yaml and pipelines.yaml (Github driver) under zuul.d And the jobs.yaml is dependent on testjob.yaml These are the following findings after running on localhost:9000 You can find the screenshot of* status, jobs, projects, builds, buildsets, nodes and tenant * in the given github repository mentioned above. 1. I am unable to see the build history of jobs and screen shows "Loading..." Please, provide a proper solution so that I can see my builds. 2. Where can I see a console log of builds section on my system? 3. I found error while running zuul-scheduler 4. I have tried to commit changes in repository and pushed the changes but I am not able to see any changes in the pipeline of Zuul dashboard Example - Coloured bars in check pipeline or gate pipeline I have followed the same procedure as provided by you .Thank you for your input . Thanks & Regards, Divya Hole. On Tue, Aug 18, 2020 at 6:44 PM Divya sopan Hole <divyasopanhole(a)gmail.com> wrote: > Hi James, > > I have configured the same in /etc/zuul/ and /etc/nodepool/ as per > documentations given http://zuul-ci.org/ > in my ubuntu-server system and the same configuration of zuul.conf, > main.yaml and nodepool.yaml in respective > folders etc_zuul and etc_nodepool can be found in given GitHub repo link > https://github.com/zuul-org/zuul-test > > I have configured jobs.yaml, project.yaml and pipelines.yaml (Github > driver) under zuul.d > And the jobs.yaml is dependent on testjob.yaml > > These are the following findings after running on localhost:9000 > You can find the screenshot of* status, jobs, projects, builds, > buildsets, nodes and tenant*. > > 1. I am unable to see the build history of jobs and screen shows > "Loading..." Please, provide a proper solution so that I can see my builds. > 2. Where can I see a console log of builds section on my system? > 3. I found error while running zuul-scheduler > > I have followed the same procedure as provided by you .Thank you for your > input . > Thanks & Regards, > Divya Hole. > > On Tue, Aug 18, 2020 at 3:35 AM James E. Blair <corvus(a)inaugust.com> > wrote: > >> Divya sopan Hole <divyasopanhole(a)gmail.com> writes: >> >> > Hello Team, >> > >> > We are doing POC on Zuul implementation on cloud infrastructure. >> > >> > During implementation we are stuck in pipeline creation & also not able >> to >> > see any zuul status on GitHub. >> >> Hi! Sorry you ran into problems, but hopefully we can fix them and make >> our documentation better. >> >> First, did you try going through the Zuul quickstart? >> >> You can find it here: >> https://zuul-ci.org/docs/zuul/tutorials/quick-start.html >> >> It uses Gerrit rather than Github, but the basic setup is the same, so >> it should help answer some of these questions. >> >> > Problem Title: Facing issues while configuring CI CD pipeline in Zuul >> > >> > OS , Tools & version: Ubuntu (VM), Zuul 3.0, github.com >> > >> > Description of the problem: >> > >> > 1.Where should the config files need to be placed? Config files such as >> > pipeline.yaml , .zuul.yaml etc. >> >> Pipeline and other configuration should go in a .zuul.yaml or zuul.yaml >> file in the root of a config-project. Or they can go in multiple files >> in the .zuul.d or zuul.d directory. Start by creating a dedicated git >> repo for holding these, and add files as you see fit. >> >> This part of the quickstart addresses this: >> >> >> https://zuul-ci.org/docs/zuul/tutorials/quick-start.html#configure-zuul-pip… >> >> > 2.Where should the config project and untrusted project reside and how >> to >> > define it ? >> > (Like full path or repo address) >> >> It can be named anything and reside anywhere. Since you're using >> Github, I'd suggest a Github project in the same Github org you usually >> use. For example, you might create a repo at >> github.com/example/zuul-config. >> >> After you create that, add it to the Zuul tenant config file. The >> quickstart does not talk about this. Perhaps it should. We usually >> place it in "/etc/zuul/main.yaml" on the zuul scheduler. Here's the >> documentation for it: >> >> https://zuul-ci.org/docs/zuul/reference/tenants.html >> >> You'll want to make it look something like this: >> >> - tenant: >> name: my-tenant >> report-build-page: true >> source: >> github: >> config-projects: >> - example/zuul-config >> >> Where the last line is the name of the repo you just created. You >> should also add whatever repos you want to test after that: >> >> untrusted-projects: >> - example/test-project >> >> > 3.We configured our pipelines and all in a separate github repo but does >> > not show "builds"(zuul dashboard showing continuously loading. >> > It is not showing any build reports on Github ) >> >> If you don't even see empty pipelines on the dashboard, then the >> scheduler may not have loaded the configuration correctly. Start by >> looking at the logs for the zuul-scheduler process and see if there are >> warnings or errors there. >> >> > 4.We are currently running all jobs in localhost that means no nodes >> apart >> > from localhost. >> > Do we need extra nodes to run the jobs ? >> >> No other nodes are needed, but I would recommend this: >> >> * Start by only running "noop" jobs. They are entirely internal and >> don't do anything. That helps you get the main system up and running. >> >> * You can run jobs on "localhost" (using zero-node nodesets), but what >> you can run there is fairly restricted unless the job is defined in a >> config-project. >> >> * Since you're doing a proof of concept, I'd suggest the next step after >> running noop would be to set up a nodepool launcher with a static >> node. That will let you run some basic jobs on an existing server (or >> vm, or container) without worrying too much about nodepool setup. >> >> * After that, move on to using "real" resources (whether those are >> containers, vms, or real static servers). >> >> > Steps tried: >> > >> > 1.Created Github App using the link : >> > https://probot.github.io/docs/development/#generating-a-new-app >> > >> > 2.Tried configuring Zuul pipeline.yaml under zuul-test-conf repo and >> > .zuul.yaml >> > >> > 3.Added an initial pipeline configuration to >> > the zuul-test-config repository. >> > Inside that project, we have created a zuul.yaml file. >> > >> > 4.In the zuul-test project, created a .zuul.yaml file with the following >> > contents: >> > >> > project: >> > check: >> > jobs: >> > - noop >> > >> > Can you please help us on the solution or documentation where we can >> look >> > for? >> >> That all looks good. The main thing I see missing is the tenant >> configuration. So I'm guessing if you check your scheduler log, it will >> tell you it is incorrect or missing. >> >> -Jim >> >

1 0

Zuul is now available in Fedora
by Fabien Boucher 18 Aug '20

18 Aug '20

Hi, I would like to share that Zuul is now packaged into Fedora. It will be available with the next Fedora 33 [1]. Nodepool is also part of Fedora. Zuul and Nodepool packages source are available here: [2] and [3]. If you are interested, help will be welcome to keep those packages into Fedora so do not hesitate to propose PRs. PRs are validated by Zuul already [4] (build, lint, functional tests [5]). Regards Fabien Boucher [1]: https://koji.fedoraproject.org/koji/packageinfo?packageID=24098 [2]: https://src.fedoraproject.org/rpms/zuul [3]: https://src.fedoraproject.org/rpms/nodepool [4]: https://src.fedoraproject.org/rpms/zuul/pull-request/3 [5]: https://src.fedoraproject.org/rpms/zuul/blob/master/f/tests/tests.yml

2 1

Zuul POC : Facing issues while configuring pipeline in Zuul;.
by Divya sopan Hole 18 Aug '20

18 Aug '20

Hello Team, We are doing POC on Zuul implementation on cloud infrastructure. During implementation we are stuck in pipeline creation & also not able to see any zuul status on GitHub. Problem Title: Facing issues while configuring CI CD pipeline in Zuul OS , Tools & version: Ubuntu (VM), Zuul 3.0, github.com Description of the problem: 1.Where should the config files need to be placed? Config files such as pipeline.yaml , .zuul.yaml etc. 2.Where should the config project and untrusted project reside and how to define it ? (Like full path or repo address) 3.We configured our pipelines and all in a separate github repo but does not show "builds"(zuul dashboard showing continuously loading. It is not showing any build reports on Github ) 4.We are currently running all jobs in localhost that means no nodes apart from localhost. Do we need extra nodes to run the jobs ? Steps tried: 1.Created Github App using the link : https://probot.github.io/docs/development/#generating-a-new-app 2.Tried configuring Zuul pipeline.yaml under zuul-test-conf repo and .zuul.yaml 3.Added an initial pipeline configuration to the zuul-test-config repository. Inside that project, we have created a zuul.yaml file. 4.In the zuul-test project, created a .zuul.yaml file with the following contents: project: check: jobs: - noop Can you please help us on the solution or documentation where we can look for? Regards, Divya Hole

2 1

Forum Brainstorming
by Kendall Nelson 18 Aug '20

18 Aug '20

Hello Everyone! The Virtual Forum is approaching. We would love 1 volunteer from the community for the Forum Selection Committee. Ideally, the volunteer would already be serving in some capacity in a governance role for your project. In addition to calling for volunteers for the Forum selection committee, this email kicks off the brainstorming period before the CFP tool opens for formal Forum submissions. The categories for brainstorming etherpads have already been setup here[1]. Please add your etherpads and ideas there! The CFP tool will open on August 31st and will close September 14th. For information on the upcoming virtual Summit[2]. For more information on the Forum[3]. Please reach out to jimmy(a)openstack.org or knelson(a)openstack.org if you're interested. Volunteers should respond on or before August 31, 2020. Thanks! Kendall (diablo_rojo) [1] Virtual Forum 2020 Wiki: https://wiki.openstack.org/wiki/Forum/Virtual2020 [2] Virtual Open Infra Summit Site: https://www.openstack.org/summit/2020 [3] General Forum Wiki: https://wiki.openstack.org/wiki/Forum

1 0

vPTG October 2020 Team Signup
by Kendall Nelson 13 Aug '20

13 Aug '20

Greetings! As you hopefully already know, our next PTG will be virtual again, and held from Monday October 26th to Friday October 30th. We will have the same schedule set up available as last time with three windows of time spread across the day to cover all timezones with breaks in between. *To signup your team, you must complete **BOTH** the survey[1] AND reserve time in the ethercalc[2] by September 11th at 7:00 UTC.* We ask that the PTL/SIG Chair/Team lead sign up for time to have their discussions in with 4 rules/guidelines. 1. Cross project discussions (like SIGs or support project teams) should be scheduled towards the start of the week so that any discussions that might shape those of other teams happen first. 2. No team should sign up for more than 4 hours per UTC day to help keep participants actively engaged. 3. No team should sign up for more than 16 hours across all time slots to avoid burning out our contributors and to enable participation in multiple teams discussions. Again, you need to fill out BOTH the ethercalc AND the survey to complete your team's sign up. If you have any issues with signing up your team, due to conflict or otherwise, please let me know! While we are trying to empower you to make your own decisions as to when you meet and for how long (after all, you know your needs and teams timezones better than we do), we are here to help! Once your team is signed up, please register! And remind your team to register! Registration is free, but since it will be how we contact you with passwords, event details, etc. it is still important! Continue to check back for updates at openstack.org/ptg. -the Kendalls (diablo_rojo & wendallkaters) [1] Team Survey: https://openstackfoundation.formstack.com/forms/june2020_virtual_ptg_survey [2] Ethercalc Signup: https://ethercalc.openstack.org/126u8ek25noy [3] PTG Registration: https://october2020ptg.eventbrite.com

1 2

Looking for more Zuul user stories
by Jeremy Stanley 13 Aug '20

13 Aug '20

Zuul's Web site has a page dedicated to users and their stories: https://zuul-ci.org/users.html We have nearly a dozen so far, but we want yours too (and if it's already there, maybe you have new details now that you've been relying on Zuul for longer?). Whether you're running Zuul yourself or your project is taking advantage of a shared Zuul deployment, the editors of SuperUser would love to hear from you. The easiest way is to take the Zuul User Survey linked from the top of the page above and indicate that you're willing to tell your story, but you can also contact the SuperUser editors at editor(a)openstack.org or see the Editorial Guidelines here: https://superuser.openstack.org/editorial-guidelines/ Zuul is becoming wildly popular as people increasingly realize they have needs only it is designed to solve, so there are certain to be more stories about it we haven't heard yet. Please tell yours too! -- Jeremy Stanley

1 0

Virtual PTG October 2020 Dates & Registration
by Kendall Nelson 11 Aug '20

11 Aug '20

Hello Everyone! I'm sure you all have been anxiously awaiting the announcement of the dates for the next virtual PTG! After polling the community[1] and balancing the pros and cons, we have decided the PTG will take place the week after the Open Infrastructure Summit[2][3] from October 26th to October 30th, 2020. PTG registration is now open[4]. Like last time, it is free, but we will again be using it to communicate details about the event (schedules, passwords, etc), so please register! Later this week we will send out info about signing up teams. Also, the same as last time, we will have an ethercalc signup and a survey to gather some other data about your team. -the Kendalls (diablo_rojo & wendallkaters) [1] ML Poll for PTG Dates: http://lists.openstack.org/pipermail/openstack-discuss/2020-July/016098.html [2] Summit Site: https://www.openstack.org/summit/2020/ [3] Summit Registration: https://openinfrasummit2020.eventbrite.com [4] PTG Registration: https://october2020ptg.eventbrite.com

1 0

Use TLS Zookeeper and a SQL db, or pin to Zuul / Nodepool 3.x
by corvus＠inaugust.com 04 Aug '20

04 Aug '20

Hi, As part of the upgrade path to Zuul v5, which will feature a fully distributed system (including schedulers), we need to make some incompatible changes. You can continue to continuously deploy Zuul (we will in OpenDev), but only if you have already made the required changes. As a reminder, here is the overall plan for v4/v5: http://lists.zuul-ci.org/pipermail/zuul-discuss/2020-March/001158.html And here are the required changes: * TLS ZooKeeper connections [1] * Network connectivity from all components to ZooKeeper * A SQL database [2] They are described in more detail in the release notes: https://zuul-ci.org/docs/zuul/reference/releasenotes.html#relnotes-3-19-0 Starting immediately we will begin merging the changes to implement this process. That means that if you are continuously deploying Zuul, you must either have these changes in place as of now, or pin your installation to a 3.x release while you make those changes. I encourage everyone to do this ASAP, so that you can continue to closely track Zuul development. The path from v3 to v5 is intended to be smooth and one that we can all incrementally follow. They key to this is not falling behind at the beginning. -Jim [1] https://zuul-ci.org/docs/zuul/howtos/zookeeper.html#zk-encrypted-connections [2] https://zuul-ci.org/docs/zuul/reference/drivers/sql.html#sql-driver

1 0

Jenkins support in Zuul v3
by T, Mohamednisar (Nokia - IN/Bangalore) 27 Jul '20

27 Jul '20

Hello Zuul team, Thank you for developing sunch a wonderful gating system. We were using zuul v2 with Jenkins and gearman. We understood that, zuul wanted move away from Jenkins to ansible jobs. As Zuul v2 is deprecated and We would like to use Jenkins with zuul v3, I have two questions 1. Is there any plan to support Jenkins in v3. 2. If we add the feature to support Jenkins in v3 using gearman, is it possible to upstream the changes back to zuul Thanks & Regards, Nisar T

2 1

October/November PTG Date Selection
by Kendall Waters 27 Jul '20

27 Jul '20

Hello Everyone! We wanted to get your input on the best dates for holding the PTG now that its been annouced that the Summit itself will be virtual[1]. Please fill out the CIVS poll by August 3 at 15:00 UTC. We really appreicate your feedback! Poll: https://civs.cs.cornell.edu/cgi-bin/vote.pl?id=E_a69944444a9b7c93&akey=3ecc… <https://civs.cs.cornell.edu/cgi-bin/vote.pl?id=E_a69944444a9b7c93&akey=3ecc…> There are obviously many pros and cons to each option, below are the conflicts/reasons why we might not want to select that option. Option 0 - Two weeks before Summit (October 5-9) Conflicts with RC work External Event Conflicts: None? Option 1 - One week after Summit (October 26-30) Halloween on Oct 31 Perfect for release timing but event fatigue is a real concern External Event Conflicts: Open Source Summit EU, ODSC Open Data Science Conference East Cloud Foundry Summit EU, KVM Forum Option 2 - Two weeks after the Summit (November 2-6) USA Election day on Nov 3; could be a distraction, contributors needing to go vote (whatever that looks like with the virus), news, etc. Event Conflicts: None? Option 3 - Three weeks after the Summit (November 9-13) Pushes far into the cycle (4 weeks after previous release, a bit late, Veterns day/holiday - may affect France and Germany and US) External Events Conflicts: VMWorld EU -The Kendalls (diablo_rojo & wendallkaters) [1] http://lists.openstack.org/pipermail/openstack-discuss/2020-July/016068.html <http://lists.openstack.org/pipermail/openstack-discuss/2020-July/016068.html>

1 0

Enabling the preferences dialog
by Sorin Sbarnea 23 Jul '20

23 Jul '20

Can we please enable the preferences dialog on Zuul? Over the last few months I was asked on multiple occasions about making some UI changes optional/configurable in zuul. So I added it, assured it fits well in the new pf4 UI, and struggle to convince other cores to review it. Please, take a look at https://review.opendev.org/#/c/723603/ and help me finish it. I guess that once first one goes in, it will much easier to review other ones. There are few other changes are waiting for the preference dialog: configure how many lines of code are included in abridged view (hardcoded to 42 now) ability to enable/disable ANSI rendering move of auto-reload option to preferences I know that previously it was mentioned a possible conflcit with "login" feature Matthew Huin was working on. Still the reality is that: user preferences is not linked to login and must work without login many deployments will not enable login due to performance concerns login change is outdated and not touched in more than a month, far away from being merged. Also please accept my apologies for nagging few of you over the last weeks about my (boring) UI changes. I hope that using the mailing list would be less intrusive and maybe more effective. Cheers, Sorin

2 1

Can me migrate zuul-jobs towards being an Ansible collection?
by Sorin Sbarnea 23 Jul '20

23 Jul '20

As I really like the quality and reusability of roles present in zuul-jobs, I would like to have bit more flexibility regarding installing them, basically being able to package them and install them as a collection. Can we agree on going into the direction of publishing it as collection in galaxy? The only major issue we have is that galaxy requires all roles not to use dashes, underlines being accepted. I think it may be possible to perform a slow transition by creating symlinks, maybe even combined with a rename of only those that are generic enough, like ensure ones. The idea is that is impossible to publish a collection that contains roles with underlines and this is not going to change. Still, it is possible to package only a set of directories in your collection, ignoring others. The second issue I am aware of is related to documentation. Galaxy expects documentation as markdown and also the meta file. That is not such a big deal as Sphinx can build documentation from both using myst-parser extension. If we agree that we want to go this path, probably it would make sense to start with a one role collection and slowly migrate others. Cheers Sorin Sbarnea

2 1

Moving zuul UI preferences in a single location
by Sorin Sbarnea 06 Jul '20

06 Jul '20

As the number of configurable user preferences seems to be growing (see list below), I think is time to put them in a single place, instead of scattering them in various places in the UI, as this would only clutter it. Also it does not scale well. - timezone config (now on top nav bar) - ability to configure log wrapping on/off (requested) - ability to enable/disable ANSI support (also requested due to performance concerns) - auto-reload on status page - other future options I proposed adding a config icon that popup a dialog where we can put these configurations. https://sbarnea.com/ss/Screen-Shot-2020-07-06-13-43-58.png https://review.opendev.org/#/c/739482/1 - adds the config dialog, dialog is now empty bu the goal was to demonstrate how it would work first. I also proposed removal of cookies and replacement with localStorage, which allowed us to simplify the code and also avoid the GDPR legal issues https://review.opendev.org/#/c/739454/ Regarding enabling ANSI support, there are two alternatives proposed (each using a different react ANSI library) https://review.opendev.org/#/c/739444/ -- via react-ansi (more terminal like, with line numbers) https://review.opendev.org/#/c/716251/ -- via ansi-to-react If we consolidate user configurable preferences into a single screen and make use of localStore it may be much easier to gradually introduce changes in zuul, as we can make them opt-ins. What do you think? Cheers Sorin

2 1

Making yum errors visible by default in zuul
by Sorin Sbarnea 05 Jul '20

05 Jul '20

Few weeks back I proposed a change that would expose the "failures" list of errors in zuul UI when a module returns it, similar to stdout and stderr. The change got in limbo after @corvus remarked that this is not a standard way to return errors for modules. He mentioned that they could get to the full output by pressing the failed button (which is another UX issue by itself because is presented as a label, only few people would guess that this is clickable). The reality more ugly than this, and finding the error for a non-veteran zuul user is a real adventure: * Once landed on the "summary" page the user would see only the "Failed to install some of the specified packages", yep **some**, not the list. * There is no butten user can press from summary page to open full return list. * Hopefully user will decide to pick "console" tab instead of "logs" which would likely confuse him more * Once landed on console page, at least he would see the failed task as red, but still w/o required details * Now he would have to guess that the red [FAILED] block is clickable * After he clicks it, he would finally get to the "failures" list. https://review.opendev.org/#/c/734833/ Returning failures was the behavior of yum module for a very long time and there are no plans to change it from Ansible side (see linked bug). Yum module is one of the most used ones, also a core plugin. Considering that my proposal was to make the field visible in summary and preview happens only when a task failed and contains that field, why do we prefer to cripple the user experience for all users? Even if Ansible would decide to magically make the msg from yum module better, this will not help us for many years. Such a change would not lang sooner than 2.11, which means that at least two more years until we will display friendly errors. I know that likely most, if not all members of zuul-discuss have a good knowledge of Zuul, so you are likely to already know stuff that is not obvious. I encourage you to step back and consider what a first-time contributor, that never used Zuul, would see and do when it gets his first CI failure. The reason why I am writing this is that I am aware of several other UX issues with zuul and I personally faced some less then pleasant feedback from first time users over the last year, especially after I helped enabling Zuul CI on Ansible molecule and ansible-lint projects. I would be very happy if you would join me in my quest for improving Zuul user experience, especially from the browser point of view. Thanks Sorin Sbarnea

2 1

[Diversity] Diversity & Inclusion WG Meeting 7/6
by Amy Marrich 03 Jul '20

03 Jul '20

The Diversity & Inclusion WG invites members of all OSF projects to our next meeting Monday, July 6th, at 17:00 UTC in the #openstack-diversity channel. The agenda can be found at https://etherpad.openstack.org/p/diversity -wg-agenda. We will be discussing changing our Wiki page to reflect the broader OSF projects and communities so that the page reflects our mission. Please feel free to add any other topics you wish to discuss at the meeting. Thanks, Amy (spotz)

1 0