March 2020 - Zuul-discuss - lists.opendev.org

[Zuul Community] Virtual OpenDev Update
by Jimmy McArthur 01 Apr '20

01 Apr '20

Hi everyone, As we continue to gather feedback and discuss what a virtual OpenDev will look like, we wanted to provide you with an update around the event. While we are still attempting to solve some of the riddles of virtual event world, we did come up with some decisions that give us something to build on, which are based on input and experience from members of the Programming Committee. Decisions: - OpenDev will happen after the Virtual PTG (exact format and timing TBD) - Will not be simultaneous/parallel Tracks so everyone has the opportunity to participate in more than one - 3 Tracks, each on different date: - Hardware Automation - Large Scale Ops - Containers in Production We also discussed the original intent and goals of OpenDev to make sure we’re still heading in a direction that’s beneficial for the community, especially since it will no longer directly precede the upcoming PTG. Similar to past OpenDev events, the goal is to identify the questions we don’t have the answers for, and to use that time to dive in and determine the work ahead of us, working together, sharing use cases, and learning from other people asking those same questions. High-level decisions, goals, and some areas we’re looking for feedback are in the etherpad below. As you continue to experience this new amazing world of virtual events, please add any feedback or ideas to the etherpad below. We’re looking forward to creating virtual OpenDev with you all! https://etherpad.openstack.org/p/Virtual_OpenDev_Planning Ashlee Ashlee Ferguson Community & Events Coordinator OpenStack Foundation

1 0

Keeping linear Git history for Zuul-gated projects
by Vitaliy Lotorev 01 Apr '20

01 Apr '20

Hi, I'm evaluating Zuul for project gating. Currently my team is using Fast Forward Only submit strategy [1] with Gerrit Autosubmitter plugin [2]. Code-Review labels are copied if change is rebased trivially (no code change). We use Fast Forward to keep Git history without merges and I wouldn't like to loose this feature while switching to Zuul. I see that all projects gated with Zuul (e.g. Zuul itself, OpenStack) are using Merge If Necessary strategy. My confusion is: Gerrit has six different merge strategies and Zuul is responsible for merging all the code. Is there any combination of Gerrit/Zuul settings to preserve linear Git history? I'm trying to understand what is wrong with Rebase If Necessary and Cherry Pick strategies. Why these strategies are not preferred for Zuul-gated projects? Will Zuul fetch random commits from A-B-C chain while using Cherry Pick or it will try to preserve the order? [1] https://gerrit-review.googlesource.com/Documentation/concept-changes.html#s… [2] https://gerrit.googlesource.com/plugins/autosubmitter/ Regards, Vitaliy

5 6

Fwd: [all] Virtualized PTG Brainstorming Community Meetings
by Kendall Nelson 31 Mar '20

31 Mar '20

Hello Everyone! So! After Marks initial email[1] that announced we would be virtualizing the PTG and collected volunteers[2] to help brainstorm the best way to hold the PTG virtually, we polled the volunteers for the best times to meet. In trying to be the most inclusive we have settled on three meetings to brainstorm together as a community. They are as follows: - April 2nd at 12:00 UTC - April 6th at 17:00 UTC - April 7th at 2:00 UTC We will be using my zoom[3] and continue using the same etherpad [2] that we collected volunteers in for all the notes from all three meetings. All are welcome! And if you can attend more than one meeting, please do! The more overlap we have the more cohesive discussions we will have. Hope to see you all there! -Kendall Nelson (diablo_rojo) [1] http://lists.openstack.org/pipermail/foundation/2020-March/002854.html [2] https://etherpad.openstack.org/p/Virtual_PTG_Planning [3] https://zoom.us/my/diablorojo

1 0

User Survey for Zuul
by Jimmy McArthur 28 Mar '20

28 Mar '20

The OSF would like to help put together a User Survey with the Zuul Community to see if we can find out how your users are using Zuul in production. This would be an anonymized survey, but would hopefully give the project greater insight into ways that people are using the software and how to make improvements/changes moving forward. If this sounds like something people are interested in, let me know and I'll start an etherpad with some basic questions. If you'd like to see an example of a survey we worked with the Kata community on, you can take a look at a PDF here: https://drive.google.com/file/d/1gZd2rh2jG2IkKBmhBeqFyB-KZCBrHLni/view?usp=… If this seems like a horrible idea, please don't hesitate to tell me that as well :) Cheers, Jimmy

8 26

How & Where to Contribute Zuul Content
by Allison Price 27 Mar '20

27 Mar '20

Hi everyone, As more users start telling their stories about running Zuul in production and accompanied by the amount of events that have been transformed to virtual experiences, I wanted to reach out to the community to make sure everyone was aware of the community channels we have available to share case studies / tutorials / project news as well as increasing the visibility of software updates and release features. As of yesterday, we had an OpenStack user reach out about how to find bug fix updates online more easily, and I think that this could happen for Zuul very soon too. Since Zuul doesn’t have a blog, I would love to discuss where software updates and bug fixes could live beyond the mailing list so that it’s a bit more discoverable for newbies. One option would be putting a Blog section up on Zuul's website. Another could be choosing an open source blogging platform that we could link to (ideally under a Zuul subdomain). Thoughts? Another place the Zuul Community can contribute is Superuser <https://superuser.openstack.org/>. Here's what kind of content you can share and how to contribute: Superuser has evolved to cover the open infrastructure landscape covering different use cases and open source projects. Whether it’s a video or an article, this content is typically more in depth than what you would see on a project blog and includes things like hands on tutorials, case studies, thought leadership articles, Q&As with open source community leaders, and updates and highlights from open source events around the world. If you have an idea you would like to share, fill out this form <https://superuser.openstack.org/contribute/> and the editorial team will reach out. If you have questions about whether your topic is the right fit, email editor(a)openstack.org <mailto:editor@openstack.org>. You can also attend the OSF community meeting <http://lists.openstack.org/pipermail/foundation/2020-March/002856.html>next week to learn more about how you can get involved and contribute! Thanks! Allison Allison Price OpenStack Foundation allison(a)openstack.org

1 0

Farewell Zuulers
by David Shrewsbury 27 Mar '20

27 Mar '20

Hi fellow Zuulers, It turns out that burnout is a real thing, and all the nastiness that comes along with it. Having been in the OpenStack/Zuul world for 8 years (wow), I feel like it's time for me to move on to new things. Effective this week, I'm giving up my core status on all-the-things, but I absolutely know that I'm leaving it all in awesomely capable hands. I'll miss working with you all, and it has been my absolute pleasure to have worked with you. You've each made me better in some way, and I appreciate it. Happy Zuuling, Shrews

3 2

Take the Zuul User Survey
by Jimmy McArthur 25 Mar '20

25 Mar '20

Are you a Zuul user? Please take a few moments to fill out the Zuul User Survey to provide feedback and information around your deployment. All information is confidential to the OpenStack Foundation and Zuul community leaders, unless you designate it can be made public. We use this valuable information to help shape the future of the software and provide much needed feedback to our development community. Thanks! Jimmy

1 1

Fwd: [OpenStack Foundation] Update on OpenDev + PTG (Vancouver)
by Jimmy McArthur 19 Mar '20

19 Mar '20

Hi all - Please have a look at this from OSF re: upcoming events: > *From:* Mark Collier <mark(a)openstack.org> > *Date:* March 18, 2020 at 3:33 PM > *To:* foundation(a)lists.openstack.org > *Subject:* [OpenStack Foundation] Update on OpenDev + PTG (Vancouver) > Hi everyone, > > Based on the input from the community, board, and the latest information available from the health experts, we've made the decision not to hold the OpenDev + PTG in Vancouver this June. Instead, we're exploring ways to turn it into a virtual event and would love the help of everyone in the community. > > We will be reaching out to participants who have already registered to issue full refunds. > > We have always aimed to produce events "of the community, by the community," and this change for OpenDev + PTG is no exception. We would like to virtualize the PTG, since it is critical to producing the next release, targeting the same timeframe. We would like to recruit community volunteers to form a Virtual PTG Organization Team to collaborate with the OSF staff to incorporate best practices and ensure the event continues to meet the goals of the upstream community. We will need to begin pulling this plan together soon, so please add your name ot this etherpad if you are interested in helping: https://etherpad.openstack.org/p/Virtual_PTG_Planning. > > For OpenDev, discussions are also meant to be collaborative and free-flowing but are less time bound by the release schedule, so rather than trying to recreate that during a single virtual event at the same time as the virtual PTG, we are thinking about other ways to accomplish the same goals. We've already assembled an awesome team of Program Committee volunteers who have received proposals for moderated discussions, and we will be working with them on some ideas on the best way to move forward. > > For the time being, we are continuing with the plan for the Open Infrastructure Summit in Berlin October 19-23. For updates on OpenDev + PTG and the Summit, please continue to read and bookmark this status page which we will continue to update: https://www.openstack.org/events/covid-19-coronavirus-disease-updates > > Mark Collier > COO, OpenStack Foundation > > > _______________________________________________ > Foundation mailing list > Foundation(a)lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/foundation

1 0

review.opendev.org Downtime March 20, 2020 at 1400UTC
by Clark Boylan 18 Mar '20

18 Mar '20

The OpenDev team is planning to take a short downtime March 20, 2020 from 14:00UTC to 15:00UTC. This outage will enable us to rename a few projects and redeploy Gerrit using containers. The container based deployment is an important first step in our longer term plan for upgrading Gerrit to a modern version. We recognize that this will be a disruption during an already disrupted week for many. We feel this is worthwhile as it fits into project release schedules and sets us up well for the future. Thank you for your patience. Feel free to ask us any questions you may have on this thread or in #opendev on Freenode. Clark

1 0

OpenDev now using #opendev on Freenode for Discussions
by Clark Boylan 18 Mar '20

18 Mar '20

Hello all, We are now using #opendev on Freenode to discuss the OpenDev Infrastructure. We hope this gives you all a more friendly neutral location to discuss the tools we use to develop our software. Feel free to join us and bring your ideas and questions. Hope to see you there, Clark

1 0

[zuul-ci.org] SEO improvements
by Jimmy McArthur 14 Mar '20

14 Mar '20

Hi all - We've contracted a professional SEO firm to help improve search placement for all OSF projects. I'd like to crowd source this on each of the project mailing lists, so the community is able to be involved: “Wish List” of keywords: 8-12 big terms you think fit your domain (if you only have 4-5 to share, fewer is okay) - open source ci - ? At least 3 competitors - Jenkins - ? Any other input on positioning, offerings, etc. that you think will help best filter for relevance - ? Cheers, Jimmy

1 1

ensure-tox: install inside python3 by default
by Mohammed Naser 13 Mar '20

13 Mar '20

Hi everyone, The current behavior of the `ensure-tox` role is to install `tox` using Python 2. The following change will switch the default behavior to installing it via Python 3. The option of installing `tox` using Python 2 remains available. https://review.opendev.org/#/c/712804/ If you're using Python 2 for your jobs and you require that `tox` continues to be installed inside Python 2, please update your jobs to use the following in their vars: tox_prefer_python2: true This message serves as a heads-up for all Zuul operators that consume zuul/zuul-jobs, this change will be merging in 2 weeks, please feel free to bring up any concerns if we've missed anything. Thanks, Mohammed

2 1

[zuul-ci.org] Supporting Companies
by Jimmy McArthur 13 Mar '20

13 Mar '20

Hello All - One of the things the Foundation offers for our projects is the ability to show Supporting Companies on each of the project websites [1]. We also have a little blurb or button there for other companies that are looking to support the project in some way. This can be through infrastructure donation or helping to offset events costs, etc... We'd like to get such a page up on Zuul, but I want to check with the community first to see what thoughts are around the concept as well as placement on the site. Cheers, Jimmy [1] https://katacontainers.io/supporters/

2 1

[zuul-community] [OpenDev] We want your discussion ideas!
by Jimmy McArthur 13 Mar '20

13 Mar '20

Hi everyone, We still need your help shaping the discussion content for OpenDev + PTG, June 8-11, 2020 <https://www.openstack.org/events/opendev-ptg-2020/>! Our vision is for the content to be programmed by you-- the community. Programming Committees for each Track have begun meeting to discuss potential topics for the event, but they need your ideas and input to make sure all of the content is relevant and interesting to the community. The Programming Committee will also select moderators who will lead interactive discussions on a particular topic within the Track, so make sure to volunteer through the form below if you’re interestedin that as well. Check out this etherpad <https://etherpad.openstack.org/p/r.961497ec02b63da123fbda235a7ba02e>to see what topics the Committees are currently discussing. If you’re interested in volunteering as an OpenDev discussion moderator, or would like to suggest topics for moderated discussions within a particular Track, please read the details below, and then fill out this form <https://openstackfoundation.formstack.com/forms/opendev_vancouver2020_volun…>. We’re looking for discussion topics and Moderators for the following OpenDev Tracks: - Hardware Automation - Large-scale Usage of Open Source Infrastructure Software - Containers in Production - Key Challenges for Open Source in 2020 OpenDev Discussion Moderatorswill: - Be appointed by the Programming Committees - Facilitate discussions within a particular Track - Have adequate knowledge and experience to lead and moderate discussion around certain topics during the event - Work with Programming Committee to decide focal point of discussion Moderators need to be available to attend OpenDev, June 8 - 10, 2020. Volunteer to be a moderator or suggest discussion topics here *before March 20*: <https://openstackfoundation.formstack.com/forms/opendev_vancouver2020_volun…>https://openstackfoundation.formstack.com/forms/opendev_vancouver2020_volun… Cheers, Ashlee Ashlee Ferguson Community & Events Coordinator OpenStack Foundation _______________________________________________ Community mailing list Community(a)lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/community

1 0

Request for Wiki Assistance
by Jimmy McArthur 11 Mar '20

11 Mar '20

Hi Zuul Community! We had our recent Zuul post denied by the wikipedia community. It's not a huge surprise and it's notoriously difficult to get a "first post" up. If any of you have some Zuul expertise you could espouse in a wiki-like way, and/or some wikipedia juice/advice you could offer us, it would be greatly appreciated. https://en.wikipedia.org/wiki/Draft:Zuul_(software) You can read the bits at the top of the page about what we're doing wrong. A few things could help: * More primary sources - by this they mean high value domains or qualified news sources in the industry * A variation on authors * I'm not sure how to address their contention that the entry reads like an advertisement, but I'm open to suggestions :) Having a wiki page is a really big step towards making Zuul a more high profile open source CI and project gating alternative, so please let me know how you can help! Cheers, Jimmy

2 3

Run a job if a directory or a file exist in the source tree
by Fabien Boucher 11 Mar '20

11 Mar '20

Hi, What do you think about a job attribute a bit similar to "files", but for telling Zuul to execute the job only if one of the listed file or directory exist in the project source tree ? Use case is where I have a common set of jobs attached to a large number of repositories. But some of the repositories don't have a specific directory that contains the data used by a job. So instead of spawning a VM and run the job playbook to discover the directory is missing and skip the rest of the playbook's task, I'd like to tell Zuul to simply skip the job at all and not waste nodepool resources. Thus this new job's attribute. Another solution is to run small parent job, in a container, to discover if the directory exist and let run or not the child job. Any thoughts ? Is that new job attribute could be valuable ? Fabien

3 3

feature: display branch in zuul dashboard
by Sorin Sbarnea 07 Mar '20

07 Mar '20

Wes asked me few days ago if we could make the branch visible in zuul ui. To me it makes sense as long we do not display the master branch, mainly because I prefer an uncluttered interface. What do you think about it? Should I propose a patch or not? Cheers Sorin ---------- Forwarded message --------- From: Wesley Hayutin <whayutin(a)redhat.com> Date: Mon, 2 Mar 2020 at 15:45 Subject: future zuul ui enhancement. To: Sorin Sbarnea <ssbarnea(a)redhat.com> I would be cool to see the branch in the header for each review in check and gate. Currently we have... openstack/tripleo-quickstart-extras 710230,2 <https://review.opendev.org/710230> 1 hr 55 min 1 hr 10 min Would be nice to add branch info there too. Let me know if that makes sense. Thanks -- -- /sorin

2 1

zuul roles bindep and epel enablement issue
by Sorin Sbarnea 07 Mar '20

07 Mar '20

Background: As you probably know on centos there is the EPEL additional repository which provides some extra packages which are not part of the distribution, so not covered by support. Enabling EPEL is easy, usually just by installing epel-release, unless someone already installed it and disabled it (this is what rdo does in order to have the mirrors configured). Recently I discovered that some linters do need re2-devel, which comes from epel on centos-8. So far we used bindep succesfully but we cannot tell bindep role to install epel-release package before installing the the other rpms. Another approach would be to use test-setup.sh to enable this repo but last time I checked this runs after bindep, so too late. How can we address this issue? Do we have a more generic issue to install dependencies on nodes? I would not want to patch nodeset images because these makes the job not portable between different zuul instances. Another reason for not patching images is that what could be good idea to install for my use case, could prove bad for another one. Cheers, Sorin -- -- /sorin

2 1

Zuul v4/v5 planning
by corvus＠inaugust.com 05 Mar '20

05 Mar '20

Hi, Some folks in IRC recently brainstormed how to sequence the changes needed to implement the scale-out-scheduler spec. This is the plan we came up with, including a description of the changes at a high level, along with the major version numbers for important releases. Our current plan is to perform all of this development on the master branch, continue other unrelated development at the same time, and release interim releases as appropriate in the usual manner. We believe this sequence is constructed in a way that will enable everyone to continue to deploy the latest releases (or commits) of Zuul in the usual way with minimal disruption. At the end of the process, you'll be able to deploy more than one scheduler. :) There will be a couple of points in the timeline where we will ask you to make forward-compatible changes to your configuration or deployment. As long as you make those changes before the upcoming release which requires them, we don't expect any issues. Here is the current plan: * Add support for Zookeeper auth * Ask users to configure Zookeeper auth, ensure all Zuul components can reach the Zookeeper cluster, and define an SQL connection * Release last 3.x series * Require Zookeeper auth * Have all components connect to Zookeeper, even if they just idle for now * SQL reporters are required (an implied SQL reporter is added to every pipeline, explicit SQL reporters are ignored) * Release 4.0.0 * Warn on explicit SQL reporters in pipelines * Start adding in more Zookeeper stuff, removing equivalent gearman as appropriate * Release 4.1.0 * Error on explicit sql reporters in pipelines * Complete HA scheduler work * Release 5.0.0 -Jim

1 0