class: center, middle, inverse # OpenStack Packaging for Fedora & CentOS ## Haïkel Guémar - @hguemar --- ## whoami .right-column[
] .left-column[ + Fedoraproject.org developer (Cloud WG) + CentOS developer (Cloud SIG/OpenStack) + OpenStack ATC + RDO Engineering @ Red Hat ] --- class: center, middle, inverse # Introduction --- class: middle ## What's OpenStack ? OpenStack is an open source platform that lets you build an Infrastructure as a Service (IaaS) cloud that runs on commodity hardware ![overview](img/openstack-software-diagram.png) http://openstack.org --- class: middle ## OpenStack is really ...
--- class: middle ## What's RDO RDO is a freely-available and community supported distribution of OpenStack packaged and integrated for RHEL, CentOS and Fedora.
http://rdoproject.org --- class: middle ## What's RDO * OpenStack packages * An installer: packstack * A deployment & management tool: RDO Manager * __MOST IMPORTANT: A COMMUNITY__ --- class: middle ## Packstack * Fast & simple deployment tool of OpenStack * Handle single-node/multi-nodes configuration * Aims at small PoCs * Built on Puppet
--- class: middle ## RDO Manager * Deployment & management console * Built on Triple O (and inspired by enovance SpinalStack) * Leverage OpenStack API !(img/rdo-manager-logo.png) [RDO Manager documentation](https://repos.fedorapeople.org/repos/openstack-m/docs/master/) [RDO Manager at Vancouver Summit](http://youtu.be/731INn1GDmk) --- class: middle ## What's Triple O ? * Undercloud (management node) * Overcloud (deployed cloud) !(img/tripleo.svg) --- class: middle ## History - OpenStack in Fedora * openstack-nova Diablo imported to Fedora 16 in August 2011  * Until now we were able to keep Fedora/OpenStack release 1:1  + Fedora 16 includes OpenStack Diablo + Fedora 17 includes OpenStack Essex + Fedora 18 includes OpenStack Folsom + Fedora 19 includes OpenStack Grizzly + Fedora 20 includes OpenStack Havana + Fedora 21 includes OpenStack Icehouse + Fedora 22 includes OpenStack Juno + Fedora 23 will include OpenStack Kilo : http://pkgs.fedoraproject.org/cgit/openstack-nova.git/commit/?id=430fcdb4f519438525bc3bbccc6480dcbce8bfd8 : https://fedoraproject.org/wiki/OpenStack#OpenStack --- class: middle ## History - OpenStack in RHEL/CentOS * Nova added to EPEL6 in November 2011 * complete Essex update in April 2012  * incompatible Folsom update in October 2012  sparked conversations leading to the creation of RDO  * RDO started with Grizzly in April 2013 : https://admin.fedoraproject.org/updates/FEDORA-EPEL-2012-5719 : https://admin.fedoraproject.org/updates/FEDORA-EPEL-2012-13088 : https://openstack.redhat.com/ --- class: middle, inverse, center # OpenStack Packaging Challenges --- class: middle ## Multiple Targets * RHEL/CentOS 7 (starting Kilo) * RHEL/CentOS 6 (clients only) * All currently supported Fedora (+ Rawhide of course) --- class: middle ## Multiple Releases * Icehouse/2014.1.3 (EOL) => april 2014 * Juno/2014.2.x (previous stable) => october 2014 * Kilo (current stable) => may 2015 * Liberty (master) --- class: middle ## Many packages For instance CentOS 7 Juno * 641 binary packages for CentOS * 282 source packages * 207 python packages * 101 source packages for openstack services * 17 source packages for openstack clients --- class: middle, inverse, center # The Setup --- class: middle ## Git * Currently hosted on Fedora dist-git * A single spec per release on one branch + master (F23) => Kilo + F22 => Juno + F21 => Icehouse * Same spec is used to be built on multiple targets * Trunk aka Liberty is a special case. Specs lives there: https://github.com/openstack-packages/ --- class: middle ## Buildsystem Setup * RDO Fedora is built in Koji, Fedora N+1 builds are made available for Fedora N *e.g. RDO Kilo for Fedora 22 are Fedora 23 builds* * RDO EL is built in CBS and is self-sufficient starting Kilo --- class: middle ## Packaging/Patches review * Using gerrit like OpenStack upstream * Patches and packaging changes runs through a review * Updates are submitted through a simple YAML file * [Hosted on gerrithub](https://review.gerrithub.io/#/q/project:openstack-packages) * Trigger a serie of CI jobs --- class: middle ## Continuous Integration * Phase1 Install packages from update YAML on the snapshot image with the all-in-one OpenStack installation, starts services and runs Tempest smoketest. Tests basic package sanity and upgrade. * Phase2 Runs from-the-scratch all-in-one installation with all the packages which passed Phase1. Tests package interaction among queued updates. + stage daily jobs and on-demand before pushing queued updates list + production daily job to catch regressions in dependency changes => Moved to ci.centos.org * [Repository level testing from Cloud SIG](https://ci.centos.org/job/cloud-sig-validate-packstack-rdo-kilo-testing_tag/) --- class: middle ## Back to the future !
--- class: middle ## Delorean Tracks upstream master (currently Liberty) and stable branches now. Breaks when upstream change requires packaging changes and alerts package owners as defined in [rdoinfo](https://github.com/redhat-openstack/rdoinfo) Going forward, all packaging changes will be done in Delorean packages first, and merged to stable packaging branches [How to add a package in RDO master](https://openstack.redhat.com/packaging/rdo-packaging.html#_how_to_add_a_new_package_to_rdo_master_packaging) [Delorean FAQ](https://etherpad.openstack.org/p/delorean-packages) --- class: middle ## rdopkg: swiss army knife for RDO packaging * Automate most of the annoyances * Rebase/Updating patches/Submit updates etc. [Available here](https://copr.fedoraproject.org/coprs/jruzicka/rdopkg/) --- class: middle, center, inverse # RDO Status --- class: middle ## Opening up the technical governance * Public infrastructure => reviewing system, CI (WiP) * Weekly IRC meetings on freenode ([agenda](https://etherpad.openstack.org/p/RDO-Packaging)) * Creation of RDO Eng. team to support and foster contributions (ping apevec or hguemar to get started!) * __RDO Eng. is the only team that has no internal meetings, all in the open!__ * Open roadmap ([RDO public trello](https://trello.com/b/HhXlqdiu/rdo)) --- class: middle ## Why? * RDO has been founded as a self-supporting community distribution of OpenStack for Fedora/RHEL ecosystem * Enable community contributors collaboration * Allow community to choose the direction of the project --- class: middle ## A lot more contributions from non-redhatters Juno highlights: * Juno/EL6 builds thanks to Thomas Oulevey (CERN) * Barbican packages thanks to Greg Swift (Rackspace) * GBP packages thanks to Robert Kukura (Cisco) --- class: middle ## RDO 💓 CentOS * RDO starting Kilo is fully built on CBS * One of the first usable product by a SIG * Considering moving more bits of RDO infrastructure over CentOS --- class: middle ## RDO mid-cycle meetup * Full day meetup during FOSDEM * Co-located with FOSDEM CentOS dojo * Discussion on planning and future organization --- class: middle ## Big tent plans * A lot of interests in maintaining non-core projects in RDO * RDO Eng. will be supporting community efforts as long as there is commitment * Note that won't impact RHOSP [Projects in RDO list](https://www.rdoproject.org/ProjectsInRDO) --- class: middle ## Packaging as an upstream project * [Proposal cooked up at Vancouver Summit](https://review.openstack.org/#/c/185187/) * We're 100% behind it * Currently discussing with Suse guys on how we could converge RPM packaging * Not a disruptive change to us as we've been working on two releases using a very similar workflow (delorean + gerrithub) --- class: middle ## No stable point-releases * Upstream will stand behind stable branches ensuring that every commit is production-ready * Allow more frequent bugfix and CVE releases in RDO * Still need to figure out details (tarballs & changelog) --- class: middle ## Operational tools * Bringing mature and advanced operational tools to RDO + Centralised Logging + Performance Monitoring + Availability Monitoring * Led by Graeme Gillies [Discussion on RDO list](https://www.redhat.com/archives/rdo-list/2015-June/msg00051.html) --- class: middle ## OPNFV * CentOS OPNFV SIG * Build a vanilla OPNFV platform based on OpenStack + OpenDaylight (ODL) * First release based w/ RDO and Foreman installer coming soon * CI + functional testing in progress * Ping Dan Radez if you want to get involved --- class: middle ## Khaleesi * Ansible framework to setup OpenStack test environment * Used by RDO and RHOSP CI * Rewritten to be reusable by everyone [Khaleesi](https://github.com/redhat-openstack/khaleesi) --- class: middle ## Trystack * Public RDO cloud available to try out OpenStack (backed by the Foundation) * Kilo migration: WiP * Kilo version will include Manila + Trove * RDO CI runs over Juno * Recruiting more operators to manage this effort! --- class: middle ## New RDO portal --- class: middle, center, inverse # Contributing to RDO --- class: middle ## RDO packaging documentation [documentation](https://openstack.redhat.com/packaging/rdo-packaging.html) [sources](http://github.com/redhat-openstack) <= Pull Requests are welcome! --- class: middle ## Communication channels * mailing-list: http://www.redhat.com/mailman/listinfo/rdo-list * IRC: #rdo @freenode --- class: middle, center, inverse # Q/A