| openstackgerrit | Chris Jones proposed openstack/tripleo-common: Add action for generating fencing parameters. https://review.openstack.org/422321 | 00:08 |
|---|---|---|
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Move nova::placement to common nova manifest https://review.openstack.org/422739 | 00:12 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Move nova placement hiera to nova-base https://review.openstack.org/422746 | 00:13 |
| openstackgerrit | Merged openstack/diskimage-builder: Fix coverage report https://review.openstack.org/421652 | 00:13 |
| *** social has quit IRC | 00:17 | |
| *** dmacpher has joined #tripleo | 00:24 | |
| *** dsneddon is now known as dsneddon_afk | 00:27 | |
| *** dsneddon has joined #tripleo | 00:29 | |
| *** rmcadams has joined #tripleo | 00:34 | |
| *** jeckersb_gone is now known as jeckersb | 00:41 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: tripleo.sh: skip plan delete for mitaka https://review.openstack.org/422673 | 00:44 |
| *** limao has joined #tripleo | 00:56 | |
| *** tzumainn has quit IRC | 01:08 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: cinder: move glance params into common https://review.openstack.org/422915 | 01:20 |
| *** shinobu_ has quit IRC | 01:27 | |
| *** iranzo has joined #tripleo | 01:31 | |
| *** iranzo has joined #tripleo | 01:31 | |
| *** bana_k has quit IRC | 01:35 | |
| *** saneax-_-|AFK is now known as saneax | 01:43 | |
| bkero | dmsimard: gate-tripleo-ci-centos-7-nonha-multinode-oooq-nv isn't containerized | 01:58 |
| dmsimard | bkero: you sure ? I see docker references all over the place | 01:58 |
| bkero | really | 01:58 |
| bkero | dmsimard: Here's an example log. Can you show me where the docker references are? http://logs.openstack.org/12/420912/3/experimental/gate-tripleo-ci-centos-7-nonha-multinode-oooq-nv/330c45e/console.html | 01:59 |
| dmsimard | bkero: http://logs.openstack.org/05/422905/1/experimental/gate-tripleo-ci-centos-7-nonha-multinode-oooq-nv/6c64c2a/console.html ctrl+f docker | 01:59 |
| dmsimard | http://logs.openstack.org/05/422905/1/experimental/gate-tripleo-ci-centos-7-nonha-multinode-oooq-nv/6c64c2a/logs/rpm-qa.txt.gz ctrl+f docker | 01:59 |
| dmsimard | http://logs.openstack.org/05/422905/1/experimental/gate-tripleo-ci-centos-7-nonha-multinode-oooq-nv/6c64c2a/logs/var/log/quickstart_collectlogs.txt.gz ctrl+f docker | 02:00 |
| bkero | dmsimard: in your log there is only 1 docker reference, and that is in collect-logs, a playbook that runs after the deployment | 02:00 |
| dmsimard | ¯\_(ツ)_/¯ | 02:00 |
| dmsimard | I'll believe you | 02:00 |
| dmsimard | I wonder how dprince, flaper87 and mandre have been testing their container stuff | 02:01 |
| dmsimard | saw mandre do a check experimental on a container related review | 02:01 |
| bkero | Isn't there a container job in experimental? | 02:01 |
| dmsimard | experimental is only that one job | 02:01 |
| dmsimard | afaict | 02:01 |
| * bkero updates his clone of project-config | 02:02 | |
| bkero | dmsimard: I'd wager either gate-tripleo-ci-centos-7-ovb-containers-oooq or gate-tripleo-ci-centos-7-undercloud-containers | 02:03 |
| EmilienM | dmsimard: weshay_afk did the container job, ask him | 02:04 |
| dprince | dmsimard: https://github.com/dprince/undercloud_containers | 02:04 |
| EmilienM | and gate-tripleo-ci-centos-7-ovb-containers-oooq is in the queue | 02:04 |
| EmilienM | dmsimard: just watch zuul | 02:04 |
| dprince | dmsimard: its all going into instack too. we are "shaking out" the architecture, and once vetted I expect the CI to come online quickly | 02:05 |
| dmsimard | ohhhhhhhhhh, there is a tripleo experimental queue | 02:05 |
| dmsimard | sorry | 02:05 |
| EmilienM | ... | 02:05 |
| dmsimard | well I saw the experimental job check in | 02:05 |
| dmsimard | already | 02:06 |
| EmilienM | and yeah, multinode job is not a container job | 02:06 |
| EmilienM | it's deploying 2 nodes: 1 undercloud and 1 node overcloud | 02:06 |
| dmsimard | didn't realize there were two experimental pipelines for tht, sorry | 02:06 |
| dprince | dmsimard: the existing conatiners CI job only runs containers on the compute role too | 02:06 |
| dprince | dmsimard: we won't break that either | 02:06 |
| dmsimard | dprince: okay | 02:07 |
| EmilienM | dprince: we had the CI squad meeting this morning and we'll change quite a lot of things in the future, wrt container CI | 02:07 |
| EmilienM | dprince: you can read notes here https://etherpad.openstack.org/p/tripleo-ci-squad-meeting | 02:07 |
| dprince | EmilienM: I will help with the undercloud containers stuff which I'm trying to push ahead of any further overcloud stuff. Not everyone agrees but I think it is the best plan to gain more developers | 02:08 |
| EmilienM | dprince: cool! | 02:11 |
| *** iranzo has quit IRC | 02:12 | |
| *** dprince has quit IRC | 02:19 | |
| openstackgerrit | Tuan Luong-Anh proposed openstack/python-tripleoclient: Replace yaml.load() with yaml.safe_load() https://review.openstack.org/420589 | 02:23 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Add docker neutron services https://review.openstack.org/422999 | 02:43 |
| *** fzdarsky__ has joined #tripleo | 02:44 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Add docker neutron services https://review.openstack.org/422999 | 02:47 |
| *** fzdarsky_ has quit IRC | 02:48 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Enable docker services in the registry https://review.openstack.org/421567 | 02:50 |
| *** morazi has quit IRC | 02:50 | |
| *** links has joined #tripleo | 02:53 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: multinode: remove 417109 workaround https://review.openstack.org/422913 | 03:01 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: docker: new hybrid deployment architecture and configuration https://review.openstack.org/416421 | 03:03 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: docker: new hybrid deployment architecture and configuration https://review.openstack.org/416421 | 03:09 |
| *** limao has quit IRC | 03:13 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: Conntainers with multi-nic and net-iso https://review.openstack.org/422448 | 03:18 |
| *** padkrish has joined #tripleo | 03:21 | |
| *** saneax is now known as saneax-_-|AFK | 03:24 | |
| *** rhallisey has quit IRC | 03:26 | |
| *** sdake has joined #tripleo | 03:30 | |
| *** yamahata has quit IRC | 03:31 | |
| *** bana_k has joined #tripleo | 03:33 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Add Rabbit to the endpoint map https://review.openstack.org/420920 | 03:36 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Added support for pass-through iSER configuration https://review.openstack.org/324781 | 03:37 |
| openstackgerrit | Merged openstack/tripleo-image-elements: Add a script to zero /etc/sysconfig/iptables at build time https://review.openstack.org/422472 | 03:37 |
| *** padkrish has quit IRC | 03:39 | |
| *** saneax-_-|AFK is now known as saneax | 03:55 | |
| *** psahoo has joined #tripleo | 04:05 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Revert "Revert "Specify cell0 db creation"" https://review.openstack.org/421999 | 04:06 |
| *** spredzy has quit IRC | 04:07 | |
| *** spredzy has joined #tripleo | 04:08 | |
| *** limao has joined #tripleo | 04:14 | |
| *** links has quit IRC | 04:16 | |
| *** links has joined #tripleo | 04:18 | |
| *** limao has quit IRC | 04:19 | |
| *** liverpooler has quit IRC | 04:23 | |
| *** udesale has joined #tripleo | 04:25 | |
| *** bana_k has quit IRC | 04:26 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: TLS everywhere job introduction https://review.openstack.org/391738 | 04:29 |
| *** udesale has quit IRC | 04:30 | |
| *** sdake_ has joined #tripleo | 04:35 | |
| *** sdake has quit IRC | 04:39 | |
| shinobu__ | is there any plan (or bp) to add dditional param(s) that ignore(s) existing overcloud nodes during scaling out operation? | 04:47 |
| shinobu__ | with this param, undercloud will completely not touch existing nodes but only deploy additional nodes. | 04:48 |
| shinobu__ | but we will keep any consistencies between nodes, if necessary :) | 04:50 |
| *** bana_k has joined #tripleo | 04:52 | |
| *** sdake_ is now known as sdake | 04:55 | |
| *** psahoo has quit IRC | 05:05 | |
| *** jerrygb has quit IRC | 05:05 | |
| *** udesale has joined #tripleo | 05:09 | |
| *** udesale has quit IRC | 05:10 | |
| *** udesale has joined #tripleo | 05:11 | |
| *** bana_k has quit IRC | 05:11 | |
| *** bana_k has joined #tripleo | 05:11 | |
| *** limao has joined #tripleo | 05:12 | |
| *** psahoo has joined #tripleo | 05:15 | |
| *** prateek has joined #tripleo | 05:15 | |
| *** pgadiya has joined #tripleo | 05:17 | |
| *** rbrady has joined #tripleo | 05:20 | |
| *** gkadam has joined #tripleo | 05:22 | |
| *** SlickNik has quit IRC | 05:37 | |
| jidar | shinobu__: I'm not sure I follow, scaling out causing the existing nodes to be counted towards the new scale and are not 'touched' | 05:37 |
| *** nyechiel has joined #tripleo | 05:38 | |
| *** padkrish_ has joined #tripleo | 05:39 | |
| *** jerrygb has joined #tripleo | 05:39 | |
| *** SlickNik has joined #tripleo | 05:41 | |
| *** padkrish_ has quit IRC | 05:45 | |
| *** masco has joined #tripleo | 06:02 | |
| *** flepied has joined #tripleo | 06:03 | |
| *** padkrish has joined #tripleo | 06:08 | |
| *** dsneddon_ has joined #tripleo | 06:14 | |
| *** crenguta has joined #tripleo | 06:14 | |
| *** flepied has quit IRC | 06:15 | |
| *** dsneddon has quit IRC | 06:15 | |
| *** absubram has joined #tripleo | 06:19 | |
| *** ealcaniz has joined #tripleo | 06:26 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates: pacemaker remote profile support https://review.openstack.org/400972 | 06:32 |
| *** dmacpher has quit IRC | 06:36 | |
| *** jprovazn has joined #tripleo | 06:38 | |
| openstackgerrit | Merged openstack/os-net-config: Remove child members activation for OVS-DPDK bond https://review.openstack.org/417805 | 06:47 |
| yolanda | hi we are having a consistent error in ovb jobs from diskimage-builder | 06:52 |
| yolanda | 2017-01-19 16:11:00.194 18954 ERROR ironic.drivers.modules.iscsi_deploy [req-0da63cea-4623-4c74-b721-3cd6d6beee72 - - - - -] Couldn't determine the UUID of the root partition or the disk identifier after deploying node 4c993b71-6de6-401b-b1f3-315a9651c171 | 06:52 |
| yolanda | do you know if that's something usual? or may be related with our change? | 06:52 |
| bandini | maybe an ironic change? | 06:59 |
| *** dsneddon_ has quit IRC | 07:01 | |
| *** hjensas has quit IRC | 07:03 | |
| *** aufi has joined #tripleo | 07:08 | |
| *** absubram has quit IRC | 07:08 | |
| *** yprokule has joined #tripleo | 07:10 | |
| *** ealcaniz has quit IRC | 07:13 | |
| *** tremble has joined #tripleo | 07:15 | |
| *** rajinir has quit IRC | 07:16 | |
| *** hjensas has joined #tripleo | 07:23 | |
| *** hjensas has quit IRC | 07:23 | |
| *** hjensas has joined #tripleo | 07:23 | |
| *** ohamada has joined #tripleo | 07:25 | |
| openstackgerrit | zhangyanxian proposed openstack/puppet-tripleo: Fix typo in endpoint.pp https://review.openstack.org/423096 | 07:25 |
| openstackgerrit | zhangyanxian proposed openstack/puppet-tripleo: Fix typo in endpoint.pp https://review.openstack.org/423096 | 07:25 |
| *** iranzo has joined #tripleo | 07:26 | |
| *** iranzo has joined #tripleo | 07:26 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Swift proxy align *-quotas with puppet-swift syntax https://review.openstack.org/422682 | 07:30 |
| *** dsneddon has joined #tripleo | 07:36 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo: Make sure we bind the rabbit inter-cluster to a specific interface https://review.openstack.org/415757 | 07:42 |
| *** pcaruana has joined #tripleo | 07:43 | |
| *** Baggypants12000 has joined #tripleo | 07:44 | |
| *** jokke__ has joined #tripleo | 07:46 | |
| *** Hazelesque_ has joined #tripleo | 07:47 | |
| *** rasca has joined #tripleo | 07:48 | |
| *** melwitt_ has joined #tripleo | 07:48 | |
| *** tdasilva has quit IRC | 07:51 | |
| *** Hazelesque has quit IRC | 07:51 | |
| *** melwitt has quit IRC | 07:51 | |
| *** jokke_ has quit IRC | 07:51 | |
| *** tdasilva has joined #tripleo | 07:51 | |
| *** psahoo has quit IRC | 07:57 | |
| *** bana_k has quit IRC | 07:57 | |
| *** jlinkes has joined #tripleo | 07:58 | |
| *** ebarrera has joined #tripleo | 07:58 | |
| *** limao has quit IRC | 08:04 | |
| *** limao_ has joined #tripleo | 08:04 | |
| *** mhenkel has joined #tripleo | 08:05 | |
| *** tesseract has joined #tripleo | 08:05 | |
| *** paramite has joined #tripleo | 08:09 | |
| *** pmannidi has quit IRC | 08:09 | |
| *** mcornea has joined #tripleo | 08:10 | |
| *** shinobu__ has quit IRC | 08:11 | |
| *** cylopez has joined #tripleo | 08:12 | |
| *** shardy has joined #tripleo | 08:14 | |
| *** zoli|gone is now known as zoli | 08:18 | |
| *** zoli is now known as zoli|wfh | 08:18 | |
| *** yamahata has joined #tripleo | 08:22 | |
| *** shardy is now known as shardy_afk | 08:26 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates: pacemaker remote profile support https://review.openstack.org/400972 | 08:30 |
| *** afazekas has quit IRC | 08:30 | |
| *** artom has quit IRC | 08:31 | |
| *** artom has joined #tripleo | 08:32 | |
| *** afazekas has joined #tripleo | 08:35 | |
| marios | bandini: o/ hey i think Jan 19 12:53:55 overcloud-controller-2 systemd: Cannot add dependency job for unit microcode.service, ignoring: Unit is not loaded properly: Invalid argument. | 08:36 |
| marios | Jan 19 12:53:55 overcloud-controller-2 systemd: Started Pacemaker High Availability Cluster Manager. | 08:36 |
| marios | Jan 19 12:53:55 overcloud-controller-2 systemd: Starting Pacemaker High Availability Cluster Manager... | 08:36 |
| marios | :) middle click fail | 08:36 |
| marios | bandini: woops | 08:37 |
| marios | bandini: https://review.openstack.org/#/c/422475/2 is good to go ... feel free to +A | 08:37 |
| *** jpena|off is now known as jpena | 08:37 | |
| marios | bandini: don't think it should cause problems i mean it doesn't do much by default | 08:37 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Force epmd listening to a specific address https://review.openstack.org/415941 | 08:39 |
| *** amoralej|off is now known as amoralej | 08:39 | |
| *** hafe has joined #tripleo | 08:42 | |
| *** florianf has joined #tripleo | 08:43 | |
| openstackgerrit | Jan Provaznik proposed openstack/tripleo-heat-templates: Set manila default_share_type config option https://review.openstack.org/416960 | 08:43 |
| *** jpich has joined #tripleo | 08:43 | |
| bandini | marios: thanks, yeah. I will doublecheck a couple of things and then +A | 08:45 |
| *** ohamada has quit IRC | 08:45 | |
| bandini | marios++ | 08:46 |
| *** ohamada has joined #tripleo | 08:49 | |
| marios | bandini: cool thanks | 08:49 |
| *** jpena is now known as jpena|off | 08:51 | |
| *** abehl has joined #tripleo | 08:51 | |
| *** shardy_afk is now known as shardy | 08:52 | |
| *** jpena|off is now known as jpena | 08:54 | |
| *** nyechiel has quit IRC | 08:55 | |
| *** crenguta has quit IRC | 08:56 | |
| *** nyechiel has joined #tripleo | 08:56 | |
| *** crenguta has joined #tripleo | 08:58 | |
| *** zzzeek has quit IRC | 09:00 | |
| *** zzzeek has joined #tripleo | 09:00 | |
| *** ccamacho has joined #tripleo | 09:01 | |
| *** openstackgerrit has quit IRC | 09:02 | |
| *** openstackgerrit has joined #tripleo | 09:05 | |
| openstackgerrit | Merged openstack/tripleo-common: Use packaged docker-cmd hook in heat-agents https://review.openstack.org/407827 | 09:05 |
| *** pgadiya has quit IRC | 09:06 | |
| *** social has joined #tripleo | 09:09 | |
| *** pgadiya has joined #tripleo | 09:10 | |
| *** derekh has joined #tripleo | 09:15 | |
| *** ealcaniz has joined #tripleo | 09:16 | |
| *** Vijayendra has quit IRC | 09:20 | |
| *** gfidente has joined #tripleo | 09:21 | |
| *** gfidente has quit IRC | 09:21 | |
| *** gfidente has joined #tripleo | 09:21 | |
| gfidente | heeeeeelllllllooooooooooooooooooooooooooo | 09:21 |
| shardy | gooooooood morning gfidente ;) | 09:22 |
| marios | oh noe. the faidentee has arrived. | 09:22 |
| gfidente | a bit aggressive yeah, sorry | 09:22 |
| gfidente | but I just wanted to pass some enthusiasm over irc | 09:23 |
| shardy | can I get another review on https://review.openstack.org/#/c/351898/ please, then we can land ocatavia support | 09:23 |
| gfidente | marios are you adding the ceph shells for upgrade then? | 09:23 |
| gfidente | or should I copypasta and gain an easy commit? | 09:23 |
| *** nmathew has joined #tripleo | 09:23 | |
| marios | gfidente: sure man feel free i wasn't planning on doing that today | 09:24 |
| gfidente | marios ack, thanks for showing how | 09:24 |
| gfidente | :) | 09:24 |
| shardy | gfidente: yeah any help with ceph would be great, I don't think we've got to that yet | 09:24 |
| marios | gfidente: i don't think i'll add all the services... added a few more yesterday https://review.openstack.org/#/c/414598/ but really i think we can land that and add as necessary | 09:24 |
| gfidente | shardy it's nice that for ocata we don't upgrade across major ceph releases | 09:24 |
| *** fzdarsky__ is now known as fzdarsky | 09:24 | |
| gfidente | so we have a bit more time to figure it out how to do it for pike | 09:25 |
| gfidente | I think we'll have to shutdown nodes one by one for it | 09:25 |
| gfidente | so I was using the batch properties for a custom software deployment before | 09:25 |
| marios | gfidente: for the ceph nodes, the upgrade will actually proceed as before, i.e. operator driven upgrade after the controllers | 09:25 |
| gfidente | marios shardy ^^ batch worked nice though | 09:26 |
| shardy | gfidente: yeah I think that should be pretty easy actually | 09:26 |
| gfidente | shardy easy depends on your starting point :P | 09:26 |
| shardy | we can add the option in roles_data to have a batch size for upgrades | 09:26 |
| marios | gfidente: so in that respect, adding the step0 to check ceph services running isn't (immediately) urgent because those ansible steps will be disabled on cephs/computes | 09:26 |
| *** Vijayendra has joined #tripleo | 09:26 | |
| gfidente | shardy++ on batch for upgrdes | 09:27 |
| *** ohamada has quit IRC | 09:27 | |
| *** ohamada has joined #tripleo | 09:27 | |
| shardy | we can then probably use the exact same batched approach for updates, with a subset of the tasks used for upgrade | 09:27 |
| *** percevalbot has quit IRC | 09:31 | |
| *** ohamada has quit IRC | 09:32 | |
| *** ohamada has joined #tripleo | 09:32 | |
| *** artom_ has joined #tripleo | 09:33 | |
| *** artom has quit IRC | 09:33 | |
| *** lucas-afk is now known as lucasagomes | 09:34 | |
| gfidente | marios wait we can.t bring down all monitors at same time either | 09:35 |
| gfidente | on controlers' | 09:35 |
| *** percevalbot has joined #tripleo | 09:36 | |
| *** crenguta has quit IRC | 09:37 | |
| marios | gfidente: so afaik no-one has poked at that yet (adding the steps to the ceph-mon.yaml). As for other services, there would be a 'stop' on the service before package update and then the puppet run (post-deploy) will configure & start things. | 09:38 |
| marios | gfidente: but, it sounds like we would need to special case the mons? | 09:38 |
| *** crenguta has joined #tripleo | 09:39 | |
| shardy | how did we upgrade the mons for previous releases? | 09:39 |
| gfidente | hmm interesting | 09:39 |
| gfidente | shardy eh the batched thing I mentioned | 09:39 |
| gfidente | sec, link | 09:40 |
| gfidente | you underestimate my ability to add bugs | 09:40 |
| *** jerrygb_ has joined #tripleo | 09:41 | |
| gfidente | shardy https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/tasks/major_upgrade_pacemaker.yaml#L51L61 | 09:41 |
| gfidente | actually https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/tasks/major_upgrade_pacemaker.yaml#L36-L61 | 09:41 |
| gfidente | it had a specific softwaredeployment and only that was batched | 09:41 |
| shardy | gfidente: Ok, I somehow missed this requirement, but I think we can add this to the upgrade architecture fairly easily | 09:42 |
| shardy | Let me grab a coffee and hack on a patch, give me a few mins | 09:43 |
| *** jerrygb has quit IRC | 09:43 | |
| gfidente | so *think* this could turn useful for rabbit, galera | 09:43 |
| gfidente | and other stuff we want to keep running during the upgrade | 09:43 |
| gfidente | (we might want to keep running) | 09:43 |
| shardy | yeah, well when all openstack services support rolling upgrades we could do this for everything | 09:44 |
| marios | shardy: damn forgot about that one too. also wanted to bring up the cinder node because we also have that together with the controllers (a bit further down in that file https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/tasks/major_upgrade_pacemaker.yaml#L106 ) and i was thinking about it with the 'disable_upgrade' flag | 09:44 |
| marios | shardy: and i believe the reason we had to do that together with controllers was because there was no way of pinning cinder to some rpc version, not sure if that is still true | 09:45 |
| *** psahoo has joined #tripleo | 09:45 | |
| shardy | marios: so that doesn't use batches, do we just need to upgrade BlockStorage at the same time as the Controllers? | 09:46 |
| *** jerrygb has joined #tripleo | 09:46 | |
| marios | shardy: right | 09:46 |
| shardy | marios: Ok, so that's basically what we already do, right? | 09:47 |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/cinder-volume.yaml#L118 | 09:47 |
| shardy | we just run those steps unless disable_upgrade? | 09:47 |
| marios | shardy: stand-alone blockstorage nodes were the exception to the upgrade_non_controller.sh pattern because of the need for them to happen together with controller services | 09:47 |
| shardy | marios: Ok, I don't think anyone is using that role in production anyway, so no big deal IMO | 09:48 |
| *** jerrygb_ has quit IRC | 09:48 | |
| shardy | getting ceph right is a bigger issue ;) | 09:48 |
| marios | shardy: cool so we would just leave out the disable_upgrade for blockstorage and let the ansible run there | 09:48 |
| gfidente | but I was wondering | 09:48 |
| gfidente | with galera and the other infra services we're allowed to have them all down together because the vms stay up anyway right? | 09:49 |
| marios | gfidente: btw/missed you were using the batched property for ceph-mons that is pretty cool | 09:49 |
| *** jbadiapa has quit IRC | 09:49 | |
| marios | gfidente: yeah we aren't touching nova-compute | 09:50 |
| marios | gfidente: i mean at that point | 09:50 |
| gfidente | yeah | 09:50 |
| gfidente | marios so I only added the yaml though, heat does things :) | 09:50 |
| *** sdake has quit IRC | 09:52 | |
| *** sdake has joined #tripleo | 09:53 | |
| *** yprokule has quit IRC | 09:54 | |
| gfidente | d0ugal why is mistral returning lists of workflows and executions when you try to get a single one? | 09:57 |
| gfidente | (by id) | 09:57 |
| *** owalsh has quit IRC | 09:59 | |
| *** owalsh has joined #tripleo | 09:59 | |
| *** hewbrocca_afk is now known as hewbrocca | 10:00 | |
| *** salmankhan has joined #tripleo | 10:00 | |
| *** yamahata has quit IRC | 10:02 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add support for batched upgrades to composable upgrades https://review.openstack.org/423160 | 10:03 |
| shardy | gfidente, marios: ^^ | 10:03 |
| shardy | we can do something like that I think (not yet tested) | 10:03 |
| *** jbadiapa has joined #tripleo | 10:04 | |
| *** karimb has joined #tripleo | 10:05 | |
| *** nijaba has quit IRC | 10:05 | |
| marios | shardy: cool... so we'd add the ceph-mon steps under upgrade_batch_tasks? | 10:06 |
| marios | shardy: otherwise the ordering looks to be the same (i.e. the ceph mon stuff before even step1 of controller upgrade) | 10:06 |
| shardy | marios: yeah, I've made it so it does the non-batched then batched tasks | 10:06 |
| shardy | but we can reverse that if needed | 10:07 |
| gfidente | shardy yeah it was going the other way around before | 10:07 |
| karimb | hello folks, what crushmap does tripleo deploy by default ? | 10:07 |
| shardy | gfidente: Ok I'll switch it | 10:07 |
| shardy | note that will still respect the steps | 10:07 |
| gfidente | shardy sec | 10:07 |
| shardy | e.g batched step1, all step1, batched step2, all step2 | 10:08 |
| shardy | etc | 10:08 |
| gfidente | the reason for doing ceph upgrade first at the time | 10:08 |
| shardy | in that patch it's all step1, batched step1, all step2, batched step2 | 10:08 |
| gfidente | was that yum was going to upgrade ceph packages, for running daemons, without going through necessary "upgrade" steps | 10:08 |
| *** psahoo has quit IRC | 10:08 | |
| gfidente | are we still doing the packages upgrade in a single yum update step? | 10:09 |
| shardy | gfidente: yes, but you could upgrade ceph* before we do yum -y update | 10:09 |
| gfidente | shardy right that was the issue we had, we needed to run additional commands after the package was updated and before the daemon was restarted | 10:10 |
| *** athomas has joined #tripleo | 10:10 | |
| gfidente | so I put it before the 'general' yum update | 10:10 |
| gfidente | and sounds like it continues to be the case | 10:10 |
| *** salmankhan1 has joined #tripleo | 10:10 | |
| d0ugal | gfidente: how are you trying to get an individual one? | 10:11 |
| gfidente | again problem is that before moving on to the next node, we need to ensure the mon is back up otherwise the vms get i/o issues | 10:11 |
| *** ealcaniz has quit IRC | 10:11 | |
| *** nijaba has joined #tripleo | 10:12 | |
| *** nijaba has quit IRC | 10:12 | |
| *** nijaba has joined #tripleo | 10:12 | |
| skramaja | can anyone have a look at - https://review.openstack.org/#/c/415682/ | 10:13 |
| *** jerrygb has quit IRC | 10:13 | |
| *** jerrygb has joined #tripleo | 10:14 | |
| *** salmankhan has quit IRC | 10:15 | |
| *** salmankhan1 is now known as salmankhan | 10:15 | |
| *** jbadiapa has quit IRC | 10:18 | |
| gfidente | karimb just per-node replication | 10:20 |
| gfidente | karimb you can disable the automatic crushmap building though and mangle it after the deployment is finished | 10:20 |
| *** psahoo has joined #tripleo | 10:21 | |
| gfidente | karimb if you deploy with an env file like this http://paste.openstack.org/show/595756/ , it will disable automatic crushmap | 10:22 |
| shardy | Ok so we can't interleave the steps, as we need each mon to be fully upgraded before starting the upgrade on the next | 10:24 |
| * shardy updates patch | 10:24 | |
| *** ealcaniz has joined #tripleo | 10:24 | |
| matbu | shardy: do you know if there is a way with SoftwareConfig / group: puppet, to just push the puppet manifest in a specific destination on the node ? (and noop it btw) | 10:25 |
| *** psahoo has quit IRC | 10:25 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Adds a pre-upgrade check that service is running (step0) https://review.openstack.org/414598 | 10:25 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add support for batched upgrades to composable upgrades https://review.openstack.org/423160 | 10:25 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add upgrade support for ceph-mon service https://review.openstack.org/423182 | 10:25 |
| *** padkrish has quit IRC | 10:26 | |
| shardy | matbu: yes I was planning to push a patch today which does something like that, so we can run puppet on the non-controler nodes | 10:26 |
| matbu | shardy: cool, can you point me to an example ? | 10:26 |
| shardy | matbu: I think we'll have to just use a group: script deployment and a cat > /root/foo.pp << EOF | 10:26 |
| *** ansiwen_ has joined #tripleo | 10:27 | |
| matbu | shardy: ha yep, it was what i'm planning to do | 10:27 |
| matbu | shardy: but i was wondering if there was something better :) | 10:27 |
| *** ansiwen has quit IRC | 10:27 | |
| shardy | gfidente: ^^ there's an example of how it might work | 10:27 |
| *** padkrish has joined #tripleo | 10:27 | |
| matbu | shardy: it's related to a customer bug that i'm fixing it in mitaka | 10:27 |
| shardy | matbu: yeah, there's not atm, but we might consider a group: file hook in future | 10:28 |
| matbu | shardy: but i need to run puppet on the non controller node, like you plan to do with N to O | 10:28 |
| *** shinobu_ has joined #tripleo | 10:28 | |
| shardy | matbu: dprince added a json-file hook recently, but for the manifests we just need "file" | 10:28 |
| *** sshnaidm is now known as sshnaidm|off | 10:28 | |
| matbu | shardy: yep, ack so i'll update my patch , thanks. Can you add me as reviewer in your 'futur' review ?plz | 10:29 |
| *** owalsh has quit IRC | 10:30 | |
| shinobu_ | I just thought, if we change some values in yamls, those changes are applied to not only existing overcloud nodes but also additional nodes. | 10:30 |
| shardy | we could use the json-file hook to write ansible playbooks in json tho | 10:31 |
| shardy | matbu: Ok let me do a quick example, but I don't think we'll be able to backport it | 10:31 |
| *** saneax is now known as saneax-_-|AFK | 10:31 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates: Configure nova neutron parameter for L to M upgrade https://review.openstack.org/422837 | 10:33 |
| *** padkrish has quit IRC | 10:34 | |
| *** salmankhan has quit IRC | 10:35 | |
| matbu | shardy: i have made this : https://review.openstack.org/#/c/422837/ | 10:36 |
| *** karimb has quit IRC | 10:36 | |
| *** limao_ has quit IRC | 10:36 | |
| *** limao has joined #tripleo | 10:37 | |
| *** owalsh has joined #tripleo | 10:38 | |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart-extras: Use pull-puppet-modules from upstream https://review.openstack.org/423190 | 10:39 |
| openstackgerrit | Merged openstack/puppet-tripleo: Remove unused variable in certmonger/mysql manifest https://review.openstack.org/409152 | 10:40 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: WIP: Conntainers with multi-nic and net-iso https://review.openstack.org/422448 | 10:40 |
| openstackgerrit | Luke Hinds proposed openstack/tripleo-heat-templates: Adds SSH Banner text into sshd_config https://review.openstack.org/408638 | 10:41 |
| *** limao has quit IRC | 10:42 | |
| *** tosky has joined #tripleo | 10:42 | |
| *** karimb has joined #tripleo | 10:42 | |
| *** dtantsur|afk is now known as dtantsur | 10:43 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add upgrade support for ceph-mon service https://review.openstack.org/423182 | 10:48 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add support for batched upgrades to composable upgrades https://review.openstack.org/423160 | 10:48 |
| *** dsneddon has quit IRC | 10:50 | |
| *** ipsecguy_ has quit IRC | 10:51 | |
| openstackgerrit | Merged openstack/puppet-tripleo: Add base profile for Octavia services https://review.openstack.org/351898 | 10:51 |
| *** panda|Zz is now known as panda | 10:52 | |
| openstackgerrit | Luke Hinds proposed openstack/tripleo-heat-templates: Adds SSH Banner text into sshd_config https://review.openstack.org/408638 | 10:54 |
| *** b00tcat` has joined #tripleo | 11:03 | |
| *** nyechiel has quit IRC | 11:06 | |
| nmathew | Is this the forum to ask a question on os-net-config | 11:17 |
| nmathew | ? | 11:17 |
| shardy | nmathew: Yes, sure, we can try to help | 11:17 |
| *** thrash|g0ne is now known as thrash | 11:18 | |
| nmathew | very basic question | 11:19 |
| nmathew | i dont see calls to ovs-vsctl in os-net-config | 11:19 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Add disable_upgrade_deployment flag to roles_data.yaml https://review.openstack.org/418344 | 11:19 |
| nmathew | how it is mapped, any pointers | 11:20 |
| openstackgerrit | Brad P. Crochet proposed openstack/python-tripleoclient: Migrate overcloud delete to full workflow https://review.openstack.org/422806 | 11:20 |
| skramaja | os-net-config's responsibility is to create ifcfg-xxx scripts, and trigger ifup | 11:20 |
| skramaja | nmathew: ovs bridge creation will be done by ifup-ovs - https://github.com/openvswitch/ovs/blob/master/rhel/etc_sysconfig_network-scripts_ifup-ovs | 11:21 |
| nmathew | Thanks skramaja, I will look into it | 11:22 |
| marios | nmathew: o-n-c uses the ifcfg files to define the ovs objects | 11:26 |
| marios | nmathew: (well it depends which implementation the host it is running on is using, but for us it is ifcfg-* files) | 11:27 |
| *** nmathew has quit IRC | 11:27 | |
| *** ipsecguy has joined #tripleo | 11:32 | |
| *** pkovar has joined #tripleo | 11:33 | |
| *** percevalbot has quit IRC | 11:38 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras: Collect logs for containers only if docker runs https://review.openstack.org/422909 | 11:39 |
| *** jkilpatr has quit IRC | 11:43 | |
| *** jbcraig has quit IRC | 11:44 | |
| *** percevalbot has joined #tripleo | 11:44 | |
| *** yprokule has joined #tripleo | 11:47 | |
| gfidente | anyone dare enough for ceph/rbd https://review.openstack.org/#/c/407038/ ? | 11:47 |
| gfidente | I should say rbd-mirror | 11:47 |
| *** suuuper has joined #tripleo | 11:52 | |
| *** percevalbot has quit IRC | 11:55 | |
| *** jkilpatr has joined #tripleo | 11:57 | |
| openstackgerrit | Frank Zdarsky proposed openstack/os-net-config: Add schema file to enable config data validation https://review.openstack.org/423230 | 11:59 |
| *** pcaruana has quit IRC | 11:59 | |
| *** percevalbot has joined #tripleo | 11:59 | |
| *** percevalbot has quit IRC | 12:00 | |
| *** percevalbot has joined #tripleo | 12:02 | |
| *** saneax-_-|AFK is now known as saneax | 12:02 | |
| *** ansmith has joined #tripleo | 12:03 | |
| *** milan has joined #tripleo | 12:04 | |
| openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci: Use HCI Ceph in HA job https://review.openstack.org/338088 | 12:05 |
| *** milan has left #tripleo | 12:05 | |
| *** milan has quit IRC | 12:05 | |
| gfidente | bnemec ^^ rebased on top of yours for compute/storagemgmt | 12:05 |
| *** jkilpatr has quit IRC | 12:05 | |
| *** pcaruana has joined #tripleo | 12:06 | |
| *** fzdarsky is now known as fzdarsky|lunch | 12:06 | |
| *** ansmith has quit IRC | 12:11 | |
| *** nmathew has joined #tripleo | 12:18 | |
| *** karimb has quit IRC | 12:18 | |
| *** sdake_ has joined #tripleo | 12:18 | |
| *** sdake has quit IRC | 12:18 | |
| *** jkilpatr has joined #tripleo | 12:19 | |
| mcornea | shardy: hi! I had an upgrade attempt and I think the upgrade tasks for cinder volume weren't executed. Do you have any suggestions on how to debug it? | 12:24 |
| EmilienM | hi | 12:24 |
| shardy | mcornea: Hi! did the heat stack error, or complete OK? | 12:26 |
| shardy | mcornea: the way I've been debugging locally is to tail /var/log/messages on the node, and watch each ansible playbook run | 12:27 |
| mcornea | shardy: it's complete ok but I couldn't find any cinder_volume reference in the os-collect-config log | 12:27 |
| shardy | EmilienM: Hi, good morning | 12:27 |
| *** masco has quit IRC | 12:27 | |
| *** ohamada has quit IRC | 12:28 | |
| mcornea | shardy: ah, maybe it's related to the fact that I'm running it under pacemaker? | 12:29 |
| *** xuao has joined #tripleo | 12:29 | |
| shardy | mcornea: Ah, yeah, the pacemaker patches haven't landed yet | 12:29 |
| mcornea | shardy: ok, that explains it. thanks! are there open review for the pacemaker services? | 12:30 |
| *** ohamada has joined #tripleo | 12:30 | |
| *** rhallisey has joined #tripleo | 12:30 | |
| *** ohamada has quit IRC | 12:30 | |
| shardy | matbu: ^^ You've been working on pacemaker integration, right? | 12:30 |
| EmilienM | slagle_, shardy: quick fyi : on PTO today, I won't be on irc most of the day | 12:30 |
| shardy | EmilienM: ack, OK enjoy! | 12:31 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 12:32 |
| shardy | mcornea: Ok so there is https://review.openstack.org/#/c/403397/ but I don't think we have the upgrade_tasks in puppet/services/pacemaker* yet | 12:32 |
| matbu | shardy: yep | 12:32 |
| shardy | matbu: what's the status on that, are you working on that locally? | 12:32 |
| EmilienM | shardy: we need +A on https://review.openstack.org/#/c/422920/ to get a promotion I think | 12:33 |
| matbu | shardy: there is this review https://review.openstack.org/#/c/403397 | 12:33 |
| slagle_ | EmilienM: yo! real quick...which are the patches that fix 3nodes? | 12:33 |
| EmilienM | slagle_: yes, a sec | 12:33 |
| matbu | shardy: it's working for me , i think for marios as well | 12:34 |
| EmilienM | slagle_: https://review.openstack.org/#/c/422915/ and https://review.openstack.org/#/c/422916/ I think | 12:34 |
| EmilienM | slagle_: the last one doesn't pass 3node because it needs the first one | 12:34 |
| EmilienM | slagle_: but I did the DependsOn order on purpose because I didn't want to add the puppet class twice | 12:34 |
| slagle_ | ok | 12:34 |
| EmilienM | slagle_: this CI job is really cool :) | 12:35 |
| EmilienM | slagle_: let me kick off a THT patch to test the job is now working with the 2 patches | 12:35 |
| mcornea | matbu: shardy it worked for me as well but there are some additional services which run under pacemaker such as cinder volume and manila share if I remember correctly | 12:35 |
| slagle_ | EmilienM: yea, that's what i was going to do, but go4it | 12:36 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Test gate-tripleo-ci-centos-7-3nodes-multinode-nv https://review.openstack.org/423245 | 12:36 |
| *** shardy is now known as shardy_lunch | 12:36 | |
| *** slagle_ is now known as slagle | 12:37 | |
| slagle | EmilienM: will keep an eye on it | 12:37 |
| *** lucasagomes is now known as lucas-hungry | 12:37 | |
| EmilienM | cool, thanks | 12:37 |
| chem | matbu: so we don't add the any default service in the pacemaker list ? | 12:39 |
| chem | matbu: for https://review.openstack.org/#/c/403397 | 12:39 |
| chem | matbu: if that's the consensus, I just +1 | 12:39 |
| EmilienM | can someone approve https://review.openstack.org/#/c/422746 please? it's not deploying Nova Placement correctly :) | 12:40 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-image-elements: Purge chrony package in NTP element https://review.openstack.org/422839 | 12:41 |
| chem | matbu: https://review.openstack.org/#/c/403397/15//COMMIT_MSG, https://review.openstack.org/#/c/403397/15/puppet/services/pacemaker.yaml and there https://review.openstack.org/#/c/403397/16/puppet/services/pacemaker.yaml | 12:41 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-image-elements: Purge chrony package in NTP element https://review.openstack.org/422839 | 12:41 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common: overcloud: include ntp element https://review.openstack.org/422840 | 12:42 |
| EmilienM | this one is also ready & easy to review: https://review.openstack.org/#/c/422913/ | 12:42 |
| slagle | EmilienM: the upgrades job failed on https://review.openstack.org/#/c/422746/, but i guess maybe it's not related? | 12:44 |
| EmilienM | slagle: I don't think so, we add the placement service during Ocata | 12:45 |
| EmilienM | let me check logs | 12:45 |
| slagle | Jan 20 00:58:04 centos-7-2-node-osic-cloud1-s3500-6790799-384241 os-collect-config: #033[1;31mError: Invalid parameter sync_db on Class[Glance::Api] at /etc/puppet/modules/tripleo/manifests/profile/base/glance/api.pp:81 on node centos-7-2-node-osic-cloud1-s3500-6790799-384241.localdomain#033[0m | 12:45 |
| EmilienM | http://logs.openstack.org/46/422746/4/check/gate-tripleo-ci-centos-7-multinode-upgrades-nv/efe7fec/logs/postci.txt.gz#_2017-01-20_00_58_41_000 | 12:46 |
| EmilienM | yeah | 12:46 |
| EmilienM | it's not related | 12:46 |
| slagle | different problem i suppose | 12:46 |
| EmilienM | and AFIk I've seen upgrade job passing again this morning | 12:46 |
| *** jerrygb_ has joined #tripleo | 12:46 | |
| *** nyechiel has joined #tripleo | 12:47 | |
| *** jerrygb has quit IRC | 12:49 | |
| panda | EmilienM: if you have time https://review.openstack.org/420620 | 12:51 |
| *** zoli|wfh is now known as zoli|lunch | 12:52 | |
| *** b00tcat` has quit IRC | 12:52 | |
| EmilienM | panda: where is it tested? | 12:53 |
| *** morazi has joined #tripleo | 12:53 | |
| panda | EmilienM: https://review.openstack.org/421272 here, an ugly hack to remap the name to gate-tripleo-ci-centos-7-ovb-nonha job | 12:54 |
| panda | EmilienM: results are here http://logs.openstack.org/72/421272/8/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/0bc1859/ | 12:54 |
| panda | EmilienM: the test does not pass, because of the short timeout | 12:54 |
| EmilienM | panda: but it's red | 12:54 |
| *** hjensas has quit IRC | 12:54 | |
| panda | EmilienM: but you can see that it ws spending one hour in tempest task, that means it was running full tempest | 12:55 |
| EmilienM | panda: so we want to merge your patch, even if we know it won't work because of timeout? | 12:55 |
| *** links has quit IRC | 12:55 | |
| * EmilienM trying to understand here | 12:55 | |
| panda | EmilienM: after that patch we're going to merge this https://review.openstack.org/420647 | 12:56 |
| panda | to increase the timeout | 12:56 |
| EmilienM | mhh ok | 12:57 |
| EmilienM | panda: did we have the timeout without quickstart? | 12:57 |
| *** nmathew has quit IRC | 12:59 | |
| *** morazi has quit IRC | 12:59 | |
| panda | EmilienM: what do you mean, http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha-tempest/54d77c1/console.html is running only smoke tests, | 12:59 |
| EmilienM | panda: ok, and now we want full tempest right? | 12:59 |
| openstackgerrit | Martin André proposed openstack/tripleo-quickstart-extras: Use containers uploads template from upstream https://review.openstack.org/423251 | 12:59 |
| panda | EmilienM: absolutely, we want the real thing | 12:59 |
| *** dprince has joined #tripleo | 12:59 | |
| EmilienM | oki doki | 12:59 |
| EmilienM | panda: +2 | 12:59 |
| panda | EmilienM: thanks. I'll pester bnemec later | 13:00 |
| *** hjensas has joined #tripleo | 13:00 | |
| *** hjensas has joined #tripleo | 13:00 | |
| *** yolanda has quit IRC | 13:01 | |
| marios | matbu: shardy_lunch was at lunch... yeah if you guys were talking about the pacemaker ansible stuff from matbu yes it works for me too had a run yesterday with it (cluster stopped/started ) | 13:01 |
| *** yolanda has joined #tripleo | 13:02 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Fix class constructors https://review.openstack.org/422680 | 13:02 |
| *** dsariel has quit IRC | 13:04 | |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud: placement: fix auth_url https://review.openstack.org/423254 | 13:08 |
| *** liverpooler has joined #tripleo | 13:08 | |
| openstackgerrit | Sven Anderson proposed openstack/puppet-tripleo: Implement Nova ec2api profile https://review.openstack.org/336562 | 13:08 |
| openstackgerrit | Sven Anderson proposed openstack/tripleo-heat-templates: Add ec2-api service https://review.openstack.org/398634 | 13:09 |
| openstackgerrit | Sven Anderson proposed openstack/tripleo-heat-templates: DON'T MERGE - tester for I2510fd4ed935d8423216fff9ce3adf2d69c9c804 https://review.openstack.org/406167 | 13:09 |
| *** xuao has quit IRC | 13:10 | |
| *** athomas has quit IRC | 13:10 | |
| *** morazi has joined #tripleo | 13:11 | |
| *** shardy_lunch is now known as shardy | 13:14 | |
| *** sdake has joined #tripleo | 13:14 | |
| *** ohamada has joined #tripleo | 13:15 | |
| shardy | marios: ack, OK lets try to get that landed, then we can add support for the services managed by pacemaker | 13:15 |
| *** athomas has joined #tripleo | 13:16 | |
| matbu | shardy: marios i was mostly working on add pcs+nova before i jump on the dell issue | 13:16 |
| *** nyechiel has quit IRC | 13:17 | |
| *** sdake_ has quit IRC | 13:17 | |
| *** dsariel has joined #tripleo | 13:18 | |
| *** dougbtv_ has joined #tripleo | 13:21 | |
| colonwq | EmilienM, and others, can this get approved for merging? https://review.openstack.org/#/c/405625/ | 13:21 |
| marios | shardy: matbu ack | 13:21 |
| *** fzdarsky|lunch is now known as fzdarsky | 13:21 | |
| EmilienM | colonwq: oh yes we need that | 13:21 |
| colonwq | Death to admin token. | 13:22 |
| EmilienM | kill v2 api! | 13:22 |
| *** trown|outtypewww is now known as trown | 13:22 | |
| shardy | colonwq: you moved the ceph::rgw::keystone* out of service_config_settings | 13:23 |
| shardy | are you sure that's what is needed? | 13:23 |
| *** jayg|g0n3 is now known as jayg | 13:24 | |
| *** pgadiya has quit IRC | 13:24 | |
| colonwq | shardy, we had problems getting this to work as I initially expected that way. I am rebuilding my dev environment so I am stuck on testing for the moment. | 13:24 |
| colonwq | I can try shifting those down after I am back on my feet. | 13:25 |
| openstackgerrit | Martin André proposed openstack/tripleo-common: Use latest containers for master branch https://review.openstack.org/423260 | 13:27 |
| *** shardy has quit IRC | 13:27 | |
| *** shardy has joined #tripleo | 13:27 | |
| shardy | colonwq: Ok, cool - AFAICT it will break if you try deploying keystone on a different role | 13:28 |
| shardy | https://github.com/openstack/puppet-ceph/blob/master/manifests/rgw/keystone/auth.pp#L68 | 13:28 |
| shardy | that shows endpoint creation, which I think has to happen via the node running keystone | 13:28 |
| shardy | moving those back to service_config_settings won't make any difference when keystone and rgw are on the same role | 13:29 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Add swift service support for composable upgrades https://review.openstack.org/405245 | 13:29 |
| gfidente | shardy I moved it actually | 13:29 |
| gfidente | those settings are for rgw not for keystone | 13:30 |
| EmilienM | can I get +A on https://review.openstack.org/#/c/422913/ please? | 13:30 |
| gfidente | I am not sure why they ended up in the keystone role initially | 13:30 |
| colonwq | shardy, I have seen a heat implementation with a custom role for rgw. | 13:30 |
| shardy | gfidente: ensure_resource('keystone_endpoint' | 13:30 |
| EmilienM | same for https://review.openstack.org/#/c/422915/ and https://review.openstack.org/#/c/422916/ | 13:30 |
| shardy | gfidente: are you sure? | 13:30 |
| gfidente | shardy dahh | 13:31 |
| shardy | gfidente: Ok, I'll remove my -1 and perhaps someone can just test and confirm on the review | 13:31 |
| gfidente | no no it's good | 13:31 |
| gfidente | I'll update it | 13:31 |
| openstackgerrit | Merged openstack/tripleo-puppet-elements: Remove carbonara package reference https://review.openstack.org/422920 | 13:31 |
| gfidente | thanks | 13:31 |
| *** Goneri has joined #tripleo | 13:31 | |
| colonwq | thanks | 13:33 |
| openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud: Allow enabling node auto-discovery on the undercloud https://review.openstack.org/423265 | 13:34 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add support for not using admin_token in Ceph/RGW https://review.openstack.org/405625 | 13:36 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add support for not using admin_token in Ceph/RGW https://review.openstack.org/405625 | 13:36 |
| gfidente | should be ok now, thanks shadower | 13:37 |
| gfidente | dah, thanks shardy | 13:37 |
| *** jpena is now known as jpena|lunch | 13:37 | |
| openstackgerrit | Merged openstack/puppet-tripleo: Move nova::placement to common nova manifest https://review.openstack.org/422739 | 13:38 |
| *** rlandy has joined #tripleo | 13:38 | |
| openstackgerrit | Frank Zdarsky proposed openstack/os-net-config: Add schema file to enable config data validation https://review.openstack.org/423230 | 13:39 |
| gfidente | shardy though I think I am missing something | 13:44 |
| *** ipsecguy has quit IRC | 13:44 | |
| *** prateek has quit IRC | 13:44 | |
| gfidente | dprince what is importing the actual rgw::keystone::auth class on the keystone node? | 13:44 |
| gfidente | dprince looking at https://review.openstack.org/#/c/370573/10 | 13:44 |
| *** ipsecguy has joined #tripleo | 13:45 | |
| *** ipsecguy has quit IRC | 13:46 | |
| *** jmelvin has joined #tripleo | 13:46 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui: [WIP] Add i18n to Notifications https://review.openstack.org/419469 | 13:46 |
| *** ipsecguy has joined #tripleo | 13:47 | |
| *** paramite has quit IRC | 13:47 | |
| *** hjensas has quit IRC | 13:47 | |
| *** gkadam has quit IRC | 13:47 | |
| *** lucas-hungry is now known as lucasagomes | 13:48 | |
| shardy | gfidente: https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/keystone.pp#L207 | 13:49 |
| shardy | I think that's it | 13:49 |
| gfidente | ah it's explicitly added there | 13:50 |
| gfidente | ok cool | 13:50 |
| *** ansmith has joined #tripleo | 13:51 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Move nova placement hiera to nova-base https://review.openstack.org/422746 | 13:52 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/os-cloud-config: Updated from global requirements https://review.openstack.org/423276 | 13:53 |
| *** jeckersb is now known as jeckersb_gone | 13:55 | |
| *** tzumainn has joined #tripleo | 13:55 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-tripleoclient: Updated from global requirements https://review.openstack.org/423278 | 13:56 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements https://review.openstack.org/423280 | 13:57 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add upgrade support for ceph-mon service https://review.openstack.org/423182 | 13:57 |
| *** leanderthal has joined #tripleo | 13:58 | |
| dtantsur | shardy, hey! are we (the ironic team) expected to provide something like ^^ for ironic? | 13:59 |
| dprince | gfidente: just got out of a call. looking... | 13:59 |
| *** xuao has joined #tripleo | 13:59 | |
| openstackgerrit | Merged openstack/tripleo-common: Add the iptables element to the image building process https://review.openstack.org/422475 | 14:00 |
| openstackgerrit | Merged openstack/tripleo-common: Provided an option to disable the password generation https://review.openstack.org/414424 | 14:00 |
| *** skramaja has quit IRC | 14:02 | |
| dprince | gfidente: http://git.openstack.org/cgit/openstack/puppet-tripleo/tree/manifests/profile/base/keystone.pp#n207 | 14:02 |
| dprince | gfidente: is that the one you wanted? | 14:02 |
| shardy | dtantsur: I've already done it, but it's not well tested yet | 14:04 |
| shardy | https://review.openstack.org/#/c/405248/ | 14:04 |
| shardy | dtantsur: if you can help review the steps there, that would be great | 14:04 |
| EmilienM | slagle: pingtest failing again :-/ Resource CREATE failed: ResourceInError: resources.volume1: Went to status error due to "Unknown" - I'll investigate once I hvae logs | 14:05 |
| shardy | dtantsur: I was planning to run only the conductor and API services in the upgrade CI job, as we can't have the NovaIronic and NovaLibvirt configs running on the same node | 14:05 |
| gfidente | dprince ack yes | 14:05 |
| EmilienM | slagle: though my patches for the cinder/glance thing is required I'm quite sure. Cinder volume needs Glance parameters for boot from volume | 14:06 |
| shardy | dtantsur: it is my hope that when we get the initial support for all the services in place the various project teams will step up and help maintain the upgrade tasks | 14:06 |
| *** leanderthal has quit IRC | 14:06 | |
| *** sdake_ has joined #tripleo | 14:06 | |
| dtantsur | shardy, thanks! yeah, NovaIronic and NovaLibvirt don't live together | 14:07 |
| *** jbadiapa has joined #tripleo | 14:07 | |
| *** [1]cdearborn has joined #tripleo | 14:08 | |
| *** sdake has quit IRC | 14:09 | |
| EmilienM | slagle: looking at cinder.conf, it sounds like my patch wasn't taken in account :/ | 14:10 |
| jprovazn | good morning/afternoon tripleo-ers, anyone has a minute for one-line review? https://review.openstack.org/#/c/416960/ | 14:10 |
| EmilienM | slagle: maybe a Depends-On thing? | 14:10 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements https://review.openstack.org/423280 | 14:10 |
| gfidente | jprovazn yes I do those usually | 14:11 |
| EmilienM | slagle: /me facepalm, I put the wrong Depends-On ID... | 14:11 |
| shardy | Can someone pls check https://review.openstack.org/#/c/405247 - adds sahara upgrade support and ready to land I think | 14:11 |
| * EmilienM feels stupid now | 14:11 | |
| jprovazn | gfidente, :) thanks | 14:11 |
| shardy | https://review.openstack.org/#/c/420100/ can also land now that swift upgrade support landed in t-h-t | 14:12 |
| jprovazn | gfidente, yes - I think I owe you couple of beers next time you are in brno | 14:12 |
| gfidente | wow | 14:12 |
| gfidente | so 'default' there matches whatever is the default share configured in manila? | 14:12 |
| gfidente | *default backend | 14:13 |
| *** jcoufal has joined #tripleo | 14:13 | |
| EmilienM | matbu, marios, chem, shardy: a quick update before I leave, about upgrade jobs. I'll work cloning scenario jobs into scenario-upgrade jobs, so we'll have one upgrade job per scenario, so we can increase coverage without overloading a single job. Exactly the same model as classic multinode job with minimum of services versus scenarios001,002,003,004 with different coverage. Wdyt? | 14:13 |
| jprovazn | gfidente, not really, the expectation is that an admin created also "default" (IOW named "default") share type after OC deployment | 14:14 |
| *** zoli|lunch is now known as zoli|wfh | 14:14 | |
| jprovazn | s/created/creates | 14:14 |
| marios | ack thanks EmilienM , haven't poked there for a while but let me know if i can help with anything. have a good one bai | 14:14 |
| chem | EmilienM: that's awesome | 14:14 |
| chem | EmilienM: idem here | 14:14 |
| EmilienM | cool | 14:14 |
| gfidente | jprovazn ah so that is the same problem we have in cinder | 14:15 |
| EmilienM | flaper87, dprince: and I think we can do the same with the container scenario, by having multinode-oooq deploying scenario with containers. Probably during Pike | 14:15 |
| jprovazn | gfidente, um, probably, not sure which one you mean | 14:15 |
| EmilienM | so we would have 3 jobs for each scenario: classic multinode, container and upgrades | 14:16 |
| gfidente | jprovazn if it has multiple backends, when creating a volume without a type it just goes on the backend with the most available free space | 14:16 |
| gfidente | is manila refusing to create the share entirely? | 14:16 |
| jprovazn | gfidente, this is defferent one then | 14:17 |
| jprovazn | gfidente, if you create manila share and do not pass specify "--type" for settign share type, the default one is used | 14:17 |
| jprovazn | gfidente, this default one must both be set in config file (my patch) and also must exist (admins does in post-deploy) | 14:18 |
| gfidente | jprovazn and what is the default chosen? | 14:18 |
| tbarron | gfidente: cinder doesn't actually require that there be a volume-type for create to succeed; manila requires that one refer to a share-type either explicitly, or as default | 14:18 |
| jprovazn | gfidente, default is the one set in config file | 14:18 |
| *** saneax is now known as saneax-_-|AFK | 14:18 | |
| *** leanderthal has joined #tripleo | 14:18 | |
| gfidente | ah so if there isn't one it won't create it at all | 14:18 |
| gfidente | got it | 14:19 |
| *** flepied has joined #tripleo | 14:19 | |
| gfidente | tks, +2 | 14:19 |
| jprovazn | gfidente, if there is no default and you don't specify --type, it will faile to create the share | 14:19 |
| jprovazn | gfidente, thanks :) | 14:19 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Test gate-tripleo-ci-centos-7-3nodes-multinode-nv https://review.openstack.org/423245 | 14:20 |
| *** zoli|wfh is now known as zoli|brb | 14:21 | |
| *** weshay_afk is now known as weshay | 14:23 | |
| *** flepied has quit IRC | 14:23 | |
| bandini | panda: do you have any ideas on https://bugs.launchpad.net/tripleo/+bug/1657173 ? | 14:26 |
| openstack | Launchpad bug 1657173 in tripleo "sshd failing to start on undercloud" [High,Triaged] | 14:26 |
| bandini | (beyond your last comment I mean) | 14:26 |
| bandini | panda: am about to look at what changed in openssh | 14:27 |
| *** nyechiel has joined #tripleo | 14:27 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates: Remove unused nova_url from neutron config https://review.openstack.org/423301 | 14:27 |
| panda | bandini: nothing else that is not written there, was about to open a bug. either is a problem there, or in systemd .. | 14:27 |
| bandini | panda: ack, thanks | 14:28 |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Don't disable heat APIs for upgrade job https://review.openstack.org/423302 | 14:29 |
| shardy | marios: ^^ I think that should fix your cfn service check problem | 14:29 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Adds a pre-upgrade check that service is running (step0) https://review.openstack.org/414598 | 14:30 |
| bandini | panda: I wonder if https://bugzilla.redhat.com/show_bug.cgi?id=1291172 has something to do with this | 14:33 |
| openstack | bugzilla.redhat.com bug 1291172 in openssh "systemctl restart/start sshd shows no error if start fails" [Medium,Closed: errata] - Assigned to jjelen | 14:33 |
| panda | bandini: I was looking at the same bug yesterday, it's the opposite problem, but shows some flaws in the interaction between systemd and sshd that may explain this too | 14:34 |
| marios | cs | 14:35 |
| marios | shardy: looking :) | 14:35 |
| shardy | marios: basically we aren't running those services in CI :) | 14:35 |
| openstackgerrit | John Fulton proposed openstack/tripleo-specs: TripleO Performance Profiles https://review.openstack.org/423304 | 14:35 |
| shardy | hopefully my patch fixes that | 14:35 |
| marios | shardy: i see, i hadn't realised you were referring to ci (I thought it was a local /env, which is why i sanity checked and posted from mine) | 14:36 |
| bandini | panda: yeah. weird | 14:36 |
| shardy | marios: yeah I assumed we had something up with the patch, but you're right it's fine I think | 14:37 |
| marios | shardy: i don't see any specific service being called out in this patch though https://review.openstack.org/gitweb?p=openstack-infra/tripleo-ci.git;a=commitdiff;h=628a0544d4abd053362619e0fdcfb113daa2e68c | 14:38 |
| shardy | marios: look in the worker-config.yaml I linked from the review | 14:39 |
| shardy | we tell puppet not to start the cfn/cw api | 14:39 |
| shardy | so I copied worker-config and removed those lines | 14:39 |
| marios | shardy: looking (sorry, trying locally rather than gerrit) , thanks will have a closer look no need to spend (more) time explaining :) | 14:39 |
| *** ealcaniz has quit IRC | 14:39 | |
| *** ohamada has quit IRC | 14:40 | |
| *** jeckersb_gone is now known as jeckersb | 14:40 | |
| *** flepied has joined #tripleo | 14:40 | |
| marios | ack i see it is (currently) explicitly set api_cfn enabled: false thanks shardy | 14:41 |
| *** amoralej is now known as amoralej|lunch | 14:41 | |
| shardy | gfidente: https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/tasks/major_upgrade_ceph_storage.sh | 14:42 |
| marios | shardy: or rather it is in worker-config.yaml but not in your workrer-config-upgrades.yaml | 14:42 |
| marios | shardy: :) thanks | 14:42 |
| shardy | do we have to run those steps manually, or can we safely do a rolling upgrade of the OSDs too? | 14:42 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Run post-deployment validations fix https://review.openstack.org/420056 | 14:42 |
| *** lblanchard has joined #tripleo | 14:42 | |
| *** absubram has joined #tripleo | 14:42 | |
| gfidente | shardy you mean the bash loop? | 14:45 |
| shardy | gfidente: well that whole script - I want to know if I should port that to upgrade_batch_tasks so we can test it in CI | 14:46 |
| gfidente | shardy no I think we can deprecate it as it was meant to cope with ceph major upgrade | 14:46 |
| gfidente | which we don't have going from n>o | 14:46 |
| gfidente | we might have to resurrect it for o>p | 14:47 |
| shardy | gfidente: Ok so what steps do we need on the OSD nodes for N->O? | 14:47 |
| shardy | just stop the service, update via yum and start again? | 14:47 |
| gfidente | yes | 14:47 |
| gfidente | plus | 14:47 |
| shardy | gfidente: Ok, cool, that's easy enough ;) | 14:48 |
| gfidente | https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/tasks/major_upgrade_ceph_storage.sh#L39-L42 | 14:48 |
| *** jcoufal__ has joined #tripleo | 14:48 | |
| gfidente | before stop and https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/tasks/major_upgrade_ceph_storage.sh#L99-L102 after start | 14:48 |
| *** nyechiel has quit IRC | 14:48 | |
| *** abehl has quit IRC | 14:48 | |
| shardy | gfidente: ack, cool - I'll try that and see how it goes | 14:48 |
| shardy | thanks | 14:48 |
| gfidente | ty | 14:49 |
| openstackgerrit | Merged openstack/instack-undercloud: Remove enable_(mistral|zaqar) options https://review.openstack.org/422802 | 14:49 |
| *** jcoufal has quit IRC | 14:49 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations: Create the neutron-sanity-check validations https://review.openstack.org/381118 | 14:49 |
| gfidente | shardy both mons and osds have to be batches | 14:49 |
| *** jpena|lunch is now known as jpena | 14:49 | |
| rbrady | trown or larsks: are there more recent docs than hhttps://github.com/openstack/tripleo-quickstart/blob/master/README.rst ? | 14:49 |
| openstackgerrit | Merged openstack/puppet-tripleo: Fix typo in endpoint.pp https://review.openstack.org/423096 | 14:50 |
| larsks | rbrady: I don't think so, but trown would be authoritative. | 14:50 |
| openstackgerrit | Brent Eagles proposed openstack/puppet-tripleo: Call VF configuration from udev rules https://review.openstack.org/423312 | 14:50 |
| yolanda | hi dtantsur , can you give another review to https://review.openstack.org/420765 ? | 14:52 |
| yolanda | i also have https://review.openstack.org/419486, that does changes on the deployment image | 14:52 |
| * dtantsur adds to his queue | 14:53 | |
| *** rbowen has quit IRC | 14:54 | |
| *** melwitt_ is now known as melwitt | 14:55 | |
| yolanda | thx | 14:55 |
| *** karimb has joined #tripleo | 14:56 | |
| trown | rbrady: there are more detailed docs at http://docs.openstack.org/developer/tripleo-quickstart/ | 14:57 |
| trown | rbrady: are you hitting some issue when following the README? | 14:58 |
| openstackgerrit | John Fulton proposed openstack/tripleo-specs: TripleO Performance Profiles https://review.openstack.org/423304 | 14:58 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-docs: Fix usage of deprecated cleaning_network_uuid in ironic docs https://review.openstack.org/423316 | 14:59 |
| rbrady | trown: following the instructions literally to try to install latest upstream doesn't make sense to me | 14:59 |
| rbrady | trown: I reached out to someone more familiar to get some assistance this morning, so I'm not blocked | 15:00 |
| rbrady | trown: I'll read the newer link you pasted and see if that helps | 15:00 |
| trown | rbrady: ok, for doing upstream development https://github.com/openstack/tripleo-quickstart/blob/master/README.rst#enable-developer-mode and http://docs.openstack.org/developer/tripleo-quickstart/devmode.html are what you want | 15:01 |
| openstackgerrit | John Fulton proposed openstack/tripleo-specs: TripleO Performance Profiles https://review.openstack.org/423304 | 15:01 |
| *** xuao has quit IRC | 15:01 | |
| gfidente | EmilienM is it 'check scenarios' to make them run? | 15:02 |
| *** xuao has joined #tripleo | 15:02 | |
| rbrady | trown: I ended up running https://paste.fedoraproject.org/531487/14849245/ | 15:04 |
| *** jcoufal__ has quit IRC | 15:05 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud: Allow enabling node auto-discovery on the undercloud https://review.openstack.org/423265 | 15:05 |
| trown | rbrady: that should get you a fully deployed and validated overcloud using the same repo-setup as upstream gates | 15:05 |
| trown | rbrady: but with no injected changes | 15:06 |
| rbrady | trown: damn. all I wanted was an undercloud with the latest bits | 15:06 |
| trown | rbrady: to stop at undercloud install just remove "--tags all" | 15:06 |
| trown | rbrady: default is to stop after undercloud install runs | 15:06 |
| rbrady | trown: ack | 15:07 |
| *** xuao has quit IRC | 15:07 | |
| *** rbowen has joined #tripleo | 15:10 | |
| openstackgerrit | Martin André proposed openstack/tripleo-common: Add pull-puppet-modules script to binaries https://review.openstack.org/422772 | 15:12 |
| *** jcoufal has joined #tripleo | 15:12 | |
| jrist | jtomasek: hey, on https://review.openstack.org/#/c/420056/ - you mention a workflow that would be the best solution | 15:12 |
| jrist | jtomasek: is this a temporary fix and do we need to track the workflow improvement? | 15:13 |
| *** amoralej|lunch is now known as amoralej | 15:13 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras: Add virtualbmc_port field to scale config https://review.openstack.org/422243 | 15:15 |
| panda | bandini: https://bugzilla.redhat.com/show_bug.cgi?id=1415218 | 15:18 |
| openstack | bugzilla.redhat.com bug 1415218 in openssh "sshd sometimes does not correctly write pid file" [Unspecified,New] - Assigned to jjelen | 15:18 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Add sahara service support for composable upgrades https://review.openstack.org/405247 | 15:19 |
| jtomasek | jrist: it is temporary fix which works fine, but it would be better to trigger validations as part of workflows | 15:20 |
| jrist | workflows I.E. mistral? or a workflow mechanism within the React tool | 15:20 |
| jtomasek | jrist: that has been discussed already we just need tos tart working on it. in mistral yes | 15:20 |
| bandini | panda: awesome, thanks | 15:20 |
| jrist | jtomasek: ok thanks. is there something tracking this somewhere? | 15:21 |
| d0ugal | jrist: I feel like thrash was looking into doing that... | 15:21 |
| jtomasek | jrist: this one is specific with the fact that deployment itself is not wrapped in a workflow. there is just a workflow to start the deployment | 15:21 |
| *** udesale has quit IRC | 15:21 | |
| *** udesale has joined #tripleo | 15:21 | |
| thrash | jrist: there is already a mechanism for calling tripleo-validations from a workflow | 15:22 |
| jrist | k | 15:22 |
| jrist | thrash: o rly | 15:22 |
| jrist | thrash: merged? | 15:22 |
| openstackgerrit | Merged openstack/tripleo-quickstart: Add new feature to consume external images https://review.openstack.org/421763 | 15:22 |
| *** jrist has left #tripleo | 15:22 | |
| *** jrist has joined #tripleo | 15:22 | |
| thrash | jrist: loser | 15:22 |
| jrist | dangit | 15:22 |
| *** ayoung has joined #tripleo | 15:22 | |
| thrash | hehe | 15:22 |
| jrist | lol | 15:22 |
| jrist | stupid ctrl-w | 15:22 |
| *** zoli|brb is now known as zoli|wfh | 15:23 | |
| ayoung | larsks, has anyone publicized the stuff we discussed at the multi-site meeting? Specifically, about the scale out of the overcloud to new sites? | 15:23 |
| jtomasek | thrash: any docs to look at? or is it used in any workflow already? | 15:23 |
| thrash | jrist: the validations workflow is present. The ability to have them called within deploy and introspection workflows is here: https://review.openstack.org/#/c/416284/ | 15:23 |
| thrash | jtomasek: jrist once that review has landed, you would be able to pass 'run_validations: True' to the introspect and deploy workflows and you would get the validations run. | 15:24 |
| *** udesale has quit IRC | 15:24 | |
| *** udesale has joined #tripleo | 15:25 | |
| *** absubram has quit IRC | 15:25 | |
| larsks | ayoung: I'm not sure, I haven't been following. | 15:26 |
| jtomasek | thrash: cool, thanks. We'll be able to remove triggering them from GUI code when it is merged | 15:26 |
| openstackgerrit | John Eckersberg proposed openstack/tripleo-heat-templates: WIP Qpid dispatch router composable role https://review.openstack.org/423326 | 15:27 |
| jtomasek | thrash: does this mean that we'll have whole deployment progress wrapped in workflow? https://review.openstack.org/#/c/407740/ | 15:27 |
| ayoung | larsks, Yeah, I've unenrolled from most OpenStack mailing lists etc since shifting projects, so I wouldn;t know eihter, but it seems important | 15:28 |
| *** jcoufal has quit IRC | 15:28 | |
| openstackgerrit | John Eckersberg proposed openstack/tripleo-heat-templates: WIP Qpid dispatch router composable role https://review.openstack.org/423326 | 15:29 |
| thrash | jtomasek: If I understand your question, yes. | 15:29 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Release notes for 5.8.0 (final Ocata) https://review.openstack.org/421166 | 15:30 |
| *** jcoufal has joined #tripleo | 15:30 | |
| ayoung | shardy, EmilienM not sure if you guys got an update from the multisite meeting. rdo (Rhys, not the distro...he's still mad at you stealing his nick BTW) has a really cool proof of concept for scale out | 15:31 |
| ayoung | shadower, EmilienM dprince the idea is that, when installing the overcloud on second or additional sites, you use the keystone from the original site, and add the new site as a new region | 15:31 |
| ayoung | one overcloud, multiple underclouds | 15:31 |
| *** adarazs is now known as adarazs_brb | 15:31 | |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Adds support to create deployment plan from git repository https://review.openstack.org/417280 | 15:32 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Release notes for 5.8.0 (final Ocata) https://review.openstack.org/421166 | 15:32 |
| panda | bnemec: available for a blind approval on this ? :) https://review.openstack.org/420620 | 15:33 |
| *** bnemec is now known as beekneemech | 15:33 | |
| openstackgerrit | Merged openstack/os-refresh-config: Adjust test suite for new psutil versions https://review.openstack.org/422180 | 15:33 |
| openstackgerrit | Merged openstack/tripleo-ui: Normalize parameters https://review.openstack.org/403422 | 15:34 |
| *** nyechiel has joined #tripleo | 15:34 | |
| panda | evidently not :( | 15:35 |
| beekneemech | panda: I'm looking. I don't blindly approve, even on Friday. :-) | 15:35 |
| *** sanagikoki has joined #tripleo | 15:37 | |
| *** jaosorior has joined #tripleo | 15:39 | |
| jtomasek | thrash: cool, I mean the workflow finishes when deployment finishes? | 15:39 |
| jtomasek | thrash: because up to now it was that deployment workflow finished when deployment successfully started | 15:39 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Only install tempest if it's going to be used https://review.openstack.org/422795 | 15:41 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Disable optional undercloud features in longer jobs https://review.openstack.org/422785 | 15:41 |
| *** nyechiel has quit IRC | 15:42 | |
| shardy | Can I get reviews on https://review.openstack.org/#/q/topic:bug/1651541 please, two patches both passing CI | 15:42 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Add support for testing predictable placement https://review.openstack.org/378014 | 15:43 |
| jaosorior | shardy: sure, reading | 15:44 |
| thrash | jtomasek: that has not been added to the deployment workflow yet. | 15:44 |
| jtomasek | thrash: ok | 15:44 |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras: Send mail tool https://review.openstack.org/423340 | 15:45 |
| *** [1]cdearborn has quit IRC | 15:45 | |
| thrash | jtomasek: it would be trivial to add, and to do so with an option for it. | 15:45 |
| jaosorior | beekneemech: rebased your patches | 15:45 |
| panda | beekneemech: you're right, I hope we can find a better way to deal with that part on the bootstrap design session | 15:45 |
| beekneemech | jaosorior: Much appreciated. | 15:46 |
| gfidente | shardy so it's customizing the name of the networks | 15:46 |
| *** hafe has quit IRC | 15:47 | |
| gfidente | shardy I assume | 15:48 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Add Roles selector https://review.openstack.org/419982 | 15:48 |
| gfidente | {get_param: ExternalNetName}: {get_param: ExternalIpList} | 15:48 |
| gfidente | would not work | 15:48 |
| gfidente | ? | 15:48 |
| *** shardy has quit IRC | 15:48 | |
| gfidente | ah I lost him | 15:49 |
| *** jcoufal has quit IRC | 15:49 | |
| jaosorior | gfidente: trying to understand that as well | 15:49 |
| gfidente | I get the purpose was trying to figure if we could avoid the map_replace | 15:49 |
| *** shardy has joined #tripleo | 15:49 | |
| gfidente | shardy hey, to make sure, things like: | 15:50 |
| gfidente | {get_param: ExternalNetName}: {get_param: ExternalIpList} | 15:50 |
| gfidente | would not work? | 15:50 |
| ansiwen_ | shardy: this should also be fixed by your recent changes, correct? https://bugzilla.redhat.com/show_bug.cgi?id=1412203 | 15:51 |
| openstack | bugzilla.redhat.com bug 1412203 in rhosp-director "Nova misconfigured after upgrade to RHOS-11: ConfigFileValueError: Value for option metadata_workers is not valid" [Unspecified,New] - Assigned to athomas | 15:51 |
| *** jcoufal has joined #tripleo | 15:51 | |
| d0ugal | EmilienM: https://review.openstack.org/#/c/421166/ | 15:53 |
| ansiwen_ | shardy: if you don't mind I would also reassign it to you in that case | 15:53 |
| jaosorior | gfidente: haha crap, had just commented | 15:53 |
| *** crenguta has quit IRC | 15:54 | |
| beagles | gfidente: I think I tried that once, and it didn't work for me then.. but then I might've been doing it wrong. The beauty of not knowing how stuff works is that you are free to try anything :) | 15:55 |
| *** b00tcat` has joined #tripleo | 15:56 | |
| jaosorior | shardy: did you get time to think of an approach for the metadata generation issue I had? | 15:56 |
| *** leanderthal has quit IRC | 15:58 | |
| *** [1]cdearborn has joined #tripleo | 15:58 | |
| jaosorior | shardy: I guess one option would be to move some of the metadata to the upper services (e.g. not in the apache profile, but in the keystone/nova/cinder ones) and then aggregate that, however, that requires some extra yaql mangling | 15:58 |
| *** Vijayendra has quit IRC | 15:59 | |
| shardy | ansiwen_: sure, it's going to be fixed via https://review.openstack.org/#/c/405241/ but that's not finished yet | 15:59 |
| shardy | gfidente: yeah I tried that, doesn't work | 15:59 |
| *** adarazs_brb is now known as adarazs | 16:00 | |
| shardy | jaosorior: sorry not yet, I'll try to take a look after I've debugged ceph upgrades | 16:01 |
| shardy | marios: One problem with your pre-upgrade validations to ensure a service is running is that it means it's impossible to restart a failed upgrade | 16:02 |
| shardy | because a bunch of the services are already stopped | 16:02 |
| shardy | so I don't think we can really do it | 16:02 |
| *** leanderthal has joined #tripleo | 16:02 | |
| *** pcaruana has quit IRC | 16:03 | |
| marios | shardy: yeah mcornea came against this as well, you would have to recover before running again. | 16:05 |
| marios | shardy: perhaps we select a set of 'core' services to check | 16:05 |
| marios | shardy: perhaps that is covered by checking the cluster status though i guess | 16:05 |
| shardy | marios: I think I'd prefer to skip the validation and just try the upgrade tasks again | 16:05 |
| shardy | marios: or at least have a boolean which disables the check | 16:06 |
| shardy | maybe we could do that | 16:06 |
| shardy | but to me it's more intuitive to make the tasks just work from whatever state | 16:06 |
| marios | shardy: yeah we could add that easily too... didn't think it was something you'd consider (i.e. more messy, having to add a flag on top) | 16:07 |
| marios | shardy: so i don't mind either way i can quickly revisit it on monday. i have a run going now with http://paste.openstack.org/raw/595803/ | 16:07 |
| shardy | well I'd rather that mess than trying to manually clean up the mess on the nodes after a partially successful upgrade :) | 16:07 |
| *** tremble has quit IRC | 16:07 | |
| shardy | marios: sure, lets chat again monday | 16:07 |
| gfidente | marios you have examples of looking up hiera within an upgrade script? | 16:07 |
| shardy | I'll just remove it from my local branch for now | 16:08 |
| marios | shardy: nova-api fails because ConfigFileValueError: Value for option metadata_workers is not valid | 16:08 |
| shardy | and leave feedback on the review | 16:08 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates: Containerized MongoDB https://review.openstack.org/423347 | 16:08 |
| shardy | marios: yeah, it's because we're still trying to start it in step6 | 16:08 |
| shardy | that problem goes away when we just let puppet start it as discussed previously | 16:08 |
| shardy | I've got a local patch but forgot to push it due to other distractions | 16:09 |
| marios | shardy: i see... i didn't think i had anything applied (step6) perhaps it was from the first set you pushed that is merged already | 16:09 |
| shardy | yeah the nova patch on gerrit still has step6, sec I'll push a wip update | 16:09 |
| *** adarazs is now known as adarazs_afk | 16:09 | |
| marios | shardy: on the plus, i am glad to see there has been no yum update (for example) on my compute or swift node so far (with the flag | 16:09 |
| shardy | I've been trying to focus on the remaining services other than nova, due to the pending discussion with mwhahaha re how much cells stuff we can expect to be handled by puppet | 16:10 |
| marios | gfidente: hey | 16:11 |
| openstackgerrit | John Eckersberg proposed openstack/tripleo-heat-templates: WIP Qpid dispatch router composable role https://review.openstack.org/423326 | 16:11 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add upgrade support for ceph-mon service https://review.openstack.org/423182 | 16:11 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add support for batched upgrades to composable upgrades https://review.openstack.org/423160 | 16:11 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add upgrade support for ceph OSD service https://review.openstack.org/423350 | 16:11 |
| marios | gfidente: you mean from within an ansible upgrade_task command ? (e.g. using shell or some similar ansible module?) | 16:11 |
| gfidente | marios yeah | 16:11 |
| marios | gfidente: hm i don't think we've had to do that afaik/can quickly remember... but you should be able to hiera -c etc etc | 16:12 |
| mwhahaha | shardy: I'm still not sure at least for the overcloud if puppet can help in the upgrade. we just need to have the upgrade process match what puppet would do | 16:12 |
| shardy | mwhahaha: hey, yeah I wasn't sure, because we decided to do the ansible steps and then run puppet afterwards | 16:13 |
| mwhahaha | shardy: i think in the undercloud, we can leverage puppet with the upgrade fact | 16:13 |
| marios | gfidente: as long as the hiera is defined for that role | 16:13 |
| *** ebarrera has quit IRC | 16:13 | |
| gfidente | marios ack | 16:13 |
| shardy | so if there's logic in puppet we can use it | 16:13 |
| mwhahaha | shardy: so i don't have a problem with that but we just need to make sure we have the process in sync | 16:13 |
| ayoung | shardy, did you see what I wrote before? Were you aware? | 16:13 |
| shardy | mwhahaha: yeah, agreed - I was dumping workarounds in to the ansible tasks hoping some of that would eventually be handled elsewhere | 16:13 |
| shardy | ayoung: yeah I saw some notes, thanks for the reminder, sounds pretty interesting | 16:14 |
| mwhahaha | shardy: yup, i'm going to try to work with owalsh to get something together today so we can at least mirror it in ansible if we have to | 16:14 |
| shardy | mwhahaha: Ok, cool - well I'll stick with the ansible steps for now, and when the puppet cells things land again, we can assess if we should use that instead | 16:14 |
| ayoung | shardy, good. I think it is the way forward. Just want to make sure it was getting handed on to the people that actually need to make it happen. | 16:14 |
| shardy | owalsh and I discussed this yesterday, and there was uncertainty if the puppet modules could differentiate between the initial deploy vs an upgrade | 16:15 |
| owalsh | mwhahaha: just brewing some coffee and looking over that review now | 16:15 |
| shardy | mwhahaha: so I was unsure if we needed to stick with the ansible approach for that reason | 16:15 |
| mwhahaha | for puppet-nova it's not something we would handle | 16:15 |
| mwhahaha | it'd be a tripleo thing | 16:15 |
| *** sdake_ has quit IRC | 16:15 | |
| owalsh | mwhahaha: but we need to ensure they play nice, yea | 16:15 |
| shardy | mwhahaha: Ok, cool - I'm fine with doing those steps in ansible, then running puppet to just configure and start the services | 16:15 |
| mwhahaha | there's some puppet tricks we might be able to leverage | 16:16 |
| openstackgerrit | Frank Zdarsky proposed openstack/os-net-config: Add schema file to enable config data validation https://review.openstack.org/423230 | 16:16 |
| gfidente | shardy if pidof fails here https://review.openstack.org/#/c/423350/1/puppet/services/ceph-mon.yaml | 16:16 |
| shardy | mwhahaha: atm the plan is to use ansible to stop the services, do any migrations, then run puppet to configure things and re-start the services | 16:16 |
| gfidente | are we blocking upgrde? | 16:16 |
| *** sdake has joined #tripleo | 16:16 | |
| shardy | so far it works pretty well AFAICS | 16:16 |
| *** sdake has quit IRC | 16:16 | |
| *** jcoufal_ has joined #tripleo | 16:16 | |
| *** sdake has joined #tripleo | 16:16 | |
| mwhahaha | shardy: yea, the issue i was seeing is that since we're not using simple_cell_setup, we might run into conflicts between the ansible/puppet stuff. but if we use the same commands in ansbile as we would in puppet it should be ok | 16:17 |
| shardy | gfidente: that's what I was just discussing with marios, I think we may want to remove that check as otherwise it's impossible to re-start a failed upgrade | 16:17 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Use TLS proxy for Glance API's internal TLS https://review.openstack.org/408536 | 16:17 |
| shardy | mwhahaha: Ok, sounds good - I'll try to get it working end-to-end with the current approach then we can chat more about it next week | 16:17 |
| *** jcoufal has quit IRC | 16:18 | |
| mwhahaha | shardy: sounds good | 16:18 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Use TLS proxy for Glance API's internal TLS https://review.openstack.org/408536 | 16:18 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Pass parameters for TLS proxy in front of Glance-API https://review.openstack.org/408562 | 16:18 |
| owalsh | shardy: this will make the ansible tasks more complex though as we need to run the individual steps that simple_cell_setup performs | 16:18 |
| gfidente | shardy ack but regardless that check, in general we stop the process if one of the tasks fails right? | 16:18 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Clean TLS proxy-related setup for glance api profile https://review.openstack.org/408565 | 16:18 |
| shardy | owalsh: ack - is that just an observation or do you have a different idea? :) | 16:19 |
| shardy | gfidente: yep | 16:19 |
| mwhahaha | shardy: we're using mapp_cell0 and a create_cell instead of the simple_cell_setup | 16:20 |
| shardy | gfidente: we have the option to tell ansible to ignore failure, but atm any failure will stop the upgrade | 16:20 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates: Configure nova neutron parameter for L to M upgrade https://review.openstack.org/422837 | 16:20 |
| mwhahaha | shardy: we need to match that flow so we don't run into issues because of the way we're creating the cells | 16:20 |
| owalsh | mwhahaha, shardy: we will also need map_cell_and_hosts and map_instances for an upgrade | 16:20 |
| shardy | mwhahaha: Ok, cool - if you or owalsh can add notes to https://review.openstack.org/#/c/405241/ on the exact steps required that would be most helpful | 16:21 |
| owalsh | mwhahaha: I'll review all of this now, add notes for the upgrade steps | 16:21 |
| shardy | or feel free to write a little ansible playbook which does the right steps then I can cut/paste it (or you can push to the review :) | 16:21 |
| shardy | I've been testing this stuff with ansible-playbook directly on the nodes, then copying it into the heat template when it works | 16:22 |
| gfidente | shardy nah I was trying to set a default for a register if the hiera call failed | 16:22 |
| owalsh | shardy: ack, I've done that too :-) | 16:22 |
| *** aufi has quit IRC | 16:23 | |
| gfidente | shardy might have found how | 16:23 |
| gfidente | problem is sad hiera command always has a return value | 16:24 |
| gfidente | like 'nil' | 16:24 |
| gfidente | and always returns 0 | 16:25 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add nova service support for composable upgrades https://review.openstack.org/405241 | 16:25 |
| shardy | owalsh: ^^ that's my latest local version, not fully tested as I've been doing ceph things today | 16:26 |
| shardy | owalsh: feel free to push to that, even if you've only tested the ansible pieces manually | 16:26 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job https://review.openstack.org/419529 | 16:27 |
| owalsh | shardy: ack | 16:28 |
| shardy | gfidente: I think you can do it by putting the hiera output in a register, then using registername.stdout.replace(nil, somedefault) | 16:28 |
| shardy | where the second part is a j2 expression | 16:29 |
| *** jcoufal_ has quit IRC | 16:31 | |
| *** jlinkes has quit IRC | 16:32 | |
| *** sudipto has joined #tripleo | 16:32 | |
| *** sudipto_ has joined #tripleo | 16:32 | |
| gfidente | shardy looks like hiera command has default | 16:34 |
| gfidente | as well | 16:34 |
| *** panda is now known as panda|bbl | 16:34 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add support for not using admin_token in Ceph/RGW https://review.openstack.org/405625 | 16:34 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add upgrade support for CephRGW service https://review.openstack.org/423360 | 16:34 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: OOQ/OVB: Add configurations for tempest job https://review.openstack.org/420620 | 16:35 |
| openstackgerrit | Merged openstack/tripleo-ui: Update app state when parameters get updated https://review.openstack.org/409825 | 16:36 |
| jrist | florianf: still here? can you rebase? https://review.openstack.org/416566 | 16:38 |
| florianf | jrist: yep | 16:38 |
| jrist | thx | 16:38 |
| *** jcoufal has joined #tripleo | 16:38 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Add upgrade support for CephRGW service https://review.openstack.org/423360 | 16:40 |
| *** paramite has joined #tripleo | 16:43 | |
| *** yamahata has joined #tripleo | 16:45 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui: Add i18n strings to roles components https://review.openstack.org/416566 | 16:48 |
| *** jaosorior has quit IRC | 16:48 | |
| *** hewbrocca is now known as hewbrocca_afk | 16:49 | |
| *** jaosorior has joined #tripleo | 16:49 | |
| *** paramite has quit IRC | 16:50 | |
| florianf | jrist: ^ | 16:50 |
| *** jaosorior has quit IRC | 16:51 | |
| *** cylopez has quit IRC | 16:55 | |
| *** padkrish has joined #tripleo | 16:55 | |
| *** flepied has quit IRC | 16:58 | |
| jrist | florianf++ | 16:58 |
| jrist | florianf: +1'd | 16:59 |
| *** derekh has quit IRC | 17:00 | |
| *** jcoufal_ has joined #tripleo | 17:00 | |
| *** padkrish_ has joined #tripleo | 17:01 | |
| *** fzdarsky is now known as fzdarsky|afk | 17:02 | |
| *** udesale has quit IRC | 17:02 | |
| *** jcoufal__ has joined #tripleo | 17:02 | |
| *** jcoufal has quit IRC | 17:02 | |
| *** padkrish has quit IRC | 17:03 | |
| *** mhenkel has quit IRC | 17:04 | |
| *** jcoufal has joined #tripleo | 17:04 | |
| *** leanderthal has quit IRC | 17:04 | |
| florianf | jrist: thx | 17:05 |
| *** jcoufal_ has quit IRC | 17:05 | |
| *** jcoufal__ has quit IRC | 17:07 | |
| *** dtantsur is now known as dtantsur|afk | 17:08 | |
| *** bana_k has joined #tripleo | 17:09 | |
| *** mcornea has quit IRC | 17:10 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Make ServiceNetMap support custom network names https://review.openstack.org/413625 | 17:13 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Add Swift to the major upgrade CI https://review.openstack.org/420100 | 17:13 |
| *** flepied has joined #tripleo | 17:15 | |
| *** rasca has quit IRC | 17:20 | |
| *** dprince has quit IRC | 17:23 | |
| *** lucasagomes is now known as lucas-afk | 17:23 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Add sahara support to major upgrade CI https://review.openstack.org/422776 | 17:25 |
| openstackgerrit | Merged openstack/tripleo-ui: Add i18n string to environment config components https://review.openstack.org/421233 | 17:25 |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Add ceph support to major upgrade job https://review.openstack.org/423383 | 17:26 |
| *** rbowen has quit IRC | 17:26 | |
| *** rbowen has joined #tripleo | 17:28 | |
| *** padkrish_ has quit IRC | 17:28 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add upgrade support for ceph-mon service https://review.openstack.org/423182 | 17:29 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add upgrade support for ceph OSD service https://review.openstack.org/423350 | 17:29 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add snmp service support for composable upgrades https://review.openstack.org/405250 | 17:29 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add ironic service support for composable upgrades https://review.openstack.org/405248 | 17:29 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add telemetry service support for composable upgrades https://review.openstack.org/405249 | 17:29 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add support for batched upgrades to composable upgrades https://review.openstack.org/423160 | 17:29 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Skip upgrade steps where no tasks are defined https://review.openstack.org/423384 | 17:29 |
| *** jcoufal has quit IRC | 17:30 | |
| *** padkrish has joined #tripleo | 17:30 | |
| jrist | florianf: dangit ! https://review.openstack.org/#/c/418798/ | 17:30 |
| *** jcoufal has joined #tripleo | 17:31 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras: updates to the static template for job doc. https://review.openstack.org/423385 | 17:32 |
| *** jaosorior has joined #tripleo | 17:32 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Deploy Manila with CephMDS in scenario004 https://review.openstack.org/423386 | 17:35 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Clean TLS proxy-related setup for glance api profile https://review.openstack.org/408565 | 17:36 |
| *** jpich has quit IRC | 17:36 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: DO NOT MERGE - testing TLS everywhere job https://review.openstack.org/419529 | 17:38 |
| *** bana_k has quit IRC | 17:39 | |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Don't disable heat APIs for upgrade job https://review.openstack.org/423302 | 17:41 |
| *** padkrish has quit IRC | 17:44 | |
| openstackgerrit | Martin André proposed openstack-infra/tripleo-ci: Allow to use an RDO review to fix a packaging issue https://review.openstack.org/388791 | 17:44 |
| *** athomas has quit IRC | 17:45 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras: virtualbmc setup is not working in devmode.sh https://review.openstack.org/421571 | 17:49 |
| *** jcoufal has quit IRC | 17:49 | |
| owalsh | shardy: for the nova-api upgrade, is the db creation ansible task an issue? | 17:51 |
| *** jcoufal has joined #tripleo | 17:57 | |
| *** karimb has quit IRC | 17:58 | |
| *** adarazs_afk is now known as adarazs | 17:59 | |
| *** dprince has joined #tripleo | 18:01 | |
| *** padkrish has joined #tripleo | 18:02 | |
| *** suuuper has quit IRC | 18:07 | |
| *** flepied1 has joined #tripleo | 18:10 | |
| *** flepied has quit IRC | 18:14 | |
| *** jcoufal_ has joined #tripleo | 18:17 | |
| *** eggmaster has joined #tripleo | 18:17 | |
| *** jcoufal has quit IRC | 18:19 | |
| *** jpena is now known as jpena|off | 18:19 | |
| *** jcoufal has joined #tripleo | 18:20 | |
| *** zoli|wfh is now known as zoli|gone | 18:21 | |
| *** jcoufal_ has quit IRC | 18:22 | |
| jaosorior | trown: can you check these two out https://review.openstack.org/#/c/422785/ https://review.openstack.org/#/c/422795/ ? | 18:22 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Set manila default_share_type config option https://review.openstack.org/416960 | 18:24 |
| openstackgerrit | Tom Barron proposed openstack/tripleo-heat-templates: Set manila default_share_type config option https://review.openstack.org/423405 | 18:25 |
| beekneemech | Would someone do the honors on https://review.openstack.org/#/c/422785 and https://review.openstack.org/#/c/422795 ? | 18:25 |
| beekneemech | It will make your ci jobs run faster. :-) | 18:25 |
| *** ccamacho has quit IRC | 18:26 | |
| *** bana_k has joined #tripleo | 18:26 | |
| trown | jaosorior: sure I will check them out after lunch | 18:29 |
| *** pkovar has quit IRC | 18:30 | |
| *** leanderthal has joined #tripleo | 18:31 | |
| *** padkrish has quit IRC | 18:31 | |
| *** ebarrera has joined #tripleo | 18:33 | |
| *** jaosorior has quit IRC | 18:35 | |
| beagles | beekneemech: do you recall whether there was a specific reason we recommended stopping the openvswitch service on undercloud upgrades? | 18:35 |
| *** trown is now known as trown|lunch | 18:35 | |
| beekneemech | beagles: It probably had to do with the ovs 2.4 to 2.5 upgrade, but I don't remember exactly. | 18:36 |
| *** padkrish has joined #tripleo | 18:36 | |
| beagles | beekneemech: ack, thanks | 18:36 |
| *** pblaho1 has quit IRC | 18:36 | |
| *** florianf has quit IRC | 18:39 | |
| *** jefrite has quit IRC | 18:40 | |
| *** ebarrera has quit IRC | 18:40 | |
| *** sudipto has quit IRC | 18:41 | |
| *** sudipto_ has quit IRC | 18:41 | |
| *** owalsh is now known as owalsh-brb | 18:42 | |
| beagles | beekneemech:the enable_"x" flags aren't case sensitive are they? | 18:43 |
| beagles | beekneemech: in the aforementioned patches that is | 18:43 |
| *** tosky has quit IRC | 18:43 | |
| *** jcoufal_ has joined #tripleo | 18:43 | |
| beekneemech | beagles: The values aren't. oslo.config will handle the variations on boolean types. | 18:43 |
| beagles | beekneemech: cool | 18:44 |
| beekneemech | I think it recognizes things like 0 and 1 too. | 18:44 |
| beagles | beekneemech: in other words - it isn't silly | 18:44 |
| beekneemech | beagles: Indeed | 18:44 |
| *** yprokule has quit IRC | 18:45 | |
| *** ccamacho has joined #tripleo | 18:45 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: cinder: move glance params into base https://review.openstack.org/422916 | 18:45 |
| *** jcoufal has quit IRC | 18:46 | |
| *** owalsh-brb has quit IRC | 18:48 | |
| *** owalsh-brb has joined #tripleo | 18:49 | |
| *** jefrite has joined #tripleo | 18:50 | |
| *** rhallisey has quit IRC | 18:50 | |
| *** padkrish has quit IRC | 18:54 | |
| *** padkrish has joined #tripleo | 18:54 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: docker: new hybrid deployment architecture and configuration https://review.openstack.org/416421 | 18:56 |
| *** jprovazn has quit IRC | 19:02 | |
| *** gfidente has quit IRC | 19:03 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Add docker keystone service https://review.openstack.org/416605 | 19:04 |
| *** jcoufal_ has quit IRC | 19:04 | |
| *** jcoufal has joined #tripleo | 19:07 | |
| *** rhallisey has joined #tripleo | 19:07 | |
| *** crenguta has joined #tripleo | 19:07 | |
| openstackgerrit | Martin André proposed openstack-infra/tripleo-ci: Allow to use an RDO review to fix a packaging issue https://review.openstack.org/388791 | 19:13 |
| *** dsneddon_afk is now known as dsneddon | 19:21 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Fix logging issues for quickstart jobs https://review.openstack.org/422638 | 19:27 |
| *** jcoufal_ has joined #tripleo | 19:31 | |
| *** paramite has joined #tripleo | 19:31 | |
| *** tesseract has quit IRC | 19:32 | |
| *** jcoufal has quit IRC | 19:32 | |
| openstackgerrit | Merged openstack/puppet-tripleo: cinder: move glance params into common https://review.openstack.org/422915 | 19:33 |
| *** padkrish has quit IRC | 19:36 | |
| *** trown|lunch is now known as trown | 19:36 | |
| *** iranzo has quit IRC | 19:40 | |
| openstackgerrit | Dan Prince proposed openstack/puppet-tripleo: Add noop resources for custom types https://review.openstack.org/209030 | 19:41 |
| *** padkrish has joined #tripleo | 19:42 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates: Add nova service support for composable upgrades https://review.openstack.org/405241 | 19:42 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/os-refresh-config: Updated from global requirements https://review.openstack.org/420924 | 19:45 |
| *** yamahata has quit IRC | 19:45 | |
| *** owalsh-brb is now known as owalsh | 19:47 | |
| *** sdake has quit IRC | 19:47 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: explicitly call out running quickstart.sh as root is not supported https://review.openstack.org/423503 | 19:48 |
| *** jcoufal_ has quit IRC | 19:49 | |
| *** ramishra has quit IRC | 19:51 | |
| *** jaosorior has joined #tripleo | 19:52 | |
| openstackgerrit | Martin André proposed openstack-infra/tripleo-ci: Allow to use an RDO review to fix a packaging issue https://review.openstack.org/388791 | 19:53 |
| *** jcoufal has joined #tripleo | 19:54 | |
| *** dsneddon is now known as dsneddon_afk | 19:54 | |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates: Add nova service support for composable upgrades https://review.openstack.org/405241 | 19:58 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Disable optional undercloud features in longer jobs https://review.openstack.org/422785 | 20:02 |
| jaosorior | beekneemech: :D ^^ | 20:02 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Only install tempest if it's going to be used https://review.openstack.org/422795 | 20:03 |
| beekneemech | \o/ faster ci jobs | 20:03 |
| beekneemech | Now if we can just avoid regressing performance again we'll be in good shape. | 20:04 |
| * beekneemech can dream | 20:04 | |
| jaosorior | lol | 20:04 |
| jaosorior | beekneemech: if I need to update package from the images, that is not provided by RDO (and is not gonna happen any time soon in CentOS) how could I do it? | 20:05 |
| jaosorior | in CI | 20:05 |
| jaosorior | beekneemech: basically I need to use a newer version of cloud-init (where a bug has been fixed) | 20:05 |
| larsks | jaosorior: we have 0.7.9 packages coming out Real Soon Now. | 20:06 |
| jaosorior | larsks: when? :D! | 20:06 |
| larsks | jaosorior: erratum is already open. Waiting for a customer to confirm a bugfix, and then I hope we can move it forward...so, less than weeks? | 20:08 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Test with scheduler hints https://review.openstack.org/378040 | 20:08 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Add feature testing matrix to readme https://review.openstack.org/399269 | 20:08 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Add support for testing predictable placement https://review.openstack.org/378014 | 20:09 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Test hostname map https://review.openstack.org/378017 | 20:09 |
| *** panda|bbl is now known as panda | 20:11 | |
| *** jefrite has quit IRC | 20:12 | |
| *** owalsh is now known as owalsh-afk | 20:12 | |
| *** crenguta has quit IRC | 20:13 | |
| openstackgerrit | Rajini Ram proposed openstack/tripleo-heat-templates: Enables support for configuring Cinder with a ScaleIO storage backend. https://review.openstack.org/422238 | 20:14 |
| *** crenguta has joined #tripleo | 20:15 | |
| *** jefrite has joined #tripleo | 20:18 | |
| *** yamahata has joined #tripleo | 20:24 | |
| *** jefrite has quit IRC | 20:25 | |
| *** amoralej is now known as amoralej|off | 20:27 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/instack-undercloud: Configure listen address/port for novajoin https://review.openstack.org/423510 | 20:31 |
| *** morazi has quit IRC | 20:31 | |
| openstackgerrit | Michele Baldessari proposed openstack/instack-undercloud: WIP Test a hacky workaround for openssh regression https://review.openstack.org/423513 | 20:32 |
| *** jefrite has joined #tripleo | 20:33 | |
| *** jeckersb is now known as jeckersb_gone | 20:37 | |
| *** jcoufal_ has joined #tripleo | 20:39 | |
| *** padkrish has quit IRC | 20:40 | |
| *** jcoufal has quit IRC | 20:42 | |
| *** jcoufal has joined #tripleo | 20:43 | |
| *** padkrish has joined #tripleo | 20:44 | |
| *** jcoufal__ has joined #tripleo | 20:45 | |
| *** jcoufal_ has quit IRC | 20:46 | |
| bandini | beekneemech: https://review.openstack.org/#/c/417164/ seems to consistently time out the deployment at ControllerDeployment_Step1 and for the life of me I cannot figure out why. I am moderately sure the change itself has nothing to do with, but the failure consistency boggles my mind. if you have a couple of mins to throw some clues that'd be grand ;) | 20:46 |
| openstackgerrit | Ben Nemec proposed openstack/diskimage-builder: Nothing to see here https://review.openstack.org/423516 | 20:47 |
| bandini | I see that the controller0 node has a "puppet apply" process in host_info.txt, but then it all seems to stop | 20:47 |
| *** jcoufal has quit IRC | 20:48 | |
| openstackgerrit | Ana Krivokapic proposed openstack/tripleo-common: Fix class constructors https://review.openstack.org/422680 | 20:49 |
| *** crenguta has quit IRC | 20:51 | |
| beekneemech | bandini: All of our jobs just stopped running so I'm not sure I'll get to it today. :-/ | 20:52 |
| bandini | beekneemech: ah no worries, I'll keep poking at it ;) | 20:52 |
| *** crenguta has joined #tripleo | 20:53 | |
| mwhahaha | what's up with the RETRY_LIMIT | 20:54 |
| beekneemech | mwhahaha: Dunno. Everything I've discovered so far is at https://bugs.launchpad.net/tripleo/+bug/1658195 | 20:57 |
| openstack | Launchpad bug 1658195 in tripleo "All tripleo-ci jobs failing with RETRY_LIMIT" [Critical,Triaged] | 20:57 |
| jaosorior | /exit | 20:57 |
| *** jaosorior has quit IRC | 20:57 | |
| beekneemech | jaosorior's got the right idea | 20:57 |
| * mwhahaha wants to follow jaosorior's lead :D | 20:57 | |
| mwhahaha | EJECT! | 20:57 |
| bandini | lol | 20:58 |
| *** crenguta has quit IRC | 21:03 | |
| *** padkrish has quit IRC | 21:05 | |
| *** crenguta has joined #tripleo | 21:05 | |
| beekneemech | Dammit, nodepool cleaned my floating ip before I could get it reassociated. | 21:07 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates: WIP DO NOT REVIEW quick debugging test https://review.openstack.org/423520 | 21:07 |
| beekneemech | bandini: Good luck with that ^ | 21:11 |
| *** ooolpbot has joined #tripleo | 21:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1658195 | 21:11 |
| *** ooolpbot has quit IRC | 21:11 | |
| openstack | Launchpad bug 1658195 in tripleo "All tripleo-ci jobs failing with RETRY_LIMIT" [Critical,Triaged] | 21:11 |
| bandini | beekneemech: ehehe yeah just wanted to put it out there, so I don't forget. I have 0 expectations ;) | 21:11 |
| bandini | beekneemech: is there anything I can do to help with this ci issue? | 21:12 |
| *** jayg is now known as jayg|g0n3 | 21:12 | |
| *** crenguta has quit IRC | 21:13 | |
| *** crenguta has joined #tripleo | 21:14 | |
| *** jcoufal has joined #tripleo | 21:18 | |
| *** padkrish has joined #tripleo | 21:18 | |
| *** jcoufal__ has quit IRC | 21:19 | |
| beekneemech | bandini: Not at this point. I'm still trying to figure out what's even going wrong. | 21:23 |
| bandini | ack | 21:23 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Nothing to see here https://review.openstack.org/423524 | 21:24 |
| *** karimb has joined #tripleo | 21:26 | |
| *** karimb has quit IRC | 21:26 | |
| *** leanderthal has quit IRC | 21:26 | |
| *** jcoufal has quit IRC | 21:32 | |
| *** ansmith has quit IRC | 21:32 | |
| *** jcoufal has joined #tripleo | 21:34 | |
| openstackgerrit | Gonéri Le Bouder proposed openstack/tripleo-heat-templates: ceph-rgw: add missing user parameter https://review.openstack.org/423526 | 21:36 |
| *** jerrygb_ has quit IRC | 21:41 | |
| *** rajinir has joined #tripleo | 21:42 | |
| *** crenguta has quit IRC | 21:45 | |
| *** salmankhan has joined #tripleo | 21:48 | |
| *** rlandy has quit IRC | 21:49 | |
| *** salmankhan has quit IRC | 21:50 | |
| *** salmankhan has joined #tripleo | 21:50 | |
| *** jcoufal has quit IRC | 21:51 | |
| *** sdake has joined #tripleo | 22:03 | |
| *** suuuper has joined #tripleo | 22:04 | |
| *** rbowen has quit IRC | 22:05 | |
| *** lblanchard has quit IRC | 22:05 | |
| *** idlemind has quit IRC | 22:09 | |
| *** suuuper has quit IRC | 22:10 | |
| *** ooolpbot has joined #tripleo | 22:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1658195 | 22:11 |
| *** ooolpbot has quit IRC | 22:11 | |
| openstack | Launchpad bug 1658195 in tripleo "All tripleo-ci jobs failing with RETRY_LIMIT" [Critical,Triaged] | 22:11 |
| *** paramite has quit IRC | 22:12 | |
| *** ccamacho has quit IRC | 22:13 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Nothing to see here https://review.openstack.org/423524 | 22:14 |
| *** b00tcat` has quit IRC | 22:15 | |
| *** trown is now known as trown|outtypewww | 22:17 | |
| *** dougbtv_ has quit IRC | 22:20 | |
| panda | beekneemech: when did zuul start to act like this ? | 22:22 |
| *** shardy has quit IRC | 22:22 | |
| beekneemech | panda: An hour or two ago. | 22:25 |
| openstackgerrit | Alexander Chuzhoy proposed openstack/tripleo-docs: Reconfigure ironic in already delpoyed overcloud to erase only the metadata, instead of the entire disk. https://review.openstack.org/422033 | 22:25 |
| *** fultonj has quit IRC | 22:26 | |
| *** bfournie has quit IRC | 22:26 | |
| panda | beekneemech: is it just tripleo-ci ? | 22:26 |
| beekneemech | panda: Only tripleo-ci jobs, but it's both the check and check-tripleo jobs. | 22:27 |
| beekneemech | So it isn't specific to our cloud. | 22:27 |
| *** chem has quit IRC | 22:27 | |
| panda | this is too much a coincidence not to be related to https://review.openstack.org/420647 | 22:31 |
| beekneemech | panda: We can try a revert. | 22:33 |
| openstackgerrit | Alexander Chuzhoy proposed openstack/tripleo-docs: Document how to reconfigure overcloud Ironic cleaning https://review.openstack.org/422033 | 22:40 |
| *** jerrygb has joined #tripleo | 22:40 | |
| *** dprince has quit IRC | 22:52 | |
| *** jeckersb_gone is now known as jeckersb | 22:55 | |
| *** akrivoka has quit IRC | 22:57 | |
| openstackgerrit | Alexander Chuzhoy proposed openstack/tripleo-docs: Document how to reconfigure overcloud Ironic cleaning https://review.openstack.org/422033 | 23:00 |
| EmilienM | hi | 23:04 |
| EmilienM | what's up folks | 23:04 |
| EmilienM | slagle: just a heads up on https://review.openstack.org/#/c/423245/ it seems like 3node is working again! thx for the review | 23:08 |
| openstackgerrit | Jason E. Rist proposed openstack/tripleo-ui: Environment parameters https://review.openstack.org/418798 | 23:09 |
| *** ooolpbot has joined #tripleo | 23:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1658195 | 23:11 |
| *** ooolpbot has quit IRC | 23:11 | |
| openstack | Launchpad bug 1658195 in tripleo "All tripleo-ci jobs failing with RETRY_LIMIT" [Critical,Triaged] | 23:11 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: cinder-api: cleanup TODO https://review.openstack.org/423549 | 23:12 |
| *** bana_k has quit IRC | 23:18 | |
| *** padkrish has quit IRC | 23:21 | |
| *** padkrish has joined #tripleo | 23:21 | |
| *** bana_k has joined #tripleo | 23:21 | |
| *** thrash is now known as thrash|g0ne | 23:21 | |
| dmsimard | http://git.openstack.org/cgit/openstack/puppet-tripleo/tree/manifests/profile/base/ceph/osd.pp#n36 | 23:24 |
| dmsimard | https://stopdisablingselinux.com/ | 23:24 |
| *** [1]cdearborn has quit IRC | 23:25 | |
| panda | EmilienM: beekneemech since you'r both here https://bugs.launchpad.net/tripleo/+bug/1657173, what is the best way to patch this on the fly ? change on tripleo::profile class ? | 23:37 |
| openstack | Launchpad bug 1657173 in tripleo "sshd failing to start on undercloud" [High,Triaged] - Assigned to Gabriele Cerami (gcerami) | 23:37 |
| EmilienM | panda: I thought I fixed it | 23:38 |
| EmilienM | with https://github.com/openstack/instack-undercloud/commit/2c93df4db920978769ecd412481f1a6c30d31922 | 23:38 |
| EmilienM | we stil hit it? | 23:38 |
| *** rbrady has quit IRC | 23:39 | |
| beekneemech | EmilienM: According to https://bugs.launchpad.net/tripleo/+bug/1657173 this is a legitimate bug in the interaction between sshd and systemd. | 23:41 |
| openstack | Launchpad bug 1657173 in tripleo "sshd failing to start on undercloud" [High,Triaged] - Assigned to Gabriele Cerami (gcerami) | 23:41 |
| beekneemech | There's a proposed workaround patch as well. | 23:41 |
| beekneemech | Because for some reason it doesn't sound like it will get fixed soon. | 23:41 |
| panda | EmilienM: twice today .. but it's friday. It's a problem with sshd interaction with systemd, changing witch puppet manifest is handling it is not changing this issue | 23:42 |
| EmilienM | beekneemech: where is workaround? | 23:42 |
| EmilienM | https://review.openstack.org/#/c/423513/ | 23:42 |
| EmilienM | oh no | 23:42 |
| beekneemech | Yeah, that one | 23:42 |
| EmilienM | that's terrible | 23:42 |
| beekneemech | So is the bug | 23:43 |
| EmilienM | yeah | 23:43 |
| beekneemech | It's gross that we can't start sshd without racing. | 23:43 |
| panda | oh, bandini already proposed on | 23:43 |
| panda | frigging bug thief :) | 23:44 |
| EmilienM | I need to leave now, enjoy the weekend folks | 23:44 |
| *** sanagikoki has quit IRC | 23:45 | |
| panda | beekneemech: so we're good ? | 23:47 |
| panda | beekneemech: jobs are working again ? | 23:47 |
| beekneemech | panda: I see 19 running jobs in the queue, so it looks like it. | 23:48 |
| panda | beekneemech: oh thank god, I'm ten years older now. | 23:48 |
| panda | I'll faint on my bed | 23:48 |
| beekneemech | panda: It is definitely not worth stressing _that_ much over. :-) | 23:49 |
| beekneemech | panda: Have a good weekend | 23:49 |
| panda | beekneemech: thanks, you too! | 23:49 |
| *** panda is now known as panda|Zz | 23:49 | |
| EmilienM | panda, beekneemech: thanks for your help guys, enjoy the WE! | 23:51 |
| beekneemech | EmilienM: You too. Now get out of here. :-P | 23:51 |
| EmilienM | ok | 23:51 |
| * beekneemech will too | 23:51 | |
| *** rbrady has joined #tripleo | 23:52 | |
| openstackgerrit | Alan Pevec proposed openstack-infra/tripleo-ci: [NO MERGE] Meant to see if the ceph-selinux moduled is loaded https://review.openstack.org/422226 | 23:54 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!