| *** gokhan_ has joined #openstack-ansible | 00:10 | |
| *** mancdaz has quit IRC | 00:12 | |
| *** robcresswell has quit IRC | 00:12 | |
| *** mancdaz has joined #openstack-ansible | 00:14 | |
| *** chyka_ has joined #openstack-ansible | 00:14 | |
| *** chyka has quit IRC | 00:18 | |
| *** chyka_ has quit IRC | 00:40 | |
| *** armaan has quit IRC | 00:49 | |
| *** armaan has joined #openstack-ansible | 00:50 | |
| *** jafeha_ has joined #openstack-ansible | 00:52 | |
| *** jafeha has quit IRC | 00:56 | |
| *** woodard has joined #openstack-ansible | 00:57 | |
| *** lbragstad has quit IRC | 00:57 | |
| *** openstacking_123 has joined #openstack-ansible | 01:00 | |
| *** openstacking_123 has quit IRC | 01:02 | |
| *** cjloader has quit IRC | 01:26 | |
| *** chyka has joined #openstack-ansible | 01:48 | |
| *** chyka has quit IRC | 02:06 | |
| *** yolanda has joined #openstack-ansible | 02:09 | |
| *** robcresswell has joined #openstack-ansible | 02:09 | |
| *** lbragstad has joined #openstack-ansible | 02:14 | |
| *** germs has joined #openstack-ansible | 02:41 | |
| *** germs1 has joined #openstack-ansible | 02:51 | |
| *** germs has quit IRC | 02:52 | |
| *** germs has joined #openstack-ansible | 02:57 | |
| *** germs1 has quit IRC | 02:58 | |
| *** ivveh has quit IRC | 03:07 | |
| *** ivveh has joined #openstack-ansible | 03:08 | |
| *** smatzek has joined #openstack-ansible | 03:11 | |
| *** dave-mcc_ has quit IRC | 03:16 | |
| *** germs has quit IRC | 03:20 | |
| *** germs has joined #openstack-ansible | 03:22 | |
| *** mgariepy has quit IRC | 03:24 | |
| *** germs has quit IRC | 03:26 | |
| *** mgariepy has joined #openstack-ansible | 03:27 | |
| *** rstarmer has joined #openstack-ansible | 03:30 | |
| *** smatzek has quit IRC | 03:34 | |
| *** ykarel|afk has joined #openstack-ansible | 04:19 | |
| *** yolanda has quit IRC | 04:32 | |
| *** cjloader has joined #openstack-ansible | 04:34 | |
| *** cjloader has quit IRC | 04:36 | |
| *** cjloader has joined #openstack-ansible | 04:36 | |
| *** rstarmer has quit IRC | 04:37 | |
| *** bhujay has joined #openstack-ansible | 04:41 | |
| *** ivve has joined #openstack-ansible | 04:51 | |
| *** cjloader has quit IRC | 04:53 | |
| *** cjloader_ has joined #openstack-ansible | 04:55 | |
| *** cjloader_ has quit IRC | 04:56 | |
| *** poopcat1 has quit IRC | 05:03 | |
| *** cjloader has joined #openstack-ansible | 05:11 | |
| *** cxc99 has quit IRC | 05:14 | |
| *** cxc99 has joined #openstack-ansible | 05:17 | |
| *** cjloader has quit IRC | 05:20 | |
| *** cjloader has joined #openstack-ansible | 05:21 | |
| *** pcaruana has joined #openstack-ansible | 05:24 | |
| *** hybridpollo has quit IRC | 05:30 | |
| *** smatzek has joined #openstack-ansible | 05:35 | |
| *** pcaruana has quit IRC | 05:36 | |
| *** smatzek has quit IRC | 05:39 | |
| *** andries has quit IRC | 06:00 | |
| *** andries has joined #openstack-ansible | 06:01 | |
| Taseer | odyssey4me: your suggestion for Sphinx requirement resulted in this => http://logs.openstack.org/91/522491/42/check/requirements-check/8edadcd/job-output.txt.gz#_2018-01-22_11_54_13_990590 | 06:06 |
|---|---|---|
| *** ykarel|afk is now known as ykarel | 06:27 | |
| *** cjloader has quit IRC | 06:34 | |
| *** arbrandes1 has joined #openstack-ansible | 07:01 | |
| *** arbrandes has quit IRC | 07:04 | |
| *** ThomasS has joined #openstack-ansible | 07:32 | |
| *** pcaruana has joined #openstack-ansible | 07:33 | |
| *** armaan has quit IRC | 07:51 | |
| *** armaan has joined #openstack-ansible | 07:51 | |
| *** jafeha_ has quit IRC | 07:54 | |
| *** mbuil has joined #openstack-ansible | 07:56 | |
| *** pcaruana has quit IRC | 07:58 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_nova master: Reinitialize the virtualenv https://review.openstack.org/535844 | 08:08 |
| *** pcaruana has joined #openstack-ansible | 08:13 | |
| odyssey4me | Taseer looks like, according to the same line, you've specified a package called 'sphin' instead of 'sphinx' | 08:19 |
| *** sxc731 has joined #openstack-ansible | 08:35 | |
| jafeha__ | good morning everyone | 08:37 |
| *** gillesMo has joined #openstack-ansible | 08:40 | |
| *** gillesMo has quit IRC | 08:41 | |
| *** jafeha__ is now known as jafeha | 08:44 | |
| evrardjp | good morning jafeha | 08:44 |
| evrardjp | good morning odyssey4me too | 08:44 |
| *** gillesMo has joined #openstack-ansible | 08:45 | |
| evrardjp | and others if any :) | 08:47 |
| *** sxc731 has quit IRC | 08:47 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: Build everything on metal https://review.openstack.org/504224 | 08:47 |
| openstackgerrit | Taseer Ahmed proposed openstack/openstack-ansible-os_congress master: Introduce os_congress role in gerrit https://review.openstack.org/522491 | 08:48 |
| *** jbadiapa has joined #openstack-ansible | 08:53 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_ironic master: Updated from OpenStack Ansible Tests https://review.openstack.org/536428 | 08:56 |
| *** shardy has joined #openstack-ansible | 08:56 | |
| openstackgerrit | Merged openstack/openstack-ansible-haproxy_server master: Updated from OpenStack Ansible Tests https://review.openstack.org/536412 | 08:57 |
| openstackgerrit | Merged openstack/openstack-ansible-rabbitmq_server master: Updated from OpenStack Ansible Tests https://review.openstack.org/536446 | 08:59 |
| openstackgerrit | Merged openstack/openstack-ansible-rsyslog_client master: Updated from OpenStack Ansible Tests https://review.openstack.org/536449 | 08:59 |
| openstackgerrit | Merged openstack/openstack-ansible-pip_install master: Updated from OpenStack Ansible Tests https://review.openstack.org/536444 | 08:59 |
| openstackgerrit | sun cheng proposed openstack/openstack-ansible-os_sahara master: Update url links in files of openstack-ansible-os_sahara https://review.openstack.org/536719 | 09:00 |
| openstackgerrit | Merged openstack/openstack-ansible-os_nova master: Updated from OpenStack Ansible Tests https://review.openstack.org/536433 | 09:01 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_client master: Updated from OpenStack Ansible Tests https://review.openstack.org/536410 | 09:01 |
| openstackgerrit | Merged openstack/openstack-ansible-plugins master: Updated from OpenStack Ansible Tests https://review.openstack.org/536445 | 09:02 |
| openstackgerrit | Merged openstack/openstack-ansible-os_sahara master: Updated from OpenStack Ansible Tests https://review.openstack.org/536436 | 09:04 |
| openstackgerrit | Merged openstack/ansible-hardening master: Updated from OpenStack Ansible Tests https://review.openstack.org/536451 | 09:10 |
| openstackgerrit | Merged openstack/openstack-ansible-repo_build master: Updated from OpenStack Ansible Tests https://review.openstack.org/536447 | 09:10 |
| openstackgerrit | Merged openstack/openstack-ansible-os_glance master: Updated from OpenStack Ansible Tests https://review.openstack.org/536424 | 09:11 |
| *** ivveh_ has joined #openstack-ansible | 09:24 | |
| *** rpittau has joined #openstack-ansible | 09:25 | |
| *** ivveh has quit IRC | 09:25 | |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server master: Updated from OpenStack Ansible Tests https://review.openstack.org/536411 | 09:27 |
| *** ivveh has joined #openstack-ansible | 09:43 | |
| *** ivveh_ has quit IRC | 09:43 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: Cleanup the gate-check-commit dstat part https://review.openstack.org/536738 | 09:45 |
| evrardjp | odyssey4me: did your thing ^ | 09:48 |
| *** markvoelker has quit IRC | 09:59 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/ocata: Update all SHAs for 15.1.15 https://review.openstack.org/535876 | 10:00 |
| *** taseer1 has joined #openstack-ansible | 10:08 | |
| *** taseer2 has joined #openstack-ansible | 10:09 | |
| *** Taseer has quit IRC | 10:09 | |
| *** taseer1 has quit IRC | 10:13 | |
| *** chas has joined #openstack-ansible | 10:18 | |
| evrardjp | odyssey4me: are you there? | 10:22 |
| odyssey4me | yes | 10:22 |
| evrardjp | great I'd like to discuss an approach | 10:23 |
| evrardjp | so this is the issue: http://logs.openstack.org/periodic/git.openstack.org/openstack/openstack-ansible/master/openstack-ansible-upgrade-aio-ubuntu-xenial/0f7042d/job-output.txt.gz#_2018-01-23_08_28_34_364556 | 10:23 |
| evrardjp | it probably appeared after your patch here: https://review.openstack.org/#/c/521750/2 | 10:24 |
| evrardjp | which has a dependency chain and moving parts. | 10:24 |
| evrardjp | the problem, as you can see in the link url, is happening during upgrades from P to Q. | 10:24 |
| evrardjp | because P has: https://github.com/openstack/openstack-ansible-repo_server/blob/stable/pike/tasks/repo_post_install.yml#L105-L122 | 10:25 |
| evrardjp | (and others) | 10:25 |
| evrardjp | would you rather backport the Q changes (which is for me a little big series of patches), or reintroduce changes in Q to handle the upgrade case? | 10:26 |
| evrardjp | I'd do the latter, but I am not fully aware of the context. | 10:26 |
| evrardjp | if that's something we need to do in P anyway, let's do it | 10:27 |
| odyssey4me | oh bother | 10:28 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: Cleanup the gate-check-commit dstat part https://review.openstack.org/536738 | 10:28 |
| evrardjp | odyssey4me: :D | 10:28 |
| odyssey4me | so we could revert just that one patch and be fine, or we could implement some sort of migration tooling | 10:29 |
| odyssey4me | the migration would need to check for the link, then if it exists copy the contents somewhere temporary, then remove the link and move the contents to a newly created folder | 10:29 |
| evrardjp | yeah the revert would work, the migration would work, and the cleanup of P would be fine too. These are sorted with the amount of work and risks :D | 10:29 |
| odyssey4me | porting that back to p will then give you the same problem for o->p | 10:30 |
| evrardjp | odyssey4me: yes | 10:30 |
| odyssey4me | it'd be turtles all the way down | 10:30 |
| evrardjp | that's why I'd like to not do it :D | 10:30 |
| evrardjp | I think the best approach is the tooling in the repo_server role | 10:30 |
| evrardjp | odyssey4me: I think for that process I'd just do a shell script. It seems less tedious than a series of ansible tasks. | 10:32 |
| odyssey4me | it's hardly worth the extra machinery, given that it's AIO specific | 10:32 |
| evrardjp | what do you mean? | 10:32 |
| evrardjp | you mean just reverting? | 10:32 |
| odyssey4me | It would only be a symlink if the repo container is on the deploy host. | 10:33 |
| evrardjp | I am still not sure what you mean.... | 10:34 |
| evrardjp | I understand that part, but I don't understand what you'd prefer to do. | 10:35 |
| evrardjp | I know it's not a big deal, but it's still something we have to fix | 10:35 |
| odyssey4me | well, one option is to revert and add a TODO to be rid of it in Rocky... and add a release note telling people that the functionality is deprecated... it's highly unlikely that the functionality is being used anywhere outside the gates but we should probably notify people | 10:35 |
| evrardjp | ok, so no migration tooling | 10:36 |
| odyssey4me | another option is to add tooling to migrate from the previous state to the new state - which is nice, but adds machinery that may break | 10:36 |
| evrardjp | I thought we could use something like memcached: https://review.openstack.org/#/c/526022/1/tasks/memcached_config.yml | 10:36 |
| evrardjp | but that won't keep existing cache, like you'd suggest. | 10:37 |
| odyssey4me | option 2 is nicer IF someone is using it, option 1 is easier and simpler from a code standpoint | 10:37 |
| evrardjp | to be 100% certain we are talking about the same thing, you mean the feature that a deploy node can be used as git cache, right? | 10:39 |
| evrardjp | because we kinda broke that promise when doing the first patch, didn't we? | 10:39 |
| odyssey4me | the idea is that if the deploy node has the git contents already, it gets pushed to the repo container when the repo container gets setup | 10:39 |
| odyssey4me | this still happens today | 10:40 |
| evrardjp | ok | 10:40 |
| odyssey4me | we previously also allowed a symlink if the deploy host and repo container host were the same - so the contents were not pushed up but instead just symlinked | 10:40 |
| evrardjp | so it's just that the bind mount and symlink thing changed | 10:40 |
| odyssey4me | this was faster for gating, and was done for the purpose of making gating faster | 10:40 |
| evrardjp | mmm I see. | 10:41 |
| *** jbadiapa has quit IRC | 10:41 | |
| odyssey4me | it's possible that we could implement something in the zuul v3 world to make gating faster using the git cache, but we're not doing that right now for some reasons... primarily that it would take time to figure out that I don't have and that doing it would require a fair bit of test implementation restructuring | 10:42 |
| evrardjp | Let skip that part, our gating works. | 10:42 |
| evrardjp | :p | 10:42 |
| odyssey4me | and right now our gate times are kinda ok - as we've discussed before, instead of using hacks like this I think we need more fundamental changes to how things are done | 10:43 |
| evrardjp | agreed. | 10:43 |
| evrardjp | but right now, I'd say let's deal with what we have | 10:43 |
| evrardjp | my concern is that for people that will do a P-Q-R upgrade path | 10:44 |
| odyssey4me | yep, obviously | 10:44 |
| evrardjp | if we do a revert, and get rid of rocky, they would still have that folder present | 10:44 |
| openstackgerrit | Merged openstack/openstack-ansible-rsyslog_server master: Updated from OpenStack Ansible Tests https://review.openstack.org/536450 | 10:44 |
| odyssey4me | so it comes down to the question of whether you want the migration done automagically, or whether we inform the deployers that the symlink functionality is going away and let them figure it out on their own | 10:45 |
| odyssey4me | I'm OK with either approach and will be happy to put the patch together, but I'd like you to choose which approach you prefer. | 10:45 |
| evrardjp | I think it's a simple risk | 10:46 |
| evrardjp | haha I was kinda the same, ok for the patch, let's discuss the approach :D | 10:46 |
| openstackgerrit | Merged openstack/openstack-ansible-os_searchlight master: Updated from OpenStack Ansible Tests https://review.openstack.org/536437 | 10:47 |
| evrardjp | I think getting rid of the symlink is fine | 10:47 |
| evrardjp | I mean | 10:47 |
| evrardjp | doing a revert + release note is fine | 10:47 |
| evrardjp | telling it's going away, because they can still use the folder in itself | 10:47 |
| evrardjp | it's not like it was a big change, and on top of that, with developer mode changes or changes we plan with the way we do repo, I think it would make sense to move forward and inform our deployers | 10:48 |
| openstackgerrit | Merged openstack/openstack-ansible-os_watcher master: Updated from OpenStack Ansible Tests https://review.openstack.org/536442 | 10:49 |
| evrardjp | we need to improve our relationship with deployers, but doing everything automatically isn't necessary a good thing | 10:49 |
| *** shardy has quit IRC | 10:49 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_zaqar master: Updated from OpenStack Ansible Tests https://review.openstack.org/536443 | 10:50 |
| openstackgerrit | Merged openstack/openstack-ansible-os_rally master: Updated from OpenStack Ansible Tests https://review.openstack.org/536435 | 10:50 |
| evrardjp | odyssey4me: I can issue the patch if you're busy. | 10:50 |
| *** shardy has joined #openstack-ansible | 10:51 | |
| evrardjp | ok let me get that rolling | 10:52 |
| odyssey4me | ok | 10:52 |
| odyssey4me | great, let me know when you have it ready for review | 10:52 |
| openstackgerrit | Merged openstack/openstack-ansible-repo_server master: Updated from OpenStack Ansible Tests https://review.openstack.org/536448 | 10:53 |
| openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: Updated from OpenStack Ansible Tests https://review.openstack.org/536440 | 10:53 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-repo_server master: Revert "Remove sylinked git cache functionality" https://review.openstack.org/536763 | 10:59 |
| evrardjp | odyssey4me: ^ | 10:59 |
| evrardjp | not sure if that's really clear | 10:59 |
| odyssey4me | mind if I edit it? | 10:59 |
| evrardjp | not at all | 11:00 |
| evrardjp | english things. | 11:00 |
| evrardjp | hwoarang: odyssey4me if you could vote on https://review.openstack.org/#/c/536738/2 that would be great. I kinda broke the upgrades from O to P while trying to fix them. | 11:02 |
| *** jcos has joined #openstack-ansible | 11:04 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_server master: Revert "Remove sylinked git cache functionality" https://review.openstack.org/536763 | 11:08 |
| evrardjp | hwoarang: we seem to have issues in role tests for suse, a problem always appearing on keystone: http://logs.openstack.org/15/535815/1/gate/openstack-ansible-functional-opensuse-423/fc43563/job-output.txt.gz#_2018-01-23_09_46_40_530768 | 11:08 |
| evrardjp | do you think the db changes could have an impact? | 11:09 |
| evrardjp | odyssey4me: that's exactly what I meant! | 11:10 |
| evrardjp | :D | 11:10 |
| odyssey4me | Glad we agree then. :) | 11:11 |
| evrardjp | ahah I can't consider you my official translator, eumel would feel bad :p | 11:12 |
| openstackgerrit | Merged openstack/openstack-ansible-os_swift master: Updated from OpenStack Ansible Tests https://review.openstack.org/536438 | 11:12 |
| *** jbadiapa has joined #openstack-ansible | 11:13 | |
| *** SmearedBeard has joined #openstack-ansible | 11:16 | |
| *** Smeared_Beard has quit IRC | 11:18 | |
| evrardjp | hwoarang: thinking about this patch: https://review.openstack.org/#/c/535254/ but I might be wrong. | 11:18 |
| evrardjp | I am probably wrong | 11:18 |
| evrardjp | I will try in more details | 11:19 |
| *** gillesMo has quit IRC | 11:19 | |
| hwoarang | evrardjp: forget about it for now i am lining up more patches | 11:29 |
| evrardjp | yeah but it's blocking gates | 11:29 |
| hwoarang | oh | 11:29 |
| hwoarang | wait | 11:29 |
| hwoarang | again | 11:30 |
| evrardjp | I have started a build locally, see if that's linked | 11:30 |
| hwoarang | it's not related to this patch i think. just some locking is going terribly wrong on galera | 11:30 |
| hwoarang | it was there on friday too, then it was ok in weekend and monday and now broke again | 11:30 |
| evrardjp | I am worried of a version change impacting suse, that would give a keystone failure | 11:30 |
| evrardjp | oh ok | 11:31 |
| hwoarang | the package hasn't updated in 10 days I am afraid | 11:31 |
| evrardjp | ok | 11:31 |
| evrardjp | I haven't digged deeper, I just looked at what changed recently :p | 11:31 |
| evrardjp | I am building right now, I will tell you more if that's the same issue. | 11:31 |
| hwoarang | there are a lot of warnings and errors in teh galera log file on that job. some of them lead to a bug upstream that was fixed in 10.2.12 which is the version currently used by suse | 11:32 |
| evrardjp | good to know. | 11:32 |
| evrardjp | let's keep in touch if we find out more about what can fix this | 11:32 |
| hwoarang | ok | 11:33 |
| evrardjp | I'll go to lunch in the time it's building :D | 11:33 |
| evrardjp | in the meantime, if you want to help with a quick thing: https://review.openstack.org/#/c/536738/ :D | 11:33 |
| hwoarang | enjoy your lunch | 11:33 |
| evrardjp | ty! | 11:34 |
| armaan | Hello folks, I was wondering whether it is possible that even after running the "repo-install.yml" playbooks, some repo container can still have the older versions? | 11:38 |
| *** jbadiapa has quit IRC | 11:38 | |
| armaan | In other words, how can i make sure that the new package is synced to all the repo containers. | 11:41 |
| *** jwitko has quit IRC | 11:45 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_heat master: Updated from OpenStack Ansible Tests https://review.openstack.org/536426 | 11:48 |
| evrardjp | armaan: it should be done automatically | 11:52 |
| openstackgerrit | Merged openstack/openstack-ansible-os_tacker master: Updated from OpenStack Ansible Tests https://review.openstack.org/536439 | 11:52 |
| evrardjp | it takes a few minutes to sync between repo containers, but the master repo should have a process handling that sync | 11:53 |
| evrardjp | check if lsyncd is running | 11:53 |
| evrardjp | on your master | 11:54 |
| openstackgerrit | Merged openstack/openstack-ansible-apt_package_pinning master: Updated from OpenStack Ansible Tests https://review.openstack.org/536408 | 11:57 |
| *** jcosmao has joined #openstack-ansible | 11:58 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_aodh master: Updated from OpenStack Ansible Tests https://review.openstack.org/536419 | 11:58 |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_container_create master: Updated from OpenStack Ansible Tests https://review.openstack.org/536413 | 11:59 |
| *** markvoelker has joined #openstack-ansible | 12:00 | |
| openstackgerrit | Merged openstack/openstack-ansible-ceph_client master: Updated from OpenStack Ansible Tests https://review.openstack.org/536409 | 12:00 |
| openstackgerrit | Merged openstack/openstack-ansible-os_cloudkitty master: Updated from OpenStack Ansible Tests https://review.openstack.org/536422 | 12:00 |
| openstackgerrit | Merged openstack/openstack-ansible-os_cinder master: Updated from OpenStack Ansible Tests https://review.openstack.org/536421 | 12:00 |
| armaan | evrardjp: roger | 12:00 |
| openstackgerrit | Merged openstack/openstack-ansible-os_keystone master: Updated from OpenStack Ansible Tests https://review.openstack.org/536429 | 12:00 |
| *** jcos has quit IRC | 12:00 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_gnocchi master: Updated from OpenStack Ansible Tests https://review.openstack.org/536425 | 12:00 |
| openstackgerrit | Merged openstack/openstack-ansible-memcached_server master: Updated from OpenStack Ansible Tests https://review.openstack.org/536415 | 12:01 |
| openstackgerrit | Merged openstack/openstack-ansible-os_horizon master: Updated from OpenStack Ansible Tests https://review.openstack.org/536427 | 12:01 |
| openstackgerrit | Merged openstack/openstack-ansible-os_designate master: Updated from OpenStack Ansible Tests https://review.openstack.org/536423 | 12:01 |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Updated from OpenStack Ansible Tests https://review.openstack.org/536434 | 12:01 |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Updated from OpenStack Ansible Tests https://review.openstack.org/536416 | 12:01 |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_openrc master: Updated from OpenStack Ansible Tests https://review.openstack.org/536417 | 12:01 |
| openstackgerrit | Merged openstack/openstack-ansible-os_monasca master: Updated from OpenStack Ansible Tests https://review.openstack.org/536431 | 12:02 |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts master: Updated from OpenStack Ansible Tests https://review.openstack.org/536414 | 12:05 |
| armaan | evrardjp: http://paste.openstack.org/show/650938/ | 12:06 |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: Updated from OpenStack Ansible Tests https://review.openstack.org/536432 | 12:06 |
| armaan | evrardjp: it appears that only links and pkg-cache directory got updated | 12:07 |
| *** taseer2 is now known as Taseer | 12:08 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_almanach master: Updated from OpenStack Ansible Tests https://review.openstack.org/536418 | 12:09 |
| evrardjp | mmm pools should be updated too, nothing in the logs? | 12:10 |
| evrardjp | lsyncd logs | 12:10 |
| evrardjp | not sure if lsyncd has logs... | 12:10 |
| evrardjp | but we should have logs somewhere | 12:10 |
| armaan | evrardjp: i also tried this, openstack-ansible repo-build.yml -e repo_build_git_reclone=yes -e repo_build_wheel_rebuild=yes -e repo_build_venv_rebuild=yes | 12:10 |
| evrardjp | I don't think that would be necessary | 12:11 |
| evrardjp | do you have a log of your run repo build run? | 12:11 |
| evrardjp | maybe restart lsyncd on the master node | 12:12 |
| armaan | evrardjp: lsyncd log http://paste.openstack.org/show/650940/ | 12:12 |
| armaan | ok let me restart | 12:12 |
| openstackgerrit | Merged openstack/openstack-ansible-os_barbican master: Updated from OpenStack Ansible Tests https://review.openstack.org/536420 | 12:12 |
| evrardjp | hwoarang: http://paste.openstack.org/show/650942/ | 12:15 |
| armaan | evrardjp: http://paste.openstack.org/show/650943/ | 12:15 |
| evrardjp | armaan: and you are checked out in 16.0.6 I guess? | 12:16 |
| evrardjp | or you are checked out in 16.0.5 ? | 12:16 |
| evrardjp | ok let's recap, I was maybe distracted | 12:17 |
| evrardjp | the issue is not that the files aren't synced, is that they aren't created in the first place | 12:18 |
| *** tnogisto2 has joined #openstack-ansible | 12:18 | |
| *** tnogisto has joined #openstack-ansible | 12:18 | |
| armaan | evrardjp: I was running stable/pike(16.0.5) few days back and the i moved back few commits because magnum is broken in stable/pike. | 12:18 |
| *** tnogisto has quit IRC | 12:18 | |
| evrardjp | so you're running some kind of 16.0.5 | 12:18 |
| armaan | evrardjp: so, i changed the commit in here https://github.com/openstack/openstack-ansible/blob/stable/pike/playbooks/defaults/repo_packages/openstack_services.yml#L191 | 12:18 |
| evrardjp | (you can check in your group vars all ) | 12:18 |
| *** smatzek has joined #openstack-ansible | 12:19 | |
| evrardjp | ok | 12:19 |
| evrardjp | then re-did the repo build | 12:19 |
| armaan | evrardjp: yes, after changing the commit to c58b727bec3561d8d283497d784a3437185924dd, i did a repo build | 12:20 |
| evrardjp | odyssey4me: in the fact we setup for the need of a repo rebuild, do we care about a change in the git repos? | 12:20 |
| evrardjp | armaan: all you did seems correct. | 12:20 |
| evrardjp | it should have worked | 12:20 |
| armaan | evrardjp: but i still had the code from latest commits | 12:21 |
| armaan | evrardjp: ok, good to hear that | 12:21 |
| evrardjp | you mean the new SHA of magnum wasn't respected, and it's like it did nothing? | 12:21 |
| armaan | evrardjp: Yes. | 12:21 |
| evrardjp | you can probably remove your venv of 16.0.5 on the repo nodes and try again, but I'd rather know why it didn't do the proper thing in the first place | 12:21 |
| armaan | evrardjp: roger that. | 12:22 |
| evrardjp | if you have your ansible run log that would be great | 12:22 |
| armaan | evrardjp: something like this "root@control02-repo-container-ef17687b:/var/www/repo/venvs# rm -rf 16.0.5/" | 12:22 |
| evrardjp | (of the first one, when you changed sha) | 12:22 |
| evrardjp | armaan: you can do it with ansible :) | 12:23 |
| evrardjp | but I'd like to have another person's opinion | 12:23 |
| armaan | evrardjp: unfortunately, i ran a lot of things after the first run, so log won't be available | 12:23 |
| armaan | evrardjp: running "rm -rf" with ansible in a production environment is a bit scary :p | 12:24 |
| armaan | evrardjp: btw it appears that venv was changed. http://paste.openstack.org/show/650943/ | 12:26 |
| evrardjp | armaan: technically the rm shouldn't be needed. I am concerned because if you did openstack-ansible repo-build.yml -e repo_build_git_reclone=yes -e repo_build_wheel_rebuild=yes -e repo_build_venv_rebuild=yes everything should be bypassed, and all the reclones/rebuild should be done | 12:29 |
| evrardjp | so what did you do right now? Removed the venvs, and rebuild? | 12:30 |
| evrardjp | (or moved the venvs and rebuild) | 12:30 |
| armaan | evrardjp: i only ran "openstack-ansible repo-build.yml -e repo_build_git_reclone=yes -e repo_build_wheel_rebuild=yes -e repo_build_venv_rebuild=yes" | 12:31 |
| armaan | didn't remove the venvs | 12:31 |
| armaan | running repo-install.yml again | 12:32 |
| *** markvoelker has quit IRC | 12:33 | |
| odyssey4me | evrardjp yes, a git sha change will cause the constraints file to change and trigger a rebuild | 12:36 |
| evrardjp | yeah so there is something wring on armaan 's case | 12:37 |
| evrardjp | weird* | 12:37 |
| *** cmart has quit IRC | 12:37 | |
| evrardjp | armaan: please paste the log of your repo-build part | 12:37 |
| odyssey4me | armaan in your os-releases folder for the release you're on, there'll be a bunch of *.txt files | 12:38 |
| armaan | evrardjp odyssey4me http://paste.openstack.org/show/650945/ | 12:39 |
| odyssey4me | check the requirements_constraints.txt and verify that magnum has the sha you intend it to have? | 12:39 |
| armaan | odyssey4me: git+file:///var/www/repo/openstackgit/magnum@c58b727bec3561d8d283497d784a3437185924dd#egg=magnum&gitname=magnum&projectgroup=magnum_all | 12:40 |
| armaan | odyssey4me: it does. | 12:40 |
| armaan | I want to switch back to this commit c58b727bec3561d8d283497d784a3437185924dd | 12:40 |
| odyssey4me | ok, and how have you adjusted the git sha? did you modify the integrated repo code or did you override using user_variables? | 12:41 |
| armaan | odyssey4me: I changed this line https://github.com/openstack/openstack-ansible/blob/stable/pike/playbooks/defaults/repo_packages/openstack_services.yml#L191 | 12:42 |
| armaan | magnum_git_install_branch: c58b727bec3561d8d283497d784a3437185924dd | 12:42 |
| odyssey4me | ok, for future reference you can just override that in /etc/openstack_deploy/user_variables.yml rather than modify the git code. Anyway, what's the full file name for magnum*.whl in the os-releases folder? | 12:43 |
| evrardjp | armaan: that's a lot of skipping | 12:43 |
| odyssey4me | the skipping is right if nothing's changed | 12:43 |
| evrardjp | yes but the sha was changed | 12:44 |
| evrardjp | or maybe I missed the point? | 12:44 |
| odyssey4me | yes, but it seems like the output given is after a previous run | 12:44 |
| odyssey4me | ie the sha was changed, and the repo build was run after that which changed things - the output given is a subsequent run | 12:44 |
| evrardjp | ok | 12:45 |
| evrardjp | I thought this was the thing JUST after | 12:45 |
| odyssey4me | doesn't look like it | 12:45 |
| evrardjp | let's follow your lead odyssey4me | 12:45 |
| evrardjp | (fixing cinder in the meantime, so i am missing parts of the convo) | 12:46 |
| armaan | odyssey4me: http://paste.openstack.org/show/650947/ | 12:46 |
| armaan | evrardjp: Yes, the output is from a subsequent run. | 12:47 |
| odyssey4me | ah, there's the problem | 12:47 |
| *** woodard has quit IRC | 12:47 | |
| odyssey4me | the venv build is not version specific - it relies on the os-releases folder having a single version available... which it does not in this case | 12:47 |
| odyssey4me | that's odd | 12:47 |
| *** woodard has joined #openstack-ansible | 12:48 | |
| odyssey4me | https://github.com/openstack/openstack-ansible-repo_build/blob/master/tasks/repo_build_wheels.yml#L65-L77 should be cleaning them up when the wheel build happens, so something fishy is going on here | 12:49 |
| armaan | odyssey4me: should i remove these http://paste.openstack.org/show/650954/ and rebuild the repo? | 12:51 |
| odyssey4me | hmm, hang on a minute - armaan what branch is this? | 12:51 |
| odyssey4me | pike? | 12:51 |
| armaan | yes, pike | 12:51 |
| evrardjp | no 2.4 change :p | 12:51 |
| odyssey4me | ok, this is a bug introduced by a change in ansible 2.3 - same issue as https://review.openstack.org/#/c/529043/ | 12:52 |
| odyssey4me | I'll push up a patch now - armaan if you could validate that it works that'd be marvellous | 12:52 |
| armaan | odyssey4me: awesome! Sure i will do that. | 12:53 |
| evrardjp | ahah good catch odyssey4me | 12:53 |
| evrardjp | I expected an ansible issue, not that one though :p | 12:53 |
| evrardjp | thanks odyssey4me again! and thanks armaan for the source of the bug :) | 12:54 |
| armaan | evrardjp: :) | 12:54 |
| evrardjp | armaan: if you want an easier and faster debugging session, it's maybe worth creating a bug directly with the first log output, then the re-run output, and telling what you're trying to achieve/what you expected. Because if we have everything under our eyes it goes faster :) | 12:55 |
| evrardjp | but anyway, it was good! | 12:55 |
| evrardjp | thanks odyssey4me and armaan again! | 12:55 |
| armaan | evrardjp: Good advice. I will keep that in mind. | 12:56 |
| evrardjp | yeah, I totally have the same issue: when I am in a problem, I am heading directly towards it for the solution, but sometimes rephrasing it for other people helps me. Just sharing my experience :D | 12:57 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: Ensure that all release files are cleaned up when rebuilding https://review.openstack.org/536802 | 12:57 |
| odyssey4me | armaan that should fix it - you'll need to tell the build to rebuild, ie: openstack-ansible repo-build.yml -e repo_build_wheel_rebuild=yes -e repo_build_venv_rebuild=yes | 12:58 |
| odyssey4me | (no need to reclone the git sources) | 12:58 |
| armaan | roger! | 12:59 |
| evrardjp | armaan: if you could leave a review on the patch above to confirm it fixes it for you, that would be great too | 12:59 |
| odyssey4me | ++ | 12:59 |
| *** cmart has joined #openstack-ansible | 13:02 | |
| *** askb has quit IRC | 13:05 | |
| *** yolanda has joined #openstack-ansible | 13:05 | |
| *** askb has joined #openstack-ansible | 13:06 | |
| evrardjp | wow tempest ImportError exception isn't reported as ImportError when using the plugin load... That's confusing | 13:07 |
| evrardjp | well no that could be alright, but it's the same error message if you can't find the plugin and if you can't load the plugin basically | 13:08 |
| evrardjp | that's the confusing part :D | 13:09 |
| *** vnogin has joined #openstack-ansible | 13:10 | |
| odyssey4me | confusing error messages FTW | 13:11 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_cinder master: Fix upgrade test https://review.openstack.org/535791 | 13:14 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_cinder master: Fix upgrade test https://review.openstack.org/535791 | 13:15 |
| evrardjp | odyssey4me: should fix it ^ | 13:15 |
| *** bhujay has quit IRC | 13:16 | |
| odyssey4me | looks good - let's see what the gate says | 13:16 |
| *** jbadiapa has joined #openstack-ansible | 13:16 | |
| evrardjp | hwoarang: the fun start when you see something like this: DBAPIError exception wrapped from (pymysql.err.InternalError) | 13:17 |
| *** cmart has quit IRC | 13:21 | |
| armaan | evrardjp odyssey4me: That patch fixed my issue. thanks a million folks :) | 13:21 |
| *** vnogin has quit IRC | 13:22 | |
| evrardjp | armaan: you're welcome | 13:22 |
| *** ykarel is now known as ykarel|afk | 13:23 | |
| openstackgerrit | Jakob Hasselmann proposed openstack/openstack-ansible-os_neutron master: Add var and docs for designate domain port config https://review.openstack.org/536809 | 13:24 |
| *** electrofelix has joined #openstack-ansible | 13:25 | |
| *** SerenaFeng has joined #openstack-ansible | 13:30 | |
| *** markvoelker has joined #openstack-ansible | 13:31 | |
| *** ykarel|afk has quit IRC | 13:32 | |
| *** SerenaFeng has quit IRC | 13:32 | |
| *** ivveh has quit IRC | 13:33 | |
| evrardjp | jafeha: thanks! :D | 13:34 |
| evrardjp | hwoarang: are you there? | 13:34 |
| evrardjp | I see the difference with my suse build | 13:34 |
| *** SerenaFeng has joined #openstack-ansible | 13:34 | |
| *** cmart has joined #openstack-ansible | 13:35 | |
| evrardjp | I don't know how deep you digged into it yet, so I'd rather avoid re-debugging what you already found. | 13:35 |
| evrardjp | but it looks like a violation of a table constraint that prevent the keystone db migrate to run | 13:35 |
| evrardjp | CONSTRAINT `CONSTRAINT_1` CHECK (`allow_application_credential_creation` in (0,1)) | 13:35 |
| evrardjp | does that ring you a bell? | 13:36 |
| *** RandomTech has joined #openstack-ansible | 13:37 | |
| *** esberglu_ has quit IRC | 13:39 | |
| evrardjp | andymccr: are you there by any chance? | 13:42 |
| andymccr | o/ | 13:42 |
| evrardjp | I will just ask you to review two things real quick then | 13:43 |
| jafeha | evrardjp, np. | 13:43 |
| andymccr | sure | 13:43 |
| evrardjp | https://review.openstack.org/#/c/536738/ https://review.openstack.org/#/c/536763/ | 13:43 |
| evrardjp | breaking upgrade gates | 13:43 |
| evrardjp | periodics* | 13:43 |
| *** cjloader has joined #openstack-ansible | 13:43 | |
| andymccr | evrardjp: on it | 13:43 |
| evrardjp | thanks! | 13:43 |
| *** vnogin has joined #openstack-ansible | 13:45 | |
| odyssey4me | andymccr while you're reviewing, https://review.openstack.org/#/c/536802/ could do with more eyes :) | 13:45 |
| andymccr | that is crazy | 13:46 |
| andymccr | lgtm - but wtf module change :P | 13:46 |
| odyssey4me | yup, fun times | 13:46 |
| andymccr | evrardjp: why do we need to || true on run_dstat? surely run_dstat just doesnt do anything if gate_exit_run_dstat is not true? | 13:47 |
| odyssey4me | we should probably do a bit of an audit of everywhere we use the find module to see if we don't have more hidden bugs | 13:47 |
| evrardjp | andymccr: I think I wrote it in the commit message. it's for upgrades. | 13:47 |
| evrardjp | We are loading the gate_check_commit, then we do checkout to previous branch, then we load the lib | 13:47 |
| evrardjp | the lib may or may not have run_dstat | 13:48 |
| evrardjp | so we run || true | 13:48 |
| andymccr | ah so if it doesnt exist | 13:48 |
| evrardjp | yeah | 13:48 |
| evrardjp | also, it's simpler than doing if upgrade, set dstat to false, etc. | 13:48 |
| evrardjp | looked cleaner imo | 13:48 |
| andymccr | yeah i mean im usually against || true in general, but im trying to think of a better way and not really coming up with much | 13:49 |
| evrardjp | yeah and that's conditional of the upgrade ofc :p | 13:49 |
| evrardjp | the other way would be to load in a different order, but then you're hitting other issues. | 13:49 |
| evrardjp | which is why we did in this order | 13:49 |
| evrardjp | || true is evil indeed. | 13:50 |
| andymccr | i guess you could check if it exists using type? | 13:50 |
| andymccr | we in urgent mode? | 13:50 |
| evrardjp | nor urgent urgent, but it's breaking O to P upgrades, which is not fun | 13:51 |
| andymccr | yeh | 13:51 |
| evrardjp | P to Q could maybe wait | 13:51 |
| odyssey4me | evrardjp is being modest, upgrades have been broken for months and he's been slowly working through fixes to get them back to working | 13:51 |
| odyssey4me | I would say we're in urgent mode. | 13:51 |
| andymccr | yeh taht sounds about right | 13:51 |
| andymccr | cool lets just merge it | 13:51 |
| mgariepy | morning everyone | 13:52 |
| evrardjp | mgariepy: good morning | 13:52 |
| mgariepy | I know it's in a bit but anyone knows he goes to openstack-summit in vancouver ? | 13:52 |
| evrardjp | I don't know, but I will try to submit a talk there to help my case :D | 13:53 |
| RandomTech | if i wanted to configure an extra network for the contains to get ips for an external connection(floating ips) would i just put "all_containers" in group binds? | 13:54 |
| mgariepy | hehe ok :) that's a good idea. | 13:54 |
| mgariepy | I'll ask by boss if he wants to pay for me ;) haha | 13:54 |
| evrardjp | it's the same country! | 13:55 |
| mgariepy | yeah only 5000 km west | 13:56 |
| evrardjp | :p | 13:57 |
| *** ykarel|afk has joined #openstack-ansible | 13:57 | |
| *** aludwar has joined #openstack-ansible | 13:57 | |
| *** esberglu has joined #openstack-ansible | 13:58 | |
| *** cjloader has quit IRC | 14:00 | |
| hwoarang | evrardjp: i am here now | 14:00 |
| evrardjp | great | 14:01 |
| hwoarang | it rings a bell... | 14:01 |
| evrardjp | so, could you remind me what was the issue? | 14:01 |
| evrardjp | darn | 14:01 |
| *** armaan_ has joined #openstack-ansible | 14:01 | |
| evrardjp | should we speak to keystone team to help us finding out what's the root cause of the issue? | 14:02 |
| hwoarang | evrardjp: is this similar to https://bugs.launchpad.net/barbican/+bug/1734329 ? | 14:02 |
| openstack | Launchpad bug 1734329 in Barbican "CHECK constraint bug in db migration on Mariadb 10.2" [Undecided,New] | 14:02 |
| evrardjp | sounds like it | 14:02 |
| hwoarang | that's a keystone regression then | 14:02 |
| hwoarang | i know a keystone dev at suse | 14:02 |
| evrardjp | yup | 14:02 |
| hwoarang | do you have a public link for that? | 14:02 |
| evrardjp | nope | 14:03 |
| evrardjp | well I had a paste | 14:03 |
| evrardjp | just a second | 14:03 |
| *** markvoelker has quit IRC | 14:04 | |
| * odyssey4me pushes up reviews everywhere to add || true to make everything work. I know andymccr really loves that. | 14:05 | |
| *** armaan has quit IRC | 14:05 | |
| andymccr | ahah | 14:05 |
| andymccr | well stuff will work | 14:05 |
| evrardjp | hwoarang: http://paste.openstack.org/show/650942/ | 14:05 |
| andymccr | just wrap the upgrade task in a || true | 14:05 |
| andymccr | :D | 14:05 |
| andymccr | green gates are green | 14:05 |
| *** SerenaFeng has quit IRC | 14:05 | |
| odyssey4me | success! | 14:05 |
| evrardjp | woot, where?! | 14:05 |
| evrardjp | :p | 14:05 |
| hwoarang | evrardjp: thanks I will forward taht | 14:06 |
| evrardjp | yeah, it's probably 10.2 issue though | 14:06 |
| *** dave-mccowan has joined #openstack-ansible | 14:10 | |
| *** dave-mcc_ has joined #openstack-ansible | 14:12 | |
| evrardjp | is it me or launchpad is in a bad shapre rn? | 14:13 |
| evrardjp | shape* | 14:13 |
| hwoarang | it's lp | 14:14 |
| hwoarang | broken for me | 14:14 |
| evrardjp | oh I got an answer | 14:14 |
| *** dave-mccowan has quit IRC | 14:15 | |
| openstackgerrit | Merged openstack/openstack-ansible-repo_server master: Revert "Remove sylinked git cache functionality" https://review.openstack.org/536763 | 14:16 |
| *** indistylo has joined #openstack-ansible | 14:16 | |
| *** ivveh has joined #openstack-ansible | 14:17 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-openstack_hosts master: templates: hostfile-setup: Improve regexp for host entries https://review.openstack.org/536842 | 14:18 |
| *** smatzek has quit IRC | 14:20 | |
| *** cmart has quit IRC | 14:28 | |
| evrardjp | dear cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, v1k0d3n, severion, bgmccollum, darrenc, | 14:33 |
| evrardjp | JRobinson__, asettle, colinmcnamara, thorst, adreznec, eil397, qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen, ullbeking: | 14:34 |
| evrardjp | the osa bug triage will start in 1h30’. Please have a look at the bug list before starting: https://etherpad.openstack.org/p/osa-bugtriage | 14:34 |
| evrardjp | Thank you | 14:34 |
| *** jwitko has joined #openstack-ansible | 14:34 | |
| *** markvoelker has joined #openstack-ansible | 14:41 | |
| *** bhujay has joined #openstack-ansible | 14:43 | |
| *** cmart has joined #openstack-ansible | 14:44 | |
| openstackgerrit | Merged openstack/openstack-ansible-repo_build master: Ensure that all release files are cleaned up when rebuilding https://review.openstack.org/536802 | 14:47 |
| evrardjp | odyssey4me: let me backport this ^ | 14:48 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-repo_build stable/pike: Ensure that all release files are cleaned up when rebuilding https://review.openstack.org/536850 | 14:48 |
| *** bhujay has quit IRC | 14:49 | |
| *** ykarel|afk has quit IRC | 14:50 | |
| *** bhujay has joined #openstack-ansible | 14:51 | |
| *** ykarel|afk has joined #openstack-ansible | 14:53 | |
| *** cjloader has joined #openstack-ansible | 14:54 | |
| *** dave-mcc_ has quit IRC | 14:55 | |
| *** yolanda has quit IRC | 14:56 | |
| *** gillesMo has joined #openstack-ansible | 15:02 | |
| mgariepy | How do I write my override to have this output ? https://github.com/openstack/openstack-ansible-plugins/blob/master/action/config_template.py#L130-L134 | 15:03 |
| mgariepy | I'm trying to add 2 pci_alias in the nova.conf but i cannot seems to do that correclty. | 15:04 |
| mgariepy | i might also be mislead in thinking that is the way it works... :) | 15:05 |
| *** dave-mccowan has joined #openstack-ansible | 15:05 | |
| *** smatzek has joined #openstack-ansible | 15:07 | |
| evrardjp | https://docs.openstack.org/openstack-ansible/latest/admin/advanced-config.html#original-template-file-test-ini-j2 | 15:07 |
| evrardjp | mgariepy: ^ | 15:08 |
| evrardjp | should have linked to https://docs.openstack.org/openstack-ansible/latest/admin/advanced-config.html#setting-overrides-in-configuration-files | 15:08 |
| mgariepy | can I add 2 lines with the same key ? | 15:09 |
| hwoarang | evrardjp: what do you think of https://review.openstack.org/#/c/536358/ ? | 15:09 |
| *** shardy is now known as shardy_afk | 15:10 | |
| evrardjp | hwoarang: voted | 15:13 |
| hwoarang | ah thanks! | 15:15 |
| *** indistylo has quit IRC | 15:19 | |
| *** esberglu_ has joined #openstack-ansible | 15:23 | |
| *** esbergl__ has joined #openstack-ansible | 15:24 | |
| *** armaan has joined #openstack-ansible | 15:26 | |
| *** esberglu has quit IRC | 15:26 | |
| *** esberglu_ has quit IRC | 15:28 | |
| *** armaan_ has quit IRC | 15:29 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Cleanup the gate-check-commit dstat part https://review.openstack.org/536738 | 15:29 |
| *** esberglu has joined #openstack-ansible | 15:31 | |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: tests: Add missing pip_install role dependency https://review.openstack.org/536358 | 15:33 |
| *** esbergl__ has quit IRC | 15:35 | |
| openstackgerrit | Taseer Ahmed proposed openstack/openstack-ansible-os_congress master: Introduce os_congress role in gerrit https://review.openstack.org/522491 | 15:35 |
| *** pbandark has joined #openstack-ansible | 15:35 | |
| evrardjp | hwoarang: I am surprised you got that issue though, but whatever. | 15:37 |
| evrardjp | it doesn't hurt | 15:37 |
| evrardjp | and it makes sense | 15:37 |
| evrardjp | you are probably hitting a precedence issue | 15:37 |
| evrardjp | one of the many | 15:37 |
| evrardjp | :p | 15:37 |
| evrardjp | https://github.com/ansible/ansible/issues/34782 | 15:38 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible stable/pike: Cleanup the gate-check-commit dstat part https://review.openstack.org/536868 | 15:41 |
| hwoarang | evrardjp: i think it makes sense because in zuul all the roles are linked in but in vagrant you have to be explicit on what ou want | 15:45 |
| hwoarang | evrardjp: how can I reproduce the galera thing? just deploy os_keystone with vagrant? because I wouldn't see it locally :/ | 15:45 |
| hwoarang | i got a patch from colleen | 15:46 |
| *** shardy_afk is now known as shardy | 15:46 | |
| evrardjp | hwoarang: yes I did that with my vagrant | 15:55 |
| evrardjp | hwoarang: http://paste.openstack.org/show/650980/ <- a crop of my vagrant file | 15:56 |
| evrardjp | take what you need :D | 15:56 |
| evrardjp | you're gonna get that issue. | 15:56 |
| *** ykarel|afk is now known as ykarel | 15:58 | |
| evrardjp | bug triage time! | 15:59 |
| evrardjp | Bug triage cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, v1k0d3n, severion, bgmccollum, | 15:59 |
| evrardjp | darrenc, JRobinson__, asettle, colinmcnamara, thorst, adreznec, eil397, qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen | 15:59 |
| evrardjp | Here is our bug list for today https://etherpad.openstack.org/p/osa-bugtriage | 15:59 |
| evrardjp | #startmeeting openstack_ansible_meeting | 15:59 |
| openstack | Meeting started Tue Jan 23 15:59:52 2018 UTC and is due to finish in 60 minutes. The chair is evrardjp. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:59 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:59 |
| *** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)" | 15:59 | |
| openstack | The meeting name has been set to 'openstack_ansible_meeting' | 15:59 |
| evrardjp | #topic rollcall | 16:00 |
| *** openstack changes topic to "rollcall (Meeting topic: openstack_ansible_meeting)" | 16:00 | |
| spotz | \o/ | 16:00 |
| evrardjp | hello spotz :) | 16:00 |
| spotz | hola | 16:00 |
| evrardjp | giving a couple of minutes before starting the thing... | 16:01 |
| evrardjp | #topic Focus of the week | 16:02 |
| *** openstack changes topic to "Focus of the week (Meeting topic: openstack_ansible_meeting)" | 16:02 | |
| hwoarang | o/ | 16:02 |
| odyssey4me | o/ | 16:02 |
| d34dh0r53 | o/ | 16:03 |
| evrardjp | The FOTW (focus of the week, not fall of the wall) for this week should be "get your stuff in". | 16:03 |
| evrardjp | I think we have stabilized things the last two weeks, and I am confident the last bugs to iron out are easy to fix, so I think we should continue to innovate now! | 16:03 |
| *** openstackgerrit has quit IRC | 16:03 | |
| *** rstarmer has joined #openstack-ansible | 16:04 | |
| evrardjp | next week is community meeting we should plan the 4 next focus of the week there. | 16:04 |
| evrardjp | ok let's move on to... | 16:04 |
| evrardjp | the real deal | 16:04 |
| evrardjp | #topic bug triage | 16:04 |
| *** openstack changes topic to "bug triage (Meeting topic: openstack_ansible_meeting)" | 16:04 | |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1744681 | 16:04 |
| openstack | Launchpad bug 1744681 in openstack-ansible "Appendix B: Example production environment configuration in OpenStack-Ansible: clarification of infra load-balancers" [Undecided,Invalid] | 16:04 |
| evrardjp | I started to triage this one a little earlier, so I'd like to know if my triage was correct. | 16:05 |
| evrardjp | If nobody complaints about this one, I move on. | 16:05 |
| evrardjp | it could be a doc bug, but I think it's more a support request. | 16:06 |
| hwoarang | yeah i agree | 16:06 |
| evrardjp | ok | 16:06 |
| evrardjp | let's move on then | 16:06 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1744458 | 16:06 |
| openstack | Launchpad bug 1744458 in openstack-ansible "Failed to build cradox on CentOS7 " [Undecided,Incomplete] | 16:06 |
| evrardjp | mgariepy: mhayden are you there? | 16:06 |
| mhayden | evrardjp: yeah, in a video meeting :/ | 16:07 |
| evrardjp | :( | 16:07 |
| evrardjp | ok if nobody can confirm, I'll leave it as new, instead of incomplete. | 16:08 |
| evrardjp | the bug reporter gave all the information to confirm, we just don't have enough resources to check right now. | 16:08 |
| evrardjp | ok | 16:08 |
| evrardjp | next | 16:08 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1744014 | 16:08 |
| openstack | Launchpad bug 1744014 in openstack-ansible "Backups in OpenStack-Ansible" [Undecided,New] | 16:08 |
| evrardjp | That seems valid and problematic indeed. It's not because we install xtrabackup that we do the backups. | 16:10 |
| evrardjp | I think that we are giving false expectations there, so I'd mark it as confirmed and high | 16:10 |
| evrardjp | or medium | 16:10 |
| mgariepy | sorry i dont have time to validate | 16:11 |
| evrardjp | mgariepy: no worries. | 16:11 |
| evrardjp | ok let's move on if ppl agree with the confirmed / medium for the docs issue. | 16:12 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1743805 | 16:12 |
| openstack | Launchpad bug 1743805 in openstack-ansible "neutron-db-manage fails on hostname with underscore" [Undecided,New] | 16:12 |
| evrardjp | I think we should mark it as incomplete, we don't know which branch... | 16:12 |
| evrardjp | agreed? | 16:13 |
| evrardjp | it might look like master, but I haven't seen that issue in master. | 16:13 |
| hwoarang | ok | 16:14 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1743032 | 16:14 |
| openstack | Launchpad bug 1743032 in openstack-ansible "Galera cluster maintenance in OpenStack-Ansible" [Undecided,New] - Assigned to Kevin Carter (kevin-carter) | 16:14 |
| evrardjp | cloudnull: do you have an update on this one? | 16:15 |
| evrardjp | I'll leave it as is then. | 16:15 |
| evrardjp | next | 16:16 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1741085 | 16:16 |
| openstack | Launchpad bug 1741085 in openstack-ansible "Playbook ceph-install.yml won't boostrap cluster" [Undecided,New] | 16:16 |
| *** SerenaFeng has joined #openstack-ansible | 16:16 | |
| evrardjp | andymccr logan- should we go ahead and remove the serial part there? | 16:16 |
| evrardjp | For me the bug is completely invalid, as I see deploys with ceph working. | 16:17 |
| evrardjp | but I understand why we'd want to remove that barrier if that's not useful | 16:17 |
| odyssey4me | better to variable it than remove it | 16:18 |
| odyssey4me | that's what we discussed last week IIRC | 16:18 |
| odyssey4me | logan- was also going to validate the issue | 16:19 |
| odyssey4me | I think | 16:19 |
| evrardjp | yeah logan- said he will try to validate it | 16:19 |
| evrardjp | yeah I like the idea to variable it. | 16:19 |
| evrardjp | I answered on the bug, saying we don't have issue in the deploys in our gates. | 16:20 |
| odyssey4me | that would be a good workaround for now | 16:20 |
| odyssey4me | our gate only has one mon, so it's not a good test of the issue | 16:20 |
| evrardjp | oh I see. | 16:20 |
| *** rstarmer has quit IRC | 16:21 | |
| evrardjp | ok I will leave it as is then. | 16:22 |
| evrardjp | next | 16:22 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1739472 | 16:22 |
| openstack | Launchpad bug 1739472 in openstack-ansible "mariadb-client excluded in ocata centos7 deploy" [Undecided,New] | 16:22 |
| evrardjp | anyone working on centos available to check that? | 16:23 |
| hwoarang | i could have a look at it since i am messing with galera already | 16:23 |
| hwoarang | *sigh* | 16:24 |
| evrardjp | that would be nice | 16:24 |
| evrardjp | sorry for that :( | 16:24 |
| hwoarang | please assign it to me | 16:24 |
| evrardjp | I think a vagrant machine should do the trick, see if there are issues there. | 16:24 |
| evrardjp | next | 16:25 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1738860 | 16:25 |
| openstack | Launchpad bug 1738860 in openstack-ansible "nginx-common dependency prevents repo container build" [Undecided,Incomplete] | 16:25 |
| evrardjp | Incomplete, ok for you? | 16:25 |
| hwoarang | yep | 16:26 |
| evrardjp | ok next | 16:27 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1738529 | 16:27 |
| openstack | Launchpad bug 1738529 in openstack-ansible "trove install fails" [Undecided,New] | 16:27 |
| hwoarang | well | 16:28 |
| hwoarang | seems valid i suppose | 16:28 |
| *** yifei has quit IRC | 16:28 | |
| *** yifei has joined #openstack-ansible | 16:29 | |
| evrardjp | should we do something like https://github.com/openstack/openstack-ansible-os_trove/blob/b6b933df6f915fb91b7e28a177cffb2b5ebcc1e0/tasks/trove_service_network.yml#L57 at L72? | 16:29 |
| bhujay | ivve: I checked it and it works well when os:nova:server is defined within the autoscalling group itself , here is the template , please note two methods that i have tried http://paste.openstack.org/show/650984 | 16:29 |
| evrardjp | yeah it seems valid. | 16:29 |
| evrardjp | hwoarang: confirmed medium? | 16:30 |
| bhujay | ivveh:^ | 16:30 |
| *** openstackgerrit has joined #openstack-ansible | 16:30 | |
| openstackgerrit | Andy McCrae proposed openstack/openstack-ansible master: Install mon servers in parallel. https://review.openstack.org/536891 | 16:30 |
| evrardjp | that wasn't for hwoarang alone, sorry for that. | 16:30 |
| hwoarang | i think so | 16:30 |
| evrardjp | ok | 16:30 |
| evrardjp | next | 16:30 |
| evrardjp | thanks andymccr ;) | 16:30 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1738451 | 16:30 |
| openstack | Launchpad bug 1738451 in openstack-ansible "openstack_host_kernel_modules missing nf_conntrack_ipv6" [Undecided,New] | 16:30 |
| andymccr | evrardjp: np, i added logan- as a reviewer and -w'd it until he reviews it :) | 16:30 |
| evrardjp | that looks valid and high. | 16:30 |
| evrardjp | andymccr: smart. | 16:31 |
| hwoarang | οκ | 16:31 |
| hwoarang | *ok | 16:31 |
| evrardjp | haha | 16:31 |
| evrardjp | keyboard tricks! | 16:31 |
| *** rstarmer has joined #openstack-ansible | 16:31 | |
| hwoarang | :) | 16:32 |
| evrardjp | so anyone agrees on confirmed and high for the conntrack? | 16:32 |
| evrardjp | oh you said ok. | 16:32 |
| evrardjp | for that :p | 16:32 |
| hwoarang | yeah fine by me | 16:32 |
| hwoarang | sounds reasonable | 16:32 |
| andymccr | yeah seems sensible | 16:32 |
| evrardjp | next then | 16:32 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1737827 | 16:32 |
| openstack | Launchpad bug 1737827 in openstack-ansible "(ceph-client): setting 'nova_ceph_client' results in deployment where volumes can't be attached to VMs" [Undecided,New] | 16:32 |
| evrardjp | that's andymccr 's domain of expertise now, even if he'd say it's not :p | 16:33 |
| evrardjp | :D | 16:33 |
| andymccr | hm | 16:34 |
| openstackgerrit | Bjoern Teipel proposed openstack/openstack-ansible-ops master: Add insecure flag for post upgrade CLI commands https://review.openstack.org/535973 | 16:34 |
| andymccr | that seems to me to be a var that exists to name space vars | 16:34 |
| andymccr | and then you use group_vars to glue them | 16:34 |
| andymccr | its kinda like saying if you change the default value of lots of settings it breaks things | 16:35 |
| evrardjp | yeah that could, but I like the idea of simplifying things with only one set :p | 16:35 |
| evrardjp | yeah | 16:35 |
| evrardjp | I think it's a big bug. | 16:35 |
| ivve | bhujay: cool, ill have a looksie | 16:35 |
| *** bhujay has quit IRC | 16:35 | |
| evrardjp | Confirmed and high? | 16:35 |
| andymccr | i dont see how its high really | 16:35 |
| andymccr | i mean if you change your keystone_endpoint vars to be something random they will fail too | 16:35 |
| evrardjp | yeah you're right. | 16:36 |
| andymccr | im not really sure what the fix even is? unless we take all the ceph bits out of the individual roles and make them a playbook | 16:36 |
| andymccr | which probably makes sense | 16:36 |
| evrardjp | yes I think it would make more sense... | 16:36 |
| andymccr | but i think tahts a topic for the PTG :D | 16:36 |
| andymccr | i will put a comment in that bug | 16:37 |
| evrardjp | you can add it then :D | 16:37 |
| evrardjp | ( andymccr : https://etherpad.openstack.org/p/osa-rocky-ptg ) | 16:38 |
| evrardjp | ok next | 16:38 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1729263 | 16:38 |
| openstack | Launchpad bug 1729263 in openstack-ansible "Swift (master) transient tempest failures under centos " [Undecided,New] | 16:38 |
| evrardjp | let's leave it as is | 16:38 |
| evrardjp | move on | 16:38 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1729014 | 16:38 |
| openstack | Launchpad bug 1729014 in openstack-ansible "os_monasca: Pike: roles are pulling down master branch" [Undecided,New] | 16:38 |
| evrardjp | agreed with your comment there hwoarang | 16:39 |
| evrardjp | I don't know what we should do with things that are unmaintained | 16:39 |
| evrardjp | probably mark it as wishlist? | 16:40 |
| hwoarang | yeah | 16:40 |
| evrardjp | ok done | 16:40 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1726936 | 16:40 |
| openstack | Launchpad bug 1726936 in openstack-ansible "Configure rados_connect_timeout with reasonable timeout" [Undecided,Fix released] | 16:40 |
| evrardjp | just marked it fix released, so let's move on | 16:40 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1721554 | 16:40 |
| openstack | Launchpad bug 1721554 in openstack-ansible "os_ceilometer fails without swift installed" [Medium,New] | 16:40 |
| evrardjp | darn, ceilometer again. | 16:40 |
| odyssey4me | I think that monasca issue is already resolved | 16:41 |
| evrardjp | odyssey4me: oh interesting | 16:41 |
| evrardjp | well it's still a whishlist if the role is unmaintained. | 16:41 |
| *** pcaruana has quit IRC | 16:41 | |
| odyssey4me | https://github.com/openstack/openstack-ansible-os_monasca/commit/f58399356fcd3766316c726f6fd397482a191e05 | 16:41 |
| evrardjp | nice :) | 16:41 |
| evrardjp | for ceilometer, I suggest we leave it as is for now. | 16:42 |
| odyssey4me | marking fix released | 16:42 |
| evrardjp | odyssey4me: thanks :D | 16:42 |
| odyssey4me | there is a team working on the monasca stuff around once per cycle to update it | 16:43 |
| evrardjp | oh interesting who is that? | 16:43 |
| odyssey4me | the same team also tends to work on sahara and some other odds and ends | 16:43 |
| evrardjp | Maybe we should tell them to be maintainer of the role, they would get an easier life. | 16:43 |
| odyssey4me | see https://review.openstack.org/#/q/project:openstack/openstack-ansible-os_monasca for recent updates | 16:44 |
| *** ivve has quit IRC | 16:44 | |
| odyssey4me | they kinda do maintain it, just not actively all the time - only when they prep for their upgrades do they start testing and fixing | 16:44 |
| odyssey4me | it's a university I think | 16:45 |
| evrardjp | mmm ok. I think it's a conversation for outside the bug triage | 16:45 |
| evrardjp | If I recall correctly, from Brasil | 16:45 |
| evrardjp | anyway... not helping the triage. Let's move on. | 16:45 |
| odyssey4me | http://stackalytics.com/?module=openstackansible-group&company=universidade%20federal%20de%20campina%20grande | 16:45 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1719517 | 16:45 |
| openstack | Launchpad bug 1719517 in openstack-ansible "Ceilometer policy.json includes python unicode encoding" [Undecided,New] | 16:45 |
| evrardjp | odyssey4me: nice :) | 16:46 |
| evrardjp | I will contact them. | 16:46 |
| odyssey4me | ah, that old chestnut - I thought there was a patch up for that already? | 16:46 |
| evrardjp | nope. | 16:46 |
| evrardjp | it was, and then it broke, and then things again, or am I mistaken? | 16:47 |
| odyssey4me | https://review.openstack.org/507368 | 16:47 |
| odyssey4me | ah yes, as we don't have tests working we need to manually confirm that it works | 16:47 |
| odyssey4me | or we just merge it? | 16:48 |
| evrardjp | haha | 16:48 |
| evrardjp | blind approach. | 16:48 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ceilometer stable/ocata: Initial OSA zuul v3 role jobs https://review.openstack.org/516640 | 16:48 |
| evrardjp | I rechecked. | 16:49 |
| odyssey4me | rebased the adding of tests on top of the patch - maybe it works or helps | 16:49 |
| evrardjp | ok | 16:49 |
| evrardjp | yeah | 16:49 |
| evrardjp | let's see. | 16:49 |
| *** chas has quit IRC | 16:49 | |
| evrardjp | wait. | 16:49 |
| *** chas has joined #openstack-ansible | 16:49 | |
| evrardjp | I thought you'd do the opposite, but fine for me. | 16:50 |
| evrardjp | we'll see. | 16:50 |
| evrardjp | next one | 16:50 |
| evrardjp | #link https://bugs.launchpad.net/openstack-ansible/+bug/1698871 | 16:50 |
| odyssey4me | meh, same-same | 16:50 |
| openstack | Launchpad bug 1698871 in openstack-ansible "[master] [os_gnocchi]Gnocchi role tests failing on installing pip packages" [Undecided,New] | 16:50 |
| evrardjp | fun stuff. | 16:50 |
| evrardjp | always the same kind of trio of winners: telemetry, extra roles, and ceph. | 16:50 |
| odyssey4me | thi s may be old and already fixed? | 16:51 |
| evrardjp | Invalid then | 16:51 |
| odyssey4me | looks like it's working? https://review.openstack.org/#/q/project:openstack/openstack-ansible-os_gnocchi | 16:51 |
| evrardjp | someone can reopn if needed. | 16:51 |
| evrardjp | yeah I kinda fixed master | 16:51 |
| odyssey4me | that said, maybe it's an integrated build issue - but it seems like it's old if alextricity reported it | 16:52 |
| evrardjp | gokhan_: is helping a lot on this one | 16:52 |
| evrardjp | yeah. | 16:52 |
| evrardjp | I'd say it's safe to mark it as invalid for now. | 16:52 |
| odyssey4me | sure | 16:52 |
| odyssey4me | or need more info to reproduce | 16:53 |
| evrardjp | yup incomplete is better. This way it expires. | 16:53 |
| evrardjp | :D | 16:53 |
| evrardjp | ok so. | 16:53 |
| evrardjp | we are done for today. | 16:53 |
| evrardjp | we caught up everything. | 16:53 |
| *** chas has quit IRC | 16:54 | |
| evrardjp | there is one bonus that's not on the triage because I just filed it, but let's skip that for now. | 16:54 |
| evrardjp | so thanks everyone! | 16:54 |
| evrardjp | next week is community meeting | 16:54 |
| hwoarang | yay | 16:54 |
| evrardjp | we'll discuss PTG, focus of the weeks, liaisons can talk about what they want, and we'll also have the floor open for discussions on specs or anything (works with whiskey questions for Dublin) | 16:55 |
| evrardjp | have a good day everyone! | 16:55 |
| hwoarang | you too | 16:55 |
| evrardjp | #endmeeting | 16:55 |
| *** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: https://goo.gl/tTmdgs" | 16:55 | |
| openstack | Meeting ended Tue Jan 23 16:55:28 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:55 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-01-23-15.59.html | 16:55 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-01-23-15.59.txt | 16:55 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-01-23-15.59.log.html | 16:55 |
| odyssey4me | thanks evrardjp | 16:55 |
| hwoarang | andymccr: do you think you can update http://blog.andy.mc.it/osa-dev-env/ to match the latest paths? it seems ~/git/openstack/ is now ~/src/git.openstack.org/ | 16:56 |
| hwoarang | and i am surprised that there is no official documentation for this feature :) | 16:56 |
| *** jbadiapa has quit IRC | 16:56 | |
| hwoarang | or if it is it's well hidden :) | 16:56 |
| *** ivve has joined #openstack-ansible | 16:56 | |
| *** chyka has joined #openstack-ansible | 17:07 | |
| *** rstarmer has quit IRC | 17:11 | |
| *** tacco_ is now known as tacco | 17:12 | |
| *** tacco has quit IRC | 17:12 | |
| *** tacco has joined #openstack-ansible | 17:12 | |
| ivve | is ceilometer service disabled by default? | 17:15 |
| *** yolanda has joined #openstack-ansible | 17:17 | |
| *** cjloader has quit IRC | 17:20 | |
| *** cjloader has joined #openstack-ansible | 17:21 | |
| *** openstacking_123 has joined #openstack-ansible | 17:27 | |
| ivve | meaning the api | 17:28 |
| *** smatzek_ has joined #openstack-ansible | 17:34 | |
| *** gillesMo has quit IRC | 17:34 | |
| *** vnogin has quit IRC | 17:36 | |
| *** idlemind has joined #openstack-ansible | 17:39 | |
| *** yolanda has quit IRC | 17:47 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Properly match the LXC index item to download https://review.openstack.org/536915 | 17:48 |
| odyssey4me | hwoarang evrardjp not sure if you're still around, but ^ is a bug we uncovered today and would appreciate some eyes on | 17:50 |
| *** hamza21 has joined #openstack-ansible | 17:51 | |
| odyssey4me | hwoarang it was kinda rushed in, but yeah - a doc page for it would be nice :) is that you volunteering? | 17:51 |
| odyssey4me | ivve ceilometer no longer has an api | 17:51 |
| odyssey4me | gnocchi, aodh, panko all have API's IIRC - ceilometer now only collects data and pushes it to the other services | 17:52 |
| *** chas has joined #openstack-ansible | 17:53 | |
| ivve | aha | 17:54 |
| ivve | metering in the api access was confusing | 17:54 |
| ivve | (im trying out some metering alarms | 17:54 |
| ivve | ) | 17:54 |
| ivve | its was empty | 17:55 |
| cloudnull | afternoons! | 17:57 |
| *** chas has quit IRC | 17:57 | |
| ivve | hey:) | 17:58 |
| *** SerenaFeng has quit IRC | 18:04 | |
| openstackgerrit | Taseer Ahmed proposed openstack/openstack-ansible-os_congress master: Introduce os_congress role in gerrit https://review.openstack.org/522491 | 18:06 |
| *** rstarmer has joined #openstack-ansible | 18:11 | |
| *** vnogin has joined #openstack-ansible | 18:11 | |
| *** vnogin has quit IRC | 18:16 | |
| *** rstarmer has quit IRC | 18:19 | |
| *** mbuil has quit IRC | 18:19 | |
| *** shardy has quit IRC | 18:22 | |
| *** rstarmer has joined #openstack-ansible | 18:26 | |
| *** smatzek_ has quit IRC | 18:27 | |
| *** yolanda has joined #openstack-ansible | 18:29 | |
| *** indistylo has joined #openstack-ansible | 18:36 | |
| odyssey4me | cloudnull if you have a moment, I'd appreciate some eyes for https://review.openstack.org/536915 | 18:37 |
| cloudnull | odyssey4me: ++ will look right now | 18:43 |
| *** indistylo has quit IRC | 18:44 | |
| odyssey4me | thx | 18:46 |
| cloudnull | odyssey4me: nice find! | 18:47 |
| odyssey4me | ja, was quite an obscure bug | 18:47 |
| odyssey4me | well, pair of bugs | 18:48 |
| *** indistylo has joined #openstack-ansible | 18:49 | |
| *** smatzek has quit IRC | 18:54 | |
| mwynne | Hi guys. Has anyone seen this error before? I'm seeing this in my neutron openvswitch log: http://paste.openstack.org/show/651007/ | 18:54 |
| mwynne | Can anyone help me out here? I've had this deployment running for quite some time, and after rebooting it I'm getting that error. | 18:55 |
| *** smatzek has joined #openstack-ansible | 18:56 | |
| *** smatzek_ has joined #openstack-ansible | 18:58 | |
| *** cjloader has quit IRC | 19:00 | |
| *** cmurphy has joined #openstack-ansible | 19:00 | |
| *** smatzek has quit IRC | 19:00 | |
| *** cjloader has joined #openstack-ansible | 19:00 | |
| mwynne | SamYaple: Any ideas? | 19:01 |
| SamYaple | mwynne: seems kind of like you lost the openvswitch db | 19:01 |
| cmurphy | hwoarang: hey are you still around? I'm wondering if you were able to start verifying https://review.openstack.org/#/c/536869/ ? | 19:01 |
| mwynne | SamYaple: haha, of course. | 19:02 |
| mwynne | SamYaple: Any way of verifying this? | 19:02 |
| mwynne | Or resolving this | 19:02 |
| SamYaple | mwynne: stop openvswitch. purge the database and containers. restart the box (required). then run the playbooks again | 19:04 |
| SamYaple | id try that if youre stuck | 19:05 |
| mwynne | SamYaple: "dpif_netlink|WARN|Generic Netlink family 'ovs_datapath' does not exist. The Open vSwitch kernel module is probably not loaded." | 19:05 |
| mwynne | lsmod | grep openvswitch returns nothing | 19:05 |
| mwynne | maybe I just need to load the module??? | 19:05 |
| SamYaple | maybe. i dont really recall how kolla loads them | 19:06 |
| mgariepy | logan-, are you there? | 19:06 |
| mwynne | SamYaple: Not kolla... OSA | 19:06 |
| SamYaple | oops* openstack-ansible* | 19:06 |
| SamYaple | yea sorry | 19:06 |
| SamYaple | channel confusion :) | 19:06 |
| mgariepy | logan-, are you running ceph luminous with bluestore ? | 19:07 |
| SamYaple | mwynne: lets wind back on my advice for a minute. give me a second to check something | 19:07 |
| mwynne | SamYaple: Yeha, I'm not going to run the playbooks again unless I HAVE to. | 19:08 |
| mwynne | SamYaple: Might have made some progress. Give me a sec here. | 19:08 |
| SamYaple | ok let me know | 19:09 |
| SamYaple | ah nvm. this is the issue i was thinking of, http://www.opencloudblog.com/?p=240 | 19:09 |
| *** smatzek_ has quit IRC | 19:09 | |
| SamYaple | but i dont think its related in this case | 19:09 |
| mwynne | SamYaple: For some reason the openvswitch kernel module wasn't loaded in the host... | 19:09 |
| logan- | o/ mgariepy, yes | 19:09 |
| *** poopcat has joined #openstack-ansible | 19:10 | |
| mgariepy | any issue ? | 19:10 |
| SamYaple | mwynne: hmmm make sure its in /etc/modules | 19:10 |
| SamYaple | though the service should load it | 19:10 |
| SamYaple | i think OSA preloads modules it needs like that | 19:10 |
| odyssey4me | IIRc the modules should be loaded in the play run, but also added to /etc/modules to ensure they load again after a reboot | 19:11 |
| odyssey4me | the load should happen on the host if OVS is in a container though | 19:11 |
| logan- | mgariepy: beware the bluestore osd cache size. for ssd it is defaulted to 3GB. in reality I am rss usage around 5-6GB per osd | 19:11 |
| mwynne | SamYaple: It's not in /etc/modules | 19:12 |
| * odyssey4me summons andymccr for the bluestore discussion. :) | 19:12 | |
| logan- | mgariepy: although I think the latest ceph minor version bump fixed a memory leak in bluestore. we just rolled the new minor version with our meltdown patches last week, let me see where some osds are at now | 19:12 |
| mwynne | SamYaple: Can I just add it to the end of the list | 19:12 |
| *** acormier has joined #openstack-ansible | 19:12 | |
| SamYaple | mwynne: yes, that wont hurt anything | 19:12 |
| *** poopcat1 has joined #openstack-ansible | 19:14 | |
| *** kstev has joined #openstack-ansible | 19:14 | |
| *** vnogin has joined #openstack-ansible | 19:16 | |
| *** poopcat has quit IRC | 19:17 | |
| logan- | mgariepy: so one of the changes we've made is to drop the bluestore ssd cache size to 1GB. all of my ssd osds are currently running in the 1.7-1.9GB rss range | 19:18 |
| logan- | so as long as you budget memory accordingly you will be fine. my suggestion is budget 1.8-2x memory usage per osd from whatever you set the bluestore cache to | 19:19 |
| logan- | stability and performance are good, have not had any issues with luminous/bluestore aside from that. the mgr web status dashboard is a little bit junky still. i still always use https://github.com/Crapworks/ceph-dash instead | 19:21 |
| mgariepy | great thanks for the hints logan- | 19:22 |
| mwynne | SamYaple: Thanks. I'll see if I can get something going now. | 19:23 |
| logan- | oh another thing to watch out for if you're upgrading from ocata mgariepy, check if you use ram/cpu ratio settings in host aggregates instead of nova.conf | 19:23 |
| *** smatzek has joined #openstack-ansible | 19:23 | |
| logan- | if you use host aggregates, read the thread on openstack-operators from last week | 19:24 |
| *** vnogin has quit IRC | 19:24 | |
| mgariepy | yeah I saw that | 19:24 |
| logan- | the most painful part of ocata for us by far has been nova-scheduler causing oom's on computes due to that | 19:25 |
| mgariepy | do you overcommit ram ? | 19:26 |
| logan- | no | 19:26 |
| logan- | we undercommit ram using host aggregates | 19:26 |
| mgariepy | ok i'll take a deeper look into that then. | 19:26 |
| logan- | so after upgrading to ocata, that aggregate ram filter is not used in scheduling anymore | 19:26 |
| odyssey4me | ouch | 19:27 |
| logan- | only the nova.conf settings are used by placement, so if you have ratios set in host aggregates then you no longer undercommit! | 19:27 |
| logan- | heh | 19:27 |
| *** vnogin has joined #openstack-ansible | 19:28 | |
| *** RandomTech has quit IRC | 19:28 | |
| *** smatzek has quit IRC | 19:29 | |
| odyssey4me | logan- so how is one supposed to do settings for host aggregates now? | 19:32 |
| odyssey4me | are you using extra groups for ansible and applying different overrides per group? | 19:33 |
| logan- | yes, we have to roll out nova.conf overrides to set the ratios on each compute | 19:33 |
| logan- | no cpu/ram/disk ratios can be set in host aggregates now | 19:34 |
| *** mhayden_ has joined #openstack-ansible | 19:34 | |
| *** mhayden has quit IRC | 19:34 | |
| odyssey4me | I've not seen the operators list post - has there been any feedback about how to do it differently, perhaps with one of the other scheduler filters or whatever? | 19:35 |
| odyssey4me | Or is this the way it is forever? | 19:35 |
| *** phalmos has joined #openstack-ansible | 19:35 | |
| logan- | some ideas are kicking around in there for changes to allow you to submit API calls to the placement service to set the ratios on the resource records for each compute | 19:36 |
| logan- | right now that is not possible because nova-compute has a periodic task that updates the placement service record with ratios sourced from nova.conf | 19:36 |
| logan- | so currently the only way to implement ratios is in nova.conf on each compute host | 19:37 |
| *** smatzek has joined #openstack-ansible | 19:37 | |
| logan- | there may be a switch added to disable that periodic ratio update task so operators can write their own ratios into placement and not have them overwritten | 19:38 |
| odyssey4me | well, at least it's implemented in one place - consistency is useful in complex systems | 19:40 |
| odyssey4me | even if the consistency is a pain | 19:40 |
| *** smatzek has quit IRC | 19:42 | |
| logan- | yeah it all makes capacity management more kludgy imo. moving compute hosts between aggregates with different resource alloc ratios/placement policies is much easier than having to maintain these records for each host. oh well | 19:42 |
| *** smatzek has joined #openstack-ansible | 19:43 | |
| logan- | at least most of the other aggregate filters still work, like the flavor metadata and max instances per host | 19:44 |
| *** germs has joined #openstack-ansible | 19:45 | |
| *** smatzek has quit IRC | 19:47 | |
| *** smatzek has joined #openstack-ansible | 19:49 | |
| *** mhayden_ has quit IRC | 19:49 | |
| *** mhayden has joined #openstack-ansible | 19:50 | |
| *** chas has joined #openstack-ansible | 19:50 | |
| *** phalmos_ has joined #openstack-ansible | 19:50 | |
| *** ykarel is now known as ykarel|afk | 19:50 | |
| *** phalmos has quit IRC | 19:51 | |
| *** indistylo has quit IRC | 19:52 | |
| *** thanmad has joined #openstack-ansible | 19:52 | |
| *** smatzek has quit IRC | 19:53 | |
| *** chas has quit IRC | 19:54 | |
| *** smatzek has joined #openstack-ansible | 19:55 | |
| mwynne | SamYaple: Another quick question for you. Does OSA deploy lxc containers for the l3 and metadata agents on a compute node for DVR? | 19:55 |
| mwynne | Or is it done on the host? | 19:55 |
| *** vnogin has quit IRC | 19:58 | |
| *** smatzek has quit IRC | 19:59 | |
| SamYaple | mwynne: sorry, im not the guy for that question, i dont work with OSA (or Kolla for that matter) much anymore. but my understanding would is on the computes, its not in a container | 19:59 |
| odyssey4me | mwynne it'll be on the host as far as I know | 20:00 |
| *** smatzek has joined #openstack-ansible | 20:01 | |
| thanmad | Ansible-Hardening question - getting fatal on auditd.conf (ubuntu16.04-user:ubuntu) should this be running as a diff user? | 20:01 |
| *** electrofelix has quit IRC | 20:01 | |
| odyssey4me | thanmad not sure about what's going on there, but the role should be run as root | 20:01 |
| odyssey4me | as far as I know at least - not sure if mhayden is around | 20:02 |
| thanmad | cheers, will try to adjust | 20:02 |
| odyssey4me | it may be a good idea to actually have it error out right at the start if it's running as a user which won't work, or alternatively perhaps it should make use of become appropriately | 20:02 |
| odyssey4me | if that's something you want, then I'd suggest registering a bug asking for it | 20:03 |
| *** ykarel|afk has quit IRC | 20:03 | |
| thanmad | sounds good. first time trying from remote host, gotta figure out how to get in as root :) | 20:04 |
| *** rstarmer has quit IRC | 20:05 | |
| mhayden | thanmad: i'm here (but horribly under the weather) | 20:05 |
| mhayden | what did you find with auditd? | 20:06 |
| *** smatzek has quit IRC | 20:06 | |
| *** ykarel|afk has joined #openstack-ansible | 20:06 | |
| *** smatzek has joined #openstack-ansible | 20:13 | |
| mwynne | thanks SamYaple odyssey4me | 20:14 |
| *** chason has quit IRC | 20:16 | |
| *** smatzek has quit IRC | 20:17 | |
| *** smatzek has joined #openstack-ansible | 20:19 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-galera_server master: tasks: galera_post_install: Configure the service before securing the DB https://review.openstack.org/536954 | 20:22 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-galera_server master: SUSE: Switch to upstream MariaDB repository https://review.openstack.org/536955 | 20:22 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-tests master: DNM - Test galera https://review.openstack.org/497241 | 20:23 |
| *** smatzek has quit IRC | 20:23 | |
| *** smatzek has joined #openstack-ansible | 20:24 | |
| *** Jeffrey4l has quit IRC | 20:25 | |
| *** Jeffrey4l has joined #openstack-ansible | 20:25 | |
| *** armaan has quit IRC | 20:27 | |
| *** chason has joined #openstack-ansible | 20:28 | |
| *** armaan has joined #openstack-ansible | 20:28 | |
| *** smatzek has quit IRC | 20:29 | |
| *** hw_wutianwei has quit IRC | 20:31 | |
| *** hw_wutianwei has joined #openstack-ansible | 20:32 | |
| *** smatzek has joined #openstack-ansible | 20:32 | |
| *** germs has quit IRC | 20:35 | |
| *** hamza21 has quit IRC | 20:48 | |
| *** ykarel|afk has quit IRC | 20:59 | |
| thanmad | mhayden: thanks got it sorted. needed to modify the playbook for become: true. rookie mistake | 21:02 |
| thanmad | thx all | 21:03 |
| *** pramodrj07 has joined #openstack-ansible | 21:03 | |
| mhayden | oh okay | 21:03 |
| mhayden | good stuff | 21:03 |
| *** rstarmer has joined #openstack-ansible | 21:05 | |
| *** smatzek_ has joined #openstack-ansible | 21:15 | |
| *** smatzek_ has quit IRC | 21:15 | |
| *** germs has joined #openstack-ansible | 21:17 | |
| *** germs has quit IRC | 21:17 | |
| *** smatzek has quit IRC | 21:23 | |
| *** chas has joined #openstack-ansible | 21:35 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/pike: Cleanup the gate-check-commit dstat part https://review.openstack.org/536868 | 21:36 |
| odyssey4me | mhayden got a minute to peek at https://review.openstack.org/536915 ? | 21:36 |
| odyssey4me | that needs to be pulled back to pike once it merges | 21:36 |
| *** chas has quit IRC | 21:39 | |
| *** dave-mccowan has quit IRC | 21:43 | |
| mhayden | odyssey4me: lookin' | 21:44 |
| * mhayden is behind on reviews today | 21:44 | |
| odyssey4me | tyvm sir | 21:44 |
| odyssey4me | you have plenty of reviews under your belt in stackalytics this cycle, so slacking off for a day is not a worry ;) | 21:44 |
| mhayden | but my queens cloud is humming along | 21:44 |
| mhayden | oh nice catch on that one | 21:45 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-os_magnum master: Fix linting error with systemctl commands https://review.openstack.org/536984 | 21:52 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-os_magnum master: Fix linting error with systemctl commands https://review.openstack.org/536984 | 21:53 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-os_magnum master: Updated from OpenStack Ansible Tests https://review.openstack.org/536430 | 21:53 |
| *** armaan has quit IRC | 21:54 | |
| *** armaan has joined #openstack-ansible | 21:54 | |
| *** armaan has quit IRC | 21:56 | |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-os_trove master: Updated from OpenStack Ansible Tests https://review.openstack.org/536441 | 21:57 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-os_trove master: Use systemctl module for daemon reload https://review.openstack.org/536985 | 21:57 |
| openstackgerrit | Merged openstack/openstack-ansible-os_ceilometer stable/ocata: Remove python unicode encoding from policy.json file https://review.openstack.org/507368 | 21:57 |
| *** armaan has joined #openstack-ansible | 21:57 | |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Remove BOOTSTRAP_ANSIBLE_FOLDER variable https://review.openstack.org/536537 | 22:00 |
| * mhayden is catchin' up | 22:00 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: Correct location of venv build logs https://review.openstack.org/536987 | 22:01 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-os_magnum master: Updated from global requirements https://review.openstack.org/535061 | 22:01 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ceilometer stable/ocata: Initial OSA zuul v3 role jobs https://review.openstack.org/516640 | 22:02 |
| odyssey4me | that gets us a working gate for os_ceilometer on ocata | 22:02 |
| *** dave-mccowan has joined #openstack-ansible | 22:03 | |
| mhayden | yay | 22:05 |
| mhayden | you might say the lack of that was putting a ceil-ing on our efforts | 22:05 |
| * mhayden chuckles | 22:05 | |
| mhayden | odyssey4me: can i trade you for a gander at https://review.openstack.org/534327 ? | 22:07 |
| odyssey4me | not so sure about https://review.openstack.org/527592 mhayden - any idea why those conditions are removed? | 22:08 |
| mhayden | the disabling of the quota part? looks like it's disabled all the time now | 22:08 |
| odyssey4me | no, the rfresh of the image | 22:09 |
| *** jwitko_ has joined #openstack-ansible | 22:09 | |
| odyssey4me | it looks like every run will remove and add it back | 22:10 |
| mhayden | hmm, there's a check for machinectl_mount.rc != 0 at the end | 22:10 |
| mhayden | oh hold on, i was looking at the old systemd prep | 22:11 |
| odyssey4me | both old and new do it - towards the end after the setup | 22:11 |
| mhayden | oh yeah, it does look like the image cache is refreshed each time | 22:12 |
| odyssey4me | not sure if that's intentional or not | 22:13 |
| odyssey4me | if so, it's not explained in the commit msg or anything | 22:13 |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts master: Properly match the LXC index item to download https://review.openstack.org/536915 | 22:13 |
| odyssey4me | well, as far as I could see - it's late, so maybe I'm being dumb | 22:13 |
| *** jwitko has quit IRC | 22:13 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts stable/pike: Properly match the LXC index item to download https://review.openstack.org/536991 | 22:13 |
| * mhayden looks around to find where cache_refresh_del/add are set | 22:13 | |
| odyssey4me | if you could add your vote to that there backport I'd be much obliged :) cc cloudnull if you're still around | 22:14 |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: Adds Neutron OVS DVR Documentation https://review.openstack.org/532798 | 22:15 |
| mhayden | oh, i think i see what's up | 22:15 |
| mhayden | it seems like the conditional should be there | 22:16 |
| * mhayden adds a comment | 22:16 | |
| *** jwitko_ has quit IRC | 22:17 | |
| * mhayden transforms into dad taxi | 22:17 | |
| mhayden | talk to y'all tomorrow | 22:17 |
| *** mhayden has quit IRC | 22:17 | |
| odyssey4me | cheerio! | 22:18 |
| openstackgerrit | Taseer Ahmed proposed openstack/openstack-ansible-os_congress master: Introduce os_congress role in gerrit https://review.openstack.org/522491 | 22:22 |
| *** acormier has quit IRC | 22:34 | |
| openstackgerrit | Merged openstack/openstack-ansible-repo_build stable/pike: Ensure that all release files are cleaned up when rebuilding https://review.openstack.org/536850 | 22:34 |
| *** acormier has joined #openstack-ansible | 22:34 | |
| *** acormier has quit IRC | 22:35 | |
| *** acormier has joined #openstack-ansible | 22:35 | |
| *** dave-mccowan has quit IRC | 22:37 | |
| *** acormier has quit IRC | 22:37 | |
| *** acormier has joined #openstack-ansible | 22:37 | |
| *** esberglu has quit IRC | 22:38 | |
| *** jwitko has joined #openstack-ansible | 22:40 | |
| openstackgerrit | Merged openstack/ansible-hardening master: Use import/include_tasks https://review.openstack.org/534327 | 22:43 |
| *** cmurphy has left #openstack-ansible | 22:44 | |
| *** cjloader has quit IRC | 23:05 | |
| *** acormier has quit IRC | 23:12 | |
| *** acormier has joined #openstack-ansible | 23:13 | |
| *** masber has quit IRC | 23:14 | |
| *** acormier has quit IRC | 23:18 | |
| *** kstev has quit IRC | 23:20 | |
| *** chas has joined #openstack-ansible | 23:23 | |
| *** acormier has joined #openstack-ansible | 23:26 | |
| *** chas has quit IRC | 23:27 | |
| *** acormier has quit IRC | 23:30 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Updated from global requirements https://review.openstack.org/535036 | 23:36 |
| *** oanson has quit IRC | 23:42 | |
| *** openstacking_123 has quit IRC | 23:42 | |
| *** oanson has joined #openstack-ansible | 23:43 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: [WIP] Make the git clone and wheel build optional https://review.openstack.org/537015 | 23:50 |
| *** dave-mccowan has joined #openstack-ansible | 23:51 | |
| *** smatzek has joined #openstack-ansible | 23:53 | |
| *** smatzek has quit IRC | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!