Thursday, 2017-10-19

*** smatzek has quit IRC00:01
*** markvoelker_ has quit IRC00:03
*** markvoelker has joined #openstack-ansible00:09
*** markvoelker has quit IRC00:13
*** jwitko has quit IRC00:16
*** jwitko has joined #openstack-ansible00:16
*** markvoelker has joined #openstack-ansible00:18
*** gouthamr has joined #openstack-ansible00:20
*** markvoelker has quit IRC00:22
*** markvoelker has joined #openstack-ansible00:27
*** thorst has joined #openstack-ansible00:31
cloudnullsnowman4839: you can run the lxc-container-destroy.yml playbook00:31
cloudnullthen remove the /etc/openstack_deploy/openstack-inventory.json file00:32
cloudnullthen its back to vanilla.00:32
*** markvoelker has quit IRC00:32
snowman4839but doesn't that destroy all containers?00:34
snowman4839lets just say I borked galera, if I destroy the galera containers and them remove all mentions of it in inventory, is that sufficent for it to just act like it was never there?00:34
*** kiennt26 has joined #openstack-ansible00:40
*** duonghq has joined #openstack-ansible00:45
*** vnogin has joined #openstack-ansible00:52
*** markvoelker has joined #openstack-ansible00:54
*** woodard_ has joined #openstack-ansible00:55
*** woodard has quit IRC00:55
*** thorst has quit IRC00:57
*** vnogin has quit IRC00:57
*** chyka has joined #openstack-ansible00:58
*** markvoelker has quit IRC00:59
*** masuberu has joined #openstack-ansible01:00
*** chyka has quit IRC01:02
*** masber has quit IRC01:04
*** drifterza has quit IRC01:06
*** markvoelker has joined #openstack-ansible01:12
*** thorst has joined #openstack-ansible01:23
*** drifterza has joined #openstack-ansible01:27
*** thorst has quit IRC01:36
*** masber has joined #openstack-ansible01:44
*** masuberu has quit IRC01:47
*** markvoelker has quit IRC01:47
*** vnogin has joined #openstack-ansible01:53
openstackgerritMerged openstack/openstack-ansible-os_barbican master: Add openstack-ansible-linters test  https://review.openstack.org/51311001:54
openstackgerritMerged openstack/openstack-ansible-haproxy_server master: Regenerate haproxy.cfg on base config changes  https://review.openstack.org/51104601:54
*** vnogin has quit IRC01:58
*** markvoelker has joined #openstack-ansible02:00
*** markvoelker has quit IRC02:05
openstackgerritMerged openstack/openstack-ansible master: Update all SHAs  https://review.openstack.org/51203702:05
*** markvoelker has joined #openstack-ansible02:10
*** markvoelker has quit IRC02:14
*** hw_wutianwei has joined #openstack-ansible02:17
*** masber has quit IRC02:19
*** markvoelker has joined #openstack-ansible02:19
openstackgerritMerged openstack/openstack-ansible-os_cinder master: Add openstack-ansible-linters test  https://review.openstack.org/51311102:21
openstackgerritMerged openstack/openstack-ansible-os_designate master: Add openstack-ansible-linters test  https://review.openstack.org/51311302:21
openstackgerritMerged openstack/openstack-ansible-os_glance master: Add openstack-ansible-linters test  https://review.openstack.org/51311402:21
openstackgerritMerged openstack/openstack-ansible-os_aodh master: Add openstack-ansible-linters test  https://review.openstack.org/51310902:21
openstackgerritMerged openstack/openstack-ansible-os_heat master: Add openstack-ansible-linters test  https://review.openstack.org/51311602:22
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Bypass web server during service setup  https://review.openstack.org/51063302:22
openstackgerritMerged openstack/openstack-ansible-os_horizon master: Add openstack-ansible-linters test  https://review.openstack.org/51311702:22
*** markvoelker has quit IRC02:23
*** markvoelker has joined #openstack-ansible02:28
*** markvoelker has quit IRC02:33
openstackgerritMerged openstack/openstack-ansible-ops master: Update readme to use force flag instead  https://review.openstack.org/51242302:35
*** thorst has joined #openstack-ansible02:37
*** thorst has quit IRC02:42
*** markvoelker has joined #openstack-ansible02:46
*** drifterza has quit IRC02:48
*** jwitko has quit IRC02:50
*** jwitko has joined #openstack-ansible02:50
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Fix Ceilometer deployments  https://review.openstack.org/51322902:51
*** vnogin has joined #openstack-ansible02:54
*** gouthamr has quit IRC02:57
*** vnogin has quit IRC02:59
*** markvoelker has quit IRC03:20
*** gkadam has joined #openstack-ansible03:23
*** markvoelker has joined #openstack-ansible03:25
*** markvoelker has quit IRC03:30
*** germs has quit IRC03:30
*** germs has joined #openstack-ansible03:30
*** markvoelker has joined #openstack-ansible03:34
*** germs1 has joined #openstack-ansible03:36
*** germs has quit IRC03:38
*** thorst has joined #openstack-ansible03:38
*** markvoelker has quit IRC03:39
*** markvoelker has joined #openstack-ansible03:43
*** thorst has quit IRC03:46
*** markvoelker has quit IRC03:48
*** markvoelker has joined #openstack-ansible03:52
*** vnogin has joined #openstack-ansible03:55
*** markvoelker has quit IRC03:57
*** dave-mccowan has quit IRC03:57
*** nwonknu has quit IRC03:57
*** Tahvok has quit IRC03:57
*** bauruine has quit IRC03:57
*** vnogin has quit IRC03:59
*** markvoelker has joined #openstack-ansible04:02
*** poopcat has quit IRC04:02
*** Tahvok has joined #openstack-ansible04:02
*** bauruine has joined #openstack-ansible04:03
*** markvoelker has quit IRC04:06
*** germs1 has quit IRC04:08
*** nwonknu has joined #openstack-ansible04:10
*** markvoelker has joined #openstack-ansible04:10
*** markvoelker has quit IRC04:15
*** markvoelker has joined #openstack-ansible04:20
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Fix Ceilometer deployments  https://review.openstack.org/51322904:31
*** jbadiapa_ has joined #openstack-ansible04:43
*** jbadiapa has quit IRC04:46
*** kiennt26 has quit IRC04:46
*** jbadiapa_ has quit IRC04:53
*** markvoelker has quit IRC04:54
*** vnogin has joined #openstack-ansible04:56
*** vnogin has quit IRC05:00
*** markvoelker has joined #openstack-ansible05:08
*** newmember has quit IRC05:11
*** newmember has joined #openstack-ansible05:11
*** markvoelker has quit IRC05:12
*** masber has joined #openstack-ansible05:15
*** markvoelker has joined #openstack-ansible05:17
*** masuberu has joined #openstack-ansible05:17
*** masber has quit IRC05:19
*** markvoelker has quit IRC05:22
*** chyka has joined #openstack-ansible05:22
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Consolidate cached container methods  https://review.openstack.org/51326505:23
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create master: Fix BTRFS package name  https://review.openstack.org/51315705:23
*** markvoelker has joined #openstack-ansible05:26
*** chyka has quit IRC05:26
*** markvoelker has quit IRC05:29
*** markvoelker has joined #openstack-ansible05:29
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Consolidate cached container methods  https://review.openstack.org/51326505:32
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create master: Fix BTRFS package name  https://review.openstack.org/51315705:34
*** woodard_ has quit IRC05:36
*** thorst has joined #openstack-ansible05:42
*** markvoelker has quit IRC05:42
*** markvoelker has joined #openstack-ansible05:42
*** markvoelker has quit IRC05:42
*** thorst has quit IRC05:47
*** snowman4839 has quit IRC05:55
*** vnogin has joined #openstack-ansible05:56
*** snowman4839 has joined #openstack-ansible05:58
*** vnogin has quit IRC06:01
*** woodard has joined #openstack-ansible06:08
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Fix Ceilometer deployments  https://review.openstack.org/51322906:10
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Fix Ceilometer deployments  https://review.openstack.org/51322906:11
*** rich1iu has joined #openstack-ansible06:14
*** yolanda has quit IRC06:15
openstackgerritMerged openstack/openstack-ansible-repo_server master: Add openstack-ansible-linters test  https://review.openstack.org/51313506:17
*** Oku_OS-away is now known as Oku_OS06:18
*** cshen has quit IRC06:21
*** drifterza has joined #openstack-ansible06:28
*** drifterza has quit IRC06:30
*** drifterza has joined #openstack-ansible06:35
*** drifterza has quit IRC06:39
rich1iuone question , is it possible to run openstack-ansible on arm64 platform ?06:39
*** drifterza has joined #openstack-ansible06:40
*** drifterza has quit IRC06:40
*** cshen has joined #openstack-ansible06:45
*** drifterza has joined #openstack-ansible06:48
*** drifterza has quit IRC06:48
*** drifterza has joined #openstack-ansible06:49
*** markvoelker has joined #openstack-ansible06:49
*** kiennt26 has joined #openstack-ansible06:51
*** drifterza has quit IRC06:53
*** drifterza has joined #openstack-ansible06:53
*** drifterza has quit IRC06:54
*** vishwana_ has joined #openstack-ansible06:54
*** vishwanathj has quit IRC06:54
*** mbuil has joined #openstack-ansible06:55
*** gunix has joined #openstack-ansible06:55
gunixhow many hosts do you recommand for a POC?06:55
*** pcaruana has joined #openstack-ansible06:55
*** drifterza has joined #openstack-ansible06:56
gunixwould 3 controllers, 2 computes, 1 block storage, 2 object storage be ok ?06:56
*** drifterza has left #openstack-ansible06:56
*** drifterza has joined #openstack-ansible06:56
*** vnogin has joined #openstack-ansible06:57
*** vishwanathj has joined #openstack-ansible06:58
*** vishwana_ has quit IRC06:59
SamYaplegunix: it would be ok for a POC yes, assuming block storage is lvm07:00
SamYaplegunix: i would recommend 3 object storage thouhg, you can collocate that on the controllers however07:00
gunixSamYaple: i have no ideea what openstack-ansible deploys for the storage node :D07:00
SamYaplegunix: you can use ceph or lvm as teh common ones. there are a number of plugins that OSA supports though07:01
gunixSamYaple: i would practice with separate storage nodes07:01
gunixSamYaple: can you do any sort of multipath using lvm ?07:01
SamYapleyou can, im not sure if OSA supports that. youd have to look/wait for someone in the channel who knows07:01
SamYapleim a ceph guyh myself07:02
*** vnogin has quit IRC07:02
gunixSamYaple: do you know any good online tutorial for ceph? i tried it once but i failed to deploy07:05
*** drifterza has quit IRC07:07
*** drifterza has joined #openstack-ansible07:07
*** drifterza has quit IRC07:08
*** newmember has quit IRC07:18
*** newmember has joined #openstack-ansible07:19
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Include the Ansible version variable when installing ara  https://review.openstack.org/51328707:21
SamYaplegunix: OSA uses ceph-ansible, so i would start there07:22
*** taseer1 has joined #openstack-ansible07:22
*** taseer2 has joined #openstack-ansible07:23
*** Taseer has quit IRC07:23
cloudnullgunix: yes we have the ability work with multipath storage and nova07:24
cloudnullhttps://docs.openstack.org/openstack-ansible-os_nova/pike/configure-nova.html#multipath07:24
*** jbadiapa has joined #openstack-ansible07:24
cloudnullthe trick would be ensuring it all will work with arm64 from a compute stand point, which it should assuming you're working with qemu/kvm07:26
cloudnullhttps://github.com/openstack/openstack-ansible-os_nova/tree/master/tasks/drivers07:26
SamYapleo/ cloudnull07:26
cloudnullthough I don't know anyone doing this with arm at the moment so there may be underlying issues we've not accounted for.07:26
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_ceilometer master: [DNM] Quick Attempt to fix ceilometer  https://review.openstack.org/51305107:26
cloudnullo/ SamYaple07:26
cloudnullhows it going brother?07:26
SamYapleim actually off for the night, but going pretty good over all07:27
SamYapleyourself?07:27
*** taseer1 has quit IRC07:27
cloudnullevrardjp: https://review.openstack.org/#/c/513229/ -- re ceilometer issues07:27
cloudnullSamYaple: fair to midland07:27
cloudnullthreatening to go to sleep07:27
SamYaplei wont make it to sydney, got other travel going on. but maybe we can catch up in Dublin? for the next ptg07:28
cloudnullbut i think i have a few more min in me :D07:28
*** taseer2 is now known as Taser07:28
SamYaplenice07:28
*** Taser is now known as Taseer07:28
SamYapleive hit the mental wall07:28
cloudnullwe do need to go get some BBQ !07:28
evrardjpoh I didn't intend to fix ceilometer, just to make sure it can pass some standard ansible stuff :p07:28
SamYapleindeed07:28
evrardjpI will have a look cloudnull07:28
evrardjpI have removed the -2 we discussed yesterday too07:28
evrardjpand hello cloudnull SamYaple!07:29
evrardjp:p07:29
SamYaplehello evrardjp!07:29
SamYaplegoodnight evrardjp!07:29
cloudnulltake care SamYaple07:29
evrardjpyup!07:29
evrardjptake care!07:29
evrardjp:)07:29
cloudnullevrardjp: if you have a moment, https://review.openstack.org/#/c/513287 I'm seeing this in pike07:30
cloudnullI wanted ara 0.14 and in a local deployment i have and it installed ansible 2.4.0 which breaks everything07:30
evrardjpoh yeah you introduced a fix!07:32
evrardjpyeah I think I filed a bug for that07:32
evrardjpoh it's not only there07:32
cloudnullorly?07:32
evrardjpyeah07:32
evrardjpin role tests07:32
evrardjpif you run run_tests twice07:33
evrardjpeven if ansible and ara is already installed, it checks ara==0.14 and sees ansible>=...07:33
evrardjpand then installs 2.407:33
evrardjpmaybe we should constraint ara.07:33
*** DanyC has joined #openstack-ansible07:34
evrardjpansible*07:34
evrardjpcloudnull: for my understanding, just adding ansible fix the thing?07:35
evrardjplet me try that on my machine I am surprised07:35
cloudnullevrardjp: yup07:37
cloudnulljust adding ansible in fixed it07:37
evrardjpinteresting07:37
evrardjpvalidating07:37
cloudnullwell it was the ansible version var07:37
cloudnullso it came out as something like ansible==2.3.2.007:37
*** DanyC_ has quit IRC07:37
cloudnullbut yes. that fixed it for me07:37
evrardjpwe should add a comment there07:37
evrardjpyes seem to work for me07:38
evrardjpwait07:38
evrardjpweird stuff07:38
evrardjpI uninstalled ara, and reinstalled ara07:38
evrardjpwith ansible already installed07:38
evrardjpby doing pip install ara==0.1407:39
evrardjphe didn't try to reinstall ansible07:39
evrardjpwhich is weird07:39
evrardjpI wonder how to reproduce that then07:39
evrardjpI think I will be happier when we'll build a pre-packaged stuff.07:41
evrardjpin the meantime you got my vote if that fixed it for you.07:42
*** thorst has joined #openstack-ansible07:43
evrardjphwoarang: thanks on the dashboard update!07:45
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-tests master: Constrain ansible when installing ARA  https://review.openstack.org/51329807:45
cloudnullevrardjp: ^ that should fix it in tests too07:45
cloudnullwe've already got an ansible constraint file in tests so simply using that when we install aara will limit its options07:46
evrardjpyeah07:47
evrardjpI didn't remember that file07:47
evrardjpgreat07:47
*** thorst has quit IRC07:47
cloudnullfeel free to update those commits w/ the bug ID if you ahve it handy, or ping it to me when you find it.07:48
cloudnullotherwise I'm crashing.07:48
cloudnull:D07:48
cloudnullsee you in a few hours o/07:49
evrardjpyeah take care!07:51
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-tests master: Constrain ansible when installing ARA  https://review.openstack.org/51329807:52
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Add BTRFS cached container task  https://review.openstack.org/51326507:52
openstackgerritMerged openstack/openstack-ansible-galera_server master: Add option to disable xtrabackup compression  https://review.openstack.org/50433307:56
*** markvoelker has quit IRC08:01
*** DanyC_ has joined #openstack-ansible08:01
gunixcloudnull: nice!08:01
gunixcloudnull: thank you for the info regarding multipath08:01
*** DanyC has quit IRC08:04
openstackgerritMerged openstack/openstack-ansible-os_molteniron master: Add openstack-ansible-linters test  https://review.openstack.org/51312108:13
openstackgerritMerged openstack/openstack-ansible-pip_install master: Add openstack-ansible-linters test  https://review.openstack.org/51313008:15
openstackgerritMerged openstack/openstack-ansible stable/pike: Updated repo cloner for zuulv3  https://review.openstack.org/51247508:18
*** pbandark has joined #openstack-ansible08:20
*** vnogin has joined #openstack-ansible08:27
*** vnogin has quit IRC08:32
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-repo_server stable/pike: [DNM] test gates  https://review.openstack.org/51330908:33
*** yolanda has joined #openstack-ansible08:34
*** armaan has joined #openstack-ansible08:45
openstackgerritMerged openstack/openstack-ansible-os_zaqar master: Add openstack-ansible-linters test  https://review.openstack.org/51312908:47
openstackgerritMerged openstack/openstack-ansible-os_rally master: Add openstack-ansible-linters test  https://review.openstack.org/51312308:49
*** electrofelix has joined #openstack-ansible08:58
*** chyka has joined #openstack-ansible08:58
*** chyka has quit IRC09:03
*** vnogin has joined #openstack-ansible09:12
openstackgerritMerged openstack/openstack-ansible-os_trove master: Add openstack-ansible-linters test  https://review.openstack.org/51312709:16
*** yolanda has quit IRC09:16
*** yolanda has joined #openstack-ansible09:18
*** armaan has quit IRC09:23
*** armaan has joined #openstack-ansible09:23
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-apt_package_pinning stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51332609:26
odyssey4merich1iu yes, multiple hardware architectures are supported - and IIRC someone has implemented changes to support arm specifically09:26
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-ceph_client stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51332809:26
odyssey4meevrardjp don't do any more job changes until the current ones have made their way through zuul09:26
odyssey4mezuul is sitting at 12GB/15GB RAM usage09:27
evrardjpOMG. you're kidding?09:27
odyssey4mehttp://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=63979&rra_id=all09:27
odyssey4mewe crashed zuul twice yesterday with all our changes09:27
evrardjpmmm. So I keep my changes pending?09:27
evrardjpI am glad I manually reviewed them09:28
*** duonghq has quit IRC09:28
evrardjpso what should I do then?09:28
evrardjpIf I can't work on each of the roles09:28
evrardjpI can't work on the proposal bot09:28
odyssey4meproposal bot is known as not working, infra was working on various things related to it last night09:29
evrardjpwell I will try to work on that quick, but I guess the proposal bot will burn zuul v3 ...09:29
evrardjpodyssey4me: yeah I know Andreas was working on it, but he is not checking on our jobs, I don't know if you heard a different story09:29
evrardjpbut right now there is NO testing on other branches than master.09:30
evrardjpthat's why I wanted to add patches...09:30
evrardjpok I will work on the queens M109:31
evrardjpoh no, no need, releases is blocked too.09:31
*** vnogin has quit IRC09:33
odyssey4meyes, releases is blocked because of the issue with signing, which relates to the proposal bot09:33
odyssey4mein other words, be patient09:33
evrardjpok will fix centos swift.09:34
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Constrain ansible when installing ARA  https://review.openstack.org/51329809:36
odyssey4me^ adjusted that to work in more than just the tests repo09:36
*** yifei has quit IRC09:39
evrardjpthanks09:41
openstackgerritMerged openstack/openstack-ansible-os_gnocchi master: Add openstack-ansible-linters test  https://review.openstack.org/51311509:43
openstackgerritMerged openstack/openstack-ansible-os_ironic master: Add openstack-ansible-linters test  https://review.openstack.org/51311809:43
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Add openstack-ansible-linters test  https://review.openstack.org/51311909:43
openstackgerritMerged openstack/openstack-ansible-os_watcher master: Add openstack-ansible-linters test  https://review.openstack.org/51312809:43
*** thorst has joined #openstack-ansible09:44
odyssey4meevrardjp I can't decide whether make the gate pipeline share a queue was a good idea or not09:45
odyssey4mepreviously we had independent queues - so every repo merged of its own accord, only testing with whatever was available and merged at the time of testing09:46
evrardjpI don't understand09:46
evrardjpoh09:46
evrardjpwhat was the reason to share the same queue?09:47
odyssey4menow that they share a queue for merging, each role patch goes into the same queue - in other words they are all tested together, and if one fails it is taken out of the line09:47
odyssey4meit increases the quality of testing, which is why I did it -it makes sure that all patches in the gate queue are tested together - not seperately09:47
evrardjpshas are relevant for us09:48
evrardjpthis doesn't increase the quality09:48
odyssey4mebut it does mean that each test waits for the one ahead of it to pass before it can merge, and it that one fails, the tests restart09:48
evrardjpbut it doesn't decrease it either09:48
*** thorst has quit IRC09:49
evrardjpdid infra ask for that?09:49
evrardjpto relieve the load?09:49
odyssey4methe shared queue is how nova/cinder/neutron/etc process their gate - testing changes made in each repo together09:49
odyssey4meno, infra did not ask for it - I thought it was a good idea and added it09:49
odyssey4megiven, it's only showing up as an issue because we have a lot of patches in the queue09:50
evrardjpI'd like to at least be informed of those changes09:50
evrardjpin the future09:50
odyssey4meyou were - you reviewed the patches ;)09:50
evrardjpnot with the full context then09:50
evrardjpbut ok that's my fault09:50
odyssey4mebut yeah, sure - it's not like we had much time to discuss right09:50
*** yolanda has quit IRC09:51
evrardjpno it's alright, it means I badly reviewed. It happens sometimes.09:51
evrardjp:p09:51
odyssey4meI should not have added it, actually. I changed what was previously there without really discussing it.09:51
evrardjphumans after all :)09:51
odyssey4meanyway, too late now09:51
evrardjpnah it's alright :)09:51
evrardjpis it possible to revert easily?09:52
odyssey4mehmm, actually - I think it's the job only - so only tests repo09:52
odyssey4meoh no - it's a change to every repo: https://github.com/openstack/openstack-ansible-tests/blob/master/zuul.d/project.yaml#L2509:52
evrardjpwhile you are here, should we discuss the job names? With what we started to discuss yesterday09:52
evrardjpto trigger from outside easily09:53
*** taseer1 has joined #openstack-ansible09:53
*** Taseer has quit IRC09:53
*** taseer2 has joined #openstack-ansible09:54
evrardjpor alternatively, is there a way to say from keystone repo, use osa generic update job _ON THIS repo_09:54
odyssey4meeasy enough - openstack-ansible-keystone-upgrade, then have the required repositories for it.... I just don't know exactly how to make it use our repo as the primary for the test09:54
odyssey4mewhat we might have to do is setup a workspace in the job, with a symlink to our repo, then go from there09:55
*** armaan has quit IRC09:55
evrardjpwith this job name, maybe the whole thing is smart09:55
evrardjpinstead of openstack-ansible-upgrade-ubuntu-xenial09:55
*** armaan has joined #openstack-ansible09:55
odyssey4meactually, I think we're confusing everything - it should just work as expected, as long as we change where we expect keystone to be09:55
*** hw_wutianwei has quit IRC09:55
odyssey4meI don't think it's crucial to work on now anyway.09:56
odyssey4meI need to focus on other work today and tomorrow, but can help out again this evening.09:57
evrardjpI'll speak with the team and tell them our status09:57
evrardjpthis way they are at least informed09:57
evrardjpyeah09:57
odyssey4mein terms of the changes to jobs - only submit around 5 at a time, and let them complete processing before submitting another batch09:57
evrardjpfocus on your day work. don't worry :p09:57
odyssey4meso prioritise the repositories you want tests in, do the urgent ones first09:57
evrardjpok09:58
odyssey4methis has 5 min update intervals: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=63979&rra_id=all09:58
*** taseer1 has quit IRC09:58
evrardjpmain repo, tests and neutron all branches basically.09:58
evrardjpand keystone09:58
odyssey4meif the used memory goes up to the max (16GB), then zuul will hang and we will have to recheck them all, 5 at a time... so try to avoid that09:59
ansiblerodyssey4me, thanks for suggesting removing non OSA roles from /etc/ansible/roles yesterday - it helped and I got over openstack-ansible setup-infrastructure.yml.09:59
odyssey4meso yeah, I would think focus on the defcore roles and infra roles09:59
evrardjpWorking only 5 at a time is gonna teach me patience.09:59
odyssey4meand any roles that have patches pending09:59
ansiblerThough now stuck in openstack-ansible setup-openstack.yml https://pastebin.com/raw/szPA1nEB  Have grep'd /etc and /opt for different ceph paterns but cannot understand what's wrong. Double use of same key?09:59
evrardjpodyssey4me: I just want to get master in the right state right now. For example we could think keystone is fine, but it's not. upgrade is still doing ocata10:00
evrardjpit's been 3 weeks I am trying to merge this _fully working_ patch10:01
evrardjpI can work on the 2.4 support too10:02
odyssey4mewell, if there are troublesome tests due to other issues at play, perhaps switch them to non-voting so that we can get tests established and working again10:02
odyssey4mewe can always submit another patch to make a non voting test voting10:02
evrardjpthat is true.10:02
odyssey4methen use that to buy time10:02
evrardjpbut they are technically passing, so why disabling them? It's just temporary issues10:02
odyssey4metemporary issues for three weeks - sounds to me like they might be transient, but they're not temporary10:03
evrardjpanyway, I understand the gist, and can restructure my work.10:03
evrardjpI didn't know the difference, let me google that.10:03
odyssey4mealso, non voting doesn't mean that we ignore the results - it just means that it's not required to merge the patch10:03
evrardjpI know that... :)10:04
odyssey4melet's try to get them merged as-is for another day10:04
*** kiennt26 has quit IRC10:04
odyssey4meif they don't work, then this evening we can chat with a broader group to discuss what to do about it10:05
odyssey4mecould you review https://review.openstack.org/512746 to get it out of the queue10:06
odyssey4meoh yeah, by the way - that tempest test I put up last night is one of the causes of failures I've seen quite often10:07
odyssey4methe other one is the git issue - I have a plan there and will do a patch for it later10:07
evrardjpgoogle didn't really help me on the difference between temporary and transient.10:08
evrardjpwhat are you talking about?10:08
odyssey4metemporary is just that, it's there - but it will go away soo10:08
evrardjptempest? is that the swift issue?10:08
odyssey4me*soon10:08
evrardjptransient seem to be the same thing10:08
odyssey4metransient is sometimes there, sometimes not10:08
odyssey4meit's less deliberate10:09
evrardjpaccording to google, but that's not oxford10:09
evrardjpok10:09
odyssey4meoh sure, but that's the intent of my meaning10:09
evrardjpok understood10:09
odyssey4metemporary is something like a workaround - you control when it's there and when it goes10:09
evrardjpso what did you say with the git and tempest?10:09
evrardjpmost of our issues right now are with the lxc images10:10
odyssey4meso there are a few problems I've seen popping up in job failures10:10
evrardjpI am not aware of git ones10:10
odyssey4meone is that tempest fails to download its image10:10
evrardjpoh yeah, but I voted on this patch I think10:10
odyssey4methat should be solved by https://review.openstack.org/51320010:10
evrardjpisn't it merged yet?10:10
evrardjpoh yeah, we are waiting for tempest to pass the first thing.10:10
odyssey4meyou're right to hold it back by the way - I have not functionally tested it10:10
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest master: Use the deployment host to download images for tempest  https://review.openstack.org/51320010:11
evrardjpI am not in a place where I want to pay the price of a blind merge10:11
odyssey4meit's now rebased on the thing with jobs, so it will test10:11
evrardjpyou rebased on top?10:11
evrardjpok10:12
evrardjpgood10:12
odyssey4meI'm not asking you to - I'm saying that we shouldn't blind merge it. It needs to be tested because I wrote it blind and it's a big change.10:12
odyssey4meright, another issue I've seen is that when the roles git clone, they fail.10:12
odyssey4methe way around that is going to be to implement a 'pre' stage in our job, because the 'pre' stage gets retried three times before failing10:13
*** rodolof has joined #openstack-ansible10:13
odyssey4meanother issue I've seen is more centos/suse specific - I've seen repo updates just hang until timeout10:14
odyssey4meI asked whether there was a local infra suse repo or reverse proxy last night, but didn't get an answer. I think that might be worth persueing.10:15
hwoarangodyssey4me: let me know if you find anything. I have been running local and opnfv tests over and over but I haven't seen any timeouts myself :(10:16
odyssey4mehwoarang yeah, I suspect it may just be a transient issue which yum doesn't handle very well10:17
odyssey4meperhaps something that nothing can handle well10:17
odyssey4mefor example, it could be some sort of packet loss due to a bad route appearing10:17
*** ansibler has quit IRC10:18
odyssey4meyour approach to using an async task for the cache prep was quite clever, I thought10:18
hwoarangodyssey4me: evrardjp: right i am seeing https://review.openstack.org/#/c/496679/ but the async task failed as expected10:19
hwoaranghowever it seems no logs were collected :/10:19
hwoarangi wonder why...10:19
evrardjpyeah the async you added is great.10:20
odyssey4meright, that's an issue we can solve now10:20
evrardjpkilling the job10:20
odyssey4meso, much like we could do the git cloning in the 'pre' stage... we can now also do the log collection in the 'post' stage10:20
evrardjpI'd love it to not fail transiently in infra at first, but that's for another time :)10:20
odyssey4methe post stage is always run, regardless of whether the job passed or failed10:21
evrardjpthat seems good.10:21
hwoarangodyssey4me: do i understand correctly that we miss something in the post step to collect logs?10:21
evrardjpnext community meeting has a point on the agenda to discuss what to keep from logs10:21
odyssey4meso, we're in a place where we can split the one step test run into three steps and have infra execute them slightly differently10:21
odyssey4mehwoarang yeah, right now we only have a run step10:21
evrardjpyeah, the git clone in pre-steps is good.10:22
evrardjpand the prepa of ansible10:22
evrardjpthen we just run stuff10:22
odyssey4mehttps://github.com/openstack/openstack-ansible-tests/blob/master/zuul.d/jobs.yaml#L4610:22
odyssey4methat's all we do10:22
* hwoarang is taking mental notes10:23
odyssey4meso my general plan is to work on splitting up the way the test runs into pre/run/post stages and to have our job use them that way10:23
odyssey4meevrardjp one thing we could also consider is removing the use of containers from roles that do not need to use them - they add a lot of overhead in terms of the setup process10:24
hwoarangmaybe i can submit a patch to use the opensuse mirrors instead of the infra ones. I can't even remember if we use the openstack mirrors. I need to see the logs once they are available10:24
odyssey4meif all a job is doing is setting up a single container - it may as well use the host10:24
evrardjpodyssey4me: I agree, that was my plan10:24
evrardjpI am still working on the everything on metal when I have a few minutes with no infra burning.10:25
odyssey4mehwoarang I was wondering whether there are suse mirrors in infra10:25
hwoarangi am not sure...10:25
odyssey4mehwoarang I don't see anything here to set a mirror for suse: https://github.com/openstack/openstack-ansible-tests/blob/b068c49acabd969b78355d773390edc0094d8235/common-tasks/test-set-nodepool-vars.yml10:25
odyssey4meperhaps that'd be a good thing to make work!10:25
hwoarangplus we stopped collecting /etc/* files it seems so i can't easily check what mirrors are being used10:25
hwoarangodyssey4me: i think the dib images that are loaded by infra are using the infra mirrors10:26
hwoarangand i dont think i wipe them10:26
odyssey4mefor that, I'd suggest that we targz the etc contents as they were so that we can still get them, it just requires a download10:26
hwoarangyeah that would be helpful10:26
odyssey4mehwoarang ah ok10:26
* hwoarang is rushing to lunch will be back asap10:27
evrardjpodyssey4me: agreed. fungi has suggested to still reduce what we need to log there10:27
evrardjpI agree with him10:27
odyssey4meevrardjp oh sure, there is a lot in there which is not relevant most of the time10:27
evrardjpexactly10:27
odyssey4meanother way to do it could be to only collect on failure10:28
evrardjpso I thought we could add to a tar the folders we want10:28
openstackgerritMerged openstack/openstack-ansible-os_tacker master: Initial OSA zuul v3 role jobs  https://review.openstack.org/51274610:30
evrardjpswift works perfectly fine on my machine...10:30
openstackgerritMerged openstack/openstack-ansible-os_magnum master: Add openstack-ansible-linters test  https://review.openstack.org/51312010:33
openstackgerritMerged openstack/openstack-ansible-plugins master: Add openstack-ansible-linters test  https://review.openstack.org/51313210:33
*** rodolof has quit IRC10:34
odyssey4mehmm, that's not good: http://logs.openstack.org/00/513200/3/check/openstack-ansible-functional-ubuntu-xenial/4bcc12c/job-output.txt.gz#_2017-10-19_10_25_46_84115210:34
*** rodolof has joined #openstack-ansible10:35
evrardjpodyssey4me: what are you trying to say?10:35
evrardjpyes we have that all over the place, but do you know why it fails?10:35
odyssey4meall tests for the patch failed with the same issue - the download took too long10:35
odyssey4mewell, the async task took too long10:36
odyssey4methat obviously needs debugging10:36
odyssey4meis this happening consistently, or only sometimes?10:36
evrardjptransient :)10:36
evrardjpsometimes this takes like 5 minutes10:36
*** taseer2 is now known as Taseer10:36
evrardjpsometimes this takes like 30 minutes.10:37
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Initial OSA zuul v3 role jobs  https://review.openstack.org/51274710:38
evrardjpwoot!10:39
evrardjp^ milestone reached!10:39
evrardjphwoarang: did you see the log that odyssey4me has shown10:40
evrardjpI think we should rollback to 118 :p10:40
evrardjplet me try locally10:40
evrardjpodyssey4me: on my machine this lxc download takes less than 5 seconds.10:40
odyssey4meok, so hwoarang's patch is doing the right thing - obviously it works sometimes10:40
odyssey4meat least this gets us a fail - it's progress10:41
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Add openstack-ansible-linters test  https://review.openstack.org/51312210:42
odyssey4memaybe https://review.openstack.org/512386 will help?10:44
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_neutron stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51334410:45
odyssey4meevrardjp do you want to remove the common queue from the backports?10:46
evrardjpoh yeah10:47
evrardjpI should give it a different name right?10:47
evrardjplet me patch that quick10:47
odyssey4meno, just remove the line10:47
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_neutron stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51334410:47
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_neutron stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51334410:48
odyssey4meyes, that's right10:48
odyssey4medo the same for https://review.openstack.org/513328 and https://review.openstack.org/513326 ?10:49
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-apt_package_pinning stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51332610:49
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-ceph_client stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51332810:49
evrardjpI'd prefer start the whole batch, come back later this way I can do other work, but we are definitely out of ram now.10:50
odyssey4meyep10:50
evrardjpthis isn't sustainable10:51
evrardjpI like zuul v3, and all its features, but right now I'd prefer to have v2.10:52
*** yifei has joined #openstack-ansible10:52
odyssey4meinfra will work on making it better10:52
evrardjpask me that in a few hours when I'll have eaten, another answer!10:52
odyssey4mehaha, hangry is real10:53
evrardjpso true.10:53
evrardjpand you know I am quite a hobbit.10:56
evrardjpdo you think we can simply backport those changes into O and N?10:56
*** stuartgr has joined #openstack-ansible10:59
odyssey4menot as-s, but almost10:59
rich1iuodyssey4me: thanks, I will try it.11:00
odyssey4meocata has centos support, but no suse support11:00
odyssey4meas it stands right now, I think that perhaps we should just skip centos/suse for ocata/newton11:00
odyssey4menewton also needs trusty tests11:00
gunixhttps://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/deploymenthost.html11:01
gunixno repo for ubuntu 16.04 ?11:01
odyssey4megunix what do you mean?11:01
openstackgerritKevin Lefevre proposed openstack/openstack-ansible-os_nova master: Enable KSM support for Nova  https://review.openstack.org/50786211:02
gunixnevermind, stupid question. i expected to see the openstack repo fro pike11:02
gunixbut it's probably somewhere else11:02
openstackgerritTaseer Ahmed proposed openstack/openstack-ansible master: (WIP) Integrate Congress with OSA.  https://review.openstack.org/50397111:02
odyssey4megunix we add it automatically in the right places for you11:02
Taseerevrardjp: I made some changes to congress tests. I rebased the patch, but it did not seem to trigger the pipelines11:05
odyssey4meTaseer zuul is almost out of memory so it might take a while11:06
Taseerodyssey4me: okay, I'll wait then. Thanks11:06
odyssey4meTaseer I see your change in the queue though11:06
odyssey4mebottom left of http://zuulv3.openstack.org/11:07
TaseerYes, I find it11:10
*** smatzek has joined #openstack-ansible11:12
*** DanyC_ has quit IRC11:13
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_neutron stable/pike: Add git and iptables to the list of packages  https://review.openstack.org/51263111:20
*** cshen_ has joined #openstack-ansible11:25
*** markvoelker has joined #openstack-ansible11:27
*** cshen_ has quit IRC11:29
*** armaan has quit IRC11:31
*** armaan has joined #openstack-ansible11:32
*** chyka has joined #openstack-ansible11:33
*** smatzek has quit IRC11:33
*** cshen_ has joined #openstack-ansible11:34
gunixhttps://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/deploymenthost.html11:37
*** chyka has quit IRC11:37
gunixwhy is here the branch 16.0.1 suggested?11:37
gunixcan't i just git clone without -b?11:37
gunixthe tutorial is for 16.0.2 :D11:38
*** armaan has quit IRC11:43
odyssey4megunix because that's the latest released tag12:06
gunixand the head is testing, i guess12:06
odyssey4meif you clone the head of the branch, you get the next proposed version12:06
gunix?12:06
gunixok, thank you!12:06
odyssey4meyes, we typically release every two weeks - giving that time in between to test and verify if things are ok12:07
openstackgerritMerged openstack/openstack-ansible-os_sahara master: Add openstack-ansible-linters test  https://review.openstack.org/51312412:07
*** ansibler has joined #openstack-ansible12:11
*** dave-mccowan has joined #openstack-ansible12:12
*** thorst has joined #openstack-ansible12:13
hwoarangevrardjp: nope. which one?12:29
* hwoarang is reading the backlog slowly12:29
*** jamesdenton has joined #openstack-ansible12:30
*** yifei has quit IRC12:33
hwoarangodyssey4me: evrardjp: Ohhh i see it now. the same error on ubuntu... that's not good12:34
hwoarangunless it didn't really finish in 5 minutes... maybe i was too optimistic12:35
mhaydenmorning folks12:39
evrardjpand... my internet connection is back!12:39
evrardjphwoarang: what were we talking about?12:40
*** yolanda has joined #openstack-ansible12:41
hwoarangevrardjp: you asked me if I say odyssey4me's log. I presume you meant this http://logs.openstack.org/00/513200/3/check/openstack-ansible-functional-ubuntu-xenial/4bcc12c/job-output.txt.gz#_2017-10-19_10_25_46_84115212:44
hwoarangi am not sure if it's the same issue or maybe the mirrors were slow and 5 minutes were not enough...12:45
*** gkadam has quit IRC12:45
evrardjpoh yes. No I think I just meant did you see the retry seconds12:46
evrardjpit look like it's doing it every 5 seconds12:46
evrardjpisn't it the task we messed up with?12:46
hwoarangyeah :/12:46
hwoarang'delay' is lying12:47
evrardjpI think I tried it on my machine and it worked. So now, I wonder what my first amend on your patch wasn't the solution...12:50
evrardjp118 if you recall :)12:50
hwoarangconfusing12:50
evrardjpdown from everyone or just me... cacti.openstack.org :/12:50
evrardjpI didn't do anything wrong!12:51
hwoarangworks for me12:52
hwoaranghmm shall we change it to 118? i don't understand what's going on. i guess the docs are lying12:52
evrardjpso my internet is down again then12:53
evrardjpand nobody is getting my irc messages12:54
evrardjpwoot!12:54
*** hachi has joined #openstack-ansible13:00
evrardjpgreat I am back! Darn flaky ipv6 stack13:02
*** cshen_ has quit IRC13:03
evrardjphwoarang: on my machine it respects the docs13:04
hwoarang:/13:06
hwoarangbug bug bug13:07
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_neutron stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51334413:07
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_neutron stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51334413:09
evrardjphwoarang: do you think it's possible to have incorrect timings?13:11
evrardjpin the gates I mean13:11
evrardjpwhat do you see in xci? Everything is downloading fine?13:12
odyssey4meevrardjp perhaps it's time to switch to using debootstrap instead ;)13:12
evrardjpoh fun stuff nova-lxd is broken today13:13
evrardjpyesterday it worked fine.13:13
evrardjpodyssey4me: everywhere? :p13:13
*** yolanda has quit IRC13:13
evrardjpI was one of the first to say ok to debootstrap I think :p13:13
*** woodard has quit IRC13:14
evrardjpbut not a prio13:14
evrardjpI may rethink this :p13:14
*** woodard has joined #openstack-ansible13:14
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_nova master: Update paste, policy and rootwrap configurations 2017-10-14  https://review.openstack.org/51204413:19
*** tnogisto has joined #openstack-ansible13:23
tnogistohello, sorry this might be a stupid question, but are there any examples of ansible-openstack user_config file, where openvswitch with self-provisioned networks is deployed?13:33
tnogistocurrently my compute node seems to take the managment IP, not the overlay IP, and Im not sure why that happens13:33
tnogistonetwork nodes neutron client node has the correct IP13:34
*** woodard has quit IRC13:36
*** hachi has quit IRC13:41
*** hachi has joined #openstack-ansible13:42
*** yifei has joined #openstack-ansible13:45
*** hachi_ has joined #openstack-ansible13:48
*** hachi has quit IRC13:48
*** hachi_ has quit IRC13:53
hwoarangevrardjp: yeah i haven't seen these timeouts :(13:58
hwoarangbut we run far less jobs than openstack. Maybe 6 per day but still...13:58
hwoarangand we only upstream mirrors13:58
evrardjpthe etherpad is updated if you want to help13:59
evrardjpany of you :)13:59
evrardjphwoarang: ok13:59
evrardjpwell we'll see :)13:59
hwoarangthe etherpad re zuul?13:59
*** vnogin has joined #openstack-ansible14:02
*** lbragstad has joined #openstack-ansible14:04
*** galstrom_zzz is now known as galstrom14:05
*** esberglu has joined #openstack-ansible14:07
openstackgerritMerged openstack/openstack-ansible-lxc_container_create stable/pike: tasks: lxc_container_create: Retry LXC start on failures  https://review.openstack.org/50991014:13
*** gouthamr has joined #openstack-ansible14:20
cloudnullmornings14:20
openstackgerritAntony Messerli proposed openstack/openstack-ansible-ops master: [WIP] Clean out old mariadb apt sources  https://review.openstack.org/51340014:24
evrardjpmorning14:29
evrardjphwoarang: yes14:29
*** gkadam has joined #openstack-ansible14:38
*** weezS has joined #openstack-ansible14:38
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Initial integrated zuulv3 jobs  https://review.openstack.org/51340614:41
*** jbadiapa has quit IRC14:43
*** galstrom is now known as galstrom_zzz14:45
openstackgerritkourosh vivan proposed openstack/openstack-ansible-os_tempest master: add var to set a specific public network gateway_ip  https://review.openstack.org/51340714:45
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_nova master: Update upgrade role for Queens from P  https://review.openstack.org/49667914:45
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Initial integrated zuulv3 jobs  https://review.openstack.org/51340614:53
*** jvidal has quit IRC14:55
*** rodolof has quit IRC14:57
*** rodolof has joined #openstack-ansible14:57
openstackgerritMerged openstack/openstack-ansible-ceph_client stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51332815:03
*** gkadam is now known as gkadam-away15:05
openstackgerritMerged openstack/openstack-ansible-apt_package_pinning stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51332615:05
*** Oku_OS is now known as Oku_OS-away15:10
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Initial integrated zuulv3 jobs  https://review.openstack.org/51340615:10
*** yifei has quit IRC15:12
*** markvoelker has quit IRC15:12
*** markvoelker has joined #openstack-ansible15:13
*** acormier has quit IRC15:14
*** acormier has joined #openstack-ansible15:14
*** newmember has quit IRC15:15
*** markvoelker has quit IRC15:17
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Initial integrated zuulv3 jobs  https://review.openstack.org/51340615:17
*** acormier has quit IRC15:18
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Initial integrated zuulv3 jobs  https://review.openstack.org/51340615:19
odyssey4meevrardjp you're mixing up periodics and PR jobs though15:19
evrardjpyes15:19
evrardjpsame definition15:19
odyssey4methat's not a good idea I don't think15:19
evrardjpI don't think we should have two different definitions for one single thing15:19
odyssey4methe parent defines the base things, then as you go down the tree you get more specific15:20
evrardjpdouble negation or?15:20
evrardjpand?15:20
odyssey4mealso, the distros are better defined lower down15:20
odyssey4meone job, then one variation using the job as parent, then all distros as variations of the second... it cuts down a lot of repeated bits - eg: https://github.com/openstack/openstack-ansible-tests/blob/master/zuul.d/jobs.yaml#L26-L5915:22
odyssey4mein this case - one job, then a variation would need to be for PR's and another for periodics as they have different triggers15:23
odyssey4methe branches bit should only get added to the periodics one15:23
evrardjpwell I kinda repeated on purpose... many things don't need to say deploy15:24
evrardjpit was very readable15:24
evrardjpbut I can modify it15:24
evrardjpI don't understand why we need two variations for periodics and prs15:25
odyssey4medo the PR's one first - don't try and tackle them both at once15:25
evrardjpit's the same job content, just different variables15:25
odyssey4meright now all the jobs you're defining will get run for all reviews15:25
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Initial integrated zuulv3 jobs  https://review.openstack.org/51340615:26
evrardjpwhy?15:26
evrardjpwhy all the jobs will run for all reviews?15:27
odyssey4meoh, I just saw the pipeline now15:27
evrardjpsorry the why wasn't very clear15:27
odyssey4meapologies - misread15:27
evrardjpI do many stupid word order mistakes, but except that, the pipeline seem simple15:27
odyssey4meit'd be nice if the jobs in the pipelines were alphanumerically ordered ;)15:28
evrardjpbut you're gonna mix apples and oranges?15:28
evrardjpcentos with ubuntu?15:28
evrardjpblasphemy!15:29
evrardjp:p15:29
evrardjpok for the reordering15:29
evrardjpit was clearer for me that way, because I used the old job definition15:29
evrardjpI think it's quite simpler at the end15:29
evrardjplet me re-order them15:29
evrardjpdarn OCD you have :p15:30
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Initial integrated zuulv3 jobs  https://review.openstack.org/51340615:32
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Initial integrated zuulv3 jobs  https://review.openstack.org/51340615:34
odyssey4meit looks like zuul has some memory back - want to recheck a few things again?15:35
odyssey4melooks like they're mostly done - so perhaps backports?15:35
evrardjpoh yeah I didn't do any commit to avoid breaking things15:36
evrardjpI have them pending, just waiting15:36
evrardjpshould we finish the big ones first?15:37
evrardjpbecause what's pending are the big ones15:37
evrardjpin master I mean15:37
evrardjpnova keystone swift...15:37
evrardjpI will do the glance cinder heat neutron15:37
evrardjpwell neutron is done15:37
openstackgerritManuel Buil proposed openstack/openstack-ansible-os_neutron master: L3 Support for ODL deployments  https://review.openstack.org/49745815:38
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_glance stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51342115:38
odyssey4mewell, the big ones are failing more often - perhaps focus more on the ones that have more patches pending15:38
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_heat stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51342215:38
*** phalmos has joined #openstack-ansible15:39
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_cinder stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51342315:39
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_tempest stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51342415:40
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_horizon stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51342515:40
evrardjp5 !15:41
*** chyka has joined #openstack-ansible15:41
evrardjpgalera lxc hosts15:42
evrardjplet me add them15:42
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-galera_server stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51342615:43
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-lxc_hosts stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51342715:43
*** woodard has joined #openstack-ansible15:45
openstackgerritManuel Buil proposed openstack/openstack-ansible-os_neutron master: Provide support for SFC deployments  https://review.openstack.org/51090915:49
*** ianychoi has quit IRC16:06
*** ianychoi has joined #openstack-ansible16:07
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible stable/pike: Include the Ansible version variable when installing ara  https://review.openstack.org/51343416:10
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Constrain ansible when installing ARA  https://review.openstack.org/51329816:10
odyssey4mecloudnull apologies - just updated that one again - missed another line16:11
cloudnullno worries :D16:11
* cloudnull was tired when I wrote that16:11
openstackgerritManuel Buil proposed openstack/openstack-ansible-os_neutron master: L3 Support for ODL deployments  https://review.openstack.org/49745816:11
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-tests stable/pike: Constrain ansible when installing ARA  https://review.openstack.org/51343716:13
cloudnullI backported those changes to pike so I didn't forget.16:13
cloudnulldo we need them in ocata too ?16:13
odyssey4meno, no ara implementation in ocata16:13
cloudnullkk16:13
cloudnullodyssey4me: evrardjp: on https://review.openstack.org/#/c/513265 do we want a btrfs, zfs, overlayfs scenario within that role too ?16:15
odyssey4meyeah, for now16:15
evrardjpcreate just a container, show that CoW works, badaboom16:16
odyssey4meif we're doing back-end things, we may as well test them16:16
evrardjpshould be two tasks16:16
odyssey4mecloudnull evrardjp actually... hmm16:16
odyssey4mecurrently the container create there is a backing container for cow containers created by lxc-container-create16:16
cloudnullwe're going to need to implement this similar to lxc-container-create16:16
evrardjpyeah but lxc-container-create has many things right?16:17
odyssey4meadding it in this repo adds quite a bit of overhead16:17
evrardjpisn't it possible to do something very lightweight instead? This way we don't test the functions of the creation of lxc container16:17
*** pcaruana has quit IRC16:18
evrardjpodyssey4me: let me rephrase then16:18
odyssey4meit'd be nicer to actually move the cow base prep to lxc-container-create instead16:18
evrardjpcould we trigger a lxc container job?16:18
evrardjpwe could technically now.16:18
odyssey4meevrardjp we could16:18
odyssey4mealthough we'd have to define it in the tests repo16:18
evrardjpno I mean the same way we'd do for keystone16:19
odyssey4meI prefer that idea, that duplicating a bunch of stuff in this repo16:19
odyssey4meevrardjp yes, that's exactly what I mean16:19
odyssey4meI can prep up a review for it if you like?16:19
odyssey4mecloudnull happy with that?16:19
*** markvoelker has joined #openstack-ansible16:20
cloudnullsounds good to me16:20
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Add tests for multi-backend  https://review.openstack.org/51344316:23
cloudnulli pitched it over.16:24
cloudnullI had it mostly done.16:24
cloudnullhowever I'm happy to abandon it if we've a better way16:24
*** markvoelker has quit IRC16:24
cloudnullmaybe we should move the zfs and btrfs backend creation playbooks to the tests repo ?16:25
cloudnullodyssey4me: or are you doing that?16:25
*** cshen_ has joined #openstack-ansible16:26
odyssey4mecloudnull I'll show you an even better solution ;)16:27
cloudnullwoot!16:27
* cloudnull abanding my copy-pasta :D16:28
*** cshen_ has quit IRC16:28
openstackgerritAntony Messerli proposed openstack/openstack-ansible-ops master: [WIP] Clean out old mariadb apt sources  https://review.openstack.org/51340016:30
*** cshen_ has joined #openstack-ansible16:32
evrardjpso FYI today is release day for the M1.16:36
evrardjpI will prepare the release after my dinner16:36
evrardjpgreat time for nova-lxd to fail.16:37
evrardjpnot their fault though16:37
*** gkadam-away has quit IRC16:48
evrardjpI will try to fix it, for the greater good!16:49
hwoarangodyssey4me: evrardjp: so i am finally looking at the zuulv3 stuff. after having read the migration guide i am still not sure where our common jobs are defined16:51
*** vnogin has quit IRC16:52
hwoarangso for example, where is openstack-ansible-functional-centos-7 defined these days?16:52
*** phalmos_ has joined #openstack-ansible16:52
odyssey4meopenstack-ansible-tests is where the base jobs are defined16:53
odyssey4mescenario's are defined in repositories that require them16:53
hwoarangodyssey4me: and how does each role know that the job is in the tests repo so it can inherit from there?16:54
hwoarangmust have missed that bit in the migration guide16:54
odyssey4mehwoarang zuul's load order specifies that repo high up in the load order (we had to make sure of that)16:54
*** phalmos has quit IRC16:55
odyssey4meso the configs in openstack-ansible-tests is loaded before any of other repositories16:55
hwoarangok but where do you define that?16:55
*** vnogin has joined #openstack-ansible16:55
hwoarangbecause the project.yml is in-repo know so you have to tell zuul somehow to go look at -tests for the actual job definition16:56
odyssey4mehwoarang trying to find it - hang on16:56
odyssey4mehttps://review.openstack.org/51267816:57
hwoarangohhhhhh16:58
hwoarangsneaky16:58
hwoarangok now it all makes sense16:58
hwoarangthank you odyssey4me16:59
odyssey4mesure thing :) we're all learning how to ride this bike... slowly17:00
*** cshen_ has quit IRC17:02
*** Random__ has joined #openstack-ansible17:07
Random__hey everyone, quick question: do i need to create the "lxcbr0" bridg before hand, or will the ansible-openstack playbooks make that one for me17:09
*** shardy has quit IRC17:12
*** vakuznet has joined #openstack-ansible17:14
hwoarangRandom__: iirc it will create one for you17:15
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Add cross-repo base job  https://review.openstack.org/51345317:17
*** vnogin has quit IRC17:18
vakuznethi, gnocchi upgrade from 15.1.9 is failing "/openstack/venvs/gnocchi-15.1.10/bin/gnocchi-upgrad17:19
vakuznete", "--create-legacy-resource-types"], "delta": "0:00:01.121827", "end": "2017-10-19 17:13:34.314072", "failed": true, "rc": 1, "start": "201717:19
vakuznet-10-19 17:13:33.192245", "stderr": "RuntimeError: module compiled against API version 0xb but this version of numpy is 0xa17:19
*** smatzek has joined #openstack-ansible17:19
*** phalmos has joined #openstack-ansible17:23
*** vnogin has joined #openstack-ansible17:24
*** mbuil has quit IRC17:24
*** phalmos_ has quit IRC17:26
vakuznetis it known issue?17:26
*** vnogin has quit IRC17:28
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Add lxc-container-create tests  https://review.openstack.org/51345717:30
odyssey4mecloudnull evrardjp ^ hopefully that does the trick, with the dependent patch17:31
*** jonmills has joined #openstack-ansible17:31
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Set OpenStack-Ansible release to 17.0.0.0b1  https://review.openstack.org/51345817:32
*** smatzek has quit IRC17:32
evrardjpI'll have a look odyssey4me17:33
evrardjpthanks!17:33
jonmillsI'm new to openstack-ansible, and in fact new to ansible.  not new to openstack though.  i wanted to ask you guys if it's possible to make openstack-ansible deploy openstack without using lxc?17:33
odyssey4mezuul has loaded the jobs, so the config is right - we'll see if it functionally works17:34
*** lbragstad has quit IRC17:35
evrardjpjonmills: yes, on bare metal. You may hit a few bugs when doing 100% on bare metal though17:35
evrardjpbut we are happy to help you on the way17:35
evrardjpjonmills: isolation is, although, best ensured with containers17:35
evrardjpodyssey4me: so basically the job is the same, you just change into a different folder17:36
odyssey4meevrardjp yes17:36
evrardjpso both folders have to be checked out, which is easy for a-r-r17:36
evrardjpmaybe different with keyston17:36
evrardjpe17:36
evrardjpbut still easy17:36
odyssey4methe get-a-r-r playbook detects another checkout there and uses it without changing it17:37
jonmillsevrardjp: actually a case where I'd prefer to put the control plane in KVM VMs that I manage outside OpenStack.  I'd have the networking set up such that there would be a shared control plane vlan seen by openstack hypervisors and the KVM nodes in question.17:37
jonmillsevrardjp: essentially i'm not a lxc fan and just prefer kvm (sorry)17:37
evrardjpjonmills: lxc containers are not like docker containers17:37
evrardjpit's alright :)17:37
evrardjpjonmills: would you prefer systemd-nspawn containers? :p17:37
odyssey4mejonmills sure, but with containers when rabbitmq dies, you just destroy and recreate containers - not the whole control plane ;)17:37
odyssey4mebut meh, each to their own :)17:38
evrardjpodyssey4me: yeah :)17:38
evrardjpwell17:38
evrardjpit's technically possible17:38
jonmillsevrardjp: it's a case where I'm running my cluster/baremetal managed by xCAT.  xCAT handles KVM quite nicely for me.17:38
evrardjpjonmills: if you are willing to iron out some of the bugs you see on the way, we'd love to see your contributions.17:39
evrardjpjonmills: I'd suggest you to read the deploy guide once17:39
openstackgerritMerged openstack/openstack-ansible-os_neutron stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51334417:39
evrardjpthen start with putting everything on metal17:39
evrardjpWOOOT17:39
evrardjpNEUTRON PIKE MERGED!17:39
evrardjpthe first!17:39
*** lbragstad has joined #openstack-ansible17:39
evrardjpjonmills: this way you get familiar with the process, how ansible works, how we do things with it, etc.17:40
spotzWe merged?!!!17:40
jonmillsevrardjp:  i'm sort of mid-way through reading the deployment guide.  i'm searching for some sort of toggle or keyword (to put in a playbook?) to basically say "hey, stop caring about lxc"17:40
odyssey4meevrardjp the third actually ;)17:40
evrardjpis_metal17:40
jonmillsaha17:40
Random__Does anyone know if i can just update the etc/network/interfaces file to make bridges or do i have to run brctl addbr also?17:41
odyssey4mejonmills it's not well documented, and not a simple toggle - evrardjp has been working on implementing something like that - or at least an example config17:41
evrardjpRandom__: etc network interfaces just define the bridges, you should either restart, or do them manually17:41
evrardjpI'd restart to check that everything is alright upon reboot :p17:41
jonmillsThank you evrardjp and odyssey4me.17:42
logan-you have to set it to 11 to go full metal, but i think only evrardjp has attained that level17:42
Random__i mean if i change the file and then restart is that all i need to do17:42
evrardjplogan-: you mean I am the only one willing to throw hardware at it :p hahaha17:42
*** vakuznet has quit IRC17:42
*** csmart has quit IRC17:43
*** evrardjp[m] has quit IRC17:43
odyssey4meevery time... https://media.giphy.com/media/gui67fZ3xIneM/giphy.gif17:44
logan-how goes the zuuls? my workstation got messed up so just catching up17:44
odyssey4melogan- we crashed it twice17:45
odyssey4meit only has 16GB of memory, and apparently isn't very good at giving it back to the system when processing job changes... and we're doing a lot of changes17:45
logan-haha nice17:45
*** germs has joined #openstack-ansible17:46
odyssey4meIIRC every time it processes a job change, it uses around 100MB memory... when I threw ~40 patches at once into the mix, it crashed17:46
odyssey4meto be fair, it's handling over 3000 repositories apparently17:46
logan-makes sense i guess that the dynamic reconfiguration stuff can be costly when done in bulk17:47
odyssey4meyeah, so we're trying to be kind and make only a few changes at a time17:47
odyssey4meif you'd like to watch the memory cycle, see http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=63979&rra_id=all17:47
*** germs1 has joined #openstack-ansible17:47
logan-are there some slow providers currently? i notice some integrated jobs are going the normal 1h35m-1h40m and then others timeout constantly17:48
logan-guessing its a slower nodepool provider rather than zuul related stuff17:48
odyssey4meja, I noticed that too -stuff is a bit slow right now... not sure exactly why, been busy trying to make jobs work17:48
logan-ah wow time for a resize on that instance :D17:48
*** pbandark has quit IRC17:49
odyssey4meyup, they know about it17:50
*** vakuznet has joined #openstack-ansible17:50
*** pbandark has joined #openstack-ansible17:50
odyssey4mezuul v4's plans included being able to scale horizontally... for now though it's a vertically scaled monolith17:50
evrardjpif you fancy some votes on the first queens milestone it's here: https://review.openstack.org/#/c/513458/17:50
odyssey4methe scheduler specifically17:50
*** germs has quit IRC17:51
evrardjpin the meantime, I am gone for playing a board game. I will be back in an hour or so.17:51
odyssey4meevrardjp if that passes the gate, I wonder if it's worth the bother actually merging it - you could just do the release from your checkout17:52
odyssey4menot sure why I didn't think of that before17:52
evrardjpI will do a release from my checkout17:53
odyssey4meoh, because it won't actually release a thing that works - never mind17:53
evrardjpbut after :p17:54
evrardjpok see you laterz !17:54
*** poopcat has joined #openstack-ansible18:00
openstackgerritMajor Hayden proposed openstack/ansible-hardening stable/pike: Zuulv3 migration  https://review.openstack.org/51346118:02
cloudnullRandom__: if these are new bridges you can just edit the file18:03
cloudnulland then run ifup18:03
cloudnullif the bridges exist you will need to add them to the file and run (brctl || ip) to make the changes live18:04
spotzRandom__ you RandomTech from yesterday?18:05
*** albertcard1 has joined #openstack-ansible18:05
*** germs1 is now known as germs18:06
Random__yes i put a space in my name and it borked18:07
*** poopcat has quit IRC18:07
Random__spotz: ^18:07
spotzRandom__: Might want to let Cloudnull the whole plan, he'll be able to help more:)18:07
spotzknow the.. can't type18:08
cloudnull:P18:08
Random__i was just figuring out how to write the task file efficently18:08
spotzcloudnull: He's trying to do an ansible play that will automatically setup our roles and run IF I remember correctly from Random__ yesterday18:09
Random__ya im making a playbook to aid with the network setup as these blades are being done from scratch18:10
*** electrofelix has quit IRC18:10
jrosserRandom__: weve done this and its horrific18:10
Random__im just talking about the bridges18:10
Random__i have everything but the task to do the templating18:11
jrosserwell yes, but theres a lot of banana skins waiting for you hidden in the ifup/down commands18:11
jrosserwe pxeboot a server then set up all the required interfaces and bridges with a playbook18:11
jrosserand its been very hard to make reliable/repeatable18:12
Random__have you tried doing a networking restart instead of ifup?18:12
jrosseroh yes18:12
Random__so sudo systemctl restart networking.service18:12
jrosserand had to rewrite that systemd service too18:12
jrosserboxrick: we need to opensource our network role18:13
Random__what os were you using?18:14
spotzAnd this is why I suggested joining us over here yesterday Random__. We've got the best/helpful folks around:)18:16
jrosserRandom__: ubuntu18:17
Random__its stange that the openstack-ansible channel isnt joined by default18:17
jrosserif youre in centos im told youll jave a much easier time18:17
*** Random__ is now known as RandomTech18:17
cloudnullRandom__: if you want something that can be used more universally without having to deal with net-config you could use something like: https://github.com/osic/osic-clouds/blob/master/nextgen/scripts/vxlan-mesh-create.sh18:17
RandomTechnope ubuntu 1618:17
spotzWell we're a project just like keystone so if you don't have an OSA related question you may not want to be here18:18
jrosserok well  busy for a couple if hours but let me try to get stuff on github later18:18
cloudnullwe used that script in the OSIC to automate a mesh network setup for hosts deployed within ironic18:18
jrosserits mad that weve workedtheough all this and not shared it18:18
spotzBad jrosser!!18:18
logan-jrosser: have you tried networkd? wonder if things get any easier that way18:19
jrosserperhaps, we got badly stung by there being hiddden state behing the files inimterface.d18:19
jrosserand residual ip addresses needing to be flished manually of interfaces18:20
logan-gotcha18:20
jrossersorry phone typing, ill try to link to our stuff later18:20
RandomTechjrosser: did you make sure you had bridge-utils first?18:20
*** rodolof has quit IRC18:23
*** rodolof has joined #openstack-ansible18:24
boxrickRandomTech: oh yes, all there.18:24
RandomTechhmm18:24
RandomTechwhat kind of error did you run into?18:24
jrosserRandomTech: boxrick is your man for this18:27
RandomTechboxrick: what error did you run into?18:27
*** rodolof has quit IRC18:28
*** cshen_ has joined #openstack-ansible18:33
odyssey4melogan- mind giving this a review? https://review.openstack.org/#/c/496678/18:34
logan-on it18:34
odyssey4methx18:36
*** stuartgr has quit IRC18:37
*** galstrom_zzz is now known as galstrom18:37
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Add lxc-container-create tests  https://review.openstack.org/51345718:38
odyssey4meok, I'm out for the night - cheers all18:39
*** cshen_ has quit IRC18:40
openstackgerritMajor Hayden proposed openstack/ansible-hardening stable/pike: Zuulv3 migration  https://review.openstack.org/51346118:41
openstackgerritMajor Hayden proposed openstack/ansible-hardening master: Remove queue from zuulv3 gate  https://review.openstack.org/51347518:41
openstackgerritAntony Messerli proposed openstack/openstack-ansible-ops master: [WIP] Clean out old mariadb apt sources  https://review.openstack.org/51340018:43
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_swift stable/pike: Suppress rsync warnings w/command  https://review.openstack.org/50126318:46
openstackgerritMajor Hayden proposed openstack/openstack-ansible-galera_server stable/pike: Suppress command/shell warnings  https://review.openstack.org/51193518:47
openstackgerritMajor Hayden proposed openstack/openstack-ansible-galera_server stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51342618:47
openstackgerritMajor Hayden proposed openstack/openstack-ansible-galera_server stable/pike: Suppress command/shell warnings  https://review.openstack.org/51193518:47
chykahey all, i'm still working on that issue with booting from the provider network. if i console into an instance and manually add the static IP it works.  But at boot is jut repeats "trying to raise network interfaces" till it times out18:48
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_cinder stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51342318:48
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_tempest stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51342418:48
chykaand its driving me crazy18:48
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_horizon stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51342518:49
openstackgerritMajor Hayden proposed openstack/openstack-ansible-lxc_hosts stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51342718:49
vakuznet15.1.10 gnocchi upgrade error: https://pastebin.com/n9drgHE518:49
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_heat stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51342218:49
cloudnullchyka: meta data / dhcp getting into the instance?18:49
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_glance stable/pike: Initial OSA zuul v3 role jobs  https://review.openstack.org/51342118:49
chykayeah, it gets up to dhcprequest but nothing after that18:50
chykaso there's some back an forth, but it doesn't go any further than that18:51
jrosserRandomTech: just working on getting our repo public18:51
*** cshen_ has joined #openstack-ansible18:53
*** smatzek has joined #openstack-ansible19:05
*** smatzek has quit IRC19:07
*** smatzek has joined #openstack-ansible19:08
*** smatzek has quit IRC19:12
chykayeah there's dhcp requests but then no acknowledgement.  then after failing to raise the interface cloud-init doesn't set an IP so the instance cant access any metadata.19:13
RandomTechGHOST RandomTech19:16
RandomTechoops :p19:16
RandomTechi think i have the task writen up for the networking19:17
*** pbandark has quit IRC19:18
jrosserRandomTech: looking at our code, theres a few subtleys. The order things are brought up/down in interfaces.d/ is not what you'd necessarily want or like.19:19
jrosserin addition, if you change any of the contents of interfaces.d and bring interface up/down afterwards you are in for bad times(tm)19:20
RandomTechim not changing interfaces.d im changing interfaces19:20
jrossernone of this generally matters in simple "eth0 dhcp" setups19:21
RandomTechwere not using dhcp either19:21
jrosserbut if you try to configure a quite complex set of interfaces, bonds and bridges as you might when following the OSA deply guide it becomes very unreliable for the reasons above19:21
RandomTechim following this: https://docs.openstack.org/project-deploy-guide/openstack-ansible/draft/app-config-test.html19:22
jrossersure19:23
*** newmember has joined #openstack-ansible19:23
jrosserwe've done the same, and attempted to entirely automate/ansible-ise the preparation of the host systems before running OSA19:24
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Update upgrade role for Queens from P  https://review.openstack.org/49667819:25
jrosserRandomTech: https://github.com/bbc/network_configure19:25
jrossercloudnull: ^^19:25
jrosserlogan-: ^^ thats what we ended up having to do19:29
logan-thanks jrosser19:29
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Add BTRFS cached container task  https://review.openstack.org/51326519:36
openstackgerritMerged openstack/openstack-ansible-lxc_container_create master: Fix BTRFS package name  https://review.openstack.org/51315719:40
*** dave-mccowan has quit IRC19:49
*** dave-mccowan has joined #openstack-ansible19:51
*** inc0 has joined #openstack-ansible19:51
inc0hey there, you guys remember discussion about healthchecks on ptg?19:52
mhaydenyeah19:52
inc0wanna do some design of it next week? First project we want to prototype it will be ironic19:52
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests stable/pike: Add Fedora support to bindep install step  https://review.openstack.org/51348719:55
openstackgerritMajor Hayden proposed openstack/ansible-hardening stable/pike: Zuulv3 migration  https://review.openstack.org/51346119:55
openstackgerritDaniel Speichert proposed openstack/openstack-ansible-lxc_hosts master: Stop trying to set MTU on LXC bridge interface  https://review.openstack.org/51278919:59
openstackgerritMajor Hayden proposed openstack/openstack-ansible master: Initial integrated zuulv3 jobs  https://review.openstack.org/51340620:01
openstackgerritMajor Hayden proposed openstack/openstack-ansible master: Initial integrated zuulv3 jobs  https://review.openstack.org/51340620:02
*** dave-mccowan has quit IRC20:02
*** smatzek has joined #openstack-ansible20:04
*** weezS has quit IRC20:06
*** weezS has joined #openstack-ansible20:06
*** vnogin has joined #openstack-ansible20:10
chykaany ideas about that provider network? :(20:14
openstackgerritJimmy McCrory proposed openstack/openstack-ansible master: [TEST] Update Ansible to 2.4.1.0-0.4.rc2  https://review.openstack.org/50181420:14
*** asb47_ has quit IRC20:20
cloudnulljrosser: boxrick: very nice!20:23
*** vnogin has quit IRC20:24
openstackgerritMerged openstack/openstack-ansible-tests stable/pike: Constrain ansible when installing ARA  https://review.openstack.org/51343720:26
*** asb47 has joined #openstack-ansible20:27
*** RandomTech has quit IRC20:27
jrossercloudnull: you wouldnt beleive the grief we've had with ubuntu networking :( to the point we've discussed changing to centos just on that basis20:28
cloudnullI can imagine :)20:28
jrosserthat role is used on all our boostrap, deploy, infra, ceph, everything so theres some very complex data gets fed in20:29
cloudnullI'm hopeful things like networkd will eventually be good enough to universally replace distro specific network scripts, but until then... its kinda a PITA20:29
cloudnullthe role looks super useful.20:30
jrosserwe also have other values for device_type like 'ipmi' and 'switch' which are consumed in our dhcp and tftp roles20:30
jrosserbut they all just get skipped in that one for host interfaces, which is quite neat20:30
SamYaplecloudnull: ive beed using networkd for a couple years now to replace distro networking20:31
SamYaplecloudnull: im down to *one* systemd oneshot service to implment some ip rule stuff20:31
cloudnullSamYaple: I've tried a couple of times, things like bonding and vlan handling has been a bit suspect in some applications.20:31
cloudnullbut ++ i have networkd all running at home. its seems to +/- work20:32
SamYaplesuspect as you think its been setup wrong? or it just didnt work20:32
cloudnullit didn't work.20:32
SamYapleyea i know what you mean. its not feature complete yet20:32
cloudnullor it did, until systemd release x.y.z came out and it was broken .20:33
SamYaplewell that seems just broken. i do bond+vlan at my house20:33
*** vnogin has joined #openstack-ansible20:33
*** jwitko_ has joined #openstack-ansible20:33
cloudnullits been a ride20:33
SamYaplea fun one though. i really like networkd20:33
SamYaplebut agreed, it has some growing up to do still20:33
cloudnullI too like it.20:33
cloudnullI think its going to be great given a couple more iterations20:33
*** jwitko has quit IRC20:36
openstackgerritMerged openstack/openstack-ansible-ops master: Tune-up the MNAIO for physical and virtual hosts  https://review.openstack.org/51198520:36
*** jwitko_ has quit IRC20:40
*** asb47 has quit IRC20:41
*** asb47 has joined #openstack-ansible20:42
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Set OpenStack-Ansible release to 17.0.0.0b1  https://review.openstack.org/51345820:46
*** woodard has quit IRC20:46
*** cshen_ has quit IRC20:46
Neptuhej20:49
NeptuIm trying to make a first instalation of openstack-ansible and I have 5 nodes on virtualbox20:49
Neptuim looking to the apendix https://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/app-config-test.html20:49
Neptubut im not so sure why I need this networks and how to configure them in advance20:50
*** snowman48391 has joined #openstack-ansible20:55
*** snowman4839 has quit IRC20:55
spotzNeptu That's an example config with our 'example' IPs21:01
*** jwitko has joined #openstack-ansible21:03
Neptuspotz: but why 3 bridges are required21:03
Neptui guess i still a newbie on openstack and those are obvious questions21:03
Neptubut for me they ar enot21:03
spotzNeptu - So the management network is for the hosts to talk amongst themselves. The storage network is for the transfer of storage which can be bandwidth intensive. The vxlan in this case could be considered your 'public; network. The guys will correct me if wrong with that interpretation21:06
spotzneptu - now things aren't going to quite match up here as this doesn't have quite the same networks and no storage network but does this help to visualize? https://docs.openstack.org/newton/networking-guide/deploy-ovs-selfservice.html21:11
*** markvoelker has joined #openstack-ansible21:13
*** gouthamr has quit IRC21:15
*** thorst has quit IRC21:16
*** rodolof has joined #openstack-ansible21:17
*** thorst has joined #openstack-ansible21:18
*** dave-mccowan has joined #openstack-ansible21:23
*** thorst has quit IRC21:23
*** jonmills has quit IRC21:25
*** smatzek has quit IRC21:26
*** dave-mccowan has quit IRC21:29
Neptuspotz: is helping21:33
spotzneptu yeah sometimes a visiual makes things clearer21:33
Neptuspotz: in that sense you are basically spliting the networking to avoid problems21:34
Neptuok ok21:34
Neptunow i need to understand on how to setup the target hosts21:34
spotzneptu Correct except for the 'public' or tunnel network21:34
Neptubuilding a vagrant ansible script to pre-setup my test enviroment21:34
spotzWhich is going to be your outside IPs/access/etc21:35
spotzI believe you can do multi-node with the AIO and that's documented.. But don't quote me I'd have to look and confirm21:35
Neptuok so you telling me you have a ipv4 internal and the tunnel should give "external" ips21:36
Neptufor the vms's21:36
*** dave-mccowan has joined #openstack-ansible21:37
spotzWell it will be where your external floating IPs are from21:37
spotzI've been doing a lot of provider networks or simple private/public ones lately so slight chance of misinterpretation21:37
Neptuspotz: the idea is to use this as test... this are my first steps21:39
Neptugonna try to configure the machines21:39
NeptuI guess I need to define what nodes are doing what21:40
spotzneptu You could start with an AIO then to get a feel then go more multi-node21:40
jrosserspotz: i have found those examples a little confusing becasue they dont explicitly talk about where floating ip etc are allocated from21:40
*** woodard has joined #openstack-ansible21:40
Neptuin my case i have a vagrant script that sizes to n so i guess one controller node one storage and many compute21:40
NeptuAIO??21:40
spotzjrosser: If you want to bug it I can try to get to it. It'd be wishlisty in my free time21:41
spotzNeptu: AIO = All in One so everything would be on one host21:41
jrosserit may just be that its not set up, but doesnt say that21:41
Neptuspotz: so is like a devstack instance21:41
NeptuI saw a Vagrantfile aswell21:41
Neptuso wonder what that does21:42
spotzjrosser: Or we forgot and no one's mentioned it:)21:42
spotzneptu correct21:42
*** dave-mccowan has quit IRC21:44
*** albertcard1 is now known as poopcat21:44
spotzNeptu probably has an AIO in that21:45
*** thorst has joined #openstack-ansible21:47
Neptuspotz: gonna check the code21:47
Neptubut basically you clone the repo and you run the boostrap-aoi script?21:47
Neptuand that should give you a devstack??21:47
*** markvoelker has quit IRC21:48
spotzneptu Well not devstack but an all inclusive installation via OSA into LXC containers like you would have if you did an OSA installation21:48
spotzbut all on one machine21:49
Neptucool is a good start21:49
*** thorst has quit IRC21:51
Neptu./scripts/gate-check-commit.sh21:51
Neptuseems to run this21:51
*** csmart has joined #openstack-ansible21:57
*** jwitko has quit IRC22:02
*** markvoelker has joined #openstack-ansible22:02
*** markvoelker has quit IRC22:06
*** markvoelker has joined #openstack-ansible22:11
*** markvoelker has quit IRC22:16
*** markvoelker has joined #openstack-ansible22:20
*** phalmos has quit IRC22:23
*** thorst has joined #openstack-ansible22:23
*** evrardjp[m] has joined #openstack-ansible22:23
*** markvoelker has quit IRC22:25
*** thorst_ has joined #openstack-ansible22:26
*** thorst has quit IRC22:27
*** markvoelker has joined #openstack-ansible22:29
*** thorst_ has quit IRC22:30
*** galstrom is now known as galstrom_zzz22:32
*** snowman48391 has quit IRC22:33
*** markvoelker has quit IRC22:34
*** weezS has quit IRC22:34
*** snowman4839 has joined #openstack-ansible22:36
*** rodolof has quit IRC22:38
*** markvoelker has joined #openstack-ansible22:39
*** markvoelker has quit IRC22:43
*** markvoelker has joined #openstack-ansible22:47
openstackgerritMerged openstack/openstack-ansible-tests master: Constrain ansible when installing ARA  https://review.openstack.org/51329822:53
*** dave-mccowan has joined #openstack-ansible22:56
openstackgerritMerged openstack/openstack-ansible master: Include the Ansible version variable when installing ara  https://review.openstack.org/51328722:57
*** thorst has joined #openstack-ansible23:07
*** weezS has joined #openstack-ansible23:20
*** markvoelker has quit IRC23:22
*** smatzek has joined #openstack-ansible23:27
*** chyka has quit IRC23:29
*** smatzek has quit IRC23:31
*** weezS has quit IRC23:34
*** markvoelker has joined #openstack-ansible23:36
*** markvoelker has quit IRC23:40
*** newmember has quit IRC23:41
*** markvoelker has joined #openstack-ansible23:45
*** smatzek has joined #openstack-ansible23:46
*** markvoelker has quit IRC23:49
*** markvoelker has joined #openstack-ansible23:54
*** markvoelker has quit IRC23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!