*** flemingo has joined #openstack-ansible | 00:01 | |
*** flemingo_ has quit IRC | 00:04 | |
*** flemingo has quit IRC | 00:05 | |
openstackgerrit | Merged openstack/openstack-ansible-plugins master: Revert "Only su within container if container_user is provided" https://review.openstack.org/557545 | 00:17 |
---|---|---|
*** Leo_m has quit IRC | 00:22 | |
*** odyssey4me has quit IRC | 00:53 | |
*** odyssey4me has joined #openstack-ansible | 00:53 | |
*** chyka has joined #openstack-ansible | 01:01 | |
*** chyka has quit IRC | 01:05 | |
*** osnaya has quit IRC | 01:45 | |
*** NWOutlier__ has quit IRC | 01:53 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Update run_tests.sh and remove tests-repo-clone.sh https://review.openstack.org/556994 | 02:09 |
cloudnull | evenings | 02:16 |
*** yifei1 has joined #openstack-ansible | 02:18 | |
logan- | o/ | 02:42 |
*** strobelight has quit IRC | 03:08 | |
*** NWOutlier__ has joined #openstack-ansible | 03:10 | |
*** udesale has joined #openstack-ansible | 03:29 | |
*** sawblade6 has joined #openstack-ansible | 03:32 | |
*** sawblade_ has quit IRC | 03:34 | |
*** sawblade_ has joined #openstack-ansible | 03:41 | |
*** sawblade6 has quit IRC | 03:43 | |
*** ianychoi__ has joined #openstack-ansible | 03:47 | |
*** geb has quit IRC | 03:49 | |
*** rudysp has quit IRC | 03:49 | |
*** ianychoi_ has quit IRC | 03:50 | |
*** goldenfri has quit IRC | 03:50 | |
*** udesale has quit IRC | 03:51 | |
*** geb has joined #openstack-ansible | 03:53 | |
*** sawblade6 has joined #openstack-ansible | 03:53 | |
*** sawblade_ has quit IRC | 03:55 | |
*** dave-mccowan has quit IRC | 03:56 | |
*** dave-mccowan has joined #openstack-ansible | 03:58 | |
*** poopcat has quit IRC | 04:06 | |
*** dave-mccowan has quit IRC | 04:16 | |
*** dave-mcc_ has joined #openstack-ansible | 04:17 | |
*** bhujay has joined #openstack-ansible | 04:21 | |
*** ianychoi__ is now known as ianychoi | 04:29 | |
*** chyka has joined #openstack-ansible | 04:37 | |
openstackgerrit | Merged openstack/openstack-ansible-specs master: doc: source: index: Add Rocky specifications to index https://review.openstack.org/556831 | 04:39 |
*** chyka has quit IRC | 04:41 | |
cloudnull | ah bummer. looks like with the changes we've been making in the new venv role we've caused some conflict where it was merged already. | 04:43 |
cloudnull | http://logs.openstack.org/94/556994/2/check/openstack-ansible-deploy-aio_lxc-ubuntu-xenial/1f7d577/job-output.txt.gz#_2018-03-29_04_37_15_348321 | 04:43 |
cloudnull | idk if we revert or fix? | 04:44 |
cloudnull | i think we're still working on the interface | 04:44 |
cloudnull | evrardjp: odyssey4me? | 04:44 |
*** dave-mcc_ has quit IRC | 04:46 | |
*** cjloader has quit IRC | 04:47 | |
*** indistylo has joined #openstack-ansible | 04:55 | |
*** cjloader has joined #openstack-ansible | 04:56 | |
*** udesale has joined #openstack-ansible | 05:04 | |
*** bhujay has quit IRC | 05:08 | |
openstackgerrit | Merged openstack/openstack-ansible-os_glance master: Convert role to use a common systemd service role https://review.openstack.org/551053 | 05:16 |
*** NWOutlier__ has quit IRC | 05:19 | |
openstackgerrit | Merged openstack/openstack-ansible-tests master: Re-use run_tests.sh variables in run_tests_common.sh https://review.openstack.org/556591 | 05:20 |
openstackgerrit | Merged openstack/openstack-ansible-tests master: Re-use env var for setting the test branch https://review.openstack.org/556594 | 05:20 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/ansible-role-python_venv_build master: Implement build delegation https://review.openstack.org/557154 | 05:20 |
*** bhujay has joined #openstack-ansible | 05:23 | |
*** cjloader has quit IRC | 05:27 | |
*** aruns has joined #openstack-ansible | 05:37 | |
*** indistylo has quit IRC | 05:40 | |
*** admin0 has joined #openstack-ansible | 05:42 | |
*** chhagarw has joined #openstack-ansible | 06:02 | |
*** udesale_ has joined #openstack-ansible | 06:13 | |
*** cjloader has joined #openstack-ansible | 06:14 | |
*** udesale has quit IRC | 06:16 | |
*** vnogin has joined #openstack-ansible | 06:17 | |
*** cjloader has quit IRC | 06:18 | |
*** haad1 has joined #openstack-ansible | 06:18 | |
*** vnogin has quit IRC | 06:22 | |
*** udesale_ has quit IRC | 06:38 | |
*** udesale has joined #openstack-ansible | 06:39 | |
*** fghaas has joined #openstack-ansible | 06:50 | |
evrardjp | cloudnull: oh bummer | 06:58 |
fghaas | #success I just wanted to mention that I ran run-upgrade.sh for the first time last night (for a pike→queens upgrade), having only used the individual upgrade playbooks before, and holy cow it's awesome. I kicked that thing off in a screen session, and didn't touch it again until after the upgrade was complete. Awesome work everyone! | 06:59 |
openstackstatus | fghaas: Added success to Success page (https://wiki.openstack.org/wiki/Successes) | 06:59 |
*** jwitko has quit IRC | 06:59 | |
*** armaan has joined #openstack-ansible | 07:00 | |
evrardjp | fghaas: a lot of effort was done in making sure this is well tested and working, but it's an ongoing effort. | 07:00 |
evrardjp | thanks for the kind words | 07:00 |
*** udesale_ has joined #openstack-ansible | 07:03 | |
*** udesale__ has joined #openstack-ansible | 07:05 | |
*** haad1 has quit IRC | 07:07 | |
*** udesale has quit IRC | 07:07 | |
*** udesale_ has quit IRC | 07:09 | |
*** haad1 has joined #openstack-ansible | 07:13 | |
fghaas | evrardjp: filed https://bugs.launchpad.net/openstack-ansible/+bug/1759784 per your request | 07:27 |
openstack | Launchpad bug 1759784 in openstack-ansible "Gate jobs don't cover Glance image upload to file store" [Undecided,New] | 07:27 |
evrardjp | thanks! | 07:41 |
*** haad1 has joined #openstack-ansible | 07:41 | |
*** ibmko has quit IRC | 07:44 | |
fghaas | Actually, one question about run-upgrade.sh: It looks as though from pike to queens, nova-{conductor,scheduler,consoleauth} were all consolidated into one LXC container when previously they used three. That leaves me with http://paste.openstack.org/show/717632/ — are the original containers (1, 2, 5) safe to discard and if so, should the run-upgrade.sh script do that? | 07:44 |
*** hamza21 has joined #openstack-ansible | 07:44 | |
*** udesale has joined #openstack-ansible | 07:45 | |
fghaas | Same for Cinder, by the way, where cinder-scheduler is now lumped in with the API container. | 07:45 |
*** udesale__ has quit IRC | 07:47 | |
fghaas | (Unless I missed something, https://docs.openstack.org/releasenotes/openstack-ansible/queens.html happens to be silent on the above.) | 07:49 |
*** electrofelix has joined #openstack-ansible | 07:54 | |
*** haad1 has joined #openstack-ansible | 07:57 | |
*** bhujay has quit IRC | 08:07 | |
openstackgerrit | Kevin Lefevre proposed openstack/openstack-ansible stable/queens: Add support for Horizon Octavia Dashboard https://review.openstack.org/556979 | 08:08 |
*** DanyC has quit IRC | 08:09 | |
*** DanyC has joined #openstack-ansible | 08:10 | |
*** aruns__ has joined #openstack-ansible | 08:12 | |
*** chyka has joined #openstack-ansible | 08:12 | |
*** DanyC has quit IRC | 08:14 | |
*** ibmko has joined #openstack-ansible | 08:14 | |
*** aruns has quit IRC | 08:16 | |
*** chyka has quit IRC | 08:17 | |
*** aruns has joined #openstack-ansible | 08:20 | |
*** aruns__ has quit IRC | 08:22 | |
*** admin0 has quit IRC | 08:26 | |
*** DanyC has joined #openstack-ansible | 08:34 | |
*** bhujay has joined #openstack-ansible | 08:35 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [WIP] Developer docs refactor https://review.openstack.org/557650 | 08:47 |
*** aruns has quit IRC | 08:49 | |
*** bhujay has quit IRC | 08:49 | |
*** aruns has joined #openstack-ansible | 08:54 | |
niraj_singh | evrardjp: masakari also need pacemaker to install along with it. So can we use this role ref:https://github.com/devgateway/ansible-role-pacemaker for pacemaker? | 08:55 |
evrardjp | yes you can re-use external roles, as long as they match our guidelines | 08:55 |
niraj_singh | ok | 08:55 |
evrardjp | this one is not matching our guidelines though | 08:56 |
niraj_singh | https://github.com/leucos/ansible-pacemaker-corosync is this one | 08:56 |
evrardjp | it doesn't look multi distro | 08:56 |
evrardjp | let me check that one | 08:56 |
niraj_singh | ok | 08:56 |
evrardjp | maybe worth checking with redhat or suse, they may have something around | 08:57 |
evrardjp | but yes you can reuse one | 08:57 |
evrardjp | maybe use the first one at the beginning | 08:57 |
niraj_singh | ok | 08:58 |
evrardjp | so that you have something to start with | 08:58 |
niraj_singh | yes :) | 08:58 |
evrardjp | and think about how it can be re-used | 08:58 |
evrardjp | please adapt the spec | 08:58 |
evrardjp | now you have an external dependency | 08:58 |
evrardjp | and new roles that need to be applied, and things like that | 08:59 |
niraj_singh | ooh yes. i will do that. | 08:59 |
niraj_singh | i also updated github repo: https://github.com/NirajSingh90/openstack-ansible-os_masakari/tree/masakari-engine this branch include masakari-api and masakari-engine installation part. | 09:00 |
*** vnogin has joined #openstack-ansible | 09:00 | |
*** cjloader has joined #openstack-ansible | 09:06 | |
*** aruns has quit IRC | 09:07 | |
*** aruns has joined #openstack-ansible | 09:08 | |
*** gkadam has joined #openstack-ansible | 09:09 | |
*** kukacz_ has joined #openstack-ansible | 09:10 | |
*** gkadam_ has joined #openstack-ansible | 09:10 | |
*** bhujay has joined #openstack-ansible | 09:10 | |
*** cjloader has quit IRC | 09:11 | |
*** gkadam has quit IRC | 09:13 | |
*** hamza21 has quit IRC | 09:19 | |
*** bhujay has quit IRC | 09:27 | |
*** bhujay has joined #openstack-ansible | 09:27 | |
*** yifei1 has quit IRC | 09:32 | |
*** kukacz_ has quit IRC | 09:41 | |
*** kukacz_ has joined #openstack-ansible | 09:42 | |
*** stuartgr has quit IRC | 09:43 | |
*** stuartgr has joined #openstack-ansible | 09:43 | |
evrardjp | niraj_singh: so you went for a single repo doing both things at the end? It's fine for me, just wondering what is the separation | 09:45 |
evrardjp | I guess I will re-read the spec as soon as I can :) | 09:45 |
niraj_singh | evrardjp: sorry but i am not clear about the sigle role for both masakari and masakari monitors till now. Discussion going on here. | 09:46 |
niraj_singh | but the depepndencies is like this: Masakari-monitors should be installed after masakari is installed as it monitors compute hosts and submits notifications to masakari. And the sequence will be same in upgrade case. | 09:47 |
niraj_singh | evrardjp: till now i didn't updated the specs. i will do that as per decision. | 09:48 |
odyssey4me | evrardjp do you think we should revert https://review.openstack.org/551344 for now until we figure out build/storage delegation? | 09:49 |
*** kukacz_ is now known as kukacz | 09:52 | |
odyssey4me | evrardjp another option could be to try and change the integrated build to use online constraints instead of the repo build constraints, at least for now - we can evolve it later again... but given that the run_tests.sh patch hasn't merged yet, we'd end up having to combine things which isn't great | 09:56 |
odyssey4me | what's weird, though, is that the package it's looking for was in the repo :/ | 09:57 |
evrardjp | odyssey4me: that's exactly what I told you in the past, sometimes it might look like it's working but fetches things outside which sometimes fail | 09:58 |
evrardjp | but I haven't any evidence, so... | 09:58 |
evrardjp | it's a large body of work now | 09:59 |
evrardjp | the revert will be hard, isn't it? | 09:59 |
odyssey4me | nope, just one merge so far | 09:59 |
evrardjp | then it's maybe wise indeed | 09:59 |
evrardjp | you -2 the others? | 10:00 |
odyssey4me | they're all -w already | 10:00 |
evrardjp | ok | 10:00 |
evrardjp | what if someone adds a +w ? | 10:00 |
evrardjp | the -w wins? | 10:01 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: Revert "Use a common python build/install role for source-base deployment" https://review.openstack.org/557667 | 10:01 |
odyssey4me | yep | 10:01 |
evrardjp | k | 10:01 |
evrardjp | -2 is explicit though | 10:01 |
odyssey4me | I can -2 them if you'd feel more comfortable | 10:01 |
evrardjp | but ok | 10:01 |
evrardjp | no that's fine, if nobody rebases will be good | 10:01 |
evrardjp | we* | 10:01 |
evrardjp | so we have to think about what went right and what went wrong? | 10:01 |
evrardjp | I'd like to finish what I am busy with, and then I can help you with that | 10:02 |
*** cjloader has joined #openstack-ansible | 10:06 | |
*** cjloader has quit IRC | 10:11 | |
odyssey4me | logan- cloudnull I see that https://review.openstack.org/557545 went in, but no explanation for the revert | 10:14 |
odyssey4me | evrardjp it looks like all the nova upgrade tests are pretty much broken due to the same issue with UCA | 10:22 |
odyssey4me | this is an ocata->pike: http://logs.openstack.org/88/551688/2/check/openstack-ansible-upgrade-ubuntu-xenial/bf2649a/job-output.txt.gz#_2018-03-29_08_50_28_165599 | 10:22 |
odyssey4me | I may as well make them all non-voting for now until we work out how to improve the tests | 10:22 |
evrardjp | GRRRRRRRRRRRRRRRR I just did git checkout -- filename1 . | 10:22 |
evrardjp | instead of git checkout -- filename1 | 10:23 |
evrardjp | all my work | 10:23 |
evrardjp | gone | 10:23 |
evrardjp | :( | 10:23 |
odyssey4me | wow, that was a fail | 10:23 |
*** savvas has joined #openstack-ansible | 10:23 | |
evrardjp | at least I have the generated html | 10:24 |
evrardjp | **** **** ****! | 10:24 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/pike: Switch upgrade test to non-voting https://review.openstack.org/557674 | 10:24 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/pike: Switch upgrade test to non-voting https://review.openstack.org/557674 | 10:24 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/pike: Omit default_schedule_zone if its not configured https://review.openstack.org/551688 | 10:26 |
*** hamza21 has joined #openstack-ansible | 10:26 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova stable/pike: change python-libguestfs to python-guestfs for ubuntu https://review.openstack.org/551972 | 10:26 |
*** haad1 has quit IRC | 10:27 | |
openstackgerrit | Merged openstack/openstack-ansible stable/queens: [Docs] Simplify overview page https://review.openstack.org/555371 | 10:28 |
openstackgerrit | Merged openstack/openstack-ansible stable/queens: [Docs] Adapt the wording for disk requirements https://review.openstack.org/556360 | 10:31 |
openstackgerrit | Merged openstack/openstack-ansible stable/queens: [Docs] Uniform image on top https://review.openstack.org/555763 | 10:31 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ceilometer master: Convert role to use a common systemd service role https://review.openstack.org/556977 | 10:32 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_aodh master: Convert role to use a common systemd service role https://review.openstack.org/552062 | 10:33 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_barbican master: Convert role to use a common systemd service role https://review.openstack.org/552071 | 10:37 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_barbican master: Convert role to use a common systemd service role https://review.openstack.org/552071 | 10:37 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [WIP] Developer docs refactor https://review.openstack.org/557650 | 10:44 |
*** Sha0000 has joined #openstack-ansible | 10:44 | |
evrardjp | odyssey4me: oh you said ALL the nova upgrade issues are UCA issues, due to the way we do things? | 10:45 |
evrardjp | mean* | 10:45 |
odyssey4me | yup | 10:50 |
odyssey4me | newton->ocata is already non-voting due to the issue, as is pike->queens... now ocata->pike is showing the same issue | 10:50 |
odyssey4me | queens->master use the same UCA for now, so that's still voting | 10:50 |
odyssey4me | I'll have to find some time to progress https://review.openstack.org/551791 so that we can use that for upgrade tests in roles | 10:51 |
*** haad1 has joined #openstack-ansible | 10:53 | |
*** Sha0000 has quit IRC | 10:55 | |
fghaas | odyssey4me, evrardjp: if one of you has thoughts on the run-upgrade.sh container question I mentioned earlier, I'd be grateful for them — whenever you can spare the time of course, no rush. | 11:02 |
odyssey4me | fghaas ah yes, the container removal is left up to the deployer - although quite honestly it could be automated into run-upgrade.sh I think | 11:04 |
odyssey4me | we just haven't had anyone pick that work up | 11:04 |
odyssey4me | care to volunteer? ;) | 11:04 |
*** gunix has left #openstack-ansible | 11:05 | |
fghaas | okay but the expectation is definitely that the containers are safe to remove? If so, I would have volunteered for adding that to the Queens release notes, at least — until it's been rolled into a script or playbook. | 11:05 |
odyssey4me | hmm, weird - I would have sworn that there was a reno for this | 11:05 |
* odyssey4me hunts down the commit | 11:06 | |
fghaas | I'm looking at https://docs.openstack.org/releasenotes/openstack-ansible/queens.html — wrong place perhaps? | 11:06 |
odyssey4me | https://github.com/openstack/openstack-ansible/commit/1200ee1bee4a1fb2d682c0f73944f1b4d5902acd#diff-9e3e0d580f558afc6cf9066758f4524b | 11:07 |
odyssey4me | https://github.com/openstack/openstack-ansible/commit/330dcd376c2709d268501a9783365ada04023292#diff-9e3e0d580f558afc6cf9066758f4524b | 11:07 |
odyssey4me | looks like the first had no reno, so yeah - if you could put together a reno for that it'd be great | 11:07 |
*** ansmith has quit IRC | 11:07 | |
fghaas | Yeah those only talk about Neutron agents though :) | 11:08 |
odyssey4me | we could figure out a run_upgrade sequence for the clean up too - that's supposed to have been done by cloudnull but hasn't happened | 11:08 |
fghaas | Okay so the other services affected are Nova, Cinder, Trove, and Heat? Any others? | 11:09 |
odyssey4me | neutron_agents (not server) | 11:09 |
odyssey4me | ironic | 11:09 |
odyssey4me | ironic_conductor -> ironic_server | 11:10 |
*** DanyC has quit IRC | 11:10 | |
odyssey4me | there may also be entirely new containers, where old api containers can be removed | 11:10 |
*** DanyC has joined #openstack-ansible | 11:10 | |
openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Update the old http links in docs https://review.openstack.org/550673 | 11:11 |
odyssey4me | eg I think there's a new nova container whichi replaces all the old ones | 11:11 |
odyssey4me | it looks like it converged to a standard default set of <service>_api_container | 11:12 |
*** DanyC has quit IRC | 11:15 | |
evrardjp | I have to think about planning, what do we need to land first. I am stretched in too many places, and I want stuff included before M1 | 11:25 |
openstackgerrit | Merged openstack/openstack-ansible-haproxy_server master: Options to enable SSL for backend connections https://review.openstack.org/549834 | 11:30 |
logan- | fghaas odyssey4me: ya without the cleanup ive seen a huge spike in memory usage after upgrading to queens due to 2 nova api/placements, etc. running on each host. aside from the container cleanup you'll also need to cleanup all of the service agents in openstack also | 11:30 |
logan- | odyssey4me: regarding the revert, cloudnull and I were looking into the failures on https://review.openstack.org/#/c/556994/ where it was failing after setup-hosts but before setup-infra | 11:32 |
fghaas | logan- yep, true, unless you're cool with seeing a lot of down services/agents | 11:33 |
logan- | if you scroll to the bottom of http://logs.openstack.org/94/556994/1/check/openstack-ansible-deploy-aio_lxc-ubuntu-xenial/dff3675/logs/openstack/ansible-logging/facts-all.log.txt.gz, you can see there is an a connection issue with the containers that causes fact collection to fail | 11:33 |
*** chyka has joined #openstack-ansible | 11:34 | |
logan- | fghaas: ya for the most part that is the extent of the impact, but its a little worse with neutron because I saw it scheduling extra dhcp agents and HA routers on all of these agents | 11:35 |
odyssey4me | logan- aha, so that was the culprit - wonder why | 11:35 |
odyssey4me | logan- an explanation in the commit message next time is a useful reference ;) | 11:36 |
logan- | odyssey4me: ya not sure, interesting that it works in the plugins gate but breaks integrated. will have to do some more debugging on it and figure it out. | 11:36 |
*** hamza21 has quit IRC | 11:37 | |
odyssey4me | logan- fghaas it'd be really good to put together the steps to do all the clean up and get it documented in the upgrade guide | 11:37 |
*** hamza21 has joined #openstack-ansible | 11:38 | |
odyssey4me | I'd be happy to actually put the patch together if we could perhaps crowd-source an etherpad with the steps | 11:38 |
fghaas | logan-: you mean you were afflicted by the fact that the Neutron agents lived in a container on the network node, and now no longer do? That one issue doesn't touch me, because I've always overridden that and had the server container on the shared infra host, and the agents container-less on the gateway nodes. :) | 11:38 |
odyssey4me | perhaps you guys could put together a quick off-the-cuff set of notes now? | 11:38 |
logan- | correct fghaas, no worries on that then. | 11:38 |
*** hamza21 has quit IRC | 11:39 | |
*** chyka has quit IRC | 11:39 | |
*** hamza21 has joined #openstack-ansible | 11:39 | |
fghaas | odyssey4me: I'm currently in the process of updating our training course for the Queens upgrade, when the lab instructions in that are done I can C&P those into an etherpad and you can grab what you'd like | 11:39 |
logan- | i have to run atm, but can help w/ that later today | 11:39 |
fghaas | Or, for that matter, I can just give you access to the course :) | 11:39 |
odyssey4me | awesome, thanks fghaas :) | 11:39 |
odyssey4me | haha, that'd be awesome - happy to beta test it for you ;) | 11:40 |
fghaas | You just said that in front of witnesses | 11:40 |
fghaas | So I'm definitely taking you up on that | 11:40 |
odyssey4me | :) | 11:41 |
evrardjp | haha | 11:42 |
odyssey4me | given that my openstack knowldge is a bit dated, I might learn some new tricks :) | 11:43 |
*** hamza21 has quit IRC | 11:43 | |
*** hamza21 has joined #openstack-ansible | 11:43 | |
* fghaas is waiting for mhayden to inject a "pfffft eyeroll c'mon" gif here | 11:45 | |
*** udesale has quit IRC | 11:46 | |
*** gkadam_ has quit IRC | 11:46 | |
*** udesale has joined #openstack-ansible | 11:46 | |
*** gkadam_ has joined #openstack-ansible | 11:47 | |
*** armaan has quit IRC | 11:48 | |
*** armaan has joined #openstack-ansible | 11:48 | |
*** Sha000000 has joined #openstack-ansible | 11:52 | |
*** strobelight has joined #openstack-ansible | 11:59 | |
evrardjp | that's not a bad idea for a user refresh | 12:03 |
evrardjp | we need to know what they are doing with this thing we are building :p | 12:03 |
evrardjp | odyssey4me: what do you think of having an entry in tox.ini for the integrated repo, as "functional", which would call gate-check-commit ? | 12:05 |
evrardjp | this way our only interface is run_tests | 12:05 |
evrardjp | and ofc I am writing the docs and it sounds weird we have something different for the integrated repo | 12:06 |
evrardjp | for later... | 12:07 |
*** armaan has quit IRC | 12:11 | |
*** armaan has joined #openstack-ansible | 12:11 | |
*** udesale_ has joined #openstack-ansible | 12:14 | |
*** DanyC has joined #openstack-ansible | 12:16 | |
*** udesale has quit IRC | 12:16 | |
*** throwsb1 has joined #openstack-ansible | 12:16 | |
openstackgerrit | Merged openstack/openstack-ansible-os_octavia stable/queens: Update systemd service for longer TimeoutStopSec https://review.openstack.org/555895 | 12:17 |
*** udesale_ has quit IRC | 12:19 | |
*** haad1 has quit IRC | 12:19 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: Revert "Use a common python build/install role for source-base deployment" https://review.openstack.org/557667 | 12:25 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [WIP] Developer docs refactor https://review.openstack.org/557650 | 12:25 |
*** haad1 has joined #openstack-ansible | 12:25 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: Revert "Use a common python build/install role for source-base deployment" https://review.openstack.org/557667 | 12:26 |
odyssey4me | any cores around - this unblocks the pike os_nova gate: https://review.openstack.org/557674 | 12:28 |
*** strobelight_ has joined #openstack-ansible | 12:28 | |
*** strobelight is now known as Guest24189 | 12:28 | |
odyssey4me | also, this helps unblock the integrated gate: https://review.openstack.org/557667 | 12:29 |
*** strobelight_ is now known as strobelight | 12:29 | |
*** tnogisto2 has joined #openstack-ansible | 12:32 | |
*** Guest24189 has quit IRC | 12:32 | |
*** tnogisto2 has quit IRC | 12:32 | |
*** tnogisto2 has joined #openstack-ansible | 12:32 | |
odyssey4me | evrardjp using tox for the integrated gate doesn't work - I tried it before | 12:34 |
evrardjp | k | 12:34 |
*** tnogisto has quit IRC | 12:35 | |
odyssey4me | that said, I'm working on a tool to read the zuul job config and spit out the things it specifies so that we can remove tox and just use the zuul job config as a single reference for test definition and running | 12:35 |
odyssey4me | so basically it will be ansible all the way | 12:35 |
evrardjp | yay | 12:35 |
odyssey4me | I have a very hacky tool done - I'm just working out the recursion bits to resolve the job parent-child hierarchy so that we have a full data set for each job. | 12:36 |
evrardjp | I will just mention the current state in our docs, and hope we'll not forget to update the docs | 12:36 |
evrardjp | if you need help, don't hesitate | 12:36 |
odyssey4me | ja, I'm trying to just hack it for now - once I have something working I'll push up a patch for iteration | 12:37 |
odyssey4me | that's my weekend fun with python hobby | 12:37 |
*** haad1 has quit IRC | 12:38 | |
*** electrofelix has quit IRC | 12:46 | |
*** haad1 has joined #openstack-ansible | 12:53 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: Developer docs refactor https://review.openstack.org/557650 | 12:57 |
*** odyssey4me has quit IRC | 12:57 | |
*** odyssey4me has joined #openstack-ansible | 12:57 | |
evrardjp | ok when https://review.openstack.org/#/c/552004/6 and ^ will pass, the documentation would be fully rewritten as wizard like stuff, and should help on the onboarding. All the usual questions are now answered. | 12:58 |
*** ansmith has joined #openstack-ansible | 12:58 | |
*** niraj_singh_ has joined #openstack-ansible | 13:00 | |
odyssey4me | looks like https://review.openstack.org/#/c/552004/6 still needs work | 13:00 |
*** niraj_singh_ has quit IRC | 13:01 | |
odyssey4me | evrardjp I see that newton-eol is now done in the roles - time for a final sha bump in the integrated repo? | 13:05 |
evrardjp | I planned to do this with the rest on friday | 13:06 |
odyssey4me | ah ok, that'll do | 13:06 |
*** kstev has joined #openstack-ansible | 13:09 | |
evrardjp | odyssey4me: that's why I didn't want to do the synchronize and copy tasks | 13:10 |
evrardjp | talking about the two patchsets for delegations | 13:10 |
evrardjp | if the venv building is just about building we can point to any host | 13:11 |
evrardjp | then we know it's producing a result on THAT host | 13:11 |
evrardjp | the orchestration should be done elsewhere | 13:11 |
odyssey4me | sure, but we also have to get the venv to the target host - so somehow that has to be copied | 13:11 |
evrardjp | to not mess up with complex things like we do | 13:11 |
evrardjp | yes that's fine, let's say that we include this in the role, but don't put that into the role execution path | 13:12 |
*** kstev1 has joined #openstack-ansible | 13:12 | |
evrardjp | we can have another series of tasks for fetching, and another series of tasks for pushing | 13:12 |
evrardjp | so instead of calling the role once, we call it three times | 13:12 |
*** savvas has quit IRC | 13:12 | |
evrardjp | delegation would be done not in the role, which starts to be messy, but at the orchestration level (the playbook) | 13:13 |
evrardjp | here it would still be a role though, because it's a role that calls the role. | 13:13 |
odyssey4me | so you're suggesting that build just builds it on whichever host, then install either downloads it from a url or copies it from the deploy host (whichever option is enabled) | 13:13 |
*** savvas has joined #openstack-ansible | 13:13 | |
*** kstev has quit IRC | 13:13 | |
evrardjp | I'd hope it would be possible to merge those last two actions into one | 13:14 |
evrardjp | deploy host being an url with ssh:// or whatever | 13:15 |
evrardjp | scp | 13:15 |
odyssey4me | well, that can be an option - but it doesn't have to be - they're two different methods of serving the file | 13:15 |
evrardjp | sfp | 13:15 |
evrardjp | sftp* | 13:15 |
evrardjp | yeah but we can do it in a smart way, and this is far simpler to understand? | 13:15 |
odyssey4me | scp/sftp would require openssh on the host serving it, which I don't think we should *require* | 13:15 |
evrardjp | maybe we should discuss the approach with other ppl? | 13:16 |
odyssey4me | but yeah, I was thinking that we could do something like that instead | 13:16 |
evrardjp | I like the idea of "I build there", "I fetch from there" | 13:17 |
evrardjp | which is simple | 13:17 |
evrardjp | but you have to split the thing in two | 13:17 |
evrardjp | I should have said | 13:17 |
evrardjp | "I build here", "I fetch from there" | 13:18 |
evrardjp | so splitting in two would allow an easy definition of "here" and "there" | 13:18 |
odyssey4me | well, regardless of whether it's a single path or two - it can still work in a single path as long as there're two actions ultimately | 13:18 |
evrardjp | I guess that if the venv build is done inside the role call, we'll have no choice than to have variables to define the target. | 13:20 |
evrardjp | targets | 13:20 |
*** hamza21 has quit IRC | 13:22 | |
*** tnogisto2 has quit IRC | 13:23 | |
*** savvas has quit IRC | 13:24 | |
*** savvas has joined #openstack-ansible | 13:24 | |
*** tnogisto has joined #openstack-ansible | 13:25 | |
odyssey4me | well, clearly what I was trying to do isn't going to work - I was hoping to distribute the build process out to target nodes, but have the results collected back to a designated storage host | 13:27 |
odyssey4me | I thought that this was a good way of ensuring that we didn't have to have multiple build hosts for each distro/arch combination | 13:28 |
*** esberglu has joined #openstack-ansible | 13:28 | |
odyssey4me | and also to distribute the computing power for the builds | 13:28 |
odyssey4me | using synchronize just doesn't work through when delegating | 13:28 |
odyssey4me | nor does copy/fetch | 13:28 |
evrardjp | maybe we are trying to solve too many things with ansible | 13:29 |
*** niraj_singh has quit IRC | 13:31 | |
*** jwitko has joined #openstack-ansible | 13:34 | |
evrardjp | delegate the build with a var is quite simple to understand | 13:34 |
evrardjp | let me analyse these two patches once again | 13:35 |
*** aruns has quit IRC | 13:39 | |
evrardjp | I just don't get cloudnull 's patch. Maybe I am dumb. | 13:40 |
*** ibmko has quit IRC | 13:40 | |
evrardjp | cloudnull: why the venv_pip_build_target == inventory_hostname ? | 13:40 |
evrardjp | I'd say the other way around, you have to sync when you don't have it yet | 13:41 |
mattt | odyssey4me evrardjp : should these SHAs not match? https://github.com/openstack/openstack-ansible-os_tempest/blob/stable/queens/defaults/main.yml#L30 https://github.com/openstack/openstack-ansible-tests/blob/stable/queens/test-vars.yml#L417 | 13:42 |
mattt | i'm noticing differing behaviours running tempest as part of integrated repo versus as a role functional test | 13:43 |
evrardjp | we should probably remove one of those | 13:43 |
odyssey4me | mattt the test-vars value will override the default | 13:43 |
evrardjp | mattt: the tempest sha in the integrated is in defauts/ blablabla | 13:44 |
odyssey4me | mattt and the integrated build will use https://github.com/openstack/openstack-ansible/blob/stable/queens/playbooks/defaults/repo_packages/openstack_testing.yml#L30 | 13:44 |
evrardjp | yeah | 13:44 |
odyssey4me | so yes, ideally they should match to the right one | 13:44 |
evrardjp | well once might wonder why we have both set, if we can just have it one in defaults :) | 13:45 |
odyssey4me | we pin the sha for stable branches so that changes upstream don't affect the stable branches as they progress development on master | 13:45 |
odyssey4me | evrardjp the one in test-vars is so that all other role tests get the same, but yeah I guess we could remove it and let the defaults carry | 13:45 |
evrardjp | let me remove it from the tests repo see what breaks | 13:45 |
evrardjp | yeah | 13:45 |
odyssey4me | in fact, I think that makes sense to do | 13:46 |
evrardjp | Sometimes I make sense! | 13:46 |
evrardjp | hahah | 13:46 |
odyssey4me | only sometimes :p | 13:46 |
odyssey4me | hopefully quite soon we'll be able to just define the sha's used in roles - and the integrated repo values will be optional | 13:47 |
odyssey4me | then it'll be much, much simpler | 13:47 |
mattt | oh shoot, forgot about that other SHA! | 13:47 |
*** gameon has joined #openstack-ansible | 13:48 | |
*** indistylo has joined #openstack-ansible | 13:50 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-tests stable/queens: Remove os_tempest defaults https://review.openstack.org/557711 | 13:52 |
*** gameon has quit IRC | 13:53 | |
evrardjp | let's see what breaks and fix it case by case ^ | 13:53 |
mattt | i still definitely have different versions of tempest installed tho | 13:53 |
*** udesale has joined #openstack-ansible | 13:53 | |
evrardjp | your host is used for different builds? | 13:53 |
evrardjp | because a search before patching show a tangled mess of overrides | 13:54 |
mattt | nope, separate AIOs, one for integrated build and one for functional test of os_tempest role | 13:54 |
evrardjp | and your os_tempest got 2 venvs? | 13:55 |
evrardjp | or did I misunderstood you? | 13:55 |
mattt | integrated: /openstack/venvs/tempest-17.0.0/lib/python2.7/site-packages/tempest-18.0.0.dist-info functional: /openstack/venvs/tempest-17.0.0/lib/python2.7/site-packages/tempest-18.0.0.dist-info | 13:56 |
mattt | let me try that again :) | 13:56 |
openstackgerrit | Merged openstack/openstack-ansible-os_nova stable/pike: Switch upgrade test to non-voting https://review.openstack.org/557674 | 13:56 |
mattt | integrated: /openstack/venvs/tempest-17.0.0/lib/python2.7/site-packages/tempest-18.0.0.dist-info functional: /opt/tempest_70ebe69cc2e4fa8a06071d48d19f61d2f01a33f6/lib/python2.7/site-packages/tempest-17.2.1.dev229-py2.7.egg-info | 13:56 |
*** savvas has quit IRC | 13:57 | |
evrardjp | so | 13:57 |
evrardjp | for the path, it's all about the venv tag, which can mean nothing | 13:58 |
evrardjp | for the integrated, we use the release version | 13:58 |
evrardjp | which is more explicit | 13:58 |
evrardjp | for what's inside the venv, that depends on the defaults/ tempest sha | 13:59 |
*** udesale has quit IRC | 13:59 | |
evrardjp | and therefore I guess you have precisely the queens version | 13:59 |
evrardjp | for the functional test, you had the override which be a little older | 13:59 |
evrardjp | because forgot to be bumped | 13:59 |
evrardjp | so it means you have a version that's got 229 commits since last tag. | 14:00 |
evrardjp | (at least to my knowledge of setuptools) | 14:00 |
*** savvas has joined #openstack-ansible | 14:00 | |
mattt | ok cool | 14:01 |
mattt | so that patch you put up should bring them in line then | 14:01 |
odyssey4me | I think we should probably try to converge on using released versions of tempest by default, and having the git sourced build be an opt-in | 14:01 |
odyssey4me | we're not able to follow tempest changes closely enough to warrant always building from git source | 14:02 |
evrardjp | odyssey4me: I think we can use a tempest tag instead of a tempest sha | 14:02 |
evrardjp | for the role defaults | 14:02 |
*** dave-mccowan has joined #openstack-ansible | 14:02 | |
odyssey4me | why bother using a tag when we can install from pip ;) | 14:02 |
mattt | it's funny, because in that slight discrepancy tempest went from using testrepository to stestr, and my role changes didn't work as expected but did in the integrated build | 14:03 |
mattt | so i was kinda confused | 14:03 |
odyssey4me | also, u-c can manage the constraint for us: https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L341 | 14:03 |
*** ibmko has joined #openstack-ansible | 14:03 | |
*** armaan has quit IRC | 14:03 | |
odyssey4me | see also https://github.com/openstack/requirements/blob/stable/pike/upper-constraints.txt#L358 | 14:04 |
evrardjp | odyssey4me: I am not sure where we differ :p | 14:04 |
evrardjp | we are already installing with pi | 14:04 |
evrardjp | pip | 14:04 |
odyssey4me | evrardjp I'm saying that we make the use of a git source entirely optional fir the tempest role - we just let u-c take its course | 14:05 |
evrardjp | oh no version at all? | 14:06 |
evrardjp | let's talk with code, shall we? | 14:06 |
odyssey4me | yes, we inherit a version from u-c so we don't need to specify it | 14:06 |
odyssey4me | ok, lemme propose something and we take it from there | 14:06 |
evrardjp | https://github.com/openstack/openstack-ansible-os_tempest/blob/stable/queens/tasks/tempest_install.yml#L87 | 14:07 |
mattt | nice, dropping the lingua franca | 14:07 |
*** savvas has quit IRC | 14:07 | |
mattt | evrardjp: re-running my test with your patch applied | 14:08 |
*** savvas has joined #openstack-ansible | 14:08 | |
evrardjp | odyssey4me: keep in mind we need the version of tempest to be able to work with plugins, but that should be alright. But there is a risk of reduced coverage if we are setting a moving target | 14:08 |
evrardjp | mattt: it will probably break :p | 14:08 |
evrardjp | but let's see | 14:08 |
evrardjp | also you'd still have a difference | 14:09 |
mattt | evrardjp: shush, it's going to be ok | 14:09 |
mattt | :) | 14:09 |
evrardjp | you should add a patch on os_tempest | 14:09 |
evrardjp | to bump its version | 14:09 |
evrardjp | or wait for odyssey4me 's patch | 14:09 |
odyssey4me | mattt go ahead and make changes to the queens branch to figure out the right sha | 14:10 |
odyssey4me | whatever I do will have to go through some motions and get agreement, which takes time | 14:10 |
evrardjp | fair point | 14:10 |
evrardjp | I'm also changing tempest, so it might be good working all together. | 14:10 |
evrardjp | Team team team! | 14:10 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest master: [TEST] Disable developer mode for tempest https://review.openstack.org/557719 | 14:13 |
evrardjp | odyssey4me: we seemed to be in disagreement, but your commit message is exactly what I thought we should be doing. | 14:15 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: [TEST] Disable developer mode for tempest https://review.openstack.org/557720 | 14:16 |
evrardjp | Later we can just trim the content of the role | 14:16 |
odyssey4me | I don't think we should get rid of the ability to use a later tempest - I just think our default should not use that mode. | 14:16 |
cloudnull | evrardjp: [08:40] why the venv_pip_build_target == inventory_hostname? -- what questions do you have? | 14:16 |
evrardjp | cloudnull: well -- I simply don't understand that condition | 14:17 |
evrardjp | let's give 2 use cases | 14:17 |
evrardjp | 1) you run everything on your metal node. | 14:17 |
evrardjp | 2) you have a repo machine where you want to build | 14:17 |
cloudnull | ok? | 14:17 |
evrardjp | case 1) venv_pip_build_target == inventory_hostname but you don't want to sync | 14:17 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [TEST] Disable developer mode for tempest https://review.openstack.org/557723 | 14:18 |
evrardjp | case 2) venv_pip_build_target != inventory_hostname and you want to sync | 14:18 |
evrardjp | what do I get wrong? | 14:18 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [TEST] Disable developer mode for tempest https://review.openstack.org/557723 | 14:18 |
cloudnull | thats in reverse | 14:18 |
odyssey4me | cloudnull mind reviewing this quick? https://review.openstack.org/557667 | 14:19 |
cloudnull | if venv_pip_build_target == inventory_hostname sync the bits | 14:19 |
evrardjp | why ? | 14:19 |
evrardjp | that's the part I don't get | 14:19 |
evrardjp | maybe we are talking about two different things | 14:19 |
cloudnull | if the build target is the inventory host name your building everything on your target host. | 14:20 |
evrardjp | why would I want to synchronize on something I already have? | 14:20 |
cloudnull | thats whats there today | 14:20 |
cloudnull | If i change the build target I dont need to sync builds will always happen elsewhere | 14:20 |
evrardjp | maybe but that's the part I don't get | 14:20 |
evrardjp | but why then? | 14:21 |
odyssey4me | evrardjp no need to sync if the build target is always the same | 14:21 |
cloudnull | theres no need to push and pull bits between the deployment host and the target hsot | 14:21 |
evrardjp | Because the install then needs the venvs, so syncing should happen | 14:21 |
openstackgerrit | Merged openstack/openstack-ansible-os_nova stable/pike: Omit default_schedule_zone if its not configured https://review.openstack.org/551688 | 14:21 |
cloudnull | the build will always happen elsewhere | 14:21 |
odyssey4me | well yes, the venv is needed for the install - that should sync, not the wheels | 14:22 |
cloudnull | correct | 14:22 |
cloudnull | that part remains | 14:22 |
evrardjp | omg | 14:22 |
evrardjp | it's just for wheels | 14:22 |
evrardjp | terrible naming | 14:22 |
evrardjp | that's very confusing | 14:22 |
cloudnull | its the wheels and venvs | 14:22 |
odyssey4me | cloudnull what I don't get then, is why not use the playbook to target a build host, and do build only (there's a flag for it) | 14:22 |
evrardjp | this is harder than what it should | 14:23 |
odyssey4me | then later target the various hosts and it should just do the install | 14:23 |
odyssey4me | if we do that, there's no need to sync wheels at all | 14:23 |
odyssey4me | we go back to the simplicity | 14:24 |
odyssey4me | right now we're trying to do orchestration in a role, which never ends well | 14:24 |
evrardjp | agreed with odyssey4me there | 14:24 |
cloudnull | totally agree. | 14:24 |
cloudnull | but the proposed method is too slow | 14:25 |
evrardjp | ahah we all agree that we wrote bad things, let's make the world better with more bisounours | 14:25 |
cloudnull | sync'ing between the target and the deploy host is painfully slow | 14:25 |
odyssey4me | ok, so shall we pull the wheel sync out? | 14:25 |
*** SimAloo has joined #openstack-ansible | 14:25 | |
cloudnull | and we are building the same bits on every run | 14:26 |
odyssey4me | so that's a problem for the integrated build, yes | 14:26 |
cloudnull | its really no change for the role tests given the use of developer mode | 14:26 |
odyssey4me | so what I can do it break this into parts - and we don't merge a things until everything affecting the integrated build is ready | 14:27 |
*** armaan has joined #openstack-ansible | 14:27 | |
cloudnull | but running this code on my 5 node hardware lab shows its not viable in production | 14:27 |
odyssey4me | we can perhaps reduce the integrated build test down to the base kit for all platforms for now, to make it easier to get this in and remove the repo build | 14:28 |
odyssey4me | the problem here is that we're trying to run before we walk, so I think we should get all the pieces on the table before we merge anything | 14:28 |
evrardjp | what if... | 14:28 |
cloudnull | i think thats the problem, the repo build is a lot faster than this | 14:28 |
evrardjp | we buid a systemd service that does an inotify service to rsync between all the nodes of a same group? | 14:29 |
odyssey4me | we can do exactly the same in a different way by executing the repo-build in each service role playbook | 14:29 |
cloudnull | happy to take a performance hit for better usability but not one that extends a deployment by hours | 14:29 |
evrardjp | we build on the first node, and all the time it's synced. | 14:29 |
evrardjp | and we don't have to care about orchestration | 14:29 |
odyssey4me | can we get this revert done? https://review.openstack.org/557667 then give me time to get all the proposed pieces on the table | 14:30 |
cloudnull | evrardjp: first node of a particular distro and arch | 14:30 |
evrardjp | yes | 14:30 |
odyssey4me | I'll hold back any further stuff that touches the integrated build | 14:30 |
evrardjp | cloudnull: what do you think of that? completely different, and will scale easily | 14:31 |
odyssey4me | we *could* merge this one as a stop-gap, and have the integrated build use the deploy host as a build host for starters: https://review.openstack.org/557461 | 14:31 |
evrardjp | because if it doesn't scale, we can just change the tech to be better than rsync | 14:31 |
odyssey4me | the wheel sync sucks, let me pull that out again and use playbooks for orchestration | 14:33 |
evrardjp | good | 14:33 |
odyssey4me | the role should just simply build/deploy the venv - we keep it at that, it'll build the wheels to help speed things up - we then use a playbook to decide where to build the venvs | 14:37 |
odyssey4me | apologies, I should have actually realised that up front instead of wasting time on trying to orchestrate inside the role | 14:38 |
odyssey4me | <--- dumbass | 14:38 |
*** cjloader has joined #openstack-ansible | 14:38 | |
evrardjp | odyssey4me: I said that in the past :p | 14:39 |
evrardjp | hahah | 14:40 |
evrardjp | (you pick on what it applies) | 14:40 |
evrardjp | hint: all of the above. | 14:40 |
odyssey4me | yes, yes you told me so | 14:40 |
odyssey4me | https://media.giphy.com/media/xlGYf1RUbYYes/giphy.gif | 14:40 |
odyssey4me | you can thanks me later, now that you've got that picture in channel and no-one's talking :p | 14:46 |
*** hamzy has quit IRC | 14:46 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [Docs] Restructure inventory documentation https://review.openstack.org/552081 | 14:47 |
evrardjp | odyssey4me: answered on https://review.openstack.org/#/c/555880/2 | 14:49 |
evrardjp | haha | 14:50 |
evrardjp | should I ping the whole world with a link to that giffy? | 14:50 |
evrardjp | :p | 14:50 |
*** bhujay has quit IRC | 14:56 | |
*** chyka has joined #openstack-ansible | 14:58 | |
*** chyka has quit IRC | 15:02 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: Make docs be container agnostic https://review.openstack.org/552004 | 15:03 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: Make docs be container agnostic https://review.openstack.org/552004 | 15:03 |
evrardjp | I see there is activity in nova for the cells things | 15:04 |
*** MikeW has joined #openstack-ansible | 15:16 | |
openstackgerrit | Merged openstack/openstack-ansible-os_glance master: Revert "Use a common python build/install role for source-base deployment" https://review.openstack.org/557667 | 15:19 |
*** hamzy has joined #openstack-ansible | 15:22 | |
*** haad1 has quit IRC | 15:27 | |
*** chyka has joined #openstack-ansible | 15:33 | |
*** indistylo has quit IRC | 15:36 | |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [Docs] Restructure inventory documentation https://review.openstack.org/552081 | 15:37 |
*** armaan has quit IRC | 15:38 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/ansible-role-python_venv_build master: Revert the use of wheel synchronizing https://review.openstack.org/557744 | 15:39 |
odyssey4me | cloudnull evrardjp ^ as discussed - we pull the wheel sync bits out | 15:40 |
evrardjp | woot | 15:40 |
odyssey4me | now, one more feature - add the ability to source the venv from a URL instead of from the deploy host | 15:41 |
odyssey4me | then I think we're ready | 15:41 |
evrardjp | I will have to take a step back to think about if all is right | 15:42 |
evrardjp | but I think it's better that way | 15:42 |
odyssey4me | it does make it easier to transition, so I think this is a good approach | 15:43 |
*** haad1 has joined #openstack-ansible | 15:47 | |
*** haad1 has quit IRC | 15:47 | |
*** Sha000000 has quit IRC | 15:48 | |
evrardjp | odyssey4me: I think I have an idea on how to make it even more readable | 15:52 |
*** cjloader has quit IRC | 15:52 | |
evrardjp | the python_venv_build should be triggered by a boolean, which can be set in the playbook. By default it would be true on first node of the targetted group + arch + distro | 15:53 |
evrardjp | it's exactly the same thing | 15:53 |
odyssey4me | it is already doign a build on the first node | 15:53 |
evrardjp | but the condition is placed elsewhere | 15:53 |
odyssey4me | the boolean just forbids it from doing the install part | 15:53 |
evrardjp | yeah it's exactly the same code | 15:54 |
evrardjp | I am thinking as an external user right now | 15:54 |
odyssey4me | I think that whole bit might just come out later, because it's probably not needed | 15:54 |
odyssey4me | if you target at one host, it only does the build | 15:54 |
evrardjp | Or alternatively maybe a comment | 15:54 |
odyssey4me | so there's no real need to have a boolean to prevent the install | 15:55 |
evrardjp | that's not what I meant :) | 15:56 |
evrardjp | It's just a bonus for later anyway | 15:56 |
evrardjp | we have the whole cycle to figure this out | 15:56 |
*** RandomTech has joined #openstack-ansible | 15:59 | |
*** vnogin has quit IRC | 16:03 | |
openstackgerrit | Matthew Thode proposed openstack/openstack-ansible-specs master: create Designate back end provider spec https://review.openstack.org/556586 | 16:05 |
*** vnogin has joined #openstack-ansible | 16:05 | |
*** MikeW has quit IRC | 16:10 | |
*** vnogin has quit IRC | 16:10 | |
*** openstacking_123 has joined #openstack-ansible | 16:11 | |
openstacking_123 | Hope is well | 16:11 |
openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-plugins master: Fix delegation to hosts not in inventory https://review.openstack.org/550665 | 16:11 |
openstacking_123 | Hitting an issue with with repo_build at Create OpenStack-Ansible requirement wheels on pike/stable | 16:13 |
*** savvas has quit IRC | 16:13 | |
openstacking_123 | Mostly related to markers 'python_version == \"3.5\"' don't match your environment and Could not find a tag or branch | 16:14 |
RandomTech | evrardjp: It does not seem adding compute-infrastructure_hosts orchestrastion_hosts and image_hosts fixed the issue | 16:15 |
cloudnull | odyssey4me: evrardjp: sorry been in meetings, and moving to new meetings. will be back in a while. | 16:16 |
openstacking_123 | I put full error here https://gist.githubusercontent.com/fritzstauff/65e08179a53b6a8d7a8cc693b6f68aa1/raw/8972843dfc107b11b1e9b0f9e3486afdf1dbffdf/repo_build if anyone has time to give a quick look. Thank you | 16:16 |
*** savvas has joined #openstack-ansible | 16:19 | |
evrardjp | openstacking_123: could you try without gnocchi? | 16:22 |
openstackgerrit | Matthew Thode proposed openstack/openstack-ansible-os_tempest master: update for changes needed to pass refstack v2 https://review.openstack.org/557750 | 16:22 |
prometheanfire | evrardjp: https://review.openstack.org/557750 that should clean up the image reuploading | 16:23 |
*** savvas has quit IRC | 16:24 | |
logan- | openstacking_123: cloudnull actually just hit this yesterday, and I think he has a fix up for review, but basically as a workaround for now try running: ansible pkg_repo -m pip -a 'name="pbr==3.1.1" state=present' | 16:26 |
logan- | and then run repo build again | 16:26 |
logan- | gnocchi uses pbr to build its wheel, and pbr just released 4.0.0 a few days ago, which seems to break the gnocchi build. | 16:27 |
openstacking_123 | Thanks guys! | 16:27 |
openstacking_123 | Thanks guys this a tremendous help. Will give this a try and report back | 16:28 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-repo_build stable/queens: Install PBR to ensure we're not breaking builds https://review.openstack.org/557754 | 16:29 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-repo_build stable/pike: Install PBR to ensure we're not breaking builds https://review.openstack.org/557756 | 16:33 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-repo_build stable/ocata: Install PBR to ensure we're not breaking builds https://review.openstack.org/557757 | 16:33 |
cloudnull | openstacking_123: ^ those are the cherry-picks for the issue | 16:33 |
openstacking_123 | thank you! | 16:34 |
cloudnull | if folks can give https://review.openstack.org/#/q/starredby:cloudnull+status:open,n,z a shove through it'll help our stable releases | 16:35 |
logan- | i still wonder how we're getting pbr in there without constraints :/ | 16:36 |
*** savvas has joined #openstack-ansible | 16:37 | |
openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-plugins master: Fix delegation to hosts not in inventory https://review.openstack.org/550665 | 16:39 |
*** savvas has quit IRC | 16:42 | |
*** savvas has joined #openstack-ansible | 16:47 | |
*** armaan has joined #openstack-ansible | 16:47 | |
throwsb1 | Hey, I am building a fresh install and I am using the latest 16.09 and the deploy is dying on infrastructure setup playbook on repo server. I am not sure if there is a python mis-match version. http://paste.openstack.org/show/717924/ | 16:48 |
throwsb1 | I am running on ubuntu 16.04.4. | 16:48 |
logan- | throwsb1: we were just discussing that a few minutes ago.. see the convo here: http://eavesdrop.openstack.org/irclogs/%23openstack-ansible/latest.log.html#t2018-03-29T16:13:29 | 16:49 |
odyssey4me | cloudnull done | 16:50 |
cloudnull | logan-: ive tested this a couple times now, it doesn't look like new PBR is being pulled in, so we're not getting pbr 4.x on the host (the previous test may have been polluted from me doing other things) it looks like PBR is just not there which is causing the issue in gnocchi. | 16:51 |
cloudnull | im still not 100% on why this is the case | 16:52 |
logan- | but this is in the repo container not the host right? | 16:52 |
cloudnull | but I can say installing pbr 3.1.1 on the repo container fixed the issue for me | 16:52 |
logan- | yea | 16:52 |
logan- | im just concerned about future breakage now | 16:52 |
*** savvas has quit IRC | 16:52 | |
logan- | because something is messed up if we're seeing pbr 4 installed in a pike repo container at any point imo | 16:52 |
throwsb1 | thanks locan | 16:52 |
odyssey4me | it does worry me a bit that we having a chink in the constraints armor :/ | 16:52 |
odyssey4me | I guess this is part of what's driving the simplification work - right now we have this all happening in too many places... it'll be more transparent and easier to work out when the work is done. | 16:53 |
openstacking_123 | cloudnull I already started with @logan pip install fix. It worked great | 16:54 |
cloudnull | cool! | 16:54 |
cloudnull | so we should have that fix in the branches asap | 16:54 |
odyssey4me | logan- cloudnull evrardjp I guess, given that we're getting combacks on it - we'll need to pull those pbr fixes into the next release... otherwise the release will likely be useless | 16:55 |
cloudnull | we might need evrardjp to cut a release | 16:55 |
logan- | yep | 16:55 |
odyssey4me | release is being proposed tomorrow, so we should get it merged and merged into the integrated build asap | 16:55 |
*** ibmko has quit IRC | 16:55 | |
cloudnull | ++ | 16:55 |
logan- | ya will need to get integrated a-r-r bumps up right after they merge | 16:55 |
*** savvas has joined #openstack-ansible | 16:56 | |
*** savvas has quit IRC | 17:05 | |
*** savvas has joined #openstack-ansible | 17:05 | |
*** gkadam__ has joined #openstack-ansible | 17:09 | |
*** gkadam has joined #openstack-ansible | 17:11 | |
*** gkadam_ has quit IRC | 17:12 | |
*** RandomTech has quit IRC | 17:13 | |
*** gkadam__ has quit IRC | 17:15 | |
*** Sha000000 has joined #openstack-ansible | 17:26 | |
evrardjp | hey sorry I was busy -- will read the scrollback | 17:30 |
evrardjp | I can wait before releasing that this goes in | 17:30 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/ansible-role-python_venv_build master: Allow a venv to be downloaded from a URL https://review.openstack.org/557779 | 17:31 |
evrardjp | so there is a package (pbr) that wasn't explicitly listed? | 17:31 |
evrardjp | isn't pbr constrained and things like that? I thought that all the OS packages including us were using it | 17:32 |
evrardjp | oh I understand | 17:32 |
odyssey4me | evrardjp cloudnull ^ adds the ability to install venvs from a URL - I'll now work on a set of patches for the integrated build | 17:32 |
*** openstacking_123 has quit IRC | 17:32 | |
evrardjp | cloudnull: odyssey4me I don't think we should backport that far back but it doesn't hurt | 17:34 |
odyssey4me | evrardjp we've had reports of brokenness for pike & queens | 17:34 |
evrardjp | I'm surprised we had to pull cython | 17:34 |
odyssey4me | the original problem was discovered on pike | 17:34 |
evrardjp | Pike/Queens make sense | 17:34 |
evrardjp | well it doesn't hurt and its better | 17:34 |
evrardjp | is there a patch in the integrated repos? | 17:35 |
odyssey4me | 'pull' cython? it's just reordered alphabetically | 17:35 |
evrardjp | oh | 17:35 |
odyssey4me | not yet, none of the pbr patches have merged | 17:35 |
evrardjp | I just misread then | 17:35 |
odyssey4me | (except master) | 17:35 |
evrardjp | yeah good | 17:35 |
evrardjp | odyssey4me: I see :) | 17:35 |
evrardjp | let's bump master! | 17:36 |
evrardjp | hahaha | 17:36 |
openstackgerrit | Shannon Mitchell proposed openstack/openstack-ansible-ops master: Apt-cacher-ng's default ubuntu mirror list has faulty mirrors https://review.openstack.org/557780 | 17:36 |
evrardjp | Let's not merge risky patches until those get in | 17:36 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/ansible-role-python_venv_build master: Allow a venv to be downloaded from a URL https://review.openstack.org/557779 | 17:37 |
evrardjp | the docs build are flaky | 17:38 |
evrardjp | sometimes using version x of openstackdocstheme , sometimes x+1 | 17:38 |
odyssey4me | probably also due to the pbr changes | 17:38 |
evrardjp | when was this pbr released? | 17:39 |
odyssey4me | a day or two ago | 17:39 |
evrardjp | two days ago | 17:39 |
evrardjp | ok that makes sense | 17:39 |
evrardjp | yeah I saw that for two days now | 17:39 |
*** hamza21 has joined #openstack-ansible | 17:39 | |
*** chyka_ has joined #openstack-ansible | 17:41 | |
evrardjp | well maybe more | 17:41 |
evrardjp | first iteration was 23/03 | 17:41 |
evrardjp | so no it's something different | 17:41 |
evrardjp | wondering if zuul docs jobs is respecting our requirements | 17:42 |
*** armaan has quit IRC | 17:42 | |
evrardjp | haha no that's not that | 17:42 |
evrardjp | Got it! | 17:42 |
evrardjp | I will fix it | 17:42 |
*** armaan has joined #openstack-ansible | 17:43 | |
*** chyka has quit IRC | 17:43 | |
openstackgerrit | Merged openstack/openstack-ansible-repo_build stable/ocata: Install PBR to ensure we're not breaking builds https://review.openstack.org/557757 | 17:46 |
*** Sha000000 has quit IRC | 17:49 | |
*** vnogin has joined #openstack-ansible | 17:51 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/ocata: Update repo_build role for PBR fix https://review.openstack.org/557784 | 17:52 |
*** fghaas has left #openstack-ansible | 17:52 | |
odyssey4me | evrardjp logan- cloudnull ^ | 17:52 |
*** poopcat has joined #openstack-ansible | 17:56 | |
odyssey4me | evrardjp wtf? http://logs.openstack.org/94/556994/2/check/build-openstack-sphinx-docs/049c39a/job-output.txt.gz#_2018-03-29_15_38_19_128593 | 17:58 |
*** osnaya has joined #openstack-ansible | 17:59 | |
*** flemingo has joined #openstack-ansible | 18:00 | |
*** gkadam has quit IRC | 18:01 | |
shananigans | Any way I can get this one looked at today? https://review.openstack.org/#/c/557780/ Its stopping the mnaio builds during the preseed kick. | 18:01 |
evrardjp | odyssey4me: opening -- just had dinner real quick | 18:01 |
*** vnogin has quit IRC | 18:02 | |
evrardjp | odyssey4me: yeah | 18:02 |
evrardjp | a new version of openstackdocs theme is out | 18:02 |
evrardjp | which breaks many things | 18:02 |
evrardjp | it's flaky | 18:02 |
evrardjp | sometimes an old version is used | 18:02 |
evrardjp | because we don't constrain it | 18:02 |
evrardjp | https://github.com/openstack/openstack-ansible/blob/master/doc/requirements.txt | 18:03 |
evrardjp | so master will sometimes break if he finds the 1.20 | 18:03 |
evrardjp | I will introduce a fix asap | 18:03 |
evrardjp | that's what I said abov | 18:03 |
evrardjp | above | 18:03 |
odyssey4me | evrardjp u-c does though: https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L343 | 18:04 |
osnaya | my understanding is: when you run openstack-ansible setup-hosts.yml --syntax-check (it only generates openstack_inventory.json and openstack_hostnames_ips.yml with container addresses...(doesn't run any code on the target hosts, right?) | 18:04 |
evrardjp | odyssey4me: it constraints to 1.20 for master | 18:04 |
evrardjp | so it can install a bad version | 18:04 |
evrardjp | depending or not if he finds 1.20 | 18:04 |
evrardjp | if 1.18.1 is the only one found on the mirror, then it's working | 18:04 |
evrardjp | I will do a compatibility shim | 18:04 |
evrardjp | just finishing dinner real quick | 18:05 |
odyssey4me | osnaya if you just want to run the inventory, just run the python script itself: /opt/ansible-runtime/bin/python /opt/openstack-ansible/.../dynamic_inventory.py | 18:05 |
evrardjp | osnaya: (and odyssey4me ) this is documented in our reference | 18:05 |
evrardjp | inventory section | 18:05 |
evrardjp | oh sorry this patch hasn't merged yet | 18:06 |
odyssey4me | evrardjp but https://github.com/openstack/openstack-ansible/blob/master/tox.ini#L10-L11 uses constraints, so it *must* find the version set in constraints or it will fail... unless that's not being used | 18:06 |
evrardjp | it's somewhere in our docs! | 18:06 |
*** flemingo_ has joined #openstack-ansible | 18:07 | |
evrardjp | odyssey4me: https://review.openstack.org/#/c/555748/ | 18:07 |
evrardjp | that was the patch to use 1.20 | 18:07 |
evrardjp | as you can see there, it failed | 18:08 |
evrardjp | let me double check if I wasn't too tired on this patch | 18:08 |
*** flemingo has quit IRC | 18:09 | |
ansmith | hello, a quick tox question, I checked out openstack-ansible-os_cinder and when I run 'tox -e ansible-syntax' I get openstack-ansible-os_cinder/tests/common/test-ansible-syntax.sh: No such file or directory. Is there a step I need to run tox tests? | 18:10 |
ansmith | when I check out openstack-ansible on its own, I can run tox fine. | 18:10 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/ansible-role-python_venv_build master: Allow a venv to be downloaded from a URL https://review.openstack.org/557779 | 18:13 |
*** sawblade_ has joined #openstack-ansible | 18:13 | |
evrardjp | odyssey4me: ok it seems to reliably use 1.20 | 18:14 |
evrardjp | on my machine I mean | 18:14 |
*** sawblade6 has quit IRC | 18:15 | |
openstackgerrit | Corey Wright proposed openstack/openstack-ansible-pip_install stable/pike: Fix misspelled registered variable name in conditional https://review.openstack.org/557792 | 18:19 |
*** ivve has quit IRC | 18:28 | |
odyssey4me | evrardjp https://review.openstack.org/557792 is fairly significant - I'm amazed that we didn't pick that up sooner | 18:29 |
evrardjp | is that only for pike? | 18:29 |
evrardjp | I see it's not a backport but significant enough | 18:30 |
evrardjp | let me not +w | 18:30 |
odyssey4me | evrardjp nope, once that merges it needs to go back to ocata too | 18:30 |
evrardjp | queens seems ok | 18:30 |
odyssey4me | the same code is not present in queens, that's why it's not a backport | 18:30 |
evrardjp | yeah I was checking in openstack-hosts | 18:31 |
evrardjp | to see if that was there | 18:31 |
evrardjp | but it's not | 18:31 |
evrardjp | it's different code, not copy pasta! | 18:31 |
odyssey4me | ok, good | 18:32 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [Docs] Fix docs for latest openstackdocstheme https://review.openstack.org/555748 | 18:34 |
evrardjp | so that's very weird, the 23 this patch failed, but openstackdocstheme 1.20 was already released. | 18:35 |
evrardjp | I should have rechecked earlier | 18:35 |
evrardjp | I wonder if I shouldn't use a different version of openstackdocstheme | 18:39 |
evrardjp | I do not agree with what they did | 18:40 |
evrardjp | I will fix openstackdocstheme instead | 18:40 |
evrardjp | let's go with this one | 18:40 |
*** esberglu has quit IRC | 18:43 | |
evrardjp | odyssey4me: could you merge this: 555748 ? | 18:44 |
evrardjp | https://review.openstack.org/#/c/555748/3 | 18:44 |
openstackgerrit | Merged openstack/openstack-ansible-pip_install stable/pike: Fix misspelled registered variable name in conditional https://review.openstack.org/557792 | 18:44 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-pip_install stable/ocata: Fix misspelled registered variable name in conditional https://review.openstack.org/557799 | 18:44 |
*** ivve has joined #openstack-ansible | 18:46 | |
throwsb1 | Hey, I am running the setup-openstack playbook and getting an unable to connect to DB. I connected to the galera db and was able to connect to the mysql and was able to move around. I also verified that I can ping keystone to galera with no issues. | 18:46 |
throwsb1 | here is the full error http://paste.openstack.org/show/717936/ | 18:47 |
openstackgerrit | Merged openstack/openstack-ansible master: [Docs] Fix docs for latest openstackdocstheme https://review.openstack.org/555748 | 18:47 |
evrardjp | throwsb1: could you check the status according to haproxy? | 18:48 |
evrardjp | before going further | 18:48 |
evrardjp | throwsb1: also, which branch? | 18:48 |
throwsb1 | using systemctl it is showing active. I am using 16.0.9. Just pulled the latest and this is a fresh build | 18:49 |
throwsb1 | I did run into this with 16.0.9.6 and thought it was due to a non-clean build, but this is the same error | 18:50 |
openstackgerrit | Merged openstack/openstack-ansible-repo_build stable/queens: Install PBR to ensure we're not breaking builds https://review.openstack.org/557754 | 18:52 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Disable developer mode for tempest role tests https://review.openstack.org/557720 | 18:52 |
*** Sha000000 has joined #openstack-ansible | 18:53 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Disable developer mode for tempest role tests https://review.openstack.org/557720 | 18:53 |
openstackgerrit | Merged openstack/openstack-ansible-os_aodh master: Convert role to use a common systemd service role https://review.openstack.org/552062 | 18:54 |
evrardjp | throwsb1: I am asking from the haproxy standpoint | 18:55 |
evrardjp | I am thinking the healthcheck user may be busted for some weird reason when I see this message, but I need more facts | 18:56 |
throwsb1 | evrardjb: anything specific I could run to verify? I am new to ha | 18:56 |
evrardjp | hatop -s /var/run/haproxy.stat | 18:56 |
evrardjp | throwsb1: https://docs.openstack.org/openstack-ansible/latest/admin/index.html | 18:57 |
evrardjp | that will be very helpful to you | 18:57 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Update repo_build role for PBR fix https://review.openstack.org/557805 | 18:57 |
throwsb1 | evrardjp: looks like galara-back is down. | 18:58 |
evrardjp | throwsb1: that's your issue | 18:58 |
evrardjp | check on why in the logs | 18:58 |
throwsb1 | ok. | 18:59 |
evrardjp | there is obiously something wrong with one of your mysql of your cluster | 18:59 |
evrardjp | that's what you have to find out | 18:59 |
evrardjp | by default it should work. | 18:59 |
evrardjp | so it's probably something in your configuration | 18:59 |
evrardjp | throwsb1: could you show us your mysql version by any chance? | 19:00 |
evrardjp | (just to make sure of something) | 19:00 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible stable/queens: [Docs] Change heading in target hosts https://review.openstack.org/555764 | 19:02 |
*** ivve has quit IRC | 19:07 | |
throwsb1 | evrardjp: I am seeing layer4 connection refused | 19:07 |
osnaya | ok... genreated inventroy.json - going thru it - questions: compute1 shows up is_Metal=true and HAproxy shows isMetal=true. Rest of the OS services and Infra services created structure showing containers... For compute and HAProxy please confirm if that is expected? | 19:08 |
evrardjp | yup | 19:08 |
evrardjp | osnaya: ^ | 19:08 |
evrardjp | neutron agents are now in metal too | 19:09 |
evrardjp | depending on your branch | 19:09 |
throwsb1 | db version is maria 10.1 | 19:09 |
evrardjp | throwsb1: in more details? | 19:09 |
evrardjp | 10.1.30? | 19:09 |
evrardjp | well layer 4 issue anyway :p | 19:09 |
throwsb1 | mariadb-server-10.1 10.1.30+maria-1~xenial | 19:09 |
osnaya | thanks | 19:09 |
ansmith | evrardjp: regarding question ^, should tests-repo-clone.sh be included in a role's tox.ini? (e.g. to setup tests/common) | 19:10 |
osnaya | @evrardjp I am deploying pike... so I see inventory.json with a container entry for neutron-agent.... I guess in pike it was still container? | 19:13 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [Docs] Simplify docs configuration https://review.openstack.org/555880 | 19:13 |
evrardjp | ansmith: as of today, not anymore I'd say | 19:13 |
evrardjp | ansmith: you need to sync the run_tests.sh | 19:13 |
ansmith | evrardjp: thanks, will resynch, I had clone yesterday | 19:14 |
evrardjp | osnaya: for pike that's normal to not have neutron agents as metal | 19:14 |
evrardjp | ansmith: are you developing your own role? | 19:14 |
evrardjp | Or are you running into issues? | 19:14 |
throwsb1 | evrardjp: I am going to dig some more. I had put in cidr in user vars for ha, which I thought was needed when specifying interfaces for ha. I am going to remove them and see if that helps any. | 19:14 |
osnaya | @evrardjp thanks for clarifying | 19:14 |
evrardjp | throwsb1: if you drop your user_variables and openstack_user_config maybe I will be able to help you | 19:14 |
evrardjp | but without that I cant do anything | 19:14 |
evrardjp | osnaya: yw | 19:15 |
ansmith | evrardjp: I was starting to work on patchsets related to bp/hybrid-messaging that we discussed at ptg | 19:15 |
evrardjp | oh great :) | 19:15 |
evrardjp | jmccrory: ^ | 19:15 |
ansmith | evrardjp: it will require touching up the roles a bit | 19:15 |
evrardjp | the existing roles are currently merging this change of the tests-repo-clone | 19:15 |
evrardjp | so you might be in the "in-between" state | 19:16 |
ansmith | evrardjp: wanted to make sure I could test the roles out before changing things much | 19:16 |
evrardjp | good idea :) | 19:16 |
evrardjp | master a moving target :) | 19:16 |
ansmith | evrardjp: good to know | 19:16 |
evrardjp | which role do you start with? | 19:16 |
evrardjp | ansmith: well we are generally stable | 19:16 |
evrardjp | but we've done major changes in the last days | 19:16 |
ansmith | patch to openstack-ansible and then roles will have a dependency on the change, wanted to do it in a way that there doesn't have to be a flag day to update the roles | 19:18 |
mhayden | ... major changes ... | 19:18 |
*** osnaya has quit IRC | 19:18 | |
evrardjp | :) | 19:20 |
evrardjp | don't change too much | 19:20 |
spotz | You guys are quite chatty today! | 19:21 |
evrardjp | ansmith: don't hesitate to ping jmccrory which is closer to your timezone than I am | 19:21 |
evrardjp | spotz: haha | 19:21 |
evrardjp | I try to answer questions | 19:21 |
spotz | mhayden!!!! I refuse to accept your resignation by the way:) | 19:22 |
evrardjp | not sure how good I am doing, but at least I got bonus points for extra trying | 19:22 |
spotz | evrardjp: When I can't answer I just refer to who I think can:) | 19:22 |
mhayden | spotz: aww sorry | 19:22 |
* mhayden is neck deep in kernel land with openshift | 19:22 | |
openstackgerrit | Merged openstack/openstack-ansible-repo_build stable/pike: Install PBR to ensure we're not breaking builds https://review.openstack.org/557756 | 19:23 |
spotz | mhayden: Glad your hanging out there! | 19:23 |
ansmith | evrardjp: thanks, will do | 19:23 |
spotz | evrardjp: While you're still about I saw tbreeds email but git still has stable/newton? | 19:25 |
odyssey4me | logan- FYI, I've thrown up an etherpad for notes on the P->Q upgrade - please add things that come to mind | 19:25 |
odyssey4me | https://etherpad.openstack.org/p/osa-pike-to-queens-cleanup-notes | 19:26 |
odyssey4me | spotz the roles have the eol tags, but theintegrated repo still needs a final bump | 19:26 |
spotz | odyssey4me: Should I hold off on using 3/30 as the EOL date? For some reason I've got tomorrow's date in the patch I've got prepped | 19:27 |
mattt | mhayden: sup buddy! | 19:27 |
mhayden | OY! | 19:27 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Update repo_build role for PBR fix https://review.openstack.org/557812 | 19:28 |
odyssey4me | spotz I think there needs to be a final sha bump, then a release of that - so it might be another few days | 19:29 |
odyssey4me | once that final release is done, we can merge a patch giving that date as the final | 19:30 |
evrardjp | mattt: and mhayden on the same channel -- OMG OMAGAD! | 19:30 |
spotz | odyssey4me: will keep a hold of my docs patch:) | 19:30 |
odyssey4me | or evrardjp can work it out | 19:30 |
spotz | heheh | 19:30 |
odyssey4me | EHRMERGEHRD? | 19:30 |
evrardjp | hahahahahahhaha | 19:30 |
evrardjp | spotz: I will issue a release on the 30 March | 19:31 |
evrardjp | and that release will bump the roles to eol | 19:31 |
openstackgerrit | Merged openstack/openstack-ansible stable/queens: [Docs] Change heading in target hosts https://review.openstack.org/555764 | 19:31 |
spotz | evrardjp: Want me to go ahead and put up the patch then so it's there? | 19:31 |
evrardjp | and then it can be tagged EOL, so I guess yes, you can plan for the 30. One day or so doesn't make a lot of difference :) | 19:31 |
mhayden | i heard someone needed gates broken | 19:31 |
evrardjp | spotz: in which branch is that? | 19:31 |
evrardjp | newton itself? | 19:31 |
evrardjp | if it's in newton, yes, you should land it | 19:32 |
evrardjp | if it's in master, that can wait | 19:32 |
spotz | evrardjp: It's master, openstack-ansible/doc/source/index.rst | 19:32 |
evrardjp | yeah | 19:32 |
evrardjp | no worries | 19:32 |
evrardjp | there is no urgency ther | 19:32 |
*** Sha000000 has quit IRC | 19:32 | |
evrardjp | you can wait for the EOL to be officially done | 19:32 |
spotz | evrardjp: Okie, I'll keep holding on to it:) | 19:32 |
*** vnogin has joined #openstack-ansible | 19:35 | |
odyssey4me | I trust y'all to keep an eye on https://review.openstack.org/#/q/Ic21bf2ef50836f793d3c3549f2400ac05c6f751a to ensure they get merged today in time for release tomorrow. | 19:36 |
odyssey4me | Time for me to !computer. | 19:36 |
mattt | odyssey4me: how does one play video games with !computer ? | 19:37 |
odyssey4me | heh, one doesn't - but this time I mean !computer | 19:38 |
odyssey4me | for cores, there are plenty of reviews waiting if anyone has time - use this bookmark: https://review.openstack.org/#/q/project:%22%255Eopenstack/(monitorstack%257Copenstack-ansible).*%22+status:open+label:Verified%253E%253D1%252Czuul+NOT+label:Workflow%253C%253D-1+NOT+label:Code-Review%253C%253D-1+NOT+owner:self | 19:38 |
evrardjp | odyssey4me: could you vote on something real quick? | 19:44 |
*** vnogin has quit IRC | 19:44 | |
evrardjp | https://review.openstack.org/#/c/555880/3 | 19:45 |
*** Sha000000 has joined #openstack-ansible | 19:45 | |
evrardjp | that's preventing issues on master for the deploy-guide | 19:45 |
evrardjp | odyssey4me: you should update your bookmarks | 19:45 |
evrardjp | :p | 19:45 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_tempest master: update for changes needed to pass refstack v2 https://review.openstack.org/557750 | 19:48 |
openstackgerrit | Matthew Thode proposed openstack/openstack-ansible-os_tempest master: update for changes needed to pass refstack v2 https://review.openstack.org/557750 | 19:51 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible stable/queens: [Docs] Include OpenStack-Ansible Manifesto https://review.openstack.org/556362 | 19:52 |
*** chhagarw has quit IRC | 19:53 | |
evrardjp | prometheanfire: team team team! | 19:53 |
openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-plugins master: Fix delegation to hosts not in inventory https://review.openstack.org/550665 | 19:54 |
prometheanfire | evrardjp: lol, if we merge the two vars the comment needed to change it's plurality :P | 19:54 |
evrardjp | yeah but now I can vote :p | 19:55 |
evrardjp | you're aware of the change, you agreed, and we can continue, because I agreed. | 19:55 |
evrardjp | wooot | 19:55 |
evrardjp | jmccrory: thanks for the work done there. | 19:55 |
evrardjp | okay it's late for me | 19:56 |
mattt | evrardjp: night night! | 19:56 |
jmccrory | evrardjp np, did you already have that experimental ansible-next job created somewhere? | 19:56 |
prometheanfire | evrardjp: lol, sure | 19:56 |
evrardjp | jmccrory: there is no 2.6 branch | 19:56 |
evrardjp | so devel it is | 19:56 |
prometheanfire | evrardjp: now we can backport it to queens/pike too | 19:56 |
prometheanfire | the full fix, not the partial that is | 19:57 |
evrardjp | Oh but we are still 2.4, so I CAN create the next | 19:57 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: Test the main repo with next version of ansible https://review.openstack.org/557820 | 19:59 |
evrardjp | jmccrory: you can probably do a test in the integrated repo, with a depends-on on your plugin patch, and check experimental. | 20:01 |
evrardjp | if we merge https://review.openstack.org/557820 | 20:02 |
evrardjp | or I can build a specific job if you like | 20:02 |
evrardjp | to direct target from the plugins | 20:02 |
evrardjp | I guess it's good enough for you to test for today | 20:03 |
jmccrory | yeah, was going to do that but think we should have some test for plugins repo specifically too to find out blockers earlier | 20:03 |
evrardjp | ok | 20:03 |
evrardjp | will add that tomorrow | 20:03 |
evrardjp | as a nv job or something | 20:03 |
jmccrory | yep, sounds good. alright, have a good night | 20:04 |
evrardjp | thanks! | 20:04 |
evrardjp | I am technically off tomorrow and monday , just so you know :) | 20:04 |
evrardjp | will still do the release | 20:04 |
spotz | evrardjp: Have a good weekend off | 20:05 |
d34dh0r53 | evrardjp: got a minute before you take off? | 20:05 |
*** sawblade6 has joined #openstack-ansible | 20:05 | |
*** sawblade_ has quit IRC | 20:08 | |
idlemind | where is the file where i can bump my local sha's of upstream projects? | 20:09 |
d34dh0r53 | idlemind: ansible-role-requirements.yml? | 20:10 |
d34dh0r53 | is that the file you're talking about? | 20:11 |
idlemind | might be | 20:11 |
*** strobelight has quit IRC | 20:12 | |
openstackgerrit | Merged openstack/openstack-ansible-ops master: Apt-cacher-ng's default ubuntu mirror list has faulty mirrors https://review.openstack.org/557780 | 20:14 |
idlemind | ah good, i actually don't think i need to ... the reference to project (neutron-dynamic-routing in my case) is in the defaults/main.yml of each sub openstack-ansible project and for me that's targetted at the stable/pike branch ... hopefully just a re-run of os-neutron will pickup the updated repo's and the bugfix i need | 20:19 |
idlemind | or do i need to do something besides the neutron play to get the git cache's to update? | 20:19 |
*** chhagarw has joined #openstack-ansible | 20:28 | |
*** osnaya has joined #openstack-ansible | 20:29 | |
osnaya | quick q: from inventory.json I see containers are created on controller(infra) node. Are there containers created on computes? any specific applicable cases? | 20:31 |
idlemind | osnaya containers are placed where you put services for me, my compute node didn't get containers until i made it a networking_host | 20:33 |
*** ansmith has quit IRC | 20:34 | |
osnaya | ok | 20:40 |
d34dh0r53 | idlemind: you'll probably want to run something like ansible-galaxy install -r ansible-role-requirements.yml to pull in the latest changes | 20:40 |
*** savvas has quit IRC | 20:41 | |
*** haad1 has joined #openstack-ansible | 20:42 | |
*** jwitko has quit IRC | 20:49 | |
*** jwitko has joined #openstack-ansible | 20:49 | |
*** hamzy has quit IRC | 20:50 | |
*** savvas has joined #openstack-ansible | 20:50 | |
*** savvas has quit IRC | 20:55 | |
*** esberglu has joined #openstack-ansible | 20:55 | |
*** chhagarw has quit IRC | 20:59 | |
*** esberglu has quit IRC | 21:00 | |
*** savvas has joined #openstack-ansible | 21:00 | |
*** DanyC has quit IRC | 21:07 | |
*** DanyC has joined #openstack-ansible | 21:11 | |
*** hamza21 has quit IRC | 21:11 | |
openstackgerrit | Merged openstack/openstack-ansible stable/ocata: Update repo_build role for PBR fix https://review.openstack.org/557784 | 21:16 |
*** esberglu has joined #openstack-ansible | 21:17 | |
openstackgerrit | Merged openstack/openstack-ansible-os_nova stable/pike: change python-libguestfs to python-guestfs for ubuntu https://review.openstack.org/551972 | 21:20 |
*** esberglu has quit IRC | 21:22 | |
*** esberglu has joined #openstack-ansible | 21:23 | |
*** gyee has joined #openstack-ansible | 21:28 | |
*** esberglu has quit IRC | 21:28 | |
gyee | does openstack-ansible support keystone fernet key rotation right now? | 21:29 |
lbragstad | gyee: yessir | 21:29 |
*** ansmith has joined #openstack-ansible | 21:29 | |
lbragstad | gyee: it's crazy automated, too | 21:29 |
gyee | where's that code? | 21:29 |
lbragstad | it's smarter than i am | 21:29 |
gyee | it's calling keystone-manage or that in a module somewhere? | 21:30 |
lbragstad | which isn't saying much, but still.. it's neat https://github.com/openstack/openstack-ansible-os_keystone/blob/master/templates/keystone-fernet-rotate.sh.j2 | 21:30 |
lbragstad | gyee: yeah - it'll call keystone-manage to establish a fernet repository on *a* keystone node | 21:31 |
lbragstad | then it goes through and lays down a rotation script that syncs the repository based on a cron job | 21:31 |
*** strobelight has joined #openstack-ansible | 21:31 | |
lbragstad | but it's controlled via an ansible variable | 21:31 |
gyee | oh nice! | 21:31 |
lbragstad | https://github.com/openstack/openstack-ansible-os_keystone/blob/master/defaults/main.yml#L74 | 21:32 |
lbragstad | the keystone nodes establish trust by sharing public keys, which allows other keystone nodes to perform the rotation if it falls outside of the rotation window (i think) | 21:32 |
spotz | Hey lbragstad:) | 21:32 |
lbragstad | s/rotation/rotation and sync/ | 21:32 |
lbragstad | spotz: o/ | 21:33 |
gyee | so it establish a 'master' node and do the rotation there | 21:33 |
gyee | then sync the keys to the other nodes? | 21:33 |
lbragstad | gyee: yeah - kinda | 21:33 |
gyee | sweat! | 21:33 |
lbragstad | it will do it that way, but the master can change | 21:33 |
gyee | right | 21:33 |
gyee | basically the one with the highest key number | 21:33 |
lbragstad | if node-1 is the master, then goes down, node-2 should have the infra to perform a sync and push those keys to the rest of the nodes in the deployment | 21:33 |
gyee | sweeeet! | 21:34 |
lbragstad | yeah... it's pretty cool | 21:34 |
d34dh0r53 | someone says fernet and lbragstad's ears start burning :) | 21:34 |
gyee | lbragstad, thanks man! you just saved me a bunch of time! | 21:34 |
lbragstad | i didn't implement it :) | 21:34 |
lbragstad | d34dh0r53: i either run to help or run away | 21:34 |
d34dh0r53 | lol | 21:35 |
gyee | I can reuse some of the mysql galera logic, basically finding the node with the highest number if stuff does go wrong | 21:35 |
gyee | as ansible is supposed to be idempotent :-) | 21:35 |
*** strobelight has quit IRC | 21:36 | |
lbragstad | yeah - i think it's done with inventory https://github.com/openstack/openstack-ansible-os_keystone/blob/master/tasks/keystone_fernet.yml#L17 | 21:37 |
lbragstad | if the list in the inventory is consistent, that node should be the same | 21:37 |
*** jwitko_ has joined #openstack-ansible | 21:38 | |
osnaya | about to run setup-hosts.yml.... is there a way to run it with parameter to create a verbose debug log? | 21:38 |
spotz | d34dh0r53: Yep:) | 21:40 |
*** jwitko has quit IRC | 21:42 | |
*** jwitko_ has quit IRC | 21:43 | |
osnaya | @cloudnull @odyssey4me @idlemind @evrardjp - is there a way to create debug log for setup-hosts.yml or setup-infrastructure.yml?? | 21:48 |
osnaya | simply redirecting console output for now | 21:55 |
*** SimAloo has quit IRC | 21:58 | |
osnaya | @cloudnull @odyssey4me @idlemind @evrardjp on the target hosts after running setup-hosts.yml how to check what containers are created? | 22:02 |
*** jwitko has joined #openstack-ansible | 22:10 | |
osnaya | anyone.... when I see the console output for setup-hosts.yml run, it shows a list of infra1_......._container_#### (about 20+) containers created thru play#6 Create container(s)TAGS: [lxc-containers-create]... How do I verify it on target before proceeding to the next step? | 22:13 |
*** savvas_ has joined #openstack-ansible | 22:17 | |
*** savvas has quit IRC | 22:20 | |
*** savvas_ has quit IRC | 22:21 | |
dmsimard | evrardjp, odyssey4me, logan-, cloudnull: btw http://lists.openstack.org/pipermail/openstack-dev/2018-March/128902.html | 22:23 |
openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-plugins master: Fix delegation to hosts not in inventory https://review.openstack.org/550665 | 22:32 |
*** flemingo has joined #openstack-ansible | 22:34 | |
*** flemingo_ has quit IRC | 22:37 | |
openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: update for changes needed to pass refstack v2 https://review.openstack.org/557750 | 22:37 |
*** flemingo has quit IRC | 22:38 | |
*** kstev1 has quit IRC | 22:39 | |
jrosser | osnaya: check the containers on the host with lxc-ls, your log is on the delpoy host in /openstack | 22:39 |
*** chyka has joined #openstack-ansible | 22:45 | |
*** chyka_ has quit IRC | 22:48 | |
*** Sha000000 has quit IRC | 22:52 | |
osnaya | was trying on the target host $lxc list (conn refused; is LXD running?) - systemctl status lxd.service says Loaded: masked (/dev/null; bad) inactive (dead)... | 22:55 |
osnaya | tried to restart (lxd.service and lxd-containers.service) but same results...so rebooted the host.... but the same results .... | 22:56 |
osnaya | tried $service lxd restart -- Failed to restart lxd.service: Unit lxd.service is masked. Googling... any pointers? | 22:57 |
osnaya | do we need to do anything to disable ipv6 entries ---- any ideas? | 22:59 |
idlemind | osnaya you could try prefixing the openstack-ansible command with ANSIBLE_STRATEGY=debug (for your earlier question) | 23:03 |
*** ibmko has joined #openstack-ansible | 23:03 | |
idlemind | osnaya lxc-ls on the host to verify the presence of the containers | 23:04 |
idlemind | osnaya you can attach to one of them by doing lxc-attach --name <> | 23:04 |
osnaya | @idlemind on the target host lxc list $lxc list (conn refused; is LXD running?) - systemctl status lxd.service says Loaded: masked (/dev/null; bad) inactive (dead)... | 23:06 |
idlemind | osnaya if it's an ubuntu host i can't say for certain. mine are centos hosts and they have "lxc-ls" | 23:06 |
idlemind | note ... lxc not lxd | 23:07 |
osnaya | @idlemind ubuntu 16.04 LTS | 23:07 |
idlemind | try "lxc-ls" | 23:07 |
idlemind | might have to "sudo lxc-ls" | 23:07 |
idlemind | a quick google seems to indicate ubuntu uses the same tooling | 23:07 |
osnaya | @idlemind lxc-ls (command not found) on Ubuntu 16.04 | 23:08 |
idlemind | odd; running that on the infra node? | 23:09 |
osnaya | dpkg shows lxc-common (2.0.8), lxcfs (2.0.8), lxd (2.0.11-0) and lxd-client (2.0.11.0) | 23:09 |
osnaya | yes on the infra1 node (there is a single controller node)... setup-hosts.yml returned successful.... so wanted to verify containers it listed as created on target host... | 23:11 |
osnaya | Linux ansible5-1 4.4.0-116-generic #140-Ubuntu SMP Mon Feb 12 21:23:04 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux | 23:11 |
idlemind | what about just "lxc list" | 23:12 |
osnaya | $lxc list (conn refused; is LXD running?) | 23:13 |
osnaya | hmmm.... systemctl status lxd-containers.service gave Warning: lxd-containers.service changed on disk. Run 'systemctl daemon-reload' to reload units. Loaded: masked (inactive dead...). | 23:15 |
*** flemingo has joined #openstack-ansible | 23:16 | |
osnaya | just checking there is a lxc.service, lxc-fs.service, lxd.service, lxd-containers.service, and lxd.socket | 23:18 |
openstackgerrit | Merged openstack/openstack-ansible-pip_install stable/ocata: Fix misspelled registered variable name in conditional https://review.openstack.org/557799 | 23:19 |
*** chyka_ has joined #openstack-ansible | 23:19 | |
*** flemingo has quit IRC | 23:21 | |
idlemind | ya one of the other folks that runs ubuntu will have to pipe in i think; it appears different commands are used on centos | 23:22 |
idlemind | other than waiting for that you could try an ansible play w/the lxc module to see if it displays them | 23:22 |
osnaya | ok | 23:23 |
*** chyka has quit IRC | 23:23 | |
idlemind | i also can't comment on the ipv6 disabling question becuase i use ipv6 in production | 23:23 |
*** chyka_ has quit IRC | 23:23 | |
osnaya | wait ok was for the earlier resp | 23:23 |
osnaya | so how to run the ansible play for lxc module? | 23:24 |
idlemind | (i vote for using it over disabling but i suppose i'm still weird) | 23:24 |
*** flemingo has joined #openstack-ansible | 23:32 | |
*** flemingo has quit IRC | 23:37 | |
openstackgerrit | Merged openstack/openstack-ansible-os_ceilometer master: Convert role to use a common systemd service role https://review.openstack.org/556977 | 23:41 |
*** flemingo has joined #openstack-ansible | 23:51 | |
*** haad1 has quit IRC | 23:51 | |
*** flemingo has quit IRC | 23:55 | |
*** osnaya has quit IRC | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!