| *** dtrainor_ has quit IRC | 01:51 | |
| *** dtrainor has joined #oooq | 01:51 | |
| *** ykarel has joined #oooq | 01:56 | |
| *** apetrich has quit IRC | 02:19 | |
| *** ykarel has quit IRC | 02:28 | |
| *** ykarel has joined #oooq | 02:28 | |
| *** dtrainor has quit IRC | 02:40 | |
| *** dtrainor has joined #oooq | 02:40 | |
| *** dtrainor_ has joined #oooq | 03:34 | |
| *** dtrainor has quit IRC | 03:34 | |
| *** gkadam has joined #oooq | 03:36 | |
| *** rlandy has quit IRC | 03:37 | |
| *** ykarel has quit IRC | 03:50 | |
| *** dtrainor has joined #oooq | 03:53 | |
| *** dtrainor_ has quit IRC | 03:54 | |
| *** saneax has joined #oooq | 03:59 | |
| *** saneax has quit IRC | 04:11 | |
| *** ratailor has joined #oooq | 04:14 | |
| *** ykarel has joined #oooq | 04:23 | |
| *** dtrainor_ has joined #oooq | 04:26 | |
| *** dtrainor has quit IRC | 04:26 | |
| *** ykarel has quit IRC | 04:42 | |
| *** ratailor_ has joined #oooq | 04:47 | |
| *** ratailor has quit IRC | 04:50 | |
| *** rascasoft has quit IRC | 04:52 | |
| *** weshay|rover has quit IRC | 04:55 | |
| *** udesale has joined #oooq | 04:56 | |
| *** udesale has quit IRC | 04:57 | |
| *** udesale has joined #oooq | 04:58 | |
| *** udesale has quit IRC | 04:59 | |
| *** ratailor__ has joined #oooq | 05:08 | |
| *** ratailor_ has quit IRC | 05:11 | |
| *** udesale has joined #oooq | 05:22 | |
| *** ykarel has joined #oooq | 05:24 | |
| ykarel | arxcruz, u can work on following tempest plugins: https://review.rdoproject.org/r/#/q/topic:rocky-update+status:open | 05:24 |
|---|---|---|
| ykarel | these are auto proposed in rdo and need to be adjusted like:- https://review.rdoproject.org/r/#/c/15897/ as per chandan's comment | 05:25 |
| *** dtrainor_ has quit IRC | 05:27 | |
| *** dtrainor has joined #oooq | 05:27 | |
| *** udesale has quit IRC | 05:31 | |
| *** ratailor has joined #oooq | 05:36 | |
| *** ratailor__ has quit IRC | 05:37 | |
| *** ratailor_ has joined #oooq | 05:38 | |
| *** skramaja has joined #oooq | 05:39 | |
| *** ratailor__ has joined #oooq | 05:40 | |
| *** ratailor has quit IRC | 05:40 | |
| *** ratailor_ has quit IRC | 05:43 | |
| *** saneax has joined #oooq | 05:57 | |
| *** udesale has joined #oooq | 06:06 | |
| *** ratailor__ has quit IRC | 06:08 | |
| *** ratailor has joined #oooq | 06:12 | |
| *** apetrich has joined #oooq | 06:15 | |
| *** jfrancoa has joined #oooq | 06:37 | |
| *** udesale has quit IRC | 06:48 | |
| *** udesale has joined #oooq | 06:55 | |
| *** dsneddon has quit IRC | 07:03 | |
| *** rascasoft has joined #oooq | 07:19 | |
| rascasoft | sshnaidm, hey hi you around? | 07:19 |
| *** kopecmartin has joined #oooq | 07:24 | |
| *** dsneddon has joined #oooq | 07:38 | |
| *** ykarel is now known as ykarel|lunch | 07:43 | |
| arxcruz | ykarel|lunch: just notice you edit mostly of them do i need to take some action? | 07:48 |
| ykarel|lunch | arxcruz, i just did two, rest are still there | 07:49 |
| arxcruz | ykarel|lunch: ok | 07:49 |
| ykarel|lunch | so please take care of them | 07:49 |
| arxcruz | ykarel|lunch: https://review.rdoproject.org/r/#/c/15983/ can you check if i did properly? | 07:56 |
| rascasoft | arxcruz, ykarel|lunch, maybe you can help me here I've two patches failing the gates because of this error http://logs.openstack.org/77/596877/2/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/a33a770/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-08-28_05_06_07 | 07:56 |
| rascasoft | arxcruz, ykarel|lunch, it's just a matter of retry or do I need to do something? | 07:57 |
| rascasoft | it is the only gate that fails, all the rest is good | 07:57 |
| arxcruz | 2018-08-28 05:06:07 | "2018-08-28 05:06:04,157 ERROR: 21411 -- Notice: hiera(): Cannot load backend module_data: cannot load such file -- hiera/backend/module_data_backend", | 07:58 |
| arxcruz | something missing ? | 07:58 |
| *** tosky has joined #oooq | 07:58 | |
| ykarel|lunch | arxcruz, commented | 07:59 |
| arxcruz | ykarel|lunch: ty | 07:59 |
| ykarel|lunch | rascasoft, that's a known issue | 07:59 |
| rascasoft | ykarel|lunch, solvable? I have two important patches depending on this | 08:00 |
| rascasoft | can I just retry? | 08:00 |
| ykarel|lunch | rascasoft, master patch merged, rocky in progress: https://review.openstack.org/#/q/topic:bug/1788907+(status:open+OR+status:merged) | 08:00 |
| ykarel|lunch | so u can add depends-on on that and it will work | 08:01 |
| rascasoft | ykarel|lunch, but if I depends-on I lose all the +2, isn't it? | 08:01 |
| ykarel|lunch | rascasoft, yes | 08:01 |
| rascasoft | ykarel|lunch, so I'll be blocked in any case | 08:02 |
| ykarel|lunch | okk, package is in current repo, ur patch on master? | 08:02 |
| ykarel|lunch | if yes recheck will work | 08:02 |
| ykarel|lunch | rascasoft, ^^ | 08:02 |
| rascasoft | ykarel|lunch, yes those are https://review.openstack.org/#/c/596877/ and https://review.openstack.org/#/c/588327/ | 08:03 |
| rascasoft | ykarel|lunch, I just rechecked, let's see | 08:03 |
| ykarel|lunch | rascasoft, recheck will be sufficient | 08:03 |
| rascasoft | ykarel|lunch, ack, thanks | 08:03 |
| *** jaganathan_ has joined #oooq | 08:03 | |
| ssbarnea | ykarel|lunch: thanks for the rndc changes. regarding rocky, do you know if further CRs are needed or now we only have to wait for zuul to merge them? | 08:08 |
| arxcruz | ykarel|lunch: done, except for https://review.rdoproject.org/r/#/c/15977 i don't think it requires any edition | 08:14 |
| *** skramaja has quit IRC | 08:19 | |
| *** jfrancoa has quit IRC | 08:29 | |
| arxcruz | ykarel|lunch: it's failing in koji... | 08:35 |
| sshnaidm | rascasoft, hi | 08:39 |
| sshnaidm | rascasoft, what's going with test? | 08:39 |
| rascasoft | sshnaidm, hey hi, so tests were successful, at least for what we care about | 08:39 |
| *** ykarel|lunch is now known as ykarel | 08:40 | |
| sshnaidm | rascasoft, cool, so we are good to go? | 08:40 |
| rascasoft | sshnaidm, overcloud deployment is failing because of this error:ERROR: Property error: : resources.Controller<nested_stack>.resources.0<https://192.168.24.2:13808/v1/AUTH_9590821899f948d286884f41741525e7/overcloud/puppet/controller-role.yaml>.resources.NetworkConfig.properties: : Unknown Property ControlPlaneDefaultRout | 08:40 |
| rascasoft | sshnaidm, maybe you know something about it | 08:40 |
| ykarel | ssbarnea, we need to get that merged to ubnblock rocky promotions | 08:41 |
| rascasoft | sshnaidm, but in any case, for what concerns the patches, we're good, I rechecked them because of the known issue | 08:41 |
| ykarel | arxcruz, did u checked koji logs? | 08:41 |
| ssbarnea | ykarel: let me know if there is something I can do to help with that. | 08:42 |
| rascasoft | sshnaidm, Ronelle told me yesterday that maybe you know something about that overcloud deploy error | 08:42 |
| *** apetrich has quit IRC | 08:43 | |
| sshnaidm | rascasoft, I don't know about this error, although seems familiar.. maybe ssbarnea knows | 08:43 |
| sshnaidm | or marios if he's not in pto | 08:44 |
| sshnaidm | ykarel, what do we need to merge? | 08:44 |
| rascasoft | ssbarnea, I count on you man :) | 08:45 |
| ykarel | sshnaidm, https://review.openstack.org/#/c/596864/ and https://review.openstack.org/#/c/596093/ | 08:45 |
| ykarel | first one for rocky and second for master | 08:45 |
| *** jfrancoa has joined #oooq | 08:45 | |
| *** jfrancoa has quit IRC | 08:50 | |
| sshnaidm | rascasoft, or on me? :) | 08:50 |
| sshnaidm | rascasoft, I highlight now all messages to ssbarnea not to miss mine ones.. | 08:51 |
| ssbarnea | rascasoft: ykarel : i seen the deginate error and it seems that this CR would fix it https://review.openstack.org/#/c/583670/ -- but I don't know why it didn't get merged. All flags are ok, not merged but also not in the queue. | 08:51 |
| rascasoft | sshnaidm, ssbarnea, I count on everyone who can help me figure out that error :D | 08:51 |
| ssbarnea | ok figured out, this is the only CR that failed to merge: https://review.openstack.org/#/c/580526/2 | 08:54 |
| arxcruz | ykarel: where can i see that? | 08:54 |
| rascasoft | ssbarnea, that's interesting, maybe it's not yet merged because of the depends-on? | 08:54 |
| rascasoft | ssbarnea, no, I correct myself, those are merged too... So I really don't know | 08:55 |
| *** skramaja has joined #oooq | 08:58 | |
| ykarel | arxcruz, checking | 08:59 |
| ykarel | which failed | 08:59 |
| ykarel | many failed | 09:00 |
| ssbarnea | last one fails with: "Error: Evaluation Error: Error while evaluating a Resource Statement, Class[Dns]: parameter 'controls' expects a Hash[String, Hash[String, Data]] value, got Hash[Undef, Struct[{'port' => Integer[953, 953], 'keys' => Tuple[String[8, 8]], NotUndef['allowed_addresses'] => Undef}]] at /etc/puppet/modules/designate/manifests/backend/bind9.pp:38:5 on node centos-7-ovh-bhs1-0001568586.localdomain", | 09:01 |
| ssbarnea | and I do remember that wes said something about this, event I remember a patch that I am not able to find now... | 09:02 |
| ykarel | ssbarnea, this ^^ is what from where fs018 startedd failing, where u are seeing it? | 09:03 |
| ykarel | and the fix was what i mentioned before | 09:04 |
| ykarel | arxcruz, so if u open log for ex. trove plugin, u will find a link like https://cbs.centos.org/koji/taskinfo?taskID=530529 | 09:05 |
| ssbarnea | https://review.openstack.org/#/c/580526/2 -- which is the only change from 5 that prevented the merge. | 09:05 |
| ykarel | arxcruz, there u can click on build, and then see logs like mock_output.log and build.log | 09:05 |
| ykarel | error is: /var/tmp/rpm-tmp.AjyXYV: line 36: cd: trove-tempest-plugin-0.1.0: No such file or directory | 09:05 |
| ssbarnea | ykarel: direct link http://logs.openstack.org/26/580526/2/gate/tripleo-ci-centos-7-scenario003-multinode-oooq-container/25786c9/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 09:06 |
| *** holser_ has joined #oooq | 09:07 | |
| *** jfrancoa has joined #oooq | 09:08 | |
| *** ratailor_ has joined #oooq | 09:08 | |
| ykarel | ssbarnea, if u see the rpm: puppet-tripleo-9.3.1-0.20180825113739.cb3abe9.el7.noarch which doesn't have the fix | 09:09 |
| *** ratailor has quit IRC | 09:10 | |
| tosky | ykarel: talking about failed jobs, I know you have to put out this fire, but did you find anything regarding the failures in stable/queens? | 09:11 |
| arxcruz | ykarel: ty | 09:12 |
| arxcruz | ykarel: http://cbs.centos.org/kojifiles/work/tasks/536/530536/build.log no idea why directory is not found | 09:14 |
| ssbarnea | in this case we need to poss this https://review.openstack.org/#/c/596864/ | 09:14 |
| arxcruz | brb, doctor appointment | 09:15 |
| ssbarnea | arxcruz: ^^ just, +W the one above so it would merge, is a cherry pick to rocky | 09:18 |
| ykarel | arxcruz, u used wrong vars, there was tarsources defined but u changed those to plugin | 09:21 |
| ykarel | so if u want, u can use spectool -g <spec file path> to check if the url is downloadable | 09:22 |
| ykarel | tosky, no i didn't checked that, ssbarnea any idea about the queens issue, jobs timing out since 23rd? | 09:29 |
| *** ratailor__ has joined #oooq | 09:31 | |
| *** ratailor_ has quit IRC | 09:34 | |
| *** skramaja has quit IRC | 09:36 | |
| *** dtantsur|afk is now known as dtantsur | 09:44 | |
| *** ratailor__ has quit IRC | 09:50 | |
| rascasoft | ssbarnea, so about https://review.openstack.org/#/c/583670/ do we have answers? Why this is not yet merged? | 09:54 |
| arxcruz | ssbarnea: i'm not core :( | 10:10 |
| *** dsneddon has quit IRC | 10:13 | |
| *** zul has joined #oooq | 10:18 | |
| *** dsneddon has joined #oooq | 10:21 | |
| *** dsneddon has quit IRC | 10:26 | |
| *** ratailor has joined #oooq | 10:28 | |
| *** ccamacho|brb has quit IRC | 10:29 | |
| *** skramaja has joined #oooq | 10:36 | |
| ssbarnea | panda: (or any other core), please +W https://review.openstack.org/#/c/596864/ -- is urgent at is seems to be at the top of a very long dependency chain. | 10:46 |
| ssbarnea | master was sorted yesterday, we (hopefully) sort rocky now and I will have a look at queens later. i suspect it could be affected by the same problems. | 10:48 |
| *** ratailor has quit IRC | 10:50 | |
| *** ccamacho has joined #oooq | 10:50 | |
| *** skramaja has quit IRC | 10:53 | |
| ykarel | master patch still need +W:- https://review.openstack.org/#/c/596093/ | 11:01 |
| ykarel | fs035 passed, fs001 failed with infra issue | 11:01 |
| *** dsneddon has joined #oooq | 11:08 | |
| *** dsneddon has quit IRC | 11:13 | |
| rascasoft | sshnaidm, can you add the workflow+1 here https://review.openstack.org/#/c/596877/ ? It finally passed the gates! | 11:30 |
| sshnaidm | rascasoft, done | 11:31 |
| rascasoft | sshnaidm, thanks | 11:31 |
| *** trown|outtypewww is now known as trown | 11:58 | |
| *** skramaja has joined #oooq | 12:08 | |
| *** weshay has joined #oooq | 12:28 | |
| weshay | howdy | 12:31 |
| *** rlandy has joined #oooq | 12:34 | |
| rascasoft | sshnaidm, weshay, rlandy, hey folks! First green on osp13 with the new modification: https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/oooq-rhos-13-puddle-bmu-ha-lab-phoenix-float_nic_with_vlans/6/ (and with *just* this modification, which means I don't have to change anything internally) | 12:36 |
| weshay | nice | 12:36 |
| tosky | ehm, is that link relevant for this channel? | 12:36 |
| sshnaidm | rascasoft, great, exactly as it should be | 12:36 |
| weshay | tosky, I'm long past caring | 12:36 |
| rlandy | rascasoft: nice - your master job should have been close as well | 12:37 |
| rascasoft | sshnaidm, weshay, rlandy we just need to decide what to do with the other patch https://review.openstack.org/#/c/596789/ | 12:37 |
| tosky | weshay: so it's not relevant, thanks for confirming | 12:37 |
| rascasoft | rlandy, on that side I'm still facing that strange problem on the overcloud deployment | 12:37 |
| sshnaidm | rascasoft, remove overcloud downloading part in it :D | 12:38 |
| rascasoft | sshnaidm, ok I can use the same review to do that. Is it ok for you weshay? | 12:38 |
| tosky | let me say it straight: this is an official openstack channel, even manager by openstack-infra, logged on eavesdrop.openstack.org | 12:38 |
| tosky | so don't use it for downstream stuff | 12:38 |
| sshnaidm | rascasoft, sure, this part is only confusing people.. | 12:38 |
| rlandy | rascasoft: so you really still need https://review.openstack.org/#/c/596789/? | 12:40 |
| rlandy | do you | 12:40 |
| weshay | rascasoft, ya.. fetch.yml should take care of that | 12:40 |
| rlandy | if not, we need to fix that role | 12:40 |
| rlandy | besides the current master job did get that image | 12:40 |
| weshay | ssbarnea, fyi.. I saw the same behavior in our no-op jobs | 12:41 |
| rlandy | weshay: did you sign us up to be early adopters of upshift that replaces ci-rhos or rdocloud? | 12:41 |
| weshay | rlandy, I did | 12:41 |
| rlandy | which one? | 12:41 |
| rlandy | I thought it was rdocloud that was moving | 12:41 |
| rlandy | today I see the doc for ci-rhos | 12:42 |
| rascasoft | rlandy, I'll convert that in a removal patch, gimme a minute | 12:42 |
| rlandy | rascasoft: ack | 12:42 |
| weshay | rlandy, the plans are still not yet firm | 12:42 |
| rlandy | weshay: that is fine, I was just confused | 12:42 |
| weshay | rlandy, I can try to explain in the call later | 12:42 |
| weshay | ssbarnea, https://review.openstack.org/#/c/567224 | 12:42 |
| rlandy | weshay: secondly, I sent an email regarding the patches to enabled rhos-13 on ovb ... | 12:43 |
| weshay | ssbarnea, the first thing to do is to write up an alert bug | 12:43 |
| rlandy | https://review.openstack.org/#/c/579406/ may be controversial | 12:43 |
| weshay | sshnaidm, how we doing w/ sova? | 12:43 |
| rlandy | sshnaidm: what do you think of ^^? | 12:43 |
| rlandy | I need it for rhos-13 but not sure of it will have negative impact elsewhere | 12:44 |
| weshay | ssbarnea, 10 bucks says we're missing a back port | 12:44 |
| rlandy | I could use something link additional properties | 12:44 |
| sshnaidm | weshay, seems working, is smth wrong with it? | 12:45 |
| weshay | sshnaidm, for the overcloud | 12:46 |
| weshay | :) | 12:46 |
| weshay | ssbarnea, fyi | 12:46 |
| weshay | 2018-08-28 09:22:55 | ERRORS | 12:46 |
| weshay | 2018-08-28 09:22:55 | [u"No image with the name 'bm-deploy-kernel' found - make sure you have uploaded boot images.", u"No image with the name 'bm-deploy-ramdisk' found - make sure you have uploaded boot images.", u'Not enough baremetal nodes - available: 0, requested: 1', u'Not enough baremetal nodes - available: 0, requested: 1', u'Not enough baremetal nodes - available: 0, requested: 1', u'Not enough baremetal nodes - available: 0, | 12:46 |
| weshay | requested: 1', u'Not enough baremetal nodes - available: 0, requested: 1', u'Not enough baremetal nodes - available: 0, requested: 1', u'Not enough baremetal nodes - available: 0, requested: 1', u'Not enough baremetal nodes - available: 0, requested: 1', u'Not enough baremetal nodes - available: 0, requested: 1', u'Not enough baremetal nodes - available: 0, requested: 1', u'Not enough baremetal nodes - available: 0, requested: 1', u'Not enough | 12:46 |
| weshay | baremetal nodes - available: 0, requested: 1', u'Not enough baremetal nodes - available: 0, requested: 1', u"No image with the name 'bm-deploy-kernel' fouConfiguration has 18 errors, fix them before proceeding. Ignoring these errors is likely to lead to a failed deploy. | 12:46 |
| sshnaidm | weshay, sova or ara? :) | 12:46 |
| weshay | 2018-08-28 09:27:39 | nd - make sure you have uploaded boot images.", u"No image with the name 'bm-deploy-ramdisk' found - make sure you have uploaded boot images.", u'Not enough baremetal nodes - available: 0, requested: 1'] | 12:46 |
| ssbarnea | yeah, me imagining the same. a) should I open a new bug or just mention on existing one that is affecting other branch(es)? b) these new 3o branches are going to create a huge amount of backporting work on losts of fixes, .... wondering it makes sense. | 12:46 |
| weshay | sshnaidm, did I say sova? | 12:46 |
| weshay | I meant ara | 12:46 |
| weshay | lolz | 12:46 |
| * weshay gets coffee | 12:46 | |
| sshnaidm | weshay, still no success on that :( | 12:46 |
| weshay | ssbarnea, point me at the open bug please | 12:46 |
| weshay | dam | 12:46 |
| sshnaidm | weshay, I need help from DF people to dive into code.. | 12:47 |
| rascasoft | sshnaidm, weshay, rlandy https://review.openstack.org/#/c/596789/ this should fix the thing | 12:47 |
| rfolco | rlandy, I'll be out until lunch time (doctor appt.), can you take over https://review.openstack.org/#/q/topic:replace_legacy_pre+(status:open+OR+status:merged) please, fix and re-run jobs ? | 12:47 |
| rfolco | rlandy, morning | 12:47 |
| rlandy | rfolco: ok | 12:48 |
| sshnaidm | rlandy, is this patch related to latest bugs | 12:49 |
| rfolco | rlandy, thx, just to not block you. I can continue when I return | 12:49 |
| sshnaidm | rlandy, of ironic and nova capabilities? | 12:49 |
| weshay | sshnaidm, can you write up an RFE bug for sova in the overcloud and describe the two attempts you've made at it | 12:49 |
| sshnaidm | weshay, yes, for ara :D | 12:50 |
| weshay | sshnaidm, thanks | 12:50 |
| rlandy | sshnaidm: I need it for ci-rhos nodes - nothing to do with upstream | 12:50 |
| * rlandy asks bob about the impact | 12:50 | |
| weshay | ssbarnea, if you want to jump on blue and debug together that is fine | 12:58 |
| weshay | let me know | 12:58 |
| ssbarnea | weshay: for the moment I added https://bugs.launchpad.net/tripleo/+bug/1789416 and tagged it with alert. | 13:00 |
| openstack | Launchpad bug 1789416 in tripleo "stable/queens: No image with the name 'bm-deploy-kernel' found - make sure you have uploaded boot images."" [Undecided,New] | 13:00 |
| weshay | ssbarnea, actually this is odd.. jump on blue | 13:00 |
| weshay | ssbarnea, thank you.. good | 13:00 |
| weshay | https://bluejeans.com/4113567798 | 13:01 |
| *** gkadam has quit IRC | 13:05 | |
| rlandy | sshnaidm: ok - I added comments to https://review.openstack.org/#/c/579406 after checking with ironic gurus - think it will be ok | 13:05 |
| *** jaganathan_ has quit IRC | 13:09 | |
| *** saneax has quit IRC | 13:11 | |
| *** agopi has quit IRC | 13:13 | |
| *** agopi has joined #oooq | 13:14 | |
| sshnaidm | rlandy, ok, so it is related to this bug https://bugs.launchpad.net/tripleo/+bug/1787910 | 13:15 |
| openstack | Launchpad bug 1787910 in tripleo "OVB overcloud deploy fails on nova placement errors" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 13:15 |
| sshnaidm | rlandy, and without these settings deployment doesn't work, right? | 13:18 |
| weshay | ssbarnea, https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-deploy/tasks/deployed-server.yml | 13:19 |
| *** saneax has joined #oooq | 13:26 | |
| *** skramaja has quit IRC | 13:26 | |
| rlandy | sshnaidm: ha - maybe | 13:27 |
| *** apetrich has joined #oooq | 13:27 | |
| rlandy | I found it on ci-rhos | 13:27 |
| rlandy | sshnaidm: hmmm ... with this, it may not be necessary | 13:31 |
| rlandy | sshnaidm: and yeah - I get no nodes w/o the adjustment | 13:31 |
| rlandy | anyways ... back to zuul v3 | 13:32 |
| rlandy | panda: how goes it with getting rid of legacy? | 13:33 |
| rascasoft | rlandy, so I changed https://code.engineering.redhat.com/gerrit/#/c/148025/ to consider the validate_ha_overcloud variable instead of all the other that I don't need anymore (due to the last patch that we verified together) | 13:34 |
| rlandy | rfolco: has two patches out https://review.openstack.org/#/q/topic:replace_legacy_pre+(status:open+OR+status:merged) | 13:34 |
| rlandy | panda: ^^ | 13:34 |
| rlandy | I'd like to make one dependent patch so we can test | 13:34 |
| rlandy | rascasoft: looks fine to me | 13:35 |
| panda | rlandy: depdendcies added | 13:42 |
| weshay | sshnaidm, panda either one of you know off hand where the multinode images bm-deploy-ramdisk are located in multinode deployments | 13:43 |
| weshay | I forget | 13:43 |
| sshnaidm | weshay, we don't have images in multinode deployment | 13:43 |
| weshay | sshnaidm, well there is no overcloud full | 13:44 |
| rlandy | panda: ack - let's see what shakes our | 13:44 |
| rlandy | out | 13:44 |
| weshay | sshnaidm, they don't boot for sure | 13:44 |
| weshay | http://logs.openstack.org/24/567224/94/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/c68d42a/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-08-28_09_27_39 | 13:44 |
| weshay | sshnaidm, maybe that is just a queens issue | 13:44 |
| weshay | in tht | 13:44 |
| rlandy | panda: this to me is wring though ... review.openstack.org/#/c/596887/1/config/nodes/2ctlr.yml | 13:45 |
| sshnaidm | weshay, seems like red herring message | 13:46 |
| weshay | ya.. maybe | 13:46 |
| * rlandy updates | 13:46 | |
| weshay | sshnaidm, is right | 13:48 |
| weshay | ssbarnea, bah.. we should have checked that first | 13:48 |
| weshay | ssbarnea, on a working job.. http://logs.openstack.org/24/567224/93/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/a3c37c3/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-08-22_01_02_09 | 13:48 |
| weshay | arxcruz, you there buddy? | 13:49 |
| arxcruz | weshay: i'm always here | 13:50 |
| weshay | arxcruz, are comfortable introducing the tempest role collab on the tripleo agenda? | 13:50 |
| arxcruz | weshay: sure, but we will discuss tins with the OSA during the ptg | 13:51 |
| rlandy | panda: I updated on of rfolco's patches - going to force change to recheck your patch | 13:55 |
| rlandy | panda: also, why the rename? https://review.openstack.org/#/c/596422/12/toci-quickstart/config/testenv/ovb-rdo-cloud-tripleo.yml | 13:56 |
| weshay | ssbarnea, http://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/roles/overcloud-deploy/tasks/create-scripts.yml#n22 | 13:57 |
| weshay | http://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/roles/overcloud-deploy/templates/config-download.yaml.j2 | 13:57 |
| panda | rlandy: wait, I dont' think this is going to work, we are no passing the zuul inventory to the quickstart call, there will be no hostvars["primary'] in our inventory, I need to make an intermediate step | 13:58 |
| panda | rlandy: because of the bug I put in the commit message | 13:58 |
| ssbarnea | weshay: not sure what to see there but i find the "downlad" typo bit funny :D | 13:58 |
| *** vinaykns has joined #oooq | 14:00 | |
| jfrancoa | weshay: I don't think it's a tht issue, as the upgrades job has the same issue and it deploys one release less (pike in this case). I manage to reproduce it in RDO cloud but I really can't find any hint on why the deploy timeouts | 14:01 |
| weshay | jfrancoa, sec.. I think I found the issue | 14:01 |
| weshay | not sure | 14:01 |
| * rlandy reads bug | 14:01 | |
| rlandy | thought patch 'closes-bug' | 14:02 |
| rlandy | panda: wrt intermediate step, ... | 14:03 |
| rlandy | suggested using include_vars: | 14:04 |
| rlandy | with the path to the zuul inventory | 14:04 |
| rlandy | ^^ suggested this yesterday - rfolco said that we had access | 14:04 |
| panda | rlandy: do we have the zuul inventory.yaml file available in the nodes ? | 14:04 |
| rlandy | panda: well before we need to resolve that, we could do an include_vars - getting comments | 14:05 |
| rlandy | <rfolco> {{ hostvars['primary']['ansible_host'] }} --> http://logs.openstack.org/48/589448/9/check/tripleo-ci-centos-7-3nodes-multinode/4398d2d/zuul-info/inventory.yaml | 14:06 |
| rlandy | panda: you tell me if you agree | 14:07 |
| *** dsneddon has joined #oooq | 14:08 | |
| weshay | ssbarnea, jfrancoa https://review.openstack.org/597141 will put up a test patch to test | 14:13 |
| rlandy | let's see what shakes out | 14:14 |
| rlandy | the failures are usually quick | 14:14 |
| jfrancoa | weshay: ahhhaaa...I realized about it too when I compared the overcloud deploy templates from the failing jobs and tripleo-ci-centos-7-containers-multinode, but wasn't sure if that could be the problem | 14:15 |
| jfrancoa | weshay: let's wait for the CI results, but looks promising | 14:15 |
| jfrancoa | weshay: thanks | 14:15 |
| panda | rlandy: I thik we may have a shot with zuul.executor.inventory_file, but again, I'm not sure it's accessible from the nodes | 14:15 |
| weshay | jfrancoa, ssbarnea test patch https://review.openstack.org/#/c/597142/ | 14:15 |
| *** hamzy has quit IRC | 14:19 | |
| *** hamzy has joined #oooq | 14:20 | |
| rascasoft | rlandy, this should solve the other problem of the master deployment, I'm testing it right now https://code.engineering.redhat.com/gerrit/148417 | 14:23 |
| *** dtrainor has quit IRC | 14:27 | |
| rlandy | rascasoft: k - let me know | 14:29 |
| rlandy | 2018-08-28 14:20:10.319529 | primary | TASK [tripleo-inventory : Add subnode to ansible inventory] ******************** | 14:30 |
| rlandy | 2018-08-28 14:20:10.347600 | primary | Tuesday 28 August 2018 14:20:10 +0000 (0:00:00.095) 0:00:01.683 ******** | 14:30 |
| rlandy | 2018-08-28 14:20:10.385311 | primary | fatal: [undercloud]: FAILED! => {"msg": "'dict object' has no attribute 'subnodes'"} | 14:30 |
| rlandy | ^^ panda: ok - so we have a clear failure | 14:31 |
| rlandy | zuul.executor.inventory_file is just the path to the file | 14:31 |
| rlandy | error show up in inventory ...tripleo-inventory | 14:32 |
| rlandy | Add the overcloud nodes to the generated inventory | 14:32 |
| rlandy | we could include_vars before then | 14:32 |
| *** dtrainor has joined #oooq | 14:37 | |
| rlandy | panda: ? | 14:37 |
| rlandy | looking at current failures | 14:37 |
| rlandy | Could not find or access '/home/zuul/src/git.openstack.org/openstack/tripleo-ci/toci-quickstart/config/testenv/singlenode.yml' | 14:39 |
| rlandy | rfolco: hmmm ... not going to fly ... Add subnode to ansible inventory | 14:41 |
| panda | rlandy: updated 596422 and dependencies | 14:54 |
| panda | rlandy: collecting subnodes in a list and passing the list to quickstart | 14:54 |
| rlandy | panda: k - was making a different change - let's try this one first | 14:55 |
| *** abishop has joined #oooq | 14:59 | |
| *** dtrainor_ has joined #oooq | 15:03 | |
| *** dtrainor has quit IRC | 15:03 | |
| *** jfrancoa has quit IRC | 15:09 | |
| *** gkadam has joined #oooq | 15:10 | |
| rlandy | weshay: before you leave, https://code.engineering.redhat.com/gerrit/#/c/148341/ | 15:11 |
| *** ykarel is now known as ykarel|away | 15:19 | |
| *** dtrainor_ has quit IRC | 15:26 | |
| *** dtrainor_ has joined #oooq | 15:27 | |
| rlandy | panda: http://zuul.openstack.org/stream.html?uuid=3d1d9998c25a49c0af27fbfcd64235c5&logfile=console.log | 15:29 |
| rlandy | panda: missing " here https://review.openstack.org/#/c/596422/14/playbooks/tripleo-ci/run-v3.yaml | 15:31 |
| panda | dam | 15:34 |
| panda | rlandy: fixed, the jobs are taking long to start, I'll do some testing locally in parallel | 15:35 |
| ssbarnea | weshay: it see again "update_containers and update_containers_append_tag is undefined" again, and affected your last patch. | 15:36 |
| rlandy | panda: ack - thanks | 15:36 |
| *** ykarel|away has quit IRC | 15:36 | |
| ssbarnea | even if the LP bug diplay all patches mentioned there as merged. | 15:37 |
| *** ykarel|away has joined #oooq | 15:37 | |
| *** agopi has quit IRC | 15:41 | |
| *** ykarel|away has quit IRC | 15:42 | |
| sshnaidm | weshay, trying to find update packages logs for containers, they are now in journal.txt, right? | 15:43 |
| *** dtantsur is now known as dtantsur|afk | 15:44 | |
| weshay | sshnaidm, :( ya | 15:45 |
| weshay | sshnaidm, I don't think my patch ever worked | 15:45 |
| sshnaidm | weshay, I can't find it..weird | 15:52 |
| sshnaidm | maybe containers aren't updated.. | 15:52 |
| panda | rlandy: should have fixed all the syntax, typo and format errors now | 15:53 |
| rlandy | panda: thanks - was just following the last failed job | 15:54 |
| weshay | sshnaidm, I'll get a blueprint started.. but I'm pto for the next several days | 15:56 |
| weshay | sshnaidm, so you'll need to take it over | 15:56 |
| sshnaidm | weshay, I don't know why to make blueprint before something works at all | 15:57 |
| weshay | sshnaidm, what ever | 15:57 |
| weshay | sshnaidm, what ever it takes not to have to debug timeouts by hand | 15:58 |
| weshay | I'm pretty much willing to do | 15:58 |
| sshnaidm | weshay, ok, if it will help... | 15:58 |
| sshnaidm | let's use ara for overcloud -> let's make it supported in product -> let's make anything to be supported in product | 15:59 |
| sshnaidm | what's next | 15:59 |
| *** udesale has quit IRC | 15:59 | |
| rlandy | hmmm .. still fetching zuul cloner | 16:02 |
| weshay | ssbarnea, no dice http://logs.openstack.org/42/597142/2/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/4ee2063/job-output.txt.gz | 16:04 |
| weshay | 2018-08-28 15:42:43 | Error: The following files were not found: /home/zuul/config-download.yaml | 16:05 |
| rlandy | panda++ | 16:05 |
| rlandy | we're getting somewhere now | 16:05 |
| weshay | ssbarnea, ok.. can fix that | 16:05 |
| panda | \o/ | 16:05 |
| vinaykns | Channel need help...I'm unable to add vbmc...it complains about QEMU driver error: Domain not found..any possible workaround..?? | 16:05 |
| rlandy | 2018-08-28 16:04:48.044703 | primary | "msg": "'dict object' has no attribute 'subnodes'" | 16:06 |
| rlandy | not quite :( | 16:06 |
| panda | ... | 16:06 |
| panda | of course ... single node has no subnodes group | 16:08 |
| *** agopi has joined #oooq | 16:08 | |
| *** dsneddon has quit IRC | 16:09 | |
| rlandy | undercloud upgrades - same | 16:10 |
| *** dsneddon has joined #oooq | 16:10 | |
| panda | rlandy: ok, I have the fix for the single node, let's see if multinode get somewhere | 16:10 |
| panda | before updating | 16:10 |
| weshay | rascasoft, fyi.. the deployment options changed from queens -> rocky/master for deployed-server https://review.openstack.org/#/c/597141/ | 16:12 |
| weshay | ssbarnea, fyi. I don't see how using numbers vs. release names is better | 16:13 |
| weshay | ssbarnea, it would probably be more confusing to folks unfamiliar w/ the ordering as well | 16:13 |
| rascasoft | weshay, ack, I was asking just to know | 16:13 |
| weshay | rascasoft, aye | 16:13 |
| rlandy | panda: that's fine | 16:14 |
| ssbarnea | weshay: 99% of features start at some version or/and end at some version, so instead of haivng to update tons of lists like " if release in [b,c]" to add "d" to the list, we would do if release >= b do.... | 16:14 |
| ssbarnea | as a note, that's not about this change, is a general question. | 16:15 |
| weshay | ssbarnea, I see ur point | 16:15 |
| ssbarnea | i don't see how we can use >,<... with strings. | 16:15 |
| rlandy | 2018-08-28 16:08:55.202010 | primary | ERROR! the playbook: ["secondary"]} could not be found | 16:16 |
| weshay | ssbarnea, it's worth proposing to openstack-dev[tripleo][ci] | 16:16 |
| rlandy | panda: guess not | 16:16 |
| rlandy | ^^ | 16:16 |
| ssbarnea | downstream we had something like this, at least in few places. | 16:17 |
| ssbarnea | add to my todo list, after the timeouts one. | 16:18 |
| *** gkadam has quit IRC | 16:21 | |
| rlandy | panda: are you fixing or should I? | 16:25 |
| rlandy | {% set subnodes_ev={"subnodes":subnodes} %} | 16:25 |
| rlandy | need an = | 16:25 |
| rlandy | for extra-vars | 16:25 |
| panda | rlandy: fixed, I was collecting node names, not ips | 16:26 |
| panda | rlandy: that should be the json format for extra-vars | 16:26 |
| rlandy | panda: cool - thanks | 16:27 |
| panda | rlandy: mmmhh, you're right about the format, I don't think the json it's escaped correctly | 16:27 |
| rlandy | panda: also - pls see my comment about = on extra-vars | 16:27 |
| panda | bah, I wanted to avoid using a yaml file as etra vars, but seems I don't have choice | 16:27 |
| rlandy | you are passing : | 16:27 |
| rlandy | won't work | 16:28 |
| panda | rlandy: I'm tryingg to use the JSON format from here https://docs.ansible.com/ansible/latest/user_guide/playbooks_variables.html#passing-variables-on-the-command-line | 16:29 |
| panda | but it's not correctly escaped ... creating a file | 16:33 |
| *** saneax has quit IRC | 16:48 | |
| *** saneax has joined #oooq | 16:49 | |
| weshay | rlandy, panda can I speak to both of you please asap | 16:55 |
| rlandy | ok | 16:56 |
| weshay | https://bluejeans.com/u/whayutin/ | 16:56 |
| *** saneax has quit IRC | 16:56 | |
| rfolco | o/ back | 16:57 |
| rlandy | weshay: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/ovb-manage-stack/tasks/ovb-create-stack.yml#L30 | 17:01 |
| rlandy | https://github.com/openstack/tripleo-quickstart-extras/blob/master/config/environments/rdocloud.yml#L8 | 17:03 |
| panda | always a few days before PTG | 17:05 |
| panda | it's when those kind of deamons wake up | 17:06 |
| panda | rlandy: new patchset for the subnodes. Changing approach by passing a file | 17:07 |
| rlandy | panda: ok - let's see how we go - thanks | 17:08 |
| *** vinaykns has quit IRC | 17:11 | |
| *** trown is now known as trown|lunch | 17:13 | |
| rlandy | rfolco: hey - panda's made some changes | 17:20 |
| rlandy | added deps | 17:20 |
| rlandy | we are watching latest | 17:20 |
| rfolco | rlandy, nice | 17:21 |
| panda | gah | 17:22 |
| panda | what now ? :( | 17:23 |
| weshay | panda, rlandy I self killed ovb devmode | 17:24 |
| weshay | https://review.openstack.org/#/c/584097/ | 17:24 |
| panda | ah, missed a braket | 17:25 |
| rlandy | may it rest in peace | 17:25 |
| *** apetrich has quit IRC | 17:32 | |
| *** kopecmartin has quit IRC | 17:37 | |
| abishop | ssbarnea: any luck determining why stable/queens "scenario00X jobs time out? see https://review.openstack.org/595357 and https://review.openstack.org/595014 | 17:41 |
| weshay | sshnaidm, have you looked at https://review.openstack.org/#/c/566938/ as a model? | 17:43 |
| sshnaidm | weshay, no, just saw.. | 17:44 |
| sshnaidm | weshay, but this is hardcoding of single plugin | 17:44 |
| sshnaidm | weshay, I don't think we can add all ara now to tripleo-common.. | 17:44 |
| sshnaidm | weshay, it's pretty big project, and update it.. | 17:45 |
| weshay | sshnaidm, ya | 17:45 |
| weshay | agree | 17:45 |
| weshay | dtrainor_, here :) | 17:47 |
| sshnaidm | weshay, need to make a mechanism of adding any ansible config variables to both undercloud and overcloud, separately.. | 17:47 |
| weshay | sshnaidm, ya | 17:47 |
| weshay | sshnaidm, /me get started on a spec | 17:47 |
| weshay | and wheeps | 17:48 |
| weshay | weeps | 17:48 |
| weshay | ? | 17:48 |
| sshnaidm | weshay, but I think still need to hack oooq to make it working till then to get data.. | 17:48 |
| weshay | sshnaidm, totally agree | 17:48 |
| weshay | sshnaidm, toure and I going to chat about it some more | 17:49 |
| sshnaidm | weshay, I'll continue to make hacks on mistral container.. | 17:49 |
| weshay | sshnaidm, he found https://github.com/ybovard/ara/blob/master/Dockerfile | 17:49 |
| sshnaidm | weshay, hmm.. install ara in container it's 2 lines | 17:50 |
| sshnaidm | weshay, this seems overhead | 17:50 |
| sshnaidm | weshay, and how can it help? | 17:51 |
| dtrainor_ | weshay, yes :) | 17:51 |
| sshnaidm | weshay, I'd better ask why this didn't work: https://review.openstack.org/#/c/596847/2/roles/overcloud-prep-containers/templates/overcloud-prep-containers.sh.j2 | 17:53 |
| *** vinaykns has joined #oooq | 18:01 | |
| rlandy | panda; still with us? | 18:10 |
| rlandy | I know it's late for you if you want rfolco and I to take over | 18:10 |
| panda | rlandy: last PS is promising | 18:14 |
| panda | and now that I said it's going to fail | 18:15 |
| panda | whoa tripleo-inventory passed | 18:15 |
| panda | failing on undercloud only, I have the fix. | 18:16 |
| panda | but at least it's doing something | 18:16 |
| *** tosky has quit IRC | 18:23 | |
| panda | rlandy: rfolco dinner time for me, the patch may work, just missing this diff for the undercloud jobs | 18:23 |
| panda | http://paste.openstack.org/show/728994/ | 18:23 |
| panda | bbl | 18:23 |
| *** trown|lunch is now known as trown | 18:24 | |
| rlandy | cool | 18:28 |
| rfolco | nice move mr panda | 18:32 |
| rlandy | panda: k ... adding that change - let's see | 18:33 |
| rlandy | from the paste | 18:33 |
| rlandy | patch update | 18:34 |
| rlandy | rdocloud jobs are filing everywhere | 18:34 |
| rlandy | let's see what those do now | 18:34 |
| rlandy | 2018-08-28 18:42:46.330710 | primary | Could not find or access '/home/zuul/src/git.openstack.org/openstack/tripleo-ci/toci-quickstart/config/testenv/singlenode.yml' | 18:49 |
| rlandy | still erroring on that | 18:49 |
| rlandy | ENV_VARS="$ENV_VARS --extra-vars @$TRIPLEO_ROOT/tripleo-ci/toci-quickstart/config/testenv/{{ environment_type }}.yml" | 19:02 |
| rlandy | ^^ issue | 19:02 |
| *** vinaykns has quit IRC | 19:06 | |
| rlandy | panda: ^^ making a change to fix ^^ | 19:09 |
| panda | mmh, the file exists | 19:09 |
| rlandy | really - where? | 19:10 |
| rlandy | it was set to multinode before | 19:10 |
| rlandy | for all other than ovb | 19:10 |
| panda | rlandy: it's a symlink to multinode.yml | 19:10 |
| panda | ah | 19:10 |
| rlandy | was not used before | 19:10 |
| panda | it's only on my git .. I didn't git add | 19:10 |
| panda | :( | 19:10 |
| rlandy | ok - pls git add | 19:10 |
| rlandy | and pls get latest patch | 19:11 |
| rlandy | so we don;t overwrite | 19:11 |
| rlandy | I added the change from your paste | 19:11 |
| *** vinaykns has joined #oooq | 19:11 | |
| panda | rlandy: uploaded new PS | 19:11 |
| rlandy | thank you sir | 19:12 |
| rlandy | and 25th time lucky?? | 19:22 |
| rlandy | oohh ... looking better | 19:27 |
| panda | 25th patchiversary edition special | 19:49 |
| *** ccamacho has quit IRC | 19:54 | |
| rlandy | we got legacy failures going down | 20:01 |
| rlandy | fatal: [undercloud]: FAILED! => {"attempts": 1, "changed": true, "cmd": ["curl", "-sfL", "http://192.168.103.253/builds-master/current-tripleo/overcloud-full.tar.md5"], "delta": "0:00:03.014815", "end": "2018-08-28 19:37:00.767979", "msg": "non-zero return code", "rc": 7, "start": "2018-08-28 19:36:57.753164", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | 20:04 |
| rlandy | checking that | 20:04 |
| rlandy | why??? | 20:10 |
| rlandy | why would checksum fail just here? | 20:17 |
| rlandy | panda: ^^ checking rdocloud failures | 20:18 |
| rlandy | Could not find or access '/opt/stack/new/tripleo-ci/toci-quickstart/config/testenv/multinode-rdocloud.yml' | 20:19 |
| rlandy | ^^ ok we got an issue | 20:20 |
| rlandy | panda: ping | 20:33 |
| rlandy | panda: weshay: rfolco: we got errors on rdocloud jobs - which means we will need to update toci_gate_test.sh and toci_gate_test | 20:39 |
| rlandy | want to see the current upstream jobs complete - then will update the patch | 20:40 |
| rlandy | we can't kill legacy atm | 20:40 |
| weshay | wooot | 20:41 |
| *** trown is now known as trown|outtypewww | 21:00 | |
| rlandy | weshay: is true by default correct ... https://review.openstack.org/#/c/592668/3/roles/build-test-packages/defaults/main.yml? | 21:19 |
| weshay | rlandy, ask Alex, but ya.. that's what he is intending afaict | 21:20 |
| *** holser_ has quit IRC | 21:24 | |
| *** jtomasek has quit IRC | 21:38 | |
| panda | rlandy: we can create some legacy ovb-rdocloud.yml | 21:39 |
| panda | rlandy: just symlinks to actual files | 21:40 |
| rlandy | panda: well I wanted to change toc_gate_test | 21:40 |
| rlandy | ENV_VARS="$ENV_VARS --extra-vars @$TRIPLEO_ROOT/tripleo-ci/toci-quickstart/config/testenv/ovb-$NODEPOOL_PROVIDER.yml" | 21:40 |
| rlandy | instead of RH_CLOUD | 21:40 |
| rlandy | I didnt commit anything yet | 21:41 |
| rlandy | so we can see the full test run with your current patch | 21:41 |
| rlandy | but I think that will only fix some of the errors | 21:41 |
| * rlandy gets | 21:41 | |
| rlandy | panda: https://paste.fedoraproject.org/paste/WqlAQl0pPAez0NyQQOPZbg | 21:42 |
| rlandy | that won;t fix this error though ... | 21:43 |
| rlandy | 2018-08-28 19:25:21.485662 | tripleo-ovb-centos-7 | cat: /etc/nodepool/primary_node_private: No such file or directory | 21:43 |
| rlandy | panda: we see | TASK [fetch-images : Get image expected checksum] ** error | 21:44 |
| rlandy | but I think that is not the real error | 21:45 |
| rlandy | its' a consequence of what didn't run before | 21:45 |
| rlandy | panda: let me know what you think of the changes in the paste and we can try start fixing the rdocloud errors | 21:46 |
| panda | mmhh more /etc/nodepool usage | 21:53 |
| panda | rlandy: your paste is ok, as far as I know ovb jobs are only run in the rdo-cloud-tripleo provider | 21:56 |
| rlandy | panda: ok - as soon as the last patch report results I will commit my changes | 21:57 |
| rlandy | we will have to deal with /etc/nodepool | 21:57 |
| *** weshay is now known as weshay|pto | 21:58 | |
| panda | rlandy: the error in https://logs.rdoproject.org/22/596422/25/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/7c26970/job-output.txt.gz#_2018-08-28_19_25_28_056573 looks likes is coming from devstack | 22:04 |
| rlandy | panda: that doesn't fail the job though | 22:05 |
| rlandy | https://logs.rdoproject.org/22/596422/25/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/7c26970/job-output.txt.gz#_2018-08-28_19_36_57_202540 | 22:06 |
| rlandy | ^^ failure is there | 22:06 |
| rlandy | may be legit? | 22:06 |
| rlandy | panda: we are nearly done with current jobs | 22:07 |
| rlandy | then let's see what the paste does | 22:07 |
| panda | rlandy: that part comes from the "prepare corss node connectivity functions of devstack, maybe thery are just not needed anymore. And are useless fro ovb anyway. | 22:08 |
| panda | rlandy: do we have a passing ovb job to compare this with ? | 22:10 |
| rlandy | panda: ack .. getting | 22:13 |
| rlandy | panda: logs.rdoproject.org/06/596906/2/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/5e74232/ | 22:14 |
| panda | heh, working build is not showing the full url | 22:16 |
| panda | rlandy: but it's wrong, it should be http://images.rdoproject.org/{{ release }}/rdo_trunk/{{ dlrn_hash|default(dlrn_hash_tag) }}/overcloud-full.tar.md5 | 22:17 |
| panda | rlandy: that means that ovb-rdo-cloud-tripleo.yml is not loaded | 22:18 |
| rlandy | panda: I think it's because it's not sourcing the right settings file | 22:18 |
| panda | rlandy: yep | 22:18 |
| rlandy | honestly, not sure any of this will help | 22:18 |
| rlandy | panda: what time is it there??? go to sleep!!! | 22:19 |
| rlandy | updates/upgrades are killing us | 22:22 |
| sshnaidm | rlandy, can you merge please? https://review.openstack.org/#/c/597041/ | 22:36 |
| *** vinaykns has quit IRC | 22:36 | |
| *** sshnaidm is now known as sshnaidm|afk | 22:39 | |
| rlandy | yes - voting | 22:48 |
| *** agopi has quit IRC | 22:51 | |
| rlandy | 2018-08-28 23:11:22.995686 | primary | TASK [tripleo-inventory : Add subnode to ansible inventory] ******************** | 23:13 |
| rlandy | 2018-08-28 23:11:23.009283 | primary | Tuesday 28 August 2018 23:11:23 +0000 (0:00:00.050) 0:00:00.709 ******** | 23:13 |
| rlandy | 2018-08-28 23:11:23.032386 | primary | fatal: [undercloud]: FAILED! => {"msg": "'subnodes' is undefined"} | 23:13 |
| rlandy | shoot | 23:13 |
| *** holser_ has joined #oooq | 23:13 | |
| *** holser_ has quit IRC | 23:20 | |
| *** agopi has joined #oooq | 23:23 | |
| panda | rlandy: copy the task from run-v3 | 23:25 |
| rlandy | panda: ack but to where | 23:27 |
| rlandy | that is what I am looking for | 23:27 |
| rlandy | we run playbooks/legacy/pre.yml | 23:27 |
| rlandy | https://github.com/rdo-infra/rdo-jobs/blob/master/playbooks/legacy/pre.yaml | 23:28 |
| rlandy | panda: and we will have to pass subnodes - I have that fix | 23:30 |
| panda | rlandy: what aboyt tripleo-ci/run.yaml directly ? | 23:34 |
| rlandy | I don;t think those jobs call that | 23:34 |
| rlandy | panda: how about this: https://review.rdoproject.org/r/16013? | 23:35 |
| rlandy | panda: then https://review.openstack.org/#/c/596422/ | 23:38 |
| rlandy | https://review.openstack.org/#/c/596422/27/toci_quickstart.sh | 23:38 |
| panda | mmhh, so who's left running run.yaml | 23:41 |
| panda | whatever is, it will break toci_quickstart.sh if it's not dumping subnode ips | 23:42 |
| rlandy | idk | 23:45 |
| rlandy | panda: feel free to revert if you have a better idea | 23:46 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!