| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata-branch @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-3nodes- (1 more message) | 00:14 |
|---|---|---|
| *** sanjay__u has quit IRC | 00:26 | |
| *** jtomasek has joined #oooq | 00:33 | |
| *** saneax is now known as saneax-_-|AFK | 00:55 | |
| *** jtomasek has quit IRC | 02:12 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-3nodes-multinode @ https://review.openstack.org/567224, stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 (1 more message) | 02:14 |
| *** ykarel|away has joined #oooq | 03:42 | |
| *** udesale has joined #oooq | 03:50 | |
| *** links has joined #oooq | 04:07 | |
| *** skramaja has joined #oooq | 04:09 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata-branch @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-containers- (1 more message) | 04:14 |
| *** anande has joined #oooq | 04:20 | |
| *** ykarel|away has quit IRC | 04:29 | |
| *** jaganathan has quit IRC | 04:36 | |
| *** jaganathan has joined #oooq | 04:37 | |
| *** ykarel|away has joined #oooq | 04:45 | |
| *** saneax-_-|AFK is now known as saneax | 04:53 | |
| *** pgadiya has joined #oooq | 05:04 | |
| *** pgadiya has quit IRC | 05:04 | |
| *** ccamacho has quit IRC | 05:07 | |
| *** ratailor has joined #oooq | 05:17 | |
| *** quiquell|off is now known as quiquell | 05:38 | |
| *** gvrangan has joined #oooq | 05:42 | |
| *** ykarel|away is now known as ykarel | 05:44 | |
| *** marios has joined #oooq | 05:47 | |
| *** ccamacho has joined #oooq | 05:51 | |
| *** jaosorior has quit IRC | 05:57 | |
| *** jfrancoa has joined #oooq | 06:03 | |
| *** links has quit IRC | 06:08 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata-branch @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-containers- (1 more message) | 06:14 |
| *** links has joined #oooq | 06:26 | |
| *** tosky has joined #oooq | 06:50 | |
| *** kopecmartin has joined #oooq | 06:53 | |
| *** bogdando has joined #oooq | 06:57 | |
| *** ccamacho has quit IRC | 07:00 | |
| *** ccamacho has joined #oooq | 07:00 | |
| *** tesseract has joined #oooq | 07:22 | |
| *** zoli is now known as zoli|wfh | 07:23 | |
| *** zoli|wfh is now known as zoli | 07:24 | |
| *** ykarel is now known as ykarel|lunch | 07:38 | |
| *** anande has quit IRC | 07:53 | |
| *** links has quit IRC | 07:58 | |
| *** holser__ has joined #oooq | 08:07 | |
| *** dtantsur|afk is now known as dtantsur | 08:09 | |
| *** links has joined #oooq | 08:12 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata-branch @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-containers- (1 more message) | 08:14 |
| *** ykarel|lunch is now known as ykarel | 08:15 | |
| *** anande has joined #oooq | 08:17 | |
| *** jaosorior has joined #oooq | 08:18 | |
| *** anande has quit IRC | 08:40 | |
| ykarel | is there some issue with promoter? 20b99f6998c088650b0c0cb066cc6aac3e5f9312_b333f915 is not promoted for master current-tripleo-rdo | 08:43 |
| ykarel | sshnaidm|rover, ^^ | 08:43 |
| sshnaidm|rover | ykarel, will check | 08:43 |
| *** panda|bbl is now known as panda | 09:18 | |
| panda | quiquell: yesterday afternoon I could not do anything, any progress with the debugging ? | 09:19 |
| quiquell | panda: Not yet | 09:20 |
| quiquell | Give me a minute | 09:20 |
| panda | quiquell: anything I can do to help, tell me | 09:21 |
| quiquell | I will | 09:21 |
| *** anande has joined #oooq | 09:22 | |
| quiquell | sshnaidm|rover: At the end I am just convertin the ruck rover tool into a alerting thing and point it to sova to look deeper | 09:25 |
| quiquell | It's a good pairing of tools | 09:25 |
| *** ratailor has quit IRC | 09:26 | |
| *** ratailor has joined #oooq | 09:26 | |
| quiquell | panda: My reproducer has finish but not applied the zuul changes | 09:32 |
| quiquell | Can you help me ? | 09:33 |
| panda | quiquell: yes | 09:33 |
| quiquell | Calling you to bj | 09:33 |
| quiquell | I am at your bj | 09:35 |
| quiquell | panda: Tripleo-ci is sensible to zuul_changes | 10:03 |
| quiquell | Looking at nodepool-setup role | 10:03 |
| quiquell | patch_repos.yaml | 10:03 |
| panda | quiquell: looks like pas 12 works, we have logs http://logs.openstack.org/65/566565/12/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/aab4d89/logs/emit_releases_file.txt.gz | 10:07 |
| panda | ugh, mail system is down | 10:10 |
| quiquell | weird, ps 12 is not changing the toci script | 10:10 |
| quiquell | But if it's working we are ok | 10:10 |
| quiquell | Going to check for trown's comments | 10:10 |
| panda | quiquell: no but it's rebased on changes to the script | 10:10 |
| quiquell | Let me chek the changes | 10:11 |
| quiquell | A lot of stuff between 11 and 12 | 10:14 |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata-branch @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-containers- (1 more message) | 10:14 |
| quiquell | jaja | 10:18 |
| quiquell | Foudn a big problem | 10:18 |
| panda | ouch | 10:21 |
| panda | quiquell: details ? | 10:22 |
| quiquell | Give you a review in a minute | 10:22 |
| chandankumar | kopecmartin: arxcruz any more card waiting on me for QA? | 10:31 |
| arxcruz | chandankumar: i don't think so | 10:32 |
| quiquell | panda: https://review.openstack.org/#/c/569954 | 10:32 |
| quiquell | panda: Can I add a Depends-On at your patch ? | 10:34 |
| quiquell | Or is better to rebase everything ? | 10:34 |
| quiquell | To test it | 10:34 |
| panda | quiquell: a depends on should be enough | 10:35 |
| quiquell | ok | 10:35 |
| quiquell | Going to change your commit to add it | 10:35 |
| *** anande has quit IRC | 10:35 | |
| quiquell | panda: Also will try to address the adding the DLRN hash | 10:39 |
| quiquell | I suppose we have to override what's inside the release file yaml | 10:39 |
| panda | quiquell: it's not enough | 10:39 |
| quiquell | how so ? | 10:39 |
| panda | quiquell: some of the other variables are calculated inside the release file. We discussed about this, I think we realized we need to add a variable with a default option for the hashes in the release file | 10:40 |
| quiquell | inside release file ? | 10:41 |
| panda | quiquell: yes | 10:41 |
| quiquell | Humm I see know | 10:42 |
| *** zoli is now known as zoli|lunch | 10:42 | |
| quiquell | It depens how ansible to the expansion | 10:42 |
| quiquell | if we have -e @foo.yaml -e bar=this | 10:42 |
| quiquell | It going to use bar from foo.yaml or from command line ? | 10:43 |
| panda | quiquell: IIUC when you -e @foo.yaml, everything inside the yaml file is rendered first, so if -e bar overrides a value in @foo.yml, it may be already too late to recalculate all the things in foo.yaml that use the old not overridden bar value | 10:45 |
| panda | quiquell: and if we -e bar first and then -e foo last, then the bar value in foo will override the old bar value, and nothing will happen anyway | 10:46 |
| panda | but I'm not 100% sure of this order of yaml rendering | 10:47 |
| quiquell | Testing it for learning | 10:47 |
| quiquell | panda: You talk about stuff like undercloud_image_url | 10:47 |
| quiquell | ? | 10:47 |
| quiquell | panda: Has something interesting to show you | 10:49 |
| quiquell | looks like | 10:49 |
| quiquell | ansible-playbook -e @queens-undercloud-newton-overcloud.yml -e dlrn_hash_tag=foo foo.yaml | 10:50 |
| quiquell | ok: [localhost] => { | 10:50 |
| quiquell | "msg": "value: https://images.rdoproject.org/queens/delorean/foo/undercloud.qcow2" | 10:50 |
| quiquell | } | 10:50 |
| quiquell | Looks like we can override the variables inside the release file | 10:50 |
| quiquell | So adding them after should be enough | 10:50 |
| panda | quiquell: mmmhh, so the ordering I understood was not correct | 10:50 |
| quiquell | Just test it | 10:51 |
| quiquell | Going to try a patchset at your commit | 10:51 |
| panda | quiquell: need to find a document with the exact ordering at this point. The test can go on and on for days :) | 10:51 |
| quiquell | I think it make sense | 10:51 |
| quiquell | If you think about it | 10:51 |
| quiquell | It's done in two steps | 10:51 |
| quiquell | ansible first set variables to values | 10:52 |
| quiquell | then it expand the templates | 10:52 |
| quiquell | going like the latest stuff i did we get right the first step | 10:52 |
| panda | quiquell: it's not that simple I'm afraid, and if you ever coded for junja templates you know why | 10:52 |
| quiquell | panda: Is not simple enough for the relases file ? | 10:53 |
| panda | quiquell: sometimes you need more than one pass at the same template to exhaust all the possible variables | 10:53 |
| quiquell | Ok, going to add a new review to test it | 10:53 |
| quiquell | We can squash it if we want later on | 10:53 |
| panda | quiquell: yes, mI mean, it's not simple to understand exacly what ansible does when rendering templates | 10:53 |
| quiquell | Damn... I am beign so naif | 10:53 |
| panda | because it will need more tha one passes to render everything correctly | 10:54 |
| panda | quiquell: ?? | 10:54 |
| quiquell | panda: Let's throw a review and see what happends | 10:55 |
| quiquell | We will never know if it's broken though... | 10:56 |
| panda | quiquell: I too like to live dangerously | 10:56 |
| quiquell | hehe | 10:57 |
| quiquell | panda: going to remove the variable from the release file and see if it works in the review | 11:00 |
| quiquell | just in the review | 11:00 |
| chandankumar | panda: arxcruz can we remove fs021 rdo ci job from python-tempestconf and tempest? | 11:00 |
| chandankumar | since it is no longer monitored i think | 11:00 |
| *** jaosorior has quit IRC | 11:01 | |
| *** jaosorior has joined #oooq | 11:02 | |
| panda | chandankumar: I think this was one of the tempest squad action items, remove fs21 from pike and master jobs and create another fs for the pike an master job to test containerized deployments | 11:03 |
| chandankumar | kopecmartin: arxcruz ^^ | 11:04 |
| quiquell | panda: Going to test on this | 11:09 |
| quiquell | https://review.openstack.org/569958 | 11:09 |
| chandankumar | panda: regarding above review, since cinder v1 api is deprecated long time ago, it would not be a problem | 11:11 |
| chandankumar | since jun | 11:11 |
| chandankumar | *juno | 11:11 |
| panda | chandankumar: ok, removing the -1, thanks | 11:13 |
| panda | chandankumar: approved | 11:19 |
| chandankumar | panda: thanks :-) | 11:19 |
| *** panda is now known as panda|lunch | 11:19 | |
| *** moguimar has quit IRC | 11:25 | |
| *** moguimar has joined #oooq | 11:25 | |
| weshay | sshnaidm|rover, hey want to try and double check me on the bm master config? | 11:33 |
| sshnaidm|rover | weshay, ok | 11:33 |
| weshay | https://code.engineering.redhat.com/gerrit/#/c/139395/ | 11:34 |
| weshay | sshnaidm|rover, that was my first pass | 11:35 |
| weshay | sshnaidm|rover, if you are not that familiar w/ these boxes we can chat about it | 11:35 |
| weshay | sshnaidm|rover, is there something more for https://review.openstack.org/#/c/569854/ | 11:36 |
| chandankumar | panda|lunch: for fs021 for containerized deployment didnot get that part | 11:36 |
| *** ratailor has quit IRC | 11:36 | |
| sshnaidm|rover | weshay, 569854 569930 569932 are ready to go | 11:39 |
| sshnaidm|rover | weshay, I don't know these boxes, but looks ok for me.. | 11:40 |
| weshay | sshnaidm|rover, ya.. essentially we need restructure the configs so they can just take a featureset config | 11:40 |
| *** dtantsur is now known as dtantsur|afk | 11:59 | |
| *** zoli|lunch is now known as zoli | 12:01 | |
| *** moguimar has quit IRC | 12:01 | |
| *** zoli is now known as zoli|wfh | 12:01 | |
| *** zoli|wfh is now known as zoli | 12:01 | |
| *** moguimar has joined #oooq | 12:01 | |
| *** moguimar has quit IRC | 12:02 | |
| *** amoralej is now known as amoralej|lunch | 12:04 | |
| *** moguimar has joined #oooq | 12:09 | |
| *** moguimar_ has joined #oooq | 12:11 | |
| *** moguimar_ has quit IRC | 12:12 | |
| *** moguimar_ has joined #oooq | 12:12 | |
| *** moguimar has quit IRC | 12:14 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode @ https://review.openstack.org/560445 | 12:14 |
| *** panda|lunch is now known as panda | 12:16 | |
| weshay | \0/ | 12:30 |
| weshay | check out that hubbot status :)) | 12:30 |
| weshay | sshnaidm|rover, myoung|ruck ^ | 12:30 |
| chandankumar | weshay: arxcruz sshnaidm|rover https://review.rdoproject.org/r/13851 please have a look at this one | 12:32 |
| *** trown|outtypewww is now known as trown | 12:34 | |
| quiquell | Trown have been checking the dlrh_hash thing | 12:43 |
| quiquell | Good morning btw | 12:43 |
| quiquell | https://review.openstack.org/#/c/569958/ | 12:44 |
| trown | quiquell: yep just checking all those reviews, thanks for being active on that | 12:44 |
| quiquell | Doing a naif testing feels to me that ansible is usable but panda has concerns | 12:44 |
| quiquell | trown: Np let's push this a little | 12:44 |
| quiquell | I have check that doing ansible-playbook -e @foo.yaml -e bar=blah | 12:45 |
| trown | quiquell: put comments on 569958 ... I think we have to workaround some tech debt theree | 12:45 |
| trown | there | 12:45 |
| quiquell | foo.yaml template get expanded with bar=blah | 12:45 |
| trown | ya I think the way you did that is fine, just need to use a different (kind of obscure) var to ensure we get the dlrn hash we intend in all cases | 12:46 |
| quiquell | trown: holy sh... get_build_command :-) | 12:47 |
| trown | there is logic around mixed upgrades that will override any other settings | 12:47 |
| quiquell | I was not even close hehe | 12:47 |
| panda | "holy shell" | 12:47 |
| quiquell | Exactly that panda | 12:48 |
| trown | so eventually we want to rip out that logic, since we have moved it to python... but until then we can use the other var to workaround our other workarounds | 12:48 |
| panda | "holy shift" | 12:48 |
| trown | you are welcome panda :P | 12:48 |
| trown | ETOOMANYWORKAROUNDS | 12:48 |
| quiquell | Workarounds enchilada | 12:49 |
| panda | yo dawg | 12:49 |
| * trown may have to actually make a yo dawg workaround meme | 12:49 | |
| quiquell | trown, panda: The hash is part of this sprint ? | 12:49 |
| trown | quiquell: ya | 12:49 |
| quiquell | ok | 12:49 |
| trown | updates are part of the sprint, and the hash is needed for updates | 12:50 |
| panda | yep, we need to have at least a workable output | 12:50 |
| quiquell | Ok, let's test the get_build_command | 12:51 |
| myoung|ruck | back | 12:52 |
| myoung|ruck | %gatestatus | 12:52 |
| hubbot | FAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode @ https://review.openstack.org/560445 | 12:52 |
| * myoung|ruck rubs his eyes in disbelief | 12:52 | |
| myoung|ruck | panda, weshay, we on for syn in 7m? | 12:53 |
| myoung|ruck | sync* | 12:53 |
| quiquell | panda, trown: btw, still not getting why reproducer is not checking the correct zuul-change of tripleo-ci | 12:53 |
| quiquell | The role and nodepool-setup is trying it | 12:53 |
| quiquell | Need to debug that | 12:53 |
| *** moguimar_ is now known as moguimar | 12:53 | |
| quiquell | That's another story | 12:53 |
| panda | myoung|ruck: aye, sorry about yesterday | 12:53 |
| weshay | myoung|ruck, yup | 12:53 |
| quiquell | trown: I think we have to pash both get_build_command and dlrn_hash | 12:55 |
| quiquell | there are templatized stuff in the release file | 12:55 |
| trown | get_build_command will override it all for containers | 12:55 |
| trown | but you might be right for repos | 12:56 |
| quiquell | There is stuff like this | 12:56 |
| quiquell | undercloud_image_url: https://images.rdoproject.org/queens/delorean/{{ dlrn_hash|default(dlrn_hash_tag) }}/undercloud.qcow2 | 12:56 |
| quiquell | ipa_image_url: https://images.rdoproject.org/queens/delorean/{{ dlrn_hash|default(dlrn_hash_tag) }}/ironic-python-agent.tar | 12:56 |
| quiquell | 12:56 | |
| quiquell | in the release file | 12:56 |
| trown | quiquell: ya so we need both | 12:57 |
| quiquell | Ok, adding them | 12:57 |
| weshay | dam yo | 12:58 |
| weshay | 12:37:52 up 593 days, 21:07, 1 user, load average: 0.00, 0.00, 0.00 | 12:58 |
| panda | wow, not kernel security updates for the past two years | 12:59 |
| weshay | panda, meh | 13:00 |
| weshay | internal box | 13:00 |
| quiquell | weshay: Looks like a skyrim steam stats | 13:04 |
| *** amoralej|lunch is now known as amoralej | 13:11 | |
| *** skramaja has quit IRC | 13:19 | |
| quiquell | trown: Added both https://review.openstack.org/#/c/569958 | 13:26 |
| *** holser__ has quit IRC | 13:26 | |
| *** holser__ has joined #oooq | 13:27 | |
| *** gvrangan has quit IRC | 13:44 | |
| quiquell | Guys do you know why this openstack image list --long -f value -c ID --property latest=centos-7-latest | 13:48 |
| quiquell | Give me two images ? | 13:48 |
| quiquell | | 28b76dd3-4017-4b46-8dc9-98ef1cb4034f | CentOS-7-x86_64-GenericCloud-1801-01 | active | | 13:48 |
| quiquell | | fdfd5d39-a76d-45df-abec-17f768ba3054 | CentOS-7-x86_64-GenericCloud-1804_02 | active | | 13:48 |
| quiquell | Ok a problem with rdo cloud | 13:49 |
| trown | ya they shouldnt both have latest property i think | 13:50 |
| quiquell | We cannot unset that ? | 13:52 |
| *** quiquell_ has joined #oooq | 13:54 | |
| *** quiquell_ has quit IRC | 13:54 | |
| trown | checking who owns the images | 13:54 |
| quiquell | trown: Do you have both with latest at your cloud ? | 13:55 |
| trown | quiquell: ya they are owned by | 14:00 |
| trown | 8dbc460fe5fd4fcab0096c2c0aad3ece | 14:00 |
| quiquell | trown: dmanchado is fixing it | 14:01 |
| trown | which is not openstack-nodepool... not sure which user it is, but infra would have to modify the images | 14:01 |
| trown | k | 14:01 |
| quiquell | But reproducer is fuck up rigth now | 14:01 |
| quiquell | Also RDO jobs will be I think | 14:01 |
| *** moguimar has quit IRC | 14:05 | |
| *** quiquell is now known as quiquell|off | 14:06 | |
| *** zoli is now known as zoli|afk | 14:07 | |
| *** moguimar has joined #oooq | 14:09 | |
| rasca | myoung|ruck, hey man -> https://code.engineering.redhat.com/gerrit/#/c/139505/ <- does this makes sense? | 14:10 |
| *** moguimar_ has joined #oooq | 14:10 | |
| *** moguimar has quit IRC | 14:13 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode @ https://review.openstack.org/560445 | 14:15 |
| *** matbu has joined #oooq | 14:16 | |
| *** moguimar_ is now known as moguimar | 14:18 | |
| *** ccamacho has quit IRC | 14:19 | |
| rasca | bandini, I think we might want to skip today's triage call, there are btw 2 bugs not triaged in the list if you want to take a look: https://bugzilla.redhat.com/show_bug.cgi?id=1564654 and https://bugzilla.redhat.com/show_bug.cgi?id=1576148 | 14:24 |
| openstack | bugzilla.redhat.com bug 1564654 in puppet-pacemaker "OSP13: Overcloud deployment fails when using capital letters in customized stack name ( --stack TEST-STACK34 )." [High,New] - Assigned to rhos-maint | 14:24 |
| openstack | bugzilla.redhat.com bug 1576148 in pacemaker "Upper case letters in HostnameFormat parameters cause trouble" [Urgent,Post] - Assigned to kgaillot | 14:25 |
| rasca | sorry folks, wrong channel :) | 14:25 |
| *** jtomasek has joined #oooq | 14:29 | |
| *** ccamacho has joined #oooq | 14:31 | |
| *** ccamacho has quit IRC | 14:31 | |
| *** ccamacho has joined #oooq | 14:32 | |
| *** saneax is now known as saneax-_-|AFK | 14:36 | |
| chandankumar | tosky++ | 14:46 |
| hubbot | chandankumar: tosky's karma is now 1 | 14:46 |
| *** matbu has quit IRC | 14:49 | |
| *** matbu has joined #oooq | 14:58 | |
| *** zoli|afk is now known as zoli | 15:01 | |
| *** zoli is now known as zoli|wfh | 15:02 | |
| *** zoli|wfh is now known as zoli | 15:02 | |
| *** ykarel has quit IRC | 15:03 | |
| *** moguimar has quit IRC | 15:07 | |
| *** moguimar has joined #oooq | 15:09 | |
| weshay | sshnaidm++ re: https://review.openstack.org/#/c/569932/ | 15:13 |
| *** udesale has quit IRC | 15:14 | |
| *** udesale has joined #oooq | 15:15 | |
| *** rlandy has joined #oooq | 15:19 | |
| rlandy | panda: hi - what did I miss at Monday's meeting? | 15:21 |
| *** yolanda has quit IRC | 15:21 | |
| weshay | rlandy,!! | 15:23 |
| weshay | rlandy, need you expertise when you have a minute | 15:23 |
| rlandy | weshay: hi - sure - I'm here | 15:23 |
| rlandy | what's up? | 15:23 |
| panda | rlandy: the script still needs some adjustment to work properly, we've had no output in some patchset , but looking good now. We have no decision on the env part of the dry run, but moving on to close the review today. | 15:24 |
| rlandy | panda: we can just remove that env dump | 15:25 |
| rlandy | or make it dump out env vars only with dry run | 15:25 |
| *** yolanda has joined #oooq | 15:25 | |
| rlandy | I don't want to hold the sprint work because of it | 15:25 |
| rlandy | let me know what you think and I can update that patch accordingly | 15:26 |
| *** Goneri has joined #oooq | 15:26 | |
| weshay | rlandy, ok.. when you have 10min | 15:27 |
| weshay | I need you on blue | 15:27 |
| panda | rlandy: I think your patch is on scope, stated the same thing in the last comment. waiting for more advantage/disadvantage analysis before calling a decision | 15:27 |
| myoung|ruck | rasca: merged https://code.engineering.redhat.com/gerrit/#/c/139505 Include validate ha logs in ha environments | 15:27 |
| rlandy | weshay: k - can join now | 15:28 |
| weshay | k | 15:29 |
| rasca | myoung|ruck, oh thanks! So I did right, good to know! | 15:30 |
| myoung|ruck | rasca: aye...i have an action item to create an RFE tracking LP to add the "append to collected log list" patch as well...but for now what you did in that review should work today w/ current collect-logs implementation (both in tripleo-env as well as current upstream roles) | 15:31 |
| rasca | myoung|ruck, but don't you think that even if we find a way to append instead of a full re declaration we will in any case need to have a specific yaml like in my case? | 15:32 |
| *** jtomasek has quit IRC | 15:32 | |
| myoung|ruck | rasca: yes, but it would avoid the duplication of the base array (and the drift it incurrs), and ideally you could just park the config anywhere...vs. in a discreet yaml | 15:33 |
| * myoung|ruck shrugs | 15:33 | |
| weshay | rlandy, https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset001.yml#L138-L143 | 15:34 |
| *** Goneri has quit IRC | 15:35 | |
| *** moguimar has quit IRC | 15:36 | |
| rlandy | weshay: https://github.com/openstack-infra/tripleo-ci/blob/master/toci-quickstart/config/testenv/ovb.yml#L30 | 15:36 |
| *** moguimar has joined #oooq | 15:36 | |
| *** links has quit IRC | 15:37 | |
| sshnaidm|rover | panda, didn't we agree yesterday to come to one decision? | 15:40 |
| * myoung|ruck will bbiaf | 15:40 | |
| panda | sshnaidm|rover: yes | 15:41 |
| sshnaidm|rover | panda, I mean together | 15:41 |
| weshay | rlandy, http://paste.openstack.org/show/721634/ | 15:42 |
| *** moguimar has quit IRC | 15:43 | |
| panda | sshnaidm|rover: we've not decided how, I asked to add more advantages/disadvantages on the current solution with a comment on the patch. | 15:44 |
| *** moguimar has joined #oooq | 15:46 | |
| sshnaidm|rover | panda, and when did you want to discuss that? | 15:49 |
| *** yolanda has quit IRC | 15:49 | |
| *** moguimar has quit IRC | 15:50 | |
| *** moguimar has joined #oooq | 15:52 | |
| panda | sshnaidm|rover: so at this point in the sprint, I think we have two choices: Merge this as it is, or remove the env dump part. We've discussed it without getting to a solid conclusion. What's left to do for me is to list all the advantages, all the disadvantages and see what decision makes more sense. | 15:52 |
| *** matbu has quit IRC | 15:54 | |
| sshnaidm|rover | panda, mmm... I thought to take it offline for discussion mean to gather all interested parties and come to something that all agree on it... | 15:55 |
| sshnaidm|rover | panda, but seems like I was wrong | 15:55 |
| *** bogdando has quit IRC | 15:58 | |
| panda | sshnaidm|rover: we could do it, maybe not at this point on the sprint, and not before having a list of advantages and disadvantages. We had discussions, even monday. I think the only discussion we can do at this point is if the advantages make more sense than the disadvantages, so we can have a decision on some bullet points. | 16:00 |
| panda | weshay: I have up to 1h till EOD now. Hard stop at 1h | 16:01 |
| weshay | panda, k.. I need 5 min w/ rlandy | 16:02 |
| weshay | almost done | 16:02 |
| weshay | rlandy, myoung|ruck https://code.engineering.redhat.com/gerrit/139519 fyi | 16:03 |
| weshay | that's WIP btw | 16:06 |
| sshnaidm|rover | panda, it doesn't explain for me why you don't want to keep agreements, but nevermind | 16:09 |
| sshnaidm|rover | rlandy, if you remove dump of env variables, I can handle it in my patch, anyway I have already list of variables to manage. I'll update that list with vars you introduced in last patches and also will add them to collect-logs function that anyway needs them. | 16:10 |
| hubbot | FAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode @ https://review.openstack.org/560445 | 16:15 |
| weshay | panda, ready | 16:15 |
| rlandy | sshnaidm|rover: was in meeting - looking at the last comments on that patch | 16:16 |
| *** tesseract has quit IRC | 16:17 | |
| *** marios has quit IRC | 16:19 | |
| *** ccamacho has quit IRC | 16:23 | |
| *** Goneri has joined #oooq | 16:31 | |
| rlandy | weshay: left a comment on https://code.engineering.redhat.com/gerrit/#/c/139519 - we should only keep network related stuff in single-nic | 16:33 |
| *** zoli is now known as zoli|gone | 16:33 | |
| *** zoli|gone is now known as zoli | 16:33 | |
| rlandy | panda; sshnaidm|rover: I missed the discussion on monday - and at this point, I'd rather not hold up the entire sprint over dumping the variables | 16:37 |
| rlandy | panda; sshnaidm|rover: my suggestion is that we dump the vars only in a dry run | 16:38 |
| rlandy | that way we have the debug capability | 16:38 |
| rlandy | really - I think it's more important to get this patch merged | 16:39 |
| EmilienM | for CI team: https://review.openstack.org/#/c/569902/1 | 16:43 |
| sshnaidm|rover | rlandy, fine with me | 16:44 |
| rlandy | sshnaidm|rover: thanks - we can rethink it with your patch - I'd k=just like to get the other work in that patch in. waiting on panda's ok | 16:46 |
| *** trown is now known as trown|lunch | 16:47 | |
| sshnaidm|rover | EmilienM, we don't need this | 16:47 |
| *** jfrancoa has quit IRC | 16:47 | |
| *** matbu has joined #oooq | 16:47 | |
| *** jtomasek has joined #oooq | 16:48 | |
| *** kopecmartin has quit IRC | 16:48 | |
| EmilienM | sshnaidm|rover: oops ok | 16:49 |
| *** Goneri has quit IRC | 16:50 | |
| panda | rlandy: ack | 16:55 |
| *** panda is now known as panda|off | 16:59 | |
| rlandy | ok - here we go | 16:59 |
| weshay | EmilienM, wtf.. you are supposed to be at SUMMIT | 16:59 |
| weshay | hrm.. failed on prep-cont https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/tripleo-quickstart-master-rdo_trunk-baremetal-hp_dl360_envE-single_nic_vlans/123/console | 17:01 |
| *** dtantsur|afk is now known as dtantsur | 17:07 | |
| *** jtomasek has quit IRC | 17:08 | |
| rlandy | sshnaidm|rover: for your review again pls :) https://review.openstack.org/#/c/567060/ | 17:15 |
| rlandy | looking at envE job | 17:15 |
| weshay | rlandy, https://thirdparty.logs.rdoproject.org/jenkins-tripleo-quickstart-master-rdo_trunk-baremetal-hp_dl360_envE-single_nic_vlans-123/undercloud/home/stack/overcloud_prep_containers.log.txt.gz | 17:15 |
| weshay | so the containers are being pushed to undercloud_network_gateway: 10.12.150.190 | 17:16 |
| weshay | does that seem right? | 17:16 |
| rlandy | I don't think so | 17:17 |
| rlandy | why there? | 17:17 |
| rlandy | local_docker_registry_host | 17:18 |
| weshay | 2018-05-22 16:48:05 | ImageUploaderException: Could not push image 10.12.150.190:8787/tripleomaster/centos-binary-rsyslog-base | 17:18 |
| rlandy | its' defaulted | 17:18 |
| rlandy | we need to override | 17:18 |
| *** matbu has quit IRC | 17:19 | |
| rlandy | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/extras-common/defaults/main.yml#L7 | 17:19 |
| rlandy | undercloud_network_cidr|nthhost(1) | 17:19 |
| weshay | ya {undercloud_network_gateway|default(undercloud_network_cidr|nthhost(1)) | 17:21 |
| weshay | rlandy, what ip should it hit? | 17:21 |
| weshay | 10.12.150.252 > | 17:22 |
| weshay | ? | 17:22 |
| *** holser__ has quit IRC | 17:22 | |
| rlandy | it would need to go to the virthost | 17:22 |
| rlandy | undercloud_undercloud_public_vip: 10.12.150.130? | 17:23 |
| rlandy | undercloud_local_ip: 10.12.150.129/26 | 17:24 |
| rlandy | 129 or 130 | 17:24 |
| rlandy | let's check the env | 17:24 |
| rlandy | we need to see what is on the eno1 on the vm | 17:24 |
| weshay | ya.. I think 10.12.150.130 | 17:25 |
| rlandy | or better yet, define (undercloud_network_cidr | 17:25 |
| weshay | I can't hit the undercloud w/ the ip in the ss | 17:25 |
| rlandy | that is fine | 17:29 |
| rlandy | Host undercloud-root | 17:29 |
| rlandy | it asks me for password | 17:30 |
| weshay | ya.. I can get to the host | 17:38 |
| weshay | rlandy, odd | 17:38 |
| rlandy | that file should work | 17:39 |
| rlandy | that is for sure the latest workspace? | 17:40 |
| rlandy | weshay: we cab get by this bu defining a undercloud_network_cidr | 17:41 |
| weshay | https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/tripleo-quickstart-master-rdo_trunk-baremetal-hp_dl360_envE-single_nic_vlans/ws/ | 17:41 |
| myoung|ruck | weshay: kicking pike want me to kick pike for the new hash (promote would flip yellow to green for pike rdo2) - but leaving envE disabled | 17:41 |
| rlandy | no such var defined right now | 17:42 |
| weshay | myoung|ruck, focus on osp13 | 17:42 |
| rlandy | that would solve the problem of defaulting to the gateway | 17:42 |
| weshay | oh | 17:42 |
| weshay | right.. we could just update the config.. and rekick | 17:42 |
| rlandy | correct - although | 17:43 |
| weshay | w/ my guess is 130 | 17:43 |
| rlandy | undercloud_network_gateway | 17:43 |
| rlandy | if that is defined | 17:43 |
| rlandy | it will use it instead of the default | 17:43 |
| weshay | right | 17:43 |
| rlandy | so we will have to override | 17:43 |
| weshay | rlandy, let's add that to our latest change | 17:43 |
| rlandy | explictly | 17:43 |
| weshay | explicitly | 17:43 |
| weshay | yas | 17:44 |
| rlandy | weshay: sure | 17:44 |
| weshay | yes | 17:44 |
| weshay | rlandy, merge it and retry | 17:44 |
| rlandy | weshay:I should? or you will? | 17:44 |
| * rlandy has trouble with the tenses in IRC | 17:44 | |
| weshay | rlandy, you better drive from here https://code.engineering.redhat.com/gerrit/#/c/139519/ | 17:44 |
| weshay | go ahead and make the changes you think are needed | 17:45 |
| rlandy | weshay: ack - ok | 17:45 |
| weshay | I'm going to have to take my kid to the doctor before our trip :( | 17:47 |
| weshay | I'm loosing time :) | 17:48 |
| weshay | trown|lunch, fyi.. we're all confirmed re: interviews. Thanks again | 17:48 |
| *** Goneri has joined #oooq | 17:49 | |
| *** matbu has joined #oooq | 17:49 | |
| *** ccamacho has joined #oooq | 17:53 | |
| *** links has joined #oooq | 18:00 | |
| rlandy | hmmm ... Already running 1 builds across all nodes | 18:01 |
| *** trown|lunch is now known as trown | 18:06 | |
| trown | rlandy: do you think you could look at https://review.openstack.org/569115 ... last of the python script patches | 18:09 |
| trown | still a couple more tripleo-ci patches for wiring in the script though | 18:10 |
| rlandy | looking | 18:10 |
| *** udesale has quit IRC | 18:12 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode @ https://review.openstack.org/560445 | 18:15 |
| rlandy | trown; I also updated https://review.openstack.org/#/c/567060/ to get rid of the 'dump env vars' controversy | 18:22 |
| ccamacho | guys quick question, I pushed https://review.openstack.org/#/c/569991/ to test in oooqextras the undercloud backup/restore, I have a depends on to oooqto set a variable to true and execute the playbook | 18:23 |
| ccamacho | am I missing something there? | 18:23 |
| ccamacho | to actually call the playbook? | 18:24 |
| rlandy | myoung|ruck: is env E still disabled? | 18:26 |
| rlandy | a run kicked on it | 18:26 |
| *** amoralej is now known as amoralej|off | 18:26 | |
| *** sanjay__u has joined #oooq | 18:28 | |
| rlandy | ccamacho: depending where you want that playbook to be included (which workflow - multinode, ovb) , you will need to add it to https://github.com/openstack/tripleo-quickstart-extras/blob/master/playbooks/multinode.yml or https://github.com/openstack/tripleo-quickstart-extras/blob/master/playbooks/baremetal-quickstart-extras.yml (which gets kicked with https://github.com/openstack/tripleo-quickstart-extras/blob/master/playbooks/ba | 18:30 |
| rlandy | remetal-full-deploy.yml) | 18:30 |
| myoung|ruck | rlandy: master is enabled, the rest disabled. kill the queens run | 18:31 |
| myoung|ruck | it kicked before i disabled...killing it now | 18:32 |
| myoung|ruck | ahh it's already dead :) | 18:33 |
| myoung|ruck | rlandy: cool https://code.engineering.redhat.com/gerrit/#/c/139519 merged, master running | 18:34 |
| * myoung|ruck is working on rhos-13 gates | 18:34 | |
| rlandy | myoung|ruck: thanks | 18:36 |
| rlandy | didn't want to kill the wrong thing | 18:36 |
| ccamacho | rlandy I want to run it in this job tripleo-ci-centos-7-undercloud-oooq | 18:39 |
| *** dtantsur is now known as dtantsur|afk | 18:40 | |
| rlandy | playbooks/multinode-undercloud.yml | 18:44 |
| myoung|ruck | weshay: fyi rhos-13 gates are looking promising (don't want to jinx it) - at least we appear to be past hostname issue. | 18:53 |
| myoung|ruck | 2018-05-22 14:21:14 | ++ hostnamectl --static | 18:53 |
| myoung|ruck | 2018-05-22 14:21:14 | + hostnamectl set-hostname --transient undercloud-75595.novalocal | 18:53 |
| myoung|ruck | 2018-05-22 14:21:14 | ++ hostnamectl --static | 18:53 |
| myoung|ruck | 2018-05-22 14:21:14 | + hostnamectl set-hostname --static undercloud-75595.novalocal | 18:53 |
| myoung|ruck | weshay: ^^ note we don't have the non-fqdn hostnames (like before) | 18:54 |
| * myoung|ruck requests positive vibes --> https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/tq-gate-rhos-13-ci-rhos-ovb-minimal-pacemaker-public-bond/3 | 18:54 | |
| *** matbu has quit IRC | 18:56 | |
| rlandy | myoung|ruck: rhos-13 - so exciting!! | 18:57 |
| myoung|ruck | rlandy: aye we have a new puddle as of yesterday too | 18:57 |
| myoung|ruck | we were getting hung up (before) on having the jobs fail on preinstall validation checks for a FQDN hostname | 18:58 |
| *** links has quit IRC | 19:01 | |
| *** matbu has joined #oooq | 19:03 | |
| *** sshnaidm|rover is now known as sshnaidm|off | 19:04 | |
| *** Goneri has quit IRC | 19:08 | |
| *** matbu has quit IRC | 19:09 | |
| *** dtantsur|afk has quit IRC | 19:33 | |
| rlandy | what's happening with this patch? https://review.openstack.org/#/c/566565/ | 19:37 |
| rlandy | trown: ^^ any idea. looks like there is still work to do here. | 19:37 |
| * rlandy missed monday's discussion | 19:37 | |
| rlandy | I need to rebase my patch on this work | 19:38 |
| trown | rlandy: I think that patch is good to go, was waiting to see the patches above work | 19:39 |
| trown | rlandy: the updates job on https://review.openstack.org/569958 is of particular interest | 19:39 |
| trown | rlandy: if that works, I think we are good to go | 19:39 |
| rlandy | k - there were a bunch of comments on adding in the dlrn hash | 19:40 |
| trown | rlandy: ya it is is done in the patch I linked ^, updated my comment to a +2 with explanation that it doesnt change current behavior wrt updates and can be merged | 19:42 |
| hubbot | FAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode @ https://review.openstack.org/560445 | 20:15 |
| *** jtomasek has joined #oooq | 20:18 | |
| *** d0ugal_ has joined #oooq | 20:19 | |
| *** d0ugal has quit IRC | 20:21 | |
| myoung|ruck | weshay, rlandy, fyi we're well into OC deploy on TQ rhos-13 gates. I need to dash to fetch mini-me. will be back later to check on things. | 20:23 |
| rlandy | myoung|ruck++ | 20:24 |
| hubbot | rlandy: myoung|ruck's karma is now 1 | 20:24 |
| rlandy | myoung|ruck: debugging the envE job | 20:24 |
| rlandy | pls keep disabled for now | 20:24 |
| myoung|ruck | rlandy: ack, not messing with it | 20:24 |
| * myoung|ruck is really gone now :) | 20:24 | |
| *** jtomasek has quit IRC | 20:47 | |
| weshay | rlandy, ok.. same issue but at least we can get to the undercloud now :) | 20:48 |
| weshay | undercloud_public_host = 10.12.150.130 | 20:49 |
| rlandy | weshay: I am testing locally with 10.12.150.129 | 20:49 |
| rlandy | looks better | 20:49 |
| weshay | cool :) | 20:49 |
| rlandy | if that finishes will merge and rekick | 20:50 |
| weshay | word up | 20:50 |
| rlandy | guess at which ip it wants :) | 20:50 |
| rlandy | Completed upload for image docker.io/tripleomaster/centos-binary-swift-object:e8480e465826874c7851e6bc5672c9cbdee1cdbb_c19a0cf9 | 20:51 |
| rlandy | Completed upload for image docker.io/tripleomaster/centos-binary-swift-container:e8480e465826874c7851e6bc5672c9cbdee1cdbb_c19a0cf9 | 20:51 |
| *** jtomasek has joined #oooq | 20:52 | |
| weshay | heh | 20:58 |
| weshay | rlandy++ | 20:58 |
| hubbot | weshay: rlandy's karma is now 3 | 20:58 |
| rlandy | weshay: yeah - looks ok - pushing change | 21:01 |
| *** trown is now known as trown|outtypewww | 21:06 | |
| rlandy | lucky job 125? | 21:14 |
| *** jtomasek has quit IRC | 21:14 | |
| weshay | lady luck | 21:17 |
| *** jtomasek has joined #oooq | 21:34 | |
| weshay | rlandy, thanks for the help!! | 21:40 |
| weshay | I'm around but renicking ask I'll be in and out | 21:41 |
| *** weshay is now known as weshay_pto | 21:41 | |
| rlandy | weshay_pto: sure - enjoy your pto | 21:42 |
| *** tosky has quit IRC | 21:49 | |
| *** jtomasek_ has joined #oooq | 22:05 | |
| *** d0ugal_ has quit IRC | 22:06 | |
| *** jtomasek has quit IRC | 22:06 | |
| *** d0ugal_ has joined #oooq | 22:08 | |
| *** matbu has joined #oooq | 22:14 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode @ https://review.openstack.org/560445 | 22:15 |
| *** jtomasek_ has quit IRC | 22:20 | |
| myoung|ruck | weshay_pto: enjoy time away! | 22:36 |
| *** dtrainor has joined #oooq | 22:44 | |
| *** dtrainor has quit IRC | 23:07 | |
| rlandy | well, we git as far as a deploy failure | 23:14 |
| rlandy | progress | 23:14 |
| rlandy | checking logs | 23:15 |
| *** matbu has quit IRC | 23:43 | |
| rlandy | deploy arguments are complicated | 23:45 |
| rlandy | we never pass single nic | 23:51 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!