| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike-branch, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens-branch, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp- (2 more messages) | 00:13 |
|---|---|---|
| *** rlandy has quit IRC | 00:35 | |
| *** agopi has joined #oooq | 01:02 | |
| *** agopi has quit IRC | 02:07 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike-branch, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens-branch, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp- (2 more messages) | 02:13 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, tripleo-ci-centos-7-containers-multinode @ https://review.openstack.org/567224, stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ (2 more messages) | 04:13 |
| *** ykarel has joined #oooq | 04:41 | |
| *** ykarel_ has joined #oooq | 04:43 | |
| *** ykarel_ is now known as ykarel11 | 05:13 | |
| *** marios has joined #oooq | 05:13 | |
| *** ykarel11 is now known as ykarel_ | 05:13 | |
| *** pgadiya has joined #oooq | 05:14 | |
| *** pgadiya has quit IRC | 05:14 | |
| *** quiquell|off is now known as quiquell | 05:33 | |
| *** jfrancoa has joined #oooq | 05:33 | |
| *** jfrancoa has quit IRC | 05:35 | |
| *** jfrancoa has joined #oooq | 05:38 | |
| *** ratailor has joined #oooq | 05:44 | |
| quiquell | sshnaidm|bbl: Let's try to merge this https://review.openstack.org/#/c/567320/ | 05:51 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, tripleo-ci-centos-7-containers-multinode @ https://review.openstack.org/567224, stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ (2 more messages) | 06:13 |
| *** ccamacho has quit IRC | 06:22 | |
| *** sshnaidm|bbl is now known as sshnaidm|off | 06:23 | |
| *** ccamacho has joined #oooq | 06:40 | |
| sshnaidm|off | quiquell, a few comments there | 06:41 |
| *** holser__ has joined #oooq | 06:45 | |
| *** matbu has joined #oooq | 06:46 | |
| sshnaidm|off | quiquell, I see you did scripts for zuul queues | 06:48 |
| sshnaidm|off | quiquell, well, I did them too, that's why I wrote in etherpad "scripts are done" :) | 06:48 |
| *** florianf has joined #oooq | 06:49 | |
| *** kopecmartin has joined #oooq | 06:50 | |
| quiquell | sshnaidm|off: Yep, we can replace one for another, Just wanted to have something running | 06:52 |
| quiquell | And see how gauge works in grafana | 06:53 |
| *** saneax-_-|AFK is now known as saneax | 07:01 | |
| *** tesseract has joined #oooq | 07:14 | |
| *** skramaja has joined #oooq | 07:15 | |
| *** jtomasek has joined #oooq | 07:19 | |
| *** skramaja has quit IRC | 07:24 | |
| *** skramaja_ has joined #oooq | 07:24 | |
| *** amoralej|off is now known as amoralej | 07:48 | |
| *** bogdando has joined #oooq | 07:53 | |
| *** kopecmartin has quit IRC | 07:54 | |
| *** kopecmartin has joined #oooq | 07:56 | |
| quiquell | sshnaidm|off: Sagi, get_dlrn_hash is still not used in the main() | 07:57 |
| quiquell | Maybe we can try to merge this and do the fix in the wiring | 07:57 |
| quiquell | So we start to reduce the commit's maze | 07:57 |
| quiquell | So we can merge the integration for upgrades | 07:58 |
| quiquell | What do you think ? | 07:58 |
| sshnaidm|off | quiquell, I don't like merging breakable code tbh | 07:58 |
| sshnaidm|off | the fixes are trivial | 07:58 |
| quiquell | sshnaidm|off: Ok, Ãlet's add a PS to it, they are going to kill me | 07:59 |
| quiquell | sshnaidm|off: You are right, let's catch t he problems in the origin | 07:59 |
| *** tosky has joined #oooq | 08:02 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike-branch, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens-branch, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp- (2 more messages) | 08:13 |
| *** gkadam has joined #oooq | 08:18 | |
| quiquell | sshnaidm|off: Fixed https://review.openstack.org/#/c/567320 | 08:21 |
| sshnaidm|off | +2 | 08:22 |
| quiquell | Cool | 08:23 |
| *** ykarel_ is now known as ykarel|lunch | 08:25 | |
| quiquell | sshnaidm|off: Do you know why https://review.openstack.org/#/c/567649 is not running gate jobs ? | 08:27 |
| sshnaidm|off | quiquell, non merged dependencies? | 08:28 |
| quiquell | sshnaidm|off: We will have to rebase everything... | 08:29 |
| *** arxcruz has quit IRC | 08:30 | |
| *** lucas-afk is now known as lucasagomes | 08:32 | |
| quiquell | Damn they are going to kill me | 08:43 |
| quiquell | sshnaidm|off: Do you have the zuul's queue script around ? | 09:05 |
| *** arxcruz has joined #oooq | 09:23 | |
| *** ykarel|lunch is now known as ykarel| | 09:27 | |
| *** anande has joined #oooq | 09:31 | |
| *** zoli is now known as zoli|lunch | 09:33 | |
| *** panda|off is now known as panda | 09:37 | |
| quiquell | panda: Good morning | 09:39 |
| quiquell | We need a +2 here https://review.openstack.org/#/c/567320 | 09:39 |
| quiquell | Did have to add a PS | 09:40 |
| quiquell | We will have to rebase all the commits... I think | 09:40 |
| *** skramaja_ is now known as skramaja | 10:13 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, tripleo-ci-centos-7-containers-multinode @ https://review.openstack.org/567224, stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ (2 more messages) | 10:13 |
| quiquell | Thanks panda, let get this thing merge and continue with the rest of the maze | 10:19 |
| *** sshnaidm|off has quit IRC | 10:41 | |
| *** saneax is now known as saneax-_-|AFK | 10:43 | |
| *** zoli|lunch is now known as zoli | 11:01 | |
| *** atoth has quit IRC | 11:12 | |
| *** sshnaidm|off has joined #oooq | 11:12 | |
| *** panda is now known as panda|lunch | 11:14 | |
| *** quiquell is now known as quiquell|lunch | 11:27 | |
| *** rfolco has joined #oooq | 11:46 | |
| *** jaosorior has quit IRC | 11:54 | |
| *** atoth has joined #oooq | 12:00 | |
| *** anande has quit IRC | 12:10 | |
| *** jaganathan has quit IRC | 12:12 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, tripleo-ci-centos-7-containers-multinode @ https://review.openstack.org/567224, stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ (2 more messages) | 12:13 |
| *** EmilienM is now known as EvilienM | 12:21 | |
| *** trown|outtypewww is now known as trown | 12:24 | |
| *** rlandy has joined #oooq | 12:35 | |
| *** holser__ has quit IRC | 12:47 | |
| *** holser__ has joined #oooq | 12:48 | |
| *** quiquell|lunch is now known as quiquell | 12:55 | |
| *** amoralej is now known as amoralej|lunch | 12:55 | |
| quiquell | trown: https://review.openstack.org/#/c/567320/ at the gates :-) | 12:56 |
| trown | quiquell: ya thanks for getting sagi +2 | 12:57 |
| rlandy | weshay: 1-on-1? | 13:03 |
| weshay | rlandy, sorry .. 2 secs | 13:04 |
| rlandy | weshay: no rush | 13:04 |
| *** ratailor has quit IRC | 13:08 | |
| weshay | rlandy, k.. ready | 13:09 |
| *** dtantsur is now known as dtantsur|brb | 13:11 | |
| weshay | rlandy, <EmilienM> mwhahaha, weshay : containerized undercloud upgrade is back green http://logs.openstack.org/41/567641/5/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/10becf2/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz | 13:19 |
| weshay | https://review.openstack.org/#/c/567641/ | 13:19 |
| *** ratailor has joined #oooq | 13:21 | |
| *** ratailor has quit IRC | 13:25 | |
| *** myoung|ruck|off is now known as myoung|ruck | 13:37 | |
| chandankumar | Done for the day, heading home early, see ya on monday | 13:41 |
| *** bogdando has quit IRC | 13:42 | |
| *** holser__ has quit IRC | 13:43 | |
| weshay | chandankumar, have a good weekend | 13:43 |
| *** amoralej|lunch is now known as amoralej | 13:47 | |
| *** Goneri has joined #oooq | 13:51 | |
| quiquell | get_dlrn_hash merged ! | 13:59 |
| quiquell | trown, rlandy, panda: tox is failing | 14:04 |
| quiquell | The latest unit test I added is failing | 14:04 |
| quiquell | This is going to prevent the next commit in the maze to be merged | 14:05 |
| quiquell | https://review.openstack.org/#/c/567649 | 14:05 |
| quiquell | plain pytest call works by calling from tox fails | 14:07 |
| quiquell | :-/ | 14:07 |
| *** skramaja has quit IRC | 14:09 | |
| weshay | quiquell, ready? | 14:09 |
| quiquell | Yep | 14:10 |
| weshay | quiquell, https://bluejeans.com/4113567798 | 14:10 |
| rlandy | quiquell: looking | 14:11 |
| quiquell | alling with tox fails | 14:11 |
| quiquell | have to be runnign over virtualenv | 14:11 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, tripleo-ci-centos-7-containers-multinode @ https://review.openstack.org/567224, stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ (2 more messages) | 14:13 |
| *** dtantsur|brb is now known as dtantsur | 14:14 | |
| rlandy | TypeError: assert_called() takes exactly 1 argument (3 given) | 14:18 |
| rlandy | checking versions | 14:18 |
| *** trown is now known as trown|brb | 14:25 | |
| rlandy | trying your review | 14:28 |
| *** trown|brb is now known as trown | 14:30 | |
| rlandy | weshay: ping re: https://review.openstack.org/#/c/567641/- this has merge already | 14:30 |
| rlandy | but queens branch has not | 14:31 |
| trown | quiquell: rlandy I fixed it | 14:32 |
| rlandy | trown; cool - thanks | 14:32 |
| trown | oops... no i didnt, but I will :P | 14:33 |
| rlandy | lol | 14:33 |
| trown | i fixed it wrong, but I know how to fix it right | 14:33 |
| trown | haste makes waste :P | 14:34 |
| *** quiquell is now known as quiquell|mtg | 14:34 | |
| trown | rlandy: could you review https://review.openstack.org/567936 if we get that in the gate, we can get all the way to having all the lint/unittests jobs merged | 14:38 |
| rlandy | looking | 14:39 |
| rlandy | trown: +2'ed | 14:40 |
| rlandy | we are using that integration testing | 14:40 |
| rlandy | I can w+1 | 14:40 |
| rlandy | I just did :) | 14:41 |
| trown | rlandy: nice, then we just have a couple bigger patches left... but at least rebases will be cheaper | 14:41 |
| trown | I need to actually review the next one from quiquell|mtg | 14:41 |
| rlandy | yep - I have some reviews to do as well | 14:42 |
| rasca | myoung|ruck, rlandy, hey folks, if you can take a look at this https://code.engineering.redhat.com/gerrit/#/c/139243/ it's a straight forward's one | 14:50 |
| ajo | guys, any idea of what could be happening to me, | 14:53 |
| ajo | I'm deploying with tripleo/master | 14:53 |
| ajo | and when I create instances: | 14:53 |
| ajo | +--------------------------------------+----------+----------------------------------+--------+------------+-------------+----------+ | 14:53 |
| ajo | | ID | Name | Tenant ID | Status | Task State | Power State | Networks | | 14:53 |
| ajo | +--------------------------------------+----------+----------------------------------+--------+------------+-------------+----------+ | 14:53 |
| ajo | | e621a700-db3c-4aa7-9da0-32b35b49c9ab | cirros-1 | d0bcc605896848898aed2cdd1c4873e8 | BUILD | scheduling | NOSTATE | | | 14:53 |
| ajo | | 47dbcc44-59fe-4bfc-a4e4-d0aecfab4e31 | cirros-2 | d0bcc605896848898aed2cdd1c4873e8 | BUILD | scheduling | NOSTATE | | | 14:53 |
| ajo | | 694c2249-bb56-4ecc-921f-3147439332a1 | cirros-3 | d0bcc605896848898aed2cdd1c4873e8 | BUILD | scheduling | NOSTATE | | | 14:53 |
| ajo | +--------------------------------------+----------+----------------------------------+--------+------------+-------------+----------+ | 14:53 |
| ajo | they remain in scheduling forever | 14:53 |
| myoung|ruck | rasca: looking | 14:58 |
| myoung|ruck | rasca: is tested already? | 14:59 |
| myoung|ruck | rasca: only asking as we're at 12d master, 11d queens and I'm working in RDO2 today :) | 15:00 |
| rlandy | myoung|ruck: you're on this? | 15:00 |
| *** quiquell|mtg is now known as quiquell | 15:01 | |
| rasca | myoung|ruck, yes, you need to consider that apart from two IHA modifications (so not involving our pipelines deployments) this is the 1:1 copy of the original one | 15:01 |
| myoung|ruck | panda|lunch, devel tools @ https://www.google.com/url?q=https%3A%2F%2Fbluejeans.com%2F7050859455 | 15:01 |
| quiquell | trown: Did you fix it ? | 15:04 |
| trown | quiquell: ya | 15:04 |
| trown | mock.called doesnt take arguments | 15:05 |
| trown | needed mock.called_with | 15:05 |
| quiquell | trown: running just pytest in the directory works | 15:05 |
| quiquell | Maybe is the mock version ? | 15:05 |
| trown | quiquell: hmm not sure... that seems pretty broken | 15:06 |
| trown | quiquell: but ya running pytest from the directory would use packages | 15:06 |
| quiquell | Ok, so let's always use tox | 15:06 |
| quiquell | Sorry about it | 15:07 |
| *** panda|lunch is now known as panda | 15:08 | |
| panda | myoung|ruck: weshay https://etherpad.openstack.org/p/devmode-replacement-feedback | 15:09 |
| quiquell | trown: Do you have a bj minute ? | 15:13 |
| quiquell | There is something I don't understand | 15:14 |
| trown | sure | 15:15 |
| quiquell | https://bluejeans.com/7891065232 | 15:16 |
| trown | quiquell: oh, was just getting logged in so I could do that :P... joining yours | 15:17 |
| quiquell | Ups ok... | 15:17 |
| *** gkadam_ has joined #oooq | 15:21 | |
| rlandy | weshay: reckicked https://review.openstack.org/#/c/569229/ with the fix ti stable/queens | 15:22 |
| rlandy | to | 15:22 |
| *** gkadam has quit IRC | 15:24 | |
| rasca | myoung|ruck, rlandy, maybe you folks can also help me on this one: I'm overriding the artcl_collect_list var to get also HA test results (which are in the undercloud's homedir under validate_ha_logs), but this seems to be ignored during the collect_logs execution | 15:28 |
| rlandy | rasca: where are you doing the override? | 15:28 |
| rlandy | it's defined in a few places | 15:28 |
| *** anande has joined #oooq | 15:28 | |
| rasca | rlandy, inside the config file I'm passing to the tripelo-quickstart command line | 15:29 |
| rlandy | can you post your logs? | 15:29 |
| rlandy | want to check what was passed to the actual collect logs | 15:30 |
| rasca | rlandy, take this for example https://thirdparty.logs.rdoproject.org/jenkins-oooq-rhos-13-puddle-bmu-had00-lab-float_nic_with_vlans-8/ | 15:31 |
| quiquell | Ok leaving now, have a good weekend guys | 15:32 |
| *** quiquell is now known as quiquell|off | 15:32 | |
| *** Goneri has quit IRC | 15:33 | |
| *** atoth has quit IRC | 15:36 | |
| *** ykarel| is now known as ykarel|away | 15:36 | |
| rlandy | ok - si it's running a function out of locala | 15:37 |
| rlandy | local | 15:37 |
| rasca | rlandy, what do you mean? | 15:39 |
| rlandy | bash ci-scripts/collect-logs.sh minimal external &> $WORKSPACE/collect_logs.txt | 15:40 |
| rasca | rlandy, so are you saying I have a problem with all my jobs | 15:41 |
| rasca | in the way I invoke collect_logs | 15:41 |
| rlandy | well, I don't see http://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/ci-scripts | 15:41 |
| rlandy | has a collect-logs.sh | 15:42 |
| rlandy | so it's using https://github.com/openstack/tripleo-quickstart/blob/master/ci-scripts/collect-logs.sh | 15:43 |
| rlandy | so your settings would have to be passed there | 15:44 |
| rlandy | but comparing to upstream jobs ... | 15:44 |
| *** tesseract has quit IRC | 15:46 | |
| quiquell|off | weshay zuul's api | 15:47 |
| quiquell|off | https://github.com/openstack-infra/zuul/blob/5f267259c72e5e486499576521e0cdc27127265f/tests/unit/test_web.py | 15:47 |
| quiquell|off | we can even have info about refspecs | 15:47 |
| quiquell|off | http://zuul.openstack.org/api/status/change/564206,3 | 15:47 |
| quiquell|off | Now I am leaving | 15:47 |
| *** anande has quit IRC | 15:47 | |
| rlandy | rasca: I am just looking at a upstream log to compare - sec | 15:48 |
| rasca | rlandy, no worries, of course I'm talking just about rdophase2 and ospphase0 | 15:48 |
| rlandy | yeah - but we are not passing settings to your collect logs call | 15:48 |
| rlandy | I want to see how we do it in upstream | 15:49 |
| rasca | rlandy, ack thanks (need to go afk for a while) | 15:50 |
| *** ykarel|away has quit IRC | 15:51 | |
| *** ykarel has quit IRC | 15:51 | |
| *** lucasagomes is now known as lucas-afk | 15:57 | |
| rlandy | rasca: ok - so you have the option of https://github.com/openstack/tripleo-quickstart/blob/master/ci-scripts/collect-logs.sh#L51 | 15:58 |
| rlandy | adding settings to a log-env | 15:58 |
| rlandy | as is done here: https://github.com/openstack/tripleo-quickstart-extras/tree/master/config/general_config | 15:58 |
| rlandy | you can define a log env: https://github.com/openstack/tripleo-quickstart/blob/master/ci-scripts/collect-logs.sh#L9 | 16:00 |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike-branch, tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata- (2 more messages) | 16:13 |
| *** marios has quit IRC | 16:14 | |
| *** ykarel|away has joined #oooq | 16:15 | |
| *** jfrancoa has quit IRC | 16:23 | |
| *** jaganathan has joined #oooq | 16:23 | |
| *** jaganathan has quit IRC | 16:24 | |
| *** jaganathan has joined #oooq | 16:24 | |
| *** hamzy has quit IRC | 16:31 | |
| rasca | ok rlandy so you're saying that in the second step of my deployments that does collect_logs I'm not passing the config file | 16:38 |
| rlandy | appears not | 16:38 |
| rasca | rlandy, ok, but I'm relying on what we have in tripleo-environments | 16:39 |
| rasca | not adding anything | 16:39 |
| rasca | this means that we never pass that config | 16:39 |
| rasca | and for the majority of the jobs this is good anyway | 16:39 |
| rasca | because of the defaults | 16:39 |
| rasca | for the rest (==my jobs) it is not | 16:39 |
| *** dtantsur is now known as dtantsur|afk | 16:40 | |
| rlandy | rasca: that's ok - you can add a local config | 16:40 |
| rlandy | use an env var to define that env | 16:41 |
| rlandy | in the job | 16:41 |
| rlandy | and that config will be used | 16:41 |
| rlandy | rasca: to step back - what do you means second step of your deployments? | 16:42 |
| rasca | rlandy, take this https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/oooq-rhos-13-puddle-bmu-had00-lab-float_nic_with_vlans/configure as an example | 16:43 |
| rasca | rlandy, we have build (quickstart.sh command line) | 16:44 |
| rasca | rlandy, and post-build actions, with collect_logs | 16:44 |
| *** gkadam_ has quit IRC | 16:44 | |
| rasca | rlandy, these are attached by some sort of automation myoung|ruck should know | 16:44 |
| rasca | rlandy, because I never explicitly configured them | 16:45 |
| *** dougbtv_ has joined #oooq | 16:45 | |
| rlandy | rasca: correct | 16:45 |
| rlandy | that is a post build publisher | 16:45 |
| rasca | rlandy, I need to change things there just for my jobs then | 16:45 |
| *** trown is now known as trown|outtypewww | 16:45 | |
| rlandy | the publisher will need to be edited to pick up an env var | 16:45 |
| rlandy | rasca; I'll get the code ... sec | 16:46 |
| *** dougbtv has quit IRC | 16:48 | |
| rlandy | http://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/jenkins/jobs/tripleo-quickstart/defaults.yaml#n373 | 16:49 |
| rlandy | if we added an env file | 16:50 |
| rlandy | and modified the publisher to pick it up, we could edit the settings you want | 16:50 |
| * myoung|ruck was onboarding calories and catches up to rasca and rlandy | 16:53 | |
| rlandy | myoung|ruck: do you agree with my assessment? | 16:55 |
| *** dougbtv__ has joined #oooq | 16:56 | |
| rasca | rlandy, I'm officially lost :D | 16:56 |
| *** dougbtv_ has quit IRC | 16:57 | |
| rlandy | rasca: juts going to let myoung|ruck comment and then I can push a change for you | 16:59 |
| *** ykarel|away has quit IRC | 16:59 | |
| myoung|ruck | rasca: so for the jobs defined in tripleo-env, we're using this http://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/config/general_config/external-logs.yml | 16:59 |
| myoung|ruck | so 'external' is passed to the collect logs script, which makes quickstart find external-logs.yml when https://github.com/openstack/tripleo-quickstart/blob/master/ci-scripts/collect-logs.sh#L51 occurs | 17:00 |
| *** Goneri has joined #oooq | 17:01 | |
| myoung|ruck | as the triple-env setup.cfg file (http://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/setup.cfg#n23) causes tripleo-env/config to be copied into workspace/config | 17:01 |
| rlandy | myoung|ruck: so I was not sure if you want to edit external for all jobs | 17:01 |
| myoung|ruck | rasca: so while this isn't perfect, the simplest thing (today) is probably to make a new config file (yes the duplication sucks) | 17:01 |
| myoung|ruck | rasca: or we can edit external-logs in place | 17:02 |
| rlandy | so I suggested that rasca can create a diff config file | 17:02 |
| rasca | rlandy, myoung|ruck, I'm more than lost now, I'm lost in space and time | 17:02 |
| rlandy | and we could change the publisher to recognize a env file | 17:02 |
| rlandy | but if you are happy to exit external, ok by me | 17:02 |
| rlandy | we should just switch case it | 17:02 |
| myoung|ruck | IMHO the core issue is that the list of things to collect is a static variable, vs. something that can be appended to. I think we can fix this (long term) in quickstart easily enough...but like rlandy says if we want something now/today, we can make a new config file, then in the JJB for your jobs just change 'external' to 'yourmonikor' - i can help | 17:03 |
| myoung|ruck | rasca: i can hop on BJ to unstick show...it's a little confusing by TLDR rlandy's suggestion is the most direct | 17:03 |
| * myoung|ruck captures collect logs appending issue as an RFE...he's prototyped a fix last year that never was birthed | 17:04 | |
| rasca | rlandy, myoung|ruck, if you have an example I can study by myself | 17:04 |
| myoung|ruck | rasca: I'll make an etherpad with the links and example of what's happening now | 17:04 |
| myoung|ruck | IRC is a bad medium IMHO for this :) | 17:04 |
| rasca | myoung|ruck, much appreciated thanks | 17:05 |
| *** zoli is now known as zoli|gone | 17:05 | |
| rlandy | we could edit external | 17:05 |
| *** zoli|gone is now known as zoli | 17:05 | |
| rlandy | just switch case it | 17:05 |
| myoung|ruck | rlandy, rasca, https://review.rdoproject.org/etherpad/p/rdo2-collect-logs-customization | 17:07 |
| rlandy | trown|outtypewww: can we rebase this: https://review.openstack.org/#/c/569120/? | 17:09 |
| rlandy | I just did :) | 17:14 |
| myoung|ruck | rasca: make sense? | 17:20 |
| *** anande has joined #oooq | 17:23 | |
| *** anande has quit IRC | 17:30 | |
| myoung|ruck | rasca https://review.rdoproject.org/etherpad/p/rdo2-collect-logs-customization @ L67 I think is the fast path to having updated settings for your job. This is (I think) what rlandy was suggesting. | 17:35 |
| rlandy | myoung|ruck: correct - that was my suggestion | 17:36 |
| myoung|ruck | rasca: I need to go afk for a Dr. appt, back in 90ish. Can look/merge later | 17:36 |
| rlandy | to be able to pass foo | 17:36 |
| rlandy | in place of external | 17:37 |
| * myoung|ruck nods at rlandy | 17:37 | |
| myoung|ruck | rlandy: I'll capture the RFE on L25 later on today, I have the (minor) patch in my noggin and will propose next week when (if) things quiet down | 17:38 |
| rlandy | cool | 17:38 |
| * myoung|ruck vanishes for 90m and will return | 17:38 | |
| *** kopecmartin has quit IRC | 17:44 | |
| rasca | myoung|ruck, rlandy, I've commented the etherpad and going off right now, we can continue on Monday | 17:45 |
| weshay | myoung|ruck, all the rdo jobs are failing on yum repo issues, proably need an alert bug in #tripleo to make them aware of the issue.. as a tracker | 17:58 |
| rlandy | panda: hi - still around? | 18:05 |
| rlandy | ping re: https://trello.com/c/bKu4ia6u/741-assuming-the-known-output-from-the-tool-hardcode-the-output-and-work-on-fs37-50 | 18:05 |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike-branch, tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata- (2 more messages) | 18:13 |
| weshay | rfolco, http://rdoci-doc.usersys.redhat.com/tripleo-environments/oooq-downstream.html | 18:18 |
| weshay | rfolco, http://rhos-release.virt.bos.redhat.com/ci-images/internal-requirements-new.txt | 18:18 |
| weshay | rfolco, https://code.engineering.redhat.com/gerrit/gitweb?p=tripleo-environments.git;a=blob;f=setup.cfg;h=0c5dd3fd181ea963ee9f71d696de153bc4313aa2;hb=HEAD | 18:19 |
| rlandy | myoung|ruck: ok - finally working on the reproducer bug | 18:28 |
| *** tosky has quit IRC | 18:39 | |
| rlandy | myoung|ruck: https://bugs.launchpad.net/tripleo/+bug/1771563/comments/1 | 18:41 |
| openstack | Launchpad bug 1771563 in tripleo "ovb reproducer fails with "AnsibleUndefinedVariable: 'dict object' has no attribute 'ansible_host'"" [High,Triaged] | 18:41 |
| rlandy | worked for me | 18:41 |
| *** tosky has joined #oooq | 18:42 | |
| *** rnoriega has quit IRC | 18:46 | |
| *** rnoriega has joined #oooq | 18:47 | |
| *** dougbtv_ has joined #oooq | 19:11 | |
| *** dougbtv_ has quit IRC | 19:18 | |
| rlandy | weshay: I still a failure on containerized-undercloud-upgrades - (the change is building though). | 19:18 |
| rlandy | https://review.openstack.org/#/c/567641/ merged | 19:19 |
| weshay | rlandy, nice | 19:20 |
| rlandy | the failure is the same though | 19:20 |
| weshay | hrm.. you should you got the patch in your build | 19:20 |
| rlandy | generating inventory | 19:20 |
| weshay | ? | 19:20 |
| weshay | probably not | 19:21 |
| rlandy | I didn't - the patch merged | 19:21 |
| weshay | rlandy, I'm misunderstanding something | 19:21 |
| * weshay looks at the job generally | 19:21 | |
| weshay | rlandy, it's green ◆ tripleo-ci-centos-7-containerized-undercloud-upgrades | 19:22 |
| rlandy | http://logs.openstack.org/29/569229/2/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/6644950/job-output.txt.gz#_2018-05-17_23_19_13_658616 | 19:25 |
| rlandy | which seems wrong because that error should have been fixed a while back | 19:26 |
| weshay | not everything was rebased | 19:27 |
| weshay | the job is working now | 19:27 |
| weshay | rlandy, http://cistatus.tripleo.org/ | 19:27 |
| weshay | myoung|ruck, ping | 19:27 |
| rlandy | ok - it's kind of immaterial to the change but it would be good to see a full run | 19:28 |
| weshay | right.. it's been passing most of the day | 19:28 |
| weshay | http://logs.openstack.org/18/567318/6/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/02d8195/ | 19:29 |
| rlandy | either way - there are too many patches outstanding | 19:31 |
| weshay | rlandy, ya.. that's quite the dep chain | 19:31 |
| rlandy | and we keep getting This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset. | 19:31 |
| rlandy | and die | 19:31 |
| rlandy | bye-bye - thanks for trying | 19:31 |
| weshay | rlandy, so.. want some help merging? | 19:31 |
| rlandy | weshay: checking out where we are with the merge chain | 19:32 |
| rlandy | that should sort out a lot | 19:32 |
| rlandy | we are here: https://review.openstack.org/#/c/567649/ | 19:33 |
| weshay | rlandy, Sagi has a point | 19:33 |
| rlandy | Patch Set 32: -Verified | 19:33 |
| rlandy | Starting gate jobs. | 19:33 |
| weshay | https://review.openstack.org/#/c/567060/27/toci_quickstart.sh | 19:33 |
| weshay | can we scrub the env for anything related to OS_PASSWORD | 19:34 |
| rlandy | weshay: he does and panda and I had a long discussion about it yesterday | 19:34 |
| weshay | grep -v -i password | 19:34 |
| rlandy | my concern in using select variables | 19:34 |
| rlandy | is that me may miss exactly what is messing up the run | 19:34 |
| rlandy | but really - it's not worth killing the whole sprint over | 19:35 |
| rlandy | sagi had some parallel work he wanted to incorporate | 19:35 |
| rlandy | but it changed the workflow or our cirrent sprint | 19:35 |
| rlandy | honestly, at this point we could kill the variable capture | 19:36 |
| rlandy | it's not essential | 19:36 |
| rlandy | I asked panda to address it at monday's meeting and get consensus and fix it | 19:36 |
| rlandy | panda is of the option that if we are spewing something confidential, better we discover it earlier than later | 19:37 |
| rlandy | weshay: ^^ feel free to wight in | 19:37 |
| rlandy | weigh in | 19:37 |
| weshay | rlandy, agree.. if there is concern about it.. let's turn it off in upstream ci | 19:37 |
| weshay | maybe enable it on the recreate script | 19:38 |
| rlandy | I can make it a dry run only thing | 19:38 |
| weshay | but isn't dry run executed upstream? | 19:38 |
| rlandy | the playbook args | 19:38 |
| rlandy | and releases stuff is stored anyways | 19:38 |
| rlandy | no | 19:38 |
| rlandy | dryrun is only executed if you add --dryrun to the job name | 19:39 |
| rlandy | what is executed upstream is the collection of the vars | 19:39 |
| rlandy | and playbook commands output | 19:39 |
| rlandy | and releases output | 19:39 |
| rlandy | I think I'll just make it execute only in dryrun and get this merged | 19:40 |
| weshay | ah | 19:41 |
| weshay | rlandy, adding that to the name | 19:41 |
| weshay | hrm | 19:42 |
| weshay | how does that help? | 19:42 |
| weshay | wouldn't you need to change the zuul config for that? | 19:42 |
| rlandy | yes - it just skips the playbook execution | 19:42 |
| rlandy | so you see what would happen | 19:42 |
| weshay | and it would still be logged upstream | 19:42 |
| rlandy | you get logs | 19:42 |
| weshay | but if we're worried about the leak | 19:42 |
| rlandy | what would be logged upstream?? | 19:42 |
| weshay | if we create a job w/ the name $-dryrun | 19:43 |
| weshay | if we had a passwd leak.. it would leak | 19:43 |
| rlandy | unlikely we would ever have a job with -dryrun run upstream | 19:43 |
| weshay | just in rdo? | 19:44 |
| weshay | was the thought? | 19:44 |
| weshay | or just local? | 19:44 |
| rlandy | just in your reproducer | 19:44 |
| rlandy | yeah | 19:44 |
| weshay | ok | 19:44 |
| rlandy | so you see the releases | 19:44 |
| myoung|ruck | weshay: pong, ack, looking, will file/alrt | 19:44 |
| rlandy | and the playbook commands | 19:44 |
| rlandy | etc. | 19:44 |
| rlandy | without waiting for the whole job to finish | 19:45 |
| weshay | myoung|ruck, FYI.. was a dupe https://bugs.launchpad.net/tripleo/+bug/1771692 | 19:46 |
| openstack | Launchpad bug 1771549 in tripleo "duplicate for #1771692 Containers multinode jobs fails on stable queens with overcloud deploy timeout" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 19:46 |
| myoung|ruck | weshay: ack | 19:47 |
| weshay | rlandy, so sagi's comment is invalid? | 19:48 |
| weshay | or just fixed now | 19:48 |
| rlandy | it's valid | 19:48 |
| rlandy | whether you agree or not is a matter of opinion | 19:48 |
| rlandy | or whether you think the benefit outweighs the risk | 19:49 |
| rlandy | I am sending an email to sagi, panda and you | 19:49 |
| rlandy | to discuss at monday's meeting and resolve | 19:49 |
| rlandy | I am not stuck on either approach | 19:49 |
| *** holser__ has joined #oooq | 20:10 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens @ https://review.openstack.org/567224, stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ (2 more messages) | 20:13 |
| *** brault has quit IRC | 20:24 | |
| *** brault has joined #oooq | 20:38 | |
| *** brault has quit IRC | 20:43 | |
| rlandy | myoung|ruck: hi - did you see my comment re: ovb reproducer? | 21:07 |
| rlandy | wfm | 21:07 |
| myoung|ruck | rlandy: auye, havne't tried again today, maybe I was hitting rdocloud at a bad time lol | 21:09 |
| rlandy | myoung|ruck: it's often a bad time :( | 21:09 |
| *** florianf has quit IRC | 21:18 | |
| weshay | rlandy, I marked 1771563 incomplete | 21:25 |
| rlandy | weshay: seems rught | 21:26 |
| rlandy | right | 21:26 |
| rlandy | I tested with bot options - worked fine | 21:26 |
| weshay | rlandy, anything else ready for review? | 21:28 |
| rlandy | weshay: https://review.openstack.org/#/c/566565 | 21:29 |
| rlandy | https://review.openstack.org/#/c/568287 | 21:29 |
| rlandy | https://review.openstack.org/#/c/567649 | 21:29 |
| rlandy | https://review.openstack.org/#/c/568285 | 21:30 |
| rlandy | weshay: someone told me yesterday 'no good deed goes unpunished when you ask' | 21:30 |
| weshay | heh | 21:30 |
| rlandy | rebasing the last patch | 21:31 |
| *** dtrainor has quit IRC | 21:31 | |
| weshay | two of those were already merged | 21:31 |
| weshay | rlandy, emit_releases is still not logged | 21:33 |
| weshay | :( | 21:33 |
| weshay | 2018-05-18 16:53:54.473071 | primary | +(/opt/stack/new/tripleo-ci/toci_gate_test.sh:221): python /opt/stack/new/tripleo-ci/scripts/emit_releases_file/emit_releases_file.py --stable-release master --featureset-file /opt/stack/new/tripleo-quickstart/config/general_config/featureset037.yml --output-file /home/zuul/workspace/logs/releases.sh --log-file /home/zuul/workspace/logs/emit_releases_file.log | 21:33 |
| weshay | think there is another patch in play | 21:33 |
| rlandy | which review? | 21:34 |
| weshay | https://review.openstack.org/#/c/566565/11/toci_gate_test-oooq.sh | 21:34 |
| weshay | http://logs.openstack.org/65/566565/11/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/3bae60f/job-output.txt.gz | 21:34 |
| rlandy | 000 would not log - that is correct - 37 should | 21:37 |
| weshay | rlandy, ??? | 21:37 |
| weshay | where are my peoples | 21:38 |
| rlandy | this patch logs ... | 21:38 |
| weshay | where is that | 21:38 |
| weshay | tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates is fs037 | 21:39 |
| weshay | btw | 21:39 |
| rlandy | this is for sure missing ... http://logs.openstack.org/65/566565/11/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/fe3f0b6/logs/ | 21:39 |
| rlandy | we are looking for $WORKSPACE/logs/releases.sh | 21:40 |
| rlandy | sec - debugging patches | 21:41 |
| rlandy | 567060 should log when it runs | 21:43 |
| rlandy | but release.sh should be there in the previous patch | 21:43 |
| *** dtrainor has joined #oooq | 21:43 | |
| rlandy | https://review.openstack.org/#/c/566565 does not depend on the right patch | 21:43 |
| rlandy | weshay: ^^ | 21:44 |
| rlandy | note the Depends-on here https://review.openstack.org/#/c/567060 | 21:44 |
| rlandy | the output shows up in https://review.openstack.org/#/c/567936/ | 21:45 |
| rlandy | patch maze here | 21:45 |
| weshay | rlandy, where? http://logs.openstack.org/36/567936/14/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/47aa5bf/logs/ | 21:46 |
| rlandy | --output-file --log-file | 21:47 |
| rlandy | ie: the ability to add output | 21:47 |
| rlandy | https://review.openstack.org/#/c/567060 is where you should see the integration working | 21:48 |
| weshay | rlandy, why don't I see it in the fs37 jobs? | 21:48 |
| rlandy | from which patch? | 21:49 |
| weshay | <rlandy> the output shows up in https://review.openstack.org/#/c/567936/ | 21:49 |
| weshay | so /me looking for emit_release_file.py in http://logs.openstack.org/36/567936/14/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/47aa5bf/job-output.txt.gz | 21:50 |
| rlandy | Let me rephrase - the ability to pass output and log arguments shows up in /567936/ | 21:50 |
| rlandy | but it is not exposed to toci in that patch | 21:50 |
| rlandy | let me rekick 567060 | 21:50 |
| weshay | k.. thanks | 21:51 |
| rlandy | ok - here we go now | 21:52 |
| rlandy | weshay: this is kind of like the days of creation ... in theory light showed up on day one but the sun and moon don't make an appearance until day 4 | 21:53 |
| weshay | heh | 21:53 |
| weshay | rlandy, k.. reading the irc chat.. I thought these were rebased such that one should see this stuff working | 21:53 |
| rlandy | I can understand why you think that :) | 21:54 |
| rlandy | 567060 is rebased on 566565 and depends on I4c8f389978717848e755f12856dd454d605c9137 | 21:55 |
| rlandy | which should be the top patch on the script side | 21:55 |
| rlandy | watching https://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-multinode-1ctlr-featureset037-updates-master/936/console | 21:56 |
| rlandy | 21:58:53 +(/opt/stack/new/tripleo-ci/toci_gate_test.sh:226): python /opt/stack/new/tripleo-ci/scripts/emit_releases_file/emit_releases_file.py --stable-release master --featureset-file /opt/stack/new/tripleo-quickstart/config/general_config/featureset037.yml --output-file /home/jenkins/workspace/gate-tripleo-ci-centos-7-multinode-1ctlr-featureset037-updates-master/logs/releases.sh --log-file /home/jenkins/workspace/gate-tripleo-c | 22:00 |
| rlandy | i-centos-7-multinode-1ctlr-featureset037-updates-master/logs/emit_releases_file.log | 22:00 |
| rlandy | that should log | 22:01 |
| *** jtomasek has quit IRC | 22:06 | |
| *** jtomasek has joined #oooq | 22:12 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, tripleo-ci-centos-7-containers-multinode @ https://review.openstack.org/567224, stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ (2 more messages) | 22:13 |
| *** jtomasek has quit IRC | 22:17 | |
| *** holser__ has quit IRC | 22:36 | |
| rlandy | omg - passed generating inventory file :) | 22:38 |
| *** d0ugal_ has joined #oooq | 23:12 | |
| *** d0ugal has quit IRC | 23:13 | |
| *** rnoriega has quit IRC | 23:17 | |
| *** lhinds has quit IRC | 23:17 | |
| *** pliu has quit IRC | 23:18 | |
| *** faceman has quit IRC | 23:19 | |
| rlandy | weshay: see logged files here: https://logs.rdoproject.org/60/567060/28/openstack-check/gate-tripleo-ci-centos-7-multinode-1ctlr-featureset037-updates-master/Z21fc3090e03f491cb172dc68b5b9b0ea/undercloud/home/jenkins/ | 23:31 |
| *** rlandy has quit IRC | 23:34 | |
| *** tosky has quit IRC | 23:42 | |
| *** jaganathan has quit IRC | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!