| *** Vorrtex has quit IRC | 00:36 | |
| *** sanjayu__ has quit IRC | 00:42 | |
| *** ykarel|away has joined #oooq | 01:57 | |
| *** ykarel|away has quit IRC | 02:09 | |
| *** Goneri has joined #oooq | 02:24 | |
| *** rlandy|ruck|bbl has quit IRC | 02:45 | |
| *** udesale has joined #oooq | 04:00 | |
| *** ykarel|away has joined #oooq | 04:14 | |
| *** jfrancoa has joined #oooq | 04:38 | |
| *** ykarel|away has quit IRC | 04:39 | |
| *** jfrancoa has quit IRC | 04:44 | |
| *** jfrancoa has joined #oooq | 04:56 | |
| *** ykarel|away has joined #oooq | 04:57 | |
| *** ykarel|away is now known as ykarel | 05:03 | |
| *** ratailor has joined #oooq | 05:12 | |
| *** jtomasek has joined #oooq | 05:45 | |
| *** marios has joined #oooq | 05:47 | |
| *** dtantsur|afk is now known as dtantsur | 05:49 | |
| *** udesale has quit IRC | 06:21 | |
| *** udesale has joined #oooq | 06:21 | |
| *** raukadah is now known as chandankumar | 06:24 | |
| *** holser_ has joined #oooq | 06:25 | |
| *** sanjayu__ has joined #oooq | 06:25 | |
| *** kopecmartin|off is now known as kopecmartin | 06:25 | |
| *** sanjayu_ has joined #oooq | 06:27 | |
| *** sanjayu__ has quit IRC | 06:29 | |
| *** jtomasek has quit IRC | 06:42 | |
| *** udesale has quit IRC | 06:49 | |
| *** holser_ has quit IRC | 06:49 | |
| *** holser_ has joined #oooq | 06:50 | |
| *** udesale has joined #oooq | 06:50 | |
| *** jtomasek has joined #oooq | 06:51 | |
| *** jtomasek has quit IRC | 06:51 | |
| *** tesseract has joined #oooq | 07:12 | |
| *** brault has joined #oooq | 07:17 | |
| *** ratailor has quit IRC | 07:18 | |
| *** ratailor has joined #oooq | 07:18 | |
| *** rnoriega has quit IRC | 07:22 | |
| *** weshay has quit IRC | 07:22 | |
| *** weshay has joined #oooq | 07:23 | |
| *** rnoriega has joined #oooq | 07:23 | |
| *** amoralej|off is now known as amoralej | 07:29 | |
| *** jpena|off is now known as jpena | 07:38 | |
| *** bogdando has joined #oooq | 07:46 | |
| *** brault has quit IRC | 07:56 | |
| *** ratailor_ has joined #oooq | 07:56 | |
| *** brault has joined #oooq | 07:57 | |
| *** ratailor has quit IRC | 07:59 | |
| *** udesale has quit IRC | 08:01 | |
| *** ratailor__ has joined #oooq | 08:01 | |
| *** brault has quit IRC | 08:01 | |
| *** udesale has joined #oooq | 08:03 | |
| *** ratailor_ has quit IRC | 08:03 | |
| *** ykarel_ has joined #oooq | 08:10 | |
| * marios biab | 08:11 | |
| *** marios has quit IRC | 08:11 | |
| *** ykarel has quit IRC | 08:12 | |
| *** ykarel_ is now known as ykarel | 08:14 | |
| *** udesale has quit IRC | 08:24 | |
| *** ratailor__ has quit IRC | 08:30 | |
| *** ratailor has joined #oooq | 08:31 | |
| *** brault has joined #oooq | 08:34 | |
| *** ratailor_ has joined #oooq | 08:36 | |
| *** ratailor has quit IRC | 08:38 | |
| *** derekh has joined #oooq | 08:41 | |
| *** brault has quit IRC | 08:47 | |
| *** udesale has joined #oooq | 08:51 | |
| *** ykarel is now known as ykarel|lunch | 09:00 | |
| *** jtomasek has joined #oooq | 09:03 | |
| *** sshnaidm|afk is now known as sshnaidm | 09:05 | |
| *** marios has joined #oooq | 09:14 | |
| sshnaidm | panda, replied on https://review.opendev.org/#/c/661505/ | 09:21 |
|---|---|---|
| chandankumar | arxcruz: around? | 09:42 |
| chandankumar | arxcruz: please join #rhos-ops internal channel | 09:42 |
| arxcruz | depends | 09:43 |
| arxcruz | for what ? | 09:44 |
| chandankumar | arxcruz: regarding tempestmail vm, they are planning to reboot | 09:44 |
| arxcruz | hold on, need to configure | 09:44 |
| chandankumar | arxcruz: please join there | 09:44 |
| *** ykarel|lunch is now known as ykarel | 09:46 | |
| zbr | chandankumar: arxcruz : re ansible tempest py3 support, can we go with https://review.opendev.org/#/c/661994/ ? | 09:46 |
| chandankumar | zbr: still testing | 09:56 |
| zbr | chandankumar: ahh, ok. feel free to takeover it and do whatever changes may be needed. | 10:00 |
| chandankumar | zbr: these are currentky ongoing issues on queens promotion pipeline | 10:05 |
| chandankumar | zbr: https://review.opendev.org/#/c/663532/ and https://review.rdoproject.org/r/#/c/21038/ will clear the promotion pipeline | 10:06 |
| arxcruz | chandankumar zbr so we decided to go with zbr patch instead of chandankumar right ? | 10:07 |
| chandankumar | arxcruz: yes | 10:08 |
| arxcruz | ok | 10:08 |
| *** jpena is now known as jpena|away | 10:36 | |
| *** holser_ is now known as holser|lunch | 10:51 | |
| marios | anyone recall what weshay said was workaround for that http://paste.openstack.org/raw/752528 maybe sshnaidm panda rfolco ? | 10:51 |
| sshnaidm | marios, ansible 2.8? | 10:53 |
| marios | sshnaidm: ah that sounds like it yeah thanks | 10:53 |
| marios | [reprozuul@reprozuul ~]$ rpm -qa | grep ansible | 10:54 |
| marios | ansible-2.8.0-2.el7.noarch | 10:54 |
| marios | sshnaidm: hmm | 10:54 |
| marios | sshnaidm: thnks though i mean i think that is what he said | 10:54 |
| marios | sshnaidm: or we use different ansible in there via bindep/requirements/venv or something | 10:55 |
| sshnaidm | marios, I'll look later, what is the command you run? | 10:56 |
| *** brault has joined #oooq | 10:56 | |
| marios | sshnaidm: ./reproducer-zuul-based-quickstart.sh --workspace WORKSPACE -ug marios -rg marios | 10:57 |
| marios | sshnaidm: from there http://logs.openstack.org/97/631497/12/check/tripleo-ci-centos-7-scenario007-standalone/4ec5142/logs/README-reproducer.html | 10:57 |
| sshnaidm | marios, on rdo cloud, right/ | 10:58 |
| sshnaidm | marios, I mean not libvirt | 10:58 |
| marios | sshnaidm: yeah and its running on an rdo vm too i mean the script | 10:58 |
| marios | cattle | 10:59 |
| sshnaidm | marios, OS? | 10:59 |
| marios | sshnaidm: centos lemme fetch details | 10:59 |
| ykarel | marios, sshnaidm in case u not aware, Carlos filed same bug too for reproducer:- https://bugs.launchpad.net/tripleo/+bug/1831877 | 10:59 |
| openstack | Launchpad bug 1831877 in tripleo "Reproducer script fails with Ansible ImportError" [Undecided,New] | 10:59 |
| marios | sshnaidm: CentOS Linux release 7.6.1810 (Core) | 10:59 |
| marios | ykarel: dcool thanks sounds like it | 10:59 |
| sshnaidm | marios, ok, can you please update it to latest and reboot? just to check | 10:59 |
| sshnaidm | ykarel, ack, thanks | 10:59 |
| marios | ykarel: so we discussed with wes yesterday we agreed we should have a tag for 'list of reproducer known issues' | 10:59 |
| marios | sshnaidm: yeah sure i did the yum update already cos i hit the other known thing about 'no test named equalto ' but did not reboot will try that too | 11:00 |
| marios | thanks sshnaidm ykarel | 11:00 |
| ykarel | marios, ack it would be good to have one tag to filter reproducer related issues | 11:00 |
| marios | ykarel: yah i think weshay said he would propose it but will ask him today | 11:01 |
| ykarel | ack | 11:01 |
| *** brault has quit IRC | 11:01 | |
| chandankumar | marios: sshnaidm panda https://review.opendev.org/#/c/663525/ please have a look thanks! | 11:08 |
| marios | chandankumar: I WILL NOT I REFUSE | 11:12 |
| marios | make me! | 11:12 |
| marios | minor nit chandankumar please fix | 11:12 |
| chandankumar | marios: if that is the case then I need to put one more test here | 11:12 |
| marios | some people... | 11:13 |
| marios | you give them 1 inch | 11:13 |
| marios | ... | 11:13 |
| *** udesale has quit IRC | 11:23 | |
| chandankumar | sshnaidm: Hello | 11:37 |
| chandankumar | sshnaidm: please have a look at this job https://sf.hosted.upshift.rdu2.redhat.com/logs/17/171117/17/check/tripleo-ci-rhel-8-standalone-rhos-15/28e8959/logs/ | 11:38 |
| chandankumar | tempest results are not getting copied | 11:38 |
| sshnaidm | chandankumar, yeah | 11:38 |
| sshnaidm | chandankumar, so..why? | 11:38 |
| chandankumar | https://sf.hosted.upshift.rdu2.redhat.com/logs/17/171117/17/check/tripleo-ci-rhel-8-standalone-rhos-15/28e8959/logs/undercloud/var/log/tempest/ | 11:39 |
| chandankumar | need to check why it is not working | 11:39 |
| chandankumar | for ansible job run, all tasks are executed | 11:40 |
| chandankumar | no ara report so cannot tell what happened | 11:41 |
| sshnaidm | chandankumar, check the task which copies folders | 11:42 |
| chandankumar | from tempest.log tests runned, there might be issue with generating results from subunit files | 11:43 |
| chandankumar | since it is running on python3 | 11:43 |
| chandankumar | files were copied but they are empty | 11:43 |
| *** ratailor_ has quit IRC | 11:51 | |
| *** amoralej is now known as amoralej|lunch | 11:57 | |
| chandankumar | sshnaidm: there might be some issue with stestr itself i think subunit file looks empty | 11:59 |
| chandankumar | there might be some issue with stestr last subunit | 11:59 |
| *** rlandy has joined #oooq | 11:59 | |
| rlandy | marios: hi ... | 12:00 |
| rlandy | is there an escalation meeting today? | 12:00 |
| *** rlandy is now known as rlandy|ruck | 12:00 | |
| rlandy|ruck | I think there used to be two a week | 12:01 |
| rlandy|ruck | panda: ^^? | 12:01 |
| chandankumar | rlandy|ruck: it is on mon & wed every week | 12:01 |
| panda | rlandy|ruck: yep yesterday. | 12:02 |
| rlandy|ruck | panda: chandankumar: k - thanks | 12:03 |
| marios | rlandy|ruck: o/ | 12:04 |
| marios | rlandy|ruck: not sure /me checking calendar | 12:05 |
| rlandy|ruck | marios: it's ok - it was yesterday | 12:05 |
| marios | rlandy|ruck: i think its moved to just once a week now? | 12:05 |
| marios | rlandy|ruck: on monday i think | 12:05 |
| rlandy|ruck | yeah | 12:05 |
| marios | rlandy|ruck: if you mean "CI Escalation Status | DFG:ALL | 12:05 |
| rlandy|ruck | I thin there used to be a call on thursday as well | 12:05 |
| rlandy|ruck | yes | 12:05 |
| marios | rlandy|ruck: oh yeah for sure htere were more calls but i think at some point they decided to make less and just try to communicate via trello in meantime update stuff etc | 12:06 |
| rlandy|ruck | marios: ack - thanks | 12:06 |
| marios | rlandy|ruck: np | 12:07 |
| rlandy|ruck | | 2019-05-29 08:29 || 13579.0 min || SUCCESS || Logs || openstack-periodic-24hr | periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-rocky | 12:08 |
| rlandy|ruck | weird - last time that job ran | 12:08 |
| chandankumar | rlandy|ruck: now it is 2comp node | 12:09 |
| marios | rlandy|ruck: that doesn't exist any more | 12:09 |
| marios | rlandy|ruck: [m@192 ~]$ oooci-jobs.sh periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-rocky | 12:09 |
| marios | nope | 12:09 |
| marios | :D | 12:09 |
| marios | rlandy|ruck: but /home/m/Documents/Scripts/oooci-jobs.sh: job DEFINITION https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/ovb-jobs.yaml#L415 | 12:09 |
| rlandy|ruck | chandankumar: k - will have to update sova | 12:10 |
| marios | rlandy|ruck: yes i mentioned this last night after chandankumar left | 12:10 |
| rlandy|ruck | marios: np - I will put in a pull request | 12:10 |
| marios | rlandy|ruck: i tried with my tool after i gave the demo and i had a heart attack (well must have been tuesday then) cos i thought i was missing jobs | 12:10 |
| marios | rlandy|ruck: :D | 12:10 |
| marios | rlandy|ruck: just after i showed it and said 'use it its fab' | 12:11 |
| rlandy|ruck | from tripleo-ci-testing to current-tripleo, missing successful jobs: [u'periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-rocky'] | 12:11 |
| rlandy|ruck | ^^ seeing what happened to this job | 12:11 |
| chandankumar | rlandy|ruck: ^^ will be failed now https://review.opendev.org/#/c/663525/ to make it green | 12:11 |
| chandankumar | queens is also broken | 12:12 |
| marios | rlandy|ruck: yeah its in rocky criteria and i think chandankumar skips with that | 12:12 |
| marios | *=* 14:10:35 *=*=*= "[ROCKY] test_resize_server_revert_with_volume_attached to skip list" https://review.opendev.org/#/c/663525/2 I75696049a2776fbe8693b2aaef71f2342b52b387 | 12:12 |
| marios | rlandy|ruck: /home/m/Documents/Scripts/oooci-jobs.sh: job NOT IN queens *** IN rocky CRITERIA https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/config/CentOS-7/rocky.ini *** NOT IN stein NOT IN master | 12:12 |
| rlandy|ruck | marios: chandankumar: thanks - w+ https://review.opendev.org/#/c/663525/ | 12:13 |
| rlandy|ruck | chandankumar: is there an equivalent skip job for queens? | 12:14 |
| chandankumar | rlandy|ruck: for these tests not, here it the skip list for all release https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/validate-tempest/vars | 12:15 |
| rlandy|ruck | periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-queens | 12:15 |
| rlandy|ruck | ok - the failing job is not fs020 | 12:15 |
| chandankumar | rlandy|ruck: queens all jobs broken at undercloud install | 12:15 |
| chandankumar | rlandy|ruck: tempestconf again broke | 12:15 |
| * rlandy|ruck apologizes for always blaming tempest | 12:15 | |
| chandankumar | rlandy|ruck: need to test this review first https://review.rdoproject.org/r/#/c/21038/ | 12:16 |
| chandankumar | then we will merge | 12:16 |
| rlandy|ruck | chandankumar: k - thanks | 12:17 |
| chandankumar | rlandy|ruck: https://logs.rdoproject.org/openstack-periodic-24hr/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-queens/7d6f1a5/logs/undercloud/home/zuul/tempest.log.txt.gz#_2019-06-06_06_16_36 feel free to create a bug from here | 12:17 |
| chandankumar | for tracking | 12:17 |
| rlandy|ruck | chandankumar: k - fs017 is not even the blocking job atm | 12:19 |
| *** derekh has quit IRC | 12:21 | |
| rlandy|ruck | periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-queens failing since 06/02 | 12:25 |
| rlandy|ruck | panda: ^^ one more - I dont seen anything listed on this failure - is there a fix/bug before I log a new one? | 12:29 |
| rlandy|ruck | https://logs.rdoproject.org/openstack-periodic-24hr/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-queens/c9f0db2/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2019-06-02_05_49_00 | 12:30 |
| weshay | zbr 1-1 | 12:30 |
| zbr | weshay: yeah, joined. | 12:31 |
| *** amoralej|lunch is now known as amoralej | 12:40 | |
| *** vinaykns has joined #oooq | 12:48 | |
| *** brault has joined #oooq | 12:59 | |
| *** jfrancoa has quit IRC | 13:00 | |
| chandankumar | rfolco: sprint planning time | 13:01 |
| weshay | rlandy|ruck zbr fyi.. rhel 7.7 is in beta, which means centos 7.7 is coming and we'll have to start looking at the cr repo and fs21 for deployment issues | 13:01 |
| weshay | fyi.. first thing would be to see what's in the cr repo, probably not much atm | 13:01 |
| chandankumar | rlandy|ruck: weshay rfolco kopecmartin sprint planning time | 13:02 |
| weshay | rlandy|ruck zbr let me know if that does not make sense | 13:03 |
| *** brault has quit IRC | 13:03 | |
| rlandy|ruck | weshay: ack - will touch base about it this afternoon - following up on promotion failures now | 13:03 |
| *** Goneri has quit IRC | 13:04 | |
| *** derekh has joined #oooq | 13:06 | |
| *** sabedevops has joined #oooq | 13:08 | |
| *** aakarsh has quit IRC | 13:10 | |
| *** holser|lunch is now known as holser_ | 13:12 | |
| *** jfrancoa has joined #oooq | 13:13 | |
| *** ykarel is now known as ykarel|afk | 13:18 | |
| rlandy|ruck | ykarel|afk: hi - if you come back to keyboard ... just logged this failure - from 4 days ago - look at all familiar to you? https://bugs.launchpad.net/tripleo/+bug/1831893 | 13:21 |
| openstack | Launchpad bug 1831893 in tripleo "periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-queens is failing overcloud deploy - Failed running docker-puppet.py for collectd" [High,Triaged] | 13:21 |
| *** Goneri has joined #oooq | 13:22 | |
| *** sbroderick has joined #oooq | 13:22 | |
| *** sabedevops has quit IRC | 13:24 | |
| *** tcw has joined #oooq | 13:25 | |
| *** udesale has joined #oooq | 13:29 | |
| *** aakarsh has joined #oooq | 13:39 | |
| marios | rfolco: can you move this https://tree.taiga.io/project/tripleo-ci-board/task/1097 to sprint 12 pretty please? how do i do that | 13:44 |
| rfolco | marios, https://tree.taiga.io/project/tripleo-ci-board/taskboard/unified-sprint-12 | 13:44 |
| rfolco | marios, story #952 still remains in sprint 11 ? | 13:46 |
| rfolco | marios, task #1097 is the only one remaining there currently | 13:46 |
| *** jaosorior has joined #oooq | 13:47 | |
| *** jaosorior has quit IRC | 13:51 | |
| *** Vorrtex has joined #oooq | 13:51 | |
| *** jpena|away is now known as jpena | 13:53 | |
| marios | 'stage promotion' feauxmotion? | 14:02 |
| * marios grabs my coat | 14:02 | |
| *** sbroderick has quit IRC | 14:02 | |
| *** Vorrtex has quit IRC | 14:03 | |
| *** brault has joined #oooq | 14:06 | |
| panda | marios: GTFO | 14:08 |
| *** brault has quit IRC | 14:11 | |
| marios | panda: mute pls :D | 14:13 |
| panda | marios: *CRRRRRFFFSS* &GNIK GNI k EPEPEPEPEP | 14:17 |
| *** ykarel|afk is now known as ykarel | 14:25 | |
| ykarel | rlandy|ruck, yes i noticed that failure, and posted here few days back for visibility but didn't checked what caused it | 14:26 |
| rlandy|ruck | ykarel: np - pinged paramite about it | 14:31 |
| ykarel | rlandy|ruck, also today we posted 2 reverts to fix queens ovb job, in case u not aware | 14:32 |
| rlandy|ruck | ykarel: thanks - catching up ... tracking notes here https://etherpad.openstack.org/p/ruckroversprint11 | 14:32 |
| rlandy|ruck | ykarel: I have the note on the queens undercloud failure | 14:33 |
| ykarel | rlandy|ruck, ack | 14:34 |
| ykarel | rlandy|ruck, there were couple of failures in master as well in morning run related to ironic | 14:34 |
| rlandy|ruck | ykarel: introspection? | 14:35 |
| ykarel | rlandy|ruck, deployment | 14:35 |
| ykarel | some real issue this time | 14:35 |
| ykarel | i looked little, and pinged dtantsur about it and then side tracked | 14:35 |
| rlandy|ruck | ykarel: watching master run now ... checking back on the error log | 14:35 |
| ykarel | good to file a bug and follow up there | 14:36 |
| ykarel | ack | 14:36 |
| rlandy|ruck | | 2019-06-06 04:00 || 9398.0 min || Please investigate. Overcloud stack: FAILED. || Logs || openstack-periodic-master | | 14:36 |
| rlandy|ruck | ok - I see | 14:36 |
| rlandy|ruck | looking into it | 14:36 |
| *** jaosorior has joined #oooq | 14:37 | |
| rlandy|ruck | should not have timedout | 14:38 |
| *** sanjayu_ has quit IRC | 14:39 | |
| rlandy|ruck | only 2.5 hours | 14:39 |
| *** jaosorior has quit IRC | 14:39 | |
| rlandy|ruck | deploy timed out - not the job | 14:40 |
| rlandy|ruck | 2019-06-06 02:31:46 | 2019-06-06 02:31:44Z [overcloud.CephStorageIpListMap.NetIpMapValue]: CREATE_COMPLETE state changed | 14:41 |
| rlandy|ruck | 2019-06-06 03:49:17 | 2019-06-06 02:31:44Z [overcloud.CephStorageIpListMap]: CREATE_COMPLETE Stack CREATE completed successfully | 14:41 |
| rlandy|ruck | ^^ time out | 14:41 |
| dtantsur | ykarel: is it still about https://review.opendev.org/#/c/663361/ ? | 14:41 |
| ykarel | dtantsur, yes | 14:41 |
| rlandy|ruck | dtantsur: hello! | 14:41 |
| *** jaosorior has joined #oooq | 14:41 | |
| dtantsur | hi rlandy|ruck :) | 14:42 |
| rlandy|ruck | if we are following the same master deploy timeout | 14:42 |
| rlandy|ruck | that is the step that is timing out | 14:43 |
| marios | rfolco: this https://tree.taiga.io/project/tripleo-ci-board/task/1097 please for sprint 12 | 14:48 |
| rfolco | marios, isn't the entire story $952 ? | 14:48 |
| rfolco | thats what I said, if you want to move only the task, you need to create a new story for it in sprint 12 | 14:49 |
| marios | rfolco: "move 1037 to sprint 12" | 14:49 |
| *** jaosorior has quit IRC | 14:55 | |
| *** brault has joined #oooq | 14:56 | |
| rlandy|ruck | ykarel: https://bugs.launchpad.net/tripleo/+bug/1831911 | 14:56 |
| openstack | Launchpad bug 1831911 in tripleo "master overcloud deployments are timing out - overcloud.CephStorageIpListMap.NetIpMapValue is taking 1h 20mins to complete" [High,Triaged] | 14:56 |
| rlandy|ruck | pls update if you have more info | 14:56 |
| *** jaosorior has joined #oooq | 14:57 | |
| rlandy|ruck | ha - think stein will promote | 15:01 |
| rlandy|ruck | periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-stein | 15:01 |
| ykarel | rlandy|ruck, re ^^ good to update bug description as per https://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/bb219fa/logs/undercloud/var/log/containers/ironic/ironic-conductor.log.txt.gz#_2019-06-06_02_35_50_233 | 15:01 |
| ykarel | ^^ is the real issue | 15:01 |
| ykarel | started happening after https://review.opendev.org/#/c/639390/ | 15:03 |
| rlandy|ruck | ykarel: thanks - updated | 15:06 |
| rfolco | panda, I added comments to the task about docker network settings to overcome the connection issue | 15:07 |
| rfolco | panda, will iterate on it now. | 15:08 |
| panda | rfolco: yes I saw them. | 15:08 |
| panda | rfolco: still can't understand why I didn't get the survey email. Do you remember the subject ? | 15:08 |
| rfolco | panda, "Taiga" | 15:09 |
| rfolco | I've invited you to fill out a form: | 15:09 |
| rfolco | Taiga | 15:09 |
| rfolco | Evaluate Taiga tool for task tracking. | 15:09 |
| panda | nothing. | 15:10 |
| chandankumar | see ya tomorrow guys, Good night | 15:10 |
| *** chandankumar is now known as raukadah | 15:10 | |
| marios | o/ rfolco | 15:11 |
| marios | o/ raukadah | 15:11 |
| marios | sorry rfolco | 15:11 |
| rfolco | panda, you are on the list. I'll send you again. | 15:11 |
| rfolco | o/ marios | 15:11 |
| rfolco | we ARE. | 15:11 |
| marios | S | 15:12 |
| marios | O | 15:12 |
| marios | R | 15:12 |
| marios | I | 15:12 |
| marios | N | 15:12 |
| rfolco | hahaha | 15:12 |
| rfolco | panda, see if you received | 15:12 |
| sshnaidm | panda, Fri ? | 15:14 |
| panda | sshnaidm: I prefer to include you even if you're not there, then omit your email. If you're intereset I can create meetings for discussions on Monday too. | 15:16 |
| panda | rfolco: yes, now received. | 15:16 |
| rfolco | panda, now your answer is no longer anonymous. | 15:17 |
| panda | rfolco: now my answer is not even longer needed. | 15:17 |
| sshnaidm | panda, maybe in Mon for all? | 15:18 |
| rfolco | panda, sorry for miscommunication, of course your answer is still important. | 15:18 |
| rfolco | panda, please accept my apologies. Your email is correct and it was in the original list. Blame Google. | 15:18 |
| panda | sshnaidm: if we have no discussion in the first day, means that we have Mon-Thur = less than 4 days to come up with the design | 15:19 |
| sshnaidm | panda, ok | 15:20 |
| panda | rfolco: well, usually a survey is accompanied by an announcement in a list, or in meeting. | 15:20 |
| panda | rfolco: and I think forthnightly would have been preferable vs biweekly :P | 15:25 |
| rfolco | panda, right, announcement. Sorry. | 15:29 |
| panda | marios: what are you doing now ? | 15:29 |
| *** blueDuckRandom has quit IRC | 15:31 | |
| *** blueDuckRandomSt has joined #oooq | 15:31 | |
| marios | weshay: reminder about the tag for reproducer related bugs in launchpad? you said you would propose that | 15:34 |
| marios | weshay: i can do if you want but tomorrow /me almost out | 15:35 |
| marios | panda: getting ready to be not here | 15:35 |
| marios | panda: writing status | 15:35 |
| marios | :D | 15:35 |
| marios | weshay: but where is that proposed to? opnstack-discuss? | 15:35 |
| marios | weshay: who 'owns'/manage the launchpad tripleo tags? | 15:35 |
| *** EmilienM has joined #oooq | 15:35 | |
| weshay | marios ah.. k.. sec | 15:35 |
| weshay | marios I'll grab it | 15:35 |
| marios | panda: what's up tho? | 15:35 |
| marios | panda: something on fire? | 15:35 |
| *** EmilienM has left #oooq | 15:35 | |
| marios | panda: otherwise can we discuss tomorrow? | 15:35 |
| *** ykarel is now known as ykarel|away | 15:36 | |
| marios | panda: but to answer your question i posted that https://review.opendev.org/663702 and reviewed that https://review.opendev.org/#/c/663697 in the last few mins | 15:37 |
| marios | panda: :) | 15:37 |
| * marios almost out ... | 15:38 | |
| rlandy|ruck | PSA: we have a whole lot of create_failed stacks | 15:38 |
| rlandy|ruck | | stack_status_reason | Resource CREATE failed: IpAddressGenerationFailureClient: resources.baremetal_env.resources.bmc_port.resources.private_bmc_port: No more IP addresses available on network | 15:39 |
| marios | k thanks weshay re the tag let me know if needs followup tomorrow | 15:40 |
| rlandy|ruck | ykarel|away:^^ fyi | 15:40 |
| ykarel|away | rlandy|ruck, ack | 15:40 |
| rlandy|ruck | working on it | 15:40 |
| weshay | marios panda input on tag name? | 15:41 |
| weshay | reproducer-ci ? | 15:41 |
| weshay | reproducer | 15:42 |
| weshay | reproducer-quickstart | 15:42 |
| weshay | the last one is what it's called in the logs | 15:42 |
| weshay | probably will go w/ that | 15:43 |
| marios | weshay: reproducer-zuul | 15:43 |
| weshay | panda rlandy|ruck sshnaidm ^ | 15:43 |
| panda | weshay: tripleo-reproducer | 15:43 |
| rlandy|ruck | whatever | 15:44 |
| weshay | lolz | 15:44 |
| marios | ooo-zuul-reproducer | 15:44 |
| marios | weshay: ^ that | 15:44 |
| * rlandy|ruck has other problems right now | 15:44 | |
| weshay | probably will want to update the dir name to match the tag | 15:44 |
| marios | NAMING IS IMPORTANT | 15:44 |
| sshnaidm | ooo-reproducer | 15:44 |
| marios | rlandy|ruck: ! ^ | 15:44 |
| panda | weshay: ooo-repr | 15:44 |
| marios | :D | 15:44 |
| panda | ooo-r | 15:44 |
| sshnaidm | reprooo | 15:44 |
| panda | 3o-r | 15:44 |
| marios | sshnaidm: haha | 15:44 |
| weshay | JOKERS | 15:44 |
| weshay | all of you | 15:44 |
| marios | clear screen | 15:44 |
| weshay | I've taught you well | 15:44 |
| weshay | ooo-reproducer | 15:45 |
| marios | serious offers from me FWIW: "ooo-zuul-reproducer" or "reproducer-zuul" | 15:45 |
| weshay | going once | 15:45 |
| marios | weshay: that is also fine | 15:45 |
| marios | ooo-reproducer | 15:45 |
| marios | nice | 15:45 |
| marios | SHIP IT | 15:45 |
| weshay | oh | 15:45 |
| * weshay notes | 15:45 | |
| weshay | the openstack ansible team was interested in the code as well | 15:45 |
| marios | oooci-reproducer | 15:45 |
| marios | :D | 15:45 |
| * marios runs | 15:45 | |
| panda | so, architecture an platform in a docker manifest are not tags | 15:47 |
| panda | they are called annotations | 15:47 |
| weshay | going w/ ooo-reproducer | 15:48 |
| weshay | oopes | 15:48 |
| weshay | ci-reproducer | 15:49 |
| marios | weshay: oooci-reproducer | 15:49 |
| marios | weshay: seriously this | 15:49 |
| marios | bai | 15:49 |
| *** marios has quit IRC | 15:49 | |
| weshay | bai | 15:49 |
| weshay | ooo is not used in other tags | 15:49 |
| panda | and to understand which images to download if you want ppc version of the container, you need to inspect the manifest and find the right digest. | 15:49 |
| *** jaosorior has quit IRC | 15:50 | |
| weshay | https://review.opendev.org/663707 | 15:51 |
| *** bogdando has quit IRC | 15:51 | |
| *** bogdando has joined #oooq | 15:51 | |
| *** bogdando has quit IRC | 15:56 | |
| *** ykarel|away has quit IRC | 16:02 | |
| *** tesseract has quit IRC | 16:03 | |
| *** jfrancoa has quit IRC | 16:05 | |
| *** chem has quit IRC | 16:10 | |
| weshay | rlandy|ruck fyi https://bugs.launchpad.net/tripleo/+bug/1831922 | 16:16 |
| openstack | Launchpad bug 1831922 in tripleo "vexhost mirror config or infra is failing vexhost master ovb jobs" [High,Triaged] | 16:16 |
| rlandy|ruck | thanks - will look in a few | 16:16 |
| zbr | marios or weshay: do you think we could merge that mol' change? https://review.opendev.org/#/c/652971/9 -- i would want to be able to run it as-is, even if we would decide to change few things later. | 16:20 |
| *** holser_ has quit IRC | 16:20 | |
| *** sabedevops has joined #oooq | 16:22 | |
| raukadah | panda: Hello | 16:34 |
| raukadah | panda: two meeting invite sent for design week kickoff | 16:35 |
| raukadah | panda: which one I accept? | 16:35 |
| raukadah | 2nd one conflicts with tempest | 16:35 |
| sshnaidm | rlandy|ruck, I think we found what is problem with introspection | 16:41 |
| sshnaidm | rlandy|ruck, there is created br-ex interface which has 192.168.24.2 address and route to it, it's created somewhen in first preparing roles, maybe multinode connectivity role | 16:42 |
| sshnaidm | rlandy|ruck, when introspection starts it tries to connect to br-ex instead of br-ctlplane and fails. | 16:43 |
| sshnaidm | rlandy|ruck, on rdo-cloud hosts don't have br-ex interface | 16:43 |
| sshnaidm | rlandy|ruck, so need to check when it's created and how to disable it.. | 16:43 |
| rlandy|ruck | sshnaidm: oh cool | 16:44 |
| rlandy|ruck | sshnaidm: that is inherited from the usptream playbook | 16:44 |
| rlandy|ruck | because we inherit the job from multinode | 16:44 |
| sshnaidm | rlandy|ruck, ovb job from multinode? | 16:45 |
| rlandy|ruck | base job ... | 16:45 |
| rlandy|ruck | sshnaidm: https://github.com/openstack/tripleo-ci/blob/master/zuul.d/base.yaml#L11 | 16:46 |
| sshnaidm | rlandy|ruck, but why br-ex isn't created in rdo cloud jobs? They inherit from same jobs.. | 16:47 |
| *** sabedevops has quit IRC | 16:47 | |
| rlandy|ruck | https://github.com/openstack-infra/zuul-jobs/blob/master/playbooks/multinode/pre.yaml#L25 | 16:48 |
| rlandy|ruck | ^^ that is where it's created | 16:48 |
| rlandy|ruck | looking at rdo jobs | 16:48 |
| rlandy|ruck | it should be the same | 16:48 |
| sshnaidm | rlandy|ruck, ok, I see multi-node-bridge running on internal jobs | 16:49 |
| rlandy|ruck | right | 16:49 |
| sshnaidm | https://sf.hosted.upshift.rdu2.redhat.com/logs/68/171268/20/check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-internal/ee426b0/job-output.txt.gz#_2019-06-05_21_48_31_553627 | 16:49 |
| sshnaidm | rlandy|ruck, but I don't see it in rdo cloud.. | 16:49 |
| rlandy|ruck | https://github.com/openstack-infra/zuul-jobs/blob/master/roles/multi-node-bridge/tasks/main.yaml | 16:49 |
| sshnaidm | interesting.. | 16:50 |
| rlandy|ruck | sshnaidm: it's controlled by the nodeste | 16:50 |
| rlandy|ruck | nodeset | 16:50 |
| rlandy|ruck | compare the nodesets | 16:50 |
| rlandy|ruck | one sec | 16:50 |
| rlandy|ruck | I'll show you - just answering other channel | 16:51 |
| rlandy|ruck | bakc | 16:54 |
| rlandy|ruck | back | 16:54 |
| rlandy|ruck | sshnaidm: on upshift we use nodeset: single-centos-7-node | 16:54 |
| sshnaidm | yeah | 16:55 |
| sshnaidm | rlandy|ruck, it's there, right? http://git.app.eng.bos.redhat.com/git/openstack/tripleo-ci-internal-jobs.git/tree/zuul.d/nodesets.yaml | 16:55 |
| rlandy|ruck | sshnaidm: compare to this ... | 16:57 |
| sshnaidm | rlandy|ruck, hmm. should we do like: | 16:59 |
| sshnaidm | - name: switch | 16:59 |
| sshnaidm | nodes: [] | 16:59 |
| rlandy|ruck | nodeset: tripleo-ovb-centos-7-primary | 17:00 |
| rlandy|ruck | sshnaidm:you need a new nodeset | 17:00 |
| *** derekh has quit IRC | 17:00 | |
| rlandy|ruck | the one you are using is used elsewhere | 17:00 |
| rlandy|ruck | so pls create a new one for the ovb jobs | 17:00 |
| rlandy|ruck | https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/nodesets.yaml#L88 | 17:01 |
| rlandy|ruck | ^^ like that | 17:01 |
| rlandy|ruck | sshnaidm: ^^ ok? | 17:01 |
| sshnaidm | rlandy|ruck, I think we have it: http://git.app.eng.bos.redhat.com/git/openstack/tripleo-ci-internal-jobs.git/tree/zuul.d/nodesets.yaml#n68 | 17:02 |
| sshnaidm | rlandy|ruck, just for rhel | 17:02 |
| *** dtantsur is now known as dtantsur|afk | 17:06 | |
| rlandy|ruck | tripleo-baremetal-centos-7-primary | 17:06 |
| rlandy|ruck | tripleo-ovb-centos-7-primary | 17:06 |
| rlandy|ruck | oh we do | 17:06 |
| *** holser_ has joined #oooq | 17:06 | |
| sshnaidm | rlandy|ruck, yeah, let's make it more clear.. | 17:07 |
| rlandy|ruck | sshnaidm: ack - then pls update the job | 17:08 |
| rlandy|ruck | https://code.engineering.redhat.com/gerrit/#/c/171268/22/zuul.d/ovb.yaml | 17:08 |
| *** holser_ has quit IRC | 17:08 | |
| *** holser_ has joined #oooq | 17:09 | |
| sshnaidm | rlandy|ruck, yeah, but firstly need to merge it | 17:11 |
| rlandy|ruck | sshnaidm: I w+ it | 17:12 |
| sshnaidm | ack | 17:12 |
| *** kopecmartin is now known as kopecmartin|off | 17:17 | |
| sshnaidm | rlandy|ruck, but not sure I understood how it's connected to zuul role.. | 17:17 |
| rlandy|ruck | one sec - will explain | 17:18 |
| *** jtomasek has quit IRC | 17:19 | |
| *** yolanda__ has joined #oooq | 17:20 | |
| *** yolanda has quit IRC | 17:23 | |
| *** jpena is now known as jpena|off | 17:23 | |
| rlandy|ruck | rfolco: ^^ can you check your ldap groups | 17:25 |
| rlandy|ruck | rfolco: sorry - see #sf-ops | 17:25 |
| rlandy|ruck | sshnaidm: sorry ... so it's here ... when: inventory_hostname in groups['switch']' | 17:32 |
| rlandy|ruck | when: inventory_hostname in groups['peers'] | 17:32 |
| rlandy|ruck | in https://github.com/openstack-infra/zuul-jobs/blob/master/roles/multi-node-bridge/tasks/main.yaml | 17:32 |
| rlandy|ruck | if there is none of those in the inventory, it skipd | 17:32 |
| rlandy|ruck | skips | 17:32 |
| sshnaidm | rlandy|ruck, oh, magic.. | 17:32 |
| rlandy|ruck | sshnaidm: something like that | 17:33 |
| rlandy|ruck | sshnaidm: https://en.wiktionary.org/wiki/abracadabra | 17:33 |
| rfolco | rlandy|ruck, where do I check ldap ? | 17:37 |
| rlandy|ruck | rfolco: mojo? | 17:37 |
| rlandy|ruck | rfolco: | 17:38 |
| rlandy|ruck | I think you should be there due to belonging to weshay's group | 17:38 |
| rlandy|ruck | but not sure how these allocations work | 17:38 |
| rlandy|ruck | weshay: ^^? | 17:38 |
| * weshay looks | 17:39 | |
| weshay | rfolco put in a people helpdesk ticket and get added to the openstack ldap group | 17:40 |
| weshay | rfolco make sure that is in the newbie doc | 17:40 |
| *** udesale has quit IRC | 17:42 | |
| weshay | rfolco ack? | 17:45 |
| *** holser_ has quit IRC | 17:54 | |
| *** panda has quit IRC | 17:59 | |
| *** panda has joined #oooq | 18:01 | |
| *** Goneri has quit IRC | 18:05 | |
| *** sshnaidm is now known as sshnaidm|off | 18:06 | |
| rfolco | weshay, ack ack... sorry | 18:06 |
| *** amoralej is now known as amoralej|off | 18:10 | |
| rlandy|ruck | weshay: firstly - stein promoted - yay ... secondly, added two cards to the escalation board. I have not assigned owners yet | 18:14 |
| rlandy|ruck | so we put ourselves are owners until dev claims them? | 18:15 |
| rlandy|ruck | weshay: also - unrelated ... f28 test from yesterday failed out ... http://logs.openstack.org/21/663421/2/check/tripleo-build-containers-fedora-28-stein-test/0e53a13/job-output.txt.gz#_2019-06-05_22_45_10_064391 | 18:16 |
| rlandy|ruck | opinion about how far we take this forward | 18:16 |
| weshay | rlandy|ruck ya.. sorry... just grabbed lunch | 18:16 |
| weshay | I saw ur ping last night | 18:16 |
| weshay | bob said it wasn't their issue | 18:17 |
| *** Goneri has joined #oooq | 18:17 | |
| weshay | rlandy|ruck sooo.... rlandy|ruck question can we repro on bm? | 18:17 |
| rlandy|ruck | weshay: I think you're on a different matter | 18:17 |
| weshay | hrm k | 18:18 |
| * weshay looks at cix board | 18:18 | |
| rlandy|ruck | I am fairly certain we will get better better results when we clear the stuck stacks from the tenant | 18:18 |
| rlandy|ruck | I added two NEW cards | 18:18 |
| rlandy|ruck | it's those I am referencing | 18:18 |
| weshay | rlandy|ruck I think https://trello.com/c/X1BQ2CFc/998-cixlp1831893tripleociproa-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-queens-is-failing-overcloud-deploy-failed-r is DF | 18:20 |
| weshay | the other one looks right | 18:20 |
| weshay | rlandy|ruck ya.. just wait for the cix mtg | 18:21 |
| rlandy|ruck | ok - good | 18:23 |
| rlandy|ruck | weshay: want to touch base/ more info/instructions re: . rhel 7.7 and centos 7.7? | 18:49 |
| weshay | rlandy|ruck sure | 18:51 |
| rlandy|ruck | k - meeting/card/bug? | 18:52 |
| weshay | rlandy|ruck basically you are watching for 7.7 packages to be dropped into http://mirror.centos.org/centos/7/cr/x86_64/Packages/ | 18:53 |
| weshay | nothing there atm | 18:53 |
| weshay | rlandy|ruck http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset021-master/194d9d4/logs/undercloud/etc/yum.repos.d/quickstart-centos-cr.repo.txt.gz | 18:53 |
| weshay | rlandy|ruck fs21 should pick up the changes | 18:53 |
| weshay | when they start to drop in.. may not happen on your watch | 18:53 |
| weshay | please xfer this to zbr in a week | 18:54 |
| weshay | rlandy|ruck make sense? | 18:54 |
| rlandy|ruck | weshay: ack - added notes to ruck etherpad | 18:54 |
| weshay | rock on ruck | 18:55 |
| rlandy|ruck | to check daily for packages | 18:55 |
| weshay | the potential is that it causes deployment failures when updates are made | 18:55 |
| rlandy|ruck | weshay: well we rarely watch fs021 | 18:56 |
| rlandy|ruck | unless we are triggered to | 18:56 |
| rlandy|ruck | weshay: any point in trying a rhel 7.7 something? | 18:56 |
| weshay | rlandy|ruck note that base os updates | 18:56 |
| weshay | can hit any release | 18:56 |
| weshay | but master is the biggest priority | 18:56 |
| weshay | rlandy|ruck also.. https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-master&job_name=periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset021-master | 18:57 |
| weshay | perhaps we turn tempest off on fs21 for now | 18:57 |
| rlandy|ruck | right - it never passes and nobody cares | 18:57 |
| weshay | as I doubt raukadah or arxcruz are using it atm to figure out which tempest jobs can be removed from the skip list | 18:57 |
| rlandy|ruck | on the upside, it can't get worse | 18:58 |
| * rlandy|ruck checks what's actually failing there | 18:58 | |
| weshay | rlandy|ruck near passed on http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset021-master/761c1c5/job-output.txt.gz | 18:59 |
| rlandy|ruck | that is the ironic bug logged in CIX | 18:59 |
| weshay | rlandy|ruck usually centos updates come weeks after rhel updates | 19:00 |
| weshay | so this is most likely not going to hit you | 19:00 |
| rlandy|ruck | 2019-06-06 14:38:32 | 2019-06-06 14:38:31Z [overcloud.ObjectStorageIpListMap]: CREATE_IN_PROGRESS Stack CREATE started | 19:00 |
| rlandy|ruck | 2019-06-06 15:55:51 | 2019-06-06 14:38:31Z [overcloud.ObjectStorageIpListMap.NetIpMapValue]: CREATE_IN_PROGRESS state changed | 19:00 |
| weshay | but we should xfer this from ruck to ruck | 19:00 |
| weshay | as that is just a guess | 19:00 |
| rlandy|ruck | ack | 19:00 |
| rlandy|ruck | so much fir having nothing to transfer | 19:01 |
| rlandy|ruck | lots of failures going on | 19:01 |
| weshay | aye.. rlandy|ruck any luck w/ f28 and nova-join? | 19:03 |
| rlandy|ruck | weshay: not much - that is what I pasted above ... | 19:03 |
| rlandy|ruck | <rlandy|ruck> weshay: also - unrelated ... f28 test from yesterday failed out ... http://logs.openstack.org/21/663421/2/check/tripleo-build-containers-fedora-28-stein-test/0e53a13/job-output.txt.gz#_2019-06-05_22_45_10_064391 | 19:03 |
| rlandy|ruck | weshay: git to update sova and deal with vexxhost issue - then will get back to f28 | 19:04 |
| rlandy|ruck | got | 19:04 |
| weshay | rlandy|ruck k.. it's weird that vex would fail on the mirror in master and not rocky, I only looked at a few | 19:05 |
| weshay | brb | 19:05 |
| raukadah | weshay: ah what is the issue? | 19:16 |
| *** zbr has quit IRC | 19:25 | |
| rlandy|ruck | sshnaidm|off: weshay: https://github.com/sshnaidm/sova/pull/66 | 19:25 |
| *** Goneri has quit IRC | 19:25 | |
| weshay | nice | 19:30 |
| *** Goneri has joined #oooq | 19:39 | |
| sshnaidm|off | rlandy|ruck, thanks | 19:46 |
| *** Goneri has quit IRC | 19:47 | |
| sshnaidm|off | rlandy|ruck, Successfully introspected 4 node(s). | 19:47 |
| rlandy|ruck | sshnaidm|off: woohoo - got it eventually | 19:47 |
| sshnaidm|off | rlandy|ruck, yeah, but stuck on 'provide --all-manageable' | 19:48 |
| sshnaidm|off | clean failed | 19:48 |
| rlandy|ruck | sshnaidm|off: can you tell the state of the nodes | 19:48 |
| rlandy|ruck | ha | 19:48 |
| rlandy|ruck | exoected that | 19:48 |
| rlandy|ruck | expected | 19:48 |
| rlandy|ruck | try turning cleaning off | 19:48 |
| sshnaidm|off | rlandy|ruck, how to do it? | 19:49 |
| rlandy|ruck | sshnaidm|off: undercloud.conf ... https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/undercloud-deploy/templates/undercloud.conf.j2#L358 | 19:50 |
| rlandy|ruck | set that to false in your ovb_internal settings file | 19:51 |
| sshnaidm|off | ok | 19:51 |
| rlandy|ruck | you can try stein if that does not work | 19:51 |
| rlandy|ruck | sshnaidm|off: I can watch the job for you | 20:00 |
| *** Goneri has joined #oooq | 20:00 | |
| *** rlandy|ruck is now known as rlandy|ruck|brb | 20:02 | |
| *** panda has quit IRC | 20:04 | |
| *** panda has joined #oooq | 20:05 | |
| *** ccamacho has quit IRC | 20:08 | |
| *** rlandy|ruck|brb is now known as rlandy|ruck | 20:17 | |
| *** tcw has quit IRC | 20:41 | |
| *** tcw has joined #oooq | 20:42 | |
| *** holser_ has joined #oooq | 20:55 | |
| *** tcw has quit IRC | 20:59 | |
| *** tcw has joined #oooq | 20:59 | |
| *** sabedevops has joined #oooq | 21:07 | |
| *** sabedevops has quit IRC | 21:24 | |
| *** sabedevops has joined #oooq | 21:26 | |
| rlandy|ruck | weshay: to rerun failed jobs in ci.centos - resume build? | 21:41 |
| rlandy|ruck | https://ci.centos.org/job/rdo_trunk-promote-stein-current-tripleo/74/ | 21:41 |
| *** aakarsh has quit IRC | 21:47 | |
| *** aakarsh has joined #oooq | 22:19 | |
| *** sabedevops has quit IRC | 22:34 | |
| *** sbroderick has joined #oooq | 22:34 | |
| *** sanjayu_ has joined #oooq | 23:03 | |
| *** holser_ has quit IRC | 23:20 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!