| *** bandini has quit IRC | 00:41 | |
| *** bandini has joined #oooq | 00:42 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 01:00 |
|---|---|---|
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 03:00 |
| *** saneax has joined #oooq | 03:09 | |
| *** atoth has quit IRC | 03:35 | |
| *** skramaja has joined #oooq | 03:36 | |
| *** jaganathan has joined #oooq | 03:53 | |
| *** ykarel|away has joined #oooq | 04:35 | |
| *** ykarel|away is now known as ykarel | 04:39 | |
| *** tcw has joined #oooq | 04:45 | |
| *** tcw has quit IRC | 04:55 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445 | 05:00 |
| *** links has joined #oooq | 05:00 | |
| *** chandankumar has joined #oooq | 05:08 | |
| *** chandankumar is now known as chkumar|ruck | 05:08 | |
| chkumar|ruck | %gatestatus | 05:08 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445 | 05:08 |
| *** tcw has joined #oooq | 05:12 | |
| *** holser_ has joined #oooq | 05:40 | |
| *** yolanda has joined #oooq | 05:46 | |
| *** kopecmartin has joined #oooq | 05:50 | |
| quiquell|off | chkumar|ruck: Is the grafana tool helping ? | 05:52 |
| *** quiquell|off is now known as quiquell | 05:53 | |
| chkumar|ruck | quiquell, yup | 05:56 |
| quiquell | Let me with any issue | 05:57 |
| quiquell | Let me know, I mean | 05:58 |
| chkumar|ruck | quiquell, It is possible to track periodic jobs in a seperate tab or section? | 05:58 |
| quiquell | You can explore then in the explore dashboard | 05:59 |
| quiquell | using | 05:59 |
| quiquell | job_name ~= periodic | 05:59 |
| quiquell | chkumar|ruck: http://38.145.34.131:3000/d/2kHMNHvik/exploration?orgId=1&var-influxdb_filter=job_name%7C%3D~%7C%2Fperiodic%2F | 05:59 |
| *** jfrancoa has joined #oooq | 06:04 | |
| *** matbu has joined #oooq | 06:11 | |
| *** holser_ has quit IRC | 06:19 | |
| *** quiquell is now known as quiquell|bbl | 06:19 | |
| *** ccamacho has joined #oooq | 06:39 | |
| *** jtomasek has joined #oooq | 06:53 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445 | 07:00 |
| *** florianf has joined #oooq | 07:06 | |
| *** tesseract has joined #oooq | 07:06 | |
| chkumar|ruck | sshnaidm|off, tracker bug for all zuulv3 issue [master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration - https://bugs.launchpad.net/tripleo/+bug/1780726 | 07:16 |
| openstack | Launchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Triaged] | 07:16 |
| *** amoralej|off is now known as amoralej | 07:21 | |
| *** tesseract has quit IRC | 07:25 | |
| *** tesseract has joined #oooq | 07:27 | |
| *** d0ugal_ has quit IRC | 07:33 | |
| *** d0ugal has joined #oooq | 07:33 | |
| *** d0ugal has quit IRC | 07:33 | |
| *** d0ugal has joined #oooq | 07:33 | |
| *** tosky has joined #oooq | 07:35 | |
| *** quiquell|bbl is now known as quiquell | 07:43 | |
| *** bogdando has joined #oooq | 07:50 | |
| *** ykarel is now known as ykarel|lunch | 08:08 | |
| *** panda|off is now known as panda | 08:26 | |
| *** holser_ has joined #oooq | 08:43 | |
| *** gvrangan has joined #oooq | 08:44 | |
| *** ykarel|lunch is now known as ykarel | 08:49 | |
| ssbarnea | hi guys! I am here, please let me know with what to start. | 08:59 |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 09:00 |
| *** sshnaidm|off is now known as sshnaidm|rover | 09:02 | |
| sshnaidm|rover | chkumar|ruck, looking | 09:03 |
| chkumar|ruck | sshnaidm|rover, Good morning :-) | 09:04 |
| panda | ssbarnea: hi, we were told you would not join for another 2 weeks | 09:04 |
| chkumar|ruck | sshnaidm|rover, ocata third party job is failing http://logs.rdoproject.org/91/564291/16/openstack-check/legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata/047915d/logs/undercloud/home/zuul/overcloud_validate.log.txt.gz | 09:04 |
| sshnaidm|rover | ssbarnea, hello! | 09:04 |
| chkumar|ruck | on noop check jobs | 09:04 |
| sshnaidm|rover | chkumar|ruck, how many times? | 09:05 |
| ssbarnea | maybe you know something I do not. now i am reading the onboarding document 2nd time and trying to get used ot the new environment. Any help/hints would be appreciated. In fact even giving me task to investigate something could help, anythign. | 09:06 |
| quiquell | ssbarnea: New to tripleo-ci ? | 09:07 |
| panda | ssbarnea: we have a scrum standup this afternoon. 14 UTC | 09:08 |
| *** Goneri has joined #oooq | 09:08 | |
| ssbarnea | yeah, kinda yes I think. Please forward invites, my calendar has only the CI escalation added for today. | 09:09 |
| panda | ssbarnea: and you don't need to attend that usually | 09:13 |
| quiquell | ssbarnea: Welcome ! | 09:15 |
| panda | ssbarnea: sent invitation | 09:15 |
| *** d0ugal has quit IRC | 09:17 | |
| *** ssbarnea_ has joined #oooq | 09:19 | |
| panda | ssbarnea: did you receive the invite ? | 09:23 |
| ssbarnea | yep! and accepted. | 09:23 |
| *** d0ugal has joined #oooq | 09:23 | |
| panda | ssbarnea: ping me if you need pointers | 09:26 |
| quiquell | panda, marios: Have put in place some non-working reviews for todays meeting | 09:26 |
| quiquell | panda, marios https://review.openstack.org/#/c/580971/, https://review.openstack.org/#/c/580974/ | 09:27 |
| panda | quiquell: me too | 09:27 |
| quiquell | panda: So letÂÂÂ's comment on them in tmeeting | 09:27 |
| panda | yeah letTTTTAAAA comment them | 09:27 |
| ssbarnea | i gues this document is stil valid, right https://docs.google.com/document/d/1IHVjfi8WJiQwAXp-dIMN9I_bR_brVclChpkevG59nmI/edit# | 09:29 |
| marios | ack quiquell thanks | 09:29 |
| quiquell | marios: They are non working PoCs, be prepare | 09:31 |
| quiquell | sshnaidm|rover: Do you have a minute | 09:32 |
| *** gvrangan has quit IRC | 09:42 | |
| ykarel | chkumar|ruck, sshnaidm|rover https://review.rdoproject.org/r/#/c/14705/ | 09:46 |
| ykarel | we need to reschedule after ^^ | 09:47 |
| panda | marios: do you have a working test for https://review.openstack.org/578081 ? | 09:47 |
| marios | panda: well i manually applied and ran it if that is what you mean | 09:48 |
| quiquell | marios, panda: we need a reproducer job at zuul, zuul encrypt can helps us to have it | 09:49 |
| panda | marios: yes, that's what I would have to do before +2, but if you have something to show, we can save time :) | 09:49 |
| sshnaidm|rover | quiquell, sorry, litl bit later | 09:49 |
| quiquell | also a dry-run version can run can be done | 09:49 |
| panda | quiquell: zuul is the answer | 09:49 |
| quiquell | sshnaidm|rover: np, just le me know if you have some time if not there is no problem | 09:49 |
| marios | quiquell: btw i had a quick firstpass on your patches but didn't vote yet i will give them proper look either later today or tomorrow morning | 09:49 |
| sshnaidm|rover | ykarel, great, merged | 09:50 |
| sshnaidm|rover | ykarel, let's reschedule | 09:50 |
| marios | quiquell: but thanks for putting them out i think it will help the discussion this afternnoon | 09:50 |
| quiquell | panda, marios: dryrun job type can be test at a zuul job | 09:50 |
| ykarel | sshnaidm|rover, ok proposing | 09:50 |
| marios | panda: well not sure what you mean by show? i applied it and ran it. its a pretty simple one, you could just past that into a terminal and run it see what happens | 09:50 |
| quiquell | marios: Yep, at least to point to something to do | 09:51 |
| *** brault has joined #oooq | 09:52 | |
| *** gvrangan has joined #oooq | 09:52 | |
| *** gvrangan has quit IRC | 09:53 | |
| marios | panda: i don't have the env (I only have one virt box there have been _many_ runs of reproder.sh and toci_gate_test since then on it | 09:53 |
| marios | panda: if that is what you meant | 09:54 |
| panda | marios: hold on, found a possible issue | 09:54 |
| marios | panda:cool, commnt please. | 09:54 |
| panda | y | 09:54 |
| *** gvrangan has joined #oooq | 09:54 | |
| marios | panda: and if you like i can give you access to my current virthost where I can apply it for you to run? | 09:55 |
| *** gvrangan has quit IRC | 09:55 | |
| panda | marios: commented | 09:56 |
| *** gvrangan has joined #oooq | 09:56 | |
| marios | panda: thank you hm yeah ... i could make it something like python-[2,3].*-pip | 10:00 |
| panda | marios: or you can just ignore [python3 for now, make this work with what we currently use. I see python3 from far far away right now .. | 10:01 |
| marios | panda: or as you said make it .. yeah | 10:01 |
| marios | panda: so i could add a note to it about python2 for now | 10:02 |
| marios | panda: but then, if you do happen to be on python3 it will fail as if you _have_ to be on python2 which is kinda not nice | 10:02 |
| marios | :/ | 10:02 |
| marios | panda: i could just add a pytho --version but we want to keep this simple | 10:03 |
| marios | and sane | 10:03 |
| marios | :) | 10:03 |
| panda | quiquell: after we merge https://review.openstack.org/580090 , what creates the ara reports ? | 10:04 |
| quiquell | panda: ara-report role, of zuul-jobs | 10:05 |
| quiquell | panda: It's always running, | 10:05 |
| panda | quiquell: where is this included ? | 10:06 |
| quiquell | panda: The info is in the commit message | 10:06 |
| quiquell | panda: Check this http://lists.openstack.org/pipermail/openstack-dev/2018-March/128902.html | 10:06 |
| quiquell | panda: containerized undercloud http://logs.openstack.org/90/580090/13/check/tripleo-ci-centos-7-undercloud-containers/7653825/ | 10:07 |
| quiquell | panda: the report is at logs/undercloud/root/ara-report | 10:07 |
| panda | mmhh, stil can't find what runs it | 10:07 |
| quiquell | panda: ara-report role: http://logs.openstack.org/90/580090/13/check/tripleo-ci-centos-7-undercloud-containers/7653825/job-output.txt.gz#_2018-07-06_14_38_22_786319 | 10:07 |
| quiquell | panda: wait, I am wrong, I think is the logs.openstack.org server that does it | 10:08 |
| quiquell | panda: It's suppose to work out of the box, so we don't have to spend time rendering HTML | 10:08 |
| quiquell | panda: The info is in the message at openstack-dev | 10:09 |
| panda | quiquell: maybe I get it | 10:09 |
| panda | quiquell: it's not a single command anymore, ara reports are created incrementally with callbacks after each task | 10:09 |
| quiquell | panda: the sqlite, not the html report | 10:09 |
| panda | so you really just need to ensure that the database is present | 10:10 |
| quiquell | panda: Yep, that's this patch for | 10:10 |
| quiquell | panda: You just need to have an ara-report dir with it | 10:10 |
| panda | quiquell: and you're not compressing the directory anymore ? | 10:14 |
| sshnaidm|rover | quiquell, ok, can talk now | 10:17 |
| sshnaidm|rover | when periodics run *phew | 10:18 |
| quiquell | sshnaidm|rover: Have rework a little the ara+undercloud thing | 10:18 |
| quiquell | sshnaidm|rover: To remove the HTML generation and use the implicit logs.openstack.org mechanism | 10:19 |
| quiquell | sshnaidm|rover: Need you to check that I am not missing anything and that it aligns with ara+overcloud | 10:19 |
| sshnaidm|rover | quiquell, which one? | 10:19 |
| quiquell | sshnaidm|rover: https://review.openstack.org/#/c/580090/ | 10:19 |
| quiquell | sshnaidm|rover: Has some Depends-On | 10:19 |
| sshnaidm|rover | quiquell, nice, need to check how it works with multiple files | 10:24 |
| quiquell | sshnaidm|rover: It has just ara with user zuul and ara with user root | 10:24 |
| quiquell | sshnaidm|rover: zuul user logs/undercloud/home/zuul/ara-report | 10:24 |
| quiquell | sshnaidm|rover: root user: logs/undercloud/root/ara-report | 10:25 |
| quiquell | sshnaidm|rover: In case of overcloud it would be mixed with undercloud | 10:25 |
| quiquell | sshnaidm|rover: As it's run with root | 10:25 |
| sshnaidm|rover | quiquell, and if we put the db files in one /logs/ara-report directory? | 10:25 |
| quiquell | sshnaidm|rover: wich one zuul or root user ? | 10:27 |
| quiquell | sshnaidm|rover: Don't know if we can mix the sqlite databases | 10:27 |
| sshnaidm|rover | quiquell, all of them | 10:28 |
| sshnaidm|rover | quiquell, well, I need to change undercloud way of ara collection anyway, it shouldn't be like that.. | 10:29 |
| sshnaidm|rover | quiquell, so finally we'll just have 3 sqlite files | 10:29 |
| *** verdurin has joined #oooq | 10:30 | |
| quiquell | sshnaidm|rover: ara undercluod is already merge, maybe we can merge this to reduce post time | 10:30 |
| quiquell | sshnaidm|rover: And fix with the ara + OC patch | 10:30 |
| sshnaidm|rover | quiquell, well, it's merged, but it should work in different way :) | 10:33 |
| sshnaidm|rover | quiquell, let's merge the oc stuff and ara tasks generation first: https://review.openstack.org/#/c/580238/ | 10:34 |
| sshnaidm|rover | quiquell, can you review it please btw ^^ | 10:34 |
| sshnaidm|rover | quiquell, then we'll do grafana work for that, because we need this yesterday | 10:35 |
| sshnaidm|rover | quiquell, and then I will fix undercloud stuff and you will adopt upstream zuul tasks for that.. How is the plan? | 10:35 |
| quiquell | sshnaidm|rover: will, do, let's have this merged, so we have the info. | 10:35 |
| quiquell | sshnaidm|rover: Looks like a good plan, let's have oc and then fix the undercloud | 10:36 |
| quiquell | sshnaidm|rover: What do you mean with adopt upsgream zuul tasks ? | 10:37 |
| sshnaidm|rover | cool | 10:37 |
| sshnaidm|rover | quiquell, your patches with ara-report | 10:37 |
| quiquell | sshnaidm|rover: Ahh ok, good, going to run the oc ara thing now | 10:39 |
| quiquell | sshnaidm|rover: Let's get this merged | 10:39 |
| *** sanjay__u has joined #oooq | 10:44 | |
| quiquell | sshnaidm|rover: We the change at ansible.py we don't need to change ansible.cfg ? | 10:44 |
| sshnaidm|rover | quiquell, we change ansible.cfg in ansible.py | 10:47 |
| quiquell | sshnaidm|rover: But this affects undercloud too ? | 10:47 |
| sshnaidm|rover | quiquell, nope | 10:48 |
| quiquell | sshnaidm|rover: Then why we remove - containerized_undercloud|bool from undercloud-setup role ? | 10:48 |
| sshnaidm|rover | quiquell, so we could collect ara even in non- containerized_undercloud jobs | 10:49 |
| quiquell | sshnaidm|rover: Ohh that's right ok | 10:49 |
| ssbarnea | is there a need to be subscribed to rhos-prio list? | 10:58 |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 11:00 |
| panda | ssbarnea: focus mainly on rhos-dev and openstack-dev | 11:00 |
| ssbarnea | ... a lot of mail to soft(ignore) :D | 11:01 |
| *** bogdando has quit IRC | 11:19 | |
| *** bogdando has joined #oooq | 11:35 | |
| *** atoth has joined #oooq | 11:39 | |
| *** saneax has quit IRC | 11:48 | |
| *** saneax has joined #oooq | 11:57 | |
| *** amoralej is now known as amoralej|lunch | 12:03 | |
| weshay | ssbarnea, welcome | 12:04 |
| sshnaidm|rover | weshay, can you please cover chkumar|ruck in ci escalation today? I need to go for 30-40 min | 12:05 |
| sshnaidm|rover | weshay, currently periodic jobs fail because failed login to registry, I'm on that | 12:05 |
| weshay | sshnaidm|rover, sure | 12:05 |
| weshay | sshnaidm|rover, they are running? | 12:05 |
| weshay | the periodic jobs | 12:05 |
| sshnaidm|rover | weshay, yes, containers build job fails | 12:06 |
| sshnaidm|rover | ^^ | 12:06 |
| chkumar|ruck | weshay, https://bugs.launchpad.net/tripleo/+bug/1780726 | 12:06 |
| openstack | Launchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Triaged] | 12:06 |
| chkumar|ruck | it is on alerts | 12:06 |
| *** d0ugal has quit IRC | 12:06 | |
| *** sshnaidm|rover is now known as sshnaidm|afk | 12:08 | |
| *** d0ugal has joined #oooq | 12:09 | |
| weshay | sshnaidm|afk, hey qq... on the ruck/rover dashboard under zuul jobs | 12:15 |
| weshay | why are those now 90% red? | 12:15 |
| weshay | sshnaidm|afk, chkumar|ruck no time outs eh? | 12:17 |
| weshay | amazin | 12:17 |
| weshay | amazing | 12:17 |
| chkumar|ruck | weshay, https://trello.com/b/j4IcIomh/production-chain-escalation | 12:18 |
| chkumar|ruck | weshay, above bug https://bugs.launchpad.net/tripleo/+bug/1780726 is not added here | 12:18 |
| openstack | Launchpad bug 1780726 in tripleo "[master][queens][pike][ocata] Base periodic jobs are broken after zuul v3 migration " [Critical,Triaged] | 12:18 |
| quiquell | weshay: How they get fixed ? | 12:19 |
| chkumar|ruck | weshay, I have added alert in bug | 12:19 |
| weshay | chkumar|ruck, it will land there, we wait 5hrs | 12:19 |
| weshay | quiquell, seems like minor adjustments to the mirror server settings | 12:19 |
| chkumar|ruck | quiquell, ack | 12:19 |
| weshay | chkumar|ruck, "promotion-blocker" is the tag that does the work | 12:20 |
| weshay | chkumar|ruck, "alert" makes it visible on #tripleo | 12:20 |
| weshay | chkumar|ruck, understood? | 12:20 |
| chkumar|ruck | weshay, yup | 12:20 |
| weshay | word up | 12:20 |
| *** trown|outtypewww is now known as trown | 12:26 | |
| *** quiquell is now known as quiquell|off | 12:28 | |
| *** dougbtv has joined #oooq | 12:33 | |
| *** rlandy has joined #oooq | 12:34 | |
| ssbarnea | i made a small CR to reproducer at https://review.openstack.org/#/c/581012/ but the gate failed with Resource CREATE failed: OverQuotaClient: resources.public_network: Quota exceeded for resources | 12:37 |
| ssbarnea | i suspect this is not something normal | 12:38 |
| rlandy | ssbarnea: yep - we need to clean up that tenant - not your patch's doing | 12:47 |
| ssbarnea | rlandy: is something I can do myself? | 12:48 |
| rlandy | ssbarnea: no - you'd need CI tenant creds for that | 12:48 |
| *** ssbarnea_ has quit IRC | 12:48 | |
| rlandy | ruck/rover can take care of it | 12:49 |
| rlandy | don't worry about that faiing test though - it won't block your job | 12:49 |
| weshay | hrm.. tenant needs a cleanin? | 12:52 |
| *** quiquell|off is now known as quiquell | 12:53 | |
| quiquell | weshay: we have an alert for tenant issues | 12:53 |
| *** matbu has quit IRC | 12:54 | |
| quiquell | http://38.145.34.131:3000/d/pgdr_WVmk/cockpit?orgId=1&from=1530968087588&to=1531140887589&var-launchpad_tags=alert&var-promotion_names=current-tripleo&var-promotion_names=current-tripleo-rdo&var-promotion_names=current-tripleo-rdo-testing&var-releases=master&var-releases=queens&var-releases=pike&var-releases=ocata&panelId=181&fullscreen | 12:54 |
| weshay | quiquell, all I have w/ regards to changes to infra | 12:55 |
| weshay | https://review.openstack.org/#/c/580676/ | 12:55 |
| weshay | https://review.openstack.org/579970 | 12:55 |
| *** matbu has joined #oooq | 12:56 | |
| weshay | quiquell, ha.. ya.. I don't think that is what ssbarnea is hitting | 12:56 |
| weshay | but I'll clean it up | 12:56 |
| weshay | hey ssbarnea you have a minute to chat? | 12:59 |
| *** chem` has joined #oooq | 12:59 | |
| *** chem` is now known as chem | 13:00 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445 | 13:00 |
| * chkumar|ruck switches the irc server | 13:01 | |
| *** chkumar|ruck has left #oooq | 13:01 | |
| *** chkumar|ruck has quit IRC | 13:01 | |
| *** chandankumar has joined #oooq | 13:02 | |
| *** chandankumar is now known as chkumar|ruck | 13:02 | |
| *** ykarel is now known as ykarel|away | 13:02 | |
| bogdando | o/ PTAL https://review.openstack.org/#/c/577391/ | 13:05 |
| bogdando | easy +2 | 13:05 |
| *** amoralej|lunch is now known as amoralej | 13:11 | |
| weshay | bogdando, thanks | 13:15 |
| *** ykarel|away has quit IRC | 13:29 | |
| *** gvrangan has quit IRC | 13:29 | |
| ssbarnea | weshay: sure! now I can talk, i was in a conf call. | 13:31 |
| weshay | ssbarnea, morning.. ya let's chat for a few | 13:32 |
| weshay | https://bluejeans.com/u/whayutin/ | 13:33 |
| weshay | panda, you want to chat in a few | 13:39 |
| panda | weshay: sure | 13:41 |
| *** sshnaidm|afk is now known as sshnaidm|rover | 13:42 | |
| *** anande has joined #oooq | 13:45 | |
| *** skramaja has quit IRC | 13:46 | |
| weshay | panda, k.. ready in 2min | 13:49 |
| weshay | marios, rfolco, quiquell please welcome your fellow newbie.. ssbarnea Sorin :) | 13:49 |
| weshay | the incoming class of 2018 | 13:51 |
| weshay | panda, ready | 13:51 |
| marios | o/ ssbarnea | 13:54 |
| marios | welcome :) | 13:54 |
| rfolco | welcome ssbarnea, are you joining the tripleo-ci team? where you from ? | 13:54 |
| ssbarnea | rfolco: hi! I am UK based, Norwich. Originallly frum Bucharest, Romania (writing a description as we chat) | 13:55 |
| rfolco | cool :) | 13:56 |
| *** anande has quit IRC | 13:59 | |
| panda | ssbarnea: meeting ? | 14:03 |
| weshay | ssbarnea, https://bluejeans.com/7050859455/ | 14:04 |
| sshnaidm|rover | ssbarnea, Sorin, start please from changing beginning of your nick :D | 14:05 |
| ssbarnea | sshnaidm|rover: i know this was going to be an issue as I use this nickname everywhere (github, registered nickname on irc,...). I myself use two-leter-autocomplete... so I understand the issue. I wonder if I could do something channel specific. | 14:09 |
| sshnaidm|rover | ssbarnea, I'm kidding :) I think people will handle this with the time :D | 14:10 |
| *** links has quit IRC | 14:18 | |
| rlandy | sshnaidm|rover: rfolco and I are dealing with the nick confusion ... you guys will work it out :) | 14:18 |
| sshnaidm|rover | rlandy, you have only 1 letter in common :) | 14:19 |
| rlandy | sshnaidm|rover: there is a guy with the nick rlandry | 14:19 |
| sshnaidm|rover | rlandy, wow | 14:20 |
| rlandy | I get invited to his doc writer meeting on a regular basis | 14:20 |
| sshnaidm|rover | I wouldn't survive that | 14:20 |
| *** ykarel|away has joined #oooq | 14:24 | |
| *** ykarel|away is now known as ykarel | 14:31 | |
| *** quiquell is now known as quiquell|off | 14:58 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445 | 15:00 |
| *** bogdando has quit IRC | 15:02 | |
| weshay | https://github.com/openstack-infra/zuul-jobs/blob/master/roles/multi-node-bridge/tasks/common.yaml#L8-L19 | 15:05 |
| weshay | panda, ^ | 15:05 |
| weshay | rlandy, https://trunk.rdoproject.org/centos7-master/delorean-deps.repo | 15:06 |
| weshay | https://trunk.rdoproject.org/centos7-queens/delorean-deps.repo | 15:06 |
| weshay | https://trunk.rdoproject.org/centos7-pike/delorean-deps.repo | 15:07 |
| weshay | https://trunk.rdoproject.org/centos7-ocata/delorean-deps.repo | 15:07 |
| *** ykarel is now known as ykarel|away | 15:09 | |
| sshnaidm|rover | weshay, do we have a bug triage? | 15:22 |
| *** rfolco is now known as rfolcOUT | 15:23 | |
| weshay | sshnaidm|rover, we used all our time on the scrum and the ovs issue | 15:27 |
| weshay | sshnaidm|rover, I reschedule it | 15:27 |
| weshay | sshnaidm|rover, chkumar|ruck https://semaphore.cloud.upshift.engineering.redhat.com/ | 15:29 |
| panda | marios: do you have PTO/holidays in this sprint ? | 15:52 |
| *** anande has joined #oooq | 15:57 | |
| *** trown is now known as trown|lunch | 16:20 | |
| rlandy | weshay: panda: marios: does this look basically right? https://review.openstack.org/#/c/581081/ | 16:21 |
| rlandy | before I ask for broader review | 16:22 |
| chkumar|ruck | weshay: sshnaidm|rover https://review.openstack.org/581025 | 16:22 |
| chkumar|ruck | please have a look, thanks :-) | 16:22 |
| *** florianf has quit IRC | 16:24 | |
| chkumar|ruck | weshay: sshnaidm|rover it is needed for tripleo-upgrade package build fix | 16:25 |
| weshay | chkumar|ruck, https://review.openstack.org/581084 | 16:26 |
| weshay | chkumar|ruck, /me looks | 16:26 |
| sshnaidm|rover | chkumar|ruck, thanks.. weshay we don't need this in periodic jobs, right? | 16:26 |
| sshnaidm|rover | because we don't build in them afaiu | 16:27 |
| chkumar|ruck | sshnaidm|rover: it is for check jobs against tht in non-voting if it is about container upgrade job? | 16:30 |
| tosky | weshay: tempestconf has a bunch of jobs that runs on changes on itself, even with different testers | 16:30 |
| *** kopecmartin has quit IRC | 16:32 | |
| weshay | tosky, k.. | 16:32 |
| weshay | tosky, still I would like to see the refstack enabled job ONLY run aginst the python-tempestconf repo | 16:32 |
| weshay | tosky, does that make sense to you? | 16:33 |
| tosky | weshay: as I wrote in the comment, I totally agree with the need for a job with refstack, which would also cross-check if the API that tempestconf exposes is not broken | 16:33 |
| tosky | it should just end up in the correct file and with the proper commit message | 16:34 |
| weshay | k.. will have a look | 16:34 |
| panda | rlandy: paul just commented | 16:35 |
| chkumar|ruck | weshay: sshnaidm|rover only one timedout job http://logs.openstack.org/47/580747/1/gate/tripleo-ci-centos-7-containers-multinode/91fceed/job-output.txt.gz in whole day | 16:37 |
| chkumar|ruck | and not able to upload the logs also | 16:38 |
| sshnaidm|rover | chkumar|ruck, good | 16:38 |
| *** florianf has joined #oooq | 16:40 | |
| panda | rlandy: also, there's no {{ release }} variable available, I think you'll have to use zuul.branch or something similar | 16:41 |
| rlandy | panda; hey - I was uncertain about that ... | 16:41 |
| rlandy | either way - looking at the pat paul pointed at | 16:42 |
| rlandy | obviously others see the problem - at least with ocata | 16:42 |
| panda | rlandy: if we are going to use that repo, the problem is that ther is not -master version | 16:43 |
| panda | rlandy: it stops at queens, so even fro zuul.branch == master, you'll have to specify queens | 16:43 |
| rlandy | panda:I know | 16:44 |
| rlandy | commenting on patch | 16:44 |
| panda | now either we understand if that repo is good enough, or we push to use delorean deps. | 16:45 |
| *** holser_ has quit IRC | 16:53 | |
| weshay | chkumar|ruck, good stuff | 16:55 |
| weshay | sshnaidm|rover, nice fix.. containers-build is fixed | 16:56 |
| *** holser_ has joined #oooq | 16:57 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 17:00 |
| *** florianf has quit IRC | 17:05 | |
| *** Goneri has quit IRC | 17:14 | |
| *** tesseract has quit IRC | 17:15 | |
| *** anande has quit IRC | 17:20 | |
| *** trown|lunch is now known as trown | 17:23 | |
| weshay | rlandy, ping | 17:27 |
| *** holser_ has quit IRC | 17:33 | |
| *** holser_ has joined #oooq | 17:33 | |
| *** brault has quit IRC | 17:44 | |
| rlandy | weshay: hello | 17:44 |
| *** jfrancoa has quit IRC | 17:44 | |
| *** amoralej is now known as amoralej|off | 17:49 | |
| weshay | marios, ping | 18:10 |
| weshay | need ur help | 18:10 |
| weshay | https://bluejeans.com/u/whayutin/ | 18:11 |
| *** anande has joined #oooq | 18:12 | |
| *** ykarel|away has quit IRC | 18:24 | |
| rlandy | panda: is there already a review to reparent 007 and 008 out there? | 18:53 |
| *** atoth has quit IRC | 18:53 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445 | 19:00 |
| rlandy | creating reparenting job - don;t think there is one other there | 19:01 |
| rlandy | out there | 19:01 |
| *** anande has quit IRC | 19:04 | |
| weshay | rlandy, where does tripleo-ci get pulled into the reproducer? | 19:06 |
| rlandy | weshay: only on the undercloud in toci-gate-test | 19:07 |
| rlandy | sec submitting reparenting job - then will link | 19:07 |
| weshay | rlandy, k.. context is .. I'm trying to get this change in play on a recreate https://review.openstack.org/#/c/580037/ | 19:07 |
| rlandy | weshay: https://review.openstack.org/#/c/581116 ... Reparent scenario007 and 008 to tripleo-ci-base | 19:10 |
| rlandy | ok - looking at your change above | 19:11 |
| weshay | rlandy, we don't clone it in the reproducer script | 19:13 |
| rlandy | weshay: that's tricky ... it's pretty much part of the (non-existent) card right now to update the reproducer ... this is how I would do it ... | 19:13 |
| rlandy | in the section that clones tq and tqe, | 19:13 |
| rlandy | clone tripleo-ci | 19:13 |
| rlandy | and two ansible playbook runs | 19:14 |
| rlandy | that call those playbooks | 19:14 |
| weshay | k.. but I'll have to parse the zuul_changes | 19:14 |
| rlandy | in the order they are listed in zuul jobs | 19:14 |
| weshay | and pull the change in question | 19:14 |
| weshay | right? | 19:14 |
| rlandy | use git-review to do that | 19:14 |
| rlandy | or ... | 19:14 |
| rlandy | change the roles path | 19:14 |
| rlandy | and - I should say | 19:14 |
| rlandy | change the role path to read from your cloned repo | 19:15 |
| rlandy | like in the reproducer review I pointed to on friday | 19:15 |
| rlandy | make sense? | 19:15 |
| weshay | ya | 19:15 |
| *** brault has joined #oooq | 19:15 | |
| rlandy | basically, these are all independent ansible-playbook calls | 19:16 |
| weshay | rlandy, because toci takes care of changes to tq and tqe I think | 19:16 |
| rlandy | with the same vars passed to them | 19:16 |
| rlandy | only after it hits the ubdercloud | 19:16 |
| rlandy | toci takes care of that | 19:16 |
| rlandy | if you have a change that impacts running a playbook before the undercloud, | 19:16 |
| rlandy | you always had to you git-review to include it | 19:17 |
| *** jaganathan has quit IRC | 19:19 | |
| *** tosky has quit IRC | 19:23 | |
| *** jaganathan has joined #oooq | 19:30 | |
| rlandy | weshay: hmm ... scenario007 abd 008 won;t run with that job | 19:33 |
| rlandy | will have to add another depends | 19:33 |
| weshay | anyone know awk? | 19:45 |
| weshay | better way to do echo $zuul_changes | grep tripleo-ci | awk -F "tripleo-ci:" '{print $2 }' | cut -d ^ -f 1 | cut -d : -f 2 | 19:46 |
| rlandy | you looking to pull just the changes for tripleo-ci? | 19:52 |
| weshay | rlandy, ya | 19:55 |
| rlandy | weshay: this was the origin include idea ... https://review.openstack.org/#/c/564589/ | 19:55 |
| rlandy | super old | 19:55 |
| weshay | k | 19:56 |
| * weshay poking around | 19:56 | |
| rlandy | maybe that's just confusing | 19:57 |
| weshay | anyone hitting | 20:29 |
| weshay | # If there is a change to openstack-infra/tripleo-ci include it immediately | 20:29 |
| weshay | echo $ZUUL_CHANGES | 20:29 |
| weshay | export tripleo_ci_change=`echo $ZUUL_CHANGES | grep tripleo-ci | awk -F "tripleo-ci:" '{print $2 }' | cut -d ^ -f 1 | cut -d : -f 2` | 20:29 |
| weshay | if [ $tripleo_ci_change ]; then | 20:29 |
| weshay | echo $tripleo_ci_change | 20:29 |
| weshay | pushd tripleo-ci | 20:29 |
| weshay | git fetch https://git.openstack.org/openstack-infra/tripleo-ci $tripleo_ci_change && git checkout FETCH_HEAD | 20:29 |
| weshay | popd | 20:29 |
| weshay | fi | 20:29 |
| weshay | oops | 20:29 |
| weshay | TASK [libvirt/setup/overcloud : Resize undercloud image (call virt-resize)] ***************************************************************************************************************************************** | 20:29 |
| weshay | fatal: [127.0.0.2]: FAILED! => {"changed": true, "cmd": ["virt-resize", "--expand", "/dev/sda1", "/var/tmp/ara/undercloud.qcow2", "/var/tmp/ara/undercloud-resized.qcow2"], "delta": "0:00:06.786351", "end": "2018-07-09 16:29:06.931990", "msg": "non-zero return code", "rc": 1, "start": "2018-07-09 16:29:00.145639", "stderr": "virt-resize: error: libguestfs error: /usr/bin/supermin5 exited with error \nstatus 1.\nTo see full error messages you | 20:29 |
| weshay | may need to enable debugging.\nDo:\n export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1\nand run the command again. For further information, read:\n http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs\nYou can also run 'libguestfs-test-tool' and post the *complete* output\ninto a bug report or message to the libguestfs mailing list.\n\nIf reporting bugs, run virt-resize with debugging enabled and include the \ncomplete output:\n\n | 20:29 |
| weshay | virt-resize -v -x [...]", "stderr_lines": ["virt-resize: error: libguestfs error: /usr/bin/supermin5 exited with error ", "status 1.", "To see full error messages you may need to enable debugging.", "Do:", " export LIBGUESTFS_DEBUG=1 LIBGUESTFS_TRACE=1", "and run the command again. For further information, read:", " http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs", "You can also run 'libguestfs-test-tool' and post the | 20:29 |
| weshay | *complete* output", "into a bug report or message to the libguestfs mailing list.", "", "If reporting bugs, run virt-resize with debugging enabled and include the ", "complete output:", "", " virt-resize -v -x [...]"], "stdout": "[ 0.0] Examining /var/tmp/ara/undercloud.qcow2", "stdout_lines": ["[ 0.0] Examining /var/tmp/ara/undercloud.qcow2"]} | 20:30 |
| weshay | hrm.. | 20:31 |
| weshay | works manually | 20:31 |
| weshay | sudo virt-resize --expand /dev/sda1 /var/tmp/ara/undercloud.qcow2 /var/tmp/ara/undercloud-resized.qcow2 | 20:31 |
| weshay | bah.. now it's working | 20:36 |
| weshay | wth | 20:36 |
| *** brault has quit IRC | 20:48 | |
| rlandy | not really | 20:50 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445 | 21:00 |
| *** jtomasek has quit IRC | 21:37 | |
| *** holser_ has quit IRC | 21:58 | |
| *** jaganathan has quit IRC | 22:15 | |
| *** jaganathan has joined #oooq | 22:27 | |
| *** brault has joined #oooq | 22:48 | |
| *** brault has quit IRC | 22:53 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445 | 23:00 |
| *** yolanda_ has joined #oooq | 23:06 | |
| *** yolanda has quit IRC | 23:09 | |
| *** rook has quit IRC | 23:22 | |
| *** hubbot` has joined #oooq | 23:22 | |
| *** hubbot has quit IRC | 23:23 | |
| *** rook has joined #oooq | 23:25 | |
| *** rook is now known as Guest67898 | 23:25 | |
| *** bandini has quit IRC | 23:27 | |
| *** bandini has joined #oooq | 23:28 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!