| *** ccamacho has quit IRC | 00:42 | |
| *** apetrich has quit IRC | 02:10 | |
| *** skramaja has joined #oooq | 03:18 | |
| *** ykarel has joined #oooq | 03:24 | |
| *** ykarel has quit IRC | 03:45 | |
| *** gkadam has joined #oooq | 03:50 | |
| *** surpatil has joined #oooq | 03:56 | |
| surpatil | hello | 03:59 |
|---|---|---|
| *** ykarel has joined #oooq | 04:12 | |
| *** jaosorior has quit IRC | 04:24 | |
| *** jaosorior has joined #oooq | 04:25 | |
| *** soniya29 has joined #oooq | 04:29 | |
| *** raukadah is now known as chandankumar | 04:59 | |
| *** udesale has joined #oooq | 04:59 | |
| *** marios has joined #oooq | 05:20 | |
| *** ratailor has joined #oooq | 05:21 | |
| *** jaosorior has quit IRC | 05:22 | |
| *** ratailor_ has joined #oooq | 05:37 | |
| *** ykarel_ has joined #oooq | 05:37 | |
| *** ykarel__ has joined #oooq | 05:39 | |
| *** ratailor has quit IRC | 05:40 | |
| *** ykarel has quit IRC | 05:40 | |
| *** ratailor__ has joined #oooq | 05:40 | |
| *** ykarel_ has quit IRC | 05:42 | |
| *** ratailor_ has quit IRC | 05:43 | |
| *** ykarel_ has joined #oooq | 05:45 | |
| *** ykarel__ has quit IRC | 05:48 | |
| *** jfrancoa has joined #oooq | 05:53 | |
| *** jfrancoa has quit IRC | 05:57 | |
| *** jfrancoa has joined #oooq | 06:12 | |
| *** ccamacho has joined #oooq | 06:33 | |
| *** jaosorior has joined #oooq | 06:39 | |
| *** jpena|off is now known as jpena | 06:49 | |
| *** ykarel_ is now known as ykarel|meeting | 06:51 | |
| *** bogdando has joined #oooq | 07:01 | |
| *** tesseract has joined #oooq | 07:06 | |
| *** jbadiapa has quit IRC | 07:40 | |
| *** holser has joined #oooq | 07:41 | |
| *** holser has quit IRC | 07:43 | |
| *** holser has joined #oooq | 07:43 | |
| *** kopecmartin|off is now known as kopecmartin | 07:44 | |
| holser | Good morning | 07:49 |
| holser | panda|rover is delorean fixed? | 07:49 |
| holser | panda|rover here is set of logs against of my patch http://pastebin.test.redhat.com/793794 | 07:56 |
| *** jbadiapa has joined #oooq | 07:56 | |
| holser | of all failed CI jobs | 07:56 |
| holser | https://paste.fedoraproject.org/paste/fP3Tur~2Evo7qXJYZ-tOXg | 07:57 |
| *** ykarel has joined #oooq | 08:04 | |
| *** ratailor has joined #oooq | 08:05 | |
| *** ykarel|meeting has quit IRC | 08:05 | |
| *** ykarel_ has joined #oooq | 08:06 | |
| *** ratailor__ has quit IRC | 08:07 | |
| *** ykarel has quit IRC | 08:09 | |
| *** saneax has joined #oooq | 08:12 | |
| *** ykarel_ is now known as ykarel|lunch | 08:13 | |
| panda|rover | holser: it should work now | 08:19 |
| zbr | panda|rover: https://review.opendev.org/#/c/679621/ | 08:23 |
| panda|rover | holser: the log show error in the build and hash retrieval process. If you try to access thos url now, they respond | 08:24 |
| panda|rover | chandankumar: you there today ? | 08:27 |
| holser | panda|rover thanks | 08:28 |
| holser | I have "recheck"ed the job | 08:28 |
| *** jaosorior has quit IRC | 08:29 | |
| chandankumar | panda|rover: yup, filling visa form | 08:35 |
| panda|rover | chandankumar: for shanghai ? | 08:36 |
| chandankumar | panda|rover: for brno | 08:36 |
| *** derekh has joined #oooq | 08:38 | |
| *** tesseract has quit IRC | 08:40 | |
| panda|rover | chandankumar: do you have time to chat ? | 08:44 |
| chandankumar | panda|rover: I will ping you in 30 mins | 08:45 |
| *** jaosorior has joined #oooq | 08:59 | |
| chandankumar | panda|rover: want to sync? | 09:07 |
| chandankumar | panda|rover: https://bluejeans.com/1571313919 | 09:09 |
| *** chandankumar has quit IRC | 09:18 | |
| panda|rover | chandjoining | 09:19 |
| panda|rover | d'oh | 09:19 |
| *** chandankumar has joined #oooq | 09:19 | |
| *** ykarel|lunch is now known as ykarel | 09:22 | |
| *** soniya29 has quit IRC | 09:28 | |
| zbr | new gerrit cli toy: https://pypi.org/project/gri/ | 09:29 |
| *** apetrich has joined #oooq | 09:36 | |
| *** dtantsur|afk is now known as dtantsur | 09:42 | |
| *** jaosorior has quit IRC | 10:05 | |
| bogdando | hi folks. I'm trying the new CI reproducer and wanted it to run tripleo-ci-centos-7-scenario007-multinode-oooq-container | 10:05 |
| bogdando | so I do wget -O reproducer-zuul-based-quickstart.tar https://storage.bhs1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/logs_52/677852/3/check/tripleo-ci-centos-7-scenario007-multinode-oooq-container/8c7489c/logs/reproducer-quickstart/reproducer-zuul-based-quickstart.tar | 10:06 |
| bogdando | then extract it, and the magic starts... | 10:06 |
| bogdando | but for some reason, the submitted patch for my local gerrit gets tripleo-ci-centos-7-scenario007-multinode-oooq-container-dlrn-hash-tag job executed instead | 10:06 |
| bogdando | what is missing to start the proper job?.. | 10:07 |
| zbr | panda|rover: does it make sense to try to explain alex why https://review.opendev.org/#/c/674571/3 is useful? | 10:10 |
| panda|rover | zbr: he has the same doubts I had | 10:11 |
| zbr | yeah, but "ability to test code locally without messing your machine" is not a good enough reason? | 10:12 |
| zbr | dev machine is likely not even an centos-7 one. | 10:12 |
| panda|rover | zbr: not if the whole ecosystem doesn't support this decision | 10:12 |
| zbr | i do not understand: what does not support? you seen it running already. | 10:13 |
| *** tosky has joined #oooq | 10:45 | |
| *** aakarsh has joined #oooq | 10:47 | |
| ykarel | bogdando, -dlrn-hash-tag job would have parent the job u trying to run | 10:49 |
| bogdando | ykarel: yes | 10:50 |
| ykarel | https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/create-zuul-based-reproducer/templates/launcher-playbook.yaml.j2#L70 | 10:50 |
| bogdando | but the job finishes almost instantly w/o having annything deployed from the parent | 10:50 |
| ykarel | so you got the logs of the job? | 10:50 |
| ykarel | or it just didn't ran | 10:50 |
| bogdando | ykarel: sadly, I had to remove the logs container from copose :) | 10:51 |
| bogdando | it fails to start with OCI mounts issues | 10:51 |
| bogdando | now I'm trying to manually change the job config in zuul.yaml | 10:51 |
| bogdando | to run something else... but zuul does not trigger/enqueue with new patchsets | 10:52 |
| bogdando | ykarel: *from docker-compose config | 10:53 |
| ykarel | bogdando, i have not used for long the reproducer, but it should retrigger on new patches | 10:54 |
| bogdando | yea | 10:54 |
| ykarel | bogdando, you can look for executor and scheduler logs to see why it's not triggering | 10:55 |
| bogdando | nothing interesting there... | 10:55 |
| bogdando | ykarel: h, actually there is... | 10:56 |
| bogdando | http://paste.openstack.org/show/Bqewg1M57umIIeB8RQj0/ ykarel | 10:57 |
| * ykarel looks | 10:57 | |
| bogdando | I think this is something to my posted 'recheck' comment | 11:00 |
| bogdando | but nothing interesting for why nothing gets triggered | 11:01 |
| ykarel | for recheck event: comment-added | 11:01 |
| ykarel | try, docker-compose logs --tail=10 -f scheduler executor launcher | 11:01 |
| bogdando | ykarel: so I'm updated the original patch revision, not the new patch I placed on top. After those squashed, zuul enqueued something | 11:05 |
| ykarel | okk good | 11:05 |
| *** ykarel is now known as ykarel|meeting | 11:06 | |
| zbr | marios: panda|rover : ready https://review.opendev.org/#/c/679621/ | 11:06 |
| *** ykarel|meeting is now known as ykarel | 11:26 | |
| *** jpena is now known as jpena|lunch | 11:31 | |
| *** soniya29 has joined #oooq | 11:36 | |
| *** udesale has quit IRC | 11:37 | |
| *** jaosorior has joined #oooq | 11:51 | |
| *** udesale has joined #oooq | 11:51 | |
| *** dtantsur is now known as dtantsur|brb | 11:57 | |
| holser | panda|rover delorean is still failing | 12:10 |
| holser | you may check 679517 on zuul | 12:10 |
| kopecmartin | chandankumar: hi, do you know what might be the problem in the DLRN-rmbuild job? https://review.rdoproject.org/r/#/c/21933/ | 12:11 |
| bogdando | ykarel: so it was enqueued but no builds :/ | 12:12 |
| bogdando | DEBUG - [e: 8937218a738843e0ad9afd050ee6fa4b] Reporting change <Change 0x7fcb8a933ac8 test1 1001,2> | 12:13 |
| bogdando | DEBUG - [e: 8937218a738843e0ad9afd050ee6fa4b] Project test1 not in pipeline <Pipeline check> for change <Change 0x7fcb8a933ac8 test1 1001,2> | 12:13 |
| bogdando | DEBUG - [e: 8937218a738843e0ad9afd050ee6fa4b] Removing change <Change 0x7fcb8a933ac8 test1 1001,2> from queue | 12:13 |
| bogdando | looks not good | 12:13 |
| panda|rover | holser: yes, it's still flaky, the DNS propagation is having problems, sometimes works, sometimes doesn't. We have 50% failures currently | 12:19 |
| ykarel | kopecmartin, chandankumar has some issues with his system and he is recovering it, there was outage at trunk rdo, it's better now, so try recheck | 12:20 |
| ykarel | bogdando, do you have multiple depends on | 12:20 |
| bogdando | ykarel: yes | 12:21 |
| ykarel | there may be issue with some depends on | 12:21 |
| bogdando | ykarel: not actually, just https://review.opendev.org/#/c/677852/4 | 12:21 |
| bogdando | a two patches, no more deps | 12:21 |
| holser | thanks panda|rover | 12:22 |
| panda|rover | holser: oh, checked now, we hav 61% success currently, so things are slowly improving | 12:23 |
| holser | thanks | 12:23 |
| holser | if we have 10 jobs in patch so 4 will fail | 12:24 |
| holser | ok good to know | 12:24 |
| ykarel | bogdando, ack, then it might he some other issue | 12:25 |
| kopecmartin | ykarel: ok, thanks | 12:25 |
| ykarel | bogdando, have you got success with new reproducer recently, if not there may be some issues wiht it | 12:25 |
| * ykarel have not used it for long | 12:25 | |
| ykarel | s/some issues/some known issues | 12:26 |
| bogdando | ykarel: nope. that's my first time | 12:30 |
| bogdando | as the old one stopped working for me | 12:30 |
| ykarel | bogdando, ack, i have used the old one around a month ago, may be some issue introduced recently | 12:32 |
| *** weshay has joined #oooq | 12:34 | |
| weshay | hey... running a little late | 12:34 |
| weshay | rfolco ^ I'lll look at the bugs later today | 12:34 |
| rfolco | weshay, oh you here... let me know if you want to make it together later today | 12:35 |
| *** gkadam has quit IRC | 12:37 | |
| *** jpena|lunch is now known as jpena | 12:40 | |
| weshay | panda|rover you on your own as ruck/rover? | 12:41 |
| weshay | panda|rover rfolco what is going on? upstream is at 46% pass rate | 12:44 |
| rfolco | chandankumar, ^ | 12:45 |
| rfolco | oops | 12:45 |
| chandankumar | weshay: rfolco trunk.rdoproject.org vm was down | 12:45 |
| chandankumar | from last sunday | 12:45 |
| weshay | panda|rover ping | 12:45 |
| weshay | panda|rover ping | 12:45 |
| weshay | panda|rover ping | 12:45 |
| chandankumar | weshay: rfolco jpena was working very hard to recover it and bring the servies on line | 12:45 |
| chandankumar | weshay: https://lists.rdoproject.org/pipermail/dev/2019-September/009134.html | 12:46 |
| jpena | weshay: right now, we're at the mercy of DNS propagation. The trunk.rdo server has been rebuilt and data restored, but for some reason some DNS servers are still serving old data | 12:47 |
| *** Goneri has joined #oooq | 12:47 | |
| weshay | thanks jpena | 12:47 |
| panda|rover | weshay: we have 61% success currently | 12:49 |
| panda|rover | in RDO, slighlty less in upstream | 12:51 |
| panda|rover | but yes, everythign is still more or less down | 12:51 |
| weshay | panda|rover k.. jump on blue w/ me please | 12:52 |
| *** saneax has quit IRC | 12:54 | |
| *** redrobot has quit IRC | 12:55 | |
| panda|rover | weshay: lost you | 12:58 |
| *** sanjayu_ has quit IRC | 12:58 | |
| *** saneax has joined #oooq | 13:01 | |
| *** sanjayu_ has joined #oooq | 13:02 | |
| *** surpatil has quit IRC | 13:05 | |
| *** soniya29 has quit IRC | 13:06 | |
| *** ratailor has quit IRC | 13:15 | |
| *** holser has quit IRC | 13:17 | |
| *** holser has joined #oooq | 13:22 | |
| chandankumar | rfolco: weshay https://etherpad.openstack.org/p/tripleo-meeting-items added podman gating at line no: 16 | 13:23 |
| chandankumar | rfolco: weshay there are some docs also floating on internal mailing list related to the same | 13:23 |
| panda|rover | chandankumar: weshay's laptop just permanently died, he may have problem responding | 13:24 |
| chandankumar | ack | 13:24 |
| weshay | bringing up a sidecar laptop now | 13:28 |
| *** redrobot_ has joined #oooq | 13:36 | |
| *** redrobot_ is now known as redrobot | 13:37 | |
| *** Vorrtex has joined #oooq | 13:37 | |
| * chandankumar will connect from home in an hour, rfolco If I donot reach on time, feel free to take care of podman gating in tripleo meeting | 13:41 | |
| *** dtantsur|brb is now known as dtantsur | 13:46 | |
| *** saneax has quit IRC | 13:51 | |
| weshay | woot... I'm back | 14:00 |
| *** chem` has quit IRC | 14:10 | |
| weshay | panda|rover can you please provide an update to the outtage in the mtg please | 14:10 |
| weshay | when we get to new items | 14:11 |
| chandankumar | rfolco: does the podman topic passed? | 14:11 |
| chandankumar | in tripleo meeting | 14:11 |
| panda|rover | weshay: maybe jpena is the right person for the update there .. but I can provide a summary | 14:12 |
| rfolco | chandankumar, at the first one I guess | 14:12 |
| weshay | panda|rover, yes a summary would be great.. you can mention jpena has more details for sure | 14:12 |
| weshay | panda|rover are we aware of molecule failing in the gate? https://storage.gra1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/logs_56/677256/4/gate/tripleo-tox-molecule/965834b/tox/reports.html | 14:13 |
| weshay | panda|rover zbr requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://trunk.rdoproject.org/fedora28-master/current-tripleo/delorean.repo | 14:14 |
| weshay | panda|rover please remove any f28 tests from any molecule test | 14:14 |
| zbr | sure, lets do some grepping | 14:15 |
| zbr | did we get centos-8? | 14:15 |
| zbr | afaik, the goal was to replace f28 with centos8. | 14:15 |
| *** udesale has quit IRC | 14:20 | |
| *** udesale has joined #oooq | 14:21 | |
| *** sanjayu_ has quit IRC | 14:23 | |
| weshay | zbr panda|rover it's failing in the gate.. so it needs to be delt w/ asap | 14:24 |
| weshay | panda|rover we need a lp | 14:24 |
| weshay | panda|rover rfolco the cockpit etherpad link needs to updated as well | 14:25 |
| *** chem has joined #oooq | 14:26 | |
| *** jaosorior has quit IRC | 14:27 | |
| zbr | weshay: send me link to effected change | 14:27 |
| weshay | zbr <weshay> panda|rover are we aware of molecule failing in the gate? https://storage.gra1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/logs_56/677256/4/gate/tripleo-tox-molecule/965834b/tox/reports.html | 14:28 |
| weshay | 08:14 <weshay> panda|rover zbr requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://trunk.rdoproject.org/fedora28-master/current-tripleo/delorean.repo | 14:28 |
| zbr | gerrit, change | 14:28 |
| zbr | ahh, found | 14:28 |
| weshay | zbr you need more coffee :) | 14:28 |
| *** chem has quit IRC | 14:38 | |
| *** chem has joined #oooq | 14:38 | |
| zbr | ... what I love these new log hosting urls, short and effective, not. | 14:42 |
| *** jaosorior has joined #oooq | 14:46 | |
| *** bogdando has quit IRC | 14:53 | |
| chandankumar | weshay: this podman gating dropped from phil -> rlandy -> to us so we brought in the meeting | 14:56 |
| weshay | I know.. I saw the emails come in over pto | 14:56 |
| weshay | chandankumar start putting your thoughts into an epic | 14:56 |
| weshay | chandankumar place the epic directly below ceph-ansible | 14:56 |
| weshay | for now at least | 14:56 |
| chandankumar | weshay: sure sir | 14:57 |
| weshay | panda|rover please jump on my blue again.. in a few min | 14:57 |
| * weshay tests it out on new $compute | 14:57 | |
| weshay | r | 14:57 |
| chandankumar | weshay: $compute ~= macc? | 14:58 |
| chandankumar | *mac | 14:58 |
| panda|rover | chandankumar: no, he's using a nova instance | 14:59 |
| panda|rover | and a vt100 | 14:59 |
| chandankumar | hehe :-) | 14:59 |
| *** ykarel is now known as ykarel|away | 15:00 | |
| zbr | panda|rover: is this ok https://review.rdoproject.org/r/#/c/22048/ ? | 15:01 |
| weshay | panda|rover https://docs.google.com/document/d/1VZhje7ZN9sk4E31fYVrPxpqMJGz5ZhHRfhte_RYMXxg/edit#heading=h.1j26ftmf3vk5 | 15:10 |
| *** skramaja has quit IRC | 15:10 | |
| *** jaosorior has quit IRC | 15:11 | |
| chandankumar | zbr: left a question there https://review.rdoproject.org/r/#/c/22048/ | 15:12 |
| weshay | rfolco ping.. jump on my blue | 15:12 |
| chandankumar | see ya tomorrow | 15:13 |
| zbr | chandankumar: and the answer is... i have no... idea. | 15:13 |
| rfolco | weshay, k let me drop from dfg info call | 15:13 |
| zbr | that this script is called by jenkins jobs from https://github.com/rdo-infra/ci-config/blob/master/jenkins/jobs/promote-master-current-tripleo.yml#L70 | 15:14 |
| zbr | chandankumar: is defined in files like rdo-infra/ci-config/jenkins/jobs/scripts/centos-rocky-current-tripleo.sh | 15:16 |
| zbr | chandankumar: maybe just to be use I would use a the old var as fallback, so we avoid breaking something if the new one is not defined. | 15:17 |
| chandankumar | zbr: verified that | 15:17 |
| chandankumar | zbr: https://codesearch.rdoproject.org/?q=DELOREAN_HOST&i=nope&files=&repos= | 15:17 |
| chandankumar | zbr: do we want to provide a fallback there also? | 15:18 |
| chandankumar | zbr: something like this https://github.com/rdo-infra/ci-config/blob/master/jenkins/jobs/scripts/promote-repo-promote.sh#L4 | 15:18 |
| zbr | i do not know but better be safe than sorry. clearly that doing ${FOO:-$BAR} would be safer. | 15:18 |
| chandankumar | zbr: sure, propose the change, we will look take a look at the breakage | 15:19 |
| zbr | chandankumar: that is related to the SSL certificates issue. | 15:20 |
| chandankumar | ah yes, | 15:20 |
| chandankumar | ok approving this one | 15:20 |
| *** chandankumar is now known as raukadah | 15:32 | |
| *** ykarel|away has quit IRC | 15:36 | |
| *** jaosorior has joined #oooq | 15:37 | |
| *** tosky_ has joined #oooq | 15:40 | |
| *** tosky has quit IRC | 15:41 | |
| *** tosky_ is now known as tosky | 15:41 | |
| weshay | panda|rover thanks for opening... please add promotion_blocker | 15:47 |
| *** udesale has quit IRC | 15:47 | |
| *** jfrancoa has quit IRC | 15:47 | |
| marios | rfolco: trying to work out how to rebase panda|rover patch without pushing new version of your one... | 15:48 |
| panda|rover | marios: nto possible | 15:49 |
| panda|rover | marios: not | 15:49 |
| panda|rover | rebase changes the base for all three | 15:49 |
| *** dtrainor has quit IRC | 15:50 | |
| marios | rfolco: panda|rover yah i did the merge conflict and about to git review but noticed it... tryin to work out what is ontop of what | 15:50 |
| marios | rfolco: panda|rover https://review.rdoproject.org/r/gitweb?p=rdo-infra/ci-config.git;a=shortlog;h=493d6bfc2caae5dc0d25286eee340d36d2ef02e6 | 15:53 |
| marios | panda|rover: rfolco so panda patch is the base. | 15:53 |
| panda|rover | marios: first the job definition, then role adaptation, then staging environment | 15:53 |
| marios | rfolco: gonna try getting latest of yours and then apply panda patch lets see | 15:54 |
| marios | rfolco: panda|rover ok merge conflict resolved updated https://review.rdoproject.org/r/21895 | 16:00 |
| marios | panda|rover: rfolco will continue to dig there tomorrow | 16:01 |
| panda|rover | marios: what will you do then ? | 16:06 |
| marios | panda|rover: lets discuss tomorrow /me out ;) (first start looking at the comments, | 16:11 |
| panda|rover | weshay: the outage may cause error at any point in the deployment process. e.g. https://openstack.fortnebula.com:13808/v1/AUTH_e8fd161dc34c421a979a9e6421f823e9/logs_16/672916/11/gate/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/c0ea677/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz. For elastic check it may be too generic to check for all the package install failures. I may try to | 16:11 |
| panda|rover | limit to the messages in console | 16:11 |
| weshay | panda|rover k.. ya.. paste a query.yml and we'll take a look and see | 16:12 |
| panda|rover | zbr: can you merge this ? https://review.rdoproject.org/r/22051 | 16:12 |
| zbr | done | 16:12 |
| panda|rover | zbr: thanks | 16:13 |
| *** marios is now known as marios|out | 16:13 | |
| *** jpena is now known as jpena|off | 16:13 | |
| *** marios|out has quit IRC | 16:15 | |
| *** dtantsur is now known as dtantsur|afk | 16:20 | |
| *** jaosorior has quit IRC | 16:25 | |
| *** kopecmartin is now known as kopecmartin|off | 16:27 | |
| *** dsneddon has joined #oooq | 16:30 | |
| rfolco | panda|rover, would you please review this one https://review.opendev.org/#/c/663977/ | 16:33 |
| *** dtrainor has joined #oooq | 16:36 | |
| panda|rover | rfolco: depends on how much you're going to pay me | 16:36 |
| rfolco | panda|rover, zero euro | 16:36 |
| rfolco | panda|rover, how much is your review price ? | 16:36 |
| panda|rover | rfolco: sold. | 16:36 |
| rfolco | great | 16:37 |
| panda|rover | rfolco: please deposit 0 euro to my bank today | 16:37 |
| rfolco | I need a receipt | 16:37 |
| rfolco | for the reibursement | 16:37 |
| panda|rover | rfolco: nope, I want your money. | 16:38 |
| rfolco | panda|rover, accept bitcoin? | 16:40 |
| panda|rover | rfolco: if they are yours, yes | 16:40 |
| panda|rover | rfolco: what's the job that tests your code ? | 16:40 |
| rfolco | ok, just asking coz I don't have any | 16:40 |
| zbr | rfolco: donation for panda: https://review.rdoproject.org/r/#/c/22077/ | 16:40 |
| rfolco | panda|rover, follow up patch | 16:41 |
| rfolco | panda|rover, https://review.opendev.org/#/c/678058/29 | 16:41 |
| zbr | panda|rover: don't forget to vote on your acl bumping, for confirming that the email is correct. (i was asked to do the same on mine) | 16:42 |
| panda|rover | rfolco: why is it in a follow up patch taht we don't intend to merge ? | 16:44 |
| rfolco | panda|rover, coz this will be in periodic w/ push=true... and we want to test push in the check job before merging it | 16:45 |
| zbr | rfolco: panda|rover : don't forget to workflow https://review.opendev.org/#/c/679800/ -- to fix broken molecule due to f28. | 16:45 |
| rfolco | panda|rover, notice - push_containers | bool | 16:45 |
| panda|rover | rfolco: I've seen it. Why don't we keep this permanently in our jobs ? | 16:46 |
| rfolco | panda|rover, what? | 16:47 |
| rfolco | whaaa | 16:47 |
| panda|rover | rfolco: so we are sure we are gating any other patches that break push ? | 16:47 |
| rfolco | whaaat? | 16:47 |
| rfolco | wha wha what | 16:47 |
| panda|rover | rfolco: wazzzzzzup ? | 16:47 |
| panda|rover | rfolco: what you don't understand ? | 16:48 |
| rfolco | panda|rover, you mean keep push=true ? can we address this in a follow-up change ? this has nothing to do with multi-arch support | 16:48 |
| rfolco | panda|rover, I can enable push=true and local registry for the check job, if that is the request | 16:48 |
| raukadah | zbr: panda|rover left comment here https://review.opendev.org/#/c/679800/1 | 16:50 |
| panda|rover | rfolco: does that change test your patch ? is your patch testing multi-arch ? if yes to both, we may want to think to test pushing too in our jobs ... | 16:53 |
| panda|rover | raukadah: yep saw it, we are merging that one, then zbr will address the other | 16:53 |
| raukadah | ack | 16:53 |
| rfolco | mjturek, is there any test with the latest patchset on your ppc64le job ? | 16:53 |
| *** jaosorior has joined #oooq | 16:54 | |
| rfolco | panda|rover, the dnm change tests the latest patchset, with and without buildah. The workflow for x86 works. | 16:54 |
| *** dtrainor has quit IRC | 16:54 | |
| rfolco | waiting mjturek to confirm if it works for ppc64le job too in jenkins... | 16:55 |
| *** dtrainor has joined #oooq | 16:55 | |
| *** matbu has joined #oooq | 16:55 | |
| zbr | i am not very keen on reducing out testing but i guess is only of 1-2 weeks. | 16:59 |
| *** derekh has quit IRC | 17:00 | |
| zbr | what is the codename for centos 8? if it does not have one, I propose "fata morgana" :D | 17:01 |
| *** jtomasek has quit IRC | 17:01 | |
| zbr | weshay: what is standalone3 -- or what do I need to update on https://opendev.org/openstack/tripleo-quickstart/src/branch/master/ci-scripts/full-deploy.sh#L140 ? | 17:04 |
| zbr | i guess we are to remove release config for fedora 28 too? | 17:05 |
| *** jaosorior has quit IRC | 17:14 | |
| *** jaosorior has joined #oooq | 17:16 | |
| *** jaosorior has quit IRC | 17:18 | |
| *** holser has quit IRC | 17:21 | |
| *** ykarel|away has joined #oooq | 17:22 | |
| * weshay looks | 17:35 | |
| weshay | zbr that was the python3 version | 17:35 |
| weshay | back when I was testing f28 | 17:36 |
| mjturek | rfolco: let's see | 17:38 |
| mjturek | rfolco: hmmm this is the latest run https://centos.logs.rdoproject.org/tripleo-upstream-containers-build-master-ppc64le/1420/logs/logs/ | 17:40 |
| mjturek | but seems like there's something stopping the build from happening | 17:41 |
| rfolco | mjturek, can you change this job to run with latest patch in https://review.opendev.org/#/c/663977/ | 17:44 |
| rfolco | tripleo-ci is checking out master apparently | 17:45 |
| rfolco | Commit message: "Nuke f28 job/nodeset definitions" | 17:45 |
| mjturek | rfolco I can but it would need to be reverted once the change lands | 17:48 |
| mjturek | once 663977 lands | 17:48 |
| rfolco | mjturek, would be nice to see the patch working on ppc64le side as well | 17:49 |
| mjturek | rfolco I'm seeing bigger problems right now | 17:49 |
| rfolco | mjturek, like what | 17:49 |
| mjturek | rfolco: something is stopping the containers from actually building | 17:51 |
| mjturek | https://centos.logs.rdoproject.org/tripleo-upstream-containers-build-master-ppc64le/1420/logs/logs/build.log | 17:51 |
| mjturek | rfolco could you take a look and see if you notice anything indicating the actual problem ^? | 17:52 |
| *** jtomasek has joined #oooq | 17:52 | |
| rfolco | mjturek, hmm you'll need to reproduce the steps manually to debug this I think | 17:54 |
| rfolco | RUN yum -y install findutils iproute iscsi-initiator-utils lvm2 ncurses procps-ng socat sudo which python openstack-tripleo-common-container-base rsync cronie crudini puppet-tripleo dumb-init && yum clean all && rm -rf /var/cache/yum" | 17:54 |
| rfolco | this is failing in the base container | 17:54 |
| mjturek | greeeaaaat | 17:54 |
| mjturek | thanks rfolco | 17:54 |
| rfolco | mjturek, our ci job collects individual logs for kolla in tmp... so its easier to debug. See if you can either add those to your job or reproduce it manually. The base container is failing, so all the rest will fail. | 17:56 |
| ykarel|away | mjturek, here is the issue https://centos.logs.rdoproject.org/tripleo-upstream-containers-build-master-ppc64le/1420/logs/logs/containers-consolidated-builds.log | 17:56 |
| ykarel|away | mjturek, there are missing package for ppc, for boost159 | 17:56 |
| ykarel|away | or some more need to dig | 17:56 |
| mjturek | *sigh* | 17:56 |
| mjturek | thanks ykarel|away | 17:57 |
| mjturek | not sure when this happened | 17:57 |
| ykarel|away | mjturek, https://cbs.centos.org/koji/buildinfo?buildID=15725 have missing ppc packages | 17:57 |
| ykarel|away | mjturek, so you mean this was working earlier? | 17:57 |
| mjturek | months ago container builds were working fine | 17:58 |
| ykarel|away | so i guess than logs will not be there for that | 17:59 |
| ykarel|away | so we can confirm how it was working | 17:59 |
| mjturek | yeah unfortunately | 17:59 |
| ykarel|away | mjturek, so is that > 2 months | 18:01 |
| mjturek | yes | 18:01 |
| ykarel|away | mjturek, okk seems related to facter update | 18:01 |
| ykarel|away | where other boost deps were changed | 18:01 |
| mjturek | ahh makes sense | 18:01 |
| ykarel|away | https://review.rdoproject.org/r/#/c/21204/, need to dig further | 18:01 |
| * ykarel|away out can check tomorrow | 18:03 | |
| mjturek | ykarel|away thanks I'll ping you sometime | 18:03 |
| mjturek | ykarel|away FYI this has a ppc64le build https://cbs.centos.org/koji/buildinfo?buildID=17625 | 18:04 |
| ykarel|away | mjturek, yup i saw that, | 18:04 |
| rfolco | mjturek, these are probably missing | 18:05 |
| rfolco | $ rpm -qa | grep boost- | 18:05 |
| rfolco | boost-locale-1.69.0-8.fc30.x86_64 | 18:05 |
| rfolco | boost-filesystem-1.69.0-8.fc30.x86_64 | 18:05 |
| rfolco | boost-date-time-1.69.0-8.fc30.x86_64 | 18:05 |
| rfolco | boost-system-1.69.0-8.fc30.x86_64 | 18:05 |
| rfolco | boost-chrono-1.69.0-8.fc30.x86_64 | 18:05 |
| rfolco | boost-iostreams-1.69.0-8.fc30.x86_64 | 18:05 |
| rfolco | boost-regex-1.69.0-8.fc30.x86_64 | 18:05 |
| rfolco | boost-atomic-1.69.0-8.fc30.x86_64 | 18:05 |
| rfolco | boost-thread-1.69.0-8.fc30.x86_64 | 18:05 |
| rfolco | (sorry, should have posted to pastelog) | 18:05 |
| mjturek | rfolco: those are all here fyi https://cbs.centos.org/koji/buildinfo?buildID=17625 | 18:06 |
| mjturek | but as boost159-* | 18:07 |
| rfolco | you're n the right track | 18:08 |
| mjturek | you don't think getting those published would fix it? | 18:09 |
| mjturek | rfolco ^ | 18:09 |
| rfolco | mjturek, you need to get these installed in your test box. I don't think it matters how you do it, if you setup a custom repo, etc. We confirmed the patch works for x86 workflow. Now it would be good to have the logs for ppc64le too. I don't think its mandatory but it helps. | 18:12 |
| *** baha has joined #oooq | 18:12 | |
| *** ykarel|away has quit IRC | 18:17 | |
| mjturek | rfolco fair enough, I'll try. I'll also get the job to use the proposed patch | 18:19 |
| rfolco | mjturek, cool thanks | 18:19 |
| weshay | zbr questions and comments in https://tree.taiga.io/project/tripleo-ci-board/task/1261?kanban-status=1447275 | 18:24 |
| *** tosky has quit IRC | 18:24 | |
| *** Goneri has quit IRC | 18:55 | |
| *** Vorrtex has quit IRC | 19:54 | |
| *** brault has joined #oooq | 20:20 | |
| *** brault has quit IRC | 20:24 | |
| *** chem has quit IRC | 20:28 | |
| *** jtomasek has quit IRC | 20:42 | |
| *** Goneri has joined #oooq | 20:58 | |
| *** dtrainor has quit IRC | 22:04 | |
| *** dtrainor has joined #oooq | 22:04 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!