| *** saneax has quit IRC | 00:18 | |
| *** dsneddon has quit IRC | 01:08 | |
| *** dsneddon has joined #oooq | 01:14 | |
| *** apetrich has quit IRC | 01:57 | |
| *** dsneddon has quit IRC | 02:44 | |
| *** dsneddon has joined #oooq | 02:44 | |
| *** ykarel has joined #oooq | 03:52 | |
| *** dsneddon has quit IRC | 04:11 | |
| *** dsneddon has joined #oooq | 04:16 | |
| *** dsneddon has quit IRC | 04:21 | |
| *** dsneddon has joined #oooq | 04:37 | |
| *** raukadah is now known as chandankumar | 04:51 | |
| *** matbu has joined #oooq | 05:20 | |
| *** quiquell has joined #oooq | 05:31 | |
| *** marios has joined #oooq | 05:38 | |
| *** ykarel is now known as ykarel|afk | 05:47 | |
| *** dtantsur|afk is now known as dtantsur | 05:52 | |
| *** skramaja has joined #oooq | 05:54 | |
| *** dsneddon has quit IRC | 06:05 | |
| *** kopecmartin|off is now known as kopecmartin | 06:09 | |
| *** matbu has quit IRC | 06:11 | |
| *** matbu has joined #oooq | 06:16 | |
| *** dsneddon has joined #oooq | 06:20 | |
| *** dsneddon has quit IRC | 06:25 | |
| *** dsneddon has joined #oooq | 06:46 | |
| *** dsneddon has quit IRC | 06:51 | |
| *** ykarel|afk has quit IRC | 06:52 | |
| *** ykarel has joined #oooq | 06:54 | |
| *** bogdando has joined #oooq | 06:54 | |
| *** apetrich has joined #oooq | 06:57 | |
| *** dsneddon has joined #oooq | 06:59 | |
| *** tesseract has joined #oooq | 07:12 | |
| *** saneax has joined #oooq | 07:14 | |
| *** dsneddon has quit IRC | 07:17 | |
| *** ccamacho has quit IRC | 07:24 | |
| *** ccamacho has joined #oooq | 07:24 | |
| chandankumar | marios: Good morning | 07:29 |
|---|---|---|
| chandankumar | marios: https://review.opendev.org/#/c/643731/ RHEL-8 bit for disk image builder will merge today \o/ | 07:29 |
| marios | chandankumar: cool we can consider switching to it then | 07:30 |
| chandankumar | marios: yes, we can check with jpena|off then how to perform that switch | 07:31 |
| marios | chandankumar: well i think sf folks might need to make it available first for sf | 07:31 |
| marios | chandankumar: but otherwise for us its a simple switch | 07:31 |
| marios | chandankumar: 'simple' assuming it works | 07:31 |
| marios | chandankumar: but we just need to change the nodeset used sec leme fetch link | 07:31 |
| *** tosky has joined #oooq | 07:33 | |
| marios | chandankumar: here https://code.engineering.redhat.com/gerrit/gitweb?p=openstack/tripleo-ci-internal-jobs.git;a=blob;f=zuul.d/nodesets.yaml;h=464ad40890e769dfcc93656332d360929e87b763;hb=refs/heads/master#l78 | 07:33 |
| marios | chandankumar: i set it to use cloud-rhel-8 but we will have to switch that with https://code.engineering.redhat.com/gerrit/#/c/167633/ | 07:34 |
| marios | chandankumar: ie. add a new upstream-rhel-8 to point to nir's new element and witch to using it in the nodeset label | 07:34 |
| marios | chandankumar: but let it merg first :D | 07:34 |
| chandankumar | marios: yes,:-) | 07:35 |
| *** holser_ has joined #oooq | 07:51 | |
| *** dsneddon has joined #oooq | 08:10 | |
| *** dsneddon has quit IRC | 08:17 | |
| *** derekh has joined #oooq | 08:40 | |
| *** ykarel is now known as ykarel|lunch | 09:07 | |
| *** dsneddon has joined #oooq | 09:14 | |
| *** panda is now known as panda|ruck | 09:24 | |
| *** ykarel|lunch is now known as ykarel | 09:39 | |
| ykarel | panda|ruck, can u please review https://review.opendev.org/#/c/662021/ | 09:43 |
| panda|ruck | ykarel: where are we doing docker-login there ? | 09:49 |
| ykarel | panda|ruck, in promotion jobs | 09:49 |
| ykarel | after building containers using that role | 09:50 |
| panda|ruck | I keep forgetting the double and triple inheritance paths we have | 09:51 |
| panda|ruck | ykarel: are we using ansible 2.8 in every zuul now ? | 09:51 |
| panda|ruck | ykarel: even downstream ? | 09:52 |
| ykarel | panda|ruck, for upstream, ansible-2.8 is not used currently as we reverted | 09:52 |
| ykarel | panda|ruck, and in downstream afaik ansible-2.8 is used | 09:52 |
| panda|ruck | ykarel: anyway, I would probably put a similar task just before the docker-login just in case, or any other parts that need to install ansible will hit this problem, anyway, let me check something, then I'll +W | 09:53 |
| ykarel | panda|ruck, docker_login there don't need explicit ansible | 09:54 |
| ykarel | as ansible running in zuul takes care of it | 09:54 |
| ykarel | panda|ruck, yes please check | 09:54 |
| panda|ruck | ykarel: APPROVED | 09:55 |
| panda|ruck | now, let me check why stain and rocky are 2 days behind ... | 09:56 |
| ykarel | panda|ruck, Thanks, i will try to get ansible 2.8 on Monday in RDO Train | 09:56 |
| ykarel | will keep u posted | 09:56 |
| panda|ruck | choo chooo | 09:56 |
| panda|ruck | all aboard! | 09:56 |
| panda|ruck | ansible!!! you're always late! | 09:57 |
| marios | panda|ruck: stein is blocked on merging that 2comp stuff from chandankumar (reminder) 12:56 < panda|ruck> now, let me check why stain and rocky are 2 days behind ... | 09:59 |
| chandankumar | rocky broken | 10:05 |
| chandankumar | virtual interface creation failed | 10:05 |
| chandankumar | filling a bug | 10:05 |
| panda|ruck | chandankumar: marios wow, can you guys fix my internet too ? | 10:07 |
| chandankumar | marios: panda|ruck https://bugs.launchpad.net/tripleo/+bug/1831223 | 10:17 |
| openstack | Launchpad bug 1831223 in tripleo "[rocky][fs020] test_resize_server_revert_with_volume_attached and test_show_update_rebuild_list_server failing after moving to 2 compute nodes" [Critical,Triaged] | 10:17 |
| *** dsneddon has quit IRC | 10:19 | |
| rfolco | cannot access repos from containers, any ideas on what is missing here ? https://sf.hosted.upshift.rdu2.redhat.com/logs/32/171832/10/check/periodic-tripleo-build-containers-rhel-7-rocky-push/211d212/job-output.txt.gz#_2019-05-30_17_21_23_959047 | 10:20 |
| rfolco | does anybody have any ideas ? see my debugging tasks on firewall and selinux... missing a forwarding rule for port 80:80 maybe ? | 10:22 |
| panda|ruck | rfolco: reldel has no idea either ? | 10:22 |
| rfolco | panda|ruck, this is container thing not rhel, so I am not sure what to ask there | 10:23 |
| rfolco | panda|ruck, connection works well outside the container | 10:23 |
| chandankumar | marios: https://bugs.launchpad.net/tripleo/+bug/1831223 any other places to look for why vnc creation is failing? | 10:23 |
| openstack | Launchpad bug 1831223 in tripleo "[rocky][fs020] test_resize_server_revert_with_volume_attached and test_show_update_rebuild_list_server failing after moving to 2 compute nodes with Virtual Interface creation failed" [Critical,Triaged] | 10:23 |
| chandankumar | or is it something related to this 'Signature verification for the image failed: Required image properties for signature verification do not exist. Cannot verify signature. Missing property: img_signature_hash_method.? | 10:24 |
| rfolco | I guess repo tries to ack connection back to base container, and the package never arrives... the host is probably not forwarding to container | 10:24 |
| panda|ruck | rfolco: "Connection reset by peer" is the TCP/IP equivalent of slamming the phone back on the hook. It's more polite than merely not replying, leaving one hanging. But it's not the FIN-ACK expected of the truly polite TCP/IP converseur. | 10:25 |
| panda|ruck | rfolco: someone is replying, but it's giving you the finger. | 10:26 |
| panda|ruck | what changed in the images ? did you ask nhicher ? | 10:26 |
| rfolco | panda|ruck, I'll talk to him... that's weird as the job worked before. | 10:28 |
| rfolco | panda|ruck, so who in rhos-delivery is the contact for asking this? | 10:28 |
| panda|ruck | rfolco: I think amoralej|off could have helped. | 10:29 |
| panda|ruck | dammit PTO | 10:29 |
| * panda|ruck shakes fist | 10:29 | |
| rfolco | panda|ruck, :-/ | 10:31 |
| panda|ruck | rfolco: ask generally there, but also nhicher to undestand what changed on the host image | 10:32 |
| chandankumar | panda|ruck: added the above rocky failure bug as a promotion blocker | 10:33 |
| ykarel | chandankumar, does barbican runs in fs020? iirc it's not runs | 10:41 |
| ykarel | just saw ur comment in bug | 10:42 |
| chandankumar | ykarel: the above failed tests was passing earlier now it is failing | 10:43 |
| chandankumar | ykarel: as per error message it is used with barbican, glance , nova | 10:43 |
| ykarel | chandankumar, agree on that part, my concern was only regarding ur comment that mentioned barbican | 10:43 |
| ykarel | so earlier: SKIPPED: Resize not available | 10:45 |
| ykarel | looking test_resize_server_revert_with_volume_attached | 10:46 |
| chandankumar | ykarel: readded the comment | 10:47 |
| panda|ruck | arxcruz: ping | 10:47 |
| ykarel | chandankumar, ack | 10:51 |
| chandankumar | panda|ruck: arxcruz is on PTO today! | 10:53 |
| panda|ruck | dammit PTO | 11:00 |
| * panda|ruck shakes fist | 11:01 | |
| derekh | panda|ruck: so I've tried a few times to reproduce that scenario012 job with the reproducer script, but each time standalone.sh is created without "-e /usr/share/openstack-tripleo-heat-templates/ci/environments/scenario012-standalone.yaml" | 11:08 |
| derekh | panda|ruck: so its not attempting the ironic parts, any ideas? | 11:08 |
| derekh | panda|ruck: If I edit the file and manually run standalone.sh a second time once its finished will that work? | 11:09 |
| panda|ruck | derekh: I'm not sure, never tried. You tried wtih the legacy reproducer, right ? | 11:11 |
| ykarel | iirc old reproducer do not work with custom standalone scenarios, u using deprecated reproducer? | 11:11 |
| derekh | panda|ruck: yup, I guess so, should I use this one? http://logs.openstack.org/45/661945/2/check/tripleo-ci-centos-7-scenario012-standalone/74abc0d/logs/reproducer-quickstart/ | 11:13 |
| *** holser_ has quit IRC | 11:13 | |
| *** holser_ has joined #oooq | 11:14 | |
| panda|ruck | derekh: that's still WIP, but it may work for you. It's a bit more demanding as it will create a local version of zuul, which you need to contact to see the logs. | 11:15 |
| derekh | panda|ruck: ok, before I try it is there a reproducer that isn't WIP or legacy ? | 11:16 |
| panda|ruck | derekh: .... no | 11:16 |
| derekh | panda|ruck: ok, will give it a go so | 11:17 |
| ykarel | derekh, in case u are looking to fix the current error with scenario012, i think i know the issue | 11:17 |
| ykarel | i mean ERROR: Property error: resources.AllNodesDeploySteps<file:///home/zuul/tripleo-heat-installer-templates/common/post.yaml>.resources.StandaloneExtraConfigPost.properties: Unknown Property EndpointMap | 11:17 |
| panda|ruck | ykarel: multinode or standalon ? | 11:18 |
| ykarel | panda|ruck, /me looking standalone | 11:18 |
| derekh | ykarel: yup, trying to fix scenario012, but trying to reproduce it first as I've no idea what it does these days | 11:18 |
| ykarel | derekh, ack to reproduce and fix as there may be other issues as well | 11:19 |
| ykarel | derekh, for current issue https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/releasenotes/notes/endpointmap-8825fcd5fa5a2ba2.yaml will help | 11:20 |
| ykarel | scenario12 have OS::TripleO::NodeExtraConfigPost: ../common/ironic_standalone_post.yaml | 11:20 |
| ykarel | and ^^ don't have EndpointMap defined | 11:20 |
| derekh | ykarel: got it, thanks | 11:21 |
| *** dsneddon has joined #oooq | 12:00 | |
| *** saneax has quit IRC | 12:11 | |
| *** saneax has joined #oooq | 12:16 | |
| *** openstack has joined #oooq | 12:26 | |
| *** ChanServ sets mode: +o openstack | 12:26 | |
| *** hrybacki has joined #oooq | 12:26 | |
| *** rlandy has joined #oooq | 12:41 | |
| rfolco | rlandy, panda|ruck good news, staging server test works ! image uploaded !! http://38.145.34.106/images/rhel7/rocky/rdo_trunk/tripleo-ci-testing/ | 12:45 |
| zbr | marios: weshay : how am I supposed to fix http://logs.openstack.org/65/649965/31/check/openstack-tox-py35/24d1759/tox/reports.html ? | 12:46 |
| zbr | that image does not exist | 12:46 |
| rlandy | rfolco: nice! | 12:46 |
| panda|ruck | ykarel: now that the ipconflict alert seems to be working, all my tests are passing | 12:47 |
| ykarel | panda|ruck, :( | 12:48 |
| ykarel | it may take many retries | 12:48 |
| ykarel | how many times u retried? | 12:48 |
| panda|ruck | ykarel: so it's probably related to load ... in the last two days it's been very quiet | 12:48 |
| weshay | zbr we can remove the image vars or the image testing from f28 release files | 12:49 |
| panda|ruck | ykarel: 4 * 10 jobs. I had some failure, but for other issues. | 12:49 |
| weshay | no images will be created | 12:49 |
| weshay | ykarel++ | 12:49 |
| *** Goneri has joined #oooq | 12:49 | |
| weshay | thanks for catching the issue w/ modify-image I was only looking at f28 :( | 12:49 |
| ykarel | panda|ruck, i see a failure in ur rdo test patch https://logs.rdoproject.org/12/20912/4/check/ipconflict-test8/2b2e95b/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 12:50 |
| marios | zbr: ack ok maybe we can skip some at least for that review ? or what weshay said about fixing the files /comment out that bit (same as skip i guess) | 12:50 |
| ykarel | weshay, np | 12:50 |
| rlandy | panda|ruck: marios: sshnaidm: weshay: I sent you you all email re: rights on internal repos. Please read and respond. thanks | 12:51 |
| panda|ruck | ykarel: ah shoot, then the alert doesn't work yet | 12:52 |
| ykarel | panda|ruck, hmm possible | 12:52 |
| rlandy | weshay: hey - can you sync some time re: container updates reviews | 12:52 |
| marios | rlandy: ack | 12:53 |
| zbr | marios: weshay: i do really want to avoid adding skips. is it possible to remove the file itself? config/release/tripleo-ci/Fedora-28/promotion-testing-hash-stein.yml --- or at least to patch the broken value to point to something that exists. | 12:54 |
| rlandy | chandankumar: thanks for your review on the logs move - just fixing the linter error. I'd like to give this a try on monday and see what damage we cause | 12:54 |
| zbr | .... and that is bit interesting because I am 100% sure all these passed, so the images were removed at some point. apparently all fedora28 release configs are broken. | 12:56 |
| panda|ruck | ykarel: .... of course ... | 12:56 |
| panda|ruck | ykarel: I'm an idiot | 12:56 |
| panda|ruck | ykarel: how can the system send an alert if the network is not up | 12:56 |
| panda|ruck | we are doomed | 12:56 |
| panda|ruck | there's no way to get a real time alert there. | 12:57 |
| ykarel | panda|ruck, but main network which routes should be up, no? | 12:58 |
| ykarel | ctlplane network i mean | 12:58 |
| panda|ruck | ykarel: I don't think so | 12:58 |
| panda|ruck | ykarel: mmmhh | 12:58 |
| panda|ruck | ykarel: probably not, it's always eth1 that fails | 12:59 |
| chandankumar | weshay: meeting time? | 13:01 |
| panda|ruck | dammit | 13:01 |
| panda|ruck | back to square one | 13:02 |
| chandankumar | weshay: we cancelled the meeting since arxcruz is not around also. | 13:04 |
| marios | well, FWIW it's ready, at least, i'm done with it. i will definitely use it, maybe its useful for anyone else :D thanks for the suggestions from tuesday. Now also supports internal SF jobs https://github.com/marios/tripleo_ruck_job_tool | 13:16 |
| ykarel | panda|ruck, sorry /me confused :( | 13:19 |
| panda|ruck | ykarel: what confuses you ? | 13:20 |
| ykarel | panda|ruck, 1st I don't think so and then probably not, it's always eth1 that fails | 13:20 |
| *** dsneddon has quit IRC | 13:22 | |
| panda|ruck | ykarel: I don't know the mapping, but I think in the overcloud nodes eth1 is the default route interface. And it always fail there. | 13:31 |
| ykarel | panda|ruck, hmm default via 10.0.0.1 dev br-ex | 13:35 |
| ykarel | panda|ruck, but, default via 192.168.24.1 dev eth0 | 13:37 |
| ykarel | so in the node that failed has route via eth0 | 13:37 |
| ykarel | me looking https://logs.rdoproject.org/12/20912/4/check/ipconflict-test8/2b2e95b/logs/overcloud-novacompute-0/var/log/extra/network.txt.gz | 13:37 |
| *** vinaykns has joined #oooq | 13:39 | |
| chandankumar | marios: panda|ruck regarding fs020 jobs it is looking good | 13:41 |
| marios | chandankumar: you mean that ? https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-queens ? | 13:43 |
| chandankumar | marios: yes | 13:43 |
| chandankumar | marios: rocky and queens issues are known | 13:43 |
| chandankumar | marios: for rocky I need help from nova, glance people | 13:44 |
| chandankumar | marios: abishop will be going to work for queens on monday | 13:44 |
| panda|ruck | ykarel: then it's dns | 13:44 |
| chandankumar | marios: on weekends, we will get master and stein promotions so asking | 13:47 |
| panda|ruck | ykarel: retrying with direct ip | 13:47 |
| ykarel | panda|ruck, ack, but dns should have worked | 13:49 |
| ykarel | i see https://logs.rdoproject.org/12/20912/4/check/ipconflict-test8/2b2e95b/logs/overcloud-novacompute-0/etc/resolv.conf.txt.gz | 13:49 |
| panda|ruck | ykarel: Error is consistent with unresolved name. without the route it would have said "Network unreachable". Not sure why the NDS is not ready at the point, but maybe only by the time we collect the file, the dns has been set up. | 13:52 |
| chandankumar | ykarel: marios we are seeing the same set of tests failure on downstream also on RHOS15 | 13:59 |
| chandankumar | which is coming on rocky | 13:59 |
| chandankumar | ykarel: marios https://docs.google.com/spreadsheets/d/1HMdPAiohKEfSeIosz0RzFBjdf4Qc9fZiuFIfjBzEQwc/edit#gid=1170071847 | 13:59 |
| chandankumar | check round 5 | 13:59 |
| chandankumar | zbr: time for honey badger call | 14:01 |
| *** dsneddon has joined #oooq | 14:04 | |
| ykarel | chandankumar, nice, same symptoms? | 14:05 |
| zbr | panda|ruck: i see some failures to pull images on http://logs.openstack.org/65/649965/32/check/tripleo-ci-fedora-28-standalone/8d42bef/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz --- it was working fine previously. is this a known issue? | 14:05 |
| ykarel | chandankumar, and good to see same releases, osp15 compare with stein | 14:06 |
| ykarel | panda|ruck, ack | 14:07 |
| chandankumar | ykarel: poked on the call | 14:15 |
| chandankumar | ykarel: may be we will get the solution by monday | 14:15 |
| chandankumar | ykarel: on stein it is passing | 14:15 |
| ykarel | chandankumar, ack | 14:17 |
| chandankumar | marios: panda|ruck I am logging out, see ya on monday | 14:17 |
| panda|ruck | chandankumar: holiday here on monday | 14:18 |
| panda|ruck | chandankumar: have a nice weekend | 14:18 |
| chandankumar | same to you, thanks ! | 14:18 |
| *** chandankumar is now known as raukadah | 14:18 | |
| marios | panda|ruck: (i think the answer is no but worth trying again) - anywhere you are tracking since i have to pickup on monday? | 14:19 |
| marios | panda|ruck: maybe add a note in https://etherpad.openstack.org/p/ruckroversprint10 for any things that might need urgent attention | 14:20 |
| *** openstackstatus has joined #oooq | 14:29 | |
| *** ChanServ sets mode: +v openstackstatus | 14:29 | |
| -openstackstatus- NOTICE: The Gerrit service at https://review.opendev.org/ will be offline briefly for maintenance starting at 15:00 UTC (roughly 30 minutes from now); for details see http://lists.openstack.org/pipermail/openstack-discuss/2019-May/006684.html | 14:30 | |
| zbr | marios: panda|ruck : when you have time, please check this refactoring on how tempest package names are loaded, making is much easier to maintain: https://review.opendev.org/#/c/661994/ (low prio) | 14:32 |
| *** skramaja has quit IRC | 14:34 | |
| ykarel | panda|ruck, marios can u check https://review.rdoproject.org/r/#/c/20919/ | 14:42 |
| ykarel | weshay, ^^ | 14:43 |
| derekh | panda|ruck: WIP reproducer wont work either, all kinds for problems with different versions of ansible being installed by both yum and pip :-( | 14:46 |
| derekh | panda|ruck: I guess next best option would be to follow this doc? http://tripleo.org/install/containers_deployment/standalone.html | 14:46 |
| panda|ruck | derekh: :( | 14:46 |
| panda|ruck | derekh: yep manual install of standalone passing scenario012 | 14:47 |
| derekh | ack | 14:47 |
| *** Vorrtex has joined #oooq | 14:47 | |
| marios | ack zbr ykarel looking | 14:47 |
| panda|ruck | derekh: thanks for taking the time | 14:48 |
| derekh | panda|ruck: no prob | 14:48 |
| panda|ruck | marios: on chandan's patch is mostly your clal at this point, if promotion fails on the weekend, the dashboard might get yellow on monday | 14:48 |
| ykarel | derekh, u can try old reproducer + hacking /opt/stack/tripleo-quickstart-extras | 14:50 |
| ykarel | standalone.sh template | 14:50 |
| derekh | ykarel: I already tried that, the change I hacked in didn't get picker up, I was left thinking there is another version of t-q-e clone onto the CI node | 14:51 |
| derekh | ykarel: so I guess I'd have to pause the process half way and then change the template before allowing it to continue | 14:51 |
| derekh | I'll try that next if I don't make any progress manually installing it | 14:52 |
| ykarel | derekh, ack, did u also git committed it? | 14:52 |
| ykarel | ur change under /opt/stack/tripleo-quickstart-extras | 14:52 |
| derekh | it commited it, but it wasn't in /opt/stack/tripleo-quickstart-extras it was in <local_workspace>/t-q-e on the machine where I ran reproducer.sh | 14:53 |
| *** ykarel is now known as ykarel|away | 14:53 | |
| ykarel|away | derekh, u need to do on the undercloud node | 14:54 |
| ykarel|away | where u source env_vars | 14:54 |
| ykarel|away | and run/opt/stack/tripleo-ci/toci_gate_test.sh | 14:55 |
| derekh | ok, thanks, will do | 14:55 |
| zbr | i am wondering why ansible team decided that dash character is invalid for group names.... | 14:59 |
| panda|ruck | zbr: maybe to follow python variable naming ? | 15:02 |
| zbr | for hosts I can understand as hash is not supported by hostnames, on the other hand for DNS entries it is the opposite | 15:04 |
| -openstackstatus- NOTICE: Gerrit is now entering its maintenance window. Expect Gerrit outages in the near future. We will notify when it is back up and running. | 15:04 | |
| zbr | i seen people starting to use the dot instead, like instead of controversial "foo-bar" or "foo_bar",... I seen groups like "foo.bar" | 15:04 |
| *** ChanServ changes topic to "Gerrit is now entering its maintenance window. Expect Gerrit outages in the near future. We will notify when it is back up and running." | 15:04 | |
| *** jaosorior has quit IRC | 15:22 | |
| * marios shutdown sequence | 15:23 | |
| *** dsneddon has quit IRC | 15:28 | |
| rlandy | panda|ruck: have you noticed any slow down in the ovb promotion job running times | 15:29 |
| rlandy | master particularly | 15:29 |
| raukadah | rlandy: we have updated the tempest skip list and moved to 2 controller jobs so fs020/fs021 timing has increased | 15:29 |
| rlandy | raukadah: I see it timeouts on the baremetal job the last two times it ran | 15:30 |
| rlandy | timeout while running tempest | 15:30 |
| rlandy | when did this change merge? | 15:30 |
| rlandy | the job is clearly on the border of the time limit | 15:31 |
| rlandy | the b, job | 15:31 |
| rlandy | bm | 15:31 |
| raukadah | rlandy: https://review.rdoproject.org/r/#/c/20898/ | 15:31 |
| raukadah | these are ovb jobs | 15:32 |
| rlandy | 2019-05-30 06:33:21.380562 | primary | TASK [validate-tempest : Execute tempest] ************************************** | 15:33 |
| rlandy | 2019-05-30 06:33:21.502984 | primary | Thursday 30 May 2019 06:33:21 +0000 (0:00:00.195) 0:01:11.293 ********** | 15:33 |
| rlandy | 2019-05-30 06:32:21.857580 | RUN END RESULT_TIMED_OUT: [untrusted : opendev.org/openstack/tripleo-ci/playbooks/tripleo-ci/run-v3.yaml@master] | 15:33 |
| rlandy | 2019-05-30 06:32:21.857926 | POST-RUN START: [trusted : code.engineering.redhat.com/openstack/tripleo-ci-internal-config/playbooks/dlrn/post-dlrn.yaml@master] | 15:33 |
| rlandy | ^^ after that change merged | 15:33 |
| rlandy | I think I just need to increase the job times | 15:33 |
| rlandy | these jobs are going to run for 5 hours | 15:33 |
| *** dsneddon has joined #oooq | 15:33 | |
| raukadah | rlandy: lots of tests got unskipped from stein | 15:34 |
| raukadah | also that's why may be? | 15:34 |
| rlandy | raukadah: stein just ran and passed ... | 15:34 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/stream/3707b7a929794e00ac3a368eb52ecccc?logfile=console.log | 15:34 |
| rlandy | so that one made it in under the time limit | 15:34 |
| rlandy | master has been running out of time | 15:35 |
| rlandy | it's obviously border line | 15:35 |
| rlandy | there was one pass on 05/29 | 15:36 |
| panda|ruck | rlandy: not particularly, do we monitor that somewhere ? | 15:36 |
| rlandy | panda|ruck: we should | 15:36 |
| rlandy | which is why I am trying to get perf tests going | 15:36 |
| raukadah | rlandy: https://opendev.org/openstack/tripleo-quickstart-extras/commit/85bba9f24a79da8069d5d0b4a7515dd62893e202 | 15:36 |
| raukadah | rlandy: few scenario tests got added | 15:36 |
| rlandy | raukadah: I am just going to increase the job times | 15:37 |
| raukadah | rlandy: ack! | 15:37 |
| rlandy | there is no better solution as I see it | 15:37 |
| rlandy | thanks | 15:37 |
| panda|ruck | alert system still doesn't work ... :( | 15:41 |
| panda|ruck | dammit | 15:41 |
| panda|ruck | ykarel|away: now it's "no route to host" | 15:41 |
| panda|ruck | ykarel|away: If the network is not ready at the point , I really don't know what could we do to send an alert | 15:42 |
| *** marios has quit IRC | 15:47 | |
| *** dsneddon has quit IRC | 15:49 | |
| zbr | panda|ruck: is extra validation really mandatory for https://review.opendev.org/#/c/652971/ ? -- i am inclined to defer it for a follow-up | 15:52 |
| *** quiquell has quit IRC | 15:52 | |
| *** ChanServ changes topic to "Docs: https://docs.openstack.org/tripleo-quickstart/latest/" | 15:58 | |
| *** rlandy is now known as rlandy|brb | 16:02 | |
| rfolco | aaarrggg taiga eats some lines in html mode | 16:05 |
| *** kopecmartin is now known as kopecmartin|off | 16:10 | |
| *** dsneddon has joined #oooq | 16:20 | |
| *** dtantsur is now known as dtantsur|afk | 16:22 | |
| *** bogdando has quit IRC | 16:25 | |
| *** dsneddon has quit IRC | 16:28 | |
| *** aakarsh|2 is now known as aakarsh | 16:33 | |
| *** rlandy|brb is now known as rlandy | 16:45 | |
| -openstackstatus- NOTICE: Gerrit is back up and running again. Thank you for your patience and sorry for the delay in this notification (we thought the statusbot was still busy updating channel topics). | 16:45 | |
| *** dsneddon has joined #oooq | 16:55 | |
| *** derekh has quit IRC | 17:00 | |
| ykarel|away | panda|ruck, mmm | 17:34 |
| ykarel|away | panda|ruck, so i saw the script | 17:34 |
| ykarel|away | if curl https://bootstrap.pypa.io/get-pip.py -o /tmp/get-pip.py is working | 17:34 |
| ykarel|away | means internet connectivity is there | 17:34 |
| ykarel|away | or ^^ only failed | 17:35 |
| ykarel|away | okk will check on Monday if i can get something | 17:52 |
| *** jschluet is now known as jschlueter | 17:56 | |
| *** holser_ is now known as holser|weekend | 17:57 | |
| *** holser|weekend has quit IRC | 17:57 | |
| *** panda|ruck has quit IRC | 17:59 | |
| *** panda has joined #oooq | 18:01 | |
| *** tesseract has quit IRC | 18:04 | |
| *** tosky has quit IRC | 18:09 | |
| *** ykarel|away has quit IRC | 18:15 | |
| rfolco | rlandy, could you please merge https://code.engineering.redhat.com/gerrit/#/c/172108/ and https://code.engineering.redhat.com/gerrit/#/c/172109/ ? The second I fixed linters (moved tar shell to archive module) | 18:43 |
| rlandy | looking | 18:44 |
| rlandy | rfolco: first one merged ... wrt second one .. | 18:45 |
| rlandy | left one question | 18:46 |
| rlandy | not sure what the second condition is for | 18:46 |
| rlandy | rfolco: if you can comment on above will vote again | 18:47 |
| rfolco | rlandy, see if makes sense. If not, I'll find a better solution. | 18:51 |
| rlandy | rfolco: ok - I see - approved | 18:52 |
| rfolco | rlandy, thanks, I don't think this breaks anything. Will iterate over the job and consolidate all the pieces when I get the core running... | 18:53 |
| rlandy | k | 18:53 |
| *** saneax has quit IRC | 19:04 | |
| rfolco | rlandy, did you submit? | 19:05 |
| rfolco | https://code.engineering.redhat.com/gerrit/#/c/172109/ | 19:05 |
| *** dtrainor has quit IRC | 19:10 | |
| rfolco | rlandy, please submit https://code.engineering.redhat.com/gerrit/#/c/172109/ | 19:20 |
| rlandy | rfolco: weird - I w+'ed it | 19:26 |
| rlandy | Rafael Folco | 19:27 |
| rlandy | Topic changed from rdo-rhel-container-push to rdo-rhel-image-upload | 19:27 |
| rlandy | 3:06 PM | 19:27 |
| rlandy | rfolco: I rechecked it | 19:28 |
| rfolco | rlandy, thx | 19:28 |
| *** dtrainor has joined #oooq | 19:33 | |
| rlandy | rfolco: not sure what's up with that review | 19:35 |
| rfolco | rlandy, ci? | 19:35 |
| rlandy | oh - tests are running I think | 19:35 |
| rfolco | linters is voting | 19:35 |
| rfolco | 3 tests are non-voting and take hours to run | 19:35 |
| rfolco | dammn | 19:35 |
| rlandy | no - it didn;t say running tests | 19:35 |
| rlandy | rfolco: but I think it is | 19:38 |
| rfolco | rlandy, https://code.engineering.redhat.com/gerrit/#/c/172109/ can merge now ? | 20:04 |
| rlandy | done | 20:05 |
| rfolco | rlandy, cool thank you | 20:06 |
| *** Vorrtex has quit IRC | 20:28 | |
| *** rfolco has quit IRC | 20:45 | |
| rlandy | weshay: you available for 5 minutes? | 20:57 |
| *** vinaykns has quit IRC | 21:01 | |
| *** jtomasek has quit IRC | 21:37 | |
| *** dsneddon has quit IRC | 21:53 | |
| *** dsneddon has joined #oooq | 22:17 | |
| *** dsneddon has quit IRC | 22:23 | |
| *** rlandy has quit IRC | 22:32 | |
| *** dsneddon has joined #oooq | 23:03 | |
| *** panda has quit IRC | 23:37 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!