| *** panda has quit IRC | 01:03 | |
| *** panda has joined #oooq | 01:05 | |
| *** apetrich has quit IRC | 01:57 | |
| *** rlandy has quit IRC | 02:34 | |
| *** rfolco has quit IRC | 02:47 | |
| *** skramaja has joined #oooq | 02:55 | |
| *** aakarsh has joined #oooq | 03:09 | |
| *** udesale has joined #oooq | 03:56 | |
| *** ykarel|away has joined #oooq | 04:01 | |
| *** ykarel|away is now known as ykarel | 04:06 | |
| *** ykarel has quit IRC | 04:17 | |
| *** ykarel has joined #oooq | 04:38 | |
| *** saneax has joined #oooq | 04:52 | |
| *** marios has joined #oooq | 05:13 | |
| *** saneax has quit IRC | 05:14 | |
| *** ratailor has joined #oooq | 05:23 | |
| *** ratailor_ has joined #oooq | 05:29 | |
| *** ykarel_ has joined #oooq | 05:30 | |
| *** ratailor has quit IRC | 05:32 | |
| *** ykarel has quit IRC | 05:32 | |
| *** udesale has quit IRC | 05:38 | |
| *** ykarel_ has quit IRC | 05:41 | |
| *** ratailor_ has quit IRC | 05:41 | |
| *** ykarel has joined #oooq | 05:44 | |
| *** ratailor has joined #oooq | 05:47 | |
| *** holser_ has joined #oooq | 05:47 | |
| *** aakarsh has quit IRC | 06:05 | |
| *** apetrich has joined #oooq | 06:42 | |
| *** slaweq has joined #oooq | 06:46 | |
| *** holser_ has quit IRC | 06:47 | |
| *** tosky has joined #oooq | 07:20 | |
| *** tesseract has joined #oooq | 07:21 | |
| *** amoralej|off is now known as amoralej | 07:37 | |
| marios | https://review.opendev.org/#/c/667966/ reviews appreciated folks moves playbooks/tripleo-buildimage to a role part of https://tree.taiga.io/project/tripleo-ci-board/us/1100 ( https://tree.taiga.io/project/tripleo-ci-board/task/1144 ) pretty please thank you ! | 07:50 |
|---|---|---|
| *** holser_ has joined #oooq | 08:03 | |
| *** saneax has joined #oooq | 08:05 | |
| *** holser__ has joined #oooq | 08:05 | |
| *** holser__ has quit IRC | 08:05 | |
| *** holser__ has joined #oooq | 08:06 | |
| *** holser_ has quit IRC | 08:07 | |
| *** ratailor_ has joined #oooq | 08:10 | |
| *** ratailor has quit IRC | 08:12 | |
| *** ykarel has quit IRC | 08:13 | |
| *** ratailor__ has joined #oooq | 08:13 | |
| *** ykarel has joined #oooq | 08:15 | |
| *** ykarel is now known as ykarel|lunch | 08:15 | |
| *** ratailor_ has quit IRC | 08:16 | |
| *** ratailor_ has joined #oooq | 08:16 | |
| *** ratailor__ has quit IRC | 08:19 | |
| *** ykarel has joined #oooq | 08:36 | |
| *** ykarel|lunch has quit IRC | 08:36 | |
| *** bogdando has joined #oooq | 08:42 | |
| *** ykarel_ has joined #oooq | 08:51 | |
| *** ykarel has quit IRC | 08:54 | |
| *** tesseract-RH has joined #oooq | 08:57 | |
| *** tesseract has quit IRC | 08:58 | |
| *** udesale has joined #oooq | 09:04 | |
| *** ratailor_ has quit IRC | 09:05 | |
| *** ratailor has joined #oooq | 09:07 | |
| *** sshnaidm|afk is now known as sshnaidm|ruck | 09:19 | |
| marios | brb | 09:23 |
| *** marios has quit IRC | 09:23 | |
| *** fmount has quit IRC | 09:23 | |
| *** ykarel_ is now known as ykarel | 09:27 | |
| *** tesseract-RH has quit IRC | 09:29 | |
| *** tesseract has joined #oooq | 09:29 | |
| *** marios has joined #oooq | 09:30 | |
| *** fmount has joined #oooq | 09:31 | |
| marios | sshnaidm|ruck: /anyone else did the vpn die for you too? /me can't get back on tried a few ams/brq/tlv | 09:31 |
| marios | &fab | 09:31 |
| *** tesseract has quit IRC | 09:33 | |
| *** tesseract has joined #oooq | 09:33 | |
| sshnaidm|ruck | marios, for me works via tlv, but Tengu says it doesn't for him | 09:34 |
| Tengu | amsterdam and brno are down to me | 09:34 |
| Tengu | will send a mail to outage... | 09:35 |
| sshnaidm|ruck | connect to tlv all | 09:37 |
| Tengu | ah, apparently SSO internal server error. | 09:37 |
| sshnaidm|ruck | so it will fall down because of load) | 09:37 |
| *** tesseract has quit IRC | 09:38 | |
| *** tosky has quit IRC | 09:39 | |
| *** tesseract has joined #oooq | 09:39 | |
| *** tosky has joined #oooq | 09:40 | |
| Tengu | hmm... tlv also not reachable. | 09:41 |
| Tengu | ah. seems to be back. | 09:49 |
| marios | ack thanks Tengu sshnaidm|ruck | 09:51 |
| marios | yah am back on ams now | 09:52 |
| *** marios has quit IRC | 09:52 | |
| *** marios has joined #oooq | 09:53 | |
| chandankumar | marios: Hello | 09:55 |
| chandankumar | marios: How stackrc got generated after undercloud installation finishes using python-tripleoclient? | 09:56 |
| * chandankumar needs to again change the code for clouds.yaml generation | 09:57 | |
| *** skramaja has quit IRC | 10:01 | |
| *** skramaja has joined #oooq | 10:01 | |
| marios | chandankumar: i'd have to dig for that don't remember off hand | 10:02 |
| chandankumar | marios: ack, np :-) | 10:13 |
| marios | chandankumar: let me know if you get stuck i'll go dig but should be fairly obvious under the v1/undercloud or undercluod_config | 10:14 |
| chandankumar | yup on it | 10:16 |
| *** ykarel_ has joined #oooq | 10:25 | |
| panda | https://review.opendev.org/666607 is ready for review | 10:26 |
| *** ykarel has quit IRC | 10:27 | |
| *** udesale has quit IRC | 10:28 | |
| *** udesale has joined #oooq | 10:29 | |
| *** ykarel has joined #oooq | 10:30 | |
| *** ykarel_ has quit IRC | 10:30 | |
| *** ykarel is now known as ykarel|meeting | 10:33 | |
| marios | panda: ack minor comments | 10:40 |
| marios | https://review.opendev.org/#/c/667966/ reviews appreciated folks moves playbooks/tripleo-buildimage to a role part of https://tree.taiga.io/project/tripleo-ci-board/us/1100 ( https://tree.taiga.io/project/tripleo-ci-board/task/1144 ) pretty please thank you ! | 10:40 |
| *** saneax has quit IRC | 10:50 | |
| *** udesale has quit IRC | 10:52 | |
| *** ykarel|meeting is now known as ykarel | 10:54 | |
| *** udesale has joined #oooq | 10:54 | |
| *** udesale has quit IRC | 10:58 | |
| *** udesale has joined #oooq | 10:58 | |
| *** holser__ has quit IRC | 11:00 | |
| *** holser_ has joined #oooq | 11:05 | |
| *** holser_ has quit IRC | 11:07 | |
| *** holser_ has joined #oooq | 11:08 | |
| *** saneax has joined #oooq | 11:17 | |
| *** udesale has quit IRC | 11:19 | |
| *** ratailor has quit IRC | 11:42 | |
| *** ykarel has quit IRC | 11:51 | |
| chandankumar | sshnaidm|ruck: please have a look at this patch https://review.opendev.org/#/c/664586/ depends-on is not getting picked | 12:23 |
| chandankumar | I am not sure what is going wrong there | 12:24 |
| sshnaidm|ruck | chandankumar, looking | 12:24 |
| chandankumar | https://logs.rdoproject.org/86/664586/35/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/c1735c1/job-output.txt.gz | 12:24 |
| sshnaidm|ruck | chandankumar, cannot import name clouds_yaml http://logs.rdoproject.org/86/664586/35/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/c1735c1/logs/delorean_logs/39/6b/396be3c75a11292d9d2c6a478b2078dd031cf744_dev/mock.log.txt.gz | 12:25 |
| chandankumar | sshnaidm|ruck: because the depends-on package tripleo-common does not got built | 12:26 |
| sshnaidm|ruck | chandankumar, dependency is picked, but fails to build | 12:26 |
| chandankumar | sshnaidm|ruck: I am trying the changes the locally it is working fine | 12:26 |
| sshnaidm|ruck | chandankumar, there is a chance that you need firstly to merge tripleo-common patch | 12:27 |
| sshnaidm|ruck | chandankumar, I remember some problems with dependencies and mock tests, tripleo-common is most likely taken from repo package there, not from built | 12:28 |
| chandankumar | last time I testing the integration it was working | 12:29 |
| sshnaidm|ruck | chandankumar, with the same code? | 12:29 |
| chandankumar | since I moved the code from tripleoclient to tripleo-common then it is not picking the clouds_yaml.py script | 12:29 |
| chandankumar | sshnaidm|ruck: yes | 12:30 |
| sshnaidm|ruck | chandankumar, well, as I said it may be taken not from source there | 12:30 |
| chandankumar | is there other way to test it? | 12:31 |
| sshnaidm|ruck | chandankumar, well, it's sure not from source: DEBUG: Verifying : openstack-tripleo-common-11.0.1-0.20190702223345.2ef56 57/173 | 12:32 |
| sshnaidm|ruck | chandankumar, merge you patch into tripleo-common firstly and then try a patch to tripleoclient | 12:32 |
| *** amoralej is now known as amoralej|lunch | 12:32 | |
| sshnaidm|ruck | chandankumar, maybe other tripleo folks have better ideas | 12:32 |
| sshnaidm|ruck | chandankumar, such things is better to discuss on #tripleo | 12:32 |
| chandankumar | sure | 12:33 |
| *** rlandy has joined #oooq | 12:33 | |
| *** udesale has joined #oooq | 13:03 | |
| *** ykarel has joined #oooq | 13:12 | |
| rlandy | chandankumar: hi - thanks for updating the card | 13:22 |
| chandankumar | rlandy: amoralej|lunch is working on creating the endpoint | 13:30 |
| *** skramaja has quit IRC | 13:30 | |
| rlandy | chandankumar: ack - the node is looking good - the error is legit | 13:31 |
| *** amoralej|lunch is now known as amoralej | 13:32 | |
| rlandy | rfolco?? | 13:32 |
| chandankumar | rlandy: https://review.rdoproject.org/r/#/c/21269/ we donot need this review as https://review.rdoproject.org/r/#/c/21293/ is there? | 13:36 |
| rlandy | chandankumar: I duplicated as my reviews originally used the cloud image which was never added to nodepool | 13:37 |
| rlandy | chandankumar: we can sync the two reviews | 13:38 |
| rlandy | we don;t need both | 13:38 |
| chandankumar | rlandy: ok | 13:38 |
| rlandy | hmmm ... I thought we fixed this error | 13:54 |
| chandankumar | rlandy: https://logs.rdoproject.org/70/21270/14/check/periodic-tripleo-ci-rhel-8-standalone-master/7354a27/job-output.txt.gz#_2019-07-03_09_50_39_481206 | 13:55 |
| *** vinaykns has joined #oooq | 13:56 | |
| marios | rlandy: chandankumar rfolco (? out?) zbr lets sync in a minute ? | 13:58 |
| marios | (see calendar for blujeans) | 13:58 |
| chandankumar | marios: yes | 13:58 |
| chandankumar | marios: /me will drop in middle might and rejoin again | 13:58 |
| rlandy | ack | 13:58 |
| marios | ack thanks chandankumar | 13:58 |
| chandankumar | rlandy: i think it needs some fix here https://opendev.org/openstack/tripleo-quickstart/src/branch/master/install-deps.sh#L142 | 14:00 |
| zbr | marios: there is a rhel8 sync | 14:00 |
| marios | zbr: yes | 14:00 |
| *** rfolco has joined #oooq | 14:01 | |
| *** aakarsh has joined #oooq | 14:01 | |
| marios | panda: o/ want to join our call? | 14:03 |
| marios | panda: (nm not important unless you aren't busy thanks we discussed that https://review.opendev.org/#/c/666607 | 14:08 |
| *** jaosorior has quit IRC | 14:20 | |
| chandankumar | rlandy: did I missed anything? | 14:23 |
| rlandy | chandankumar: ack - my whole sob story :) | 14:24 |
| rlandy | chandankumar: anyways, you are right - we need some bindep changes | 14:24 |
| rlandy | will get on it after the meeting | 14:24 |
| chandankumar | rlandy: we can check the the correct images whether rhui repos are enabled or not from a custom playbook | 14:24 |
| chandankumar | in pre-run | 14:24 |
| rlandy | chandankumar: ack - good idea | 14:24 |
| chandankumar | rlandy: but this patch worked https://softwarefactory-project.io/r/#/c/15867/ | 14:25 |
| rlandy | chandankumar: yep - it seems so | 14:25 |
| rlandy | chandankumar: actually this one ... https://softwarefactory-project.io/r/#/c/15868/ | 14:26 |
| chandankumar | rfolco: https://logs.rdoproject.org/70/21270/14/check/periodic-tripleo-ci-rhel-8-standalone-master/7354a27/job-output.txt.gz#_2019-07-03_09_49_38_362330 | 14:31 |
| chandankumar | panda: https://logs.rdoproject.org/70/21270/14/check/periodic-tripleo-ci-rhel-8-standalone-master/7354a27/job-output.txt.gz#_2019-07-03_09_49_38_362330 | 14:33 |
| chandankumar | here can you check here api is getting hitted | 14:34 |
| chandankumar | ? | 14:34 |
| panda | chandankumar: it's not the api there, it's just the https repo | 14:35 |
| chandankumar | panda: ok | 14:36 |
| chandankumar | panda: then amoralej is working for enabling the api endpoint | 14:36 |
| chandankumar | rfolco: : https://review.rdoproject.org/r/#/c/21270/ | 14:44 |
| chandankumar | rlandy: ^^ | 14:44 |
| chandankumar | rlandy: https://softwarefactory-project.io/nodepool-log/upstream-rhel-8-0000000010.log | 14:50 |
| rlandy | marios: http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-master-upload/2217c28/ | 14:56 |
| marios | rlandy: thanks | 14:56 |
| *** PagliaccisCloud has joined #oooq | 14:59 | |
| marios | rlandy: zbr sshnaidm|ruck interview sync ? | 15:00 |
| rlandy | ack | 15:01 |
| *** aakarsh has quit IRC | 15:08 | |
| *** aakarsh has joined #oooq | 15:24 | |
| ykarel | arxcruz|rover, sshnaidm|ruck are u guys aware of the ironic wsgi issue in master periodic | 15:27 |
| ykarel | just noticed tripleo jobs are also affected | 15:28 |
| sshnaidm|ruck | ykarel, not yet | 15:28 |
| sshnaidm|ruck | ykarel, what is that? | 15:28 |
| ykarel | sshnaidm|ruck, https://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset030-master/1f0b1df/logs/undercloud/var/log/extra/podman/containers/container-puppet-ironic_api/stdout.log.txt.gz | 15:29 |
| ykarel | sshnaidm|ruck, all the job which setups ironic container are affected | 15:29 |
| sshnaidm|ruck | omg, all red in promotion | 15:29 |
| ykarel | sshnaidm|ruck, i noticed it in puppet promotion jobs and pushed and have proposed https://review.opendev.org/#/c/668913/ | 15:30 |
| *** PagliaccisCloud has left #oooq | 15:30 | |
| arxcruz|rover | sshnaidm|ruck we needto change the cockpit | 15:31 |
| arxcruz|rover | i saw failure, but the color is not red | 15:31 |
| arxcruz|rover | so i didn't visualize it properly, sorry | 15:31 |
| sshnaidm|ruck | arxcruz|rover, not red? | 15:31 |
| arxcruz|rover | sshnaidm|ruck in the cockpit | 15:31 |
| arxcruz|rover | the rdo jobs failing, are not red | 15:32 |
| sshnaidm|ruck | arxcruz|rover, where? | 15:32 |
| arxcruz|rover | sshnaidm|ruck http://dashboard-ci.tripleo.org/d/cEEjGFFmz/cockpit?orgId=1&fullscreen&panelId=206 | 15:33 |
| arxcruz|rover | for example, in the duration | 15:33 |
| arxcruz|rover | ykarel i'm pinging dmitri to +2 that :) | 15:33 |
| ykarel | arxcruz|rover, one job failed with network error: rax mirror | 15:33 |
| sshnaidm|ruck | arxcruz|rover, well, this is table of failing only | 15:33 |
| ykarel | need to recheck after current job finishes | 15:33 |
| arxcruz|rover | sshnaidm|ruck yes, but i did not pay too much attention, my fault | 15:35 |
| arxcruz|rover | I saw this morning, just checked the fs039 to see if we still facing the failure and completely miss the rest of the jobs... :/ | 15:35 |
| arxcruz|rover | i'll pay more attention next time | 15:35 |
| arxcruz|rover | ykarel i'll create a lp, if you mind then add a closes-bug later | 15:36 |
| rlandy | marios: can you try this line in yiur local rhel8 install: https://opendev.org/openstack/tripleo-quickstart/src/branch/master/install-deps.sh#L126 | 15:36 |
| *** lmiccini has quit IRC | 15:36 | |
| arxcruz|rover | ykarel got +2 from dmitri | 15:37 |
| rlandy | marios: actually - never mind | 15:38 |
| *** Vorrtex has joined #oooq | 15:38 | |
| marios | rlandy: [root@rhel8-1 ~]# dnf search python2-libselinux | 15:39 |
| marios | No matches found. | 15:39 |
| rlandy | fine | 15:39 |
| marios | rlandy: http://paste.openstack.org/show/753834/ | 15:40 |
| arxcruz|rover | ykarel https://bugs.launchpad.net/tripleo/+bug/1835269 | 15:41 |
| openstack | Launchpad bug 1835269 in tripleo "App.wsgi was removed from ironic, and now jobs are failing" [Critical,Triaged] - Assigned to yatin (yatinkarel) | 15:41 |
| arxcruz|rover | sshnaidm|ruck https://bugs.launchpad.net/tripleo/+bug/1835269 | 15:41 |
| ykarel | arxcruz|rover, ack, | 15:41 |
| *** udesale has quit IRC | 15:45 | |
| *** rfolco has quit IRC | 15:47 | |
| * marios almost out | 15:49 | |
| rlandy | chandankumar: wrt https://logs.rdoproject.org/70/21270/15/check/periodic-tripleo-ci-rhel-8-standalone-master/bcedb95/job-output.txt.gz#_2019-07-03_10_55_00_262459 - I feel like we dealt with this for downstream image | 15:50 |
| rlandy | and the fixes we made were to address the same failures | 15:50 |
| *** bogdando has quit IRC | 15:50 | |
| rlandy | 2019-07-03 10:55:00.269468 | primary | PermissionError: [Errno 13] Permission denied: '/usr/local/lib/python3.6/site-packages/shyaml-0.6.1.dist-info' | 15:50 |
| rlandy | ^^ new though | 15:50 |
| *** apetrich has quit IRC | 15:55 | |
| *** marios is now known as marios|out | 15:56 | |
| *** marios|out has quit IRC | 15:59 | |
| *** apetrich has joined #oooq | 16:06 | |
| *** holser__ has joined #oooq | 16:08 | |
| *** chem has quit IRC | 16:09 | |
| *** holser_ has quit IRC | 16:10 | |
| *** holser__ has quit IRC | 16:13 | |
| *** holser_ has joined #oooq | 16:16 | |
| *** apetrich has quit IRC | 16:22 | |
| amoralej | rlandy, could you test dlrn api for rhel8-master in https://trunk.rdoproject.org/api-rhel8-master/api ? | 16:26 |
| rlandy | amoralej: is this enough of a test ... https://logs.rdoproject.org/70/21270/15/check/periodic-tripleo-ci-rhel-8-standalone-master/bcedb95/job-output.txt.gz#_2019-07-03_10_53_34_556739? | 16:29 |
| amoralej | rlandy, that's not dlrn-api | 16:29 |
| amoralej | that's just static dlrn content | 16:29 |
| amoralej | i mean reporting job results | 16:30 |
| amoralej | rlandy, in https://logs.rdoproject.org/70/21270/15/check/periodic-tripleo-ci-rhel-8-standalone-master/bcedb95/job-output.txt.gz#_2019-07-03_10_55_05_129515 | 16:30 |
| rlandy | I think rfolco was trying to work with that | 16:30 |
| amoralej | it's using https://trunk.rdoproject.org/api-redhat-master | 16:31 |
| amoralej | it should be https://trunk.rdoproject.org/api-rhel8-master | 16:31 |
| rlandy | k - looking how it's picking that link | 16:32 |
| amoralej | anyway, it seems there are other issues also | 16:32 |
| amoralej | ImportError: No module named dlrnapi_client.shell | 16:32 |
| amoralej | could be python2/python3 issue | 16:32 |
| rlandy | yeah - I was just trying to resolve the bindep stuff | 16:32 |
| rlandy | so we could get by ^^ | 16:32 |
| rlandy | that error is from earlier on | 16:33 |
| rlandy | DLRNAPI_URL="https://trunk.rdoproject.org/api-${DLRNAPI_DISTRO,,}-$RELEASE" | 16:36 |
| rlandy | that is why it's using redhat | 16:37 |
| rlandy | amoralej: ^^ will have to fix that | 16:37 |
| amoralej | that's harder to fix | 16:38 |
| amoralej | mmm | 16:38 |
| rlandy | amoralej: we can make a case to fox it on our side | 16:39 |
| rlandy | if distro =redhat ... | 16:39 |
| amoralej | in fact, you should change it to also cover centos8 | 16:39 |
| rlandy | that code is in https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/ci-scripts/tripleo-upstream/get-hash.sh#L19 | 16:39 |
| rlandy | ack - we should | 16:40 |
| amoralej | in future when we introduce centos8 we'll need to have both centos7 and centos8 builders running in parallel for some time | 16:40 |
| rlandy | right | 16:41 |
| rlandy | so there are two issues | 16:41 |
| amoralej | so using just DLRNAPI_DISTRO will not be enough | 16:41 |
| amoralej | yeah | 16:41 |
| rlandy | 1. ${DLRNAPI_DISTRO_VERSION}- | 16:41 |
| rlandy | for 7/8 parallel | 16:41 |
| rlandy | and redhat vs rhel | 16:41 |
| amoralej | yes | 16:41 |
| rlandy | amoralej: just to clarify - we want to stick with rhel - not redhat? | 16:42 |
| amoralej | i think it'd be better, yes | 16:42 |
| amoralej | i could make it work with redhat hacking manually config | 16:42 |
| rlandy | ok | 16:42 |
| amoralej | but will be broken as soon as we run puppet in the server again | 16:42 |
| amoralej | i'd have to think in something better | 16:43 |
| rlandy | so I can make a hacky fix for testing today and put in a design change for the team going forward | 16:43 |
| rlandy | hmmm ... but it's config so I'll have to merge it to test | 16:44 |
| rlandy | either way, I need to resolve these bindep issues to finish the install | 16:44 |
| amoralej | could we make it configurable per distro/release instead of based on conventions? | 16:45 |
| amoralej | conventions tend to be tricky | 16:45 |
| amoralej | or better, convention based but able to override | 16:45 |
| rlandy | yeah - which I why I think we need a temp 'hack' solution while we agree on a proper design | 16:45 |
| rlandy | unfortunately, being in a config repo, I'd have to merge the hack | 16:46 |
| amoralej | gimme a while | 16:47 |
| amoralej | i'll apply hack in my side | 16:47 |
| amoralej | to unblock | 16:48 |
| amoralej | is it worthy? | 16:48 |
| rlandy | sure | 16:48 |
| rlandy | zbr: need your python3 expertise | 16:55 |
| rlandy | https://opendev.org/openstack/tripleo-quickstart/src/branch/master/install-deps.sh#L212 | 16:55 |
| rlandy | zbr: checkout https://logs.rdoproject.org/70/21270/15/check/periodic-tripleo-ci-rhel-8-standalone-master/bcedb95/job-output.txt.gz#_2019-07-03_10_54_55_775437 | 16:56 |
| zbr | rlandy: ticky one, sometimes pip wants to remove stuff from system when you install with --user (--upgrade being the culprit) | 16:59 |
| *** Vorrtex has quit IRC | 17:00 | |
| zbr | 2nd issue: bindep needs sudo, right? so why not installing bindep with sudo? (obviously without any upgrade params) | 17:00 |
| rlandy | zbr: this is a disaster for rhel 8 | 17:01 |
| *** Vorrtex has joined #oooq | 17:01 | |
| rlandy | now some how the fixes we applied for the fake rhel-8 cloud image don't work here | 17:01 |
| rlandy | maybe we are missing packages on the image itself? | 17:01 |
| * rlandy reprovisions test box with rhel 8 | 17:02 | |
| rlandy | I need a working test env | 17:02 |
| zbr | everythign we do with this file is bit shady, not a surprise that it chokes. | 17:02 |
| zbr | rlandy: we already have a molecule job testing insall-deps.sh for the other platforms. maybe we should add rhel-8 to the mix.... if we can pull the container | 17:03 |
| amoralej | rlandy, https://trunk.rdoproject.org/api-redhat-master is now working, but note that it's just a temporary thing until jobs can be moved to use rhel8 url | 17:04 |
| rlandy | zbr: so I am not sure why this works one the downstream image and not on rdocloud one | 17:04 |
| rlandy | amoralej: ack - thanks | 17:04 |
| rlandy | will test it in the next job run | 17:04 |
| rlandy | thank you for enabling this work | 17:05 |
| zbr | rlandy: the old story about DIB preparation, i seen very ugly stuff done there upstream (regarding installing pip/venv/setuptools with pip and disabling them in yum) -- which AFAIK invalidates them as testing grounds. | 17:05 |
| rlandy | zbr: yeah - there is something different here | 17:09 |
| *** Vorrtex has quit IRC | 17:09 | |
| rlandy | zbr: but python3 -m pip install pip --upgrade - should work? | 17:10 |
| zbr | rlandy: i know. but at the same time i am kinda p.... by the fact that I cannot really spawn a r8 container to debug it. | 17:10 |
| zbr | rlandy: you still need sudo in front of it, | 17:11 |
| zbr | rlandy: i think that the error was clear: it fails because it attempts to upgrade setuptools from system. probably an older pip bug, considering that it uses 9.x | 17:14 |
| zbr | try to update pip first and see if it works after | 17:15 |
| zbr | we were always famous for shipping only ancient versions of pip | 17:15 |
| rlandy | sorry - juts pxe booting | 17:17 |
| rlandy | sec | 17:17 |
| *** ykarel is now known as ykarel|away | 17:23 | |
| rlandy | zbr: compare these two: | 17:29 |
| rlandy | https://logs.rdoproject.org/70/21270/15/check/periodic-tripleo-ci-rhel-8-standalone-master/bcedb95/job-output.txt.gz#_2019-07-03_10_54_55_775437 | 17:29 |
| rlandy | and https://sf.hosted.upshift.rdu2.redhat.com/logs/periodic/code.engineering.redhat.com/openstack/tripleo-ci-internal-jobs/master/periodic-tripleo-ci-rhel-8-standalone-need-images-rhos-15/844457a/job-output.txt.gz#_2019-07-02_23_55_25_552305 | 17:29 |
| rlandy | pip:19.1.1 vs pip:9.0.3 | 17:29 |
| rlandy | maybe the user setup | 17:31 |
| zbr | i need a shell to such a machine to look at it, otherwise is like tarot | 17:31 |
| rlandy | zbr: you can use the test box I just set up | 17:36 |
| *** amoralej is now known as amoralej|off | 17:36 | |
| rlandy | but I am not sure it's a good rep pf DIB | 17:37 |
| zbr | i will try to pull it from rdo registry, hopefully I can make docker speak with it | 17:37 |
| * rlandy still likes hardware provisioning | 17:37 | |
| rlandy | works | 17:37 |
| rlandy | zbr: why such a diff in the pip versions thoudh? | 17:39 |
| rlandy | pip:19.1.1 vs pip:9.0.3? | 17:39 |
| rlandy | what decides that? | 17:39 |
| zbr | ask our release engineering, they just don't like to update pip, ever, finding lots of excuses related to "potential risks". pip used to not be available as rpm for a very long time. | 17:40 |
| zbr | that is because installing stuff as root with pip invalidates supported status, as it conflicts with rpms. | 17:41 |
| zbr | so pip is seen by releng as the big-bad-wolf :D | 17:41 |
| zbr | i remember that ~2years ago it used to be pip-6 | 17:42 |
| zbr | AFAIK, using any version of pip<10.1 is kinda insane due to the big number of changes made at that time. above that is less important | 17:43 |
| *** ykarel|away has quit IRC | 17:43 | |
| zbr | anyway, we are not sure is pip yet | 17:43 |
| *** tcw has quit IRC | 17:44 | |
| *** tcw has joined #oooq | 17:52 | |
| *** sshnaidm|ruck is now known as sshnaidm|afk | 17:53 | |
| *** rfolco has joined #oooq | 17:56 | |
| *** holser_ has quit IRC | 18:19 | |
| *** rascasoft has quit IRC | 18:25 | |
| *** rascasoft has joined #oooq | 18:25 | |
| zbr | rlandy: i was able to pull the image from rdo registry but is pretty much useless because.. This system is not registered | 18:27 |
| rlandy | zbr: you cab add rhui | 18:36 |
| rlandy | can | 18:36 |
| *** aakarsh has quit IRC | 18:37 | |
| zbr | where are the infos? somehow i have the impression that I would not be able to do that on travis | 18:38 |
| rlandy | zbr: see pvt | 18:39 |
| rlandy | zbr: I think this may be the issue ... | 18:39 |
| rlandy | https://softwarefactory-project.io/nodepool-log/upstream-rhel-8-0000000010.log | 18:39 |
| rlandy | see ... | 18:39 |
| rlandy | 2019-07-02 18:49:09.002 | Successfully installed virtualenv-16.6.1 | 18:39 |
| rlandy | 2019-07-02 18:49:09.091 | + ln -sf /usr/bin/virtualenv2 /usr/bin/virtualenv | 18:39 |
| rlandy | 2019-07-02 18:49:09.098 | + rm -f /usr/local/bin/virtualenv | 18:39 |
| rlandy | zbr: ^^ | 18:40 |
| rlandy | then we try ... | 18:40 |
| rlandy | the above is in the image build | 18:40 |
| rlandy | and then in the install-deps we try | 18:40 |
| zbr | rlandy: yep, that was one of the messes I encounted on uptream image preparation where a system file was replaces | 18:41 |
| rlandy | https://github.com/openstack/tripleo-quickstart/blob/master/install-deps.sh#L141 | 18:41 |
| rlandy | zbr:^^ | 18:42 |
| rlandy | what did you do about it? | 18:42 |
| zbr | nothing | 18:42 |
| rlandy | then stuff would have failed | 18:43 |
| *** tesseract has quit IRC | 18:44 | |
| rlandy | zbr: ok - then explain this to me ... | 18:47 |
| rlandy | https://github.com/openstack/tripleo-quickstart/blob/master/install-deps.sh#L142 | 18:47 |
| rlandy | $(python_cmd) -c "from __future__ import print_function; import $1; print('$1:%s ' % $1.__version__, end='')" | 18:49 |
| rlandy | should have returned true | 18:49 |
| zbr | rlandy: there is nothing wrong with pip itself, which is useable. the issue is that the line that tries to install bindep is failing. anyway I am close to unlock my r8 container so I will be able to get some tests | 19:02 |
| rlandy | zbr: unless your container does what DIB does, I am not sure we will reproduce | 19:03 |
| rlandy | zbr: we don;t even need install-deps here - I don't think | 19:06 |
| zbr | rlandy: may be true but what I am trying to do is to enable molecule to test rhel8 because I already have a merged scenario that tests exactly this script. | 19:07 |
| zbr | which means that once done, i will know what happens on rhel8 and we can refactor it in a safe way | 19:07 |
| rlandy | this all fails and reports success | 19:09 |
| rlandy | crazy | 19:09 |
| zbr | rlandy: the file is missing the strict bash mode: set -euo pipefail --- so I am not surprised | 19:13 |
| rlandy | which file? | 19:14 |
| rfolco | zbr, in case you did not see it | 19:19 |
| rfolco | https://review.opendev.org/#/c/666666 | 19:19 |
| *** sabedevops has joined #oooq | 19:25 | |
| *** aakarsh has joined #oooq | 19:44 | |
| *** sabedevops has quit IRC | 19:53 | |
| *** sabedevops has joined #oooq | 19:55 | |
| *** sabedevops has quit IRC | 19:56 | |
| rlandy | zbr: for example... 2019-07-03 10:54:58.750532 | primary | Package python3-setuptools-39.2.0-4.el8.noarch is already installed. | 19:58 |
| rlandy | 2019-07-03 10:55:00.279326 | primary | ERROR: setuptools not installed | 19:59 |
| rlandy | 2019-07-03 14:55:00.344240 | primary | ERROR | 19:59 |
| rlandy | ^^ how is that possible? | 19:59 |
| zbr | rlandy: try to remove --upgrade from that line, it is likely that it will work. | 19:59 |
| zbr | that is because due to this param, pip would decide to upgrade setuptools, and fail. | 20:00 |
| rlandy | check_python_module $module_name || MISSING_MODULES+=("$module_name") | 20:00 |
| rlandy | there is no upgrade | 20:00 |
| rlandy | check_python_module () { | 20:01 |
| rlandy | # validate module import and print package versions on single final line | 20:01 |
| rlandy | $(python_cmd) -c "from __future__ import print_function; import $1; print('$1:%s ' % $1.__version__, end='')" | 20:01 |
| zbr | rlandy: just add a -x on its call and run it again, without trace mode we will go nowhere | 20:10 |
| *** holser_ has joined #oooq | 20:10 | |
| *** holser_ has quit IRC | 20:11 | |
| *** holser_ has joined #oooq | 20:11 | |
| rlandy | zbr: here is my best guess ... DIB (in its wisdom) is uninstall, reinstalling and upgrading pip, virtualenv and setuptools | 20:12 |
| rlandy | we then come along with install-deps | 20:13 |
| rlandy | and try repeat process | 20:13 |
| rlandy | but shyaml gets in the way | 20:13 |
| rlandy | we are doing a --user install | 20:13 |
| rlandy | but the virtualenv is using --system-site-packages, maybe? | 20:14 |
| zbr | a venv with system site packages can cause this issue if you try to upgrade. also anything installed in --user, will never be visible to a virtualenv. | 20:16 |
| rlandy | zbr: okie dokie ... so dlrnclient requires shyaml | 20:21 |
| rlandy | 2019-07-03 16:20:16.043347 | primary | Collecting shyaml | 20:22 |
| rlandy | 2019-07-03 16:20:16.333526 | primary | Downloading http://mirror.regionone.rdo-cloud.rdoproject.org/pypifiles/packages/29/84/30051cc954696388d63bac118278e5c5a02d1765eed257b41b63a8b9c333/shyaml-0.6.1-py2.py3-none-any.whl | 20:22 |
| rlandy | 2019-07-03 16:20:16.369604 | primary | Requirement already satisfied: pyyaml in /usr/lib64/python3.6/site-packages (from shyaml) (3.12) | 20:22 |
| rlandy | 2019-07-03 16:20:16.435699 | primary | Installing collected packages: shyaml | 20:22 |
| rlandy | 2019-07-03 16:20:16.447838 | primary | Successfully installed shyaml-0.6.1 | 20:22 |
| rlandy | 2019-07-03 16:20:14.704666 | primary | +(/home/zuul/src/opendev.org/openstack/tripleo-ci/toci_gate_test.sh:47): main(): sudo /usr/bin/dnf -y '--exclude=python2*' install shyaml | 20:23 |
| rlandy | 2019-07-03 16:20:15.274277 | primary | Last metadata expiration check: 1:10:45 ago on Wed Jul 3 15:09:30 2019. | 20:23 |
| rlandy | 2019-07-03 16:20:15.544409 | primary | No match for argument: shyaml | 20:23 |
| rlandy | this is where our problems start | 20:23 |
| rlandy | zbr: this is where I need your help ... | 20:26 |
| rlandy | 2019-07-03 16:20:15.599042 | primary | +(/home/zuul/src/opendev.org/openstack/tripleo-ci/toci_gate_test.sh:54): main(): sudo python3 -m pip install shyaml | 20:27 |
| rlandy | 2019-07-03 16:20:16.682077 | primary | PermissionError: [Errno 13] Permission denied: '/usr/local/lib/python3.6/site-packages/shyaml.py' | 20:29 |
| rlandy | That is our real problem | 20:33 |
| rlandy | 2019-07-03 16:20:16.682077 | primary | PermissionError: [Errno 13] Permission denied: '/usr/local/lib/python3.6/site-packages/shyaml.py' | 20:33 |
| *** aakarsh has quit IRC | 20:49 | |
| *** holser_ has quit IRC | 20:53 | |
| chandankumar | rlandy: sorry, I went out with my friends | 20:54 |
| chandankumar | rlandy: just reading right now | 20:54 |
| chandankumar | sshnaidm|afk: rlandy: we are using the correct nodepool image https://logs.rdoproject.org/70/21270/16/check/periodic-tripleo-ci-rhel-8-standalone-master/7b4ed3b/ara-report/result/facb588c-f282-4612-9a97-61ed1cd71448/ | 20:58 |
| chandankumar | rlandy: rhui repos are there | 20:58 |
| *** jtomasek has quit IRC | 21:03 | |
| *** slaweq has quit IRC | 21:11 | |
| rlandy | chandankumar: so the issue is not the rhui repos | 21:18 |
| rlandy | we haven't even got there yet | 21:19 |
| rlandy | it's install-deps | 21:19 |
| chandankumar | rlandy: it is about confirmed we are using the right nodepool image or not & rhui is there or not, I will take a look at install-deps in morning:_) | 21:20 |
| rlandy | chandankumar: I'm working on it now | 21:20 |
| rlandy | shyaml is our first issue | 21:20 |
| rlandy | I will leave you notes in the card | 21:20 |
| chandankumar | rlandy: sure thanks :-) | 21:21 |
| rlandy | there are a bunch more possible issues | 21:21 |
| rlandy | like why it doesn;t recognize setuptools | 21:21 |
| *** rfolco has quit IRC | 21:22 | |
| *** sabedevops has joined #oooq | 21:36 | |
| *** slaweq has joined #oooq | 21:38 | |
| *** sabedevops has quit IRC | 21:43 | |
| *** slaweq has quit IRC | 21:43 | |
| *** sabedevops has joined #oooq | 21:50 | |
| *** sabedevops has quit IRC | 21:53 | |
| *** tcw has quit IRC | 21:54 | |
| rlandy | out for about 2 hours | 21:58 |
| rlandy | bbl | 21:58 |
| *** rlandy is now known as rlandy|bbl | 21:58 | |
| *** tcw has joined #oooq | 22:02 | |
| *** vinaykns has quit IRC | 22:12 | |
| *** tosky has quit IRC | 22:38 | |
| *** holser_ has joined #oooq | 23:20 | |
| *** holser_ has quit IRC | 23:52 | |
| *** saneax has quit IRC | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!