Monday, 2022-10-17

nightmare_unrealHello i am trying to build IPA image using diskimage-builder on gitlab CI.  I am using latest (master) version of dib . getting this error  " Error: Unable to find a match: scsi-target-utils python-devel"08:30
opendevreviewRafal Lewandowski proposed openstack/diskimage-builder master: Added example configuration  https://review.opendev.org/c/openstack/diskimage-builder/+/86158208:40
nightmare_unrealCan someone review this patch : https://review.opendev.org/c/openstack/diskimage-builder/+/85088208:44
opendevreviewRafal Lewandowski proposed openstack/diskimage-builder master: Added example configuration  https://review.opendev.org/c/openstack/diskimage-builder/+/86158208:58
opendevreviewRafal Lewandowski proposed openstack/diskimage-builder master: Added example configuration  https://review.opendev.org/c/openstack/diskimage-builder/+/86158209:20
opendevreviewRafal Lewandowski proposed openstack/diskimage-builder master: Added example configuration  https://review.opendev.org/c/openstack/diskimage-builder/+/86158209:36
opendevreviewRafal Lewandowski proposed openstack/diskimage-builder master: Added example configuration  https://review.opendev.org/c/openstack/diskimage-builder/+/86158210:16
opendevreviewRafal Lewandowski proposed openstack/diskimage-builder master: Added example configuration  https://review.opendev.org/c/openstack/diskimage-builder/+/86158210:41
opendevreviewRafal Lewandowski proposed openstack/diskimage-builder master: Added example configuration  https://review.opendev.org/c/openstack/diskimage-builder/+/86158210:54
opendevreviewRafal Lewandowski proposed openstack/diskimage-builder master: Added example configuration  https://review.opendev.org/c/openstack/diskimage-builder/+/86158211:05
opendevreviewRafal Lewandowski proposed openstack/diskimage-builder master: Added example configuration  https://review.opendev.org/c/openstack/diskimage-builder/+/86158212:51
ravlewI'm getting 2022-10-17 13:01:07.849515 | ubuntu-focal |       /usr/local/lib/python3.10/site-packages/setuptools/config/setupcfg.py:463: SetuptoolsDeprecationWarning: The license_file parameter is deprecated, use license_files instead. in nodepool-build-image-siblings test, is this a known issue?13:06
ravlewI mean this one: 2022-10-17 13:01:07.841407 | ubuntu-focal |   Building wheel for netifaces (setup.py): finished with status 'error'13:07
ravlew2022-10-17 13:01:07.849484 | ubuntu-focal |   × python setup.py bdist_wheel did not run successfully.13:08
clarkbravlew: can you link to the failed job? deprecation warnings won't cause failures13:52
ravlewclarkb: https://zuul.opendev.org/t/openstack/build/9c462c2e396a4bf9a34bad3b3bf1972f/logs13:54
clarkbravlew: https://zuul.opendev.org/t/openstack/build/9c462c2e396a4bf9a34bad3b3bf1972f/log/job-output.txt#3467 that is the error13:55
clarkbit is happening because netifaces has made a recent release and apparently has not made a wheel for the version of python there so we try to build it from scratch13:56
clarkbthe most recent release is very old though so thats intereting13:57
clarkbmaybe it is a new transitive dep for another package that released recently13:57
ravlewI see13:58
clarkboh they don't have python3.10 wheels I'm guessing this job runs with python3.1013:58
clarkbI need to hop into meetings now. But I think we either need to update the bindep file to include build-essential or drop netifaces or something13:59
clarkbgcc is listed in bindep.txt but for some reason bindep didn't decide it needed to be installed14:53
clarkbhttps://zuul.opendev.org/t/openstack/build/9c462c2e396a4bf9a34bad3b3bf1972f/log/job-output.txt#3183-3204 you can see that here14:53
clarkbok that is because that is the bindep install on the install side no the build side. The build side did build a wheel here: https://zuul.opendev.org/t/openstack/build/9c462c2e396a4bf9a34bad3b3bf1972f/log/job-output.txt#3013-3014 which should'vebeen used on the install side to do the install14:54
clarkbhttps://zuul.opendev.org/t/openstack/build/9c462c2e396a4bf9a34bad3b3bf1972f/log/job-output.txt#3311 why would it prefer a cached sdist over a cached wheel?14:55
clarkbfungi: ^ did pip recently change behavior around preferences for sdist vs wheel?14:56
clarkbI wonder if pip 22.3 is to blame15:00
clarkbhowever we haven't updated our base images since that release this is very confusing15:01
fungiare the cached sdist and cached wheel for the same version of the project?15:03
fungialso why isn't netifaces getting a wheel built for our wheelhouse in afs?15:03
clarkbyes https://zuul.opendev.org/t/openstack/build/9c462c2e396a4bf9a34bad3b3bf1972f/log/job-output.txt#3013-3014 there is the wheel being cached for 0.11.0. https://zuul.opendev.org/t/openstack/build/9c462c2e396a4bf9a34bad3b3bf1972f/log/job-output.txt#3311 is when it decides to use the 0.11.0 sdist15:04
clarkbfungi: nodepool doesn't use the openstack wheel caches because they weren't available or python3.10 when we swapped and testing at that time indicated it wasn't necessary as enough projects upstream of us had pushed arm wheels by then15:05
fungioh, got it15:05
clarkbhttps://zuul.opendev.org/t/openstack/build/9c462c2e396a4bf9a34bad3b3bf1972f/log/job-output.txt#2987-2990 https://zuul.opendev.org/t/openstack/build/9c462c2e396a4bf9a34bad3b3bf1972f/log/job-output.txt#3256 it did the same thing with openshift15:07
clarkbits almost like it won't prefer locally built wheels over locally cached sdists15:07
clarkbI guess the next thing to do is update to pip 22.3 in the builds if we aren't already and debug from there?15:08
fungiyeah, i'm not aware of anything pip would be doing intentionally to select an sdist over a wheel (its features have been focused on moving to the opposite of that, in fact)15:11
clarkbThe other possibility is that we're copying the sdist from the builder to the install image but not the wheels and so pip can't find them15:12
clarkbhttps://zuul.opendev.org/t/openstack/build/9c462c2e396a4bf9a34bad3b3bf1972f/log/job-output.txt#3177 is where we do that I Think and unfortunately docker doesn't give us a listing of the copy contents15:13

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!