Tuesday, 2017-05-09

*** lennyb has quit IRC00:03
*** lennyb has joined #openstack-dib00:04
*** pmannidi has quit IRC00:41
*** pmannidi has joined #openstack-dib00:46
openstackgerritIan Wienand proposed openstack/diskimage-builder master: exec_sudo : no decoding  https://review.openstack.org/46342701:03
ianwmmedvede: http://dal05.objectstorage.softlayer.net/v1/AUTH_3d8e6ecb-f597-448c-8ec2-164e9f710dd6/pkvmci/diskimage-builder/27/463427/1/check/dib-dsvm-functests-devstack-xenial/3994af3/01:07
ianwthis seems to be failing pretty consistently not being able to download?01:07
*** johnsom has quit IRC01:13
*** johnsom has joined #openstack-dib01:13
mmedvedeianw: not sure how to debug this, not able to reproduce the failure. Wanted to check on our elk for history, but realized the job isn't indexed :(01:13
ianwmmedvede: network issue on the host?01:14
ianwfor once, i'm not sure it's dib's fault ;)01:14
mmedvedehehe, that is definitely not dib fault. I suspect it could be networking. I need to check which host it was running on01:15
mmedvedeI did a quick wget test on one of other dsvm slaves and it worked every time. So makes it harder to figure out01:16
ianwahh, i thought i was seeing it pretty regularly01:19
openstackgerritIan Wienand proposed openstack/diskimage-builder master: exec_sudo : no decoding  https://review.openstack.org/46342701:19
mmedvedeianw: should I disable debian-minimal for now? I do not remember if it provides the testing for the broken functionality01:20
ianwmmedvede: yeah ... we just turned it on for ubuntu-minimal i think?01:20
ianwit did just hit for ^^ too01:22
ianwhttp://dal05.objectstorage.softlayer.net/v1/AUTH_3d8e6ecb-f597-448c-8ec2-164e9f710dd6/pkvmci/diskimage-builder/27/463427/2/check/dib-dsvm-functests-devstack-xenial/d5a6747/01:22
mmedvedeall right. I am able to reproduce the problem by running the debootstrap. Just downloading the package manually works. I can work with that01:28
openstackgerritIan Wienand proposed openstack/diskimage-builder master: exec_sudo : no decoding  https://review.openstack.org/46342701:34
*** NobodyCam has quit IRC01:58
*** NobodyCam has joined #openstack-dib01:58
*** khomkrit1499 has joined #openstack-dib03:18
mmedvedeianw: so I found very strange thing is happening - an older version of debian Pakcages.gz gets downloaded somehow, and of course signature check fails. This is the reason for the powerkvm CI test failure03:19
mmedvedeLooks like CDN for http://ftp.us.debian.org/debian/dists/stable/main/binary-ppc64el/Packages.gz did not update (if they even use a CDN)03:22
mmedvedeso it appears that that us mirror has an out of date repo, mirroring has failed. I wonder who should be contacted to fix this03:25
mmedvedenot related to dib :)03:26
*** aparnav has joined #openstack-dib03:29
mmedvedeianw: I switched to a different deb mirror, seems to work now03:44
*** khomkrit1499 has quit IRC04:01
ianwmmedvede: thanks!  yeah, not sure about the mirror issue04:04
*** andreas-f has joined #openstack-dib04:40
*** jamielennox is now known as jamielennox|away05:12
*** jamielennox|away is now known as jamielennox05:18
*** jamielennox is now known as jamielennox|away05:20
*** jamielennox|away is now known as jamielennox05:23
*** chhavi has joined #openstack-dib05:26
openstackgerritIan Wienand proposed openstack/diskimage-builder master: exec_sudo: command should be "str"  https://review.openstack.org/46342705:34
yolandahi ianw , are you testing the python 3 issues with sudo? i tried yesterday refactoring the patch, but is still failing05:48
ianwyolanda: yep, see 46342705:48
yolandaindeed, i was getting errors on different places, depending on the approach i was taking with exec_sudo05:49
ianwyolanda: so, hopefully that is clear.  for sanity that function should just take str() input (that way, we can join it for the print, whatever)05:50
yolandai added the "b" prefix yesterday, but i don't think that it needs to land05:50
ianwif we get bytes from somewhere ... like the output of a subprocess call, etc, then we should make that a str() when we receive it05:50
yolandalet me revert my tries from yesterday so your patch is cleaner05:51
ianwyolanda: if you want, just squash that change into the other one05:51
ianwit passes ocatvia test05:51
ianwalso, https://review.openstack.org/463431 is out to give us python3 on the xenial tests05:52
yolandaianw, i think that yours can even apply before, right?05:52
ianwif it works, i think we run centos/trusty as python2, and xenial as python3.  that way we're covered for both05:52
ianwyolanda: maybe?  can try rebasing it before if you want05:52
yolandayep05:53
yolandalet me revert my changes05:53
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Refactor: block-device filesystem creation, mount and fstab  https://review.openstack.org/44458605:56
yolandaagh, messed the cherry-pick05:57
ianwhmm ... are you try to swap them?05:58
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Refactor: block-device filesystem creation, mount and fstab  https://review.openstack.org/44458605:59
ianwi'd "git review -d 463427" then "rebase -i master" and swap them?05:59
yolandaoh i normally just cherry-pick the patch i want and commit again... maybe your idea works better06:00
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Use check_output  https://review.openstack.org/46347106:00
yolandaanyway, it's there now06:00
ianwheh, yeah, i'm rebase crazy06:00
ianw"-x" is also awesome to run tox in between06:00
yolandaneed to step out for 30 minutes but can continue later06:02
yolandarebase of yours give some merge conflicts06:02
*** isaacb has joined #openstack-dib06:22
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: exec_sudo: command should be "str"  https://review.openstack.org/46342706:25
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: exec_sudo: command should be "str"  https://review.openstack.org/46342706:27
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Refactor: block-device filesystem creation, mount and fstab  https://review.openstack.org/44458607:40
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: exec_sudo: command should be "str"  https://review.openstack.org/46342707:46
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: exec_sudo: command should be "str"  https://review.openstack.org/46342707:51
*** TheJulia has quit IRC07:57
*** TheJulia has joined #openstack-dib07:58
*** jamielennox is now known as jamielennox|away08:19
*** hashar has joined #openstack-dib08:22
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Refactor: block-device filesystem creation, mount and fstab  https://review.openstack.org/44458608:34
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Refactor: block-device filesystem creation, mount and fstab  https://review.openstack.org/44458608:38
*** jamielennox|away is now known as jamielennox08:51
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: exec_sudo: command should be "str"  https://review.openstack.org/46342710:05
*** pmannidi has quit IRC10:22
ianwyolanda: hmmm ... that looping ... ood10:40
ianwodd10:40
yolandai was hitting the same on my test system actually10:42
yolandai refactor a bit, so it does not happen10:42
ianwb" " is not right ... that would stop at a space10:48
yolandabut independently on that, this should not cause that loop10:52
yolandaor you mean that the change from b' ' to b" " caused it?10:55
ianwyolanda: it should be b''10:56
ianwno space10:56
ianwdid you inadvertently turn it into b" " when it started failing?10:56
yolandai guess so10:56
ianwthat would explain it :)10:56
yolandaok let's retry with the right char10:57
ianwi was really wondering how that pattern could fail!10:57
ianwit's saying "stop when you hit EOF" which happens when the program exists10:57
ianwexits10:57
yolandaso yes, i messed that adding an extra space :(10:58
yolandaianw, don't you think we shall add output to logger.error if exit code from the proc.wait() is not zero? right now if your patch, you could only see the error if enablign debug11:00
yolandaand the output should be relevant if we hit an error in the exec_sudo11:00
ianwyolanda: yes, true, i did remove that check there11:04
ianwyolanda: probably what we should do is copy the way check_output() works11:04
ianwreturn 0, or raise CommandFailed or whatever it is11:04
ianwCalledProcessError11:05
ianwin fact, if we called it sudo_check_output and made it behave the same ... well that would be pretty neat because anyone who understands check_output() understands it's just that with a sudo infront11:08
ianwthough i do want to trace in there ... it's important, so that's not the same11:09
ianwyeah, scratch that11:09
yolandaso you prefer that we replace the popen with the check_output?11:10
ianwyolanda: no, sorry i was thinking we could copy the interface.  but it doesn't quite work11:11
ianwi think that the function should check the return value, and raise CalledProcessError if !011:11
ianwyolanda: seems pretty nice? -> http://paste.openstack.org/show/609187/11:16
yolandaand also add the output to logger.error properly11:16
ianwyolanda: well, raising the exception will either be caught, or print a good traceback11:17
yolandaraise subprocess.CalledProcessError(proc.returncode,11:18
yolanda                                            ' '.join(sudo_cmd))11:18
yolandathat will give errors again on python 3?11:18
yolandathe join like that?11:18
yolandaah no, because it should have failed earlier11:18
ianwno, because sudo_cmd is a list of "str"s11:18
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: exec_sudo: command should be "str"  https://review.openstack.org/46342711:19
yolandayep, that is checked before11:20
ianwyolanda: sorry, tiny tiny nit on the function doc but otherwise LGTM!11:23
*** hashar has quit IRC11:28
*** hwoarang has quit IRC11:39
*** hwoarang has joined #openstack-dib11:40
yolandai'm also testing Andrea's patch with xfs , and fails with several errors, seems that xfs is not supporting much of the options11:50
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: exec_sudo: command should be "str"  https://review.openstack.org/46342711:52
*** hwoarang has quit IRC12:04
*** chhavi has quit IRC12:05
*** hashar has joined #openstack-dib12:08
*** hwoarang has joined #openstack-dib12:08
*** hwoarang has quit IRC12:28
*** hwoarang has joined #openstack-dib12:32
*** hwoarang has quit IRC12:34
*** hwoarang has joined #openstack-dib12:34
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Refactor: block-device filesystem creation, mount and fstab  https://review.openstack.org/44458612:35
yolandaianw, andreas-f , so i posted comments on https://review.openstack.org/#/c/444586/36 . Hitting conflicts between the filesystem definition on the block device, vs the exported FS_TYPE12:36
*** hwoarang_ has joined #openstack-dib12:49
*** hwoarang has quit IRC12:51
*** aparnav has quit IRC13:25
*** chhavi has joined #openstack-dib13:40
*** hwoarang_ is now known as hwoarang14:11
*** dmarlin has joined #openstack-dib15:06
*** isaacb has quit IRC15:13
*** abarbaneld has joined #openstack-dib15:51
abarbaneldI have been reading through the Disk Builder Documentation, I am trying to use the element install-static, I created the directory static and my items are not found in the image, can anyone help?15:52
abarbaneldCommand is: disk-image-create -a amd64 -o test -t qcow2 -p mariadb-server,java-1.7.0-openjdk centos7 vm install-static15:53
*** dabarban has joined #openstack-dib15:59
*** abarbaneld has quit IRC16:00
*** dabarban is now known as abarbaneld16:00
greghaynesabarbaneld: that element is only useful if you create the directory static inside of a custom element16:01
greghaynesabarbaneld: so you'd need to create a 'my-element' and inside there a file element-deps with 'install-static' and then a static dir with your files, then add that element to your build16:02
abarbaneldSo adding that element to my build would be a matter of passing the element name?16:03
greghaynesyes and export ELEMENTS_PATH=path_to_dir_with_your_element16:04
abarbaneldGreat! thanks for the assist greghaynes16:05
greghaynesnp16:05
greghaynesthat being said, it'd be neat IMO to have the install-static element support setting DIB_INSTALL_STATIC_DIR=/some/dir and it'd automatically grab file from there16:06
greghaynesshould be easy to write too if youre interested16:06
abarbaneldPossibly, let me see if I can get this working16:07
*** isaacb has joined #openstack-dib16:11
*** hashar has quit IRC16:44
*** isaacb has quit IRC17:00
*** chhavi has quit IRC18:18
*** andreas-f has quit IRC19:49
*** abarbaneld has quit IRC20:40
*** pmannidi has joined #openstack-dib21:35
ianwyolanda: cool on the python3 jobs, did we test them?22:04
ianwto answer -> http://logs.openstack.org/86/444586/37/check/gate-dib-dsvm-functests-python3-ubuntu-xenial-nv/661a379/console.html22:08
ianwyay! it fails :)22:08
*** dmarlin has quit IRC22:46
*** jamielennox is now known as jamielennox|away23:07
*** jamielennox|away is now known as jamielennox23:11
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Refactor: block-device filesystem creation, mount and fstab  https://review.openstack.org/44458623:34
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Let exec_sudo raise exceptions  https://review.openstack.org/46362723:34

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!