Thursday, 2016-12-08

openstackgerritgreghaynes proposed openstack/diskimage-builder: Make dib-python use the default python for distro  https://review.openstack.org/40828800:29
openstackgerritgreghaynes proposed openstack/diskimage-builder: Create ubuntu/fedora test for pip-and-virtualenv  https://review.openstack.org/40776900:31
openstackgerritgreghaynes proposed openstack/diskimage-builder: Add install-types as pip-and-virtualenv dep  https://review.openstack.org/40824800:31
openstackgerritgreghaynes proposed openstack/diskimage-builder: Fix pip-and-virtualenv to work with python3  https://review.openstack.org/40772300:31
openstackgerritgreghaynes proposed openstack/diskimage-builder: Move pip-and-virtualenv source install to 10-  https://review.openstack.org/40827700:31
openstackgerritgreghaynes proposed openstack/diskimage-builder: Allow package-installs to parse python_version  https://review.openstack.org/40829300:31
openstackgerritgreghaynes proposed openstack/diskimage-builder: Allow package-installs to parse python_version  https://review.openstack.org/40829300:39
openstackgerritgreghaynes proposed openstack/diskimage-builder: Create ubuntu/fedora test for pip-and-virtualenv  https://review.openstack.org/40776900:43
openstackgerritgreghaynes proposed openstack/diskimage-builder: Add install-types as pip-and-virtualenv dep  https://review.openstack.org/40824800:43
openstackgerritgreghaynes proposed openstack/diskimage-builder: Fix pip-and-virtualenv to work with python3  https://review.openstack.org/40772300:43
openstackgerritgreghaynes proposed openstack/diskimage-builder: Move pip-and-virtualenv source install to 10-  https://review.openstack.org/40827700:43
openstackgerritgreghaynes proposed openstack/diskimage-builder: Make dib-python use the default python for distro  https://review.openstack.org/40828800:48
openstackgerritgreghaynes proposed openstack/diskimage-builder: Create ubuntu/fedora test for pip-and-virtualenv  https://review.openstack.org/40776900:51
openstackgerritgreghaynes proposed openstack/diskimage-builder: Add install-types as pip-and-virtualenv dep  https://review.openstack.org/40824800:51
openstackgerritgreghaynes proposed openstack/diskimage-builder: Fix pip-and-virtualenv to work with python3  https://review.openstack.org/40772300:51
openstackgerritgreghaynes proposed openstack/diskimage-builder: Move pip-and-virtualenv source install to 10-  https://review.openstack.org/40827700:51
openstackgerritgreghaynes proposed openstack/diskimage-builder: Allow package-installs to parse python_version  https://review.openstack.org/40829300:51
*** jschwarz has quit IRC01:25
*** jschwarz has joined #openstack-dib01:27
openstackgerritIan Wienand proposed openstack/diskimage-builder: Add get_elements; preserve backwards compat for expand_dependencies  https://review.openstack.org/40738601:57
ianwtfw you pull a thread and everything untangles01:58
greghaynesYes, see that py3 vs 2 deal02:37
greghaynesI thought it was going to be one patch02:37
openstackgerritIan Wienand proposed openstack/diskimage-builder: Add get_elements; preserve backwards compat for expand_dependencies  https://review.openstack.org/40738603:15
*** jaianshu has joined #openstack-dib04:23
*** jaianshu_ has joined #openstack-dib04:45
*** jaianshu has quit IRC04:48
openstackgerritIan Wienand proposed openstack/diskimage-builder: Add get_elements; preserve backwards compat for expand_dependencies  https://review.openstack.org/40738604:52
*** chhavi__ has joined #openstack-dib04:57
*** sudipto has joined #openstack-dib05:04
*** sudipto_ has joined #openstack-dib05:04
openstackgerritIan Wienand proposed openstack/diskimage-builder: Put MKFS_OPTS after filesystem type  https://review.openstack.org/40840805:05
*** narayrak has joined #openstack-dib05:17
*** pmannidi has quit IRC05:47
*** pmannidi has joined #openstack-dib06:29
*** owalsh has joined #openstack-dib08:15
*** jaianshu__ has joined #openstack-dib08:20
*** jaianshu_ has quit IRC08:23
*** jaianshu_ has joined #openstack-dib08:27
*** jaianshu__ has quit IRC08:30
*** jaianshu has joined #openstack-dib08:30
*** jaianshu_ has quit IRC08:33
*** hashar has joined #openstack-dib08:37
*** strigazi_AFK is now known as strigazi08:39
*** pmannidi has quit IRC09:28
*** pmannidi has joined #openstack-dib09:30
*** pmannidi has quit IRC09:39
*** pmannidi has joined #openstack-dib09:41
*** hogepodge has quit IRC09:45
*** hogepodge has joined #openstack-dib09:46
*** chhavi__ has quit IRC09:48
*** pmannidi has quit IRC09:50
*** owalsh has quit IRC10:02
*** chhavi__ has joined #openstack-dib10:51
*** owalsh has joined #openstack-dib10:54
*** strigazi is now known as strigazi_AFK10:59
*** hogepodge has quit IRC11:01
*** chhavi__ has quit IRC11:12
*** hogepodge has joined #openstack-dib11:21
*** hogepodge has quit IRC11:26
*** hogepodge has joined #openstack-dib11:38
*** hogepodge has quit IRC11:48
*** sudipto_ has quit IRC11:51
*** sudipto has quit IRC11:51
*** hogepodge has joined #openstack-dib12:00
*** chhavi__ has joined #openstack-dib12:03
*** jaianshu has quit IRC12:21
openstackgerritAndrey Shestakov proposed openstack/diskimage-builder: Revert "Fix ironic-python-agent image not loading vfat mod"  https://review.openstack.org/40795512:45
*** narayrak has quit IRC13:37
*** jaianshu has joined #openstack-dib13:47
*** strigazi_AFK is now known as strigazi13:49
*** jaianshu has quit IRC14:19
*** sudipto_ has joined #openstack-dib14:31
*** sudipto has joined #openstack-dib14:31
*** sudipto_ has quit IRC15:25
*** sudipto has quit IRC15:25
*** owalsh has quit IRC16:05
*** chhavi__ has quit IRC16:25
*** hashar is now known as hasharCall17:02
openstackgerritgreghaynes proposed openstack/diskimage-builder: Make dib-python use the default python for distro  https://review.openstack.org/40828817:27
*** hasharCall is now known as hashar18:07
*** hashar has quit IRC18:16
*** sudipto_ has joined #openstack-dib18:24
*** sudipto has joined #openstack-dib18:24
*** sudipto_ has quit IRC18:36
*** sudipto has quit IRC18:36
openstackgerritgreghaynes proposed openstack/diskimage-builder: Make dib-python use the default python for distro  https://review.openstack.org/40828819:04
*** strigazi is now known as strigazi_AFK19:26
greghayneshttp://logs.openstack.org/88/408288/8/check/gate-dib-dsvm-functests-ubuntu-xenial/9c7656f/console.html#_2016-12-08_19_23_48_47159419:52
greghaynesthats a very odd failure19:52
ianwhmm, yep19:57
ianwgreghyanes: repeatable?19:57
pabelangerUmmm19:57
pabelanger2016-12-08 19:47:43,817 INFO nodepool.image.build.fedora-24: mount: none already mounted or /opt/dib_tmp/dib_build.bIPidWaE/mnt/proc busy19:57
pabelangerwe just got that19:58
pabelangeron nb02.o.o19:58
pabelangerweird19:58
pabelangerworking theory is we manually killed DIB, and the next build hit the existing mount20:00
greghaynesianw: I guess so?20:01
greghaynespabelanger: yea this seems like either a xenial or new dib bug20:01
greghaynesim guessing the latter20:02
ianwpabelanger: seems unlikely if the same thing is hitting in dib CI20:02
ianwany interest in dib meeting?20:02
greghaynesoh, today?20:03
greghaynesif we were giong to I think itd be yesterday20:03
greghaynesthe odd thing about this bug is clearly it got through our CI, so something else must have changed20:04
ianwok, it's mounted in http://logs.openstack.org/88/408288/8/check/gate-dib-dsvm-functests-ubuntu-xenial/9c7656f/console.html#_2016-12-08_19_23_29_06881920:07
ianwthen the next occurrence is another mount at http://logs.openstack.org/88/408288/8/check/gate-dib-dsvm-functests-ubuntu-xenial/9c7656f/console.html#_2016-12-08_19_23_48_46697220:07
ianwahhh, here we go!  http://logs.openstack.org/88/408288/8/check/gate-dib-dsvm-functests-ubuntu-xenial/9c7656f/console.html#_2016-12-08_19_23_48_32584420:08
ianwi think this is a red herring20:08
ianwwe haven't cleaned up properly20:08
ianwin fact, it seems that "die" did not die -- http://logs.openstack.org/88/408288/8/check/gate-dib-dsvm-functests-ubuntu-xenial/9c7656f/console.html#_2016-12-08_19_23_48_32584420:09
openstackgerritIan Wienand proposed openstack/diskimage-builder: Put MKFS_OPTS after filesystem type  https://review.openstack.org/40840820:23
greghaynesianw: ohhh20:47
greghaynesianw: yea die is pretty broken20:47
greghaynesI want to say it only exits 1 if the previous command did or something, its not an actualy exit20:48
greghaynesso yea, I think its two bugs - the die didnt die and were failing to cleanup for some reason20:48
greghaynespabelanger: ^20:49
greghaynespabelanger: you might be right in that you killed something which tickled the second bug20:49
pabelangerI think so, we did -9 disk-image-create to abort a diskimage build in nodepool20:51
pabelangerbut didn't check mount to see what was left over20:51
ianwpabelanger: thing is we can leave old mounts behind, but we're always doing the mounts into new tmp dirs20:53
ianwsince the die didn't die, we continued on, assuming that we'd cleaned up and unmounted ... but we hadn't20:54
pabelangermaybe add a signal handler?20:55
pabelangeror what is the right way to abort a build20:56
ianwpabelanger: well ... i would say don't to be honest :)20:56
pabelangerha20:56
ianwso many points probably don't have asynchronous exit handlers20:56
greghaynesif you kill dib-run-parts it might just work20:56
ianwwe do try to clean up, modulo bugs like this one20:57
greghaynesI suspect we need to do a bit of polling here20:57
ianwbut not much of a guarantee20:57
ianwhttps://git.openstack.org/cgit/openstack/diskimage-builder/tree/elements/yum-minimal/root.d/08-yum-chroot#n27420:58
ianw# TODO : move this into a exit trap; and reconsider how20:59
ianw    # this integrates with the global exit cleanup path.20:59
greghaynesoh right20:59
ianwhmm, i wonder if the die() is actually working, but it's the subshell/flock hiding this https://git.openstack.org/cgit/openstack/diskimage-builder/tree/elements/yum-minimal/root.d/08-yum-chroot#n13820:59
greghaynesI dont see 'sudo $_RPM --root ...' so die has to be working21:03
ianwyeah, i think what happens here is the flock returns ok, so the exit code for the script is 021:11
greghaynesnice21:11
openstackgerritgreghaynes proposed openstack/diskimage-builder: Make dib-python use the default python for distro  https://review.openstack.org/40828822:32
openstackgerritgreghaynes proposed openstack/diskimage-builder: Make dib-python use the default python for distro  https://review.openstack.org/40828822:35
openstackgerritgreghaynes proposed openstack/diskimage-builder: Dont generate qcow2's in tests  https://review.openstack.org/40884022:49
*** pmannidi has joined #openstack-dib23:02
greghaynesianw: we keep getting fedora mirror fails :/23:04
greghayneshttp://logs.openstack.org/40/408840/1/check/gate-dib-dsvm-functests-ubuntu-trusty/2665ea4/console.html#_2016-12-08_23_01_34_28183323:04
*** pmannidi has quit IRC23:25
*** pmannidi has joined #openstack-dib23:27
openstackgerritgreghaynes proposed openstack/diskimage-builder: Allow disto-specific mirror settings  https://review.openstack.org/40885023:34
openstackgerritgreghaynes proposed openstack/diskimage-builder: Add support for using infra's mirrors in tests  https://review.openstack.org/40885123:34
openstackgerritgreghaynes proposed openstack/diskimage-builder: Allow disto-specific mirror settings  https://review.openstack.org/40885023:47
openstackgerritgreghaynes proposed openstack/diskimage-builder: Add support for using infra's mirrors in tests  https://review.openstack.org/40885123:50

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!