Tuesday, 2017-06-06

openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move ppc block-device default to right $ARCH  https://review.openstack.org/47117000:01
*** farosas has quit IRC00:06
*** jamielennox is now known as jamielennox|away01:17
mmedvedeianw: ack01:29
ianwmmedvede: unfortunately ... i've pulled a thread and now the whole thing is untangling ...01:30
mmedvedethis is what happens when you refactor :)01:30
mmedvederfolco (not in the channel) was looking at the original prep partition ppc fix, but I believe that things have moved very far since it was last touched01:31
*** pmannidi has quit IRC01:33
ianwi'd be interested if they want to look again, especially in a few days, as i'd really like feedback from fresh eyes on how it is working01:33
mmedvedeat least ppc test is still failing correctly01:33
*** jamielennox|away is now known as jamielennox01:34
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Use picked nodes for later cmd_* calls  https://review.openstack.org/46933002:20
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Don't make image & loopdev functions static  https://review.openstack.org/47084502:20
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move global mount tracking into state  https://review.openstack.org/46975202:20
*** pmannidi has joined #openstack-dib02:20
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Update tracing in block_device_create_config_file  https://review.openstack.org/47116302:20
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move rollback into NodeBase object  https://review.openstack.org/46410502:20
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Use global state to check for duplicate fs labels  https://review.openstack.org/46975102:20
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Remove 'state' argument from later cmd_* calls  https://review.openstack.org/46975002:20
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Pad state dump  https://review.openstack.org/47116202:20
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Add state to NodeBase class  https://review.openstack.org/46974902:20
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move ppc block-device default to right $ARCH  https://review.openstack.org/47117002:20
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Start at block-device mounting/unmounting cleanup  https://review.openstack.org/47118302:20
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Start at block-device mounting/unmounting cleanup  https://review.openstack.org/47118302:30
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Use picked nodes for later cmd_* calls  https://review.openstack.org/46933002:51
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Start at block-device mounting/unmounting cleanup  https://review.openstack.org/47118302:51
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Don't make image & loopdev functions static  https://review.openstack.org/47084502:51
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move global mount tracking into state  https://review.openstack.org/46975202:52
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Update tracing in block_device_create_config_file  https://review.openstack.org/47116302:52
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move rollback into NodeBase object  https://review.openstack.org/46410502:52
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Use global state to check for duplicate fs labels  https://review.openstack.org/46975102:52
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Remove 'state' argument from later cmd_* calls  https://review.openstack.org/46975002:52
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Pad state dump  https://review.openstack.org/47116202:52
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Add state to NodeBase class  https://review.openstack.org/46974902:52
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move ppc block-device default to right $ARCH  https://review.openstack.org/47117002:52
*** chhavi has joined #openstack-dib03:30
*** hashar has joined #openstack-dib07:21
*** hashar_ has joined #openstack-dib07:30
*** hashar has quit IRC07:33
*** hashar_ is now known as hashar07:51
openstackgerritMerged openstack/diskimage-builder master: Pad state dump  https://review.openstack.org/47116208:21
*** pmannidi has quit IRC09:25
*** jamielennox is now known as jamielennox|away10:10
*** jamielennox|away is now known as jamielennox10:16
*** brault has joined #openstack-dib11:10
*** brault has quit IRC11:26
*** brault has joined #openstack-dib11:48
*** rfolco has joined #openstack-dib12:07
*** farosas has joined #openstack-dib12:07
openstackgerritOpenStack Proposal Bot proposed openstack/diskimage-builder master: Updated from global requirements  https://review.openstack.org/47045112:13
*** isaacb has joined #openstack-dib13:29
*** isaacb has quit IRC15:01
*** hashar has quit IRC15:13
*** rfolco has quit IRC15:56
*** hashar has joined #openstack-dib15:57
*** rfolco has joined #openstack-dib16:01
*** hashar has quit IRC16:16
*** jamielennox is now known as jamielennox|away16:26
*** jamielennox|away is now known as jamielennox17:05
*** chhavi has quit IRC17:55
*** mordred has quit IRC18:47
*** mordred has joined #openstack-dib18:48
rfolcoianw, around ? I think we should break down into 2 separate changes - https://review.openstack.org/447739 - 1) /dev/mapper change 2) ppc prep fix. Agree ?19:12
ianwrfolco: hi19:12
ianwrfolco: yes, that's pretty much where i'm heading.  that review is out of date19:13
ianwi'm trying to get consistent use of the dm nodes with https://review.openstack.org/#/c/471183/19:13
ianwcurrently we ... well, i'm not really sure ... we do "partprobe" on the loop device, and then check if the partitions exist, and if they don't we run kpartx, but don't check dm nodes ... it's all just very confused19:14
rfolcoianw, if you don't mind, to keep changes simple, I would submit a new change for ppc fix because it does not have anything about /dev/mapper, or cleanups IMHO.19:20
ianwrfolco: sure, you mean you have a fix?19:21
ianwthat doesn't rely on any of this?19:21
ianwwhat i am thinking is that if we start passing the bootloader element the dm nodes, rather than /dev/loop directly, it "just works"19:22
rfolcowhat would be the dm path ? /dev/mapper ? I tested it manually, it stills fails to run grub-install on it.19:23
rfolcoI have built manually grub with several commits, and after 2.02~beta3, it just works as is (but it is available on zesty only). So beta2 fails here: http://git.savannah.gnu.org/cgit/grub.git/tree/util/grub-install.c#n177119:25
rfolcoit apparently fails to open device and populate dev->disk->partition.19:25
ianwrfolco: so i had this working19:25
ianwyeah, that was some of the code i was looking at.  if you go digging back, i'm not sure if i put comments in, or maybe if we check irc logs, i thought we found it taking different paths depending on the "/dev" arguments19:27
rfolcoprep is a just a dump of ELF into the partition, so all we need is to grub-mkimage and then dd the elf binary into the partition.19:27
rfolcothis is how I did for CirrOS image building19:28
rfolcoBugs against xenial won't be accepted at this point, so the fix with mkimage and dd would be a good solution IMHO19:29
ianwok!  if that works ... great :)19:31
ianwso no grub-install step?19:31
ianwi still think we want to use dm nodes anyway, because of LVM in the future19:32
rfolcoianw, if ppc, mkimage and dd (no grub-install), yes. That's the only way i could fix it. I also made it work with zesty 2.02~beta3 grub2-common, but its ugly installing .deb directly, although it works.19:33
rfolcoianw, question, when you say dm nodes, what would be the device path /dev/XXX?19:33
rfolco/dev/mapper/?19:34
ianw/dev/mapper/loop0p1 etc19:34
rfolcoI will confirm that, but still fails :)19:34
rfolcook, will make some more tests. Thanks for the braistorming, ianw19:35
ianwrfolco: so per https://review.openstack.org/#/c/447739/22/diskimage_builder/elements/bootloader/finalise.d/50-bootloader we *had* it working19:36
ianwusing grub-install to "p2" (so not the "boot" partition, as you say maybe misnamed)19:36
ianwand device mapper nodes19:36
rfolcohmm, grub-install should target the prep partition, and only loads the remaning modules from $root/boot/grub (p2). Not sure this really worked.19:39
ianwi'm sure mmedvede booted it19:40
ianwi'm pretty sure, i mean :)19:40
rfolcook, will re-test it to see what happens19:41
ianwrfolco: if you just take 447739 i guess it *should* work19:42
ianwthe problem there was, i just changed everything to use /dev/mapper/.... but didn't fix any of the cleanup19:43
mmedvederfolco: yeah, we got it working at some point with the grub that it installs19:43
mmedvedeI am 100% sure. It was not a pretty workaround to get it working, but it worked19:43
rfolcommedvede, did you boot it and grub loaded fine ?19:44
mmedvedeirrc, it booted into OS19:45
rfolcook19:45
rfolcoI will re-test it and let you guys know, thx19:46
mmedvederfolco: here is the log from when I tested the built image http://eavesdrop.openstack.org/irclogs/%23openstack-dib/%23openstack-dib.2017-03-22.log.html19:49
*** jamielennox has quit IRC20:34
*** jamielennox has joined #openstack-dib20:38
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Start at block-device mounting/unmounting cleanup  https://review.openstack.org/47118320:50
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Start at block-device mounting/unmounting cleanup  https://review.openstack.org/47118320:54
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Start at block-device mounting/unmounting cleanup  https://review.openstack.org/47118321:13
*** farosas has quit IRC21:23
*** pmannidi has joined #openstack-dib23:04

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!