Wednesday, 2017-03-22

mmedvededifferent error this time!00:00
*** cloudnull has quit IRC00:14
*** cloudnull has joined #openstack-dib00:14
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Create PReP boot partition for PPC  https://review.openstack.org/44773900:16
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [DNM] Test boot partition code  https://review.openstack.org/44809900:16
ianwok, that's trying to kpartx it just before we install grub00:17
ianwif grub installs to /dev/mapper devices but not /dev/loop devices, well that's a least a big clue00:17
mmedvedeianw: I think I see a bad copy paste, is it supposed to be TMP_IMAGE_PATH in 50-bootloader?00:18
ianwmmedvede: yes, i think so, that should be the .raw device00:19
mmedvedeoh, it is global from disk-image-create00:21
mmedvedeianw: /tmp/in_target.d/finalise.d/50-bootloader: line 28: TMP_IMAGE_PATH: unbound variable00:25
ianw:(00:25
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Create PReP boot partition for PPC  https://review.openstack.org/44773900:31
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [DNM] Test boot partition code  https://review.openstack.org/44809900:31
mmedvedeianw: also, is BOOT_DEVICE needs to be BOOT_DEV?00:34
ianwyeah, probably00:34
ianwlet's see if this mounts00:34
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Create PReP boot partition for PPC  https://review.openstack.org/44773900:37
mmedvedeianw: 50-bootloader: line 25: kpartx: command not found00:39
ianw?00:41
mmedvedehttp://dal05.objectstorage.softlayer.net/v1/AUTH_3d8e6ecb-f597-448c-8ec2-164e9f710dd6/pkvmci/diskimage-builder/99/448099/13/check/dib-dsvm-functests-devstack-xenial/75f4985/00:41
mmedvedeianw: it could not run kpartx from bootloader element00:41
ianwi mean how can that be00:41
mmedvedeyeah, it is installed00:42
mmedvedeianw: finalize step is in chroot, maybe it is only installed on host00:43
mmedvedeor I am getting it backwards00:44
mmedvederight, block-device is outside chroot, finalise is in chroot00:46
mmedvedeand TMP_IMG_DIR not accessible there00:48
ianwyeah, sigh00:51
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Create PReP boot partition for PPC  https://review.openstack.org/44773900:58
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [DNM] Test boot partition code  https://review.openstack.org/44809900:58
ianwstarting to clutch at straws here ...00:58
mmedvedeI think part of it is that there might be some confusion of when we are in chroot vs outside01:07
ianwhang on, now it's not failing in stable-vm01:12
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Create PReP boot partition for PPC  https://review.openstack.org/44773901:15
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [DNM] Test boot partition code  https://review.openstack.org/44809901:15
mmedvedewatching it live, got to stable-vm01:19
ianwmmedvede: it seemed to pass ...01:25
mmedvedeianw: so you clutching to straws did work :)01:25
ianwwell it would be nice if it didn't raise more questions than it answered :)01:26
mmedvedeianw: there is the strange warning "warning: unknown device type dm-1" during grub-install01:26
ianwyeah, that's in the host system though01:26
ianwno in the image (i think)01:26
mmedvedeianw: I'll test a full-blown dsvm image build in my env01:26
ianwi guess this suggests that grub-install only works on /dev/mapper, and probably has something to do with the probe paths01:27
ianwi mean the way it probes paths01:28
mmedvedeif that is the reason, that would mean it is prone to breaking again01:29
mmedvedeok, I am building a full image now. Would test if it is bootable too01:32
ianwmmedvede: great, let me know.  grabbing some lunch, i'll think on it a bit ...01:48
mmedvedeianw: thanks. which tz are you?01:48
mmedvedeit is 21:00 where I am01:49
mmedvedeI am guessing somewhere in aus :)01:51
mmedvedeianw: the image dib built on ppc is good. VM boots02:05
ianwmmedvede: yes, sydney .au02:50
ianwok, that's good!  well, now to figure out what to do ...02:50
*** aparnav has joined #openstack-dib03:32
*** Administrator_ has joined #openstack-dib04:38
*** zhugaoxiao has quit IRC04:41
*** chhavi has joined #openstack-dib05:02
*** chhavi has quit IRC05:15
*** chhavi has joined #openstack-dib05:16
*** chhavi has quit IRC05:21
ianwoohh, i have another idea ...05:35
ianwi'll update the bug05:35
*** venki has quit IRC07:42
*** venki has joined #openstack-dib07:42
*** andreas-f has quit IRC07:48
*** hashar has joined #openstack-dib08:19
*** venki has quit IRC08:23
*** chhavi has joined #openstack-dib09:28
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Add lvm management to diskimage-builder  https://review.openstack.org/44440309:49
*** venki has joined #openstack-dib10:42
openstackgerrityolanda.robla proposed openstack/diskimage-builder master: Fix typo in CMDLINE env var for bootloader  https://review.openstack.org/44850811:02
*** hashar is now known as hasharLunch11:08
*** chhavi has quit IRC11:13
*** venki has quit IRC11:18
*** venki has joined #openstack-dib11:19
*** aparnav has quit IRC12:02
*** venki has quit IRC12:19
*** venki has joined #openstack-dib12:19
*** hasharLunch is now known as hashar13:05
*** mgould has joined #openstack-dib13:17
mgouldhi everyone! could someone please review https://review.openstack.org/#/c/344214/ ? It has one +2 and green CI13:17
*** venki has quit IRC13:25
*** venki has joined #openstack-dib13:25
*** chhavi has joined #openstack-dib13:31
*** venki has quit IRC14:05
*** venki has joined #openstack-dib14:05
*** chhavi has quit IRC14:25
openstackgerritDan Radez proposed openstack/diskimage-builder master: Adding aarch64 support for CentOS7  https://review.openstack.org/42223214:47
*** qwebirc12229 has joined #openstack-dib15:19
qwebirc12229diskimage-builder centos715:19
qwebirc12229how to do15:20
mgouldqwebirc12229: disk-image-create -o [output image name] centos [other elements to include]15:29
*** qwebirc12229 has quit IRC15:51
*** chhavi has joined #openstack-dib16:16
*** hashar has quit IRC17:29
*** mgould is now known as mgould|afk18:18
*** chhavi has quit IRC18:49
*** andreas-f has joined #openstack-dib19:26
*** hashar has joined #openstack-dib19:40
ianwandreas-f: when you get a minute, could you look at https://bugs.launchpad.net/diskimage-builder/+bug/1674402 ... i have a question in there about using /dev/mapper20:20
openstackLaunchpad bug 1674402 in diskimage-builder "bootloader element fails to install grub on ppc64 platform" [Undecided,In progress] - Assigned to Ian Wienand (iwienand)20:20
*** hashar has quit IRC20:23
*** hashar has joined #openstack-dib20:23
andreas-fiamw: I already read this.20:24
andreas-fMy current idea is to unify this.20:24
andreas-fe.g. use kpartx *for all*20:24
andreas-f(and drop partprobe)20:25
andreas-fDo you know why there were (are) two ways of handling partitions?20:25
openstackgerritAndreas Florath proposed openstack/diskimage-builder master: Use stevedore for module config of block device  https://review.openstack.org/44709020:27
ianwandreas-f: no, i don't really know why20:29
ianwit seems it has just always been this way20:29
andreas-fI run some tests on Ubuntu: both ways are working there.20:29
andreas-fCan we get more PowerKVM machines: the CI finished in 6:30! ;-)20:36
mmedvedeandreas-f: it is not running a full set of tests :)20:38
mmedvedebut I hope I can expand the coverage20:38
andreas-fIt does not build any 'vm' image? (Or do I miss something?)20:41
andreas-f(Would be nice to have, because this really triggers the partitioning code...)20:42
ianwandreas-f: we've been testing with https://review.openstack.org/#/c/448099/20:42
mmedvedePowerKVM CI only runs partial functional test, and functional testing does not use vm element. That's the reason for ^20:42
ianwandreas-f: i don't see where the code takes the results of kpartx?  _notify_os_of_partition_changes() calls ... won't we need to parse the result to find out where the partitions are?20:43
andreas-fIs the test 'just' a build test - or is there also a test where the image is really started?20:43
andreas-fThe current code is mostly a port of an 'old' bash script.20:44
ianwmmedvede did report that a built image booted20:44
mmedvedeandreas-f: at the moment yes. I'd need to add nodepool job to test the VM booting20:44
andreas-fAnd it looks that nobody really knows why it is written as it is.20:45
ianwthat's about right it seems20:46
andreas-fianw: do you mind when I remove the 'partprobe' and 'udevadm' in https://review.openstack.org/#/c/447739/17/diskimage_builder/block_device/level1/partitioning.py?20:49
andreas-fWant to see the CI result for this.20:49
openstackgerritAndreas Florath proposed openstack/diskimage-builder master: Create PReP boot partition for PPC  https://review.openstack.org/44773921:00
bkeroianw: ever figure out the prep partitoin thing?21:03
ianwbkero: sort of https://bugs.launchpad.net/diskimage-builder/+bug/1674402/comments/621:11
openstackLaunchpad bug 1674402 in diskimage-builder "bootloader element fails to install grub on ppc64 platform" [Undecided,In progress] - Assigned to Andreas Florath (ansreas)21:11
ianwandreas-f: sure.  will pull that apart into some separate changes in a bit21:11
openstackgerritIan Wienand proposed openstack/diskimage-builder master: [DNM] Test boot partition code  https://review.openstack.org/44809921:12
andreas-fOne technical question for the PPC change: Is this correct that the partition 0 will not be mounted at all?21:17
andreas-f(So no data?)21:18
andreas-fWhere does it get the kernel / initramfs from?21:18
andreas-fMust this be a special (e.g. second) partition?21:19
ianwandreas-f: aiui this is for openfirmware code21:20
ianwgrub copies it in21:20
ianwhttps://www.ibm.com/developerworks/community/wikis/home?lang=en#!/wiki/W51a7ffcf4dfd_4b40_9d82_446ebc23c550/page/PowerLinux%20Boot%20howto does explain it a bit21:21
ianwopenfirmware looks for a prep typed partition that has stage 1 code21:22
ianwthat page also does say to grub-install to /dev/sda1 ... however when i tried installing it to /dev/loop0p1 (the prep partition) it failed21:24
andreas-fMaybe I'm missing something, but this does not explain where the kernel and ramdisk have to be.21:24
andreas-fI'm asking because currently it is not possible to have a separate /boot and / partition for the other architectures (because there is the need to change the bootloader element for this) - but this should be implemented (as Yolanda requested this).21:24
andreas-fFound it: looks the /boot partition is not needed (but possible).21:26
ianwyeah, i guess only if your root is something sufficiently weird grub can't read it21:30
openstackgerritAndreas Florath proposed openstack/diskimage-builder master: Create PReP boot partition for PPC  https://review.openstack.org/44773922:08
andreas-fCI is green: removed the partprobe and udevsettle - but I'm not sure if this was really tested....22:09
andreas-ffor 448099 it's not green:22:10
andreas-f2017-03-22 21:30:01.704209 | [debian-minimal/stable-vm] /usr/sbin/grub-install: error: cannot find a GRUB drive for /dev/mapper/loop0.  Check your device.map.22:10
openstackgerritMikhail S Medvedev proposed openstack/diskimage-builder master: [DNM] Test boot partition code  https://review.openstack.org/44809922:17
mmedvedethe 448099 tests the partitioning. If it is not green, something is broken22:18
andreas-fYes - it looks that for other systems grub does not like /dev/mapper22:19
ianwurgh22:24
andreas-fWas a problem in the code: the /dev/loopX is still the same - only the partitions are mapped to /dev/mapper/loopXpY.22:28
andreas-fHad to 'adapt' disk-image-build...22:28
*** pmannidi has quit IRC22:29
andreas-fLocal test succeeds:22:30
andreas-f+ /usr/sbin/grub-install '--modules=biosdisk part_msdos' --force /dev/loop322:30
andreas-fInstalling for i386-pc platform.22:30
andreas-fInstallation finished. No error reported.22:30
openstackgerritAndreas Florath proposed openstack/diskimage-builder master: Create PReP boot partition for PPC  https://review.openstack.org/44773922:31
andreas-fThis should eliminate the special case handling in disk-image-create.22:31
andreas-fThe last 'special' handling for PPC remains in 5ß-bootloader.22:33
andreas-fAnd I have currently no idea how to clean this up...22:33
andreas-fOne possibility to leave this now hackish (as it was) and always assume that this is partition 0 of the IMAGE_BLOCK_DEVICE (a sed should do).22:39
andreas-fThe next steps would be to merge https://review.openstack.org/#/c/444586/ (Creates the base for disk-image base queries).22:41
andreas-fAdd another patch that adds a get-boot-dev function to dib-block-device...22:42
andreas-f... and use this in bootloader.22:42
andreas-fThe device where the [boot] flag is set should be returned.22:42
ianwyeah, or just the one named "boot" :)22:43
andreas-fAnd a last step: change the bootloader element to use this.22:43
andreas-fThis should then enable also the possibility to have a separate /boot partition on all systems.22:44
ianwwhich helps yolanda with the lvm stuff too, right?22:44
andreas-fNo - lvm is separated from this.22:45
andreas-fBut what I understood is that she needs a separate /boot partition because of some security policy22:45
andreas-f(maybe I misunderstood.)22:45
ianwoh, ok22:45
andreas-fWould this be a way to go?22:46
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Capture output in _exec_sudo  https://review.openstack.org/44881022:46
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Add default PPC block-device layout  https://review.openstack.org/44881122:46
ianwi thought you'd probably want a plain old /boot if you've got lvm for root, but may also be wrong22:46
andreas-fGrub *can* boot from LVM ;-)22:47
ianwi think ^^ can stand-alone at this point, trying to reduce the change load22:47
ianwyeah, i guess it can; although maybe when you start adding things like luks encryption that's where it fails22:48
andreas-fHere it is nearly midnight and I have to go to sleep... Will just look through your patches.22:48
ianwandreas-f: np, thanks.  i think we're moving in the right direction, anyway22:49
*** pmannidi has joined #openstack-dib22:51
*** pmannidi has quit IRC22:51
*** pmannidi has joined #openstack-dib22:52
*** pmannidi has quit IRC22:52
*** pmannidi has joined #openstack-dib22:52
andreas-fgood night.22:54
*** hashar has quit IRC23:01
*** andreas-f has quit IRC23:11

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!