Monday, 2018-04-09

*** dhill_ has quit IRC01:06
*** dhill_ has joined #openstack-dib01:11
*** dhill_ has quit IRC01:23
*** dhill_ has joined #openstack-dib01:23
*** tonyb has joined #openstack-dib01:50
prometheanfireianw: fixed02:16
*** chhagarw has joined #openstack-dib04:07
*** andreas_s has joined #openstack-dib04:30
*** andreas_s has quit IRC04:35
*** andreas_s has joined #openstack-dib06:33
*** andreas_s has quit IRC06:42
*** ADMINIBM has joined #openstack-dib06:45
ADMINIBMHi, I am trying to automate vm creation in openstack based product and came across DIB,OZ and VeeWee along with other tools. I am using a ppc64 based environment - for now KVM on ppc64 arch and want to automate image creation for Linux flavors - RHEL, SLES and Ubuntu - I want to use the latest versions of these OS - for eg Ubuntu 18.04 to start with06:47
ADMINIBMI installed python-diskimage-builder and used sudo DIB_RELEASE=xenial disk-image-create -a ppc64el -o ubuntu-xenial.qcow2 -x vm ubuntu06:51
ADMINIBMThis did proceed to download the cloudimage and run pre-install script but failed saying no python in /bin/usr/env06:56
ADMINIBMI want to ask 1. If dib is the only tool with ppc64 arch support for image creation06:57
ADMINIBM2. does DIB use cloudimages for all RHEL , SLES and Ubuntu flavors or iso need to be used for latest versions image creation?06:57
*** hashar has joined #openstack-dib06:58
*** andreas_s has joined #openstack-dib07:26
rm_workthe LATEST for Ubuntu uses a tgz I think? But, IMO if you are building images for openstack clouds based on the standard distros, DIB is definitely what you want to be using...08:49
rm_workIt is the official tool AFAIU08:49
rm_workother projects inside openstack that build images all rely on DIB08:49
openstackgerritBharat Kunwar proposed openstack/diskimage-builder master: Fix yaml dependency issue with dracut-regenerate for python3  https://review.openstack.org/55849709:01
ADMINIBMhttps://cloud-images.ubuntu.com/bionic/current/09:10
ADMINIBMthis is the site for ubuntu 18.04 cloud images in which I want to use ppc64le09:10
ianwADMINIBM: dib does work with ppc64, and tonyb is the person to talk to probably09:20
ADMINIBM@ianw thanks, yes I saw DIB has ppc64le only for Ubuntu but even with that I was not able to disk-image-create bionic ubuntu 18.04 on ppc64le - it said it needed python although I have that installed09:22
ADMINIBM@tonyb could you provide inputs09:22
ianwADMINIBM: can you put a full log into pastebin or similar?09:24
ianwADMINIBM: also, maybe try "ubuntu-minimal" ... that actually builds things up from debootstrap, and may work better09:24
ADMINIBM:~/diskimage-builder$ sudo DIB_RELEASE=bionic disk-image-create -a ppc64el -o ubuntu-bionic.qcow2 -x vm ubuntu09:25
ADMINIBMthis is the command I used09:25
ADMINIBMI have installed python-diskimage-builder09:25
ADMINIBM+ true09:25
ADMINIBM+ case "$1" in09:25
ADMINIBM+ shift09:25
ADMINIBM+ break09:25
ADMINIBM+ export DIB_IMAGE_CACHE=/home/neo/.cache/image-create09:25
ADMINIBM+ DIB_IMAGE_CACHE=/home/neo/.cache/image-create09:25
ADMINIBM+ mkdir -p /home/neo/.cache/image-create09:26
ADMINIBM+ '[' '' = 1 -a /home/neo '!=' '' ']'09:26
ADMINIBM+ source /usr/bin/../share/diskimage-builder/lib/img-defaults09:26
ADMINIBM++ source /usr/bin/../share/diskimage-builder/lib/common-defaults09:26
ADMINIBM+++ '[' -f /etc/debian_version ']'09:26
ADMINIBM++++ dpkg --print-architecture09:26
ADMINIBM+++ _ARCH=ppc64el09:26
ADMINIBM+++ ARCH=ppc64el09:26
ADMINIBM+++ export ARCH09:26
ADMINIBM+++ export DIB_NO_TMPFS=009:26
ADMINIBM+++ DIB_NO_TMPFS=009:26
ADMINIBM+++ export DIB_MIN_TMPFS=209:26
ADMINIBM+++ DIB_MIN_TMPFS=209:26
ADMINIBM+++ _BASE_ELEMENT_DIR=/usr/bin/../share/diskimage-builder/elements09:26
ADMINIBM+++ ELEMENTS_PATH=09:26
ADMINIBM+++ export ELEMENTS_PATH=/usr/bin/../share/diskimage-builder/elements09:26
ADMINIBM+++ ELEMENTS_PATH=/usr/bin/../share/diskimage-builder/elements09:26
ADMINIBM+++ export DIB_OFFLINE=09:26
ADMINIBM+++ DIB_OFFLINE=09:26
ADMINIBM+++ [[ :/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin =~ :/sbin ]]09:26
ADMINIBM+++ [[ :/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin =~ :/usr/sbin ]]09:26
ADMINIBM+++ [[ :/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin =~ :/usr/local/sbin ]]09:26
ADMINIBM++ FS_TYPE=ext409:26
ADMINIBM++ export IMAGE_TYPE=qcow209:26
ADMINIBM++ IMAGE_TYPE=qcow209:26
ianwplease don't paste it in here...09:26
ADMINIBM++ export IMAGE_NAME=ubuntu-bionic.qcow209:26
ADMINIBM++ IMAGE_NAME=ubuntu-bionic.qcow209:26
ADMINIBM+ source /usr/bin/../share/diskimage-builder/lib/common-functions09:27
ADMINIBM+ source /usr/bin/../share/diskimage-builder/lib/img-functions09:27
ADMINIBM+ '[' 0 == 1 ']'09:27
ADMINIBM+ '[' -z 'vm ubuntu' ']'09:27
ADMINIBM+ arg_to_elements vm ubuntu09:27
ADMINIBM+ for arg in '"$@"'09:27
ADMINIBM+ IMAGE_ELEMENT=' vm'09:27
ADMINIBM+ for arg in '"$@"'09:27
ADMINIBM+ IMAGE_ELEMENT=' vm ubuntu'09:27
ADMINIBM+ '[' '' '!=' 1 ']'09:27
ADMINIBM+ IMAGE_ELEMENT='base  vm ubuntu'09:27
ADMINIBM+ '[' 0 == 1 ']'09:27
ADMINIBM+ echo 'Building elements: base  vm ubuntu'09:27
ADMINIBMBuilding elements: base  vm ubuntu09:27
ADMINIBM++ /usr/bin/element-info base vm ubuntu09:27
ADMINIBMTraceback (most recent call last):09:27
ADMINIBM  File "/usr/bin/element-info", line 21, in <module>09:27
ADMINIBM    sys.exit(main(sys.argv))09:27
ADMINIBMTypeError: main() takes no arguments (1 given)09:27
ADMINIBM+ IMAGE_ELEMENT=09:27
ADMINIBMoh ok, where is paste-bin/09:27
ADMINIBMsudo DIB_RELEASE=bionic disk-image-create -a ppc64el -o ubuntu-bionic.qcow2 -x vm ubuntu-minimal09:27
ADMINIBMgives same error09:27
ianwADMINIBM: paste.openstack.org is fine09:27
ianwADMINIBM: have you installed it?09:28
ianwin a virtualenv?09:28
ADMINIBMhttp://paste.openstack.org/show/718720/09:29
ADMINIBM have you installed it? - installed what ?09:29
ADMINIBMI have installed python-diskimage-builder in KVM on ppc64le09:30
ianwis that a system package?09:30
ADMINIBMThe base OS for KVM is 16.04 Ubuntu09:31
ianwhmm, i think that's probably the issue, you'll need to use from upstream09:31
ADMINIBMhttps://pypi.python.org/pypi/diskimage-builder/2.7.209:32
ianwADMINIBM: try https://docs.openstack.org/diskimage-builder/latest/developer/index.html#quickstart09:32
ADMINIBMyou mean clone it and then use disk-image builder09:33
ianwyes, follow those instructions to make a virtualenv and run it from in there09:35
ADMINIBMok, I created it and followed steps09:36
ADMINIBMlet me try xenial now09:37
ADMINIBMretried debian09:38
ADMINIBMsame error09:38
ADMINIBMhttp://paste.openstack.org/show/718721/09:39
*** andreas_s has quit IRC09:40
ianw /usr/bin/element-info09:45
ianwit's still using the system version09:45
ianwtry ./path/to/venv/bin/disk-image-create09:45
ADMINIBM./path/to/venv/bin/disk-image-create10:14
ADMINIBMwhats this?10:14
*** andreas_s has joined #openstack-dib10:16
ianwADMINIBM: i mean run the disk-image-create binary that is inside the virtualenv10:25
ADMINIBMeven if I go inside the directory , which was same10:32
ADMINIBM0:~/dib/diskimage-builder/diskimage_builder$ sudo DIB_RELEASE=bionic ./disk-image-create.py -a ppc64el -o ubuntu-bionic.qcow2 -x vm ubuntu-minimal10:32
ADMINIBMsudo: ./disk-image-create.py: command not found10:32
ADMINIBM.py file can be only run by python not as script10:33
ianwADMINIBM: no, it is a binary file10:33
ADMINIBMhmm..its listing as .py10:34
ianwwhere did you make the virtualenv?10:34
ADMINIBMin this path itself10:34
ADMINIBMI followed exact instructions that were there on site10:34
ianwthen you should be able to run "disk-image-create" and it will choose the one from the virtualenv10:35
ADMINIBM /home/neo/dib/diskimage-builder/diskimage_builder10:35
ianwno you want /home/neo/dib/bin/disk-image-create10:36
ianw"/home/neo/dib" is your virtualenv10:36
ADMINIBMI changed directory a bit and got to the env10:39
ADMINIBMrunning disk-image-create10:39
ianwmaybe uninstall the package to avoid any confusion10:41
ianwi have nothing against the package, but it's quite old and not kept up-to-date, just because our processes are all pretty much around running from master10:42
ADMINIBMok, i will uninstall python-diskimage-builder10:44
ADMINIBMgood news is :10:45
ADMINIBM2018-04-09 10:42:40.904 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/img-functions:compress_and_save_image:156 :   echo 'Converting image using qemu-img convert'10:45
ADMINIBM2018-04-09 10:42:40.905 | Converting image using qemu-img convert10:45
ADMINIBM2018-04-09 10:42:40.907 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/img-functions:compress_and_save_image:157 :   qemu-img convert -c -f raw -O qcow2 /tmp/dib_image.bgwnq2Jj/image0.raw ubuntu-bionic.qcow2-new10:45
ADMINIBM2018-04-09 10:43:21.626 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/img-functions:compress_and_save_image:160 :   OUT_IMAGE_PATH=ubuntu-bionic.qcow2-new10:45
ADMINIBM2018-04-09 10:43:21.628 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/img-functions:compress_and_save_image:161 :   finish_image ubuntu-bionic.qcow210:45
ADMINIBM2018-04-09 10:43:21.630 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/common-functions:finish_image:55 :   '[' -f ubuntu-bionic.qcow2 -a 0 -eq 0 ']'10:45
ADMINIBM2018-04-09 10:43:21.633 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/common-functions:finish_image:67 :   mv ubuntu-bionic.qcow2-new ubuntu-bionic.qcow210:45
ADMINIBM2018-04-09 10:43:21.636 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/common-functions:finish_image:68 :   '[' 0 == 1 ']'10:45
ADMINIBM2018-04-09 10:43:21.638 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/common-functions:finish_image:73 :   echo 'Image file ubuntu-bionic.qcow2 created...'10:45
ADMINIBM2018-04-09 10:43:21.638 | Image file ubuntu-bionic.qcow2 created...10:45
ADMINIBM2018-04-09 10:43:21.641 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/disk-image-create:main:540 :   '[' -n '' ']'10:45
ADMINIBM2018-04-09 10:43:21.643 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/disk-image-create:main:547 :   cleanup_image_dir10:45
ADMINIBM2018-04-09 10:43:21.645 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/common-functions:cleanup_image_dir:214 :   kill_chroot_processes /tmp/dib_image.bgwnq2Jj10:45
ADMINIBM2018-04-09 10:43:21.704 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/common-functions:cleanup_image_dir:215 :   tmpfs_check 010:45
ADMINIBM2018-04-09 10:43:21.707 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/common-functions:tmpfs_check:23 :   local echo_message=010:45
ADMINIBM2018-04-09 10:43:21.709 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/common-functions:tmpfs_check:24 :   '[' 0 == 0 ']'10:45
ADMINIBM2018-04-09 10:43:21.712 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/common-functions:tmpfs_check:25 :   '[' -r /proc/meminfo ']'10:45
ADMINIBM2018-04-09 10:43:21.715 | ++ /home/neo/dib/diskimage-builder/diskimage_builder/lib/common-functions:tmpfs_check:26 :   awk '/^MemTotal/ { print $2 }' /proc/meminfo10:45
ADMINIBM2018-04-09 10:43:21.719 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/common-functions:tmpfs_check:26 :   total_kB=26781004810:45
ADMINIBM2018-04-09 10:43:21.722 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/common-functions:tmpfs_check:29 :   RAM_NEEDED=410:45
ADMINIBM2018-04-09 10:43:21.724 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/common-functions:tmpfs_check:30 :   '[' 267810048 -lt 4194304 ']'10:46
ADMINIBM2018-04-09 10:43:21.726 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/common-functions:tmpfs_check:30 :   return 010:46
ADMINIBM2018-04-09 10:43:21.729 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/common-functions:cleanup_image_dir:216 :   timeout 120 sh -c 'while ! sudo umount -f /tmp/dib_image.bgwnq2Jj; do sleep 1; done'10:46
ADMINIBM2018-04-09 10:43:21.790 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/common-functions:cleanup_image_dir:221 :   rm -rf --one-file-system /tmp/dib_image.bgwnq2Jj10:46
ADMINIBM2018-04-09 10:43:21.793 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/disk-image-create:main:550 :   trap EXIT10:46
ADMINIBMubuntu-bionic.qcow2-new10:46
ADMINIBMseems to be new image10:46
ADMINIBMlet me see where its created10:46
*** dhill_ has quit IRC11:26
ADMINIBM@tonyb Hi, I am trying to automate vm creation in openstack based product and came across DIB,OZ and VeeWee along with other tools. I am using a ppc64 based environment - for now KVM on ppc64 arch and want to automate image creation for Linux flavors - RHEL, SLES and Ubuntu - I want to use the latest versions of these OS - for eg Ubuntu 18.04 to start with11:36
ADMINIBM<ADMINIBM> I installed python-diskimage-builder and used sudo DIB_RELEASE=xenial disk-image-create -a ppc64el -o ubuntu-xenial.qcow2 -x vm ubuntu11:36
ADMINIBM<ADMINIBM> This did proceed to download the cloudimage and run pre-install script but failed saying no python in /bin/usr/env11:36
ADMINIBM<ADMINIBM> I want to ask 1. If dib is the only tool with ppc64 arch support for image creation11:36
ADMINIBM<ADMINIBM> 2. does DIB use cloudimages for all RHEL , SLES and Ubuntu flavors or iso need to be used for latest versions image creation?11:36
ADMINIBM@ianw gave me inputs with which i could create ubuntu qcow2 image for bionic using :~/dib/env/bin$ sudo DIB_RELEASE=bionic ./disk-image-create -a ppc64el -o ubuntu-bionic.qcow2 -x vm ubuntu-minimal11:39
*** hwoarang has joined #openstack-dib12:12
*** ADMINIBM has quit IRC12:42
*** vmlinuz has joined #openstack-dib12:43
*** vmlinuz has joined #openstack-dib12:43
*** mjturek has joined #openstack-dib12:44
*** hwoarang has quit IRC12:57
*** hwoarang has joined #openstack-dib12:57
*** hwoarang has quit IRC13:35
*** chhagarw has quit IRC13:48
*** hwoarang has joined #openstack-dib15:14
*** ADMINIBM has joined #openstack-dib15:16
ADMINIBM@tonyb are you there?15:27
*** andreas_s has quit IRC15:28
ADMINIBM@ianw what is the storage media used for the images created by DIB15:28
ADMINIBM?15:29
*** andreas_s has joined #openstack-dib15:29
*** andreas_s has quit IRC15:38
*** andreas_s has joined #openstack-dib15:38
*** andreas_s has quit IRC15:43
*** andreas_s has joined #openstack-dib15:48
*** andreas_s has quit IRC16:06
*** andreas_s has joined #openstack-dib16:07
*** hashar has quit IRC16:10
*** ADMINIBM has quit IRC16:19
*** andreas_s has quit IRC16:20
*** andreas_s has joined #openstack-dib16:26
*** andreas_s has quit IRC16:35
*** dhill_ has joined #openstack-dib16:39
*** andreas_s has joined #openstack-dib16:40
*** hashar has joined #openstack-dib16:42
*** ADMINIBM has joined #openstack-dib16:43
*** dhill_ has quit IRC16:48
*** dhill_ has joined #openstack-dib16:48
*** andreas_s has quit IRC16:49
*** andreas_s has joined #openstack-dib16:54
*** dhill__ has joined #openstack-dib17:02
*** dhill_ has quit IRC17:03
*** andreas_s has quit IRC17:09
*** andreas_s has joined #openstack-dib17:28
*** andreas_s has quit IRC17:32
*** chhagarw has joined #openstack-dib17:42
*** ADMINIBM has quit IRC17:50
*** andreas_s has joined #openstack-dib18:00
*** andreas_s has quit IRC18:15
*** chhagarw has quit IRC18:45
*** chhagarw has joined #openstack-dib18:58
*** chhagarw has quit IRC20:45
*** vmlinuz has quit IRC21:04
ianwADMINIBM: tonyb and myself are in.au tz21:08
ianwoh, they've gone21:08
tonybianw: Yeah.21:12
ianwtonyb: well you get the gist, they were interested in ppc64 builds.  at least they seemed to get to the point of getting a .qcow2 out the other end, so hopefully enough to keep evaluating21:15
tonybYeah I got more deets in a PM.  They confused me with ppc64 vs ppc64{le,el} and they're interested in all the distros and of course you can't do RHEL without a subscription21:16
tonybI have no idea about *suse*21:16
*** vmlinuz has joined #openstack-dib21:21
*** vmlinuz has joined #openstack-dib21:21
*** vmlinuz has quit IRC21:22
*** hashar has quit IRC21:37

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!