| openstackgerrit | Merged openstack/diskimage-builder master: Stop using slave_scripts/install-distro-packages.sh https://review.openstack.org/563264 | 00:21 |
|---|---|---|
| *** phuongnh has joined #openstack-dib | 01:08 | |
| openstackgerrit | Merged openstack/diskimage-builder master: pip-and-virtualenv: fix install-pip when centos-release-openstack is enabled https://review.openstack.org/562936 | 02:07 |
| *** phuongnh has quit IRC | 02:28 | |
| *** phuongnh has joined #openstack-dib | 04:02 | |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder master: WIP: Docker matrix build https://review.openstack.org/414347 | 04:39 |
| *** pmannidi has quit IRC | 05:37 | |
| *** dhill__ has quit IRC | 05:43 | |
| *** hashar has joined #openstack-dib | 06:02 | |
| *** eshas has joined #openstack-dib | 06:03 | |
| eshas | hi | 06:03 |
| eshas | Iam using DIB today freshly downloaded | 06:04 |
| eshas | running into this error continuously and unable to create images | 06:04 |
| eshas | 2018-04-23 05:47:51.523 | ++ mktemp /home/esha/.cache/image-create/.download.XXXXXXXX 2018-04-23 05:47:51.524 | + tmp=/home/esha/.cache/image-create/.download.KqdUgX4c 2018-04-23 05:47:51.524 | + '[' 0 = 1 ']' 2018-04-23 05:47:51.524 | + '[' -f /home/esha/.cache/image-create/SHA256SUMS.ubuntu.xenial.ppc64el -a -s /home/esha/.cache/image-create/SHA256SUMS.ubuntu.xenial.ppc64el ']' 2018-04-23 05:47:51.524 | + success='Downloaded and | 06:04 |
| eshas | 2018-04-23 05:47:51.524 | + success='Downloaded and cached https://cloud-images.ubuntu.com/xenial/current/SHA256SUMS for the first time' 2018-04-23 05:47:51.524 | ++ curl -v -L -o /home/esha/.cache/image-create/.download.KqdUgX4c -w '%{http_code}' --connect-timeout 10 https://cloud-images.ubuntu.com/xenial/current/SHA256SUMS 2018-04-23 05:47:51.524 | /tmp/dib_build.QJ9N8ZVh/hooks/bin/cache-url: line 89: curl: command not found 201 | 06:05 |
| eshas | 2018-04-23 05:47:51.524 | + rcode= 2018-04-23 05:47:51.528 | + /home/esha/dib/diskimage-builder/diskimage_builder/lib/common-functions:run_d:1 : trap_cleanup 2018-04-23 05:47:51.530 | + /home/esha/dib/diskimage-builder/diskimage_builder/lib/img-functions:trap_cleanup:36 : exitval=1 2018-04-23 05:47:51.532 | + /home/esha/dib/diskimage-builder/diskimage_builder/lib/img-functions:trap_cleanup:37 : cleanup 2018-04-23 05:47:51.5 | 06:05 |
| eshas | whyis the curl command failing? | 06:06 |
| eshas | I have been using DIBand since friday running into this issue | 06:06 |
| eshas | @ianw @tonyb @clarkb | 06:06 |
| ianw | eshas: do you have curl installed on your builder? | 06:08 |
| eshas | hmm dowe have to explicitly? | 06:08 |
| eshas | let me try that | 06:08 |
| ianw | eshas: try running tests/install_test_deps.sh out of the dib source tree, it will install the things you need | 06:08 |
| eshas | also I am not able to get into env directly by cd /dib/env/bin - it needs me to run activate which wasnot the case before | 06:10 |
| eshas | ok, curl installed, going to run test... | 06:10 |
| ianw | clarkb / sean-k-mooney: dropped a comment on https://review.openstack.org/#/c/548958/4 about unicode / tracing / etc. currently more confuesd than ever | 06:10 |
| ianw | eshas: not sure what you mean by that. but you're best approach is to "source env/dib/bin/activate ; disk-image-create ..." | 06:11 |
| eshas | @ianw I installed curl, ran test for deps.. it installed fewbutremoved manythatare required by me.. might need to reset my setup :( | 06:18 |
| eshas | esha@neo160:~/dib/env/bin$ sudo DIB_RELEASE=xenial openssh-server DIB_DEV_USER_USERNAME=ubuntu DIB_DEV_USER_PASSWORD=passw0rd DIB_DEV_USER_PWDLESS_SUDO ./disk-image-create -a ppc64el -o ubuntu-xenial-vm1 -t raw -x vm ubuntu sudo: openssh-server: command not found | 06:18 |
| eshas | this is the commandI am trying | 06:18 |
| eshas | openssh-server is not getting recognised | 06:18 |
| eshas | also if I try to remove it then next error is DIB_DEV_USER_PWDLESS_SUDO not getting recognised as valid | 06:19 |
| eshas | are these 2elements to be used differently | 06:20 |
| ianw | DIB_* is an environment variable ... | 06:26 |
| ianw | i'd suggest you put this in a script, then run that script via sudo. that will probably be the easiest way to avoid issues with arguments to sudo | 06:26 |
| eshas | so DIB_OPENSSH_SERVER=1 ? | 06:26 |
| eshas | ok, I will | 06:26 |
| eshas | and DIB_DEV_USER_PWDLESS_SUDO=1 is required | 06:27 |
| eshas | let me make a script | 06:27 |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder master: WIP: Docker matrix build https://review.openstack.org/414347 | 06:38 |
| *** eshas has quit IRC | 06:39 | |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder master: IP: Docker matrix build https://review.openstack.org/414347 | 06:53 |
| *** pavel_V has joined #openstack-dib | 06:59 | |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder master: IP: Docker matrix build https://review.openstack.org/414347 | 07:03 |
| *** pavel_V has quit IRC | 07:10 | |
| *** pavel_V has joined #openstack-dib | 07:13 | |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder master: IP: Docker matrix build https://review.openstack.org/414347 | 07:26 |
| *** eshas has joined #openstack-dib | 08:36 | |
| *** phuongnh has quit IRC | 08:41 | |
| *** brault has joined #openstack-dib | 09:10 | |
| eshas | I created a vm using DIB : sudo DIB_RELEASE=xenial DIB_OPENSSH_SERVER=1 DIB_DEV_USER_USERNAME=ubuntu DIB_DEV_USER_PASSWORD=passw0rd DIB_DEV_USER_PWDLESS_SUDO=1 ./disk-image-create -a ppc64el -o ubuntu-xenial-vm1 -t raw -x vm ubuntu | 09:11 |
| eshas | The vm got createdwith a .d directory that has the /dib/env/bin/ubuntu-xenial-vm1.d/dib-manifests# ls dib_arguments dib_environment dib-manifest-dpkg-ubuntu-xenial-vm1 | 09:12 |
| eshas | whenItry to ssh to this vm, though it connects via ssh but password fails so cant enter | 09:13 |
| eshas | esha@neo160:~/dib/env/bin$ ssh 9.126.171.244 The authenticity of host '9.126.171.244 (9.126.171.244)' can't be established. ECDSA key fingerprint is SHA256:I8W1S1LJmD6Q0RIISEPalB46fo364HfscZUQd/sst48. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added '9.126.171.244' (ECDSA) to the list of known hosts. Password: Password: Password: Password: Connection to 9.126.171.244 closed by remote host. Conn | 09:14 |
| eshas | even viaVNC console Ubuntu login: comes up and I try to enter the username/password entered in env variables but login fails | 09:16 |
| eshas | (env) esha@neo160:~/dib/env/bin$ ssh ubuntu@9.126.171.244 Password: Password: Password: Password: Password: Password: Received disconnect from 9.126.171.244 port 22:2: Too many authentication failures for ubuntu Connection to 9.126.171.244 closed by remote host. Connection to 9.126.171.244 closed. | 09:19 |
| eshas | howdo I login to this vm? | 09:19 |
| eshas | @promethenfire @clarkb @tonyb @ianw? | 09:21 |
| eshas | Am really stuck at login since a week now | 09:29 |
| ianw | eshas: did you include the devuser element in the list? "vm ubuntu devuser"? | 09:45 |
| eshas | sudo DIB_RELEASE=xenial DIB_OPENSSH_SERVER=1 DIB_DEV_USER_USERNAME=ubuntu DIB_DEV_USER_PASSWORD=passw0rd DIB_DEV_USER_PWDLESS_SUDO=1 ./disk-image-create -a ppc64el -o ubuntu-xenial-vm1 -t raw -x vm ubuntu | 09:46 |
| eshas | this is where I specified DEV_USER value, do i need to give element again? | 09:46 |
| eshas | sudo DIB_RELEASE=xenial DIB_OPENSSH_SERVER=1 DIB_DEV_USER_USERNAME=ubuntu DIB_DEV_USER_PASSWORD=passw0rd DIB_DEV_USER_PWDLESS_SUDO=1 ./disk-image-create -a ppc64el -o ubuntu-xenial-vm1 -t raw -x vm ubuntu devuser openssh-server | 09:47 |
| eshas | youmeansomething like this? | 09:47 |
| ianw | eshas: yes, like that. you have environment variables (the capitals), but you need the actual elements listed to get picked up | 09:48 |
| eshas | ok, and if I create a script do I need to specify each environment variable eg: export DIB_DEV_USER_PASSWORD=passw0rdetc and just write commandinend like | 09:50 |
| eshas | ./disk-image-create -a ppc64el -o ubuntu-xenial-vm1 -t raw -x vm ubuntu devuser openssh-server | 09:50 |
| eshas | howdoI use all this in bash script | 09:51 |
| eshas | let me try with devuser element etc | 09:51 |
| ianw | eshas: you might need to read up on bash environment variables if it's not making sense | 09:51 |
| ianw | the things *after* disk-image-create are the elements. before that is environment variables set for the process by the shell, which are used within the elements | 09:52 |
| eshas | ok, i will also my network interface is not coming up with ip , i want to customize the cloud init I use | 09:52 |
| eshas | ok, thanks for clarifying, I didnt know that we hadto specify elements again | 09:52 |
| eshas | to delete a vm created by DIB, I can just remove the .raw and the .d created for it by DIB? | 09:56 |
| ianw | eshas: yes, but it should overwrite it as well | 10:06 |
| eshas | overwrite implies? | 10:07 |
| eshas | rm -rf .dand rm .raw | 10:07 |
| eshas | sudo DIB_RELEASE=xenial DIB_DEV_USER_USERNAME=ubuntu DIB_DEV_USER_PASSWORD=passw0rd DIB_DEV_USER_PWDLESS_SUDO=1 ./disk-image-create -a ppc64el -o ubuntu-xenial-vm4 -t raw -x vm ubuntu devuser openssh-server | 10:07 |
| eshas | trying with this now | 10:07 |
| eshas | still it is failing | 10:12 |
| eshas | (env) esha@neo160:~/dib/env/bin$ ssh ubuntu@9.126.171.246 ubuntu@9.126.171.246's password: Permission denied, please try again. | 10:12 |
| eshas | from VNC , bringing up network interface is failing | 10:15 |
| eshas | even on VNC console, ubuntu login: ubuntu and Password: passw0rd is giving invalid login credentials | 10:20 |
| eshas | this is after using devuser element separately | 10:20 |
| eshas | sudo DIB_RELEASE=xenial DIB_DEV_USER_USERNAME=ubuntu DIB_DEV_USER_PASSWORD=passw0rd DIB_DEV_USER_PWDLESS_SUDO=1 ./disk-image-create -a ppc64el -o ubuntu-xenial-vm4 -t raw -x vm ubuntu devuser openssh-server | 10:20 |
| eshas | and deploying image with this image | 10:20 |
| eshas | can I mount this image as is and chroot to login? or use guestfish? I am not seeing the how these elements help as they dont seem to be working for me | 10:22 |
| olivierb- | Hello dibers, Could someone please have a look at https://review.openstack.org/#/c/562535 and give comments, this would help me finalize the work on this. Many thanks | 10:29 |
| ianw | eshas: you can mount it with guestfish | 10:36 |
| eshas | @ianw yes,i think I need to go that way as devuser element is not working / allowing to login | 10:38 |
| eshas | nor via ssh | 10:38 |
| eshas | sudo DIB_RELEASE=xenial ./disk-image-create -a ppc64el -o ubuntu-xenial-vm4 -t raw -x vm ubuntu devuser openssh-server | 10:39 |
| eshas | will only try this and then guestfish to enter vm, lets see | 10:39 |
| eshas | My aim is to download cloud-img, install OS in RAW, createa vm from image- then configure customized cloud-init, ssh, firewall disable, MAC removal, .rules file removal and networksettings in cloud.cfg along with eth0 setup | 10:41 |
| eshas | https://docs.openstack.org/image-guide/openstack-images.html#no-hard-coded-mac-address-information - steps including and after this | 10:41 |
| eshas | forppc64el in ubuntu and rhel | 10:42 |
| eshas | I thought DIB could do all that in openstack env, but its not helping as much | 10:42 |
| ianw | eshas: i think it can, but as you are seeing there is a fair level of setup in all of this | 10:46 |
| ianw | eshas: if you want to run your command with "-x" and also specify a "--logfile" and then attach that logfile to a bug, it might be more helpful. it's very hard to say what's going on without build logs | 10:47 |
| eshas | ok, even guestfish is not able to open the .raw files | 10:51 |
| eshas | I do run with -x | 10:51 |
| eshas | let me try with --logfile also | 10:52 |
| eshas | sudo DIB_RELEASE=xenial DIB_DEV_USER_USERNAME=ubuntu DIB_DEV_USER_PASSWORD=passw0rd ./disk-image-create -a ppc64el -o ubuntu-xenial-vm5 -t raw -x vm ubuntu devuser openssh-server --logfile | 11:19 |
| eshas | is this how we specifythe log file? | 11:19 |
| ianw | i'd do "disk-image-create -x --logfile=out.log ..." | 11:26 |
| eshas | yeah I made a .txt | 11:29 |
| eshas | openinga bug | 11:29 |
| eshas | If I want to install OS with specific options then how doI do it via cloud-image? for examplefordiskpartitioning i use entire disk guided instead of LVM etc | 11:30 |
| eshas | here in cloudimages all that is automated | 11:30 |
| eshas | https://bugs.launchpad.net/diskimage-builder/+bug/1766228 | 11:52 |
| openstack | Launchpad bug 1766228 in diskimage-builder "Unable to login to ubuntu vm created by DIB" [Undecided,New] | 11:52 |
| eshas | this is the bug I created for issue in login to xenial image with latest DIB code | 11:53 |
| eshas | @ianw please take a look | 11:53 |
| ianw | eshas: put a comment, I'd try not using the username "ubuntu" because i think the cloud image already has that user. the devuser element may not reset it enough to log in. we should probably fail in devuser if we see there is already a user with that name? | 12:03 |
| eshas | I am trying with devuser currently | 12:34 |
| eshas | will update in few minutes | 12:34 |
| *** mjturek has joined #openstack-dib | 12:53 | |
| eshas | @ianw : devuser and passw0rd worked finally via VNC | 12:57 |
| eshas | however ifconfig shows that no ipv4 address is set on vm | 12:57 |
| *** dhill_ has joined #openstack-dib | 13:01 | |
| *** vmlinuz has joined #openstack-dib | 13:24 | |
| *** vmlinuz has joined #openstack-dib | 13:24 | |
| *** eshas has quit IRC | 13:42 | |
| *** rajinir has joined #openstack-dib | 15:08 | |
| *** pavel_V has quit IRC | 15:25 | |
| *** vmlinuz has quit IRC | 15:35 | |
| *** vmlinuz has joined #openstack-dib | 15:36 | |
| *** vmlinuz has joined #openstack-dib | 15:36 | |
| *** pavel_V has joined #openstack-dib | 16:00 | |
| *** pavel_V has quit IRC | 17:13 | |
| *** odyssey4me has joined #openstack-dib | 17:57 | |
| odyssey4me | o/ everyone - I've been experimenting with using diskimage-builder to build base rootfs tarballs which will be used for nspawn/lxc containers | 17:59 |
| odyssey4me | I did a little tweaking to the ubuntu-minimal element to make it.... minimal - because lxc/nspawn containers do not need a kernel installed (they inherit from the host). | 18:00 |
| odyssey4me | So I'm wondering what the right approach is here to prevent duplication - most of the element is fine, but it is certainly not minimal and can be reduced in a few areas... but obviously this is an established element name so I don't really want to muck with it. | 18:01 |
| clarkb | odyssey4me: ya I don't think you can change it at this point, however you are right minimal actually more accurately means "minimal as defined by default $distro bootstrap tool" and debootstrap gives you a kernel in that case | 18:01 |
| clarkb | odyssey4me: what I would probably do is rely on debootrap element like -minimal does and change the behavior with a different name | 18:02 |
| odyssey4me | well, as of today's packages on ubuntu xenial, I don't get a kernel - https://github.com/openstack/diskimage-builder/blob/master/diskimage_builder/elements/ubuntu-minimal/package-installs.yaml is giving me a kernel | 18:02 |
| clarkb | ubuntu-no-kernel | 18:02 |
| clarkb | odyssey4me: I think that was a relatively new change and debian itself gives you a kernel still? | 18:03 |
| clarkb | odyssey4me: but for backward compat the element has to be consistent? | 18:03 |
| odyssey4me | I haven't explored quite that far - I did see the note from pabelenger that in bionic it doesn't add an init at all | 18:03 |
| odyssey4me | but it doesn't note anything about kernels | 18:03 |
| clarkb | basically -minimal was a stand in for not having -minimal element | 18:04 |
| clarkb | and that implied kernel | 18:04 |
| odyssey4me | yeah, so I was thinking of adding a new one - say something like 'ubuntu-systemd-container' (or whatever) - and then moving some stuff from ubuntu-minimal into ubuntu-common to prevent duplicaiton | 18:04 |
| clarkb | ya I think something like that would work. Basically using ubuntu-mininal should give you consistent results over time but the background machinery can be moved into shared element | 18:05 |
| odyssey4me | ok, as long as that's an amenable approach I'll have a go at preparing a patch for it | 18:06 |
| *** noam__ has joined #openstack-dib | 18:24 | |
| *** noam__ has left #openstack-dib | 18:25 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/diskimage-builder master: Move common ubuntu environment setting to ubuntu-common element https://review.openstack.org/563731 | 18:34 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/diskimage-builder master: Move common ubuntu environment setting to ubuntu-common element https://review.openstack.org/563731 | 18:36 |
| *** vmlinuz has quit IRC | 18:51 | |
| *** vmlinuz has joined #openstack-dib | 18:51 | |
| *** vmlinuz has joined #openstack-dib | 18:51 | |
| *** rajinir has quit IRC | 19:08 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/diskimage-builder master: Remove redundant sources change/update https://review.openstack.org/563739 | 19:12 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/diskimage-builder master: Add ubuntu-systemd-container operating-system element https://review.openstack.org/563748 | 19:40 |
| *** pavel_V has joined #openstack-dib | 19:55 | |
| *** pavel_V has quit IRC | 20:11 | |
| *** mjturek has quit IRC | 20:38 | |
| *** mjturek has joined #openstack-dib | 20:40 | |
| *** mjturek has quit IRC | 20:44 | |
| *** rajinir has joined #openstack-dib | 20:45 | |
| *** pavel_V has joined #openstack-dib | 21:11 | |
| *** vmlinuz has quit IRC | 21:22 | |
| *** vmlinuz has joined #openstack-dib | 21:22 | |
| *** vmlinuz has joined #openstack-dib | 21:22 | |
| *** vmlinuz has quit IRC | 21:33 | |
| ianw | odyssey4me: i'll take a look, i feel like greghaynes has done some work on kernel-less images at one point | 21:37 |
| greghaynes | Yes a long time ago, I think I just ignored the kernel issue but I agree that should be fixed | 21:38 |
| greghaynes | Happy to look at patches for that | 21:39 |
| greghaynes | With the python3 stuff, something ive been wondering about is expressing default element-deps that can be overriden. For this case of not wanting a kernel then ubuntu-minimal could express a default dependency on a ubuntu-kernel element but another element (no-kernel) could element-provides ubuntu-kernel which would get noticed if added to the build and would prevent adding the normal ubuntu-kernel | 21:41 |
| greghaynes | element | 21:41 |
| greghaynes | clarkb: openstackgerrit I want to say when we had the bug where we were installing two kernel versions in ubuntu-minimal I fixed that by removing kernel from the initial debootstrap | 21:43 |
| greghaynes | er odyssey4me ^ | 21:43 |
| greghaynes | yea https://github.ibm.com/wrigley/icp-core/blob/master/icp_core/db/ipam.py#L94 | 21:43 |
| greghaynes | argh, https://github.com/openstack/diskimage-builder/blob/master/diskimage_builder/elements/ubuntu-minimal/package-installs.yaml#L1 | 21:43 |
| clarkb | ah that is why we do an explicit install later | 21:44 |
| clarkb | which should be fine if we move everything but that out of the -minimal element | 21:44 |
| clarkb | then -minimal can install a kernel and be on its way | 21:45 |
| greghaynes | clarkb: yea, what goes on is debootstrap doesnt have the smarts to pull in updates repos so once theres a newer kernel you install the original version in debootstrap then upgrade to the newer one | 21:45 |
| greghaynes | clarkb: yes, alternatively theres some flexibility since its package installs - could add a special installtype for 'nokernel' | 21:45 |
| greghaynes | not sure what option is going to be least pain | 21:46 |
| greghaynes | yea so if you wanted to not duplicate the ubuntu element we could add a package-installs flag "installtype_excludes" which means "dont install this package for this installtype". Then you could set installtype_excludes: nokernel in that ubuntu-minimal package-installs.yaml | 21:50 |
| greghaynes | at which point to use it you can DIB_INSTALLTYPE_ubuntu_minimal=nokernel | 21:51 |
| greghaynes | but also doing the common element / kernel and container element is fine *shrug* | 21:53 |
| *** hashar has quit IRC | 21:54 | |
| ianw | greghaynes: heh, i started writing that for mbr too. i wanted it to choose mbr as the default, but have it be able to be overwritten | 22:04 |
| greghaynes | ianw: yea, itd work great for the py3k stuff too I think | 22:05 |
| greghaynes | so maybe worth doing | 22:05 |
| *** pavel_V has quit IRC | 22:06 | |
| *** dhill_ has quit IRC | 22:14 | |
| ianw | it got too hard and i forget why. from memory i was thinking of having extra stuff after elements in elements-deps | 22:14 |
| ianw | so it was like | 22:14 |
| ianw | block-device : block-device-mbr | 22:14 |
| ianw | which meant "depends on block-device, but if none specified used block-device-mbr" | 22:14 |
| ianw | then i started pulling apart the element solving stuff to implement that, and it all got too hard iirc :) | 22:15 |
| *** dhill_ has joined #openstack-dib | 22:16 | |
| greghaynes | ahh fun | 22:21 |
| *** dhill_ has quit IRC | 22:34 | |
| *** dhill_ has joined #openstack-dib | 22:43 | |
| *** dhill_ has quit IRC | 22:54 | |
| *** dhill_ has joined #openstack-dib | 23:00 | |
| *** dhill_ has quit IRC | 23:38 | |
| *** dhill_ has joined #openstack-dib | 23:45 | |
| *** dhill_ has quit IRC | 23:53 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!