Friday, 2018-04-13

*** mjturek has quit IRC00:07
*** Sukhdev has quit IRC00:10
*** rajinir has quit IRC04:14
*** eshas has joined #openstack-dib04:17
*** andreas_s has joined #openstack-dib05:01
*** andreas_s has quit IRC05:06
*** mordred has quit IRC05:29
*** mordred has joined #openstack-dib05:41
*** andreas_s has joined #openstack-dib05:48
*** andreas_s has quit IRC05:48
*** andreas_s has joined #openstack-dib05:48
eshasHi06:43
eshasI have created a xenial RAW image from DIB and deployed it, but I cant login to it as it needs creds06:51
eshasalso its not pingable06:51
eshas@tonyb @ianw any clue?06:51
eshasI generated ssh keys too and provided public key on deploy , but how to give private key?06:52
eshasssh to ip fails saying cannot connect on port 2206:52
*** hashar has joined #openstack-dib06:53
ianweshas: what elements did you use?07:40
eshas:~/dib/env/bin$ sudo DIB_RELEASE=xenial ./disk-image-create -a ppc64el -o ubuntu-xenial -t raw -x vm ubuntu07:41
eshasto create RAW image07:41
eshascopied it to disk and imported, then on my server ssh-keygen -t rsa -f cloud.key to generate cloud.key.pub and cloud.key07:42
eshasI passed cloud.key.pub while creating vm from image07:42
eshasVM VNC console goes to Ubuntu login: which is not posible without creds07:43
eshasThus I am trying via server :07:44
eshaspvc4 ~]# ssh -o StrictHostKeyChecking=no -i cloud.key ubuntu@9.126.171.242                                                                                                             ssh: connect to host 9.126.171.242 port 22: No route to host07:44
eshasbut its failing to connect to vm07:44
eshasis openssh not installed via DIB ? or is there something else I am doing incorrect07:52
ianwi don't use the ubuntu element much; it's based on the upstream image which i think has ssh07:53
ianwyou might like to use guestfish to attach to the image and poke around in it07:53
ianwyou are booting this in an openstack cloud, right?07:54
eshasyes08:08
eshasopenstack08:08
eshas[root@pvc4 ~]# ssh -vvv -i cloud.key root@9.126.171.24208:08
eshasOpenSSH_7.4p1, OpenSSL 1.0.2k-fips  26 Jan 201708:08
eshasdebug1: Reading configuration data /etc/ssh/ssh_config08:08
eshasdebug1: /etc/ssh/ssh_config line 58: Applying options for *08:08
eshasdebug2: resolving "9.126.171.242" port 2208:08
eshasdebug2: ssh_connect_direct: needpriv 008:08
eshasdebug1: Connecting to 9.126.171.242 [9.126.171.242] port 22.08:09
eshasdebug1: connect to address 9.126.171.242 port 22: No route to host08:09
eshasssh: connect to host 9.126.171.242 port 22: No route to host08:09
eshasthis is the debug log i see08:09
eshasand how to assign the ip .. as thats done during OS installation normally but here install is automated08:10
ianweshas: before you go too much further; can you boot and log into a standard imgae like https://cloud-images.ubuntu.com/releases/16.04/release/ubuntu-16.04-server-cloudimg-amd64-disk1.img ?08:11
eshasbut  I have only ppc64 env08:12
ianwwell something like https://cloud-images.ubuntu.com/releases/16.04/release/ubuntu-16.04-server-cloudimg-ppc64el-disk1.img ?08:13
ianwit's just if your keys aren't in the cloud properly , or something like that, then it's going to be easier to figure out with a known good image from upstream08:14
eshasok, I thought Xenial would download this one only08:14
eshasjust that I need it to be in RAW else it was not booting in my env08:15
eshasimage does boot to Ubuntu login:08:18
eshasthats where I am stuck08:18
ianwright, do you see anything about cloud-init in the logs?08:29
ianwconsole log08:29
ianwit should put out something i think08:29
*** eshas has quit IRC09:06
*** eshas has joined #openstack-dib09:28
olivierb-Hello everyone, I have a potentially very basic question but after digging for a bit of time today on it I can not understand the in and outs of my issue or may be this is not an issue at all just something I missed. Here is the stuff: I have used DIB to successfully generate a ubuntu-minimal based image with LVM support that I use to provision a set of machines/VMs using Bifrost/Ironic and this  works wonderfully well. However when I09:30
olivierb- install some packages on those machines, these packages regenerate the initramfs and kernel but very strangely (at least from my perspective) the new ramdisk is missing a lot of stuff from my original (1 third in size) but also some other stuff added in the new one. Anyways the worse part is that this new ramdisk+kernel does not boot successfully as lvm and xfs drivers are not included (at minima). My question is therefore why does09:30
olivierb- this behaviour occur, may be this is not relevant to DIB itself and more a generic linux issue but as a Linux user I would (naively ?) expect that rebuilding a kernel/ramdisk from a working system should lead to a working situation09:30
olivierb-any pointer, advice, explanation, hint greatly appreciated09:31
*** pbourke has quit IRC10:15
*** pbourke has joined #openstack-dib10:16
ianwoliverb-: i hate to bear bad news but i've never heard of that before :/10:25
*** tflink has quit IRC10:34
*** tflink has joined #openstack-dib10:35
*** eshas has quit IRC11:18
*** tflink has quit IRC11:56
*** tflink has joined #openstack-dib11:58
*** tflink has quit IRC12:05
olivierb-ianw, no pb, please note I have been using yolanda advices to build my dib reference image but using dracut-regenerate not initramfs, may be this is (partly) where the issue may be. Do I need to provide my dib environment some extra infos so that the deployed image can be updated into idempotent image with same drivers/... ?12:10
olivierb-i meant debootstrap not initramfs of course12:11
*** tflink has joined #openstack-dib12:19
*** vmlinuz has joined #openstack-dib12:30
*** vmlinuz has joined #openstack-dib12:30
*** gaoyan has joined #openstack-dib12:41
*** gaoyan has quit IRC12:42
*** gaoyan has joined #openstack-dib12:48
*** tflink has quit IRC12:54
olivierb-while I am here any pointer to how to use debootstrap with LVM ?13:03
*** tflink has joined #openstack-dib14:12
*** rajinir has joined #openstack-dib14:17
*** mjturek has joined #openstack-dib14:21
*** gaoyan has quit IRC14:49
*** openstackgerrit has quit IRC14:50
*** andreas_s has quit IRC15:34
*** pavel_V has quit IRC15:50
*** hashar is now known as hasharAway16:24
*** eshas has joined #openstack-dib16:42
eshas@ianw - do we have logs in DIB? which console log?16:45
clarkbeshas: are you asking if the built images write a console log to a tty?17:10
clarkbor about logs for the image builds themselves?17:10
*** eshas has quit IRC17:28
*** eshas has joined #openstack-dib17:35
*** dhill_ has joined #openstack-dib17:35
eshasclarkb : the RAW ubuntu xenial image I built via DIB , and then deployed vm from it, I am not able to login to it as it asks for Ubuntu login17:37
eshasso I was thinking if there is any console log etc where I could see17:37
clarkbeshas: you'll either need to bake a user into the image (devuser element can be used for this) or rely on something like cloud-init or glean to configure user(s) on boot for you17:37
clarkbfor the console log yes you should be able to ask nova or virsh or whatever boot tool you used for the console log17:38
eshasok, i use nova, yes nova logs are there, but there isno error17:38
eshasdevuser allows user and password to be created?17:39
clarkbeshas: yes and ssh keys17:39
clarkbeshas: the openstack client can get console logs from nova17:39
*** dhill_ has quit IRC17:39
clarkbeshas: `openstack server console log $uuid` or similar (I'd have to check the help output)17:39
eshasI did generate a ssh key pair and passed public key while deploying vm17:39
*** dhill_ has joined #openstack-dib17:39
clarkbeshas: which ubuntu element did you use?17:40
clarkbeshas: ubuntu-minimal or ubuntu?17:40
eshasubuntu17:40
clarkbeshas: try ssh using that key as the ubuntu user17:40
eshas:~/dib/env/bin$ sudo DIB_RELEASE=xenial ./disk-image-create -a ppc64el -o ubuntu-xenial -t raw -x vm ubuntu17:40
eshashmm..you mean on login VNC console , use ssh key?17:41
eshasssh private key17:41
clarkbeshas: no using ssh client something like `ssh -i path_to_private_key ubuntu@server_ip`17:41
eshas[root@pvc4 ~]# ssh -vvv -i cloud.key root@9.126.171.24217:41
eshasOpenSSH_7.4p1, OpenSSL 1.0.2k-fips  26 Jan 201717:41
eshasdebug1: Reading configuration data /etc/ssh/ssh_config17:41
eshasdebug1: /etc/ssh/ssh_config line 58: Applying options for *17:41
eshasdebug2: resolving "9.126.171.242" port 2217:41
eshasdebug2: ssh_connect_direct: needpriv 017:41
eshasdebug1: Connecting to 9.126.171.242 [9.126.171.242] port 22.17:41
eshasdebug1: connect to address 9.126.171.242 port 22: No route to host17:41
eshasssh: connect to host 9.126.171.242 port 22: No route to host17:41
eshasok, let me try ubuntu user17:41
clarkbeshas: if there is no route to host chances are the ubuntu user won't work either17:43
eshas[root@pvc4 ~]# ssh -o StrictHostKeyChecking=no -i cloud.key ubuntu@9.126.171.24217:43
eshasssh: connect to host 9.126.171.242 port 22: No route to host17:43
clarkbeshas: I would check the console log from nova and see that networking is configured properly17:43
eshasyes, it didnt17:43
clarkbno route to host implies an netowrking issue17:43
clarkbcheck security groups17:43
eshasyes, so usually in OS installation , ip, dns,gateway etc is specified17:44
eshashere I couldnt do that as OS was automatically installed by DIB17:44
eshasbut I did specify the ip etc during nova boot17:44
clarkbeshas: right cloud-init is supposed to configure that for you on boot17:44
clarkband do so dynamically because you won't know what your IP is until after nova starts creating it17:45
eshasyes, but how do we specify cloud-init here17:45
clarkbeshas: I believe it is default part of the ubuntu elemnt (which is why I asked which element was used earlier)17:45
clarkbhowever considreing this is ppc there is also a chance it just isn't booting17:45
eshasok17:45
clarkb(I'm not sure how well that is tested)17:46
eshasif i virsh into it , it just hangs17:46
eshasthat i why i went via VNC, where ubuntu login: comes up17:46
clarkbeshas: you probably want to use the devuser element ot bake in a user you can vnc with then17:47
eshasok, let me chk devuser element17:47
eshas:~/dib/env/bin$ sudo DIB_RELEASE=xenial DIB_DEV_USER_USERNAME=user1 DIB_DEV_USER_USERNAME ./disk-image-create -a ppc64el -o ubuntu-xenial -t raw -x vm ubuntu17:53
eshassomething like this?17:53
clarkbeshas: you only need one DIB_DEV_USER_USERNAME, also I would set a password if accessing via vnc and you may want to enable sudo access too in order to help debug17:54
eshas:~/dib/env/bin$ sudo DIB_RELEASE=xenial DIB_DEV_USER_USERNAME=user1 DIB_DEV_USER_PASSWORD=<pwd>  ./disk-image-create -a ppc64el -o ubuntu-xenial -t raw -x vm ubuntu17:55
clarkbya that should wokr, but consider setting the sudo access flag too17:55
eshas:~/dib/env/bin$ sudo DIB_RELEASE=xenial DIB_DEV_USER_USERNAME=user1 DIB_DEV_USER_PASSWORD=<pwd> DIB_DEV_USER_PWDLESS_SUDO ./disk-image-create -a ppc64el -o ubuntu-xenial -t raw -x vm ubuntu17:55
eshasok,  this is what I will try now17:55
clarkbDIB_DEV_USER_PWDLESS_SUDO=117:55
clarkbor true or something17:55
eshasok17:56
eshaslet me try with yes, default is No17:56
*** Sukhdev has joined #openstack-dib17:57
eshas2018-04-13 18:03:16.140 | + time_cond='-z /home/neo/.cache/image-create/SHA256SUMS.ubuntu.xenial.ppc64el'18:03
eshas2018-04-13 18:03:16.140 | + success='Server copy has changed. Using server version of https://cloud-images.ubuntu.com/xenial/current/SHA256SUMS'18:03
eshas2018-04-13 18:03:16.141 | ++ curl -v -L -o /home/neo/.cache/image-create/.download.l16bj7PR -w '%{http_code}' --connect-timeout 10 https://cloud-images.ubuntu.com/xenial/current/SHA256SUMS -z /home/neo/.cache/image-create/SHA256SUMS.ubuntu.xenial.ppc64el18:03
eshas2018-04-13 18:03:16.151 |   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current18:03
eshas2018-04-13 18:03:16.151 |                                  Dload  Upload   Total   Spent    Left  Speed18:03
eshas  0     0    0     0    0     0      0      0 --:--:--  0:00:09 --:--:--     0* Resolving timed out after 10522 milliseconds18:03
eshas  0     0    0     0    0     0      0      0 --:--:--  0:00:10 --:--:--     018:04
eshas2018-04-13 18:03:26.673 | * Closing connection 018:04
eshas2018-04-13 18:03:26.673 | curl: (28) Resolving timed out after 10522 milliseconds18:04
eshas2018-04-13 18:03:26.674 | + rcode=00018:04
eshas2018-04-13 18:03:26.678 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/common-functions:run_d:1   :   trap_cleanup18:04
eshas2018-04-13 18:03:26.681 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/img-functions:trap_cleanup:36 :   exitval=118:04
eshas2018-04-13 18:03:26.683 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/img-functions:trap_cleanup:37 :   cleanup18:04
eshas2018-04-13 18:03:26.685 | + /home/neo/dib/diskimage-builder/diskimage_builder/lib/img-functions:cleanup:42   :   dib-block-device umount18:04
eshasthis is not downloading xenial and just exitting with 118:04
eshassudo DIB_RELEASE=xenial DIB_DEV_USER_USERNAME=root DIB_DEV_USER_PASSWORD=passw0rd DIB_DEV_USER_PWDLESS_SUDO=Yes ./disk-image-create -a ppc64el -o ubuntu-xenial1 -t raw -x vm ubuntu18:04
clarkblooks like a dns resolution timeout18:05
clarkbalso can you use a paste service for large pastes like that (paste.openstack.org or githbub gist or similar)18:05
eshasok, sure18:11
eshasbut its pointing to the same xenial cloud image18:12
clarkbeshas: yes your problem is local I think18:12
eshaslet me see18:12
clarkbyou can try running the curl yourself to see if you get a different result18:12
eshasyes, even the original simple DIB didnt work18:14
eshasi will chk the networking18:14
eshasdo you know if for sles also we can use DIB?18:15
clarkbeshas: you can for opensuse, unsure of sles18:15
eshasfor rhel I think cloud image is there18:15
eshasyeah, i couldnt find sles cloud images - so can iso be used directly?18:16
clarkbI don't think you can boot an iso with nova, but unsure18:17
eshasI need to use ubuntu, rhel and sles (i had iso for all) but just got to know about cloud images and DIB18:17
eshasso trying to use it to automate18:17
eshasbut I need my own custom cloud-init etc18:18
eshasand first step to get into vm (login) .. stuck since yest18:18
eshasonce in I can see if openssh is installed, firewall stuff, and cloud init for netwokring18:18
eshasclarkb:SO do you know the code flow on a higher level for DIB?18:19
clarkbeshas: yes, there are a series of run stages and each element can add scripts that are executed in order with run-parts for each run stage18:20
clarkbthen at the end dib converts the source content to your requested output image18:20
clarkbyou can in theory make an element to support sles, I'm just not sure anyone has done it yet18:20
eshasok .. i will check that18:20
clarkbthe rhel element might be a good example for how to get your keys/secrets in place18:20
eshashmm..ok.. i will chk that18:21
eshasi was only trying to make ubuntu work first18:21
eshasAlso there are tools like Oz , kickstart files, SuseStudio VeeWee ect18:22
eshasbut I found DIB more widely used .. not sure if thats the right track as I have a short runway18:22
clarkbfor x86 I'd definitely recommend it if needing to support many images because then one tool can do it all. I am not sure how well ppc is supported across all of those distros though18:23
eshasAutomate image creation in openstack env on ppc64le arch . Then customization of image also to b automated - cloudinit , epel etc18:24
eshasok, thats the issue, i could find ppc64le support in DIb only18:24
eshasrest tools https://docs.openstack.org/image-guide/create-images-automatically.html  didnt seem to have ppc64le18:25
clarkbya it is supported and people like tonyb have been caring for it18:26
mtreinisheshas: when tonyb is around he's a good person to talk to about ppc64le and openstack18:26
mtreinishheh, clarkb is too quick :)18:26
eshasyeah ianw has been helpful and tonyb also18:27
eshasclarkb was quick to reply today!18:27
eshasI will chk my network setup and retry and get back18:27
*** eshas has quit IRC18:53
*** pavel_V has joined #openstack-dib18:58
*** Sukhdev has quit IRC19:28
*** openstackgerrit has joined #openstack-dib20:13
openstackgerritFĂ©lix Bouliane proposed openstack/diskimage-builder master: Allow to pin ubuntu version rather than current  https://review.openstack.org/55916720:13
*** pavel_V has quit IRC20:19
*** pavel_V has joined #openstack-dib21:33
*** vmlinuz has quit IRC22:22
*** vmlinuz has joined #openstack-dib22:23
*** vmlinuz has joined #openstack-dib22:23
*** Sukhdev has joined #openstack-dib22:51
*** hasharAway has quit IRC22:58
*** dhill_ has quit IRC23:00
*** dhill_ has joined #openstack-dib23:07
*** mjturek has quit IRC23:15
*** vmlinuz has quit IRC23:37
*** Sukhdev has quit IRC23:54

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!