| *** pmannidi has joined #openstack-dib | 00:10 | |
| *** mjturek has quit IRC | 00:19 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Don't only install python3-virtualenv https://review.openstack.org/559871 | 00:57 |
|---|---|---|
| ianw | greghaynes: ^ one to look at | 00:58 |
| greghaynes | hrmm | 00:59 |
| greghaynes | im a bit sad we ended up in a place where we have to support something different than distro defaults | 00:59 |
| greghaynes | but it is what it is | 00:59 |
| ianw | greghaynes: it's a bit of a mess, because you can't really split it into a v2 & v3 element, because they both want to own /usr/bin/pip / /usr/bin/virtualenv | 01:05 |
| ianw | we have to do all that funky ordering in there to make sure /usr/bin/pip == v2 and then we have /usr/bin/pip3 | 01:05 |
| clarkb | next pip release may make it worse too :/ | 01:06 |
| greghaynes | yeah, maybe we can just wait a few years and then just ignore v2 on distros which dont package it ;) | 01:06 |
| ianw | clarkb: i'm not sure if this particular thing gets worse, because pip10 will only refuse to uninstall distutils installed packages, and i don't think the system virtualenv is? | 01:10 |
| clarkb | I think on a lot of systems it is | 01:11 |
| clarkb | like suse :/ | 01:11 |
| *** dhill__ has quit IRC | 01:12 | |
| *** dhill_ has joined #openstack-dib | 01:13 | |
| *** dhill_ has quit IRC | 01:14 | |
| *** dhill_ has joined #openstack-dib | 01:15 | |
| *** dhill_ has quit IRC | 01:17 | |
| ianw | clarkb: yeah, in this case, i think we're ok ... /usr/lib/python2.7/dist-packages/virtualenv-15.0.1.egg-info/top_level.txt exists | 01:21 |
| ianw | http://paste.openstack.org/show/718773/ | 01:21 |
| ianw | tonyb: mind a sanity check over https://review.openstack.org/#/c/559084/ ... touching the dhcp timeout thing again | 01:32 |
| tonyb | ianw: Hmm okay, I see what it's doinng but I need to think about why the existing timeout handling is inadequate and does this new code make the existing stuff obselete? | 01:35 |
| ianw | tonyb: my understanding was that the existing timeout kind of depends on the link not being there; while this is more a case of the link is up, but the dhclient won't get a response | 01:53 |
| tonyb | Yeah that makes sense. | 01:54 |
| *** andreas_s has joined #openstack-dib | 02:32 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Don't only install python3-virtualenv https://review.openstack.org/559871 | 02:34 |
| *** andreas_s has quit IRC | 02:37 | |
| *** ADMINIBM has joined #openstack-dib | 03:50 | |
| *** ADMINIBM has quit IRC | 04:06 | |
| *** ADMINIBM has joined #openstack-dib | 04:07 | |
| *** strigazi has quit IRC | 04:11 | |
| *** strigazi has joined #openstack-dib | 04:14 | |
| *** chhagarw has joined #openstack-dib | 04:32 | |
| *** ADMINIBM has quit IRC | 04:50 | |
| *** ADMINIBM has joined #openstack-dib | 04:56 | |
| *** strigazi_ has joined #openstack-dib | 05:13 | |
| ADMINIBM | Hi, I want to build Ubuntu xenial 16.04 iso via DIB. Does DIB support local iso building? | 05:14 |
| *** strigazi has quit IRC | 05:17 | |
| ianw | ADMINIBM: yes, but it's probably less used than generating a .qcow2 | 05:48 |
| ianw | there is an iso element; afaik it's mostly used by ironic | 05:50 |
| ADMINIBM | @ianw that is ok, I have to just try if it creates a .img from iso, that too should be ok | 05:50 |
| ADMINIBM | oh | 05:50 |
| ADMINIBM | so cant be used in openstack directly | 05:50 |
| ianw | what do you want the image for? | 05:51 |
| ADMINIBM | For Ubuntu on ppc64le env, my basic requirement is to automate OS installation and cloud init and copy image then to my storage disk, and use for deploys and other functions in a private cloud product | 05:52 |
| ADMINIBM | thus I was trying to use DIB | 05:52 |
| ADMINIBM | The IaaS product is openstack based and supports KVM..that is where I installed virtualenv | 05:54 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder master: new diskimage-build command with config https://review.openstack.org/554002 | 05:54 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder master: Move fail early checks in to python https://review.openstack.org/555462 | 05:54 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder master: Move environment create/cleanup to python https://review.openstack.org/555463 | 05:54 |
| ianw | ADMINIBM: so basically you want to customise and build an image, upload it into glance then boot that image for various testing? | 05:55 |
| ADMINIBM | yes, correct | 05:55 |
| ianw | in that case, i'd image you'd be better off with a .qcow2 or .raw image, rather than an iso | 05:56 |
| ADMINIBM | till now we use iso for all Linux versions -Ubuntu,SLES and RHEL for ppc64 and build manually , OS install, cloud-init etc and then use the image | 06:00 |
| ADMINIBM | we save off the .img | 06:00 |
| ianw | 2018-04-10 05:16:02.819488 | controller | + tools/check_devstack_plugin.sh:sshintonode:43 : [[ 5364449280 -lt 5364514816 ]] | 06:07 |
| ianw | urgh ... why is this 64mb out? | 06:07 |
| ianw | ADMINIBM: perhaps you want to look at nodepool? https://docs.openstack.org/infra/nodepool/ | 06:09 |
| ianw | it does a very similar thing | 06:09 |
| ADMINIBM | @ianw : Nodepool uses Python 3.7 and doesnt support ppc64 | 06:17 |
| ADMINIBM | so i dont think that can be used | 06:18 |
| ianw | ADMINIBM: it does use python3 in the latest versions, that's true | 06:20 |
| tonyb | ADMINIBM: when you say ppc64 do you mean ppc64 or ppc64{le,el} | 06:20 |
| ianw | i think it could support ppc64 -- it doesn't really care underneath. it just builds images using dib and uploads them to clouds | 06:20 |
| ianw | we have it working with arm64 | 06:20 |
| ADMINIBM | ppc64le - power server based - HMC,Novalink and KVM | 06:21 |
| ADMINIBM | @tonyb | 06:21 |
| tonyb | ADMINIBM: okay that'll work (perhaps there are a few bugs) but ppc64 will not ;p | 06:21 |
| ADMINIBM | you mean that -> implies DIB? | 06:22 |
| ADMINIBM | yes, I have come down to DIB after comparing with Oz,VeeWee and many other tools | 06:23 |
| tonyb | ADMINIBM: Yeah, I use DIB on ppc64le (mostly .rpm based distros) and it works for me | 06:23 |
| ADMINIBM | DIB was only one for ppc64le | 06:23 |
| tonyb | You may run into issues with *suse* as that isn't somethign that's used at all, but it shoudl work (with fixes) | 06:24 |
| ADMINIBM | I have to use for all linux versions - Ubuntu provides iso for ppc64le as well as cloud images .img | 06:24 |
| ADMINIBM | RHEL and SLES we only have .iso for ppc64le as cloud images support only x86_64 | 06:24 |
| ADMINIBM | that is why I am trying to find if DIB can be used with with iso | 06:25 |
| tonyb | ADMINIBM: I don't follow that statement. RHEL has generic guest images for x86_64 and ppc64le (centos currently doesn't) but that's a different issue | 06:25 |
| ADMINIBM | where are ppc64le cloud-images for RHEL and SLES? | 06:26 |
| tonyb | ADMINIBM: if you have a RHEL subscription they | 06:26 |
| ADMINIBM | I saw on redhat site and suse sites and couldnt find | 06:26 |
| tonyb | 'll show up in a similar place to the x86_64 ones | 06:26 |
| tonyb | I have no idea about SLES (well *suse* | 06:27 |
| ADMINIBM | hmm.. I have checked there with license subscription | 06:27 |
| tonyb | ADMINIBM: okay | 06:27 |
| tonyb | ADMINIBM: but we can probably make forward progress with Ubuntu. | 06:27 |
| ADMINIBM | yes, opensuse has x86_64 and they tell to use SuSeStudio for sles | 06:28 |
| tonyb | Do you have the command line you're using and the failure? | 06:28 |
| ADMINIBM | for iso? | 06:28 |
| ADMINIBM | till now I have only been able to create virtual env and then use DIB for .img cloud image of ubuntu 1804 to .qcow2 | 06:29 |
| *** andreas_s has joined #openstack-dib | 06:29 | |
| tonyb | ADMINIBM: okay so you want to start with the (ubuntu) cloudimg and customise it and then generate a .iso from the result? | 06:30 |
| ADMINIBM | (env) neo@neo160:~/dib/env/bin$ sudo DIB_RELEASE=bionic ./disk-image-create -a ppc64el -o ubuntu-bionic.qcow2 -x vm ubuntu-minimal | 06:30 |
| tonyb | Oh okay I see | 06:31 |
| tonyb | ADMINIBM: so try adding 'iso' after the ubuntu-minimal | 06:31 |
| ADMINIBM | I actually want to use .iso as input | 06:31 |
| tonyb | Oh now I'm confused | 06:32 |
| tonyb | You want to take an ubuntu install ISO and use DIB to generate a cusomised .qcow2? | 06:32 |
| ADMINIBM | For Ubuntu on ppc64le env, my basic requirement is to automate OS installation and cloud init and copy image then to my storage disk, and use for deploys and other functions in a private cloud product | 06:32 |
| ADMINIBM | till now all this is done manually | 06:32 |
| ADMINIBM | that is why i want to use DIB | 06:33 |
| tonyb | Where does the ISO fit into that statement? | 06:33 |
| tonyb | ADMINIBM: Sorry I'm just not follwoing? | 06:33 |
| ADMINIBM | I can take the input as .img cloud image or .iso for Ubuntu as Canonical provides the .img for ppc64le | 06:34 |
| ADMINIBM | but for rhel and sles I have to use input as .iso as no .img available for ppc64le AFAIK | 06:34 |
| tonyb | ADMINIBM: okay, well as I said I can't comment about anything to do with DIB and *suse*, but for both Ubuntu and RHEL you can start with a cloud image and use DIB to customise that (and I know that works on RHEL as I do it regularly) | 06:37 |
| tonyb | So given that | 06:37 |
| ADMINIBM | where do you get the cloud image for ppc64 for RHEL? | 06:38 |
| tonyb | I believe that your problem statement is: | 06:38 |
| tonyb | I'd like to start with the vendor provided cloud images and use DIB to customise them to generate a .XXX image that I can use as a golden master for my cloud product | 06:38 |
| ADMINIBM | http://cloud-images.ubuntu.com/ is for ubuntu ppc64 | 06:38 |
| tonyb | Is that correct? | 06:39 |
| tonyb | If so can you pick eith .qcow2 or .iso for .XXX and let me know | 06:39 |
| ADMINIBM | yes, its sort of correct - my actual statement is to automate image creation from iso on ppc64 | 06:39 |
| ADMINIBM | for all linux versions | 06:40 |
| tonyb | ADMINIBM: As I said before it'll show up in your subscriptions, you'll need to check you have the correct entitlements | 06:40 |
| ADMINIBM | ok, then i will check on that , cause we do have a valid subscription | 06:40 |
| tonyb | ADMINIBM: okay so we're talking in circles. I say one thing and then you reverse it and say I'm correct | 06:40 |
| ADMINIBM | no no, :) | 06:41 |
| tonyb | I can't help you if we can't agree on what you're trying to achieve and what problem youre hitting | 06:41 |
| ADMINIBM | I could not find any ppc64le image for redhat | 06:41 |
| tonyb | ADMINIBM: okay please ignore that for now | 06:41 |
| ADMINIBM | now that you are saying it exists, i will try to check with my license and vendor | 06:41 |
| tonyb | ADMINIBM: let's just focus on Canonical and Ubuntu | 06:41 |
| ADMINIBM | my main aim is to automate OS installation and cloudinit , ssh ,etc type of customizations - that is how i researched and found DIB | 06:42 |
| tonyb | Okay | 06:42 |
| tonyb | DIB shoudl be able to help with that | 06:43 |
| ADMINIBM | and ofcourse all this on ppc64le | 06:43 |
| ADMINIBM | in openstack | 06:43 |
| tonyb | Yes I get that. | 06:43 |
| tonyb | Okay. | 06:43 |
| tonyb | So I'll try again to state the aim. | 06:43 |
| ADMINIBM | https://review.openstack.org/#/c/453803/ | 06:44 |
| tonyb | You'd like to use the vendor provided cloud image and customise it to generate a .qcow2 file for use with your cloud product | 06:45 |
| ADMINIBM | yes | 06:45 |
| tonyb | ADMINIBM: that review was wrong, please ignore it | 06:45 |
| ADMINIBM | else if not then use the iso | 06:46 |
| tonyb | No! | 06:46 |
| ADMINIBM | cause iso is what I have for ppc64le for all RHEL/SLES/Ubuntu | 06:46 |
| tonyb | ADMINIBM: please restate the whole problem in similar language to what I used | 06:46 |
| ADMINIBM | You'd like to use the vendor provided cloud image(if available for ppc64le) or the iso and customise it to generate a .qcow2 file for use with your cloud product | 06:47 |
| tonyb | ADMINIBM: okay so as we've said before using DIB from an ISO isn't an option. | 06:48 |
| ADMINIBM | oh | 06:48 |
| ADMINIBM | but i did see the ISO element | 06:48 |
| tonyb | ADMINIBM: If you really only have ISOs then you'll need to use a virtualisation tool to run the installer and generate a cloud-image | 06:49 |
| tonyb | *then* use that with DIB to add the customisations | 06:49 |
| tonyb | ADMINIBM: that *generates* an ISO not consumes one | 06:49 |
| ADMINIBM | virtualisation tool implies virt-install etc? | 06:50 |
| tonyb | ADMINIBM: https://mengxd.wordpress.com/2016/05/24/first-blog-post/ is an example of how to use the .iso to create a .qcow2 that is appropriate for DIB | 06:50 |
| tonyb | You'd be able to do somethign similar with any distro that supports automated installs | 06:50 |
| ADMINIBM | hmm ok | 06:51 |
| ADMINIBM | let me chk | 06:51 |
| tonyb | ADMINIBM: yes virt-install is an example of somethign you can use | 06:51 |
| ADMINIBM | but that doesnt help in installing OS manually | 06:51 |
| tonyb | ADMINIBM: I *think* that as RHEL and Ubuntu have pre-built guest images then you can just start with them | 06:51 |
| ADMINIBM | ok, yes, i will try that first with DIB | 06:52 |
| ADMINIBM | also will try to find rhel cloud images | 06:52 |
| tonyb | ADMINIBM: Yes it does, you can use virt-install or similar to go from an ISO to a .qcow2 without any input from a user | 06:52 |
| tonyb | ADMINIBM: I do it *many* times a day to create custom images on RHEL | 06:53 |
| tonyb | For my use case cloud-init is a problem rather then a help so I can't use the pre-built guest image | 06:53 |
| tonyb | ADMINIBM: Good luck, feel free to poke me tomorrow if you have a specific question | 06:54 |
| ADMINIBM | even for us , we might need to install our own version of cloud-init if this preinstalled one doesnt work | 06:54 |
| ADMINIBM | that is why iso path was more straightforward | 06:54 |
| ADMINIBM | sure, thanks, let me try today | 06:54 |
| ADMINIBM | if you dont use .img then how do you use DIB? | 06:55 |
| ADMINIBM | @tonyb: what do you mean by .rpm - you have a single one for all needed in an OS? | 06:56 |
| tonyb | ADMINIBM: I use DIB in 2 ways | 07:03 |
| tonyb | ADMINIBM: one to customise the rhel cloud guest | 07:03 |
| tonyb | ADMINIBM: and 2 to customise my image built from .ISO (well a network repo) | 07:04 |
| tonyb | I used .rpm to diffrentiate from .deb as simple way to explain the set of distros | 07:04 |
| ADMINIBM | ok, so you do use an .ISO with DIB | 07:05 |
| ADMINIBM | how do you do that | 07:05 |
| *** hashar has joined #openstack-dib | 07:07 | |
| tonyb | ADMINIBM: No I do NOT use a .ISO with DIB, please reread what I said | 07:07 |
| tonyb | anyway as I said If you have a specific question tomrrow I'll try to help | 07:08 |
| ADMINIBM | ok, sure | 07:08 |
| ADMINIBM | thanks much! | 07:08 |
| openstackgerrit | Hoang Trung Hieu proposed openstack/diskimage-builder master: Add iscsi-boot element for CentOS images https://review.openstack.org/542708 | 07:20 |
| *** ADMINIBM has quit IRC | 07:53 | |
| *** pmannidi has quit IRC | 08:17 | |
| *** jesusaur has quit IRC | 08:23 | |
| *** jesusaur has joined #openstack-dib | 08:27 | |
| *** ADMINIBM has joined #openstack-dib | 08:43 | |
| *** strigazi_ is now known as strigazi | 10:01 | |
| *** jesusaur has quit IRC | 10:02 | |
| *** ADMINIBM has quit IRC | 10:05 | |
| *** jesusaur has joined #openstack-dib | 10:15 | |
| *** strigazi is now known as strigaz_ | 10:59 | |
| *** strigaz_ is now known as strigazi_ | 10:59 | |
| *** strigazi_ is now known as strigazi | 10:59 | |
| *** dhill_ has joined #openstack-dib | 11:57 | |
| *** openstackgerrit has quit IRC | 12:04 | |
| *** vmlinuz has joined #openstack-dib | 12:07 | |
| *** vmlinuz has joined #openstack-dib | 12:07 | |
| *** ADMINIBM has joined #openstack-dib | 12:28 | |
| *** mjturek has joined #openstack-dib | 13:01 | |
| *** pbourke has joined #openstack-dib | 13:21 | |
| pbourke | hi, I seem to be having trouble with dib running out of space on /run/user/0 - anyone familiar with this problem or know how I might increase the size? | 13:21 |
| *** chhavi__ has joined #openstack-dib | 14:12 | |
| *** chhagarw has quit IRC | 14:15 | |
| *** andreas_s has quit IRC | 14:47 | |
| *** andreas_s has joined #openstack-dib | 14:47 | |
| *** andreas_s has quit IRC | 14:56 | |
| clarkb | pbourke: /run/user/ are tmpfs dirs created by systemd for each user | 15:09 |
| clarkb | I've not run into this problem, rather than determining how to increase the size we may want to look into what is being written there and reducing the consumption | 15:09 |
| clarkb | pbourke: do you know what is failing to write there? I'm guessing it will complain about a specific file when saying it is out of space | 15:10 |
| pbourke | clarkb: I finally got it building by specifying a custom image size... though a little unsure why its not able to determine that properly itself | 15:10 |
| pbourke | its creating /dev/loop0 with a size of about 2.4G, but that hits 100% before it can install everything it needs | 15:11 |
| pbourke | the above msg about /run/user is a red herring I think | 15:11 |
| clarkb | ya it should build the image in a chroot then mount the image on loopback and write to it and that is done specifically to determine how big of a raw image is needed iirc | 15:12 |
| clarkb | pbourke: grepping for "Image size report" will show you the image sizing info that it determined | 15:19 |
| clarkb | in your logs | 15:19 |
| *** ADMINIBM has quit IRC | 15:44 | |
| *** ADMINIBM has joined #openstack-dib | 16:07 | |
| *** andreas_s has joined #openstack-dib | 17:03 | |
| *** pbourke has quit IRC | 17:05 | |
| *** andreas_s has quit IRC | 17:16 | |
| *** andreas_s has joined #openstack-dib | 17:21 | |
| *** andreas_s has quit IRC | 17:36 | |
| *** pbourke has joined #openstack-dib | 18:19 | |
| *** mjturek has quit IRC | 18:30 | |
| ianw | i think the gate is officially broken? | 19:07 |
| ianw | has anything passed lately? | 19:07 |
| ianw | 2018-04-10 13:52:06.550726 | controller | + tools/check_devstack_plugin.sh:sshintonode:43 : [[ 5364449280 -lt 5364514816 ]] | 19:09 |
| ianw | http://logs.openstack.org/84/559084/1/check/nodepool-functional-py35-ubuntu-src/80716f7/job-output.txt.gz#_2018-04-10_13_52_06_550726 | 19:10 |
| ianw | 2018-04-10 08:11:27.994677 | controller | + tools/check_devstack_plugin.sh:sshintonode:43 : [[ 5364449280 -lt 5364514816 ]] | 19:11 |
| ianw | http://logs.openstack.org/08/542708/6/check/nodepool-functional-py35-ubuntu-src/512262a/job-output.txt.gz#_2018-04-10_08_11_27_994677 | 19:11 |
| ianw | 2018-04-10 05:16:02.819488 | controller | + tools/check_devstack_plugin.sh:sshintonode:43 : [[ 5364449280 -lt 5364514816 ]] | 19:12 |
| ianw | http://logs.openstack.org/71/559871/2/check/nodepool-functional-py35-ubuntu-src/3658f98/job-output.txt.gz#_2018-04-10_05_16_02_819488 | 19:13 |
| *** andreas_s has joined #openstack-dib | 19:48 | |
| *** pbourke has quit IRC | 19:50 | |
| *** andreas_s has quit IRC | 19:53 | |
| ianw | pabelanger / clarkb: ^ any particular thoughts on why suddenly we're 64mb short on the growroot test for trusty? | 20:12 |
| clarkb | ianw: nothing immediately comes to mind | 20:13 |
| clarkb | ianw: its all a single partition right so /boot or similar isn't eating into that space? | 20:13 |
| ianw | clarkb: yeah, no boot, we already have a bunch of slop space for the mbr section but just suddenly we've lost more space :/ | 20:19 |
| clarkb | could it be alignment problem? | 20:20 |
| clarkb | though I'd expect a few kb for that based on block sizese | 20:20 |
| *** VisBits has quit IRC | 20:27 | |
| *** chhavi__ has quit IRC | 20:29 | |
| *** ADMINIBM has quit IRC | 20:29 | |
| ianw | i dunno, maybe it does some sort of modulo maths? i guess all we can do is modify the slop space more | 20:30 |
| *** vmlinuz has quit IRC | 21:00 | |
| *** hashar has quit IRC | 21:08 | |
| *** dhill_ has quit IRC | 23:06 | |
| *** dhill_ has joined #openstack-dib | 23:09 | |
| ianw | ok, lets see if we can get the gate moving again | 23:44 |
| ianw | the smaller size check is in nodepool now | 23:44 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!