Thursday, 2017-08-31

poojaTheJulia: Doesn't ironic calculate the root partition size though? I am only setting the disk_gb property of the node00:01
poojaAny other attributes that need to be set so that space is reserved for boot loader, swap and a config drive?00:02
TheJuliaOh... hmmm00:03
TheJuliapooja: I guess your manually triggering deployments?00:06
*** zhangfei has joined #openstack-ironic00:08
*** thegreenhundred has joined #openstack-ironic00:14
*** ijw has joined #openstack-ironic00:15
*** sasha2 has quit IRC00:16
*** ijw has quit IRC00:19
*** sasha2 has joined #openstack-ironic00:20
*** hw_wutianwei has joined #openstack-ironic00:35
*** sasha2 has quit IRC00:37
*** baoli has joined #openstack-ironic00:46
*** baoli has quit IRC00:47
*** baoli has joined #openstack-ironic00:48
*** rama_y has quit IRC00:48
poojaTheJulia: Sorry, got pulled in a meeting earlier!00:52
poojaNo, I am triggered deploy using nova and have setup the flavor and baremetal node with disk_gb as 117Gb.00:52
pooja* triggering baremetal node deploy00:52
*** yuanying has joined #openstack-ironic01:00
*** phuongnh has joined #openstack-ironic01:02
*** TuanLA has joined #openstack-ironic01:04
*** yuanying_ has quit IRC01:04
*** yuanying_ has joined #openstack-ironic01:04
*** yuanying has quit IRC01:05
*** mat128 has joined #openstack-ironic01:07
*** ijw has joined #openstack-ironic01:07
*** yangyapeng has joined #openstack-ironic01:14
*** ijw has quit IRC01:14
*** ijw has joined #openstack-ironic01:15
wonghi,may I ask a question?01:16
wongmay I configure tenant network by using horizon dashboard?01:17
wongI want to make ironic nodes to serve tenant01:19
*** ijw has quit IRC01:20
*** syqian has joined #openstack-ironic01:30
TheJuliapooja: if it is a partition image, Swap would also go into that if defined, at least if memory serves, so that needs to be accounted for potentially.01:33
*** yangyapeng has quit IRC01:34
TheJuliawong: with neutron networking, as in the network_interface set to "neutron" on the node, I don't see why not if the users are creating ports in neutron, and then attaching them to instances they are deploying via nova.01:35
*** yangyapeng has joined #openstack-ironic01:35
poojaOh okay, i couldn't find documentation around how to specify swap_mb as such, but came across root device hints. It also says IPA by default selects smallest disk and not necessarily the first disk for partitioning?01:35
poojaI am now trying to use add properties/root_device='{"size": ">= 110"} to see if that helps and also reducing MiB value by 1.01:36
TheJuliayeah that might help, root_device hints can definitely help01:38
TheJuliaat least, then you can make sure if you have multiple devices in the mix01:39
*** mat128 has quit IRC01:41
wongTheJulia:you mean we can just enroll the nodes first,then user can create ports and attach them to instance? but the node can't access TFTP after they are deployed01:54
TheJuliawong: and yes, that is because the conductor will move the node to a provisioning network for the deployment to take place01:55
*** yangyape_ has joined #openstack-ironic01:57
*** yangyapeng has quit IRC01:57
*** yuanying_ has quit IRC02:01
*** litao__ has joined #openstack-ironic02:02
*** yuanying has joined #openstack-ironic02:04
*** sasha2 has joined #openstack-ironic02:18
wongtks02:20
*** syqian has quit IRC02:25
*** syqian has joined #openstack-ironic02:25
*** yangyape_ has quit IRC02:28
*** yangyapeng has joined #openstack-ironic02:28
poojaTheJulia: Tried using "size": ">= 110", but nova complains about disk size not being an integer, possibly this (>=) was not supported in Newton?02:31
poojaAnyway setting the Gib value to 110 worked for me. Thanks!02:31
wongTheJulia:when I create an instance by using horizon dashboard,whther the ironic conductor can finish all things? include deploying and changing network ?02:33
pooja120Gb is 111.7 Gib, so setting local_gb to 110Gib worked. I guess it wasn't clear that local_gb should be set to Gib value - 1 (not Gb -1).02:34
*** namnh has joined #openstack-ironic02:35
wongand the network between deploying and tenant network is separated02:35
*** mat128 has joined #openstack-ironic02:40
*** zhangfei has quit IRC02:41
wongpooja:once I set local_gb 500G and my disk is 500G,it's failed also.02:43
*** pooja has quit IRC02:50
*** ijw has joined #openstack-ironic02:56
wongit seems that the disk must be larger than local_gb02:57
*** zhangfei has joined #openstack-ironic02:58
openstackgerritRuby Loo proposed openstack/python-ironicclient stable/ocata: DNM testing devstack change in ironic  https://review.openstack.org/49939103:00
*** zshi_ has joined #openstack-ironic03:01
*** ijw has quit IRC03:01
TheJuliaPooja: I thought it was :(.03:02
TheJuliaOh, they left :(03:02
TheJuliawong: that is what the conductor does, orchestrate deployment including changing network in that process03:03
wongTheJulia:I know it now, tks a lot03:08
*** tiendc has joined #openstack-ironic03:09
wongTheJulia;it's too late in your place,can't you have a sleep?03:09
*** zshi_ has quit IRC03:10
TheJuliawong: I'm actually heading to sleep now03:10
TheJuliaHave a wonderful day!03:10
wong:) have a good night03:10
*** mat128 has quit IRC03:12
*** zshi_ has joined #openstack-ironic03:23
*** rama_y has joined #openstack-ironic03:28
*** rama_y has quit IRC03:29
*** rama_y has joined #openstack-ironic03:29
*** rbudden has quit IRC03:34
*** pooja has joined #openstack-ironic03:36
poojawong: Yes, I think local_gb value should be set to (Gib-1) and not Gb. Maybe we should make that clear in the documentation.03:37
*** udesale has joined #openstack-ironic03:37
*** links has joined #openstack-ironic03:39
wongpooja: you are right03:59
openstackgerritShivanand Tendulker proposed openstack/ironic master: Boot from volume fails with 'iscsi' deploy interface  https://review.openstack.org/49944604:02
*** mat128 has joined #openstack-ironic04:09
*** mat128 has quit IRC04:09
*** jaianshu has joined #openstack-ironic04:11
*** vmud213 has joined #openstack-ironic04:12
*** ijw has joined #openstack-ironic04:16
*** ijw has quit IRC04:21
*** rama_y has quit IRC04:21
*** baoli has quit IRC04:23
*** baoli has joined #openstack-ironic04:37
*** jlabarre has quit IRC04:41
*** sasha2 has quit IRC04:44
*** MattMan_1 has quit IRC04:49
*** baoli has quit IRC04:49
*** MattMan_1 has joined #openstack-ironic04:49
openstackgerritMerged openstack/ironic master: Follow up Secure boot support for irmc-pxe driver.  https://review.openstack.org/49339404:50
*** phuongnh has quit IRC04:52
*** syqian has quit IRC04:52
*** phuongnh has joined #openstack-ironic04:53
*** syqian has joined #openstack-ironic04:53
*** rbartal has joined #openstack-ironic05:07
*** ianychoi__ has joined #openstack-ironic05:12
*** ianychoi_ has quit IRC05:16
*** oomichi has quit IRC05:28
*** oomichi has joined #openstack-ironic05:30
*** rbartal has quit IRC05:31
openstackgerritShivanand Tendulker proposed openstack/ironic master: Fix ``agent`` deploy interface to call ``boot.prepare_instance``  https://review.openstack.org/49905005:35
*** yangyapeng has quit IRC05:42
*** yangyapeng has joined #openstack-ironic05:43
openstackgerritShivanand Tendulker proposed openstack/ironic master: Fix ``agent`` deploy interface to call ``boot.prepare_instance``  https://review.openstack.org/49905005:52
*** marios has joined #openstack-ironic05:56
*** mjura has joined #openstack-ironic06:00
wonghi,ironic as a hypervisor can be coexist with other hypervisor types?06:02
*** snswin has quit IRC06:03
*** snswin has joined #openstack-ironic06:03
*** pooja has quit IRC06:12
*** links has quit IRC06:15
*** parlos has joined #openstack-ironic06:15
syqianwong, what are you mean? other hypervisor such as kvm, xen...?06:17
wongyeah06:20
*** pcaruana has joined #openstack-ironic06:22
*** ntpttr_laptop has quit IRC06:22
wongif they can be coexist in  single nova service,I don't need support another nova service06:22
*** ntpttr_laptop has joined #openstack-ironic06:22
*** ntpttr_laptop__ has joined #openstack-ironic06:23
*** ntpttr_laptop has quit IRC06:23
syqianwong, this may be cann't. you should support a single nova-compute service for ironic.06:24
wongsure?06:24
*** marios has quit IRC06:25
syqianwong, i think it is. in the nova.conf you can config compute_driver=xxxx to select which driver you ues.06:27
wongand only choose one06:27
syqianwong, yes, it seems you can only choose one driver.06:28
wongI know, tks a lot06:28
*** mjura has quit IRC06:28
syqianwong, no prob, by the way, it's my opinion, you can search it deeper.06:30
wongOK06:31
*** vsaienk0 has joined #openstack-ironic06:33
*** hshiina has joined #openstack-ironic06:35
*** jtomasek has quit IRC06:36
*** jtomasek has joined #openstack-ironic06:37
*** jtomasek has quit IRC06:39
*** jtomasek has joined #openstack-ironic06:40
*** syqian has quit IRC06:40
*** rcernin has joined #openstack-ironic06:40
*** stendulker has joined #openstack-ironic06:40
wonganother thing, Nova service can have  multiple ironic-host-manager?06:41
*** mjura has joined #openstack-ironic06:41
*** syqian has joined #openstack-ironic06:41
*** livelace has joined #openstack-ironic06:45
*** ntpttr_laptop__ has quit IRC06:51
*** phuongnh has quit IRC06:57
*** phuongnh has joined #openstack-ironic06:57
*** hjensas has joined #openstack-ironic06:59
*** hjensas has quit IRC06:59
*** hjensas has joined #openstack-ironic06:59
*** charcol has quit IRC07:00
*** zhangfei has quit IRC07:03
*** syqian_ has joined #openstack-ironic07:04
*** hoonetorg has quit IRC07:04
*** syqian has quit IRC07:07
*** jaganathan has joined #openstack-ironic07:11
*** zhangfei has joined #openstack-ironic07:11
*** hoonetorg has joined #openstack-ironic07:17
*** racedo has joined #openstack-ironic07:28
*** links has joined #openstack-ironic07:29
*** tesseract has joined #openstack-ironic07:32
*** rbartal has joined #openstack-ironic07:38
*** hjensas has quit IRC07:38
*** syqian__ has joined #openstack-ironic07:41
*** hjensas has joined #openstack-ironic07:43
*** hjensas has quit IRC07:43
*** hjensas has joined #openstack-ironic07:43
*** oomichi has quit IRC07:44
*** oomichi has joined #openstack-ironic07:44
*** syqian_ has quit IRC07:45
openstackgerrityolanda.robla proposed openstack/bifrost stable/pike: Fix bug in ironic policy  https://review.openstack.org/49949007:48
openstackgerrityolanda.robla proposed openstack/bifrost stable/ocata: Fix bug in ironic policy  https://review.openstack.org/49949107:49
vdrokgood morning ironic!08:01
vdrokwong: yes, if you're using nodes without resource classes, better to use ironic_host_manager08:02
vdrokor do you mean multiple host managers , like default one and ironic?08:02
vdrokif so, than it's not possible. with mixed hypervisor case you should use the standard host manager08:02
openstackgerrityolanda.robla proposed openstack/bifrost master: DNM: testing centos  https://review.openstack.org/49949808:11
*** mgoddard has joined #openstack-ironic08:14
etingofmorning again \o/08:15
*** marios has joined #openstack-ironic08:16
*** openstackgerrit has quit IRC08:17
*** marios_ has joined #openstack-ironic08:19
*** ralonsoh has joined #openstack-ironic08:23
*** lucas-afk is now known as lucasagomes08:30
wongOK08:31
*** Nisha_Agarwal has joined #openstack-ironic08:35
Nisha_AgarwalHey Ironic!!!08:35
Nisha_AgarwalGood morning/afternoon08:35
vdrokgood morning etingof and Nisha_Agarwal08:37
Nisha_Agarwalhey vdrok etingof08:37
Nisha_Agarwalvdrok, i was looking ironic-inspector code. dtantsur|afk mentioned in past that inspector automates the creation/assigning of resource class name to the nodes. If you have any idea could you point me to the code where it does that.08:40
*** syqian__ has quit IRC08:41
*** syqian__ has joined #openstack-ironic08:42
vdrokNisha_Agarwal: I don't see resource_class in inspector code after a quick search, you sure it's already done?08:43
*** karimb has joined #openstack-ironic08:45
Nisha_Agarwalvdrok, thats what dtantsur|afk mentioned in his mail http://lists.openstack.org/pipermail/openstack-dev/2017-April/115278.html08:46
Nisha_Agarwalvdrok, i was just trying to see how it does that and can we use that in ironic also...08:47
Nisha_Agarwalvdrok, he says this "Also ironic-inspector is useful for automatically defining resource classes on08:47
Nisha_Agarwalnodes, so I'm not sure about this purpose being defeated as well."08:47
vdrokwhat's written there seem to indicate that it's possible, not that it's currently being done08:48
vdrokaarefiev: ^^08:48
*** openstackgerrit has joined #openstack-ironic08:49
openstackgerrityolanda.robla proposed openstack/bifrost master: Fix the dhcp checks on centos  https://review.openstack.org/49949808:49
aarefievNisha_Agarwal: there is no way to assign resource class automatically08:51
pas-hamorning ironic :)08:51
aarefievNisha_Agarwal: you could try inspector rules to assign it based on discovered properties08:52
*** dtantsur|travel has joined #openstack-ironic08:52
dtantsur|travelmorning ironic08:52
Nisha_Agarwalaarefiev, could you help me with some example08:52
Nisha_Agarwaldtantsur|travel, hi08:52
dtantsur|travelI'm unexpectedly traveling today, so I will be on and offline08:52
dtantsur|travelwill try to get a stable connection in the evening08:53
vdrokgood morning dtantsur|afk08:57
vdrokor dtantsur|travel ? :)08:57
aarefievNisha_Agarwal: let me check that we have appropriate `action`, we are going to discuss this on ptg more08:57
dtantsur|travelthe latter for now :) I'm outside of VPN, so not connecting to my bouncer08:57
aarefievmorning dtantsur|travel :)08:57
*** mrch has joined #openstack-ironic09:02
aarefievNisha_Agarwal: something like http://paste.openstack.org/show/620002/09:02
aarefievI'm not sure if it would work from the box09:02
*** openstackgerrit has quit IRC09:03
dtantsur|travellooks good09:03
Nisha_Agarwalaarefiev, ohk. that means it cannot be used by ironic09:03
dtantsur|travelactually, I was planning to provide a few examples in ironic-inspector docs09:03
dtantsur|travelmmm, yeah. it's inspector.09:03
aarefievI guess it may need to hack ironic api version in inspector09:04
Nisha_Agarwalaarefiev, yeah u can do it in inspector. but for OOB inspection the logic needs to sit inside ironic09:04
Nisha_Agarwalaarefiev, thanks for the example. atleast i know what dtantsur|travel meant in past09:05
aarefievyeah, we need some logic for this in ironic09:05
aarefievlike rules09:06
Nisha_Agarwalaarefiev, what i feel is that it is similar to node-update09:06
Nisha_Agarwalthe value for resource class is still coming from user09:07
Nisha_Agarwali was thinking inspector automates the resource class name based on the inspected values09:07
Nisha_Agarwaldtantsur|travel, i was looking at nova code for this. I feel if we allow resource class structure at ironic nodes, probably we can schedule based on standard resource class rather than skipping them09:09
aarefievyeah, the goal here is to make it automaticaly, so user may specify some resource classe based on inspected data09:09
*** e0ne has joined #openstack-ironic09:09
Nisha_Agarwalaarefiev, generally we dont know the resources before inspection09:10
Nisha_Agarwaloh i got what u meant09:11
aarefievNisha_Agarwal: why?09:11
sambetts|afkNisha_Agarwal: you should have the idea about the falvors you want to provide to your users09:11
*** sambetts|afk is now known as sambetts09:11
Nisha_Agarwalsambetts, i misunderstood aarefiev's example09:12
Nisha_Agarwalsambetts, aarefiev now i know what he meant09:12
sambettsNisha_Agarwal: resource classes map directly to flavors, so a "large-baremetal" flavor should have a certain expected set of resources09:13
Nisha_Agarwalsambetts, yes.09:13
sambettsyou can use inspector rules to group machines with ram >= certain amount, disk >= certain amount, and cpus >= certain amount, into that resource class09:14
Nisha_Agarwalsambetts, aarefiev dtantsur|travel i still dont understand why ironic shouldnt be scheduled based on standard resources09:15
Nisha_Agarwalsambetts, i understand that with the given example09:15
*** milan has joined #openstack-ironic09:18
sambettsNisha_Agarwal: there are a lot of reasons, there are several specs covering the design, but the main reason is because an ironic node is indivisible, when you ask for a baremetal node you get the whole node09:18
milanmorning Ironic! :)09:18
sambettsNisha_Agarwal: so it made sense to have flavors that ask for 1 of a type of baremetal node09:18
sambettse.g. 1 large baremetal node09:19
sambettsor 1 baremetal node with GPUs09:19
milan#pixiesay -mflexing Yawn!09:19
PixieBootsᕙʕ⇀ᴥ⇀ʔᕗ: Yawn!09:19
dtantsur|travelNisha_Agarwal: please find a mail from me to the ML for explanation of why standard properties don't really work for ironic09:20
Nisha_Agarwalsambetts, i have read the specs in nova already.09:20
* dtantsur|travel does not have time right now, sorry09:20
Nisha_Agarwaldtantsur|travel, i read that09:20
Nisha_Agarwalsambetts, dtantsur|travel i am not able to put my point across , but i think ironic should have resource class structure at ironic nodes so as to allow scheduling based on standard resources09:23
sambettsNisha_Agarwal: so an ironic node can report multiple resource classes with values?09:23
Nisha_Agarwalsambetts, yes09:23
sambettsI agree, I think that would be useful, even if its not for schduling based on standard resources, but just for adding additonal information about what a baremetal node has e.g. number of GPUs etc09:25
vdrokmorning sambetts and milan09:25
milanmorning vdrok! :)09:26
milanalso morning dtantsur|travel Nisha_Agarwal and sambetts! :)09:26
vdroksambetts: if it's not needed for scheduling why do these additional resource classes?09:26
* milan 's coffee is gone but his brain still loading 09:26
sambettsvdrok: it is for schdulaing, but not for standard resources (ram disk cpu)09:26
vdrokok, but still everything is consumed, so why not have resource class baremetal_large_with_5_gpus09:27
sambettsvdrok: so you could have a flavor that asks for 1 large-baremetal, that has at least 2 gpus for example, and the standard ironic resource classes matches the 1 large-baremetal and consumes the whole node, but the GPUs will match as long as that node has at least 2 avaible09:28
dtantsur|travelyep, the problem with several resource classes is that you cannot consume half of them09:28
stendulkersambetts: Did you mean a single baremetal associated with multiple resource classes?09:28
dtantsur|traveland we get back to the problem of double assignment and ugly hacks in the ironic virt driver09:28
Nisha_Agarwaldtantsur|travel, yep we cannot consume half of them. but we can consume them fully in the ironic-virt-driver as we do for standrad resource classes today09:29
sambettsNisha_Agarwal: that is the exact hack we're trying to kill with resource classes09:29
vdrokNisha_Agarwal: it gives us lots of headache09:29
dtantsur|travelNisha_Agarwal: no, we cannot.09:31
Nisha_Agarwalmmmm09:31
dtantsur|travelironic virt driver is not the place to track resources. what we do now is ugly and buggy, and is already half broken in Pike09:31
sambettsNisha_Agarwal: that hack is what makes us different and special when it comes to schdulaing in nova, when we switch to resource classes as proposed today all that horrible code goes away and we don't need custom host manager logic or custom filters to make ironic work09:31
dtantsur|travelNisha_Agarwal, sambetts, vdrok, I'd say this conversation is not overly helpful without nova folks involved, e.g. jaypipes or dansmith09:32
* dtantsur|travel runs to the bus, sorry09:32
*** dtantsur|travel has quit IRC09:32
* Nisha_Agarwal also needs to run right now. but it would help we can discuss this along with nova guys. may be 6hrs from now.(would be around 9 pm my time)09:33
sambettspersonally I don't like resource classes as they are implmented today, but we're in a transition period, flavors as they exist today will be going away, and resource classes will become first class citizens, and I think at that point it'll make much more sense that we're doing it this way09:34
Nisha_Agarwalsambetts, :)09:34
Nisha_Agarwalsambetts, vdrok should we discuss this around 9 pm  my time(~6 hrs from now)09:35
Nisha_Agarwalwith the nova guys also involved09:35
*** hoonetorg has quit IRC09:36
vdrokwell, you can just come and ask the questions :)09:36
Nisha_Agarwalvdrok, :)09:36
Nisha_Agarwalthanks09:36
* Nisha_Agarwal need to log off for some time now.09:37
*** Nisha_Agarwal has quit IRC09:41
wonghi,if the node is removed to the tenant network,wether the ironic manager can connect it?09:46
*** etingof has quit IRC09:46
*** hw_wutianwei has quit IRC09:47
sambettswong: connect to it how? regardless of which data network a node is connected to ironic should always be able to talk to the out of band managment (IPMI) for a node09:48
*** openstackgerrit has joined #openstack-ironic09:53
openstackgerritMarkos Chandras (hwoarang) proposed openstack/bifrost master: Test OPNFV CI verify job. Please ignore.  https://review.openstack.org/36760809:53
wongI understand it09:53
*** hoonetorg has joined #openstack-ironic09:53
*** ralonsoh has quit IRC10:03
*** ralonsoh has joined #openstack-ironic10:04
*** priteau has joined #openstack-ironic10:04
*** yangyapeng has quit IRC10:05
*** yangyapeng has joined #openstack-ironic10:05
*** rajame has joined #openstack-ironic10:06
openstackgerritMerged openstack/ironic master: [doc] add FAQ about updating release notes  https://review.openstack.org/49770810:08
*** yangyapeng has quit IRC10:10
vdroksambetts: https://review.openstack.org/499545 here is why reschedule not happening in that test10:12
patchbotpatch 499545 - nova - Allow reschedules for ironic computes if one force...10:12
yolandaTheJulia, or other cores, fix for bifrost in centos... https://review.openstack.org/49949810:14
patchbotpatch 499498 - bifrost - Fix the dhcp checks on centos10:14
sambettsvdrok: ewww... huge -1 to adding ironic hypervisor specific code outside of the ironic driver :/10:15
vdrokyeah I know10:15
vdrokthe problem is, it's scheduler, and this part does not seem to be customizable at all10:16
vdroks/scheduler/conductor10:17
*** etingof has joined #openstack-ironic10:20
*** etingof has quit IRC10:25
*** wong has quit IRC10:25
*** etingof has joined #openstack-ironic10:26
*** udesale has quit IRC10:27
*** karimb has quit IRC10:28
*** priteau has quit IRC10:28
*** amarao has quit IRC10:31
*** priteau has joined #openstack-ironic10:31
vdroksambetts: this is not ironic specific https://review.openstack.org/#/c/499545/2/nova/scheduler/utils.py, but still ugly, and not sure if eg for vmware it's possible to run hypervisor on the same host as n-cpu. if it is, this logic is wrong too :(10:33
patchbotpatch 499545 - nova - Allow reschedules for ironic computes if one force...10:33
pas-hadtantsur|afk: vdrok some small fixes to staging drivers stable branches https://review.openstack.org/#/q/I537a731df702273d0184b02fa7532eaff8a167ba,n,z10:37
pas-hathe pike one is actually quite needed for unit tests on gates (install ironic as of pike, not from master). not broken now, but may break any time in the future10:38
pas-haothers are just some more convenience for developers10:38
*** amarao has joined #openstack-ironic10:39
*** karimb has joined #openstack-ironic10:39
*** jkilpatr has quit IRC10:41
stendulkersambetts: Hi10:44
sambettsHi10:44
stendulkersambetts: regarding patch https://review.openstack.org/#/c/49905010:44
patchbotpatch 499050 - ironic - Fix ``agent`` deploy interface to call ``boot.prep...10:44
stendulkerThis is regarding your comment to move the boot device setting code from agent.py:reboot_to_instance()10:45
stendulkerIt can break the 3rd party vendor drivers if they were relying on it10:46
stendulkerIf we keep it, we would be setting the boot device twice, in worst case10:46
stendulkeryuriy also had similar opinion10:46
stendulkersambetts: what you think?10:46
sambettsstendulker: actually I think if we leave it in there we'll end up setting the boot device 3 times, once in reboot_to_instance, once in prepare_instance_to_boot, and once in prepare_instance10:48
sambettsmaking calls to the baremetal can be slow10:48
stendulkeroh yes, it would thrice..10:48
sambettsso reducing unnessary requests to the BMC would be ideal10:48
sambettsIMO the boot interface should be the interface that is handling setting the boot device, thats its purpose10:48
stendulkeri agree, it should be done only in the boot interface10:49
stendulkeronly for legacy reasons this code is lying in agent.py10:49
stendulkerall our in-tree drivers do it properly10:49
stendulkeronly question is about out of tree drivers10:50
*** rajame has quit IRC10:50
stendulkersambetts, i will keep it as it for now.10:51
stendulkersambetts: thank you.10:51
sambettsnp10:51
*** zhangfei has quit IRC10:54
openstackgerritAndrey Shestakov proposed openstack/ironic master: Change pxe dhcp options name to codes.  https://review.openstack.org/49955310:59
*** jkilpatr has joined #openstack-ironic11:01
*** namnh has quit IRC11:01
*** TuanLA has quit IRC11:02
*** jaianshu has quit IRC11:04
*** parlos has quit IRC11:06
*** parlos has joined #openstack-ironic11:12
*** jistr is now known as jistr|biab11:12
*** phuongnh has quit IRC11:14
*** stendulker_ has joined #openstack-ironic11:25
*** stendulker has quit IRC11:26
*** rbudden has joined #openstack-ironic11:28
*** stendulker_ has quit IRC11:30
*** vmud213 has quit IRC11:35
*** mat128 has joined #openstack-ironic11:37
*** lucasagomes is now known as lucas-hungry11:44
*** bfournie has quit IRC11:46
*** bfournie has joined #openstack-ironic11:47
*** efried_off is now known as efried11:50
*** bfournie has quit IRC11:51
*** thegreenhundred has quit IRC11:55
*** litao__ has quit IRC11:55
*** jkilpatr has quit IRC12:03
*** TuanLA has joined #openstack-ironic12:07
*** karimb has quit IRC12:07
*** jkilpatr has joined #openstack-ironic12:09
*** jkilpatr has quit IRC12:12
*** jkilpatr has joined #openstack-ironic12:12
*** jlabarre has joined #openstack-ironic12:12
*** jkilpatr has quit IRC12:17
*** fellypefca has joined #openstack-ironic12:19
*** bfournie has joined #openstack-ironic12:20
*** jistr|biab is now known as jistr12:20
fellypefcaGood morning :)12:26
openstackgerritPavlo Shchelokovskyy proposed openstack/ironic master: Deny some driver_info updates when console is on  https://review.openstack.org/33000312:26
*** dprince has joined #openstack-ironic12:26
*** mat128 has quit IRC12:27
*** mat128 has joined #openstack-ironic12:30
*** jkilpatr has joined #openstack-ironic12:30
*** rama_y has joined #openstack-ironic12:34
*** jaosorior has quit IRC12:37
*** thegreenhundred has joined #openstack-ironic12:38
*** jaosorior has joined #openstack-ironic12:38
*** jaosorior has quit IRC12:44
*** jaosorior has joined #openstack-ironic12:45
*** jaosorior has quit IRC12:45
*** jaosorior has joined #openstack-ironic12:46
*** TuanLA has quit IRC12:47
milanmorning fellypefca! :)12:50
*** lucas-hungry is now known as lucasagomes12:51
milansambetts, https://review.openstack.org/#/c/487909/9 please ;)12:51
patchbotpatch 487909 - ironic-inspector - Allow periodics to terminate inspector12:51
sambettsmilan: taking a look now12:53
sambetts:)12:53
milansambetts, thanks! :)12:53
milanlong road to the dnsmasq stuff but getting closer with every patch ;)12:54
fellypefcamilan o/12:54
openstackgerritFellype Cavalcante proposed openstack/ironic master: Introduce hpOneView and ilorest to OneView  https://review.openstack.org/46812912:57
*** trown|outtypewww is now known as trown12:57
sambettsmilan: why an event and not a lock?12:58
milansambetts, yeah, looking at the same, a non-blocking lock should do the same job12:58
fellypefcasambetts, yuriyz and TheJulia ^ thanks again for the reviews, and if you could take a look.. :)12:59
* milan tries to find a "smarter" answer or remember one O:-)12:59
sambettsmilan: I just saw event and expected something to be checking whether the event had been set12:59
sambettsin a loop somwhere12:59
sambettse.g. if shutting_down.set(): shutdown()13:00
sambettsthat kind of thing13:00
*** udesale has joined #openstack-ironic13:00
sambettsbuts its being used as a lock/semaphore instead13:00
milansambetts, it has a check later but the other way: try self.shutting_down.set() except:13:00
milanyeah13:00
*** tiendc has quit IRC13:01
milanif a semaphore was used, the shutting down would have to happen in one block13:01
milansambetts, ^13:01
milanI guess13:01
*** baoli has joined #openstack-ironic13:02
*** sasha2 has joined #openstack-ironic13:02
*** sasha2 has quit IRC13:02
*** sasha2 has joined #openstack-ironic13:02
*** Goneri has joined #openstack-ironic13:03
sambettsmilan: with the a semaphone you would define it like shutting_down = Semaphore(1) and then in the shutdown function you would do, if not shutting_down.acqire(blocking=False): return13:04
milanyup can be done that way13:04
* milan looks why he put it this way13:05
sambettsyeah the alternative is exactly the same but using a lock, shutting_down = Lock() and then in the shutdown function it would be indentical to the semaphore code13:05
milansambetts, dunno, most likely it didn't cross my mind... can update it though or follow up, thanks for the check13:09
TheJuliagood morning erveryone13:12
milanmorning TheJulia! :)13:13
*** udesale has quit IRC13:15
*** mat128 has quit IRC13:17
*** ianychoi__ is now known as ianychoi13:20
milansambetts, the only thing in favour of the event is it's really a single-shot thing that isn't going to be released if anything happened13:22
milan... the process is shutting down13:22
sambettsI wouldn't expect a lock to be released unless something explictly calls .release() on it13:23
milanbut wouldn't you expect releasing a lock eventually?13:24
sambettsas far as I can tell an event is basically just a lock with an additional wait() method for sitting waiting until its set by something else13:25
milanevent is (implemented as) an atomic flag; yes you can wait on it13:26
milanit's a signalling mechanism IMO13:26
sambettsexactly, which is why it doesn't really fit in this use case13:27
sambettsIMO13:27
sambettsunless we had another thread that was the "shutdown thread" and we start it and then it just sits and does "shutting_down.wait()" until something sets the flag13:27
sambettsthat is the use case for an event13:28
*** zshi_ has quit IRC13:29
milansambetts, OK, if you won't mind a semaphore that never is going to be released13:30
milanI'll amend13:30
sambettsmilan: I think that is fine, it makes more sense to me anyway, because I saw Event and was looking to see what was checking it, but there isn't anywhere trying to check it, only set it13:31
milansambetts, fair enough, updating13:33
sambetts:D thanks!13:33
*** jcoufal has joined #openstack-ironic13:34
*** rama_y has quit IRC13:34
*** mgoddard has quit IRC13:40
*** jaganathan has quit IRC13:42
*** mgoddard has joined #openstack-ironic13:44
*** crushil has quit IRC13:45
*** zhangfei has joined #openstack-ironic13:48
*** zhangfei has quit IRC13:53
*** crushil has joined #openstack-ironic13:55
*** ChubYann has quit IRC13:56
*** jaosorior has quit IRC13:57
*** mrch has quit IRC13:58
openstackgerritMilan Kováčik proposed openstack/ironic-inspector master: Refactoring the firewall  https://review.openstack.org/47183113:59
openstackgerritMilan Kováčik proposed openstack/ironic-inspector master: Allow periodics to terminate inspector  https://review.openstack.org/48790913:59
openstackgerritMilan Kováčik proposed openstack/ironic-inspector master: Introducing a dnsmasq PXE filter driver  https://review.openstack.org/46644813:59
openstackgerritMilan Kováčik proposed openstack/ironic-inspector master: TEST check dnsmasq PXE filter in devstack  https://review.openstack.org/46871213:59
milansambetts, thanks for the check! :)13:59
*** hjensas has quit IRC14:08
*** ChubYann has joined #openstack-ironic14:10
*** ijw has joined #openstack-ironic14:13
*** hshiina has quit IRC14:18
*** snswin has quit IRC14:21
*** rivers has joined #openstack-ironic14:21
*** ntpttr_laptop has joined #openstack-ironic14:22
riversHi, i needed help with tftp-boot, I'm trying to boot up Baremetal node using nova, and after "nova boot", i see the baremetal node getting a DHCP response back from controller, gets an IP, but fails at tftp, and times out14:24
riversI've noticed that tftp-server which is probably supposed to be started by neutron via xinetd isn't running, not sure which logs to look at to debug this14:25
sambettsrivers: the tftp server isn't started by neutron, it should be started by the operator as part of the ironic install14:26
riversAnd also, the pxe.tftp-server IP address is not in the same CIDR as the flat network used to boot up the batemetal node14:26
sambettsrivers: it doesn't have to be in ther same network as long as there is a route to it14:26
riverssambetts: I used these instructions to setup tftp, https://docs.openstack.org/ironic/latest/install/configure-pxe.html , I'm not sure if they are sufficient14:27
riverssambetts: tftp-server gets an IP address which is the same OAM ip for the controller node, which I'm trying to boot the baremetal host on a private flat network14:28
*** srobert has joined #openstack-ironic14:28
sambettsrivers: the flat network needs to have a route to the ironic services including the tftp server14:29
riverssambetts: so basically i did a neutron net-create, and a subnet on that, should i create a router too "in the neutron router-list"? Sorry not too well versed in networking. Thanks14:30
TheJuliarivers: yes, you'll likely want to create a router14:31
TheJuliaor, directly plug your controllers into the provisioning/cleaning networks... but that is like 1000x easier said than done14:32
sambettsrivers: if you are using ironic in flat network mode, its expected that your flat network is a provider network with a real world gateway, so that the ironic control plane services can talk directly to the baremetal servers on the IPs they are given14:33
riversTheJulia: in my ironic.conf, I have the cleaning/provisioning set to the uuid of the flat network, Do i set the "#tftp_server=$my_ip" too ?14:33
sambettsif you use a neutron network you'll introduce a NAT which means that the conductor will not be able to talk to the baremetal servers14:34
sambettss/neutron network/neutron router/14:34
TheJuliarivers: I would first ensure that there is connectivity between the baremetal node, regardless of the network, and some way for it to reach your conductor. That will dictate what settings you may need to change in your conductor in terms of addresses provided14:36
riverssambetts: When i do a nova boot, i have to specify a "--nic net-id=$IRONIC_NETWORK_ID " , which is configured on a flat network, does that mean that I'm introducing a NAT ... sorry for asking these questions, just trying to clear the concept here14:44
*** rama_y has joined #openstack-ironic14:45
sambettsrivers: sorry I meant if you use a neutron router you;ll introduce a NAT14:45
sambettsrivers: doing nova boot with the network is correct14:45
*** rama_y has quit IRC14:46
riverssambetts: So I should not create a neutron router to connect to the neutron net that i created... How do i verify if there is connectivity between the baremetal node and the tftp-server... I'm all over the place, not sure what to do at this point14:47
sambettsrivers: the flat network should have a real gateway router and subnet accaible by the subnet that your conductor is in14:48
riverssambetts: ok got it14:48
*** osdev_ has joined #openstack-ironic14:52
openstackgerritMerged openstack/ironic master: Boot from volume fails with 'iscsi' deploy interface  https://review.openstack.org/49944614:54
*** ntpttr_laptop has quit IRC14:57
*** rpioso has joined #openstack-ironic15:00
*** trungnv has quit IRC15:03
*** trungnv has joined #openstack-ironic15:04
openstackgerritJulia Kreger proposed openstack/bifrost master: VM networking for Neutron testing  https://review.openstack.org/49827115:06
openstackgerritJulia Kreger proposed openstack/bifrost master: DNM: Execute tests for neutron integration  https://review.openstack.org/49826815:06
openstackgerritJulia Kreger proposed openstack/bifrost master: WIP: Initial neutron task changes  https://review.openstack.org/45251515:06
*** dprince has quit IRC15:11
*** parlos has quit IRC15:12
openstackgerritPeter Piela proposed openstack/ironic-ui master: Cleaup ironic-ui portgroup REST interface  https://review.openstack.org/49963615:13
*** amarao has quit IRC15:18
*** ralonsoh has quit IRC15:23
riverssambetts: According to these instructions, https://docs.openstack.org/ironic/latest/install/configure-pxe.html , I only start the xinetd process, but never the "systemctl start tftp " , Am i supposed to start the tftp process manually ?15:29
*** mjura has quit IRC15:32
*** pcaruana has quit IRC15:32
*** srobert has quit IRC15:34
*** ntpttr_laptop has joined #openstack-ironic15:37
*** yangyapeng has joined #openstack-ironic15:43
*** e0ne has quit IRC15:47
sambettsxinetd should manage the tftp service15:48
NobodyCamGood Morning Ironic'ers15:54
jlvillalGood morning Ironic15:58
openstackgerritMarkos Chandras (hwoarang) proposed openstack/bifrost master: playbooks: roles: bifrost-ironic-install: Set defaults for /etc/hosts  https://review.openstack.org/49969216:03
vdrokgood morning TheJulia NobodyCam and jlvillal16:04
NobodyCamGood morning vdrok and jlvillal :)16:04
jlvillal:)16:04
NobodyCam:)16:04
*** lucasagomes is now known as lucas-hungry16:04
jlvillaleat lucas-hungry eat!16:04
*** marios has quit IRC16:06
*** srobert has joined #openstack-ironic16:08
*** rama_y has joined #openstack-ironic16:11
openstackgerritMilan Kováčik proposed openstack/ironic-inspector master: Introducing RPC  https://review.openstack.org/49768916:12
*** mat128 has joined #openstack-ironic16:15
*** hoonetorg has quit IRC16:18
anupnHi sambetts: after recheck, some of the jobs that were failing due to slow node are not failing. But, tinycore jobs are failing16:18
anupnsambetts, http://logs.openstack.org/85/495385/2/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-src-ubuntu-xenial/bfaed46/console.html#_2017-08-30_18_39_12_48661116:19
anupnsambetts, I checked that image gets created, and there is no problem is building tinycore image http://logs.openstack.org/85/495385/2/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-src-ubuntu-xenial/bfaed46/logs/devstacklog.txt.gz#_2017-08-30_18_20_07_81116:19
sambettsanupn: the problem is this: http://logs.openstack.org/85/495385/2/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-src-ubuntu-xenial/bfaed46/logs/devstacklog.txt.gz#_2017-08-30_18_39_08_15616:20
sambettsanupn: http://logs.openstack.org/85/495385/2/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-src-ubuntu-xenial/bfaed46/logs/ironic-bm-logs/node-0_console.txt.gz16:21
sambettsthat is the log of the server that tried to boot16:21
sambettsit appears it was unable to mount the root fs of the image16:21
anupnsambetts, yes cleaning, i noticed that. Yes i checked bmc logs and it says unable to mount something16:21
anupnyeah exactly16:21
anupnseems again something not related to the patch, so was wondering what caused it16:22
sambettsanupn: I can see that compiling of the python 3 libs is failing here http://logs.openstack.org/85/495385/2/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-src-ubuntu-xenial/bfaed46/logs/devstacklog.txt.gz#_2017-08-30_18_19_38_39416:22
sambettsthe tinyipa images without that are significantly bigger basically x2 the size of the originals16:24
sambetts34mb vs 61mb16:24
sambettsand therefore they can't boot because there isn't enough ram16:24
sambettsin the VM16:24
anupnhmm, ^ is interesting.16:24
anupnsambetts, what do you mean "without that"?16:24
anupn"without that are bigger"16:25
sambettswithout compiling the python3 libs and deleteing all the source16:25
anupnsambetts, but i am actually compiling them with python3 here https://review.openstack.org/#/c/495385/2/imagebuild/tinyipa/finalise-tinyipa.sh@17116:26
patchbotpatch 495385 - ironic-python-agent - Build tinyipa with python316:26
anupnand PYOPTIMIZE_TINYIPA is set to true16:26
anupnso that will be executed16:26
sambettsanupn:   http://logs.openstack.org/85/495385/2/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-src-ubuntu-xenial/bfaed46/logs/devstacklog.txt.gz#_2017-08-30_18_19_38_394 <---- it is failing16:27
anupnsambetts, hmm yes16:28
anupnit is unable to execute that command due to not finding /usr/local/lib16:28
anupnpython316:28
sambettsits probably /usr/local/lib/python3.4 or something like that16:28
sambettsthe same as it was python2.7 for python316:29
sambettspython2*16:29
anupnbut without that, still image got created just that it got created bigger in size16:29
*** dprince has joined #openstack-ironic16:29
sambettsanupn: a bigger image can't boot because it doesn't fit into the amount of RAM the VMs have16:29
anupnsambetts, yes agree. I see IRONIC_VM_RAM=102416:30
*** jistr is now known as jistr|afk16:31
anupnso yes. it should precompile in that case. But just wondering now, it will never work inside job if we set PYOPTIMIZE_TINYIPA=false16:31
sambettsanupn: we know we created and set pyoptimize to true specifically so we could reduce the ram in the job16:32
*** yangyapeng has quit IRC16:32
sambettsanupn: so if we were to create a job with it turned off, we know we'd need to increase the amount of ram16:33
* sambetts ---> home 16:34
anupnsambetts, hmm wise, agree16:34
*** nicodemos has left #openstack-ironic16:34
*** sambetts is now known as sambetts|afk16:34
anupnsambetts, have a good rest of the evening16:34
sambetts|afko/ cya16:34
fellypefcanigh sambetts|afk :)16:34
anupnsambetts|afk, cya16:34
fellypefcanight* :D16:34
TheJuliagoodnight16:34
*** trown is now known as trown|lunch16:35
*** crushil has quit IRC16:41
*** mat128 has quit IRC16:44
*** milan has quit IRC16:47
*** namnh has joined #openstack-ironic16:48
*** marios_ has quit IRC16:52
*** crushil has joined #openstack-ironic16:53
*** baoli has quit IRC17:04
*** mgoddard has quit IRC17:04
*** baoli has joined #openstack-ironic17:04
*** baoli has quit IRC17:06
riversHi, the neutron port thats created for the Baremetal host always seems to remain DOWN, even though I see the baremetal host getting a DHCP response... Is that supposed to be this way ?17:12
*** rcernin has quit IRC17:12
jlvillalrivers: I think that is a known issue. I don't think it hurts anything.17:12
jlvillalrama_y: Do you know for sure?  ^^^^17:12
rama_yjlvillal, rivers: it shows DOWN; it is a known issue17:13
jlvillalrama_y: Is there a bug on that?17:13
rama_yPossibly there is a bug filed;17:13
rama_yLet me check.17:14
*** tesseract has quit IRC17:14
rama_yHere it is: https://bugs.launchpad.net/nova/+bug/159983617:14
openstackLaunchpad bug 1599836 in OpenStack Compute (nova) "Booting Ironic instance, neutron port remains in DOWN state" [Medium,Confirmed]17:14
*** baoli has joined #openstack-ironic17:15
*** srobert_ has joined #openstack-ironic17:15
*** srobert has quit IRC17:15
riversOk, thanks for pointing that out, My baremetal host cannot connect to the tftp-server to PXE-boot  after getting a DHCP response, thought maybe neutron port status "DOWN' may have something to do with this17:15
*** jkilpatr has quit IRC17:16
*** namnh has quit IRC17:16
rama_yrivers: I too observed the same and thought so too. However, it was not the port status that was the issue.17:17
*** mat128 has joined #openstack-ironic17:21
riversrama_y: Yeah I'm lost at the moment, not sure how to debug tftp-server, I can see a DHCP request coming back, I have a flat network configured, and a subnet on it, used for nova boot, and I'm using PXE (not iPXE, or uefi)17:21
riversramay_y: Any pointers , what to look for to debug tftp-server ? Thanks17:22
rama_yrivers: in my case I had to configure the network bridge17:26
*** ijw has quit IRC17:28
*** jkilpatr has joined #openstack-ironic17:29
*** ijw has joined #openstack-ironic17:29
openstackgerritMarkos Chandras (hwoarang) proposed openstack/bifrost master: playbooks: roles: bifrost-ironic-install: Set defaults for /etc/hosts  https://review.openstack.org/49969217:30
riversrama_y: Well i think my network bridge is fine, as I can get a dhcp response, are there any logs that tftp-server flushes out,17:31
riversWhats the purpose of the map-file , that these instructions recommend " https://docs.openstack.org/ironic/latest/install/configure-pxe.html "17:31
*** trown|lunch is now known as trown17:33
*** ijw has quit IRC17:33
*** yangyapeng has joined #openstack-ironic17:33
openstackgerritPeter Piela proposed openstack/ironic-ui master: Cleaup ironic-ui portgroup REST interface  https://review.openstack.org/49963617:33
jlvillalTheJulia: Any ideas?17:34
jlvillalopenstack server create --flavor baremetal --volume 5b18aba4-613b-407b-bdc8-a5c262e336dc --key-name default testing17:34
jlvillalBlock Device 5b18aba4-613b-407b-bdc8-a5c262e336dc is not bootable. (HTTP 400) (Request-ID: req-18e5c5c4-8254-4936-88b8-950365fcaf87)17:34
rama_yrivers: you will find a map file in your tftpboot directory17:34
* TheJulia reads17:35
rama_yDid you try ipxe_enabled = false ?17:35
TheJuliajlvillal: how did you get the block device?17:36
jlvillalTheJulia: I followed these instructions near the bottom: https://docs.openstack.org/ironic/latest/contributor/ironic-boot-from-volume.html17:36
rama_yFor me, it was my network config that gave me tftp ARP timeout17:36
riversrama_y: ipxe_enabled = false, its set to false in my ironic.conf17:36
jlvillal# create volume17:36
jlvillalvolume=$(openstack volume create --image $image --size 1 my-volume -f value -c id)17:36
TheJuliawhat kind of image did you use?17:37
jlvillalTheJulia: I created an Ubuntu wholedisk image17:37
jlvillalTheJulia: $ disk-image-create $DISTRO_NAME vm dhcp-all-interfaces -o baremetal-${DISTRO_NAME}-${DIB_RELEASE}17:37
rama_yOk; do you see a folder getting created under /data/ironic/tftpboot with the node UUID?17:37
jlvillalexport DIB_RELEASE=xenial17:37
jlvillalexport DISTRO_NAME=ubuntu17:37
riversrama_y: Yes i see a folder getting created under /tftpboot/UUID/17:38
rama_yrivers: if you see this folder appearing with 'config' file and deploy_ramdisk and deploy_kernel files, then your tftp boot is on the right track17:38
*** yangyapeng has quit IRC17:38
rama_ySo, at what point your tftpboot fails?17:39
TheJuliajlvillal: out of curiosity, did you set the volume as bootable?17:39
jlvillalTheJulia: Uh, I don't know. I was just following the instructions.17:39
openstackgerritPeter Piela proposed openstack/ironic-ui master: Cleanup ironic-ui portgroup REST interface  https://review.openstack.org/49963617:40
jlvillalTheJulia: Just this: volume=$(openstack volume create --image $image --size 1 my-volume -f value -c id)17:40
riversrama_y: Well when the baremetal host, gets to the tftp > stage, it fails immediately with PXE-E11: ARP timeout17:40
TheJuliajlvillal: I guess it needs a cinder set-bootable... blah blah blah command17:40
riversrama_y: It most likely fails to copy the images from the conductor host to the newly launched baremetal host17:40
rama_yrivers: in my case ARP timeout was due to the ovs bridge not configured with an IP address.17:41
jlvillalTheJulia: Hmmm. I don't see that in our devstack code. I'll look some more17:41
riversrama_y: Do you need to configure the ovs-bridge with an IP ? I just configured the port, with an IP { the same port thats added to the ovs-bridge over a flat-network }17:42
rama_yrivers: in /etc/neutron/plugins/ml2/ml2....ini I had to make changes.17:42
*** mgoddard has joined #openstack-ironic17:43
rama_yYes; rivers: the ovs-bridge needs to be configured with an IP17:43
* TheJulia goes back to shade code17:43
*** crushil has quit IRC17:43
rama_yrivers: not sure if you have something like this in ml2 conf file: bridge_mappings = public:br-ex,physnet1:br-eno417:44
riversrama_y: I'm assuming you just did that with " ifconfig <br-name> " ? Or did you set that in the "/etc/neutron/plugins/ml2/m" somewhere ?17:44
* mordred hands TheJulia a bunny rabbit17:44
rama_yrivers: yes; ifconfig <br-name> ....17:44
TheJuliamordred: is it an alien bunny rabbit?17:45
rama_yrivers: You may already have this in ml2 conf : tenant_network_types = flat,vxlan17:45
rama_yrivers: and add your flat network to 'flat_networks = ...'17:46
* etingof is wondering if anyone has a cycle or two for reviewing https://review.openstack.org/#/c/498489/17:47
patchbotpatch 498489 - ironic-python-agent - Report /dev/disk/by-path on inspection17:47
riversrama_y ; yeah i do have these.. I also noticed that the "tftp-server' kept getting assigned the Host-ip of the conductor node, so I manually set the tftp-server IP on the same subnet as the "br-flat" , which is within the ramge of the netron-nic used for nova booting17:48
riversrama_y; i set the tftp-server =$ip, in the ironic.conf, Not sure if thats the right thing to do, because otherwise, the server-ip was being set to the same as the External OAM ip of the conductor node17:48
rama_yrivers: I did not change tftp-server IP17:48
*** baoli has quit IRC17:49
*** yangyapeng has joined #openstack-ironic17:49
riversrama_y : was your tftp-server IP being set on the same subnet as your bridge ?17:49
jlvillalTheJulia: Strange. The volume is in error state after I create it :(17:49
*** baoli has joined #openstack-ironic17:49
rama_yrivers: tftp-server is set to the same IP as the conductor node in ironic.conf17:50
rama_yI left it as is17:50
*** jistr|afk is now known as jistr17:50
riversrama_y: No idea where to go from here, Major roadblock for me :(17:51
rama_yrivers: I understand completely17:52
*** links has quit IRC17:52
rama_yrivers: another thing you might want to check is ip routes17:53
*** etingof has quit IRC17:53
*** yangyapeng has quit IRC17:53
mordredTheJulia: of course!17:53
riversrama_y: How do i do that ?17:55
*** crushil has joined #openstack-ironic17:55
rama_yrivers: #ip route17:56
jlvillalTheJulia: This might be it :) 2017-08-31 17:50:41.396 23121 ERROR oslo_messaging.rpc.server ImageUnacceptable: Image 4dfeb2b5-0e7e-4c47-9c78-309ebf68c7d0 is unacceptable: Image virtual size is 2GB and doesn't fit in a volume of size 1GB.17:56
rama_yrivers: #route -n17:56
TheJuliajlvillal: doh!17:56
jlvillalTheJulia: doh!17:56
*** yangyapeng has joined #openstack-ironic17:58
jlvillalTheJulia: :(  ImageCopyFailure: Failed to copy image to volume: qemu-img: Could not open '/opt/stack/data/cinder/conversion/tmp6ILa1Rubuntu-xenial@lvmdriver-1': Unknown driver 'aki'17:58
riversrama_y: I also noticed another thing, when i check "neutron agent-list", i see that the "Metering Agent" , and "Metadata agent" is not alive.. Should they be ?17:58
rama_yrivers: I do see metadata agent alive17:59
rama_yI do not see metering agent.18:00
*** rwsu has quit IRC18:00
* jlvillal tries to upload the image a different way18:00
rama_yrivers: I don't know much about neutron; my guess is metadata agent is needed. Not sure about metering agent.18:01
*** yangyapeng has quit IRC18:02
*** ijw has joined #openstack-ironic18:03
rama_yjlvillal: Here is a paste for reference: http://paste.openstack.org/show/620121/18:07
rama_yjlvillal: I did this for BFV testing on VM node18:07
jlvillalrama_y: Thanks18:11
riversrama_y: Been reading up on this, Did you have to do something with your iptables or rules , as part of your tftp-server bring up process ? Thanks18:12
rama_yrivers: yes; I deleted a rule18:13
rama_yfor br-ex18:13
rama_yrivers: ip route del x.x.x.x dev br-ex18:14
riversrama_y: did you have to add any rules, like for port 69 used for tftp "iptables -A INPUT -p tcp --dport 69 -j ACCEPT" , something like this18:16
rama_yrivers: I don't recall adding it18:16
*** rwsu has joined #openstack-ironic18:16
riversrama_y: Btw what does deleting the br-ex do for you ?18:17
rama_yrivers: I was able to pxe boot the node18:18
rama_yrivers: also take a look at the tftp config here: /etc/xinetd.d/tftp18:20
rama_yyou would see something like this:  server_args     = -v -v -v -v -v --map-file /opt/stack/data/ironic/tftpboot/map-file /opt/stack/data/ironic/tftpboot18:21
*** jistr is now known as jistr|off18:21
rama_yrivers: you were asking about the map file earlier ^^^18:21
riversrama_y; the ip address to delete br-ex, is that the one you see from if-config or route ? I just tried and got an error "No such process", even though i see br-ex18:21
riversrama_y: yeah i have something similar in my /etc/xinetd/tftp  " -v -v -v -v -v --map-file /tftpboot/map-file /tftpboot "18:22
rama_yrivers: I did 'ip route'18:23
rama_yrivers: I deleted an ip route; not 'br-ex' or the 'ip address' of br-ex18:24
*** livelace has quit IRC18:24
rama_yrivers: btw, did you use devstack in your environment?18:26
*** mat128_ has joined #openstack-ironic18:34
*** mat128 has quit IRC18:37
*** jtomasek has quit IRC18:37
*** fellypefca has quit IRC18:38
*** mat128_ has quit IRC18:43
*** mat128 has joined #openstack-ironic18:43
riversrama_y: i used packstack to install Vanilla openstack, and I'm on the Ocata release18:46
rama_yrivers: ok; I used devstack, Pike release18:47
rama_yrivers: good luck!18:49
riversThanks18:53
*** eglute has left #openstack-ironic18:55
*** eglute has joined #openstack-ironic18:56
*** eglute has left #openstack-ironic18:56
*** jkilpatr has quit IRC18:57
*** yangyapeng has joined #openstack-ironic18:57
*** jkilpatr has joined #openstack-ironic18:57
*** rcernin has joined #openstack-ironic19:01
*** yangyapeng has quit IRC19:01
*** ijw has quit IRC19:08
*** pooja has joined #openstack-ironic19:11
poojaHi all.. Apart from the disk-image-builder, is there another way to generate user images (not deploy images) for baremetal provisioning?19:12
poojaIs a qcow2 image used for VMs on KVM same as a whole disk image for Ironic? I have a windows qcow2 with cloudbase-init which works on KVM and would like to deploy it on baremetal19:13
*** hoonetorg has joined #openstack-ironic19:14
*** krtaylor has quit IRC19:15
*** mayela29 has joined #openstack-ironic19:15
*** mayela29 has quit IRC19:15
*** ijw has joined #openstack-ironic19:16
*** ijw has quit IRC19:16
*** ijw has joined #openstack-ironic19:16
TheJuliapooja: there are other ways, and libvirt does grok qcow2s for disks. You should be able to deploy that windows image19:17
poojaTheJulia: thanks! Good to know that the same images can be used for VMs and baremetal :)19:18
TheJuliapooja: so...19:18
TheJuliathe images must be what are called whole disk images in those cases19:19
poojaSure!19:21
poojaCurious to know - what are the other ways of generating new images for ironic?19:21
*** etingof has joined #openstack-ironic19:29
*** mrtenio has joined #openstack-ironic19:35
*** ijw has quit IRC19:39
*** mrtenio has quit IRC19:40
*** jkilpatr has quit IRC19:40
openstackgerritRamamani Yeleswarapu proposed openstack/ironic master: [TEST] [DO NOT MERGE] Checking gate jobs  https://review.openstack.org/49976819:44
TheJuliapooja: manually :)19:50
TheJulias/manually/manually by hand using loopbacks and eventually creating a raw or qcow2 file that represents the disk19:51
*** e0ne has joined #openstack-ironic19:53
*** yangyapeng has joined #openstack-ironic19:58
*** yangyapeng has quit IRC20:02
*** jkilpatr has joined #openstack-ironic20:03
poojaTheJulia: This is the guide I followed for manually creating the Windows qcow2 image - https://docs.openstack.org/image-guide/windows-image.html20:08
*** yee379 has quit IRC20:09
poojaIt worked on KVM, but for baremetal the node fails on boot and keeps restarting while trying to apply some configuration. Doesn't start in safe mode either.20:09
*** yee379 has joined #openstack-ironic20:09
poojaAre these image creation steps not enough for Ironic?20:09
TheJulianetwork adapter would naturally be different20:12
TheJuliadoes it even start booting?20:12
*** rpioso has quit IRC20:14
poojaYes, it goes to the boot screen and then I see a popup for 'restarting due to error'20:16
*** krtaylor has joined #openstack-ironic20:16
riversHi, I managed to bootup a baremetal node, but it seemed to bootup just once, and took me to a ubuntu login screen , and on the controller host itself, I saw the provision_state of node go from "deploying" to "wait-call-back"20:31
riversI thought isnt the deploy image supposed to load the User Image, and reboot itself, I have no clue why it even took me to a login screen for a Ubuntu image , and never rebooted20:31
*** e0ne has quit IRC20:36
TheJuliarivers: could it be that you have an ubuntu based deployment ramdisk... and that you don't have network connectivity enabling the wait callback state to be exited?  Have you checked your ironic-api and ironic-conductor logs?20:37
jlvillalTheJulia: rama_y: Making progress on BFV testing. I got to an error since I am not using iPXE. Recreating my devstack VM...again20:38
TheJuliaheh20:39
TheJuliayeah, that is kind of a super hard requirement20:39
rama_yjlvillal, thanks.20:40
jlvillalTheJulia: I had disabled it because I was having issues where it wouldn't chain boot :( But usually I can manually enter the iPXE command line and get it to work.20:40
*** ijw has joined #openstack-ironic20:40
jlvillalTheJulia: I think something strange with Vagrant/Virtualbox networking20:40
riversTheJulia: The only useful thing i see in ironic-conductor logs is this "Deploy boot mode is None for 764a5c62-21ee-494f-ae6b-044b6d02fadc. get_boot_mode_for_deploy /usr/lib/python2.7/site-packages/ironic/drivers/modules/deploy_utils.py:78220:40
rivers"20:40
TheJuliajlvillal: I'd <3 a screenshot of that20:40
jlvillalTheJulia: I can try :)20:41
jlvillalTheJulia: The failure?20:41
jlvillalI have a little video :)20:41
TheJuliaa video of it would work20:41
TheJuliajust to understand what state it is actually getting stuck in20:41
TheJuliasince the step immediately following should be dhcp'ing, and then that dhcp reply should have a url in it from the dhcp server20:42
jlvillalTheJulia: https://goo.gl/photos/7S6Pn57cBkyC5P4A920:42
TheJuliahmmmmm20:43
jlvillalTheJulia: It will automatically loop the video. I found it easier to download it and watch in VLC20:43
TheJuliadoes it never actually get to ipxe on it's own20:43
TheJulia?20:43
riversTheJulia: After deploying athe deploy image, in an ideal scenario, does the baremetal node itself reboot to load user image, after doing a successful Lookup ?20:44
jlvillalTheJulia: Not really. Seems strange. PXE and tftp work. It downloads the iPXE program20:44
jlvillalTheJulia: But then iPXE fails. Very strange I think20:44
*** ijw has quit IRC20:45
*** yangyapeng has joined #openstack-ironic20:53
TheJuliarivers: lookup occurs to identify it's self. deploying node then gets instructions on what to do, image is written to disk, and then the node is rebooted.20:54
TheJuliajlvillal: that is really weird20:54
jlvillalTheJulia: Yeah :(20:55
*** mat128 has quit IRC20:55
TheJuliamaybe the wrong ipxe binary?20:55
jlvillalTheJulia: What do you mean? The one that is running that times out? Or the one it is trying to fetch (boot.ipxe) ?20:57
*** yangyapeng has quit IRC20:57
*** crushil has quit IRC20:58
riversTheJulia: I just did this again, and noticed that immediately after getting the pxe-boot image, the ironic node provisioning state, moves from "deploying" to "wait call-back" , and this is even before the node bootsup20:58
riversTheJulia: and upon the first boot, the node just goes into a login prompt, and doesnt seem to accept default ubuntu login credentials20:58
TheJuliajlvillal: hmmmmmmmmm20:59
jlvillalTheJulia: And my use case of my Virtualbox being the iPXE server seems like a rare case. Everything I search for seems to be the VM as the client for iPXE21:00
TheJuliajlvillal: because it is not on the first device, and for some reason it is not going anywhere.  is spanning tree enabled?21:00
TheJuliarivers: yes, wait call-back is an intermediate state while we are waiting for the agent to check-in21:00
jlvillalTheJulia: I tried this with an ethernet cable connected between my two boxes and it failed also. So no switch.21:00
jlvillalTheJulia: Now I'm back to using a 10Gb fiber switch between the boxes21:01
TheJuliamake it use the first interface perhaps?  since your pee'ing off of the second interface it looks like21:01
TheJuliapxe'ing21:01
jlvillalheh21:01
* TheJulia actually goes to figure out how to disable autocorrect21:01
jlvillalIt made me laugh!21:01
riversTheJulia: oh, according to this https://docs.openstack.org/ironic/latest/_images/states.svg , it should have gone from "deploying" to "Active" , it only goes to wait-call-back if its failing or deleting21:02
jlvillalI was like, what?21:02
TheJulia\o/ no more autocorrect21:02
srartDon't know if the rest of the country is panicking yet, but in TX we have gas lines, like in the 70s lines.21:02
TheJuliasrart: 70s vehicles deep?21:03
TheJuliavehicles from the 70s?21:03
* TheJulia is otherwise confused21:03
srartlike the lines in the 70s gas shortage.21:03
TheJuliaoh, ahh21:03
*** trown is now known as trown|outtypewww21:04
TheJuliapeople are not freaking out quite yet, at least in New Mexico.21:04
*** yusef has joined #openstack-ironic21:04
srartmay want to beat your local panic and get it before prices finish skyrocketing.21:04
* TheJulia has a full gas tank and a full diesel tank21:04
* TheJulia also has a full propane tank, but that is only used for warmth and cooking21:04
* srart has half electric car21:05
*** ijw has joined #openstack-ironic21:05
srartso I get to be extra smug right now. ;-)21:05
* TheJulia wishes her RV was all electric..... 21:05
srartbiodiesel it and chop up the bodies.21:05
TheJuliarivers: so the state machine doesn't let it go from deploying to active until it is done deploying21:06
TheJuliarivers: think of wait callback as a state in between21:06
TheJuliasrart: Biodiesel blends, sadly gets me less milage when towing my car21:07
riversTheJulia: ok, this is the furtheset ive gotten in a week, and now deployment fails, because I'm taken to a Ubuntu login page, on first boot, and then failing... the ironic-conductor.log dont show anything useful, looks like its not even getting to a lookup phase, should i suspect the deploy image created using "disk-image-builder" ?21:08
*** penick has joined #openstack-ironic21:10
riversAlso, do both the Deploy Image and the User Image need to be the same OS ? Can i have deploy as Ubuntu, and User image as Fedora etc ?21:10
TheJuliarivers: that is exactly what you should suspect21:10
TheJuliathey do not need to be the same distribution or os21:10
TheJuliaso, I'd recommend coreos or maybe building a fedora image.  Also, there are DIB elements that you can use to burn a user into the image for troubleshooting21:11
TheJuliaMost likely, with the ramdisk booting, it is hardware support, like it doesn't know how to use the network cards or something silly like that21:12
riversTheJulia: I used this page, and just used the disk-image-builder (second half on this page) https://docs.openstack.org/ironic/latest/install/deploy-ramdisk.html21:12
riversTheJulia: Do you recommend using ironic python agent instead of disk image builder ?21:13
*** Goneri has quit IRC21:13
TheJuliahttps://docs.openstack.org/diskimage-builder/latest/elements/devuser/21:14
*** crushil has joined #openstack-ironic21:15
TheJuliathe diskimage-builder ironic-agent image creation just installs ironic python agent inside of the image. You may want to try our pre-built CoreOS images21:15
*** mgoddard has quit IRC21:15
jlvillalrivers: Do you have a serial connection to the system? It can be very illuminating compared to not having it.21:15
TheJuliao/ crushil21:15
jlvillalrivers: My minicom status line: CTRL-A Z for help | 9600 8N1 | NOR | Minicom 2.7 | VT102 | Offline | ttyS021:16
*** ijw has quit IRC21:16
jlvillalTheJulia: Yeah, failed again. But I hit CTRL-B. Did 'dhcp' and then a few moments later 'chain http://10.0.2.15:3928/boot.ipxe' and it worked. Weird!21:26
TheJuliaSo, a Ethernet interface hold down it is then....21:27
riversTheJulia: I wasn't able to ssh into the baremetal node, CTRL-A-Z at which point? Sorry didnt full understand what you meant by that21:27
TheJuliaBut... Just dhcping should be enough21:27
TheJuliaSince the reply from the server should tell you what to do........21:28
*** etingof has quit IRC21:32
*** etingof has joined #openstack-ironic21:32
*** racedo has quit IRC21:33
riversTheJulia: Where do i find the prebuild CoreOs deployment images ?21:34
TheJuliarivers: ignore the bit about control-a-z21:35
riversok21:35
TheJuliahttps://tarballs.openstack.org/ironic-python-agent/coreos/files/21:35
*** karimb has joined #openstack-ironic21:35
TheJuliayou'll need a ramdisk and kernel file that match the version of openstack ironic your using21:36
TheJuliaif you look at our troubleshooting docs, it tells you how to set it up so you can ssh into coreos21:36
TheJuliayou can also just login on the console21:36
*** srobert_ has quit IRC21:36
*** penick has quit IRC21:41
openstackgerritJohn L. Villalovos proposed openstack/python-ironicclient stable/pike: Allow OS_BAREMETAL_API_VERSION=latest to work  https://review.openstack.org/49981921:41
*** baoli has quit IRC21:43
riversTheJulia: Found a download link to prebuild coreos deploy images here too https://docs.openstack.org/ironic/latest/install/deploy-ramdisk.html .... Btw with this, I can still use the Ubuntu User images right ? The User image can be any OS right, regardless of what the Deploy image OS is ?21:45
riversthanks21:45
*** baoli has joined #openstack-ironic21:45
TheJuliayes, you can. A user image can be any os when it is a whole disk image21:46
*** priteau has quit IRC21:49
*** bfournie has quit IRC21:49
*** baoli has quit IRC21:50
riversTheJulia: Does it have to be a whole disk image ? I created parition images using "disk-image-create ubuntu baremetal dhcp-all-interfaces grub2 -o my-image "21:52
jlvillalTheJulia: I think I just booted from volume on real bare-metal :)21:53
TheJuliarivers: I think that actually makes you a whole disk image21:54
*** yangyapeng has joined #openstack-ironic21:54
TheJuliajlvillal: woot!21:54
jlvillalTheJulia: Probably old news for you. But cool for me to see it in real-life21:54
*** yangyapeng has quit IRC21:58
rama_yjlvillal, awesome!21:58
jlvillalBut then I can't login. Since no DHCP21:59
jlvillalAnd both consoles are dead. Serial and KVM21:59
riversTheJulia: No the whole disk image is created with this "disk-image-create ubuntu vm dhcp-all-interfaces -o my-image " or so the openstack page says... .. but to ask the question again, if its not a whole disk image, then a CoreOS deploy image will not support a Ubuntu user image ? is that the case , thanks22:00
jlvillalBut that was happening with cirros before. Since I have 4 interfaces and it only seems to DHCP the first interface.22:00
*** [1]rpioso has joined #openstack-ironic22:00
* jlvillal finds it confusing that dib element 'vm' makes a wholedisk image and dib element 'baremetal' makes a non-wholedisk image. 22:01
TheJuliait doesn't really afaik22:01
TheJuliaanyway22:01
jlvillalNot exactly intuitive names to me.22:02
TheJuliaThings have become confused22:02
TheJuliaIf it is not linux, and does not use grub, then you must use a whole disk image. So, coreos really doesn't care about what it deloys22:02
riversTheJulia: There is this parameter for ironic node "driver_internal_info   | {u'is_whole_disk_image': False} ", does this get automatically set, or am i supposed to modify that based on the type of image ?22:11
poojais_whole_disk_image was set automatically in my case when used with nova-compute22:13
TheJuliait is set based upon the parameters supplied for the deployment22:13
TheJuliaso, automatically22:13
*** jcoufal has quit IRC22:16
*** ijw has joined #openstack-ironic22:17
riversTheJulia: So i just tried the prebuild coreos image you pointed me to, and even this on first boot takes me to "login prompt "22:17
TheJuliahttps://docs.openstack.org/developer/ironic-python-agent/troubleshooting.html22:18
riversTheJulia: Am i supposed to do something at this point, or i thought its supposed to reboot itself with the user-image ... and i have the "local boot" option also set for node and flavor22:18
*** dprince has quit IRC22:20
TheJuliarivers: Well, deployment is not instantanious. You'll want to look at the node status.  In the mean time, you might want to look at the webpage I just linked22:20
*** bfournie has joined #openstack-ironic22:23
*** ijw has quit IRC22:23
*** bfournie has quit IRC22:24
*** bfournie has joined #openstack-ironic22:25
*** ijw has joined #openstack-ironic22:27
*** Nisha_Agarwal has joined #openstack-ironic22:28
*** krtaylor has quit IRC22:28
*** rcernin has quit IRC22:30
*** Nisha_Agarwal has quit IRC22:38
*** leyal has quit IRC22:38
*** thegreenhundred has quit IRC22:38
*** leyal has joined #openstack-ironic22:38
*** [1]rpioso has quit IRC22:40
*** Nisha_Agarwal has joined #openstack-ironic22:51
*** yangyapeng has joined #openstack-ironic22:55
*** pooja has quit IRC22:55
*** yangyapeng has quit IRC22:59
*** rbudden has quit IRC23:06
*** ijw has quit IRC23:11
*** stendulker has joined #openstack-ironic23:11
*** rbudden has joined #openstack-ironic23:11
*** ijw has joined #openstack-ironic23:12
*** stendulker_ has joined #openstack-ironic23:13
*** stendulker has quit IRC23:15
*** ijw has quit IRC23:16
crushilTheJulia, Sorry was afk23:29
*** charcol has joined #openstack-ironic23:36
*** Nisha_Agarwal has quit IRC23:37
*** ntpttr_laptop has quit IRC23:40
*** tcrowe has joined #openstack-ironic23:41
*** ijw has joined #openstack-ironic23:45
*** stendulker_ has quit IRC23:46
*** rama_y has quit IRC23:48
*** priteau has joined #openstack-ironic23:49
*** ijw has quit IRC23:51
*** yangyapeng has joined #openstack-ironic23:52
*** priteau has quit IRC23:54
*** yangyapeng has quit IRC23:57
openstackgerritAnup Navare proposed openstack/ironic-python-agent master: Build tinyipa with python3  https://review.openstack.org/49538523:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!