Tuesday, 2014-10-21

*** todd_dsm has quit IRC00:03
*** Haomeng has joined #openstack-ironic00:06
*** Haomeng|2 has quit IRC00:07
*** zigo has quit IRC00:07
*** praneshp has quit IRC00:12
devanandaNobodyCam: edited to clarify00:12
devanandagotta run now ... need to head t othe airport soon00:12
*** todd_dsm has joined #openstack-ironic00:13
*** zigo has joined #openstack-ironic00:13
NobodyCam:) have a good night00:17
NobodyCamflight00:18
*** kongfy has joined #openstack-ironic00:42
*** marcoemorais has quit IRC00:48
*** Haomeng|2 has joined #openstack-ironic00:58
*** Haomeng has quit IRC00:59
*** todd_dsm has quit IRC01:13
*** takadayuiko has joined #openstack-ironic01:21
*** rushiagr_away is now known as rushiagr01:24
*** rameshg87 has joined #openstack-ironic01:25
*** rushiagr is now known as rushiagr_away01:26
*** todd_dsm has joined #openstack-ironic01:28
*** rameshg871 has joined #openstack-ironic01:55
*** rameshg87 has quit IRC01:58
*** spandhe has quit IRC02:00
*** nosnos has joined #openstack-ironic02:02
*** dlaube has quit IRC02:04
*** todd_dsm has quit IRC02:04
*** eghobo has quit IRC02:06
*** rameshg871 has quit IRC02:17
*** rloo has quit IRC02:18
Haomeng|2morning:)02:56
*** Haomeng|2 has quit IRC02:56
mrdaHi harlowja02:56
mrdasorry, tab expansion fail02:57
harlowja:)02:57
*** chenglch has joined #openstack-ironic02:59
devananda"mechanical delay"03:04
devanandanow I'm waiting on a new plane03:04
*** yjiang5 has quit IRC03:13
*** ramineni has joined #openstack-ironic03:13
*** yjiang5 has joined #openstack-ironic03:15
*** greghaynes has quit IRC03:15
*** greghaynes has joined #openstack-ironic03:19
*** pcrews has quit IRC03:23
*** nosnos has quit IRC03:26
*** nosnos has joined #openstack-ironic03:27
*** nosnos has quit IRC03:32
*** ChuckC has quit IRC03:35
*** praneshp has joined #openstack-ironic04:00
*** bradjones has quit IRC04:05
*** bradjones has joined #openstack-ironic04:07
*** nosnos has joined #openstack-ironic04:16
*** rakesh_hs has joined #openstack-ironic04:46
*** wendar_ is now known as wendar05:03
*** lazy_prince has quit IRC05:18
*** harlowja is now known as harlowja_away05:30
*** rameshg87 has joined #openstack-ironic05:30
*** rakesh_hs2 has joined #openstack-ironic05:41
*** rakesh_hs has quit IRC05:41
*** k4n0 has joined #openstack-ironic05:50
*** ryanpetrello has quit IRC05:55
*** ryanpetrello has joined #openstack-ironic05:55
*** killer_prince has joined #openstack-ironic06:00
*** killer_prince is now known as lazy_prince06:00
*** lazy_prince is now known as killer_prince06:06
*** pradipta_away is now known as pradipta06:12
*** killer_prince is now known as lazy_prince06:12
*** Haomeng has joined #openstack-ironic06:32
*** ifarkas has joined #openstack-ironic06:41
*** bigjools has quit IRC06:48
*** bigjools has joined #openstack-ironic06:48
*** chenglch has quit IRC06:56
*** chenglch has joined #openstack-ironic06:57
*** pensu has joined #openstack-ironic06:57
GheRiveromorning all07:02
*** andreykurilin_ has joined #openstack-ironic07:11
devanandamorning, GheRivero07:22
*** dtantsur|afk is now known as dtantsur07:37
dtantsurMorning Ironic07:37
dtantsurdevananda, yeah, it proved to be much better that carry on set of patches for Ironic. I'm looking forward to decision on DRAC/ILO OOB discovery (aka introspection) to plug into this thing as well.07:39
*** andreykurilin_ has quit IRC07:41
*** jcoufal has joined #openstack-ironic07:50
*** mitz has quit IRC07:52
*** lazy_prince is now known as killer_prince07:55
*** mitz has joined #openstack-ironic07:55
*** chenglch has quit IRC07:56
openstackgerritDmitry Nikishov proposed a change to openstack/ironic: Removed hardcoded IDs from "node" test resources  https://review.openstack.org/12797407:56
*** chenglch has joined #openstack-ironic07:56
*** praneshp has quit IRC07:59
*** killer_prince is now known as lazy_prince07:59
*** praneshp has joined #openstack-ironic08:00
*** jistr has joined #openstack-ironic08:02
*** ndipanov_gone is now known as ndipanov08:07
*** athomas has joined #openstack-ironic08:10
*** praneshp has quit IRC08:19
*** pradipta is now known as pradipta_away08:22
*** pensu has quit IRC08:27
*** lsmola has quit IRC08:33
*** takadayuiko has quit IRC08:33
*** openstackgerrit has quit IRC08:34
*** openstackgerrit has joined #openstack-ironic08:35
*** lucasagomes has joined #openstack-ironic08:37
*** pensu has joined #openstack-ironic08:41
*** MattMan has joined #openstack-ironic08:43
*** Mohit has joined #openstack-ironic08:44
*** Mohit has quit IRC08:44
*** igordcard has joined #openstack-ironic08:46
*** lsmola has joined #openstack-ironic08:46
*** Mohit has joined #openstack-ironic08:49
*** Mohit is now known as m0hit08:49
*** m0hit is now known as m0hitt08:52
*** bradjones_ has joined #openstack-ironic08:53
*** bradjones has quit IRC08:53
*** bradjones_ is now known as bradjones08:53
*** m0hitt is now known as m0hit08:53
*** bradjones has quit IRC08:53
*** bradjones has joined #openstack-ironic08:53
*** m0hit is now known as m0hitt08:54
*** m0hitt is now known as __mohit__08:54
*** pensu has quit IRC08:55
*** __mohit__ has quit IRC08:58
*** __mohit__ has joined #openstack-ironic08:59
*** igordcard has quit IRC09:03
*** lsmola has quit IRC09:05
*** igordcard has joined #openstack-ironic09:07
*** pelix has joined #openstack-ironic09:09
*** pensu has joined #openstack-ironic09:09
dtantsurbrb09:18
*** athomas has quit IRC09:18
*** lsmola has joined #openstack-ironic09:20
*** yuanying has quit IRC09:26
*** yuanying has joined #openstack-ironic09:27
*** athomas has joined #openstack-ironic09:29
*** teju has joined #openstack-ironic09:30
*** yuanying has quit IRC09:32
*** nosnos has quit IRC10:02
*** nosnos has joined #openstack-ironic10:03
*** nosnos has quit IRC10:08
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Add API endpoint to set/unset the node maintenance mode  https://review.openstack.org/12892510:10
*** jcoufal has quit IRC10:10
*** yuanying has joined #openstack-ironic10:11
*** chenglch has quit IRC10:20
*** teju has left #openstack-ironic10:37
*** jcoufal has joined #openstack-ironic10:38
*** jcoufal has quit IRC10:39
*** jcoufal has joined #openstack-ironic10:39
*** pensu has quit IRC10:41
*** pensu has joined #openstack-ironic10:41
*** bradjones has quit IRC10:45
*** bradjones has joined #openstack-ironic10:47
*** foexle has joined #openstack-ironic10:52
openstackgerritDmitry Nikishov proposed a change to openstack/ironic: Removed hardcoded IDs from "node" test resources  https://review.openstack.org/12797410:53
*** ramineni has quit IRC11:00
*** rameshg87 has quit IRC11:04
*** romcheg has quit IRC11:05
*** pensu has quit IRC11:05
*** jistr is now known as jistr|english11:27
kongfyHi, is any body here ? I encountered a problem when deploy ironic with devstack , I have stucked a few days…I really need some help !11:37
*** pelix has quit IRC11:37
*** k4n0 has quit IRC11:37
*** rwsu has quit IRC11:37
*** kbyrne has quit IRC11:37
*** RioS2 has quit IRC11:37
*** mrda has quit IRC11:37
*** mrda has joined #openstack-ironic11:37
*** kbyrne has joined #openstack-ironic11:37
*** RioS2 has joined #openstack-ironic11:37
*** rwsu has joined #openstack-ironic11:38
*** pelix has joined #openstack-ironic11:38
*** k4n0 has joined #openstack-ironic11:38
kongfyI followed the doc in Ironic  deleloper guild, and the test vm works well , but I can’t get the real baremetal machine work…..11:39
*** k4n0 has quit IRC11:46
*** k4n0 has joined #openstack-ironic11:46
*** pelix has quit IRC11:46
*** pelix has joined #openstack-ironic11:46
lucasagomeskongfy, hey what's the problem?11:48
lucasagomesr u using the ipmitool driver?11:48
kongfyyes ,and the machine is actually powered on by ipmi11:48
lucasagomesright, so for deployment r you using PXE?11:49
kongfybut PXE can  not get an IP from DHCP11:49
lucasagomesright, and you're using neutron for ur DHCP?11:49
kongfyI’m confused with neutron configuration…11:49
kongfyI’m not sure how to config it , is there some instructions?11:50
lucasagomeskongfy, http://docs.openstack.org/developer/ironic/deploy/install-guide.html#configure-neutron-to-communicate-with-the-bare-metal-server11:50
lucasagomesI don't know much about the neutron part too, I think it's where most ppl get stuck on11:51
*** dprince has joined #openstack-ironic11:52
lucasagomesIronic has a pluggable mechanism for dhcp backends, but upstream we have only neutron and a no-op one, for those who wants to use some static dhcp config11:52
kongfythx , I followed this article, but It seems not compliant with Devstack, so I changed the config file in /etc/neutron/plugins ,and recreate networks11:53
kongfyand then even the vm stuck at wait-callback ...11:54
lucasagomesyeah, can u see the node terminal?12:00
lucasagomesI mean console*12:02
kongfyyes , I can see it12:04
kongfystuck at booting from PXE , no DHCP offer received12:04
lucasagomesI see, maybe you can try to debug what's wrong with neutron using dhcping, I'm not the best source of info on that network issue involving neutron really :/12:05
lucasagomesmaybe worth taking a look at how neutron does it with devstack as well12:06
lucasagomeslooking at the devstack lib/neutron12:06
kongfyyeah ,I will keep trying ,thank you for your patient!!12:08
kongfyI have tried that way ,have to say ,neutron is scary ….12:09
lucasagomeskongfy, no worries12:09
lucasagomesyeah :/12:09
lucasagomesbrb lunch12:10
*** lucasagomes is now known as lucas-hungry12:10
lucas-hungrykongfy, but anyway... if ur just trying you may want to run ur own dhcp server12:10
lucas-hungryjust to see if that works12:10
lucas-hungrybrb12:10
kongfythat ’s great !!! where can I get them ?12:11
kongfyI know what’s your meaning, I will try it! but can my own dhcp cooperate well with ironic ?12:15
*** sirushti has quit IRC12:20
*** sirushti has joined #openstack-ironic12:22
*** k4n0 has quit IRC12:28
jrollmorning everybody :)12:57
*** lazy_prince is now known as killer_prince12:57
jrollkongfy: if you use your own dhcp server, set the config dhcp_provider=none12:57
*** jistr|english is now known as jistr12:57
jrolland you'll need to set it up to do tftp and such for pxe booting12:58
kongfyis that a config entry in devstack or neutron?12:58
jrollironic12:59
jrollwith that option, ironic won't make calls to neutron12:59
kongfythx a lot! I will try it !12:59
jroll:)13:00
openstackgerritJim Rollenhagen proposed a change to openstack/ironic: Add Node.maintenance_reason  https://review.openstack.org/12864513:00
jrolldtantsur: ^ fixed :)13:00
jrolllucas-hungry: your patch will need a rebase13:00
openstackgerritJim Rollenhagen proposed a change to openstack/ironic: Add maintenance_reason when setting maintenance mode  https://review.openstack.org/12864613:00
dtantsurjroll, thanks13:00
*** lucas-hungry is now known as lucasagomes13:02
lucasagomesjroll, morning! cheers I will take a look13:02
*** rloo has joined #openstack-ironic13:06
GheRiverolucasagomes: what's the status of the oslo.config patch? https://review.openstack.org/#/c/128005/13:07
lucasagomesGheRivero, oh I'll get back to it, I've to find a way to do a glob to get the config options. Feel free to update it if u want as well.13:08
GheRiveroI'll take a look to it later. thx for the update!13:09
jrollI don't like splitting it to two files, fwiw :|13:09
jrollbut if others want it, it's fine13:10
GheRiverome neither. We can just update it (and let one config file) and asks the ops/ML what they prefer13:10
*** pensu has joined #openstack-ironic13:11
jrollI'm excited for the ops meetup... curious who else is operating ironic13:11
lucasagomesoh yeah I will remove that split too13:14
*** jistr has quit IRC13:20
*** jistr has joined #openstack-ironic13:23
NobodyCamgood morning Ironic13:28
jrollheya NobodyCam :)13:28
NobodyCammorning jroll lucasagomes and GheRivero :)13:29
lucasagomesNobodyCam, morning13:29
GheRiveromorning NobodyCam13:30
NobodyCamvirtual box releases too many updates :-p13:30
NobodyCamhey GheRivero All ready for .fr13:30
*** r-daneel has joined #openstack-ironic13:34
GheRiverosure! It's going to be really easy for me this time13:34
NobodyCamlol :)13:35
rloohello Ironickers (jroll, GheRivero, lucasagomes, NobodyCam)13:36
jrollmorning rloo :)13:36
openstackgerritDmitry Nikishov proposed a change to openstack/ironic: Removed hardcoded IDs from "node" test resources  https://review.openstack.org/12797413:38
lucasagomesrloo, yo morning13:38
NobodyCammorning rloo13:44
*** pensu has quit IRC13:47
*** romcheg has joined #openstack-ironic13:48
marckmorning everyone, I'm having trouble getting the ironic packages installed in Juno. Following the guide @ http://docs.openstack.org/developer/ironic/deploy/install-guide.html, when I try to install the packages it fails with "ironic-api : Depends: ironic-common (= 2014.1~rc1-0ubuntu1) but it is not going to be installed"13:51
NobodyCammarck: hummm13:51
NobodyCamhave you included icnic-common on the apt-get command?13:52
marckyes, running apt-cache show ironic-common, the version is 2014.1~rc1-0ubuntu1, not 2014.213:53
rloomarck, NobodyCam: this might help: http://packages.ubuntu.com/search?suite=utopic&searchon=names&keywords=ironic13:53
NobodyCamrloo: :) grat link13:54
rloomarck: was it trying to install 2014.2 or 2014.1 (for ironic-api etc)?13:54
NobodyCamgreat even13:54
marckI'm running trusty (14.04), is it safe to install debs from utopic (14.10)13:54
marckrloo: 2014.113:55
rloomarck: so 2014.1 is icehouse. you want juno cuz it is better :-)13:55
marckrloo: sure...? :)13:56
rloomarck: I think it is safe to install from utopic, because we've been testing that version with trusty.13:56
rloomarck: definitely sure!13:56
rloomarck: having said that, I haven't tried it myself. guess we should and update the instructions.13:56
marckrloo/NobodyCam: thank you both, I'll give it a shot.13:56
NobodyCam:)13:56
rloomarck: when it works, let us know ;)  Also, any other feedback about the documentation (or lack of) would be great13:57
NobodyCam++++13:57
rloodoes anyone know how/if ubuntu will make ironic avail with trusty?13:58
NobodyCami do not13:59
*** sambetts has joined #openstack-ironic14:00
NobodyCamwell google shows me https://launchpad.net/ubuntu/trusty/+source/ironic/2014.1~rc1-0ubuntu114:00
NobodyCamwhich says "IRONIC" ... in The Trusty Tahr14:01
jrollthat's icehouse, though14:02
NobodyCamya14:02
*** todd_dsm has joined #openstack-ironic14:04
NobodyCamhttps://launchpad.net/~openstack-ubuntu-testing/+archive/ubuntu/juno14:05
NobodyCamthey are testing14:06
NobodyCamso I would assume at some point14:06
rlooNobodyCam: so some packages are in trusty and utopic. some (like ironic) are only in utopic. you think it is just a matter of time that there will be versions on trusty?14:07
marckI downloaded the 2014.2 debs from http://mirrors.kernel.org/ubuntu/pool/universe/i/ironic/14:08
NobodyCamrloo: yea14:08
NobodyCammarck: :)14:08
marckstarted with python-ironic and it complained about python-pecan and python-pyghmi not being install14:08
NobodyCammarck: yep. I'start with command and its deps14:09
NobodyCams/i'/i'd /14:09
jrollwhy is ubuntu requiring python-pyghmi :(14:09
jrollthat's wrong for juno14:10
NobodyCamya14:10
NobodyCamremoved here https://github.com/openstack/ironic/commit/2ba774deb6def3ca8bad2131a8dd7ba4f2fac218#diff-b4ef698db8ca845e5845c4618278f29aL3014:12
marckafter running apt-get -f install, I was able to manually install the debs. ironic-api, ironic-common and python-ironic are all 2014.2...but no ironic-conductor14:14
marck"ironic-conductor depends on lsb-base (>= 4.1+Debian11ubuntu7); however: Version of lsb-base on system is 4.1+Debian11ubuntu6."14:15
*** pcrews has joined #openstack-ironic14:15
*** bradjones has quit IRC14:16
marcklsb-base 4.1+Debian11ubuntu8 is available in utopic, but that would break upstart according to dpkg14:18
jrollthis is why I don't believe in distro packages :(14:20
jrollI wish I could help you, marck, but I don't know much about this stuff14:20
NobodyCamshould we come up with pip install docs?14:21
jrollvirtualenv /path/to/env && source /path/to/env/bin/activate && pip install git+https://github.com/openstack/ironic.git@stable/juno14:23
jrolldone14:23
NobodyCam:-p ... brb14:23
marckjroll/NobodyCam: I appreciate the help, this is a PoC so we're just trying to get a demo going. I've been hearing that installing from source is the best method. When you install a component using pip, are the start up scripts installed?14:25
jrollmarck: no, that's a downside, you have to come up with init scripts14:26
jrollI could put up a simple one somewhere, though14:27
*** bradjones has joined #openstack-ironic14:29
marckjroll: that'd be great, thanks.14:31
jrollmarck: https://gist.github.com/jimrollenhagen/16904f939120ccca71f014:34
jrollthat's approximately what we use14:34
NobodyCammarck: you could also take a look at the disk image builder element for Ironic for how it does that.. https://github.com/openstack/tripleo-image-elements/blob/master/elements/ironic/install.d/ironic-source-install/68-ironic14:34
*** bradjones has quit IRC14:37
*** kbyrne has quit IRC14:37
*** ChuckC has joined #openstack-ironic14:38
*** derekh has joined #openstack-ironic14:39
*** zz_jgrimm is now known as jgrimm14:44
*** kongfy has quit IRC15:14
*** jistr has quit IRC15:14
marckI installed ironic using pip and I've got ironic-api and ironic-conductor running. I followed the docs but when I run ironic node-validate, deploy has a result of False and the reason "Cannot validate iSCSI deploy. The following parameters were not passed to ironic: ['root_gb', 'image_source']"15:15
*** jcoufal has quit IRC15:16
dtantsurmarck, it should be ok, these values are filled by nova on deploying instance15:18
rloomarck: so depending on which driver you're using, the node's 'driver_info' needs to have parameters set.15:18
lucasagomesmarck, oh it's because those fields are going to be filled by Nova... it's not straight forward :/ there's a bug opened about it as well afaik15:18
marckI set enabled_drivers=pxe_ipmitool15:18
lucasagomesrloo, those are instance_info, maybe we should not check that at validate time15:19
rloomarck: oh, I think those aren't driver_info things but instance_info things.15:19
NobodyCamyes thats the instance info ones15:19
rloolucasagomes: yeah. or no. if we assume nova puts those values in then fine. but in a standalone world...15:19
lucasagomesyeah15:20
jrollso15:20
jrollas part of the long running ramdisk spec15:20
lucasagomesexactly, we have to think about something around there15:20
jrollI proposed passing a method to validate15:20
jrolle.g. 'deploy', 'tear_down', etc15:21
jrollthere could be a different method for node-validate15:21
*** ifarkas has quit IRC15:21
NobodyCammarck: if you manually hacking on this you would use somehting like :15:23
NobodyCamironic node-update nodeUUid add instance_info/root_gb=1015:23
NobodyCamironic node-update nodeUUid add instance_info/image_source=ea5f4e1b-c4c1-475d-a95c-b9e929bfc1d915:23
NobodyCamnote size and image uuid is from my local test env15:24
NobodyCamand would need to me replaced with the correct values for your env15:24
*** rakesh_hs2 has quit IRC15:25
lucasagomesjroll, that sounds like a good idea, so it doesn't validate the whole interface, but specific methods15:26
lucasagomesjroll, like the vendor_passthru stuff15:26
jrollright15:26
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Driver VendorPassthru to support different HTTP methods  https://review.openstack.org/12994215:26
lucasagomesjroll, btw ^15:26
lucasagomesI still have to write the spec15:26
jrollcool15:26
marckNoValidHost exception in nova-conductor.log, brb15:27
*** dprince has quit IRC15:27
*** dprince has joined #openstack-ironic15:27
*** igordcard has quit IRC15:29
lucasagomesmarck, is the conductor running? does it have the driver you're using enabled?15:30
*** igordcard has joined #openstack-ironic15:31
lucasagomesgate is ultra slow :(15:34
lucasagomesup to 19h15:34
*** marcoemorais has joined #openstack-ironic15:40
*** jistr has joined #openstack-ironic15:43
NobodyCameasy clean up spec with 2 x +2's already any one else gots a free minute to git a quick look see: https://review.openstack.org/#/c/12790015:43
NobodyCams/git/give it/15:44
* rloo is too picky, not going to look15:44
jrollNobodyCam: +2a15:46
NobodyCam:)15:49
devanandamorning, all15:49
NobodyCamgood morning devananda :)15:49
jrollheya devananda :)15:49
openstackgerritA change was merged to openstack/ironic-specs: iLO Management Interface  https://review.openstack.org/12790015:55
lucasagomesdevananda, morning15:55
*** viktors is now known as viktors|afk15:57
jrolllucasagomes: can you rebase https://review.openstack.org/#/c/128925/ ? )16:00
jroll:) even16:00
jrolland then everybody can approve everything16:01
lucasagomesoh yush sorry16:01
lucasagomesrebasing...16:01
jrollthanks!16:01
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Add API endpoint to set/unset the node maintenance mode  https://review.openstack.org/12892516:09
lucasagomesdone :)16:09
jrollhooray16:09
openstackgerritJim Rollenhagen proposed a change to openstack/ironic: Clear maintenance_reason when setting maintenance=False  https://review.openstack.org/12969416:10
*** romcheg has quit IRC16:11
*** igordcard has quit IRC16:16
*** sambetts has quit IRC16:22
*** dtantsur is now known as dtantsur|afk16:31
openstackgerritJohn Trowbridge proposed a change to openstack/python-ironicclient: Adds tty password entry for ironicclient  https://review.openstack.org/12901016:42
*** derekh has quit IRC16:47
marcklucasagomes: ironic-conductor is running, I posted the ironic/nova configs and some logs here: http://paste.openstack.org/show/122777/16:48
marckthe compute node is failing because it can't find ironic.nova.compute.manager, I updated the nova.conf on the compute node but wasn't sure what pieces of ironic to install16:49
jrollcompute_manager=ironic.nova.compute.manager.ClusteredComputeManager16:50
jrollthat's in ironic's tree16:50
jrollso you would need to install ironic on that node, if that's what you want to use16:50
jrollhowever it is not a requirement unless you want multiple nova-computes16:50
marckjroll: thanks for the response, I have a controller, network and one compute node. nova-compute is not running on the controller, should it be?16:53
jrollI don't know what each of those is supposed to have16:54
jrollnova-compute needs to be running somewhere16:55
marckIt's running on the compute node, but ironic isn't installed. installing now...16:56
*** ndipanov is now known as ndipanov_gone16:57
jrollyeah, or you could leave out that conf option16:58
marckthe install guide said it needed to be on the nova controller and compute nodes17:00
jrollgot a link handy?17:01
NobodyCamhttp://docs.openstack.org/developer/ironic/deploy/install-guide.html17:01
marckhttp://docs.openstack.org/developer/ironic/deploy/install-guide.html, heading "Configure Compute Service to use the Bare Metal Service"17:01
jrollhmm17:04
jrollI wonder if the default setting works there17:04
marcksince installing ironic (but not starting anything) the msg in nova-scheduler.log changed from "nova.filters [req-uuid None] Filter ComputeFilter returned 0 hosts" to "nova.filters [req-uuid None] Filter ComputeCapabilitiesFilter returned 0 hosts"17:04
NobodyCammarck: have you set the node properties?17:06
marckproperties = {u'memory_mb': u'1024', u'cpu_arch': u'x86_64', u'local_gb': u'100', u'cpus': u'2', u'root_gb': u'25'}17:07
*** zigo has quit IRC17:08
jrollis it cpus or num_cpus, I can't remember17:08
JayF| properties             | {u'memory_mb': 131072, u'cpu_arch': u'amd64', u'local_gb': 32, u'cpus': |17:08
NobodyCamI set: ironic node-update nodeUUid add properties/local_gb=1017:08
NobodyCamironic node-update nodeUUid add properties/memory_mb=204817:08
NobodyCamironic node-update nodeUUid add properties/cpus=117:08
JayFI think that means CPUs :)17:08
*** zigo has joined #openstack-ironic17:08
jrollalso... people tend to use ExactCpuFilter or something17:08
jrollnot sure if relevant17:08
jrollmaybe flavor data is weird17:08
JayFah, that's true17:08
*** pensu has joined #openstack-ironic17:10
marckthe flavor and node have cpus=2 and memory_mb=1024, should I recreate the flavor so cpus=1 and memory_mb=512?17:11
NobodyCammarck: I don't see why17:11
NobodyCammarck: what do you get from nova hypervisor-stats17:11
marckthe only hypervisor listed is the compute node which hypervisor-stats matches17:15
*** harlowja_away is now known as harlowja17:15
jrollaha, that's progress17:15
marckNobodyCam: incresing the nodes stats got us somewhere, there are messages relating to the nova boot cmd in ironic-api.log and ironic-conductor.log17:17
NobodyCammarck: can you post the logs. please use paste.openstack.org or some such service17:18
*** praneshp_ has joined #openstack-ironic17:19
jrolloh17:20
jrollohhhhh17:20
jrollnova-compute has this concept of reserved ram17:20
jrollidk what the default is17:20
jrollbut it reserves memory for the hypervisor17:20
jrollso if the "hypervisor host" has 1024mb of ram, you can't deploy a 1024mb instance there17:21
jrolland it sees ironic nodes as hypervisor hosts17:21
jrollso uh... let me find that17:21
NobodyCamjroll: our docs do say to set ram_allocation_ratio=1.017:21
jrollI think it's reserved_host_memory_mb17:22
jroll=017:22
jrollNobodyCam: dunno if that's the same thing17:22
NobodyCamwe also set that too17:22
jrolloh17:22
jrollhrm.17:22
*** killer_prince is now known as lazy_prince17:22
NobodyCamjroll: http://docs.openstack.org/developer/ironic/deploy/install-guide.html#configure-compute-service-to-use-the-bare-metal-service17:22
jrollstrange17:23
jrollyeah, I see it17:23
*** athomas has quit IRC17:24
NobodyCamhypervisor-stats should give out like http://paste.openstack.org/show/JHxKicrkNKE0goH8jJyn/17:24
NobodyCamwhich in my case is two node with one used17:24
marckNobodyCam: http://paste.openstack.org/show/122784/17:25
marckbe back17:26
*** ryanpetrello has quit IRC17:27
lucasagomesI will call it a day17:31
lucasagomeshave a great night everyone!17:31
NobodyCamhave a good night lucasagomes17:31
*** ryanpetrello has joined #openstack-ironic17:31
jrollnight lucasagomes :)17:32
*** dlaube has joined #openstack-ironic17:32
lucasagomessee ya'll :)17:32
*** lucasagomes is now known as lucas-dinner17:32
dlaubeg'morning17:32
NobodyCammorning dlaube :)17:33
openstackgerritRuby Loo proposed a change to openstack/ironic: Iterate over glance API servers  https://review.openstack.org/12999117:39
*** zigo has quit IRC17:41
*** zigo has joined #openstack-ironic17:41
dlaubeanyone know what causes this error upon nova-api start? http://pastie.org/private/p5rsjykbvurfdwe9g8zuw17:42
dlauberoot@lab5:~# nova-api --version17:42
dlaube2014.2.117:42
dlaubeI've tried reinstalling/building oslo.config but that didn't seem to help17:42
*** praneshp has joined #openstack-ironic17:43
*** jistr has quit IRC17:43
*** spandhe has joined #openstack-ironic17:43
*** praneshp_ has quit IRC17:43
NobodyCamdlaube: thats a odd error , check the rootwrap files for iptables-save17:44
devanandadlaube: permission issue perhaps17:45
NobodyCamoh thats from nova17:45
NobodyCamgood point devananda17:45
*** praneshp_ has joined #openstack-ironic17:46
NobodyCambrb quick walkies being requested17:47
*** lazy_prince is now known as killer_prince17:48
openstackgerritA change was merged to openstack/python-ironicclient: Add keystone v3 CLI support  https://review.openstack.org/11117517:49
*** praneshp has quit IRC17:49
*** praneshp_ is now known as praneshp17:49
dlaubeahh, some of my owner/group permissions were off on my rootwrap.d and rootwrap.conf in /etc/nova17:49
dlaubestill failing though17:50
*** jistr has joined #openstack-ironic17:56
NobodyCamdlaube: same error?18:00
dlaubeyes, but when I ran the exec line in my /etc/init/nova-api.conf, it was prompting me for sudo password so that nova could complete the iptables save18:00
dlaubeI added user nova to sudoers and nova-api is running now18:01
*** marcoemorais has quit IRC18:01
dlaubei think I'm all set now18:01
*** marcoemorais has joined #openstack-ironic18:01
*** marcoemorais has quit IRC18:02
*** marcoemorais has joined #openstack-ironic18:02
*** marcoemorais has quit IRC18:03
*** kincl has joined #openstack-ironic18:03
dlaubethanks NobodyCam and devananda18:03
*** marcoemorais has joined #openstack-ironic18:04
devanandadlaube: cheers18:04
dlaubeare you gents up in SF?18:05
dlaubeI think jroll is but not sure about the rest of you guys18:05
jrolldlaube: I am, also JayF and JoshNang18:06
jrollwe all work at rackspace sf18:06
NobodyCamdlaube: I'm in so cal atm18:06
dlaubenice!18:07
dlaubeI'm down in santa cruz, but I'll have to buy you guys a beer sometime18:07
dlaubedo any of you attend the bay area openstack meetups?18:07
NobodyCamdlaube: are we going to you at the summit?18:08
dlaubeunfortunately not18:08
NobodyCam:(18:08
dlaubecan't make it this year :(18:08
NobodyCamwell maybe we can see you at the next one.. it is at least on the west cost :)18:09
jrollno, I don't go to the meetups, they tend to be in south bay and I'm the opposite direction18:09
jrollNobodyCam: where is it again?18:09
NobodyCamjroll: Vancouver I believe18:10
jrollah yeah :)18:10
jrollsoudns fun, I've never been18:10
jrolloh look, another openstack project name hijack https://www.kickstarter.com/projects/atomcomputer/neutron-a-full-blown-windows-pc-in-the-palm-of-you18:10
*** marcoemorais has quit IRC18:10
NobodyCamjroll: its the word  "windows" that makes me not want to click it18:13
jrollhehe18:13
*** pensu has quit IRC18:13
jrollit's like a little NUC18:13
jrollbut windows18:13
jrolland they're naming it neutron18:13
devanandaneutron is (tm) now. someone should tell them18:13
rloo+2 for vancouver :-)18:14
rloodo we need to ironic (tm) first?18:15
*** pensu has joined #openstack-ironic18:15
NobodyCamI donated to this kickstarter: https://www.kickstarter.com/projects/194429923/star-trek-axanar?ref=nav_search18:16
dlaubeVancouver? sweet!18:17
dlaubejroll: I understand. I hate driving all the way up to SF from down here18:18
dlaube;)18:18
*** marcoemorais has joined #openstack-ironic18:18
jrolldlaube: :D18:20
jrolldevananda: have something I could link to them?18:20
jrollor should I just point someone from the board/tc at it18:20
JayFjroll: devananda is the TC18:21
jrolls/\/tc// then18:22
marckNobodyCam: back, did you see anything in the logs?18:22
NobodyCammarck: can you execute "sudo nova-rootwrap /etc/nova/rootwrap.conf iptables-save -c" as the nova user?18:25
dlaubeNobodyCam: did you mean me?18:27
NobodyCamgah yes I did18:27
dlaubeor maybe marck and I just went through the same ordeal18:27
dlaubeheh18:27
dlaubeyeah, I'm able to run that now18:27
NobodyCam:-p18:27
dlaubenova user did not have sufficient perms to run sudo18:27
dlaubeand my ownership perms were off on /etc/nova/rootwrap.d18:28
*** pelix has quit IRC18:28
NobodyCamdlaube: restart the nova services and see if the error changes..18:29
NobodyCamI would expect it to18:29
dlaubenova-api starts just fine now18:31
dlaubestays running too18:31
*** jistr has quit IRC18:31
NobodyCam:)18:31
*** marcoemorais has quit IRC18:33
*** marcoemorais has joined #openstack-ironic18:33
*** pensu has quit IRC18:33
*** marcoemorais has quit IRC18:36
*** marcoemorais has joined #openstack-ironic18:36
NobodyCamdlaube: how does nova hypervisor-stats look? better this time?18:43
*** marcoemorais has quit IRC18:44
*** marcoemorais has joined #openstack-ironic18:44
openstackgerritA change was merged to openstack/ironic-python-agent: Write image directly to disk  https://review.openstack.org/12904618:50
NobodyCamI like that change !19:01
NobodyCamyjiang5: ^^^^^^^19:01
NobodyCamj* Nice one19:02
jrollit's good for the project19:02
jrollbad for spped P19:02
jrollspeed, even19:02
jrollbut not that bad19:02
NobodyCamhow much worse is it ? vs convert then write?19:02
NobodyCamI would expect faster19:03
jrollJayF put a comment with numbers19:03
jrollwell19:03
jrollslower on our hardware, I should say19:03
jroll:)19:03
jrollthe 64kb block size helped a lot on our hardware19:03
jrollbut it's like... 8m03s vs 8m15s19:03
jrollor something19:03
NobodyCam:)19:03
NobodyCamiscsi block size vs ip packet conflict19:04
NobodyCamip packet size19:04
jrolleh?19:04
jrollthis doesn't use iscsi :P19:05
NobodyCamoh fiddle sticks19:05
NobodyCamI was already looking at other code19:05
jrollbut that's interesting19:05
*** derekh has joined #openstack-ironic19:06
*** andreykurilin_ has joined #openstack-ironic19:08
NobodyCamjroll: are you running large packets? If i have hardware that will support it I've usally bumped the ip packet size to 4K or 16K (based on what the hardware will support) for areas where traffic like pulling disc images from glance / (san type traffic)19:09
*** jistr has joined #openstack-ironic19:10
jrollNobodyCam: the dd is the slow part, not the download19:10
jrollthough I would love to stream straight to disk eventually19:10
NobodyCamwe use o direct?19:12
jrollwe were19:13
jrollthat patch uses qemu-img whatever direct19:13
jrollwe did a lot of work optimizing that dd for our hardware, I don't think it's going to get much faster19:13
jrollalso, that's test hardware, prod is faster19:13
*** BertieFulton has joined #openstack-ironic19:14
NobodyCamhumm I don't have -t oprtion for qemu-img19:16
NobodyCamhttp://manpages.ubuntu.com/manpages/gutsy/man1/qemu-img.1.html19:16
NobodyCamnever mind19:16
NobodyCam:-p19:16
jrollthis branch could use some reviews :) https://review.openstack.org/#/q/status:open+branch:master+topic:bp/maintenance-reason,n,z19:18
marckI put up a new paste, http://paste.openstack.org/show/122815/ that includes more info19:25
*** dprince has quit IRC19:28
Shrewsjroll: the spec for that is merged, but the lp blueprint isn't approved. we just haven't done that yet?19:29
jrollShrews: I guess; I tend to ignore launchpad blueprints, I think only deva can approve/target anyway19:30
Shrewsjroll: i didn't +A b/c of that. not sure of the protocol there19:30
jroll¯\_(ツ)_/¯19:31
NobodyCamas I understand once spec is landed bp WILL be approved19:32
rlooNobodyCam, jroll, Shrews: I think we will have to remind devananda about his duties wrt blueprints ;)19:33
jrollhate launchpad. hate launchpad blueprints even more.19:33
NobodyCam:-p he is in meeting all day today and tomorrow19:33
rlooNobodyCam: yes, I think you're right. Shrews: I say go ahead and approve if you want to.19:33
NobodyCammarck:  extra_specs                | {"cpu_arch": "{i686|x86_64}"}  is that valid?19:33
rlooNobodyCam: maybe we can ask devananda to give you or someone else that power19:34
Shrewsrloo: ok. we're stuck waiting on jenkins anyway19:34
NobodyCammarck: replyed to your paste.19:35
NobodyCamtake a look at let me know19:35
marckI tried 'x86_64' with no luck, https://bugzilla.mozilla.org/show_bug.cgi?id=963165 It's related to baremetal, but I though I'd give it a try19:35
Shrewsanyone know why the queue is so slow today, anyway?19:35
jrollShrews: provider quotas :(19:36
*** BertieFulton has quit IRC19:37
jrollomy, you're from mozilla, marck ?19:37
marckno, just googling around19:37
jrollah19:38
jrollI mean, x86_64 should work19:38
jrollafaik19:38
NobodyCamhumm I recall something about amd6419:39
marckNobodyCam: replied to your paste19:40
jrollamd64 should work now too19:41
jrollbut x86_64 is the canonical version19:41
jroll(in nova)19:41
NobodyCammarck: I don;t see your reply19:42
NobodyCamhumm19:42
jrollyou don't need baremetal:deploy_kernel_id anymore19:44
jrollsame for ramdisk19:44
marckhttp://paste.openstack.org/show/122826/19:44
marckit gets to nova.scheduler.filters.compute_capabilities_filter, the "fails instance_type extra_specs requirements"19:45
jrolloh19:45
marckI have to go, thank you very much for all your help today. Hopefully we can figure it out19:46
jrollhmm19:46
NobodyCammarck: set the flavors extra spec cpu arch to just x8619:46
NobodyCam-6419:46
NobodyCamgah19:47
NobodyCamx86_6419:47
NobodyCamjroll: take a look at the cpu arch on his flavor.. I think thats what he is hitting19:49
jrollyeah indeed19:50
jroll"I tried 'x86_64' with no luck,"19:50
jrolllooks like ComputeCapabilitiesFilter is catching it19:51
jrollisn't there something with like... baremetal capabilities?19:51
jrollI might be completely off track here19:51
NobodyCamlooks like there is a disk size mis match from node-show to flavor-show...19:52
jrollhmm19:53
jrollmaybe19:53
* jroll bbiab19:53
NobodyCami too will brb..19:54
*** boris-42 has quit IRC19:59
*** jistr has quit IRC20:01
*** derekh has quit IRC20:01
rlooShrews, jroll: wrt 128645, since it hasn't yet been approved ;) I had a question https://review.openstack.org/#/c/128645/7/ironic/api/controllers/v1/node.py20:02
*** vdrok_ has joined #openstack-ironic20:05
* NobodyCam is back20:09
*** pensu has joined #openstack-ironic20:12
Shrewsrloo: good question. depends on if we want that field to show up in a node collection or not. my initial reaction is to say "no, they can get the reason from querying the node"20:13
rlooShrews: it seems odd to show that, but not show 'maintenance'.20:14
Shrewsrloo: eh, not to me, really. the data in a node list is very trimmed down, but i can be convinced the other way20:15
Shrewshttp://docs.openstack.org/developer/ironic/webapi/v1.html#NodeCollection20:16
rlooShrews: I had another question so I -1'd the patch.20:16
Shrewsrloo: cool20:16
rlooShrews: there should be a similar/generated page with maintenance-info.20:17
Shrewseh?20:17
rloohttp://docs-draft.openstack.org/45/128645/6/check/gate-ironic-docs/f15904a/doc/build/html/webapi/v1.html#nodes20:18
rlooShrews: so, for full info on node, maintenance & maintenance_reason are shown. but for the trimmed version, only maintenance is shown.20:19
rlooShrews: so I think that's fine. I think I keep tripping up over the code with double negatives, 'if not expand: except_list...'20:21
rlooShrews: now, if someone can remind me what the NodePatchType stuff is for...20:22
*** yuanying has quit IRC20:25
Shrewsrloo: check out https://review.openstack.org/#/c/128925/8/ironic/api/controllers/v1/node.py20:26
rlooShrews: so what it is doing (with maintenance_reason but not maintenance) is that it is allowing someone to update/modify maintence_reason but not maintenance.20:28
NobodyCamrloo: I can see that20:31
NobodyCamnode already in maintenance but someone wants to update reason?20:31
Shrewsrloo: i think the intent is to NOT allow maintenance_reason to be updated via the PATCH (only through the new API lucas is creating)20:32
*** boris-42 has joined #openstack-ironic20:32
rlooShrews: yes, that's it! Because I was fairly sure we could change maintenance mode via a node update.20:33
rlooShrews: thx!20:34
Shrewsnp20:34
*** pensu has quit IRC20:39
Shrews@all: FYI, I'm going to be at the AllThingsOpen conference tomorrow and Thursday, so I won't be around.20:39
mrdaMorning Ironic20:40
Shrewsmrda: morning20:40
NobodyCammorning mrda20:41
NobodyCamShrews: Enjoy20:41
ShrewsNobodyCam: thx!20:42
rlooShrews: have fun!20:43
rloomorning mrda!20:43
Shrewsis this review showing jenkins results twice for anyone else, or has yosemite messed up my browser? https://review.openstack.org/#/c/129031/20:44
Shrews3 times, actually20:44
* Shrews hurls angry wet ferrets at java-based review systems20:46
NobodyCamoh that sounds much worse then just the normal wet cats20:49
NobodyCamthat get tossed around20:49
* mrda thought it was all about wet fish, but is willing to learn20:50
NobodyCamlol mrda have you heard of wet vs dry code?20:51
*** foexle has quit IRC20:52
NobodyCamwell really damp vs dry20:52
NobodyCamlol20:52
rlooShrews: I see several jenkins for patch set 4. are you seeing double of jenkins, done at the same time?20:52
NobodyCambut tossing damp cats makes little sense20:52
NobodyCamShrews: none of the times are dup for me20:53
mrdaNobodyCam: DRY as a principle is well known to me.  But the cat reference isn't :)20:54
Shrewstimes are all different. just didn't expect so many results. if someone wants to approve that and get it off my mind, that would be swell!20:54
Shrewsmrda: clearly you don't know mordred20:54
NobodyCamlol ahh thats a monty thing20:54
NobodyCam:)20:54
Shrewsand my ferrets will eat his cats, so i win20:54
mrdalol20:54
mrdaI know mordred, but not that well :)20:55
NobodyCamlol20:56
*** yjiang5 has left #openstack-ironic20:58
Shrewsrloo: sqlalchemy.types.String is a base type for all string-based data types in a db (TEXT, VARCHAR, etc)21:01
Shrewsso, yeah, that's fine21:01
rlooShrews: ok. but to be more specific, TEXT would be better?21:02
rloocuz something could be a String but not Text?21:02
*** praneshp_ has joined #openstack-ironic21:02
Shrewsrloo: String is abstract, TEXT is not (db dependent)21:02
NobodyCamShrews: theres no bug for the hash ring?21:03
ShrewsNobodyCam: not really a bug21:03
*** praneshp has quit IRC21:03
*** praneshp_ is now known as praneshp21:03
rlooShrews: ok thx. So the other test in that file should use String too, not TEXT.21:04
ShrewsNobodyCam: i mean, maybe it *could* be?21:04
NobodyCamI was just checking21:04
*** ChuckC has quit IRC21:05
Shrewsrloo: well, i dunno about those. types.TEXT derives from types.String21:06
rlooShrews: I am thinking I don't want to know anything more ;)21:06
Shrewsdo we want to keep them more abstract, or closer to the actual db data type? i would argue abstract is better, but clearly either works21:07
NobodyCamShrews: 129031 done21:07
ShrewsNobodyCam: w00t! so am I21:07
Shrewsgood night all21:08
NobodyCamlol ... have a nice couple of days21:08
rlooShrews: I think I'm fine with either, but would be nice to be consistent.21:08
rlooShrews: night already? bye!21:08
*** vdrok_ has quit IRC21:09
dlaubeI'm trying to nova boot a node using the ironic driver. I can see that the instance is in status "BUILD" and Task State as "spawning", but it's been this way for about 15-20 minutes21:09
dlaubenothing in the nova-compute.log to suggest what is going on21:10
dlaubeanyone have some advice for other things I can look at to determine what's going on?21:10
*** ChuckC has joined #openstack-ironic21:11
NobodyCamdlaube: ironic node-show uuid21:11
NobodyCamthou build sounds like it having issue pulling the image from glance. or maybe just supper slow21:12
*** lucas-dinner has quit IRC21:19
*** yuanying has joined #openstack-ironic21:21
NobodyCambrb21:25
*** todd_dsm has quit IRC21:25
*** yjiang5 has joined #openstack-ironic21:26
*** yjiang5 has left #openstack-ironic21:26
*** yjiang5 has joined #openstack-ironic21:27
dlaubehttp://pastie.org/private/rmjofznvozmr9yah1i0jsq21:28
NobodyCamdlaube: humm last error is none on that. anything in the logs?21:33
NobodyCamdlaube: ironic-conductor log should tell us why the deploy failed21:36
dlaubenothing in logs at all21:36
dlaubehuh21:36
dlaubeI used to have working logs21:36
dlaubelol21:36
dlaubelog_file = ironic.log    log_dir = /var/log/ironic21:36
dlaubecrap, I think log_dir=/var/log/ironic/  is all I need21:39
NobodyCam:-p21:44
dlaubeok, must have forgot to set verbose=true and debug=true21:44
dlaubeI have logs again21:44
dlaubelet me nova boot this puppy again and see what is what21:45
NobodyCamdlaube: also check what state the node is "waiting" at..21:46
NobodyCamie is it waiting for call back?21:46
openstackgerritA change was merged to openstack/ironic: Improve hash ring value conversion  https://review.openstack.org/12903121:46
dlaubewill it say something about "waiting" in ironic-conductor.log ?21:47
dlaubeor should I eyeball to see where it left off or something21:47
dlaubeseeing a nice exception in ironic-conductor.log21:48
openstackgerritJim Rollenhagen proposed a change to openstack/python-ironicclient: Add node-set-maintenance command  https://review.openstack.org/12969321:49
jrollthat should be good now21:49
jrolland there's two patches here that just need +A https://review.openstack.org/#/q/status:open+project:openstack/ironic+branch:master+topic:bp/maintenance-reason,n,z21:50
jroll(jenkins is done)21:50
dlaubegetting an exception is better then no exception in the logs :D  http://pastie.org/private/a4aeckjm2cenaqxmnina21:51
*** andreykurilin_ has quit IRC21:51
dlaubeexcept when everything works 100% of the time21:51
dlaubehahaha21:51
*** yuanying has quit IRC21:55
*** praneshp_ has joined #openstack-ironic22:03
openstackgerritJosh Gachnang proposed a change to openstack/ironic-python-agent: Add command metrics to IPA API  https://review.openstack.org/11998122:03
NobodyCamcan any one think of a clean why to ask a conductor to rebuild it's tftpboot dir..22:04
NobodyCamI can do it with a aweful hack22:04
*** praneshp has quit IRC22:06
*** praneshp_ is now known as praneshp22:06
NobodyCamdlaube: cruft in the db? Returning exception Node e9eff0a1-5971-4ddf-b0cb-e7d98f255fb6 is associated with instance 013d3157-f5fc-41c6-815f-8fc8e885fdf8. to caller22:07
dlaubeI issued multiple nova boot commands against that single ironic testing node, e9eff0a1-5971-4ddf-b0cb-e7d98f255fb622:08
NobodyCamI can tell22:09
dlaubeseeing a handful of instances via "nova list" that ultimately reference e9eff0a1-5971-4ddf-b0cb-e7d98f255fb622:09
NobodyCam:-p22:09
dlaubecould that be the cause of that exception?22:09
NobodyCamoh ya22:09
NobodyCamstart fresh22:09
dlaubetrying to delete them with nova but its hung with Task State "deleting"22:11
dlaubeheh22:11
NobodyCam:-p22:13
jrollNobodyCam: I mean... just validate instance info for all nodes belonging to the conductor or something?22:14
jrolland by validate I mean check that k/r are in cache and download if not22:14
dlaubewhats the easiest way to disassociated the two instances that want to own that ironic node? I can drop the tables in the nova DB and restart nova*22:14
NobodyCamjroll: I have a case where a system has been updated and tftpboot  dir wiped out22:15
jrollNobodyCam: right, on conductor startup, make sure you have all instance k/r's there22:15
JayFdlaube: you also have to detach the instance uuids from ironic as well22:15
dlaubeJayF: not sure how I do that22:17
NobodyCamjroll: oh just restart and it should rebuild?22:17
jrollNobodyCam: that's how the code should look, not sure if it works that way22:17
JayFdlaube: I think it'd be something like # ironic node-update NodeUUID delete instance_uuid22:17
JayFdlaube: but that's syntax from memory :)22:17
NobodyCamlet me see if I can check that22:17
jrollinstance_uuid is internal :(22:17
jroller wait22:17
jrollit's not22:17
jrollignore me22:18
jrollJayF is right22:18
JayFif nova can set/unset it, so can an oper ;)22:18
*** mrmoje has joined #openstack-ironic22:18
dlaubecool, thanks JayF!22:18
dlaubewill give that a try22:18
JayFdlaube: np, good luck22:18
dlaubety.22:21
dlaubefyi; looks like it was  ironic node-update NodeUUID remove instance_uuid22:21
JayFah22:23
JayFI use replace (for maint/unmaint) much more often than delete22:23
JayFer, I guess, remove, hah22:23
openstackgerritJohn Trowbridge proposed a change to openstack/python-ironicclient: Adds tty password entry for ironicclient  https://review.openstack.org/12901022:27
openstackgerritA change was merged to openstack/ironic: Add Node.maintenance_reason  https://review.openstack.org/12864522:32
NobodyCamjroll: fyi I just tried restarting the conductor, it does not rebuild the tftpboot dir.22:34
NobodyCamI have to hack the DB to do it22:34
jrollNobodyCam: huh22:38
NobodyCamjroll: I was looking into a issue where the tftpboot dir had been wiped out on a conductor22:39
jrollright, I got that22:39
NobodyCamjust restarting the conductor did not rebuild the tftpdir22:40
NobodyCamI can hack it, by adding a fake conductor to the conductors table as offline then assign all the node from the conductor I want to rebuild the tftpboot dir on to that offline conductor,22:41
NobodyCamp22:41
NobodyCamp_task comes along and rebuilds the tftpboot dir in just a monute or so22:42
NobodyCamand ressigns the nodes back to the correct conductor22:42
JayFYou're saying, basically22:43
JayFa conductor that restarts, if it's nodes are never taken over by another conductor22:43
JayFalmost needs to take_over() it's own nodes again22:44
JayFIronic is tying "hostname" to "state on disk" when that is not always true22:44
jrollsomething like that22:45
jrollI mean22:45
jrollshould we be writing code to work around an operator blowing away ironic's data?22:46
jrollit's a crappy situation to get into, and maybe we should handle it for them22:46
jrollidk22:47
*** jmank has joined #openstack-ironic22:47
NobodyCamJayF: its this that stops it if the node is not over taken over.. https://github.com/openstack/ironic/blob/master/ironic/conductor/manager.py#L91722:47
*** mrmoje has quit IRC22:47
JayFI mean, I honestly don't like that conductors in the pxe driver have state on disk at all22:49
JayFI don't know the best way to handle that, but it seems like right now the assumption Ironic makes is a conductor with the same hostname has the same ondisk state22:49
NobodyCamso forcing a affinity change to a known offline conductor allows it to rebuild. I agree I don't think we should codify  a work around.22:49
JayFand we'd need to break that assumption everywhere to fix this bug, basically22:49
*** jgrimm is now known as zz_jgrimm22:49
NobodyCamthe fix we used in this case was to save the tftpboot dir and restore it22:50
NobodyCambut something to think about22:50
NobodyCami don't think allowing ironic to verify and rebuild the tftpboot dir is out of scope22:51
*** yuanying has joined #openstack-ironic22:51
JayFI don't think it is either, per se22:52
JayFbut I almost would prefer us point our brains at a model that wouldn't require us to keep state on disk22:52
NobodyCambut howto do it22:52
JayFbut every thought I have about that leads me to us having Ironic be every damn service in the chain, lol22:52
NobodyCamJayF: I was hoping this could be a pod topic? at the summit22:52
JayFI mean, I'm interested from a general operations standpoint22:53
JayFbut I don't like or run the pxe driver22:53
NobodyCamJayF: my first is a manual hash ring rebalance command22:53
JayFso not sure my input is useful in this case :P22:53
NobodyCam*first thought22:53
jrollNobodyCam: I would just have it call take_over on its own nodes22:57
jrollit should be fast if there's nothing to do22:58
jrollmaybe22:58
jrollit might hit glance, I don't remember22:58
*** derekh has joined #openstack-ironic23:05
NobodyCamjroll: I'll look in to it. i don't really feel its a bug as right now there is now real way we can completly rebuild the tftpboot dir. ironic has no idea where pxelinux.0 is on a system, I supose we could search for it.23:06
jrollhm, yeah23:07
jrollidk.23:07
NobodyCam:) fix is don't delete he tftpboot dir ...lol ... or if you do... restore it.23:07
jrollya23:07
JayFNobodyCam: I mean, of all the reasons, that's not an awesome one TBH. Config var "pxelinux_rom=" which defaults to autodetection (looking for where the packages would put it in rhel/debian)23:09
JayFNobodyCam: if Ironic needs and will modify things in the dir it should probably own all contents23:09
JayFbut things have been working with things as they are now, so ummv23:09
JayF*ymmv23:09
NobodyCam:-p JayF ya i'm not saying its not something we shouldn't address, just need to put some thought behind it. because I would like to be able to fix a "d'oh" moment23:11
JayFI mean there are clearly buckets full of use case for this23:11
JayFI just wonder if we can remove the need rather than fulfill it23:12
* JayF dreams of a utopia with no state23:12
NobodyCam:)23:12
NobodyCamwe  will get there ... But I did see logans run, and I am over 30 :-p so utopia's are scarry to me ...lol23:14
JayFthe only utopic thing I expect to ever see23:15
JayFis the next ubuntu23:15
NobodyCamlol :-p23:15
*** Haomeng|2 has joined #openstack-ironic23:34
*** Haomeng has quit IRC23:35
yjiang5Hi, I'm trying to figure out the raw image conversion, and have several questions, can anyone give me some hints?23:43
*** zz_jgrimm is now known as jgrimm23:46
JayFAsk away23:47
NobodyCamyjiang5: did you see the patch the IPA guys landed today23:47
JayFNobodyCam: you're so happy about that :P23:47
JayFNobodyCam: that's how it was done about 3 commits into the old teeth-agent :)23:48
JayFNobodyCam: sans -t directsync23:48
yjiang5firstly, what's the exact usage case of "forced_raw_images"? It's used in converted_size() and image_to_raw(). If forced_raw_images is False, both of function will not do anything, especially the converted_size() will return 0. It's really a hack IMHO. The caller asking for image_to_raw(), the caller has more idea of it, we should really not hack that config in the callee. Secondly, why the create_boot_iso() will invoke the images.fetch_to_raw()23:48
yjiang5NobodyCam: sorry, not yet.23:49
*** takadayuiko has joined #openstack-ironic23:49
NobodyCam:)23:49
yjiang5NobodyCam: let me check, thanks23:49
jroll"It's really a hack IMHO."23:49
jrollhonestly, half this project is a hack23:50
yjiang5jroll: :)23:50
jrollI mean that with all love and respect23:50
NobodyCamit removed the entire dd command I think thats good23:50
NobodyCamyjiang5: fyi: https://review.openstack.org/12904623:50
NobodyCam:-p23:50
yjiang5NobodyCam: Cool! landed today means merged or in gerrit?23:50
yjiang5NobodyCam: thanks23:50
yjiang5NobodyCam: I don't use IPA yet, I simply use iscsi deploy. So the iscsi deploy will be replaced by IPA?23:52
NobodyCamyjiang5: I think that same patch may work for iscsi23:52
NobodyCamsame == same consept23:53
jrolloh that's interesting23:53
NobodyCamfor iscsi it would be uncompress over iscsi23:54
yjiang5NobodyCam: Yes, I have a small patch at hand, to convert the image on the fly when copy (i.e. execute 'qemu-image -O convert', instead of dd, if the image is not raw).23:54
JayFyjiang5: right now IPA vs iscsi deploy is more about how you want machines deployed and what feature sets you need. I don't think we want that to always be true though23:54
NobodyCamJayF: my goal is that all drivers (and agent) provide the same (core) functions23:55
yjiang5JayF: I didn't take IPA because I was using 12.04 when I begin try Ironic. Then I didn't switch to IPA when switch to 14.04 because iscsi works happily for me.23:56
JayFyjiang5: your host OS doesn't matter to IPA23:57
yjiang5JayF: Devstack w/ ironic requires docker.io :)23:57
JayFI get what you mean now23:57
JayFdevstack is a whole other ball of wax than real life :P23:57
openstackgerritJay Faulkner proposed a change to openstack/ironic-python-agent: Improve docstrings for cmd/agent.py  https://review.openstack.org/12066223:59
yjiang5JayF: I have only 3 machines, so devstack meet my requirement, and in fact, I really don't know any  method other than devstack to try ironic on my 3 machines (I have a patch to enable devstack to install on real hardware).23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!