| *** [1]rpioso has quit IRC | 00:10 | |
| TheJulia | sahil: See http://docs.openstack.org/developer/ironic/_images/states.svg (You can send "abort" if your still in clean-wait (or you can just wait for cleaning to timeout), and then send it to manageable state using "manage") | 00:15 |
|---|---|---|
| *** mmedvede has quit IRC | 00:19 | |
| *** hoangcx has joined #openstack-ironic | 00:28 | |
| *** syed_ has quit IRC | 00:32 | |
| *** thrash is now known as thrash|g0ne | 00:40 | |
| *** wajdi has joined #openstack-ironic | 00:53 | |
| *** mmedvede has joined #openstack-ironic | 00:54 | |
| sahil | Thank you TheJulia | 00:55 |
| sahil | so I ironed out some issues that I figured out | 00:55 |
| sahil | one was incorrect gateway | 00:55 |
| *** Sukhdev has joined #openstack-ironic | 00:56 | |
| sahil | so here is the confusion | 00:56 |
| sahil | my openstack VM has ip address x.x.x.17 | 00:56 |
| sahil | and gateway is configured on x.x.x.11 | 00:56 |
| sahil | x.x.x.11 is a bridge configured on the host | 00:57 |
| sahil | via which the DEVSTACK VM is able to ping the bare-metal node | 00:57 |
| sahil | I configured the baremetal-node (installed OS manually) and pinged it from the devstack VM | 00:57 |
| sahil | it worked | 00:57 |
| sahil | but after restacking it no longer can ping to the node | 00:58 |
| sahil | on checking I realized that devstack has used the gateway ip x.x.x.11 as one of the interface in the qrouter-<id> | 00:58 |
| sahil | is that correct configuration ? | 00:59 |
| TheJulia | sahil: so, as I understand it, restackinf is destructive, but I'm not a frequent devstack uset | 00:59 |
| TheJulia | That sounds correct routing wise with the use of neutron namespaces | 01:00 |
| TheJulia | Well, really neutron using Linux kernel namespaces | 01:00 |
| *** Sukhdev has quit IRC | 01:01 | |
| sahil | if that sounds correct, then it is weird | 01:01 |
| sahil | because devstack used the ip address of an existing gateway to configure an interface on its router | 01:02 |
| *** rama_y has joined #openstack-ironic | 01:08 | |
| sahil | here is my confusion | 01:10 |
| sahil | I am trying to setup devstack with flat network | 01:10 |
| sahil | where my VM and the baremetal I wish to boot using ironic are on the same vlan | 01:11 |
| sahil | so towards that end, I am using the following network parameters in the local.conf | 01:11 |
| sahil | HOST_IP=x.x.x.17 | 01:11 |
| sahil | which is one of the ip on the VM | 01:12 |
| sahil | corresponding interface is | 01:12 |
| *** phuongnh has joined #openstack-ironic | 01:12 | |
| sahil | PUBLIC_INTERFACE=eth0 | 01:12 |
| sahil | PHYSICAL_NETWORK=private PROVIDER_NETWORK_TYPE="flat" | 01:12 |
| sahil | NETWORK_GATEWAY=x.x.x.11 | 01:13 |
| *** xuao has joined #openstack-ironic | 01:13 | |
| sahil | ALLOCATION_POOL=start=x.x.x.21,end=x.x.x.30 | 01:13 |
| sahil | what is wrong in this | 01:13 |
| *** bfournie has joined #openstack-ironic | 01:16 | |
| *** sahil has quit IRC | 01:27 | |
| *** amotoki has joined #openstack-ironic | 01:29 | |
| *** amotoki has quit IRC | 01:33 | |
| openstackgerrit | Tang Chen proposed openstack/python-ironicclient: Support i18n for osc plugin help msg https://review.openstack.org/357639 | 01:41 |
| *** baoli has joined #openstack-ironic | 01:43 | |
| *** amotoki has joined #openstack-ironic | 01:46 | |
| *** jjohnson2 has joined #openstack-ironic | 01:49 | |
| *** ijw has joined #openstack-ironic | 01:58 | |
| *** ijw has quit IRC | 01:58 | |
| *** ijw has joined #openstack-ironic | 01:59 | |
| *** amotoki has quit IRC | 02:05 | |
| *** xuao has quit IRC | 02:07 | |
| *** ijw has quit IRC | 02:09 | |
| *** amotoki has joined #openstack-ironic | 02:20 | |
| *** baoli has quit IRC | 02:21 | |
| *** priteau has joined #openstack-ironic | 02:22 | |
| *** baoli has joined #openstack-ironic | 02:26 | |
| *** priteau has quit IRC | 02:27 | |
| *** amotoki has quit IRC | 02:28 | |
| *** hoangcx has quit IRC | 02:29 | |
| *** baoli has quit IRC | 02:35 | |
| *** amotoki has joined #openstack-ironic | 02:41 | |
| *** sabeen has quit IRC | 02:42 | |
| *** sabeen has joined #openstack-ironic | 02:45 | |
| *** amotoki has quit IRC | 02:48 | |
| *** hoangcx has joined #openstack-ironic | 02:53 | |
| *** vishwanathj has quit IRC | 02:54 | |
| *** rbudden has quit IRC | 02:57 | |
| *** Romanenko_K has joined #openstack-ironic | 03:12 | |
| *** vikrant has joined #openstack-ironic | 03:31 | |
| *** wuhg has joined #openstack-ironic | 03:31 | |
| *** sdake_ has joined #openstack-ironic | 03:32 | |
| *** sdake has quit IRC | 03:35 | |
| openstackgerrit | Zhenguo Niu proposed openstack/ironic: Clean nodes stuck in CLEANING state when ir-cond restarts https://review.openstack.org/349971 | 03:41 |
| *** fragatin_ has joined #openstack-ironic | 03:44 | |
| *** links has joined #openstack-ironic | 03:45 | |
| *** fragatin_ has quit IRC | 03:46 | |
| *** fragatina has quit IRC | 03:46 | |
| *** fragatina has joined #openstack-ironic | 03:53 | |
| *** fragatina has quit IRC | 03:57 | |
| *** appu103_ has joined #openstack-ironic | 03:58 | |
| *** appu103_ is now known as aparnav | 03:58 | |
| openstackgerrit | Nguyen Phuong An proposed openstack/ironic: [api-ref] Stop supporting os-api-ref 1.0.0 https://review.openstack.org/366473 | 04:01 |
| *** vmud213 has joined #openstack-ironic | 04:07 | |
| *** sabeen has quit IRC | 04:11 | |
| *** rama_y has quit IRC | 04:12 | |
| *** amotoki has joined #openstack-ironic | 04:20 | |
| openstackgerrit | Ankit Kumar proposed openstack/proliantutils: Fix Inspection failure in Gen7 https://review.openstack.org/357134 | 04:35 |
| openstackgerrit | Vasyl Saienko proposed openstack/ironic: DO NOT REVIEW https://review.openstack.org/296432 | 05:07 |
| *** moshele has joined #openstack-ironic | 05:09 | |
| *** ChubYann has quit IRC | 05:12 | |
| *** jaosorior has joined #openstack-ironic | 05:12 | |
| *** rbartal has joined #openstack-ironic | 05:13 | |
| *** harlowja_at_home has joined #openstack-ironic | 05:18 | |
| *** openstackgerrit has quit IRC | 05:18 | |
| *** openstackgerrit has joined #openstack-ironic | 05:19 | |
| *** hoangcx has quit IRC | 05:20 | |
| *** hoangcx has joined #openstack-ironic | 05:25 | |
| *** Sukhdev has joined #openstack-ironic | 05:29 | |
| *** wuhg has quit IRC | 05:41 | |
| *** sdake_ is now known as sdake | 05:46 | |
| *** Sukhdev has quit IRC | 05:51 | |
| *** e0ne has joined #openstack-ironic | 05:52 | |
| *** harlowja_at_home has quit IRC | 05:54 | |
| *** mjura has joined #openstack-ironic | 06:01 | |
| *** rajinir has quit IRC | 06:05 | |
| *** sdake has quit IRC | 06:18 | |
| *** praneshp has quit IRC | 06:30 | |
| *** pcaruana has joined #openstack-ironic | 06:34 | |
| openstackgerrit | Tuan Luong-Anh proposed openstack/ironic: Change $LOGFILE path in configuration devstack https://review.openstack.org/366518 | 06:39 |
| *** stevemar has joined #openstack-ironic | 06:44 | |
| *** tangchen has joined #openstack-ironic | 06:52 | |
| openstackgerrit | Vasyl Saienko proposed openstack/ironic: DO NOT REVIEW https://review.openstack.org/296432 | 06:54 |
| *** devananda|travel has quit IRC | 07:00 | |
| *** fxpester has joined #openstack-ironic | 07:00 | |
| *** e0ne has quit IRC | 07:01 | |
| *** tesseract- has joined #openstack-ironic | 07:02 | |
| *** sdake has joined #openstack-ironic | 07:03 | |
| *** ohamada has joined #openstack-ironic | 07:10 | |
| openstackgerrit | Yibo Cai proposed openstack/ironic: Support multi arch deployment https://review.openstack.org/322632 | 07:12 |
| *** hshiina has joined #openstack-ironic | 07:22 | |
| *** jpich has joined #openstack-ironic | 07:24 | |
| *** bcornec has quit IRC | 07:28 | |
| openstackgerrit | Vasyl Saienko proposed openstack/ironic: Update configure_tenant_networks https://review.openstack.org/356460 | 07:33 |
| *** pas-ha has quit IRC | 07:37 | |
| *** pas-ha has joined #openstack-ironic | 07:37 | |
| pas-ha | morning Ironicers :) | 07:38 |
| *** ifarkas_afk is now known as ifarkas | 07:42 | |
| *** mbound has joined #openstack-ironic | 07:51 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** sborkows has joined #openstack-ironic | 08:00 | |
| *** zzzeek has joined #openstack-ironic | 08:00 | |
| *** moshele has quit IRC | 08:01 | |
| *** moshele has joined #openstack-ironic | 08:01 | |
| tangchen | morning, all | 08:04 |
| sborkows | morning all | 08:04 |
| tangchen | morning, pas-ha | 08:04 |
| openstackgerrit | Tang Chen proposed openstack/python-ironicclient: Support i18n for osc plugin help msg https://review.openstack.org/357639 | 08:08 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack/ironic: [WIP] Testing latest u-c https://review.openstack.org/318440 | 08:10 |
| xek | morning | 08:19 |
| vmud213 | morning pas-ha,tangchen,sborkows,xek and everyone else | 08:21 |
| *** lucas-dinner is now known as lucasagomes | 08:22 | |
| *** bcornec has joined #openstack-ironic | 08:22 | |
| openstackgerrit | Nguyen Phuong An proposed openstack/ironic: [api-ref] Remove temporary block in conf.py https://review.openstack.org/366473 | 08:24 |
| *** priteau has joined #openstack-ironic | 08:27 | |
| *** openstackgerrit has quit IRC | 08:34 | |
| *** openstackgerrit has joined #openstack-ironic | 08:34 | |
| openstackgerrit | Vasyl Saienko proposed openstack/ironic: DO NOT REVIEW https://review.openstack.org/296432 | 08:38 |
| *** derekh has joined #openstack-ironic | 08:40 | |
| *** e0ne has joined #openstack-ironic | 08:41 | |
| *** athomas has joined #openstack-ironic | 08:41 | |
| *** dtantsur|afk is now known as dtantsur | 08:46 | |
| dtantsur | Morning Ironic | 08:46 |
| pas-ha | morning dtantsur | 08:46 |
| *** hshiina has quit IRC | 08:47 | |
| *** links has quit IRC | 08:53 | |
| *** vikrant has quit IRC | 08:53 | |
| *** vikrant has joined #openstack-ironic | 08:54 | |
| *** priteau has quit IRC | 08:55 | |
| *** links has joined #openstack-ironic | 08:55 | |
| *** mbound has quit IRC | 08:56 | |
| aarefiev | morning! | 08:58 |
| openstackgerrit | Anton Arefiev proposed openstack/ironic-inspector: Test grenade https://review.openstack.org/366602 | 08:58 |
| dtantsur | morning aarefiev | 08:59 |
| aarefiev | morning dtantsur, I'm trying to play with timeouts, I still can't reproduce issue | 09:01 |
| dtantsur | ugh | 09:02 |
| Romanenko_K | hi! | 09:05 |
| lucasagomes | dtantsur, pas-ha aarefiev Romanenko_K morning | 09:05 |
| dtantsur | o/ | 09:06 |
| aarefiev | morning lucasagomes | 09:06 |
| Romanenko_K | Please triage these two bugs about OSC plugin CLI: https://bugs.launchpad.net/python-ironicclient/+bug/1620737 https://bugs.launchpad.net/python-ironicclient/+bug/1620749 Do i have correct expectations regarding to CLI behavior here? | 09:10 |
| openstack | Launchpad bug 1620737 in python-ironicclient "Malformed ports field in 'node create' and 'node show' OSC subcommands" [Undecided,New] | 09:10 |
| openstack | Launchpad bug 1620749 in python-ironicclient "Lack of chassis_uuid field in OSC plugin baremetal node show output" [Undecided,New] | 09:10 |
| dtantsur | Romanenko_K, lemme check | 09:11 |
| Romanenko_K | thnks! | 09:13 |
| *** moshele has quit IRC | 09:21 | |
| *** moshele has joined #openstack-ironic | 09:21 | |
| *** moshele has quit IRC | 09:23 | |
| *** moshele has joined #openstack-ironic | 09:24 | |
| *** sborkows has quit IRC | 09:27 | |
| *** sborkows has joined #openstack-ironic | 09:27 | |
| jroll | morning y'all | 09:31 |
| openstackgerrit | Vasyl Saienko proposed openstack/ironic: Update configure_tenant_networks https://review.openstack.org/356460 | 09:33 |
| lucasagomes | jroll, morning | 09:34 |
| lucasagomes | that's quite early dude :-) | 09:34 |
| jroll | yeah, woke up too early :P | 09:34 |
| *** wznoinsk has quit IRC | 09:35 | |
| *** tuanla_ has joined #openstack-ironic | 09:36 | |
| tuanla_ | Hello ironic team | 09:40 |
| dtantsur | morning jroll, tuanla_ | 09:41 |
| openstackgerrit | Galyna Zholtkevych proposed openstack/python-ironicclient: Update openstack baremetal driver commands https://review.openstack.org/362047 | 09:44 |
| *** sdake has quit IRC | 09:47 | |
| openstackgerrit | Anton Arefiev proposed openstack/ironic-inspector: Test grenade https://review.openstack.org/366602 | 09:47 |
| *** wuhg has joined #openstack-ironic | 09:49 | |
| openstackgerrit | Jim Rollenhagen proposed openstack/ironic: Log a warning for unsupported drivers and interfaces https://review.openstack.org/366399 | 09:52 |
| jroll | do folks think ^ should have a release note, or the followup patches that deprecate drivers? (or both?) | 09:53 |
| * jroll steps away for a bit | 09:54 | |
| *** hoonetorg has quit IRC | 09:58 | |
| openstackgerrit | Galyna Zholtkevych proposed openstack/python-ironicclient: Update openstack baremetal driver commands https://review.openstack.org/362047 | 09:59 |
| dtantsur | jroll, I thought about that, but decided that we only need release notes for things that are actually visible | 10:00 |
| dtantsur | i.e. when we deprecate actual drivers | 10:01 |
| lucasagomes | jroll, I'm good with it w/o a release note | 10:10 |
| *** phuongnh has quit IRC | 10:11 | |
| *** hoangcx has quit IRC | 10:13 | |
| *** athomas has quit IRC | 10:14 | |
| *** ohamada has quit IRC | 10:20 | |
| *** ohamada has joined #openstack-ironic | 10:20 | |
| *** mgould has joined #openstack-ironic | 10:22 | |
| *** athomas has joined #openstack-ironic | 10:23 | |
| openstackgerrit | Sergii Turivnyi proposed openstack/python-ironicclient: Negative tests for testing actions with Chassis. https://review.openstack.org/343796 | 10:26 |
| openstackgerrit | Sergii Turivnyi proposed openstack/python-ironicclient: Negative tests for testing actions with chassis-update https://review.openstack.org/344715 | 10:26 |
| openstackgerrit | Sergii Turivnyi proposed openstack/python-ironicclient: Negative tests for testing actions with node-list command https://review.openstack.org/360549 | 10:28 |
| openstackgerrit | Sergii Turivnyi proposed openstack/python-ironicclient: Negative tests for testing actions with node-port-list. https://review.openstack.org/360636 | 10:29 |
| openstackgerrit | Sergii Turivnyi proposed openstack/python-ironicclient: Negative tests for testing actions with node-get command https://review.openstack.org/342060 | 10:31 |
| openstackgerrit | Sergii Turivnyi proposed openstack/python-ironicclient: Tests for testing port-create command https://review.openstack.org/291802 | 10:32 |
| dtantsur | lucasagomes, just got hit by https://bugs.launchpad.net/ironic/+bug/1621006 wdyt? | 10:38 |
| openstack | Launchpad bug 1621006 in Ironic "Cleaning must not be allowed for nodes in maintenance" [Low,Triaged] - Assigned to Dmitry Tantsur (divius) | 10:38 |
| lucasagomes | dtantsur, :-O +2! | 10:38 |
| lucasagomes | IMHO ironic should not touch such nodes | 10:39 |
| dtantsur | yeah... it happened just now: I haven't noticed that my nodes are in maintenance and was waiting for cleaning to finish... | 10:39 |
| dtantsur | will fix today | 10:39 |
| mgould | should we disallow all state transitions for nodes in maintenance? | 10:40 |
| mgould | also, morning everyone! | 10:40 |
| dtantsur | mgould, this is exactly what I was going to ask | 10:40 |
| jroll | hm, there was a reason we did it that way... I believe it was so we could boot into an agent so ops could investigate and then kick out of maintenance if fixed up | 10:40 |
| dtantsur | i.e. deploy will fail the same manner | 10:40 |
| jroll | but I'm not 100% sure that was why | 10:41 |
| dtantsur | jroll, rescue? because deploy won't work as well | 10:41 |
| jroll | we don't allow a transition to deploy in maintenance | 10:41 |
| jroll | dtantsur: what rescue? :) | 10:41 |
| jroll | rescue is only valid for ACTIVE anyway | 10:41 |
| dtantsur | the very rescue we're going to have soon and *somebody* already has downstream ;) | 10:41 |
| jroll | :P | 10:41 |
| dtantsur | hmm, right | 10:42 |
| dtantsur | anyway, the way we have it now, cleaning won't work, so I'm inclined to ban at least "provide" and "clean" transitions | 10:42 |
| jroll | possibly | 10:43 |
| jroll | might be worth talking to deva or JayF | 10:43 |
| jroll | see if they can recall | 10:43 |
| jroll | or even ruby | 10:43 |
| dtantsur | I'll put up a patch and we'll see... | 10:43 |
| jroll | fair enough | 10:44 |
| jroll | please mark it in upgrade notes so I notice we should bump major semver version, it's a breaking change | 10:44 |
| dtantsur | jroll, why do you think it is breaking? cleaning already does not work in maintenance, we'll just make it explicit | 10:45 |
| jroll | dtantsur: the transition does work, I can tell you that's something we use while operating downstream | 10:46 |
| jroll | it boots IPA and waits for intervention | 10:47 |
| jroll | else you must boot it manually, which is somewhat painful (because networking/dhcp/etc) | 10:47 |
| dtantsur | jroll, hmm, I guess we need to expose the boot interface in API... | 10:47 |
| jroll | it's breaking because set-provision-state provide|clean used to be a 202, now is a 400 or whatever (no we should probably not microversion this if we change it) | 10:48 |
| jroll | heh, maybe | 10:48 |
| dtantsur | jroll, btw do you use "provide" or "clean" downstream? | 10:49 |
| jroll | dtantsur: provide, we don't typically do manual cleaning steps except in dev/test | 10:49 |
| dtantsur | I guess "clean" might make sense, OOB cleaning will work | 10:50 |
| dtantsur | ah, provide... | 10:50 |
| jroll | we're at the point where when something goes wrong that isn't handled automatically, we want to get on the box and investigate | 10:50 |
| dtantsur | jroll, I wonder if we need to allow rescue in all states | 10:51 |
| dtantsur | * future rescue :) | 10:51 |
| jroll | mmmmm | 10:51 |
| jroll | that'd be an interestign conversation | 10:52 |
| jroll | I'd almost rather have: openstack baremetal node boot-me-an-agent | 10:52 |
| dtantsur | ++ I would have it too | 10:52 |
| dtantsur | which is nearly in-band introspection btw ;) | 10:53 |
| *** sambetts has joined #openstack-ironic | 10:53 | |
| sambetts | Morning everyone | 10:53 |
| jroll | heh | 10:53 |
| jroll | hey sambetts :) | 10:53 |
| dtantsur | morning sambetts | 10:54 |
| sambetts | if anyone's pinged me you'll need to repeat please because I'm on webchat as my gfx card on my PC has blown up :( | 10:54 |
| jroll | :/ | 10:55 |
| sambetts | hey jroll, dtantsur | 10:55 |
| sambetts | jroll: yeah... no idea what happened, its just freaked out | 10:56 |
| sambetts | its an old card though | 10:56 |
| dtantsur | aarefiev, can our grenade problems be related to some networking conflict with infra? | 10:59 |
| dtantsur | this is the only reason I can think of why ironic itself is not affected and it can't be reproduced locally... | 10:59 |
| mgould | morning sambetts! | 11:01 |
| sambetts | hey mgould | 11:01 |
| mgould | anything exciting happen while I was gone? | 11:03 |
| aarefiev | dtantsur: yeah, it's strange, it fails on ssh timeout when trying to ping gateway from instance | 11:04 |
| openstackgerrit | Tuan Luong-Anh proposed openstack/ironic: Change $LOGFILE path in configuration devstack https://review.openstack.org/366518 | 11:05 |
| dtantsur | mgould, largely, a few releases. I've also finished bringing overcloud ironic to tripleo. | 11:05 |
| dtantsur | mgould, now ironic-inspector is close to finishing the feature work, but we got our grenade broken in a strange way | 11:06 |
| *** slagle has joined #openstack-ironic | 11:06 | |
| *** amotoki has quit IRC | 11:06 | |
| mgould | dtantsur: 1) yay! 2) yay! 3) yay! 4) d'oh! | 11:06 |
| mgould | so grenade is currently broken? | 11:06 |
| dtantsur | yep (for inspector only, apparently) | 11:07 |
| lucasagomes | jroll, dtantsur boot-me-an-agent would be super handy | 11:07 |
| dtantsur | sambetts, we've been discussing https://bugs.launchpad.net/ironic/+bug/1621006 | 11:08 |
| openstack | Launchpad bug 1621006 in Ironic "Cleaning must not be allowed for nodes in maintenance" [Low,Triaged] - Assigned to Dmitry Tantsur (divius) | 11:08 |
| lucasagomes | and using with nova we could just use the same mechanism for rescue | 11:08 |
| lucasagomes | when the instance is active | 11:08 |
| jroll | when is grenade supposed to run tempest after the upgrade? I'm not seeing it in ironic's grenade job... http://logs.openstack.org/99/366399/2/check/gate-grenade-dsvm-ironic/a637018/logs/grenade.sh.txt.gz | 11:08 |
| mgould | jroll: I think it gets run elsewhere in the grenade script | 11:09 |
| dtantsur | jroll, it's in main console.log | 11:09 |
| jroll | ahhhhh, ok | 11:09 |
| jroll | thanks | 11:09 |
| *** tuanla_ has quit IRC | 11:11 | |
| sambetts | the bug makes sense to me, and I like the idea of being able to boot the node with a agent while in maintenance for all sorts of debugging and manual maintence stuff | 11:12 |
| mgould | jroll: looks like the gate script runs tempest after grenade.sh has finished: https://review.openstack.org/#/c/346923/1/grenade.sh | 11:14 |
| patchbot | patch 346923 - openstack-dev/grenade - Document TARGET_RUN_SMOKE flag | 11:14 |
| jroll | mgould: right, which is why it's on console.log | 11:15 |
| mgould | jroll: ah, sorry | 11:15 |
| jroll | mgould: no, thank you for pointing it out :) | 11:16 |
| *** baoli has joined #openstack-ironic | 11:17 | |
| *** lucasagomes is now known as lucas-hungry | 11:20 | |
| *** thrash|g0ne is now known as thrash | 11:25 | |
| openstackgerrit | Vasyl Saienko proposed openstack/ironic: DO NOT REVIEW https://review.openstack.org/296432 | 11:26 |
| *** sambetts has quit IRC | 11:32 | |
| *** skazi has quit IRC | 11:32 | |
| *** sambetts|afk is now known as sambetts | 11:32 | |
| sambetts | managed to squeeze a little bit of life out of my gfx card while I wait for my new one to arrive tomorrow | 11:33 |
| mat128 | hi group! | 11:34 |
| jroll | morning mat128 :) | 11:35 |
| mgould | morning mat128! | 11:36 |
| *** amotoki has joined #openstack-ironic | 11:37 | |
| sambetts | hey mat128 | 11:39 |
| TheJulia | Good morning | 11:47 |
| ricardoas | morning! | 11:48 |
| dtantsur | morning mat128, TheJulia, ricardoas | 11:48 |
| openstackgerrit | Sam Betts proposed openstack/ironic-python-agent: Include IPA Version during heartbeat https://review.openstack.org/364834 | 11:49 |
| *** amotoki has quit IRC | 11:50 | |
| ricardoas | morning dtantsur :) | 11:50 |
| *** bfournie has quit IRC | 11:54 | |
| *** skazi has joined #openstack-ironic | 11:54 | |
| *** baoli_ has joined #openstack-ironic | 11:54 | |
| openstackgerrit | Kyrylo Romanenko proposed openstack/python-ironicclient: Hide 'ports' field from node OSC subcommands output https://review.openstack.org/366703 | 11:57 |
| *** baoli has quit IRC | 11:57 | |
| *** amotoki has joined #openstack-ironic | 11:58 | |
| openstackgerrit | Galyna Zholtkevych proposed openstack/python-ironicclient: Update openstack baremetal driver commands https://review.openstack.org/362047 | 12:01 |
| *** trown|outtypewww is now known as trown | 12:02 | |
| *** wajdi has quit IRC | 12:04 | |
| *** wajdi has joined #openstack-ironic | 12:04 | |
| *** links has quit IRC | 12:04 | |
| *** wajdi has joined #openstack-ironic | 12:05 | |
| mgould | morning TheJulia, ricardoas | 12:05 |
| *** chlong has joined #openstack-ironic | 12:05 | |
| *** devananda has joined #openstack-ironic | 12:06 | |
| *** devananda is now known as devananda|travel | 12:06 | |
| *** amotoki has quit IRC | 12:07 | |
| vsaienk0 | jroll: https://review.openstack.org/#/c/366399/2/ironic/common/driver_factory.py this will generate a warning for drivers from ironic-staging-drivers, I think we should skip them. | 12:07 |
| patchbot | patch 366399 - ironic - Log a warning for unsupported drivers and interfaces | 12:07 |
| ricardoas | morning mgould | 12:08 |
| jroll | vsaienk0: why would it? the default in the base class is supported=True | 12:08 |
| jroll | vsaienk0: I made True the default, because we can't control out-of-tree things, so no reason to warn for them | 12:08 |
| vsaienk0 | jroll: right! I've missed that supported is True by default | 12:10 |
| jroll | :) | 12:10 |
| sambetts | jroll: I like the idea of warning if someone tries to load any unoffical driver, although I guess they can just set supported=True if they really wanted :/ | 12:12 |
| jroll | sambetts: yeah, like I said, no control | 12:12 |
| jroll | presumably if they've installed and used an unofficial driver, they know what that means (or their vendor does) | 12:13 |
| sambetts | yeah | 12:13 |
| jroll | bbiab | 12:15 |
| *** links has joined #openstack-ironic | 12:16 | |
| *** hoonetorg has joined #openstack-ironic | 12:23 | |
| *** lucas-hungry is now known as lucasagomes | 12:23 | |
| openstackgerrit | Sam Betts proposed openstack/ironic: Receive and store agent version on heartbeat https://review.openstack.org/364861 | 12:23 |
| *** bfournie has joined #openstack-ironic | 12:27 | |
| *** dprince has joined #openstack-ironic | 12:27 | |
| *** rbudden has joined #openstack-ironic | 12:30 | |
| *** amotoki has joined #openstack-ironic | 12:33 | |
| lucasagomes | no open patches in ironic-lib :-) | 12:36 |
| *** mmedvede has quit IRC | 12:36 | |
| lucasagomes | jroll, ^ btw, can we get a release of it soon-ish ? | 12:36 |
| *** wajdi has quit IRC | 12:42 | |
| sambetts | lucasagomes: Do you know if I want to merge a change into nova, that depends on an ironic client change, if we have to release Ironic client or if I can use depends-on? | 12:43 |
| openstackgerrit | Kyrylo Romanenko proposed openstack/python-ironicclient: Hide 'nodes' field from chassis OSC subcommands output https://review.openstack.org/366731 | 12:43 |
| lucasagomes | sambetts, you likely to need a release, unless the code in nova knows how to handle old and new versions of the client lib | 12:44 |
| *** vikrant has quit IRC | 12:47 | |
| lucasagomes | (even tho nova is not sctrictly dependent on the ironicclient, but I think we should be able to say: "the nova ironic driver now depends on client verison X.Y.Z" | 12:47 |
| openstackgerrit | Anton Arefiev proposed openstack/ironic-inspector: Test grenade https://review.openstack.org/366602 | 12:47 |
| lucasagomes | )* | 12:47 |
| openstackgerrit | Vasyl Saienko proposed openstack/ironic: DO NOT REVIEW https://review.openstack.org/296432 | 12:47 |
| *** mgoddard_ has joined #openstack-ironic | 12:48 | |
| *** jaosorior has quit IRC | 12:49 | |
| *** jaosorior has joined #openstack-ironic | 12:50 | |
| *** Goneri has joined #openstack-ironic | 12:51 | |
| *** wuhg has quit IRC | 12:51 | |
| *** mgoddard has quit IRC | 12:52 | |
| *** mjturek has joined #openstack-ironic | 12:52 | |
| sambetts | lucasagomes: :( its annoying because I can't use the CI to test my changes because the CI doesn't read the depends-on :( | 12:59 |
| lucasagomes | sambetts, ouch :-/ | 13:01 |
| lucasagomes | that can be a PITA indeed | 13:01 |
| *** mmedvede has joined #openstack-ironic | 13:02 | |
| lucasagomes | sambetts, so the change in the client is already merged in master ? | 13:03 |
| lucasagomes | and we just need a release ? | 13:03 |
| sambetts | lucasagomes: no, its not merged yet, I have a change that requires changes in nova, client, and ironic itself, and I wanted to run an end to end test in the CI to ensure it all worked when put together in the CI | 13:05 |
| sambetts | so I've pushed commits with the nova patch depends on the client patch and the client patch depends on my Ironic change | 13:05 |
| *** leitan has joined #openstack-ironic | 13:06 | |
| openstackgerrit | Sam Betts proposed openstack/ironic: Add Network Interface Attach and Detach APIs https://review.openstack.org/327046 | 13:06 |
| sambetts | lucasagomes: I think if we had ironicclient from source enabled in the CI it would work, but I assume we don't do that for a reason | 13:08 |
| lucasagomes | sambetts, yeah, the only place we should test ironicclient from source is in the ironicclient gate itself | 13:09 |
| lucasagomes | that said, I'm in a similar situation but less complex waiting a release from ironic-lib to make changes in IPA and ironic to use the root device hints thingy (which I'm code atm) | 13:10 |
| sambetts | lucasagomes: I guess I could put up a fake patch into ironicclient to test it, make that fake patch depend on the nova, client and ironic changes, then the client from source test should test it all together right? | 13:11 |
| *** vishwanathj has joined #openstack-ironic | 13:11 | |
| openstackgerrit | Lucas Alvares Gomes proposed openstack/ironic-python-agent: Add support for root device hints with operators https://review.openstack.org/366742 | 13:12 |
| *** links has quit IRC | 13:12 | |
| lucasagomes | sambetts, it should pull the depends-on changes yes | 13:12 |
| openstackgerrit | Sam Betts proposed openstack/python-ironicclient: Add python API for node interface attach/detach https://review.openstack.org/364420 | 13:13 |
| *** vmud213 has quit IRC | 13:14 | |
| openstackgerrit | Sam Betts proposed openstack/python-ironicclient: DO NOT MERGE Testing Client Changes with Nova https://review.openstack.org/366747 | 13:16 |
| *** trown is now known as trown|brb | 13:17 | |
| *** aparnav has quit IRC | 13:18 | |
| openstackgerrit | Sam Betts proposed openstack/ironic: Receive and store agent version on heartbeat https://review.openstack.org/364861 | 13:19 |
| *** hoangcx has joined #openstack-ironic | 13:19 | |
| *** rloo has joined #openstack-ironic | 13:24 | |
| openstackgerrit | Julia Kreger proposed openstack/ironic: [WIP] Add storage_interface DB field and object https://review.openstack.org/348005 | 13:26 |
| *** ohamada has quit IRC | 13:27 | |
| *** trown|brb is now known as trown | 13:28 | |
| *** jcoufal has joined #openstack-ironic | 13:28 | |
| *** mgoddard_ has quit IRC | 13:30 | |
| *** mgoddard has joined #openstack-ironic | 13:30 | |
| jroll | lucasagomes: yeah, I can post one - I'm not sure when ocata opens for library releases but I can put the request up | 13:33 |
| *** rloo has quit IRC | 13:33 | |
| jroll | sambetts: vsaienk0 did an interesting thing with a dummy patch to devstack-gate to pull in an ironicclient patch, you might ask him | 13:33 |
| *** hamzy has quit IRC | 13:34 | |
| lucasagomes | jroll, right on, thanks a lot | 13:34 |
| openstackgerrit | Sam Betts proposed openstack/python-ironicclient: DO NOT MERGE Testing Client Changes with Nova https://review.openstack.org/366747 | 13:35 |
| sambetts | jroll: hoping this will work ^ | 13:35 |
| lucasagomes | in any case I will just put up the patches for IPA (already up) and Ironic as well | 13:35 |
| vsaienk0 | jroll, sambetts: the patch actually was to ironic https://review.openstack.org/#/c/296432/65/devstack/lib/ironic | 13:35 |
| patchbot | patch 296432 - ironic - DO NOT REVIEW | 13:35 |
| lucasagomes | so we can get the feature as soon as ocata opens | 13:35 |
| sambetts | vsaienk0: ah I see, if my ironicclient patch doesn't work I'll try that method instead | 13:35 |
| jroll | lucasagomes: we just need a y bump in x.y.z for ironic-lib, yes? didn't break anything? | 13:36 |
| jroll | vsaienk0: ah, cool | 13:36 |
| jroll | thanks | 13:36 |
| lucasagomes | jroll, yeah just a minor | 13:36 |
| jroll | k | 13:36 |
| * lucasagomes added x.y.z in the patch because he didn't remember the current version :D | 13:36 | |
| jroll | lucasagomes: eh? which patch? | 13:37 |
| lucasagomes | jroll, https://review.openstack.org/366742 | 13:38 |
| patchbot | patch 366742 - ironic-python-agent - Add support for root device hints with operators | 13:38 |
| jroll | ah, lol | 13:38 |
| lucasagomes | I thought you looked at it heh | 13:38 |
| jroll | it'll be 2.2.0 btw | 13:38 |
| lucasagomes | fair, I will update the patch after the release, don't need to waste more gate resources cause I know it will fail now (the function is not present in the utils.py module from ironic-lib) | 13:39 |
| * lucasagomes updates locally | 13:39 | |
| jroll | lucasagomes: I'm going to -2 that so we don't accidentally merge in newton, remind me to undo it when ocata is open :) | 13:41 |
| lucasagomes | jroll, ++, want me to -2 it ? | 13:41 |
| jroll | oh yeah, go for it | 13:41 |
| jroll | then I won't be blocking you | 13:41 |
| lucasagomes | yeah | 13:41 |
| lucasagomes | done | 13:41 |
| jroll | thanks | 13:42 |
| *** sabeen has joined #openstack-ironic | 13:42 | |
| *** hoangcx has quit IRC | 13:42 | |
| *** skazi has quit IRC | 13:42 | |
| *** krtaylor has joined #openstack-ironic | 13:42 | |
| *** jvgrant_ has joined #openstack-ironic | 13:43 | |
| devananda|travel | morning, all | 13:44 |
| jroll | ohai devananda|travel | 13:45 |
| *** hoangcx has joined #openstack-ironic | 13:45 | |
| *** sabeen1 has joined #openstack-ironic | 13:46 | |
| lucasagomes | devananda|travel, morning ;-) | 13:46 |
| *** joprovost has joined #openstack-ironic | 13:46 | |
| *** sabeen has quit IRC | 13:48 | |
| jroll | lucasagomes: apparently ocata releases will open after g-r gets branched, around sept 26 or maybe a bit later depending on things | 13:49 |
| dtantsur | morning devananda|travel | 13:51 |
| *** michauds has joined #openstack-ironic | 13:52 | |
| *** rloo has joined #openstack-ironic | 13:54 | |
| lucasagomes | jroll, thanks for the info! It's a bit far tho, but ¯\_(ツ)_/¯ | 13:55 |
| jroll | rloo: since I'm bad at writing things, do you mind reviewing at least the warning log here? https://review.openstack.org/#/c/366399/2/ironic/common/driver_factory.py | 13:56 |
| patchbot | patch 366399 - ironic - Log a warning for unsupported drivers and interfaces | 13:56 |
| jroll | lucasagomes: heh, yeah you can hack our devstack plugin to pull in master | 13:56 |
| *** skazi has joined #openstack-ironic | 13:56 | |
| rloo | jroll: sure. but i want you to know, that I find it painful to write English. | 13:56 |
| lucasagomes | jroll, yeah, that's how I test it :-) | 13:56 |
| lucasagomes | no rush | 13:56 |
| jroll | lucasagomes: cool | 13:57 |
| lucasagomes | ty | 13:57 |
| *** hj-hpe has joined #openstack-ironic | 13:57 | |
| *** rcernin has joined #openstack-ironic | 13:57 | |
| jroll | rloo: you're very good at it, so I'm grateful when you do. you don't have to on this patch if you don't want to :) | 13:57 |
| rloo | jroll: do we have an idea as to when we might remove them? | 13:58 |
| rloo | jroll: or at least, the earliest time frame that we might do so? | 13:58 |
| *** wajdi has joined #openstack-ironic | 13:59 | |
| rloo | jroll: i'm actually wondering if we can put some value in the supported flag, to indicate the earliest that it might be deleted | 13:59 |
| lucasagomes | rloo, I would prefer to leave it open without a hard date | 13:59 |
| jroll | rloo: well, 3 months from landing the deprecation, at a minimum. but, they might not be removed (if someone adds CI), and this is meant to be continuous. | 13:59 |
| jroll | I'd also prefer to leave it open, I think it will vary by driver | 14:00 |
| mat128 | rloo: then people will set the date back on their computers to run unsupported drivers :) | 14:00 |
| lucasagomes | it may happen that somoene that is depending on that driver see the message and propose {him, her}self to maintain it | 14:00 |
| rloo | jroll: i was thinking 'the earliest that this may be removed is ...'. | 14:00 |
| *** anush has joined #openstack-ironic | 14:00 | |
| rloo | what are operators meant to do when they see this warning? | 14:00 |
| rloo | am also wondering how we will deal with this with the new driver composition, but we can deal with that later. | 14:01 |
| jroll | panic and flail wildly | 14:01 |
| jroll | I put it on interfaces as well for that reason | 14:01 |
| rloo | jroll: no worries, we can handle it :) | 14:01 |
| *** joprovost1 has joined #openstack-ironic | 14:02 | |
| *** joprovost has quit IRC | 14:02 | |
| *** joprovost1 is now known as joprovost | 14:02 | |
| *** narasimha_SV has joined #openstack-ironic | 14:03 | |
| rloo | jroll: commented. | 14:04 |
| rloo | jroll: are we allowed to deprecate AND unsupport? I mean, is that ok with the 'follows deprecation' tag or whatever it is. | 14:04 |
| dtantsur | morning rloo | 14:04 |
| jroll | thanks rloo | 14:04 |
| rloo | hi and good morning dtantsur, jroll, mat128, lucasagomes and everyone else! | 14:05 |
| mat128 | o/ | 14:05 |
| jroll | rloo: yes, 'follows deprecation' implies that a valid config for cycle X is also valid for X+1, if there's no deprecation warnings | 14:05 |
| lucasagomes | rloo, morning | 14:05 |
| rloo | jroll: ok, nothing about having to support it? | 14:05 |
| jroll | rloo: nope | 14:06 |
| rloo | jroll: good! | 14:06 |
| jroll | :) | 14:06 |
| *** cdearborn has joined #openstack-ironic | 14:06 | |
| mgould | morning rloo | 14:08 |
| rloo | hi mgould | 14:08 |
| narasimha_SV | while using pxe_ipmitool , after creating a node when I check hepervisor-stats it is showing 1 node but I am not able to see all the other hardware details ? | 14:09 |
| narasimha_SV | is this expected result ?? | 14:10 |
| narasimha_SV | http://paste.openstack.org/show/567476/ | 14:11 |
| lucasagomes | narasimha_SV, how many nodes do you have ? And what's the value of "count" in the hypervisor-stats command ? | 14:11 |
| * lucasagomes looks | 14:11 | |
| narasimha_SV | i have added all the details about his in above link | 14:12 |
| narasimha_SV | http://paste.openstack.org/show/567476/ | 14:12 |
| lucasagomes | narasimha_SV, does your node have all the properties/ set ? | 14:12 |
| lucasagomes | cpus, local_gb, memory_mb and cpu_arch | 14:12 |
| jroll | narasimha_SV: depending on the state of the node, there might be no resources presented - your node looks ok, but if you've just changed power or provision state (or ironic just changed it), you may need to wait a few minutes for nova to pick up the resources | 14:13 |
| lucasagomes | ^ yeah it's also not instanteneous, the changes may take a while to be propagated from ironic to nova | 14:13 |
| narasimha_SV | jroll: its been more than 2 hours | 14:13 |
| jroll | ok | 14:13 |
| * jlvillal wonders if this really is opensource video conferencing: https://meet.jit.si/ | 14:13 | |
| jroll | narasimha_SV: so yeah, can you show a full node-show? | 14:14 |
| mat128 | jlvillal: it is | 14:14 |
| jlvillal | Thinking about next virtual mid-cycle | 14:14 |
| mat128 | jlvillal: I tried it, you can self-host by simply running their app | 14:14 |
| mat128 | it's very similar to appear.in, but open source | 14:14 |
| openstackgerrit | Jim Rollenhagen proposed openstack/ironic: Log a warning for unsupported drivers and interfaces https://review.openstack.org/366399 | 14:14 |
| jlvillal | mat128, Cool :) And you are fast in responding!!! | 14:14 |
| jroll | rloo: dtantsur: lucasagomes: jlvillal: ^ updated log message | 14:14 |
| mat128 | jlvillal: I was looking for video conferencing products for my team | 14:14 |
| jroll | jlvillal: I use jitsi to connect to pbx.o.o, it isn't terrible | 14:14 |
| mat128 | jlvillal: current solutions all peg my CPU and drain my laptop battery | 14:14 |
| mat128 | jroll: did you get video to work with jitsi? | 14:15 |
| jlvillal | jroll, Right. This is a video version of it. I guess | 14:15 |
| mat128 | I mean, the fat app | 14:15 |
| mat128 | jlvillal: the jitsi app supposedly allows video conferencing on jingle-compatible XMPP servers | 14:15 |
| jroll | mat128: not sure pbx.o.o supports it, I haven't tried though | 14:15 |
| jroll | jlvillal: yeah, seems neat | 14:15 |
| mat128 | jlvillal: but I have never got it to work | 14:15 |
| narasimha_SV | http://paste.openstack.org/show/567477/ | 14:15 |
| mat128 | meet.jit.si is WebRTC so that works for most people, as long as you can access the page | 14:16 |
| lucasagomes | jroll, thanks | 14:16 |
| mat128 | jlvillal: https://github.com/jitsi/jitsi-meet | 14:16 |
| lucasagomes | narasimha_SV, | properties | {u'cpu_arch': u'x86_64'} | 14:16 |
| rloo | jroll: sorry, I'm actually looking at the patch now. can we distinguish interfaces from drivers? | 14:16 |
| lucasagomes | narasimha_SV, that's the only property you have | 14:16 |
| jroll | narasimha_SV: ok right, so you need cpus, memory_mb, and local_gb in properties, that's what tells nova what resources are available | 14:17 |
| rloo | jroll: or is it obvious when the 'driver' name is logged, that it is a driver or an interface? | 14:17 |
| lucasagomes | narasimha_SV, you need to specify the number of cpus (cpus), memory_mb, local_gb (disk size in GB) | 14:17 |
| jroll | rloo: we can, in the subclasses, I could split that out if you like. I hate the name interfaces personally but ¯\_(ツ)_/¯ | 14:17 |
| lucasagomes | then it will appear in the nova command | 14:17 |
| narasimha_SV | ok thanks | 14:17 |
| narasimha_SV | i will try | 14:17 |
| *** hoangcx has quit IRC | 14:17 | |
| rloo | jroll: well, we should have agreed on the naming before. or now. at least before the driver composition reform is done. or maybe it is too late. dunno. | 14:18 |
| jroll | rloo: I mean, it's fine, both called drivers would be too confusing :) | 14:18 |
| rloo | jroll: so i'll leave it up to you to change that log msg to distinguish drivers from interfaces. sorry, i only looked at the string before. | 14:19 |
| jroll | dtantsur: mr. driver composition, what do you think? ^ | 14:19 |
| *** hoangcx has joined #openstack-ironic | 14:20 | |
| *** nicodemos has quit IRC | 14:20 | |
| *** cinerama has quit IRC | 14:20 | |
| *** yibo has quit IRC | 14:20 | |
| *** anteaya has quit IRC | 14:20 | |
| *** sambetts has quit IRC | 14:20 | |
| *** stevebaker has quit IRC | 14:20 | |
| *** Guest40699 has quit IRC | 14:20 | |
| * dtantsur runs away | 14:20 | |
| dtantsur | sorry, I don't quite get the question | 14:21 |
| *** sabeen has joined #openstack-ironic | 14:21 | |
| *** sabeen1 has quit IRC | 14:21 | |
| *** aslezil has joined #openstack-ironic | 14:21 | |
| TheJulia | slightly more context might help | 14:21 |
| jroll | dtantsur: that driver deprecation log, should we have different messages for drivers vs. interfaces? | 14:22 |
| narasimha_SV | jroll,lucasagomes: if I wont add those details will there be an issue ?? | 14:22 |
| narasimha_SV | like scheduler wont be able to get this node added ? | 14:22 |
| lucasagomes | narasimha_SV, yes, you won't be able to deploy the node :-) | 14:22 |
| jroll | narasimha_SV: that's how nova knows what resources the node has, and it is how it matches a flavor to a node | 14:22 |
| dtantsur | jroll, we deprecate drivers, no? | 14:22 |
| jroll | so if your flavor has cpus:0 and memory_mb:0 and local_gb:0, maybe it will work :) | 14:22 |
| narasimha_SV | ok | 14:22 |
| jroll | dtantsur: I think one day we may deprecate interfaces, though (or maybe just hardware types?) | 14:23 |
| lucasagomes | jroll, I think we use things like local_gb when partitioning the disk | 14:23 |
| jroll | ah, true | 14:23 |
| lucasagomes | worth trying, but I don't think it will work | 14:23 |
| lucasagomes | we check if the image fits the disk and things like that | 14:23 |
| lucasagomes | if the disk is 0 it will fial | 14:23 |
| lucasagomes | fail* | 14:23 |
| jroll | yep | 14:23 |
| openstackgerrit | Imre Farkas proposed openstack/ironic: Fix nits on DRAC OOB inspection patch https://review.openstack.org/366785 | 14:24 |
| dtantsur | jroll, let's start with deprecating drivers :) right now we don't have interfaces independent of drivers | 14:24 |
| openstackgerrit | Vasyl Saienko proposed openstack/ironic: DO NOT REVIEW https://review.openstack.org/296432 | 14:25 |
| jroll | dtantsur: well, driver factory handles both, but I can make it just do drivers? or leave as is and promise not to mark interfaces unsupported | 14:25 |
| rloo | dtantsur, jroll: we actually have those network interfaces that are independent of drivers. I commented on that; not sure how your patch deals with those. | 14:25 |
| *** fxpester has quit IRC | 14:26 | |
| jroll | tbh I was going to mark noop network as unsupported, given we don't test it (but probably not remove it anytime soon) | 14:26 |
| dtantsur | huh | 14:27 |
| dtantsur | I'd wait for driver composition before that, just to avoid too much confusion | 14:27 |
| jroll | sure | 14:27 |
| *** lucasagomes is now known as lucas-afk | 14:29 | |
| TheJulia | This makes me think we really ought to have some sort of testing wrapped around noop... but it is such a foreign thing that we might as well just trigger bifrost's ci job at that point. | 14:30 |
| jroll | I'd be +1 on a bifrost job on ironic | 14:31 |
| *** syed_ has joined #openstack-ironic | 14:32 | |
| dtantsur | moar jobs \o/ | 14:32 |
| * dtantsur pushes for a lightweight tripleo job for quite some time as well | 14:33 | |
| TheJulia | dtantsur: What do you mean by lightweight? (Admittedly, I'm totally out of touch with tripleo's current... well... mostly everything since it has changed so much in the last two years.) | 14:35 |
| dtantsur | TheJulia, I mean, avoid doing the whole 1.5 hrs deployment :) e.g. they have multinode jobs now, which are substantially faster | 14:37 |
| TheJulia | The only concern that I would truly have is just memory limitations in a single CI node. | 14:38 |
| *** rpioso has joined #openstack-ironic | 14:38 | |
| *** nicodemos has joined #openstack-ironic | 14:42 | |
| *** cinerama has joined #openstack-ironic | 14:42 | |
| *** yibo has joined #openstack-ironic | 14:42 | |
| *** anteaya has joined #openstack-ironic | 14:42 | |
| *** sambetts has joined #openstack-ironic | 14:42 | |
| *** stevebaker has joined #openstack-ironic | 14:42 | |
| *** Guest40699 has joined #openstack-ironic | 14:42 | |
| *** hoonetorg has quit IRC | 14:43 | |
| TheJulia | dtantsur: but ultimately, moar is better :) | 14:43 |
| dtantsur | yeah :) we'll see | 14:44 |
| TheJulia | :) | 14:45 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic: [WIP] Drastically reduce list of actions allowed for nodes in maintenance https://review.openstack.org/366793 | 14:45 |
| dtantsur | jroll, JayF, ^^^ | 14:45 |
| openstackgerrit | Jim Rollenhagen proposed openstack/ironic: Log a warning for unsupported drivers and interfaces https://review.openstack.org/366399 | 14:46 |
| *** hamzy has joined #openstack-ironic | 14:46 | |
| dtantsur | TheJulia, re https://review.openstack.org/366793: not sure if we need to allow adopt there... | 14:46 |
| patchbot | patch 366793 - ironic - [WIP] Drastically reduce list of actions allowed f... | 14:46 |
| TheJulia | dtantsur: wow that is a context switch for my brain | 14:47 |
| jroll | rloo: not sure what you mean by "Did you test to see what happens if 'flat' can't be loaded?" do you want me to add a test there? did you mean if 'flat' is unsupported? is there any part of that code you'd like me to explain (how interfaces are loaded etc) | 14:47 |
| *** hoangcx has quit IRC | 14:48 | |
| rloo | jroll: sorry, i added another comment later. initially, i wasn't quite sure if it worked with interfaces. | 14:48 |
| dtantsur | TheJulia, sorry :) | 14:48 |
| rloo | jroll: although i guess we should add a test for interface too | 14:48 |
| *** moshele has quit IRC | 14:49 | |
| jroll | rloo: I'll just make sure _warn_if_unsupported is called for the base case there, cool? | 14:50 |
| rloo | jroll: yeah, that should do it | 14:50 |
| *** mkam has joined #openstack-ironic | 14:51 | |
| *** sborkows has quit IRC | 14:51 | |
| TheJulia | dtantsur: I'm honestly not sure. Off hand, I think allowing retries makes sense, but at the same time I'm struggling to think of a case where a user would be stuck in that kind of situation. But perhaps, the answer is to process the heartbeats. Maintenance state and delete a node kind of makes sense, and seems like something a user might end up getting | 14:52 |
| TheJulia | themselves into kind of easily. | 14:52 |
| jroll | oh yeah, we definitely need to allow the delete verb | 14:53 |
| dtantsur | jroll, TheJulia, yeah, but deleting a node implies cleaning | 14:53 |
| dtantsur | which does not work :) | 14:53 |
| jroll | else a bmc going out means the user is billed until the operator fixes it | 14:53 |
| TheJulia | dtantsur: not if cleaning is disabled :) | 14:53 |
| dtantsur | TheJulia, well, yes, but it's enabled by default | 14:53 |
| jroll | I'm absolutely -1 on not allowing delete | 14:54 |
| *** mbound has joined #openstack-ironic | 14:54 | |
| dtantsur | jroll, then how do you suggest to make it work? | 14:54 |
| jroll | nova users shouldn't need to care if a node is in maintenance | 14:54 |
| dtantsur | because you're not -1 on not allowing it, you're +1 on fixing it ;) | 14:54 |
| TheJulia | jroll: ++ | 14:54 |
| dtantsur | or should we get back heartbeats processing? | 14:55 |
| jroll | dtantsur: erm, I'm -1 on breaking delete verb while in maintenance | 14:55 |
| dtantsur | jroll, nobody breaks it, it's broken. now. | 14:55 |
| openstackgerrit | Vasyl Saienko proposed openstack/ironic: DO NOT REVIEW https://review.openstack.org/296432 | 14:55 |
| dtantsur | jroll, unless you disable the whole cleaning, which we don't recommend that users do. | 14:55 |
| jroll | dtantsur: from the nova user perspective, it isn't broken - your patch would break it | 14:55 |
| *** amotoki has quit IRC | 14:56 | |
| jroll | "why'd my nova delete fail?" "the bmc is broken" "why do I care? I'm not paying for something I don't want" | 14:56 |
| dtantsur | jroll, well, fair. if we're ok with these nodes hanging in clean wait forever... | 14:56 |
| dtantsur | so, now I think we should just allow heartbeats and make cleaning (try to) work.. | 14:56 |
| TheJulia | or just let cleaning fail | 14:56 |
| jroll | dtantsur: well, no, we shouldn't do any actions on the machine while in maintenance | 14:57 |
| *** hoonetorg has joined #openstack-ironic | 14:57 | |
| TheJulia | if a node is in maintenance, there should be an alarm or an indicator in an operator's monitoring system | 14:57 |
| JayF | dtantsur: wdyt about allowing delete in maintenance | 14:57 |
| jroll | didn't I mention why we chose to do this earlier today? :) | 14:57 |
| JayF | dtantsur: imo we have to allow deleteing in maint | 14:57 |
| *** hoangcx has joined #openstack-ironic | 14:57 | |
| dtantsur | JayF, I'm fine with that, as soon as we're fine with it resulting on clean fail after the timeout | 14:57 |
| JayF | ah, I see jroll in scrollback now, lol | 14:57 |
| JayF | dtantsur: very fine with it | 14:57 |
| JayF | dtantsur: as you can tell, it already happens today :) | 14:57 |
| dtantsur | okie, you've convinced me | 14:58 |
| *** rbrud has joined #openstack-ironic | 14:58 | |
| jroll | well, it doesn't fail today | 14:58 |
| jroll | it waits | 14:58 |
| jroll | 10:40:49 jroll | hm, there was a reason we did it that way... I believe it was so we could boot into an agent so ops could investigate and then kick out of maintenance if fixed up | 14:58 |
| JayF | and then it times out | 14:58 |
| jroll | I still believe that's useful | 14:58 |
| jroll | it does not | 14:58 |
| *** mkam has quit IRC | 14:58 | |
| JayF | oh? interesting | 14:58 |
| jroll | the heartbeat touches the updated at or whatever | 14:58 |
| JayF | Either way, the use case is: I have a semi-broken node, that's got an instance -> I want to fix it, but can't disrupt the customer -> on customer delete, troubleshoot | 14:59 |
| JayF | like we've used a maint-while-active workflow for nodes that had reported hardware failures from a customer | 14:59 |
| jroll | right | 14:59 |
| *** mjura has quit IRC | 14:59 | |
| jroll | JayF: so wdyt is more useful while a thing is in maint, booting into an agent and heartbeating while we wait, or failing cleaning altogether | 14:59 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic: [WIP] Drastically reduce list of actions allowed for nodes in maintenance https://review.openstack.org/366793 | 15:00 |
| *** hoangcx has quit IRC | 15:01 | |
| dtantsur | jroll, wdym "it doesn't fail"? cleaning won't happen, so it will timeout eventually... | 15:02 |
| jroll | dtantsur: no, the heartbeat updates the field that the timeout checks | 15:02 |
| dtantsur | jroll, I mean cleaning timeout | 15:02 |
| jroll | I do too | 15:02 |
| dtantsur | hmm, ok, so it hangs forever :) | 15:02 |
| jroll | unless something has changed | 15:02 |
| jroll | yeah, looks like it should work | 15:03 |
| dtantsur | well, it's even worse then, we're stuck in "clean wait" | 15:03 |
| jroll | I guess I don't understand why that's so bad | 15:04 |
| jroll | maybe a bit confusing | 15:04 |
| *** hoangcx has joined #openstack-ironic | 15:04 | |
| openstackgerrit | Caio Oliveira proposed openstack/ironic: [WIP] Custom power sync https://review.openstack.org/332978 | 15:05 |
| dtantsur | jroll, 1. start cleaning for node in maintenance, 2. it gets in "clean wait", 3. and stays there forever | 15:05 |
| dtantsur | jroll, because of https://github.com/openstack/ironic/blob/master/ironic/drivers/modules/agent_base_vendor.py#L474-L478 | 15:05 |
| jroll | dtantsur: I understand what happens now, and why | 15:05 |
| jroll | dtantsur: why is booting an agent and waiting, worse than failing altogether? | 15:05 |
| dtantsur | confusing for users? | 15:06 |
| jroll | right, so it's a bit confusing, we can probably fix that | 15:06 |
| jroll | other than that it seems fine to me, but I may be missing something | 15:06 |
| openstackgerrit | Jim Rollenhagen proposed openstack/ironic: Log a warning for unsupported drivers and interfaces https://review.openstack.org/366399 | 15:08 |
| dtantsur | jroll, another approach will be in https://github.com/openstack/ironic/blob/master/ironic/drivers/modules/agent_base_vendor.py#L474-L478 to fail cleaning | 15:08 |
| dtantsur | (ditto for deploying) | 15:08 |
| jroll | dtantsur: yes, I understand the options, we just talked about that | 15:09 |
| jroll | like I said, there's a valid use case for getting an agent booted and waiting | 15:09 |
| jroll | so it's a matter of if that use case is worth making this less confusing, or if we should just kill that use case | 15:09 |
| openstackgerrit | Anton Arefiev proposed openstack/ironic-inspector: Test grenade https://review.openstack.org/366602 | 15:09 |
| dtantsur | yes, but it's not what we call cleaning. unless we document this behavior and state that it's desired | 15:10 |
| *** thrash is now known as thrash|biab | 15:10 | |
| jroll | right, we can make it less confusing | 15:10 |
| dtantsur | the reason I don't like it is because maintenance happen automatically | 15:10 |
| dtantsur | so today I just didn't notice that I got into it. I spent some time wondering why cleaning hangs. | 15:10 |
| jroll | sure | 15:11 |
| jroll | there's a log there, did that not help? | 15:11 |
| *** mkam has joined #openstack-ironic | 15:11 | |
| dtantsur | I didn't get to logs at that moment | 15:12 |
| dtantsur | anyway, it's a bit | 15:12 |
| dtantsur | * a bit cruel IMO | 15:12 |
| dtantsur | but we can document it as a feature and leave it like that | 15:13 |
| dtantsur | "Cleaning works as cleaning for nodes not in maintenance, and just boots IPA and waits for nodes in maintenance" | 15:13 |
| jroll | I mean, I'm not trying to tell you you're wrong, I'm just saying that we originally did it this way for a reason, and we can either document it correctly or kill that use case :/ | 15:14 |
| dtantsur | that's the question :) wanna me to start a ML thread/bring it to the meeting? | 15:15 |
| *** narasimha_SV has quit IRC | 15:15 | |
| jroll | dtantsur: sure, if you like, I can dig up old conversation or whatever | 15:16 |
| *** rloo has quit IRC | 15:16 | |
| dtantsur | yes please | 15:16 |
| * jroll wishes eavesdrop.o.o was in elastic search with a retention time of forever | 15:17 | |
| sambetts | ++ | 15:17 |
| mgould | ++ | 15:18 |
| *** praneshp has joined #openstack-ironic | 15:23 | |
| TheJulia | ++ | 15:24 |
| *** lucas-afk is now known as lucasagomes | 15:24 | |
| *** sdake has joined #openstack-ironic | 15:24 | |
| dtantsur | jroll, I've send a email, and I think option #2 there actually satisfies both your and my requests. tl;dr we can fail cleaning on receiving the 1st heartbeat, but not power off the node. | 15:26 |
| jroll | dtantsur: https://review.openstack.org/#/c/167801/ and http://eavesdrop.openstack.org/irclogs/%23openstack-ironic/%23openstack-ironic.2015-03-26.log.html#t2015-03-26T11:48:14 | 15:26 |
| patchbot | patch 167801 - ironic - Agent driver: no-op heartbeat for maintenanced node (MERGED) | 15:26 |
| jroll | seems like the most interesting history | 15:26 |
| *** ifarkas is now known as ifarkas_afk | 15:27 | |
| jroll | dtantsur: interesting, will take a look shortly | 15:27 |
| jroll | dtantsur: it looks like this patch was possibly to solve a race when maintenance is set during agent boot for cleaning | 15:28 |
| jroll | s/possibly/partially | 15:28 |
| dtantsur | yeah, it's pretty clear, and it makes sense | 15:30 |
| *** rbartal has quit IRC | 15:31 | |
| dtantsur | except for it's not necessary a race: we perfectly allow cleaning in maintenance.. | 15:32 |
| *** jvgrant_ has quit IRC | 15:34 | |
| *** baoli_ has quit IRC | 15:34 | |
| *** rama_y has joined #openstack-ironic | 15:35 | |
| sambetts | dtantsur: is there a possible 1.5 there which bans the provision verbs from working in maintenance, and if a node is in maintenance doesn't start cleaning on delete? | 15:35 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic: [WIP] Abort cleaning and deployment if a node ends up in maintenance https://review.openstack.org/366828 | 15:35 |
| *** krtaylor has quit IRC | 15:35 | |
| dtantsur | jroll, here is how it would look like ^^^ | 15:35 |
| dtantsur | sambetts, I'm thinking about that too. | 15:35 |
| dtantsur | hmm, not I need to make sure it does not power off though | 15:36 |
| jroll | dtantsur: well, the race was that it would actually clean, which we definitely didn't want to do :P | 15:36 |
| dtantsur | heh | 15:36 |
| sambetts | dtantsur: so on delete if in maintenance, remove instance_info move to availiable or managable? and then leave the node alone | 15:37 |
| *** thrash|biab is now known as thrash | 15:37 | |
| *** hoonetorg has quit IRC | 15:38 | |
| dtantsur | sambetts, I was thinking active -> deleted -> cleanfail | 15:38 |
| *** Sukhdev has joined #openstack-ironic | 15:38 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic: [WIP] Abort cleaning and deployment if a node ends up in maintenance https://review.openstack.org/366828 | 15:38 |
| dtantsur | jroll, sambetts, now without power off ^^^ | 15:38 |
| openstackgerrit | Markos Chandras proposed openstack/bifrost: Fix unbound variable error in scripts/collect-test-info.sh https://review.openstack.org/366835 | 15:39 |
| * jroll in a meeting, this is way too fast for me to follow :P | 15:39 | |
| sambetts | dtantsur: I'm thinking if in maintenance active -> deleted -> managable else active -> deleted -> cleaning | 15:40 |
| JayF | dtantsur: ++ | 15:40 |
| dtantsur | heh sorry man, just wanted to put up the patches before I leave for a day | 15:40 |
| JayF | dtantsur: re: the state flow | 15:40 |
| JayF | dtantsur: Because we wanna explicitly indicate this node is "unclean" | 15:40 |
| dtantsur | sambetts, I don't want to pretend like we passed cleaning | 15:40 |
| dtantsur | JayF++ we still have tenant data and whatever | 15:41 |
| *** Romanenko_K has quit IRC | 15:41 | |
| JayF | exactly | 15:41 |
| *** chlong has quit IRC | 15:41 | |
| *** moshele has joined #openstack-ironic | 15:41 | |
| sambetts | dtantsur: I move to managable because you have to go through cleaning to get back to avaible and I wouldn't even start cleaning to prevent a node reboot | 15:41 |
| dtantsur | sambetts, we can't report success for something that failed.. | 15:42 |
| *** hoonetorg has joined #openstack-ironic | 15:42 | |
| *** praneshp has quit IRC | 15:43 | |
| dtantsur | *FAIL state will make it clear that something didn't work. also we don't have a transition CLEANWAIT -> MANAGEABLE, it will have to go trough something else anyway | 15:43 |
| JayF | cleanfail -> managable is a transition though | 15:44 |
| JayF | the state machine itself is sorta indicating what's the "right" next step | 15:44 |
| JayF | active -> deleted -> cleanfail -(by operator)-> managable | 15:44 |
| * jroll finds lunch quickly | 15:44 | |
| sambetts | (just play devils advacate here) In my case I wouldn't go cleanwait to manageable, I would just go DELETED -> MANAGEABLE, I wouldn't even try cleaning if I detected I was in maintenance | 15:45 |
| dtantsur | sambetts, this will give an admin a big WTF, I'm afraid :) | 15:45 |
| dtantsur | imagine, a user tears down an ACTIVE instance, and it silently goes to MANAGEABLE | 15:45 |
| *** MattMan has quit IRC | 15:46 | |
| *** rloo has joined #openstack-ironic | 15:46 | |
| sambetts | what happens in cases where cleaning is disabled? we just go straight to availiable and leave the node in maintenance? | 15:46 |
| *** MattMan has joined #openstack-ironic | 15:46 | |
| dtantsur | sambetts, when cleaning is disabled, tear down succeeds | 15:46 |
| dtantsur | so yes | 15:47 |
| JayF | available+maintenance would be what makes sense to me there too | 15:47 |
| *** joprovost1 has joined #openstack-ironic | 15:47 | |
| *** joprovost has quit IRC | 15:48 | |
| *** joprovost1 is now known as joprovost | 15:48 | |
| sambetts | ok, clean fail makes sense to me, are you going into clean fail based on a heartbeat or just adding it as a conditional in the statemachine transition? | 15:48 |
| JayF | you'd always have to do it on heartbeat, at least | 15:49 |
| JayF | to handle the maintenanced-while-cleaning-is-starting (or has started) case | 15:49 |
| sambetts | I would have something that simply does if event == CLEAN AND node.maintance: then CLEANFAIL | 15:49 |
| sambetts | JayF: oh right yeah | 15:49 |
| sambetts | hmm ' | 15:49 |
| JayF | you can shortcut it like that, which is fine too, but you'll have to get the heartbeat or else you get a race | 15:49 |
| dtantsur | +1 | 15:50 |
| *** rajinir has joined #openstack-ironic | 15:51 | |
| sambetts | I'd shortcut it before we power cycle the node, so in the case that the node is in maintenace before delete, then it wouldn't even get a chance to boot the ramdisk | 15:52 |
| *** praneshp has joined #openstack-ironic | 15:53 | |
| sambetts | if it goes into maintenance during the cleaning process then we need to catch the heartbeat and then move to cleanfailed at the end when we try to perform the power action or something right | 15:54 |
| *** moshele has quit IRC | 15:55 | |
| dtantsur | anyway, let's continue on the ML, I have to bail out already | 15:56 |
| sambetts | cool :) | 15:56 |
| dtantsur | I think jroll has a use case for actually trying cleaning, soooo... | 15:56 |
| sambetts | yeah that might be interesting | 15:57 |
| dtantsur | see you all tomorrow | 15:57 |
| *** dtantsur is now known as dtantsur|afk | 15:57 | |
| sambetts | cya later dtantsur|afk | 15:57 |
| *** praneshp has quit IRC | 15:57 | |
| *** pcaruana has quit IRC | 16:01 | |
| *** mgoddard_ has joined #openstack-ironic | 16:05 | |
| *** rama_y has quit IRC | 16:07 | |
| *** rama_y has joined #openstack-ironic | 16:07 | |
| *** mgoddard has quit IRC | 16:08 | |
| *** tesseract- has quit IRC | 16:09 | |
| *** rbrud has quit IRC | 16:10 | |
| *** rpioso has quit IRC | 16:15 | |
| *** wznoinsk has joined #openstack-ironic | 16:15 | |
| jroll | dtantsur|afk: no, again, I have a use case for *booting to an agent* and waiting | 16:19 |
| *** rpioso has joined #openstack-ironic | 16:19 | |
| *** mgoddard has joined #openstack-ironic | 16:21 | |
| JayF | jroll: honestly, isn't that something that my general long running ramdisk spec should cover? | 16:21 |
| JayF | jroll: we can still power on a machine if we want an agent booted on it | 16:21 |
| *** mgoddard_ has quit IRC | 16:21 | |
| jroll | JayF: sure, agree, how do you propose we do it in the meantime? | 16:21 |
| mgagne | so using haproxy, I see a lot of connection reset by the server (ironic-api). Lets say I don't run Mitaka, what can I do to improve my life? Could those errors be related to lack of workers in the API? Too many connections? | 16:22 |
| jroll | mgagne: I haven't personally seen that, but it does sound like not enough workers, any logs around it? | 16:22 |
| JayF | jroll: like I said ^ before, we have to catch the heartbeat and go to cleanfail. the question would be if we should preempt that by going straight to cleanfail on a delete-while-maint | 16:23 |
| mgagne | jroll: only logs I have is on the client side (nova) where the response is "empty", no HTTP status at all so it crashes with BadStatusLine exception | 16:23 |
| jroll | JayF: I'd think cleanfail would/should shutdown the node, but I haven't checked | 16:24 |
| *** praneshp has joined #openstack-ironic | 16:24 | |
| JayF | jroll: and I'm saying that's OK. For our downstream use case we can explicitly power on an agent if we wish | 16:24 |
| jroll | mgagne: no access to ironic-api logs I guess? I'd think there would be a traceback there | 16:24 |
| mgagne | jroll: nothing, even with DEBUG level | 16:24 |
| jroll | JayF: curious if other people use that | 16:24 |
| jroll | mgagne: :/ | 16:24 |
| jroll | mgagne: might be worth pummeling a dev server to see if that's what happened | 16:25 |
| mgagne | so it looks like something is dropped before logging happens, clearly between haproxy backend and ironic-api. trying to see if there is any knob I can tweak on the api side first | 16:25 |
| *** krtaylor has joined #openstack-ironic | 16:26 | |
| mgagne | jroll: issue is in prod. curl api manually and no issue of course =) | 16:27 |
| mgagne | jroll: could try to run mod_wsgi and see if it changes anything | 16:29 |
| jroll | mgagne: yeah, I mean spin up a dev server and see if you can hit it hard enough with concurrent requests to make it do the same | 16:29 |
| *** baoli has joined #openstack-ironic | 16:29 | |
| jroll | haproxy is just seeing a connection reset? just to be sure, there's nothing between haproxy and ironic-api? | 16:30 |
| mgagne | we are hitting ceilometer-api much harder without issue but it's running in mod_wsgi :P | 16:30 |
| jroll | right | 16:30 |
| jroll | wouldn't be surprised if apache hangs on to connections and waits, while wsgiref just drops them | 16:30 |
| mgagne | same L2 network | 16:30 |
| jroll | no firewall or anything though? | 16:30 |
| mgagne | no firewall, straight pipe | 16:30 |
| jroll | hrm | 16:31 |
| mgagne | I guess my only option is mod_wsgi for now | 16:31 |
| mgagne | or upgrade to ironic mitaka | 16:31 |
| *** jpich has quit IRC | 16:31 | |
| mgagne | so I can use api_workers | 16:31 |
| JayF | mgagne: we run a bunch of ironic behind haproxy, and I don't think I've *ever* seen a connection reset from ironic-api | 16:31 |
| JayF | mgagne: I'd be very, very suspicious of environmental things, especially if it's new | 16:31 |
| JayF | mgagne: like basic-linux-network-troubleshooting on the api nodes and haproxy | 16:32 |
| JayF | i.e. an iptables state table that's full or something | 16:32 |
| mgagne | JayF: lot of nodes? like, lets say, over 500? | 16:32 |
| JayF | would cause this | 16:32 |
| mgagne | we don't have iptables, we purge it | 16:32 |
| mgagne | oh | 16:32 |
| mgagne | hahaha | 16:32 |
| mgagne | TCP: TCP: Possible SYN flooding on port 6385. Sending cookies. Check SNMP counters. | 16:32 |
| jroll | o_o | 16:33 |
| JayF | mgagne: >1k nodes, with hundreds heartbeating simultaneously, backed by 6 ironic api nodes and a haproxy | 16:33 |
| JayF | mgagne: told you :D | 16:33 |
| JayF | \o/ | 16:33 |
| mgagne | but | 16:33 |
| mgagne | it's not every day in the logs | 16:33 |
| mgagne | we see connection drops every day/minutes | 16:33 |
| *** jaosorior has quit IRC | 16:33 | |
| mgagne | will check on that side first | 16:33 |
| JayF | ah | 16:34 |
| TheJulia | mgagne: I feel like I've seen that where haproxy is trying to keep a connection ready/open for requests | 16:34 |
| JayF | looks like you can get that message in some cases | 16:34 |
| JayF | when the backend isn't selecting packets off the interface fast enough | 16:34 |
| mgagne | will tweak tcp settings and see if it changes anything | 16:35 |
| mgagne | JayF: thanks for the hint ;) | 16:35 |
| jroll | can always just spin up more api hosts :) | 16:35 |
| jroll | mgagne: how many apis/nodes are you running? | 16:36 |
| mgagne | we have 2 already :O | 16:36 |
| mgagne | and as I said, we are hitting ceilometer-api MUCH harder | 16:36 |
| jroll | just curious | 16:36 |
| JayF | mgagne: we have *6* for ~1k servers | 16:36 |
| jroll | I think we run 6 in our larger environments? we also keep agents up heartbeating though | 16:36 |
| mgagne | but could also be that ironic driver in nova-compute hits ironic-api in parallel? | 16:36 |
| jroll | and may also be over-scaled | 16:36 |
| jroll | it does | 16:37 |
| JayF | yeah | 16:37 |
| jroll | er | 16:37 |
| jroll | it may* | 16:37 |
| jroll | there's multiple threads and such :) | 16:37 |
| mgagne | :D | 16:37 |
| *** praneshp_ has joined #openstack-ironic | 16:37 | |
| NobodyCam | Good Morning Ironic'ers :) | 16:38 |
| JayF | mgagne: have you checked your haproxy admin panel? anything interesting | 16:38 |
| mgagne | but could it be also caused by api not accepting the connection fast enough? | 16:38 |
| mgagne | JayF: yea, I'm in the stats panel, that's where I found the connection reset by server | 16:38 |
| jroll | ok this may sound crazy | 16:38 |
| mgagne | dug my way up from nova-compute.log | 16:38 |
| jroll | but is dns working well on your api hosts? | 16:38 |
| *** praneshp has quit IRC | 16:38 | |
| *** praneshp_ is now known as praneshp | 16:38 | |
| *** mbound has quit IRC | 16:39 | |
| mgagne | we have dnsmasq installed, dns works fine, I mean, I can resolve entries | 16:39 |
| JayF | mgagne: here's the haproxy config we're using, I doubt it's helpful but thought it'd at least give you a comparison point https://gist.github.com/jayofdoom/aea5c419b537441536101cd9d5917cc7 | 16:39 |
| jroll | mgagne: okay, if it's slow or being throttled or whatever it can cause problems | 16:40 |
| jroll | ... because wsgiref does an rDNS query for each request | 16:40 |
| TheJulia | ouch | 16:40 |
| mgagne | at this point, the problem would show on all services? or is it new in Liberty or deps in it? | 16:40 |
| jroll | no, it's part of wsgiref, which we've used since the beginning (but I think dropped in mitaka) | 16:41 |
| mgagne | I think we are reaching a limit somewhere, max session is 244 | 16:41 |
| jroll | which is stdlib | 16:41 |
| mgagne | looks similar to a kernel limit | 16:41 |
| TheJulia | mgould: did you check the open file limit? | 16:41 |
| jroll | TheJulia: you say ouch - don't ask me how I learned about this :) | 16:42 |
| JayF | I think jroll and I are less helpful, because when we saw this stuff blowing up in the inital onmetal deployment, our reaction was to spin up more apis, and now we're overscaled and never see these problems ;P | 16:42 |
| mgagne | JayF: hehe, don't mind the input. this might also be our solution =) | 16:42 |
| *** ChubYann has joined #openstack-ironic | 16:42 | |
| TheJulia | jroll: I'm not sure I want to know how :) | 16:42 |
| JayF | TheJulia: lets just say don't bite the hand that sits on the dns-rate-limiting lever | 16:43 |
| JayF | lol | 16:43 |
| jroll | heh | 16:43 |
| TheJulia | lol | 16:43 |
| openstackgerrit | Miles Gould proposed openstack/python-ironicclient: Document updating nested node attributes with CLI https://review.openstack.org/354742 | 16:43 |
| jroll | JayF: you know, this did present as abnormal levels of TCP RST | 16:43 |
| JayF | I honestly don't remember | 16:44 |
| JayF | I believe you though :) | 16:44 |
| JayF | I block out bad memories :P | 16:44 |
| jroll | then noticed tcp queues filled up | 16:44 |
| jroll | mgagne: another thing to check, I guess | 16:44 |
| mgagne | jroll: well now my keyboard stopped working on those nodes. time to blame network team | 16:44 |
| jroll | it's always the network \o/ | 16:45 |
| mgagne | :D | 16:45 |
| jroll | mgagne: maybe your tcp queues are so full ssh stopped working :P | 16:45 |
| mgagne | :D | 16:45 |
| mgagne | dropped load-balancer too and coworkers too | 16:45 |
| lucasagomes | calling it a day, have a great evening all! | 16:45 |
| JayF | all computer problems have two root causes: networking, dns, or off-by-one | 16:45 |
| *** lucasagomes is now known as lucas-dinner | 16:45 | |
| mgagne | anyway will tweak tcp settings and try mod_wsgi | 16:45 |
| TheJulia | lol | 16:45 |
| mgagne | can confirm :D | 16:46 |
| *** rbrud has joined #openstack-ironic | 16:46 | |
| *** praneshp has quit IRC | 16:48 | |
| *** rama_y has quit IRC | 16:48 | |
| jlvillal | JayF: :) | 16:49 |
| mgagne | ok, lot of connections in TIME_WAIT | 16:49 |
| jlvillal | JayF: And I was having networking problems yesterday while trying to setup port forwarding in anticipation of moving away from my expensive static IP internet service to much more reasonably priced DHCP internet service. | 16:50 |
| *** trown is now known as trown|lunch | 16:50 | |
| *** jvgrant_ has joined #openstack-ironic | 16:50 | |
| TheJulia | mgagne: between what parts? | 16:52 |
| mgagne | on ironic-api when nova-compute triggers power sync periodic tasks | 16:52 |
| mgagne | we have over 600 nodes and I see a max session of ~240. So I think some are getting dropped. maybe time to add api workers | 16:53 |
| mgagne | ok so will add new api workers | 16:54 |
| *** xavierr_afk is now known as xavierr | 16:54 | |
| mgagne | throwing resources at the problem :D | 16:54 |
| *** rbudden has quit IRC | 16:58 | |
| TheJulia | mgagne: I'm fairly sure you can turn down the time that the kernel waits to close the socket out in TIME_WAIT state. I had a database years ago that would end up running out of open connections because it didn't close it's self out so things were held open until the socket was fully closed out. | 16:59 |
| mgagne | yea at this point, I don't think that's a real issue. TIME_WAIT closes in less than ~2s | 17:00 |
| *** anush has quit IRC | 17:00 | |
| TheJulia | Ahhh | 17:00 |
| mgagne | asked someone to spawn more api =) | 17:00 |
| TheJulia | yeah, I was seeing the full socket timeout occur :( | 17:00 |
| *** Sukhdev has quit IRC | 17:01 | |
| TheJulia | which, is far more than 2 seconds | 17:01 |
| *** watanabe_isao has joined #openstack-ironic | 17:01 | |
| JayF | man I've troubleshooted some crazy bugs before | 17:02 |
| JayF | one bug, IPVS working badly with iptables on the same IPs, you'd have iptables block incoming FIN | 17:02 |
| JayF | this was IMAP, so if you did a server quit, we sent the FIN and it worked no problem | 17:02 |
| JayF | but if you had a connection drop unexpectedly, the FIN would be blocked by iptables and the connection would hold open through the ESTABLISHED timeout, which is ~5 days by default in linux | 17:03 |
| mgagne | ok, "fixed" the issue. I limited the backend connection to 200 instead of 8000 | 17:05 |
| mgagne | only got 1 error instead of hundreds | 17:05 |
| *** derekh is now known as derekh_ark | 17:05 | |
| *** derekh_ark is now known as derekh_afk | 17:05 | |
| *** fragatina has joined #openstack-ironic | 17:08 | |
| krtaylor | jlvillal, ironic-qa meeting? | 17:08 |
| TheJulia | mgould: artificial throttling I guess :) | 17:08 |
| krtaylor | jlvillal, just curious, not that I had anything | 17:09 |
| openstackgerrit | Julia Kreger proposed openstack/ironic: Add volume_connectors and volume_targets to task https://review.openstack.org/366196 | 17:10 |
| *** jcoufal has quit IRC | 17:13 | |
| watanabe_isao | krtaylor, good morning. About the qa meeting, I have one question to ask. If the meeting is not held today I would like to ask it here. | 17:13 |
| *** e0ne has quit IRC | 17:14 | |
| *** Sukhdev has joined #openstack-ironic | 17:14 | |
| Sukhdev | jroll: Ping | 17:14 |
| *** links has joined #openstack-ironic | 17:15 | |
| mjturek | watanabe_isao: yep looks like it's not happening | 17:15 |
| *** krtaylor has quit IRC | 17:16 | |
| *** krtaylor has joined #openstack-ironic | 17:16 | |
| watanabe_isao | I | 17:17 |
| rloo | krtaylor, mjturek, watanabe_isao: John sent out email this morning, cancelling the qa meeting | 17:17 |
| krtaylor | rloo, thanks, just checking that... | 17:17 |
| krtaylor | watanabe_isao, ask away | 17:18 |
| mjturek | rloo: whoops! I see it now :) thanks | 17:18 |
| watanabe_isao | krtaylor, yes sir. It is about your spec of 3rd party ci <https://specs.openstack.org/openstack/ironic-specs/specs/not-implemented/third-party-ci.html#problem-description> | 17:19 |
| watanabe_isao | I think for us, 3rd party mentioners, we need to return the test result within 8 hours, since the patch set has been sent, is it right? | 17:20 |
| krtaylor | watanabe_isao, initially (Newton) yes | 17:21 |
| krtaylor | watanabe_isao, the goal is to get to 4hrs | 17:21 |
| krtaylor | but we'll have a chance to revisit that requirement at summit | 17:22 |
| krtaylor | watanabe_isao, is that doable for your test sytem? | 17:22 |
| krtaylor | system | 17:22 |
| watanabe_isao | krtaylor, yes. I just want to know, how can we self check we are returning all the tests within that time. | 17:24 |
| krtaylor | ah, sure, just look at the patch set submission time and compare it with when you post results | 17:25 |
| krtaylor | we haven't implemented any kind of strict time interval check | 17:25 |
| krtaylor | it is just so that a developer can expect results from all the test systems in a reasonable amount of time | 17:26 |
| watanabe_isao | krtaylor, I mean do we have a tool like ci-watch, that can automatically check all the tests? | 17:26 |
| openstackgerrit | Julia Kreger proposed openstack/ironic: [WIP] Add storage_interface DB field and object https://review.openstack.org/348005 | 17:27 |
| krtaylor | watanabe_isao, I dont believe that is an option in ci-watch, but it sounds like a good enhancement :) | 17:27 |
| krtaylor | mmedvede, ^^^ | 17:27 |
| mmedvede | did not have much time to work on ci-watch lately :( | 17:28 |
| mmedvede | krtaylor: what is the enhancement, in a couple of words? | 17:28 |
| *** links has quit IRC | 17:29 | |
| krtaylor | mmedvede, to check time it took for a system to return results on a patchset | 17:29 |
| watanabe_isao | krtaylor, so does it mean, currently we ask 3rd party CIs return their result within 8(4) hours. But wo can only take a random sampling to check for that? | 17:29 |
| krtaylor | watanabe_isao, all of these requirements are not strictly policed, by any project that I know of | 17:31 |
| krtaylor | watanabe_isao, if a system was reporting late over a period of weeks, then some action might be taken, but that's not really my call to make | 17:32 |
| krtaylor | watanabe_isao, I think it would be something that was looked at only if the system was causing some other kind of issue, reporting incorrectly, etc | 17:33 |
| krtaylor | there may be people that watch that info very closely, but not me :) | 17:34 |
| watanabe_isao | krtaylor, I see. I just noticed that jroll has mailed to warn some drivers which do not have a CI with it. And our CI currently has a performance issue with it, and is stopped. I just want to make sure that our CI will not in the next list.:) | 17:35 |
| openstackgerrit | Julia Kreger proposed openstack/ironic: [WIP] Add storage_interface to base driver class https://review.openstack.org/348006 | 17:35 |
| *** Sukhdev has quit IRC | 17:36 | |
| watanabe_isao | krtaylor, do you know who may be the time keeper, please? | 17:38 |
| *** jvgrant_ has quit IRC | 17:38 | |
| *** jvgrant_ has joined #openstack-ironic | 17:39 | |
| krtaylor | watanabe_isao, you can ask jroll, but I don't think we are watching that (time) too closely right now | 17:39 |
| watanabe_isao | krtaylor, I got it. Thanks very much. | 17:40 |
| *** Sukhdev has joined #openstack-ironic | 17:41 | |
| watanabe_isao | jroll, sir, may I have your one minute, please? | 17:41 |
| jroll | Sukhdev: hey, what's up? | 17:41 |
| jroll | watanabe_isao: one moment, reading back | 17:42 |
| jroll | watanabe_isao: ok, what's your question? who is watching the time? | 17:42 |
| Sukhdev | jroll : QQ - the work that we are doing for ironic-neutron, should it not qualify for ATC code for Summit? | 17:42 |
| watanabe_isao | jroll, yes. | 17:43 |
| jroll | Sukhdev: depends what "we" means - typically, code commits are what qualify | 17:43 |
| rajinir | https://www.irccloud.com/pastebin/fM64KYd0/cleaning | 17:44 |
| *** jvgrant_ has quit IRC | 17:44 | |
| jroll | watanabe_isao: it won't be super strict, more about if we notice a CI system is consistently slower than the goal | 17:44 |
| rajinir | Shouldn't there be default cleaning steps? Any pointers? | 17:44 |
| mgagne | ok so issue is still present. we bypassed the load-balancer to make sure it wasn't the problem. :-/ | 17:45 |
| watanabe_isao | jroll, sir. Do we have any tool or something to confirm that (consistently slower than the goal)? I want to use it for a self check. | 17:46 |
| TheJulia | rajinir: Curious, it depends on how the node has reached cleaning | 17:46 |
| *** harlowja has quit IRC | 17:46 | |
| rajinir | TheJulia: Its CI, part of tempest | 17:46 |
| rajinir | test | 17:46 |
| *** causten has joined #openstack-ironic | 17:46 | |
| jroll | watanabe_isao: I'm not aware of any toold to make that easy, sorry | 17:47 |
| TheJulia | rajinir: got a link to a CI test failure where we can see this? | 17:47 |
| rajinir | TheJulia: https://stash.opencrowbar.org/logs/61/364861/3/check/dell-hw-tempest-dsvm-ironic-pxe_drac/1c2339b/ | 17:48 |
| *** sahil has joined #openstack-ironic | 17:48 | |
| sahil | Hello | 17:48 |
| *** harlowja has joined #openstack-ironic | 17:49 | |
| watanabe_isao | jroll, I see. One last question, please. More like a require. | 17:50 |
| jroll | watanabe_isao: no need to ask to ask, just ask :) | 17:51 |
| TheJulia | rajinir: that link just hangs for me right now :\ | 17:51 |
| *** jralph has quit IRC | 17:51 | |
| rajinir | Thejulia: hmm. I can see clean_steps are missing | 17:52 |
| *** mbound has joined #openstack-ironic | 17:52 | |
| TheJulia | hello sahil, sorry I didn't reply again last night. For some reason I didn't get any notifications | 17:52 |
| rajinir | TheJulia: Is there a way to set? | 17:52 |
| *** fragatina has quit IRC | 17:52 | |
| sahil | hi | 17:52 |
| sahil | I wanted to talk to someone from yesterday | 17:52 |
| *** fragatina has joined #openstack-ironic | 17:53 | |
| jroll | hi sahil | 17:53 |
| sahil | HI TheJulia | 17:53 |
| sahil | Hi Jroll | 17:53 |
| TheJulia | rajinir: they should be created as part of a node going into cleaning from being deleted if memory serves. There is no way to set that field afaik, nor should it be since it is for the driver's use | 17:53 |
| sahil | so it may be a small issue | 17:53 |
| sahil | but I guess I need help | 17:53 |
| rajinir | TheJulia: Probably the node didn't crated properly | 17:53 |
| sahil | so with the help of some others here I was able to setup devstack with ironic that can talk to a baremetal node | 17:54 |
| sahil | on a fixed vlan | 17:54 |
| sahil | for that i had to configure a ovs bridge and add the interface that was connected to that vlan | 17:54 |
| *** hoangcx has quit IRC | 17:54 | |
| TheJulia | rajinir: more likely there is some issue along the way :\ | 17:54 |
| sahil | the issue with the gateway | 17:54 |
| sahil | before running stack.sh | 17:55 |
| rajinir | TheJulia: ok | 17:55 |
| sahil | I could ping the node from my devstack vm | 17:55 |
| TheJulia | rajinir: By the way, the server finally replied indicating that permission to access is denied | 17:55 |
| sahil | after stacking I could no | 17:55 |
| sahil | not* | 17:55 |
| sahil | as a consequence, when I try to provision a node it boots but hangs at dhcp | 17:55 |
| *** sambetts is now known as sambetts|afk | 17:55 | |
| sahil | as it does not get any info from ironic/neutron | 17:55 |
| watanabe_isao | jroll, Our CI (irmc CI) has a performance issue right now, our test is a little bit slow. We are stopping the CI and improving it. I noticed your mail of warning non-CI drivers. If their is any schedule about the next check, I would like to know, and will do our best to recover our CI before that time. | 17:56 |
| sahil | I checked the qrouter-<id> namespace | 17:56 |
| *** trown|lunch is now known as trown | 17:56 | |
| sahil | and found that the gateway IP address that I had passed in local.conf was configured as an interface on the qrouter-xx | 17:57 |
| sahil | that messed up things | 17:57 |
| *** hoangcx has joined #openstack-ironic | 17:57 | |
| sahil | so I need help to fix my devstack | 17:57 |
| jroll | watanabe_isao: I'm planning to do a run through today and see what's going on, and mark some drivers untested - I will keep your comment in mind and leave irmc marked supported | 17:57 |
| sahil | such that it can talk to baremetal node can recieve dhcp response from dhcp server running under neutron | 17:57 |
| sahil | I am done taling | 17:58 |
| sahil | talking | 17:58 |
| sahil | waiting for response/suggestions | 17:58 |
| watanabe_isao | jroll, thank you very much. I will go back to my work, and return irmc CI ASAP. | 17:59 |
| *** Sukhdev has quit IRC | 17:59 | |
| openstackgerrit | Pavlo Shchelokovskyy proposed openstack/ironic: Allow using TempURLs for deploy images https://review.openstack.org/344160 | 17:59 |
| mgould | sahil: so the gateway was added to the wrong namespace? | 18:00 |
| sahil | I guess so yes | 18:00 |
| sahil | in the qrouter namespace | 18:00 |
| sahil | as an interface | 18:00 |
| sahil | I suppose that should not be the case as the gateway IP is actually of the bridge on the host | 18:01 |
| sahil | that makes it possible for the DEVSTACK VM to talk to the baremetal node | 18:01 |
| mgould | how did you specify it in local.conf | 18:01 |
| mgould | ? | 18:01 |
| TheJulia | sahil: can you share your local.conf file? | 18:01 |
| sahil | new to irc | 18:01 |
| sahil | how do I share the file | 18:01 |
| TheJulia | sahil: Use http://paste.openstack.org/ | 18:01 |
| mgould | sahil: http://paste.openstack.org | 18:01 |
| sahil | got it | 18:01 |
| TheJulia | make sure nothing sensitive to your environment is present, and then share the link once posted. :) | 18:02 |
| rajinir | Thejulia: Working with the IT folks to get the log link working back again :( | 18:02 |
| jroll | watanabe_isao: you're welcome, thanks for the chat | 18:02 |
| *** jvgrant_ has joined #openstack-ironic | 18:02 | |
| TheJulia | rajinir: It happens :) | 18:03 |
| sahil | here it is | 18:03 |
| *** fragatina has quit IRC | 18:03 | |
| sahil | http://paste.openstack.org/show/567586/ | 18:03 |
| *** fragatina has joined #openstack-ironic | 18:04 | |
| TheJulia | rajinir: so clean_steps should be getting created upon the agent heartbeating https://github.com/openstack/ironic/blob/master/ironic/drivers/modules/agent_base_vendor.py#L443 lines 493-502 would be pertinent | 18:08 |
| *** rbudden has joined #openstack-ironic | 18:08 | |
| rajinir | TheJulia: The node doesn't have clean_step config set | 18:09 |
| *** jcoufal has joined #openstack-ironic | 18:10 | |
| *** jvgrant_ has quit IRC | 18:11 | |
| TheJulia | rajinir: So I think that would be the first entry into cleaning then... Are you building an IPA image? | 18:13 |
| sahil | any ideas TheJulia | 18:15 |
| TheJulia | sahil: pondering | 18:16 |
| *** watanabe_isao has quit IRC | 18:16 | |
| *** jvgrant_ has joined #openstack-ironic | 18:18 | |
| mgould | sahil: no idea, sorry | 18:19 |
| * mgould -> home; good night everyone! | 18:19 | |
| sahil | hmm, ok thanks for the time | 18:19 |
| *** e0ne has joined #openstack-ironic | 18:19 | |
| *** mgould is now known as mgould|afk | 18:19 | |
| TheJulia | sahil: so you have PHYSICAL_NETWORK set to "private", is that the actual label in ovs? | 18:22 |
| sahil | yup | 18:22 |
| sahil | this is the exact local.conf I am using | 18:22 |
| sahil | it creates private network attaches subnet with network range reserved for my vlan | 18:23 |
| *** hoangcx has quit IRC | 18:24 | |
| sahil | wait, what do you mean "label in ovs" | 18:24 |
| sahil | it makes a network with name "private" | 18:24 |
| sahil | I am guessing for flat network I do not need a router | 18:25 |
| sahil | what happens if I set Q_USE_PROVIDER_NETWORKING=True to 'false' instead | 18:26 |
| TheJulia | sahil: I honestly don't know neutorn well enough to say, but we don't indicate use of that in the developer quickstart documentation | 18:30 |
| TheJulia | sahil: I was trying to piece together context with the question while I skimmed through the ironic devstack plugin. With your config, everything is expecting things to be hooked in advance to your OVS_PHYSICAL_BRIDGE. The only thing neutron really should end up doing then is updating the configuration dnsmasq has, so it does seem like somehow extra | 18:32 |
| TheJulia | configuration is taking place | 18:32 |
| sahil | I did create that br-ironic bridge and added the interface to it before stacking | 18:32 |
| sahil | so you think I should comment out certain directives | 18:33 |
| TheJulia | likely, neutron related ones we don't explicitly indicate would be a good start :) | 18:39 |
| *** mkam has quit IRC | 18:39 | |
| *** goneri_ has joined #openstack-ironic | 18:39 | |
| *** goneri_ has quit IRC | 18:41 | |
| *** jcoufal_ has joined #openstack-ironic | 18:44 | |
| *** jcoufal has quit IRC | 18:45 | |
| *** wajdi_ has joined #openstack-ironic | 18:47 | |
| *** joprovost has quit IRC | 18:47 | |
| *** mkam has joined #openstack-ironic | 18:48 | |
| *** wajdi__ has joined #openstack-ironic | 18:49 | |
| *** joprovost has joined #openstack-ironic | 18:50 | |
| *** wajdi has quit IRC | 18:50 | |
| *** wajdi_ has quit IRC | 18:51 | |
| *** jvgrant_ has quit IRC | 18:53 | |
| *** causten has quit IRC | 18:54 | |
| *** jvgrant_ has joined #openstack-ironic | 18:54 | |
| *** hoangcx has joined #openstack-ironic | 18:55 | |
| *** athomas has quit IRC | 18:56 | |
| *** sukhdev has joined #openstack-ironic | 18:57 | |
| *** jvgrant_ has quit IRC | 18:58 | |
| *** causten has joined #openstack-ironic | 18:59 | |
| *** sahil has quit IRC | 19:01 | |
| *** sdake has quit IRC | 19:02 | |
| *** mkam has quit IRC | 19:04 | |
| openstackgerrit | Mathieu Mitchell proposed openstack/ironic: Add a basic install guide https://review.openstack.org/363294 | 19:06 |
| openstackgerrit | Mathieu Mitchell proposed openstack/ironic: Import Bare Metal service overview into install-guide https://review.openstack.org/366329 | 19:06 |
| *** clenimar has quit IRC | 19:10 | |
| *** sdake has joined #openstack-ironic | 19:10 | |
| *** joprovost has quit IRC | 19:11 | |
| *** narasimha_SV has joined #openstack-ironic | 19:12 | |
| narasimha_SV | nova boot --flavor ironic-test-3 --image test-image instance-1 | 19:12 |
| narasimha_SV | this will be the command for provisioning an ironic node right | 19:13 |
| narasimha_SV | so how it takes IP from this ? | 19:13 |
| *** derekh_afk is now known as derekh | 19:13 | |
| narasimha_SV | can anyone please explain ? | 19:13 |
| narasimha_SV | I am confised at this point | 19:13 |
| narasimha_SV | *confused | 19:13 |
| *** lucas-dinner has quit IRC | 19:13 | |
| mat128 | nova will take an IP from the network you have in your tenant | 19:15 |
| mat128 | note that this command wont work if you have multiple networks | 19:15 |
| *** lucasagomes has joined #openstack-ironic | 19:15 | |
| *** causten has quit IRC | 19:16 | |
| *** mkam has joined #openstack-ironic | 19:17 | |
| *** Sukhdev_ has joined #openstack-ironic | 19:17 | |
| *** fragatin_ has joined #openstack-ironic | 19:17 | |
| *** mkam has joined #openstack-ironic | 19:17 | |
| *** causten_ has joined #openstack-ironic | 19:19 | |
| *** fragatina has quit IRC | 19:21 | |
| *** rcernin has quit IRC | 19:21 | |
| *** jvgrant_ has joined #openstack-ironic | 19:22 | |
| *** joprovost has joined #openstack-ironic | 19:28 | |
| *** jvgrant has quit IRC | 19:29 | |
| *** causten_ has quit IRC | 19:31 | |
| *** causten has joined #openstack-ironic | 19:31 | |
| *** moshele has joined #openstack-ironic | 19:37 | |
| *** jjohnson2 has quit IRC | 19:41 | |
| *** hoangcx has quit IRC | 19:43 | |
| *** rama_y has joined #openstack-ironic | 19:43 | |
| *** wajdi__ has quit IRC | 19:48 | |
| *** fragatin_ has quit IRC | 19:53 | |
| *** fragatina has joined #openstack-ironic | 19:54 | |
| *** wajdi_ has joined #openstack-ironic | 19:56 | |
| *** wajdi__ has joined #openstack-ironic | 19:57 | |
| *** wajdi_ has quit IRC | 19:57 | |
| openstackgerrit | Vasyl Saienko proposed openstack/ironic: DO NOT REVIEW https://review.openstack.org/296432 | 19:57 |
| *** wajdi_ has joined #openstack-ironic | 19:58 | |
| *** joprovost has quit IRC | 19:58 | |
| * rloo loves the DoNotReview patches | 19:58 | |
| *** wajdi__ has quit IRC | 20:01 | |
| *** dprince has quit IRC | 20:01 | |
| *** rama_y has quit IRC | 20:02 | |
| *** causten has quit IRC | 20:04 | |
| *** sahil has joined #openstack-ironic | 20:04 | |
| *** openstackgerrit has quit IRC | 20:04 | |
| *** sabeen has quit IRC | 20:04 | |
| *** mbound has quit IRC | 20:04 | |
| *** openstackgerrit has joined #openstack-ironic | 20:04 | |
| *** causten has joined #openstack-ironic | 20:06 | |
| *** e0ne has quit IRC | 20:22 | |
| *** moshele has quit IRC | 20:23 | |
| *** anush has joined #openstack-ironic | 20:25 | |
| *** narasimha_SV has quit IRC | 20:25 | |
| *** derekh has quit IRC | 20:25 | |
| *** Goneri has quit IRC | 20:30 | |
| JayF | jroll: how about: good new contributor documentation | 20:31 |
| JayF | jroll: I think we need some of that | 20:31 |
| JayF | lol | 20:31 |
| jroll | JayF: heh, I've never seen a new contributor doc that couldn't be improved :) | 20:32 |
| *** rama_y has joined #openstack-ironic | 20:32 | |
| jroll | running to the store, back later | 20:32 |
| jlvillal | krtaylor: Sorry. I sent out an email about no QA meeting. Plus I had a meeting conflict :( | 20:33 |
| krtaylor | jlvillal, no worries, my bad for not checking email first | 20:35 |
| *** jabroney has joined #openstack-ironic | 20:36 | |
| openstackgerrit | Gabriel Bezerra proposed openstack/python-oneviewclient: Add auditing instrumentation for python-oneviewclient https://review.openstack.org/337281 | 20:39 |
| *** snizar has joined #openstack-ironic | 20:41 | |
| *** snizar_ has joined #openstack-ironic | 20:41 | |
| *** michauds has quit IRC | 20:43 | |
| *** wajdi_ has quit IRC | 20:45 | |
| *** wajdi has joined #openstack-ironic | 20:45 | |
| *** jcoufal_ has quit IRC | 20:48 | |
| *** vishwana_ has joined #openstack-ironic | 20:51 | |
| *** vishwanathj has quit IRC | 20:52 | |
| *** jcoufal has joined #openstack-ironic | 20:54 | |
| *** sahil has quit IRC | 20:54 | |
| *** jvgrant_ has quit IRC | 20:55 | |
| *** jvgrant has joined #openstack-ironic | 20:55 | |
| *** sabeen has joined #openstack-ironic | 20:56 | |
| *** trown is now known as trown|outtypewww | 20:57 | |
| rloo | jlvillal: before i forget (again), what was your question about https://review.openstack.org/#/c/364440/ | 20:57 |
| patchbot | patch 364440 - python-ironicclient - osc node power on & off commands | 20:57 |
| jlvillal | rloo: Oh. Let me get back to you. Kind of in the middle of something. | 20:57 |
| *** mkam has quit IRC | 20:57 | |
| jlvillal | rloo: Thanks for following up! | 20:57 |
| rloo | jlvillal: sure. no worries. | 20:57 |
| *** jvgrant has quit IRC | 21:00 | |
| openstackgerrit | Jay Faulkner proposed openstack/ironic: Add metrics to administrator guide https://review.openstack.org/356811 | 21:01 |
| *** sukhdev has quit IRC | 21:04 | |
| *** mbound has joined #openstack-ironic | 21:05 | |
| openstackgerrit | Doug Hellmann proposed openstack/python-ironicclient: standardize release note page names and ordering https://review.openstack.org/366980 | 21:06 |
| openstackgerrit | Julia Kreger proposed openstack/ironic: Add volume_connectors and volume_targets to task https://review.openstack.org/366196 | 21:06 |
| openstackgerrit | Julia Kreger proposed openstack/ironic: [WIP] Add storage_interface DB field and object https://review.openstack.org/348005 | 21:07 |
| openstackgerrit | Julia Kreger proposed openstack/ironic: [WIP] Add storage_interface to base driver class https://review.openstack.org/348006 | 21:07 |
| openstackgerrit | Julia Kreger proposed openstack/ironic: [WIP] Add base cinder common interface https://review.openstack.org/355625 | 21:07 |
| openstackgerrit | Julia Kreger proposed openstack/ironic: [WIP] Add Cinder storage driver https://review.openstack.org/366197 | 21:08 |
| *** mbound has quit IRC | 21:10 | |
| openstackgerrit | Merged openstack/python-oneviewclient: Add auditing instrumentation for python-oneviewclient https://review.openstack.org/337281 | 21:10 |
| *** krtaylor has quit IRC | 21:11 | |
| *** mmedvede has quit IRC | 21:15 | |
| *** mkam has joined #openstack-ironic | 21:17 | |
| openstackgerrit | Merged openstack/python-oneviewclient: Remove discover from test-requirements https://review.openstack.org/345773 | 21:25 |
| *** jheroux has quit IRC | 21:27 | |
| *** mkam has quit IRC | 21:27 | |
| *** jvgrant has joined #openstack-ironic | 21:35 | |
| *** mkam has joined #openstack-ironic | 21:40 | |
| *** mmedvede has joined #openstack-ironic | 21:41 | |
| *** snizar_ has quit IRC | 21:45 | |
| *** snizar has quit IRC | 21:45 | |
| *** jmccrory has quit IRC | 21:53 | |
| *** jmccrory has joined #openstack-ironic | 21:53 | |
| *** krtaylor has joined #openstack-ironic | 21:53 | |
| *** causten has quit IRC | 21:54 | |
| *** jmccrory has quit IRC | 21:55 | |
| *** jmccrory has joined #openstack-ironic | 21:55 | |
| *** jmccrory has quit IRC | 21:57 | |
| *** causten has joined #openstack-ironic | 21:57 | |
| *** jmccrory has joined #openstack-ironic | 21:57 | |
| mrda | Morning Ironic | 22:02 |
| *** mkam has quit IRC | 22:02 | |
| *** rama_y has quit IRC | 22:04 | |
| *** Goneri has joined #openstack-ironic | 22:05 | |
| *** jvgrant has quit IRC | 22:07 | |
| *** jvgrant has joined #openstack-ironic | 22:07 | |
| *** bfournie has quit IRC | 22:08 | |
| *** rama_y has joined #openstack-ironic | 22:10 | |
| *** jvgrant has quit IRC | 22:10 | |
| *** chlong has joined #openstack-ironic | 22:12 | |
| *** snizar has joined #openstack-ironic | 22:13 | |
| *** snizar_ has joined #openstack-ironic | 22:13 | |
| *** cdearborn has quit IRC | 22:16 | |
| *** jvgrant has joined #openstack-ironic | 22:17 | |
| openstackgerrit | Ruby Loo proposed openstack/python-ironicclient: Adds --chassis-uuid to osc 'baremetal node set' https://review.openstack.org/363999 | 22:17 |
| *** baoli_ has joined #openstack-ironic | 22:17 | |
| *** baoli has quit IRC | 22:18 | |
| *** jvgrant has quit IRC | 22:19 | |
| *** jralph has joined #openstack-ironic | 22:21 | |
| *** rama_y has quit IRC | 22:22 | |
| *** sdake has quit IRC | 22:24 | |
| *** rloo has quit IRC | 22:26 | |
| *** rloo has joined #openstack-ironic | 22:27 | |
| *** rbudden has quit IRC | 22:28 | |
| *** jvgrant has joined #openstack-ironic | 22:32 | |
| *** rbrud has quit IRC | 22:32 | |
| *** fragatin_ has joined #openstack-ironic | 22:34 | |
| *** jvgrant has quit IRC | 22:36 | |
| *** fragatina has quit IRC | 22:37 | |
| *** rpioso has quit IRC | 22:46 | |
| openstackgerrit | Merged openstack/ironic-inspector: TrivialFix: Remove cfg import unused https://review.openstack.org/365902 | 22:50 |
| *** baoli_ has quit IRC | 22:54 | |
| *** fragatin_ has quit IRC | 22:57 | |
| *** harlowja has quit IRC | 23:03 | |
| *** Goneri has quit IRC | 23:09 | |
| *** rajinir has quit IRC | 23:15 | |
| *** wajdi_ has joined #openstack-ironic | 23:19 | |
| *** sabeen has quit IRC | 23:19 | |
| *** wajdi has quit IRC | 23:22 | |
| *** jabroney1 has joined #openstack-ironic | 23:24 | |
| NobodyCam | morning mrda | 23:25 |
| *** anush has quit IRC | 23:26 | |
| *** wajdi_ has quit IRC | 23:26 | |
| *** jabroney has quit IRC | 23:26 | |
| *** rbudden has joined #openstack-ironic | 23:28 | |
| mrda | hey NobodyCam | 23:29 |
| NobodyCam | :) | 23:29 |
| *** leitan has quit IRC | 23:39 | |
| *** rloo has quit IRC | 23:39 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
