| *** rh-jelabarre has quit IRC | 00:07 | |
| *** rh-jelabarre has joined #openstack-ironic | 00:08 | |
| *** rh-jelabarre has quit IRC | 00:12 | |
| *** ijw has joined #openstack-ironic | 00:16 | |
| *** dsneddon has joined #openstack-ironic | 00:19 | |
| w14161_1 | TheJulia, thanks. | 00:24 |
|---|---|---|
| TheJulia | w14161_1: Hopefully that quickly addresses confusion, but I a curious what sort of issue you encountered that your digging into ironic lib :) | 00:28 |
| TheJulia | w14161_1: let us know if you need any help or if you find a bug | 00:28 |
| *** livelace has joined #openstack-ironic | 00:38 | |
| *** livelace has quit IRC | 00:46 | |
| openstackgerrit | Merged openstack/sushy master: Add Chassis<->ComputerSystem/Manager linkage https://review.openstack.org/623028 | 01:08 |
| openstackgerrit | Merged openstack/sushy master: Update the docstring of `sub_processors()` https://review.openstack.org/631495 | 01:08 |
| *** rh-jelabarre has joined #openstack-ironic | 02:08 | |
| *** tiendc has joined #openstack-ironic | 02:36 | |
| *** ijw has quit IRC | 02:57 | |
| *** trungnv has joined #openstack-ironic | 03:02 | |
| *** Bhujay has joined #openstack-ironic | 03:30 | |
| *** Bhujay has quit IRC | 03:35 | |
| *** bfournie has joined #openstack-ironic | 03:54 | |
| *** dnuka has joined #openstack-ironic | 04:41 | |
| dnuka | good morning o/ | 04:42 |
| *** Bhujay has joined #openstack-ironic | 04:43 | |
| *** ijw has joined #openstack-ironic | 04:45 | |
| *** tendulke has joined #openstack-ironic | 05:03 | |
| *** rh-jelabarre has quit IRC | 05:04 | |
| *** ijw has quit IRC | 05:12 | |
| *** tendulke has quit IRC | 06:36 | |
| *** ijw has joined #openstack-ironic | 06:37 | |
| *** jiapei has quit IRC | 06:42 | |
| *** johnsom has quit IRC | 06:42 | |
| *** ijw has quit IRC | 06:42 | |
| *** johnsom has joined #openstack-ironic | 06:42 | |
| *** jiapei has joined #openstack-ironic | 06:43 | |
| *** jtomasek has joined #openstack-ironic | 06:48 | |
| *** ijw has joined #openstack-ironic | 06:58 | |
| *** rcernin has quit IRC | 07:00 | |
| *** ijw has quit IRC | 07:03 | |
| *** arne_wiebalck has joined #openstack-ironic | 07:24 | |
| arne_wiebalck | Good morning, Ironic. | 07:25 |
| dnuka | good morning arne_wiebalck :) | 07:26 |
| arne_wiebalck | Good morning dnuka ! | 07:26 |
| *** dnuka is now known as dnuka|brb | 07:29 | |
| openstackgerrit | paresh sao proposed openstack/ironic-specs master: OOB disk-erase for ilo5 based HPE Proliant Servers https://review.openstack.org/631181 | 07:35 |
| *** YaWang has joined #openstack-ironic | 07:46 | |
| *** YaWang has quit IRC | 07:47 | |
| openstackgerrit | paresh sao proposed openstack/ironic-specs master: OOB disk-erase for ilo5 based HPE Proliant Servers https://review.openstack.org/631181 | 07:48 |
| *** YaWang has joined #openstack-ironic | 07:50 | |
| *** rpittau has joined #openstack-ironic | 07:54 | |
| rpittau | good morning ironic! o/ | 07:55 |
| openstackgerrit | Hamdy Khader proposed openstack/python-ironicclient master: Add is-smartnic port attribute to port command https://review.openstack.org/629449 | 07:57 |
| *** dnuka|brb is now known as dnuka | 07:57 | |
| dnuka | good morning rpittau :) | 07:57 |
| rpittau | hey dnuka :) | 07:59 |
| arne_wiebalck | good morning rpittau | 07:59 |
| rpittau | hi arne_wiebalck :) | 07:59 |
| *** dsneddon has quit IRC | 08:01 | |
| *** e0ne has joined #openstack-ironic | 08:02 | |
| *** dsneddon has joined #openstack-ironic | 08:02 | |
| *** Bhujay has quit IRC | 08:09 | |
| *** dnuka is now known as dnuka|brb | 08:10 | |
| *** e0ne has quit IRC | 08:24 | |
| *** ijw has joined #openstack-ironic | 08:27 | |
| *** iurygregory has joined #openstack-ironic | 08:31 | |
| iurygregory | morning | 08:32 |
| *** ijw has quit IRC | 08:32 | |
| rpittau | hi iurygregory :) | 08:32 |
| iurygregory | rpittau, o/ | 08:32 |
| *** gkadam has joined #openstack-ironic | 08:34 | |
| *** tendulke has joined #openstack-ironic | 08:43 | |
| *** ijw has joined #openstack-ironic | 08:48 | |
| *** ijw has quit IRC | 08:53 | |
| *** Bhujay has joined #openstack-ironic | 08:53 | |
| *** Bhujay has quit IRC | 08:53 | |
| *** Bhujay has joined #openstack-ironic | 08:54 | |
| *** Bhujay has quit IRC | 08:55 | |
| *** Bhujay has joined #openstack-ironic | 08:56 | |
| arne_wiebalck | iurygregory: good morning! | 08:57 |
| iurygregory | arne_wiebalck, o/ | 08:58 |
| *** derekh has joined #openstack-ironic | 09:38 | |
| *** dnuka|brb is now known as dnuka | 09:44 | |
| dnuka | hi iurygregory o/ | 09:44 |
| iurygregory | dnuka, o/ | 09:44 |
| *** tendulke has quit IRC | 09:50 | |
| *** dtantsur|afk is now known as dtantsur | 09:57 | |
| dtantsur | morning ironic | 09:58 |
| dtantsur | etingof: we certainly need to make the power sync parallel | 09:58 |
| rpittau | hey dtantsur :) | 09:58 |
| mgoddard | morning all | 09:58 |
| dtantsur | probably we can do with just some partitioning of the existing periodic call | 09:58 |
| dnuka | morning dtantsur, mgoddard o/ | 09:59 |
| rpittau | hi mgoddard :) | 09:59 |
| * arne_wiebalck sees power sync and starts looking through the backlog | 10:04 | |
| dtantsur | hehe | 10:04 |
| arne_wiebalck | dtantsur: etingof: what’s the issue you’re tackling? | 10:05 |
| * dtantsur defers to etingof | 10:05 | |
| etingof | hey, hey o/ | 10:06 |
| arne_wiebalck | hey etingof o/ | 10:06 |
| dnuka | morning etingof o/ | 10:06 |
| rpittau | hi etingof :) | 10:07 |
| iurygregory | morning dtantsur | 10:08 |
| etingof | arne_wiebalck, it feels that we do IPMI power sync nodes one by one | 10:08 |
| etingof | we do that every 60 secs by default | 10:09 |
| arne_wiebalck | etingof: this is the Ironic internal periodic task to collect the current state from all nodes? | 10:09 |
| etingof | in the above holds, in the case when we have hundreds of nodes to keep an eye on, it feels like we may never be able to catch up in 60 secs | 10:09 |
| etingof | yes, that's the internal periodic task | 10:10 |
| arne_wiebalck | etingof: to give you some numbers, we currently have ~1700 nodes in Ironic and have set sync_power_state_interval to 300 | 10:10 |
| arne_wiebalck | etingof: this is to say, yes you are right :) | 10:11 |
| dtantsur | arne_wiebalck: would it help you, if ironic ran this periodic task in parallel in several batches? | 10:11 |
| etingof | arne_wiebalck, so how it works for you? | 10:11 |
| etingof | 1700/300 -> 6 ipmitool runs per second | 10:11 |
| arne_wiebalck | dtantsur: I think the question is if one needs the power state faster than 5 mins | 10:11 |
| dtantsur | and what's the answer for you? | 10:12 |
| arne_wiebalck | dtantsur: for now, “no” | 10:12 |
| dtantsur | I guess ideally we should report power state changes much faster. We just cannot. | 10:12 |
| arne_wiebalck | dtantsur: but we plan to add ~8’000 nodes or so | 10:12 |
| *** e0ne has joined #openstack-ironic | 10:13 | |
| arne_wiebalck | dtantsur: that may require us to change the value again | 10:13 |
| arne_wiebalck | dtantsur: and if that needs to be 30 mins, it becomes an issue | 10:13 |
| * etingof recalls that maas may have more than one way to power sync the nodes | 10:13 | |
| dtantsur | arne_wiebalck: so, my thinking is: we need to split this periodic task into a separate processes. and we need to run several nodes in parallel there. | 10:14 |
| arne_wiebalck | dtantsur: yes, sounds good | 10:14 |
| dtantsur | it's kind of on my radar.. I just never have enough time to properly do it. | 10:14 |
| arne_wiebalck | dtantsur: do all controllers run this task? | 10:14 |
| etingof | my patch proposes running up to 8 ipmitool processes in parallel... | 10:14 |
| dtantsur | arne_wiebalck: yep. only for nodes that are mapped to the conductor | 10:14 |
| arne_wiebalck | dtantsur: ok | 10:14 |
| dtantsur | so if you have 10 conductors and 8000 nodes, each will process roughly 800 | 10:15 |
| dtantsur | which is still a lot, ofc | 10:15 |
| dtantsur | especially since ironic-conductor is single-threaded (with green threads)\ | 10:15 |
| arne_wiebalck | dtantsur: I see | 10:15 |
| arne_wiebalck | etingof: you have a link to your patch? | 10:16 |
| * etingof thinks that ipmitool is run in a subprocess(es) | 10:16 | |
| dtantsur | etingof: I don't have a patch - that's the problem | 10:16 |
| dtantsur | if somebody wants to lend me a hand, I can provide guidance, etc | 10:16 |
| dtantsur | (I'm also a futurist core if we need to fix something there) | 10:16 |
| etingof | arne_wiebalck, https://review.openstack.org/#/c/631872/ | 10:16 |
| patchbot | patch 631872 - ironic - WIP: Parallelize periodic power sync calls - 1 patch set | 10:16 |
| dtantsur | etingof: well, in subprocess, but we block on the result | 10:16 |
| iurygregory | dtantsur, i can try to help | 10:17 |
| etingof | dtantsur, sorry, which patch you do not have? | 10:17 |
| dtantsur | etingof: https://review.openstack.org/#/c/631872/1/ironic/conductor/manager.py is cool, but it seems half measure | 10:17 |
| patchbot | patch 631872 - ironic - WIP: Parallelize periodic power sync calls - 1 patch set | 10:17 |
| dtantsur | ignore me re patch, I confused who asks whom | 10:17 |
| iurygregory | not sure if i have the necessary skills lol | 10:17 |
| dtantsur | iurygregory: we need to fork ironic-conductor early on, and run one of the tasks in the forked process (and nothing else). | 10:18 |
| etingof | dtantsur, half measure? | 10:18 |
| *** ijw has joined #openstack-ironic | 10:18 | |
| dtantsur | etingof: we can do better than run more green threads | 10:18 |
| dtantsur | we can run the whole beast in a forked process | 10:18 |
| iurygregory | humm | 10:18 |
| dtantsur | which actually gives us one more CPU core, not just more code competing for the same one | 10:18 |
| etingof | hmm, what's the difference? with my patch we basically fork ironic into 8 independent processes each running ipmitool | 10:19 |
| iurygregory | i will look at the conductor code in a few | 10:19 |
| iurygregory | dev conf mtg starting in 10min | 10:19 |
| etingof | the master single-threaded ironic waits (non-blockingly) for the children termination | 10:19 |
| dtantsur | etingof: spawn_worker launches a green thread | 10:20 |
| etingof | right, but only for watching the child, no? | 10:20 |
| dtantsur | no, everything is green threads | 10:20 |
| dtantsur | so you still compete for this one CPU | 10:20 |
| etingof | but ipmitool is an external binary, it can't be green-threaded, can it? | 10:21 |
| dtantsur | well, right. I'm talking about ironic-conductor here. | 10:21 |
| *** openstackgerrit has quit IRC | 10:21 | |
| dtantsur | what I'm afraid of is that with 8000 nodes your patch won't be enough | 10:22 |
| *** ijw has quit IRC | 10:22 | |
| etingof | so when we run ipmitool we 1) fork the conductor and 2) spawn a green thread to watch the pipe to the child | 10:22 |
| etingof | this 2) should be non-blocking | 10:22 |
| dtantsur | forking conductor mid-way is super dangerous | 10:22 |
| dtantsur | e.g. what will happen with RPC? two instances? | 10:22 |
| dtantsur | that's why I say we should fork early, before we run other periodic tasks or the RPC server | 10:23 |
| etingof | I think it's like any fork - the process stops, forks and the second copy gets wiped out with the new binary | 10:23 |
| dtantsur | yes, but it's not what you just described | 10:23 |
| etingof | then the parent continues | 10:23 |
| dtantsur | yes, this is what we have. but we still wait on 8000 ipmitool executions in the same process on the same one CPU core | 10:24 |
| dtantsur | it can be 8000 in sequence, or 8 batches of 1000 | 10:24 |
| dtantsur | your patch makes it faster, but it does not make it lighter | 10:24 |
| dtantsur | i.e. when this one core we run on is finally congested, we're out of options | 10:24 |
| etingof | this is what I do not understand... when we run any single ipmitool, do we do fork & exec from the conductor? | 10:25 |
| dtantsur | I suggest do exactly what you proposed, but fork the conductor process for it | 10:25 |
| dtantsur | sure, yes | 10:25 |
| etingof | so once we do fork & exec we end up with two conductor processes on two CPU cores (potentially) | 10:25 |
| dtantsur | sure, but one of them will be ipmitool soon. the other will have a green thread blocked on waiting for this ipmitool. | 10:26 |
| dtantsur | repeat 8x1000 times | 10:26 |
| etingof | right, but why it's blocked thread? is not it a non-blocking socket? | 10:26 |
| dtantsur | well, the green thread IS blocked. the execution switches to another green thread. | 10:27 |
| dtantsur | realistically, arne_wiebalck will need like 20 threads for their 8000 nodes to sync | 10:27 |
| etingof | then it does not block the whole conductor | 10:27 |
| dtantsur | yes, but it consumes its resources. resources of one CPU where we run *EVERYTHING* :) | 10:27 |
| dtantsur | green threads are not entirely cheap. | 10:27 |
| etingof | well, sleeping on I/O might not be expensive CPU-wise... | 10:28 |
| dtantsur | sure, while you do it in sane volumes | 10:28 |
| dtantsur | so what I say is: let's take your solution and make a step further. run this whole routine in a process of its own. | 10:29 |
| etingof | I think nginx folks have researched how many sleeping sockets nginx could sustain. I think with epoll they reached 10K or something | 10:30 |
| etingof | do you mean to have a dedicated server process spawning ipmitool instances? | 10:31 |
| dtantsur | and how much stuff is one conductor doing with 8000 nodes? | 10:31 |
| dtantsur | keep in mind that the power sync loop is not the only thing we're doing | 10:31 |
| etingof | a lot indeed! I am just thinking, if we add a bunch of sleeping I/O sockets, would that significantly add up to the amount of work conductor does...? | 10:32 |
| dtantsur | etingof: I'm trying to future proof :) reviewing your patch meanwhile, I think we can merge it anyway. | 10:33 |
| etingof | awesome! I'd add tests and reno then | 10:34 |
| etingof | I think TheJulia had recollections the other night that running ipmitool in parallel might confuse something somewhere... | 10:35 |
| dtantsur | etingof: left some comments (not related to the forking idea) | 10:38 |
| *** ijw has joined #openstack-ironic | 10:39 | |
| etingof | thank you dtantsur o/ | 10:39 |
| etingof | btw, I suspect that if any single BMC of the 1700 nodes (that arne_wiebalck is herding) slows down a bit, some of the remaining nodes might not power sync within the current 300s time frame... | 10:42 |
| *** ijw has quit IRC | 10:43 | |
| dtantsur | etingof: well, your approach does provide some relief here, since the other threads will catch up | 10:43 |
| arne_wiebalck | etingof: that is probably the case, yes … I’ll have a look how the power does at the moment (b/c last time we checked was when we were still <1k nodes, I think) | 10:43 |
| etingof | also consider ipmitool response timeout used to hit 5 minutes, before we start killing the beast after 1 minute of waiting | 10:45 |
| *** livelace has joined #openstack-ironic | 10:46 | |
| etingof | in other words, if you run into a single non-responding BMC, your effective power sync period becomes 1 minute less | 10:46 |
| dtantsur | can someone review https://review.openstack.org/#/c/629250/ please? it's not big and is required for the allocation API work. | 10:55 |
| patchbot | patch 629250 - ironic - Allocation API: allow picking random conductor for... - 2 patch sets | 10:55 |
| *** tssurya has joined #openstack-ironic | 10:59 | |
| arne_wiebalck | etingof: there is no direct way to see the duration of the power sync, is there? from what I see, there is nothing in the logs and update_at in the db does not get updated when the power state does not change, I guess | 10:59 |
| * arne_wiebalck tries to remember what triggered us to change the interval option … probably a warning issued when the periodic task run into itself? | 11:00 | |
| etingof | perhaps power sync is noted in the logs, but you'd probably need to parse that out... | 11:06 |
| arne_wiebalck | etingof: it doesn’t seem to be … I’m not running in debug mode, though | 11:06 |
| rpittau | side note: if the update_at changes only if there's a power state change, maybe add a "last_run" field to the power sync db ? | 11:10 |
| *** moshele has joined #openstack-ironic | 11:10 | |
| etingof | arne_wiebalck, may be if you run tcpdump on the conductor machine to catch IPMI exchanges and try to map them on the power sync time frame? | 11:13 |
| etingof | essentially to see is there any period of time where ipmi power status packets are not present on the wire... | 11:14 |
| etingof | or may be wrap `ipmitool` binary into a shell script and log from that shell script into some sql db...? | 11:15 |
| * etingof sorry for pulling arne_wiebalck into the hackerish affairs | 11:16 | |
| arne_wiebalck | etingof: :-D | 11:16 |
| arne_wiebalck | arne_wiebalck: another way would be to decrease the interval and see when the warning comes back :-D | 11:17 |
| *** tiendc has quit IRC | 11:19 | |
| * arne_wiebalck switches on debugging and goes for lunch … wcgw | 11:30 | |
| w14161_1 | TheJulia, no bug so far, I just look ironic source code, I can not under some code of ironic which related to ironic_lib, so I asked this question. | 11:37 |
| *** dnuka is now known as dnuka|brb | 11:40 | |
| *** dnuka|brb has quit IRC | 11:45 | |
| *** dnuka has joined #openstack-ironic | 11:48 | |
| *** dnuka is now known as dnuka|brb | 11:48 | |
| *** openstackgerrit has joined #openstack-ironic | 11:52 | |
| openstackgerrit | Merged openstack/metalsmith master: Clean up the edge cases around states https://review.openstack.org/631823 | 11:52 |
| *** moshele has quit IRC | 12:04 | |
| *** ijw has joined #openstack-ironic | 12:08 | |
| *** ijw has quit IRC | 12:13 | |
| *** moshele has joined #openstack-ironic | 12:14 | |
| hjensas | In CI it does'nt look like the depends-on for ironic was picked up on review: https://review.openstack.org/576873 . I belive the Depends-On syntax is correct? | 12:17 |
| patchbot | patch 576873 - networking-baremetal - WIP: Enable ironic notifications - 9 patch sets | 12:17 |
| arne_wiebalck | etingof: dtantsur: for a conductor with ~700 nodes, it seems the sequential power sync loop takes a bit more than 2 mins in our deployment (this is deduced from the “get/release lock” messages in the debug logs) | 12:20 |
| arne_wiebalck | etingof: dtantsur: that is above the default 60s and below the 300s we configured a while ago (so I think the measured value is sensible) | 12:21 |
| etingof | 6 ipmitool calls per second, not bad I think | 12:22 |
| etingof | ...for as long as not a single of those 700 calls gets stuck though | 12:22 |
| arne_wiebalck | etingof: yes … and that’s actually sth I never thought about | 12:23 |
| etingof | arne_wiebalck, I've been thinking that another way to observe the situation may be to enable process accounting, then see the number of ipmitool calls and their runtimes | 12:23 |
| arne_wiebalck | etingof: pasacct you mean? | 12:24 |
| arne_wiebalck | etingof: psacct | 12:24 |
| etingof | yep | 12:24 |
| arne_wiebalck | etingof: I think we have that enabled by default | 12:24 |
| etingof | ha, that must be a lot of logs | 12:24 |
| arne_wiebalck | etingof: it is :-D | 12:24 |
| iurygregory | hjensas, i think Depends-On should be before Change-Id | 12:25 |
| etingof | arne_wiebalck, may be `lastcomm ipmitool` reveals something? | 12:26 |
| hjensas | iurygregory: hm, it does pull in the ironicclient change - http://logs.openstack.org/73/576873/9/check/networking-baremetal-multitenant-vlans/238ec9d/job-output.txt.gz#_2019-01-20_02_02_01_324426 | 12:27 |
| hjensas | iurygregory: that Depends-On is also after Change-Id. | 12:27 |
| iurygregory | strange | 12:28 |
| arne_wiebalck | etingof: why didn’t you say that earlier? :-P | 12:28 |
| arne_wiebalck | etingof: it does | 12:28 |
| iurygregory | i now that Depends-On doesnt trigger a patch to gate if the patch has a +2 +W before the depends-on was merged | 12:28 |
| arne_wiebalck | etingof: confirms the 2min cycle before a 3min break | 12:28 |
| *** ijw has joined #openstack-ironic | 12:28 | |
| *** rh-jelabarre has joined #openstack-ironic | 12:29 | |
| hjensas | iurygregory: makes sense. This is just check jobs. I'd like the CI to run with all the patches to we can verify in logs that all the things work. :) | 12:32 |
| iurygregory | hjensas, i have one with many depends on let me check | 12:32 |
| openstackgerrit | Harald Jensås proposed openstack/ironic master: API - Implement /events endpoint https://review.openstack.org/631946 | 12:33 |
| *** ijw has quit IRC | 12:33 | |
| openstackgerrit | Harald Jensås proposed openstack/networking-baremetal master: WIP: Enable ironic notifications https://review.openstack.org/576873 | 12:34 |
| * hjensas tries to rebase the ironic change, and move the Depends-On's above Change-Id. Also swapped the order of the Depends-On, the Ironic patch first this time. | 12:35 | |
| etingof | arne_wiebalck, nice! and sorry for being slow on neurons | 12:36 |
| arne_wiebalck | etingof: ha ha, no thanks for pointign me to this! this will be very handy next time! | 12:37 |
| *** kaiokmo has joined #openstack-ironic | 12:37 | |
| *** jistr is now known as jistr|afk | 12:38 | |
| openstackgerrit | Mark Goddard proposed openstack/bifrost master: Make explicit fact gathering timeout configurable https://review.openstack.org/632078 | 12:41 |
| TheJulia | good morning everyone | 12:43 |
| iurygregory | good morning TheJulia | 12:43 |
| openstackgerrit | Hamdy Khader proposed openstack/ironic master: Add is_smartnic to Port data model https://review.openstack.org/629640 | 12:44 |
| *** amoralej is now known as amoralej|lunch | 12:45 | |
| TheJulia | do I have to look like a human today? | 12:47 |
| *** dnuka|brb is now known as dnuka | 12:47 | |
| dnuka | morning TheJulia o/ | 12:47 |
| TheJulia | I hope everyone had a wonderful weekend | 12:48 |
| hjensas | good morning TheJulia | 12:48 |
| iurygregory | not wonderful but a normal one | 12:48 |
| w14161_1 | morning, TheJulia | 12:48 |
| TheJulia | iurygregory: :( | 12:49 |
| * iurygregory spent the weekend validating programming questions for the programming contest at DevConf | 12:49 | |
| *** dnuka is now known as dnuka|brb | 12:50 | |
| TheJulia | fuuuun | 12:50 |
| TheJulia | My saturday was in a metal tube | 12:50 |
| TheJulia | flights were chaos friday and saturday | 12:50 |
| iurygregory | damm =( | 12:50 |
| iurygregory | hope your travel to Brno will be better | 12:50 |
| TheJulia | My initial flight out of boston was delayed over three hours and I ended up having to stay overnight along the way because there was no way to get home or anywhere close to home. :( | 12:51 |
| iurygregory | that sucks =( | 12:51 |
| TheJulia | I went to the airport Saturday morning and the line was possibly the longest security line I've ever seen | 12:52 |
| iurygregory | this happened to me in 2015 coming back from the summit in Tokyo | 12:53 |
| TheJulia | Yeah, it is no fun when it happens. | 12:57 |
| TheJulia | I feel like I lost all of Saturday as a result | 12:58 |
| * TheJulia sips coffee | 12:58 | |
| hjensas | iurygregory: \o/ Looks like the rebase did the trick, I see both depends-on changes in console output of the running zuul job now. | 12:59 |
| dtantsur | morning TheJulia | 12:59 |
| TheJulia | \o/ | 12:59 |
| TheJulia | good morning dtantsur | 12:59 |
| iurygregory | hjensas, cool! | 12:59 |
| dtantsur | sigh, I hope you did get some rest on Sunday | 12:59 |
| TheJulia | some, not enough | 12:59 |
| dtantsur | :( | 12:59 |
| TheJulia | What is compounding rest issues is we had an overnight wind storm here. Winds gusting 30+ knots | 13:00 |
| TheJulia | still occasionally gusts | 13:00 |
| * dtantsur assumes 30+ knots is a lot | 13:00 | |
| TheJulia | yeah, roughtly 30+ mph | 13:00 |
| * iurygregory =O | 13:01 | |
| rpittau | hi TheJulia :) | 13:08 |
| *** jistr|afk is now known as jistr | 13:10 | |
| openstackgerrit | Hamdy Khader proposed openstack/ironic master: Add is_smartnic to Port data model https://review.openstack.org/629640 | 13:28 |
| *** priteau has joined #openstack-ironic | 13:40 | |
| *** amoralej|lunch is now known as amoralej | 13:52 | |
| TheJulia | https://bluejeans.com/u/jkreger <-- for mid-cycle call | 13:54 |
| *** arne_wiebalck_ has joined #openstack-ironic | 13:54 | |
| *** kaifeng has joined #openstack-ironic | 13:55 | |
| mgoddard | It's the first kayobe IRC meeting in a few minutes, so I'll have to miss the first part of today's session. I'll dial in when it's over | 13:57 |
| TheJulia | mgoddard: Thanks for the heads up | 13:57 |
| *** ijw has joined #openstack-ironic | 13:58 | |
| mgoddard | no problem. Apologies for previous missed meetings and lack of heads up. It's normally because I'm with a security conscious client, with no IRC access :( | 13:59 |
| TheJulia | 7 people on the call \o/ | 14:00 |
| iurygregory | \o/ | 14:00 |
| *** jcoufal has joined #openstack-ironic | 14:00 | |
| *** ijw has quit IRC | 14:03 | |
| openstackgerrit | Merged openstack/ironic master: Add pxe template per node https://review.openstack.org/625553 | 14:14 |
| *** ijw has joined #openstack-ironic | 14:19 | |
| *** ijw has quit IRC | 14:24 | |
| *** rloo has joined #openstack-ironic | 14:31 | |
| *** e0ne has quit IRC | 14:36 | |
| *** rloo has quit IRC | 14:41 | |
| *** e0ne has joined #openstack-ironic | 14:41 | |
| *** Bhujay has quit IRC | 14:43 | |
| *** YaWang has quit IRC | 14:44 | |
| *** mjturek has joined #openstack-ironic | 14:44 | |
| mjturek | morning ironic! | 14:46 |
| *** dnuka|brb is now known as dnuka | 14:47 | |
| dnuka | morning mjturek | 14:48 |
| *** yolanda has joined #openstack-ironic | 14:51 | |
| *** baha has joined #openstack-ironic | 14:51 | |
| iurygregory | morning mjturek | 14:52 |
| iurygregory | mgoddard, can you point the patches in the etherpad? =) | 14:55 |
| *** cdearborn has joined #openstack-ironic | 14:57 | |
| *** iurygregory is now known as iury|brb | 14:59 | |
| *** iury|brb is now known as iurygregory | 15:03 | |
| *** cdearborn has quit IRC | 15:06 | |
| *** cdearborn has joined #openstack-ironic | 15:06 | |
| mjturek | hmm, is there a meeting today? | 15:13 |
| dtantsur | mjturek: nope because of https://etherpad.openstack.org/p/ironic-stein-midcycle | 15:13 |
| mjturek | whoops! Thanks dtantsur | 15:14 |
| dnuka | thanks dtantsur :) | 15:14 |
| *** dnuka has quit IRC | 15:15 | |
| *** cdearborn has quit IRC | 15:16 | |
| openstackgerrit | Ilya Etingof proposed openstack/ironic master: Parallelize periodic power sync calls https://review.openstack.org/631872 | 15:16 |
| iurygregory | mjturek, if you want to join the mid-cycle https://bluejeans.com/u/jkreger | 15:17 |
| *** moshele has quit IRC | 15:17 | |
| mjturek | just did iurygregory - thank you! | 15:17 |
| iurygregory | mjturek, yw | 15:17 |
| iurygregory | coffee time | 15:18 |
| *** Bhujay has joined #openstack-ironic | 15:21 | |
| *** rloo has joined #openstack-ironic | 15:25 | |
| NobodyCam | Good Morning Ironic'ers | 15:40 |
| *** Bhujay has quit IRC | 15:43 | |
| iurygregory | morning NobodyCam o/ | 15:43 |
| *** TxGirlGeek has joined #openstack-ironic | 15:43 | |
| NobodyCam | good Morning iurygregory :) | 15:46 |
| *** ijw has joined #openstack-ironic | 15:48 | |
| rpittau | hey NobodyCam :) | 15:50 |
| openstackgerrit | Ilya Etingof proposed openstack/ironic master: Parallelize periodic power sync calls https://review.openstack.org/631872 | 15:51 |
| *** munimeha1 has joined #openstack-ironic | 15:52 | |
| *** ijw has quit IRC | 15:53 | |
| NobodyCam | Good Morning rpittau | 15:55 |
| *** ijw has joined #openstack-ironic | 16:09 | |
| *** ijw has quit IRC | 16:14 | |
| *** arne_wiebalck_ has quit IRC | 16:14 | |
| *** kaifeng has quit IRC | 16:18 | |
| TheJulia | Thanks everyone for your time during the call | 16:19 |
| *** TxGirlGeek has quit IRC | 16:19 | |
| iurygregory | that was my first mid-cycle \o/ | 16:19 |
| rpittau | same :) | 16:20 |
| rloo | thx TheJulia for organizing etc! | 16:20 |
| rloo | iurygregory, rpittau: first of many :) | 16:20 |
| arne_wiebalck | rloo: +1 | 16:21 |
| iurygregory | rloo, true \o/ | 16:21 |
| mgoddard | iurygregory: better to follow the whiteboard, since it will be kept more up to date: https://etherpad.openstack.org/p/IronicWhiteBoard | 16:28 |
| iurygregory | mgoddard, ack | 16:28 |
| mgoddard | iurygregory: just adding the API patch to that | 16:29 |
| iurygregory | much better the color now =) | 16:30 |
| iurygregory | i got blind for 2s before hehe | 16:31 |
| iurygregory | mgoddard, i will read the spec and after that i will push some reviews =) | 16:32 |
| mgoddard | iurygregory: great, that will be a big help | 16:34 |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-python-agent master: [WIP] Build tinyipa with python3 https://review.openstack.org/495385 | 16:36 |
| * rpittau just noticed that 2017 was not last year.... | 16:40 | |
| *** gkadam has quit IRC | 16:45 | |
| TheJulia | eek | 16:47 |
| *** ijw has joined #openstack-ironic | 16:49 | |
| iurygregory | we have 19 projects under ironic =O | 16:50 |
| rpittau | 19 is a good number | 16:52 |
| *** ijw has quit IRC | 16:53 | |
| iurygregory | true | 16:53 |
| iurygregory | cya tomorrow o/ | 16:55 |
| rpittau | bye iurygregory o/ | 16:55 |
| *** moshele has joined #openstack-ironic | 16:55 | |
| *** priteau has quit IRC | 16:58 | |
| *** moshele has quit IRC | 16:58 | |
| *** e0ne has quit IRC | 16:58 | |
| rpittau | bye all! good evening! o/ | 16:59 |
| *** rpittau has quit IRC | 16:59 | |
| *** priteau has joined #openstack-ironic | 17:00 | |
| *** ijw has joined #openstack-ironic | 17:10 | |
| *** ijw has quit IRC | 17:15 | |
| *** dtantsur is now known as dtantsur|afk | 17:16 | |
| dtantsur|afk | g'night | 17:16 |
| *** tssurya has quit IRC | 17:28 | |
| *** fragatina has joined #openstack-ironic | 17:43 | |
| *** fragatina has quit IRC | 17:44 | |
| *** fragatina has joined #openstack-ironic | 17:44 | |
| *** fragatina has quit IRC | 17:52 | |
| *** logan- has quit IRC | 17:52 | |
| *** fragatina has joined #openstack-ironic | 17:52 | |
| *** logan_ has joined #openstack-ironic | 17:53 | |
| *** logan_ is now known as logan- | 17:53 | |
| TheJulia | iurygregory: And they are all awesome! :) | 17:54 |
| *** fragatina has quit IRC | 17:55 | |
| *** fragatina has joined #openstack-ironic | 17:56 | |
| *** fragatina has quit IRC | 17:58 | |
| *** fragatina has joined #openstack-ironic | 17:58 | |
| *** moshele has joined #openstack-ironic | 18:00 | |
| *** priteau has quit IRC | 18:01 | |
| *** derekh has quit IRC | 18:01 | |
| *** fragatina has quit IRC | 18:03 | |
| *** fragatina has joined #openstack-ironic | 18:03 | |
| *** fragatina has quit IRC | 18:05 | |
| *** fragatina has joined #openstack-ironic | 18:05 | |
| *** openstackgerrit has quit IRC | 18:07 | |
| *** fragatina has quit IRC | 18:07 | |
| *** fragatina has joined #openstack-ironic | 18:08 | |
| *** fragatina has quit IRC | 18:08 | |
| *** fragatina has joined #openstack-ironic | 18:09 | |
| *** fragatina has quit IRC | 18:09 | |
| *** fragatina has joined #openstack-ironic | 18:10 | |
| *** fragatina has quit IRC | 18:11 | |
| *** fragatina has joined #openstack-ironic | 18:12 | |
| *** fragatina has quit IRC | 18:13 | |
| *** fragatina has joined #openstack-ironic | 18:14 | |
| *** fragatina has quit IRC | 18:15 | |
| *** fragatina has joined #openstack-ironic | 18:16 | |
| *** _fragatina_ has joined #openstack-ironic | 18:17 | |
| *** fragatina has quit IRC | 18:22 | |
| *** robbbe has joined #openstack-ironic | 18:24 | |
| *** openstackgerrit has joined #openstack-ironic | 18:26 | |
| openstackgerrit | Harald Jensås proposed openstack/ironic master: API - Implement /events endpoint https://review.openstack.org/631946 | 18:26 |
| openstackgerrit | Harald Jensås proposed openstack/networking-baremetal master: Enable ironic notifications https://review.openstack.org/576873 | 18:31 |
| *** baha has quit IRC | 18:38 | |
| *** ijw has joined #openstack-ironic | 18:39 | |
| *** _fragatina_ has quit IRC | 18:40 | |
| *** amoralej is now known as amoralej|off | 18:40 | |
| *** fragatina has joined #openstack-ironic | 18:41 | |
| *** ijw has quit IRC | 18:44 | |
| *** fragatina has quit IRC | 18:47 | |
| *** fragatina has joined #openstack-ironic | 18:47 | |
| *** fragatina has quit IRC | 18:47 | |
| *** fragatina has joined #openstack-ironic | 18:48 | |
| *** fragatina has quit IRC | 18:56 | |
| *** fragatina has joined #openstack-ironic | 18:56 | |
| *** fragatina has quit IRC | 18:57 | |
| *** jcoufal_ has joined #openstack-ironic | 18:57 | |
| *** fragatina has joined #openstack-ironic | 18:58 | |
| *** ijw has joined #openstack-ironic | 19:00 | |
| *** jcoufal has quit IRC | 19:01 | |
| *** baha has joined #openstack-ironic | 19:03 | |
| *** fragatina has quit IRC | 19:03 | |
| *** fragatina has joined #openstack-ironic | 19:04 | |
| *** moshele has quit IRC | 19:04 | |
| *** ijw has quit IRC | 19:04 | |
| *** fragatina has quit IRC | 19:07 | |
| *** fragatina has joined #openstack-ironic | 19:07 | |
| openstackgerrit | Harald Jensås proposed openstack/networking-baremetal master: Enable ironic notifications https://review.openstack.org/576873 | 19:16 |
| -openstackstatus- NOTICE: The error causing post failures on jobs has been corrected. It is safe to recheck these jobs. | 19:17 | |
| *** ijw has joined #openstack-ironic | 19:25 | |
| *** baha has quit IRC | 19:26 | |
| *** fragatina has quit IRC | 19:28 | |
| *** fragatina has joined #openstack-ironic | 19:29 | |
| *** rh-jelabarre has quit IRC | 19:31 | |
| *** fragatina has quit IRC | 19:39 | |
| *** fragatina has joined #openstack-ironic | 19:39 | |
| *** fragatina has quit IRC | 19:42 | |
| *** fragatina has joined #openstack-ironic | 19:43 | |
| *** rh-jelabarre has joined #openstack-ironic | 19:50 | |
| *** gabys has joined #openstack-ironic | 20:10 | |
| *** fragatina has quit IRC | 20:20 | |
| *** fragatina has joined #openstack-ironic | 20:21 | |
| *** ianw is now known as ianw_pto | 20:26 | |
| *** jtomasek has quit IRC | 20:32 | |
| *** rh-jelabarre has quit IRC | 20:33 | |
| *** rh-jelabarre has joined #openstack-ironic | 20:36 | |
| *** gabys has quit IRC | 20:37 | |
| *** gabys has joined #openstack-ironic | 20:38 | |
| *** gabys has quit IRC | 20:42 | |
| *** priteau has joined #openstack-ironic | 20:51 | |
| *** e0ne has joined #openstack-ironic | 20:57 | |
| *** gabys has joined #openstack-ironic | 21:00 | |
| *** jcoufal_ has quit IRC | 21:03 | |
| *** priteau has quit IRC | 21:04 | |
| *** baha has joined #openstack-ironic | 21:04 | |
| *** ijw has quit IRC | 21:15 | |
| *** ijw has joined #openstack-ironic | 21:16 | |
| *** e0ne has quit IRC | 21:51 | |
| *** rcernin has joined #openstack-ironic | 21:54 | |
| *** fragatina has quit IRC | 22:04 | |
| *** fragatina has joined #openstack-ironic | 22:04 | |
| *** mjturek has quit IRC | 22:07 | |
| *** baha has quit IRC | 22:09 | |
| *** fragatina has quit IRC | 22:11 | |
| *** fragatina has joined #openstack-ironic | 22:12 | |
| *** fragatina has quit IRC | 22:18 | |
| *** fragatina has joined #openstack-ironic | 22:19 | |
| *** priteau has joined #openstack-ironic | 22:34 | |
| *** fragatina has quit IRC | 22:39 | |
| *** fragatina has joined #openstack-ironic | 22:40 | |
| *** fragatina has quit IRC | 22:40 | |
| *** fragatina has joined #openstack-ironic | 22:40 | |
| *** fragatina has quit IRC | 22:41 | |
| *** fragatina has joined #openstack-ironic | 22:42 | |
| *** fragatina has quit IRC | 22:44 | |
| *** fragatina has joined #openstack-ironic | 22:45 | |
| *** MattMan has quit IRC | 22:49 | |
| *** MattMan has joined #openstack-ironic | 22:50 | |
| *** fragatina has quit IRC | 22:51 | |
| *** fragatina has joined #openstack-ironic | 22:52 | |
| *** fragatina has quit IRC | 23:07 | |
| *** fragatina has joined #openstack-ironic | 23:08 | |
| *** livelace has quit IRC | 23:15 | |
| *** dsneddon has quit IRC | 23:21 | |
| *** dsneddon has joined #openstack-ironic | 23:22 | |
| *** livelace has joined #openstack-ironic | 23:33 | |
| *** e0ne has joined #openstack-ironic | 23:34 | |
| *** e0ne has quit IRC | 23:39 | |
| *** livelace has quit IRC | 23:42 | |
| *** munimeha1 has quit IRC | 23:53 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!