opendevreview | Merged openstack/networking-generic-switch master: CI: Alternate logic for multinode key replacement https://review.opendev.org/c/openstack/networking-generic-switch/+/840519 | 01:39 |
---|---|---|
opendevreview | Julia Kreger proposed openstack/networking-generic-switch stable/yoga: CI: Alternate logic for multinode key replacement https://review.opendev.org/c/openstack/networking-generic-switch/+/840731 | 02:37 |
opendevreview | Steve Baker proposed openstack/sushy-tools master: Fix per-request memoization https://review.opendev.org/c/openstack/sushy-tools/+/840780 | 03:08 |
opendevreview | Steve Baker proposed openstack/sushy-tools master: Add an allowed list to filter managed virtual machines https://review.opendev.org/c/openstack/sushy-tools/+/840804 | 03:08 |
opendevreview | Merged openstack/networking-generic-switch stable/yoga: CI: Alternate logic for multinode key replacement https://review.opendev.org/c/openstack/networking-generic-switch/+/840731 | 05:38 |
*** mat_fechner is now known as matfechner | 06:21 | |
arne_wiebalck | Good morning, Ironic! | 06:24 |
janders | hey arne_wiebalck o/ | 11:18 |
ajya | Hi ftarasenko , cc dtantsur looking at the latest logs these are the differences between succeeded node and failed node - https://paste.opendev.org/show/btgQTCvsi59oyvWaFifn/ | 11:23 |
ajya | the one that succeeded don't have heartbeats, for the failed one the heartbeat seem to complete the cleaning while cleaning still running causing error later | 11:24 |
ajya | ftarasenko: do you know why the successful node does not have heartbeat? | 11:25 |
ajya | Does anyone have idea why heartbeats make cleaning complete when it shouldn't? Something to configure in the step? | 11:26 |
dtantsur | ajya: generally, heartbeats are supposed to cause progress in cleaning/deploy | 11:26 |
dtantsur | we have a special flag (polling?) to prevent that | 11:26 |
dtantsur | the question why it does not work is a good one | 11:26 |
dtantsur | if you have a way to reproduce it, you can insert logging everywhere to see how the decision is made and what the node's status is | 11:27 |
ajya | I can't reproduce it, but I have more logs from ftarasenko | 11:28 |
ajya | will check what happens with polling flag, otherwise this is the difference - it works for some nodes because no heartbeats happening | 11:29 |
ajya | also will check what happens with heartbeats in my environment | 11:29 |
ftarasenko | Hi! I can reproduce failed cleaning with more debug output if required. | 11:33 |
ajya | ok, I'll check if and where more logging should be added. So far cleaning_polling is set to True in both cases. | 11:59 |
iurygregory | good morning Ironic | 12:04 |
iurygregory | can I get a +W in https://review.opendev.org/c/openstack/ironic/+/840671 so I can work on the release? :D | 12:10 |
TheJulia | I can in a little bit | 12:16 |
TheJulia | Just starting to wake up | 12:16 |
iurygregory | sure o/ | 12:19 |
iurygregory | rpittau, in the ironic-inspector-tempest-managed-non-standalone I see a lot of No space left on device in the bm-logs and after that ironic_python_agent.errors.HeartbeatError: Error heartbeating to agent API: Error 400: Invalid or missing agent token received. | 12:20 |
TheJulia | sweet | 12:22 |
dtantsur | >_< | 12:26 |
TheJulia | so... does this mean the weekend drinking starts... early? | 12:36 |
* dtantsur already had coffee with baileys | 12:36 | |
TheJulia | +2+A | 12:40 |
iurygregory | I'm going to attempt to increase the disk size just for testing... | 12:41 |
dtantsur | iurygregory: we also need to check if we expect the raw image streaming to be used | 12:42 |
TheJulia | we should ask infra if they reduced the disk sizes again | 12:43 |
TheJulia | just to be on the safe side | 12:43 |
dtantsur | I think we worked around the cloud disk sizes by using /opt | 12:44 |
iurygregory | dtantsur, the stream_raw_images option you mean? | 12:44 |
TheJulia | Yeah, we did that though... | 12:44 |
dtantsur | iurygregory: it's not just the option, we need to be able to do that | 12:45 |
iurygregory | but we are only using opt in some scenarios (I think), let me double check | 12:45 |
iurygregory | ohhh seems like we don't have LIBVIRT_STORAGE_POOL_PATH: /opt/libvirt/images in some inspector jobs | 12:47 |
dtantsur | \o/ | 12:48 |
iurygregory | I will attempt to add that to see | 12:48 |
opendevreview | Iury Gregory Melo Ferreira proposed openstack/ironic-inspector master: [DNM] Testing CI with LIBVIRT_STORAGE_POOL_PATH https://review.opendev.org/c/openstack/ironic-inspector/+/840891 | 12:52 |
opendevreview | Dmitry Tantsur proposed openstack/ironic-python-agent stable/xena: Do not try to guess EFI partition path by its number https://review.opendev.org/c/openstack/ironic-python-agent/+/840892 | 12:57 |
dtantsur | this was a crazy backport, please review carefully ^^^ | 12:57 |
iurygregory | oh I can imagine | 12:57 |
opendevreview | Dmitry Tantsur proposed openstack/ironic-python-agent stable/wallaby: Do not try to guess EFI partition path by its number https://review.opendev.org/c/openstack/ironic-python-agent/+/840170 | 13:04 |
dtantsur | same ^^ | 13:04 |
TheJulia | oh joy, at least we found it quickly | 13:04 |
* TheJulia reads absolutely batshit crazy laws being proposed and wishes there was an easy way to depart her country | 13:05 | |
dtantsur | TheJulia: yeah, I'm sorry to read the recent news :( | 13:06 |
dtantsur | Easy it is not, but I wonder if some, ehemm, calmer country is an option | 13:06 |
TheJulia | its a nice fancy but if we do it, we have to walk away from ever returning | 13:08 |
TheJulia | well, fancy to think about if we were to do it | 13:08 |
iurygregory | TheJulia, I'm sure you will find a solution, fingers crossed \o/ | 13:08 |
TheJulia | and that also means we have to walk away from promise of some funds for retirement | 13:08 |
TheJulia | It is really only feasible if your younger | 13:08 |
iurygregory | =( | 13:10 |
TheJulia | My wife had someone super interested in recruiting her to work for a company in the EU about a year or two ago, and we looked at it and the long term impacts and yeah. It was soboring to do the math and look at the long term impact... | 13:13 |
dtantsur | yeah, I cannot comment on the financial situation | 13:16 |
dtantsur | my own approach was to run without looking back, but that's definitely not for everyone | 13:16 |
TheJulia | yeah | 13:16 |
* dtantsur has just read that > 3 mln people have left Russia THIS YEAR | 13:16 | |
TheJulia | wow | 13:16 |
iurygregory | WOW O.o 3mln ? | 13:17 |
dtantsur | I can hardly believe myself | 13:17 |
iurygregory | https://review.opendev.org/c/openstack/releases/+/840896 IPA release \o/ | 13:17 |
dtantsur | a lot of people just noped out into nowhere on short notice | 13:17 |
iurygregory | I'm wondering how they are able to do that on short notice... | 13:18 |
TheJulia | leaving and never looking back perhaps? | 13:18 |
dtantsur | surprisingly, there are still countries that accept Russians without a visa | 13:18 |
iurygregory | my point was related to visa =) | 13:19 |
dtantsur | ticket prises went through the roof (10x increase wasn't uncommon) | 13:19 |
iurygregory | wow | 13:19 |
TheJulia | Wow, their population growth rate based on just deaths/births is in hard contraction already | 13:19 |
dtantsur | so, there are neighbouring countries like Armenia and Georgia, other former USSR countries as well | 13:19 |
dtantsur | the fact that Russia has a very old population is a part of the problem | 13:20 |
dtantsur | the old population in Russia is extremely conservative | 13:20 |
dtantsur | (politely speaking) | 13:21 |
TheJulia | We have a very similar problem here | 13:21 |
iurygregory | I do see some resemblance with Brazil... | 13:22 |
TheJulia | The problem we also have is people are not really retiring | 13:22 |
dtantsur | I think this scale is even worse | 13:22 |
TheJulia | in part... because acquisition of wealth being the most important thing... and there is not really any sort of safety net | 13:22 |
TheJulia | Yeah | 13:23 |
dtantsur | Russia had a huge drop in births from ~ mid 80th to mid or even late 90th | 13:23 |
TheJulia | Yeah, the graph is super sobering to look at | 13:23 |
dtantsur | while there was a huge spike after the war (our variant of boomers, more or less) | 13:24 |
TheJulia | On the subject of happier graphs... https://usercontent.irccloud-cdn.com/file/Uoncb8SK/muahahahaha.png | 13:25 |
dtantsur | 50th were years of recovery from both the war and stalinism. 70th were the years of (perceived) prosperity | 13:25 |
dtantsur | in the 80th it went southwards, the (perceived) prosperity only returned in 2000th | 13:25 |
* dtantsur should probably stop distracting people with history lessons :) | 13:26 | |
TheJulia | Anyone remember the bar discussion in Atlanta how weirdly similar propaganda was? :) | 13:26 |
dtantsur | not me, unfortunately | 13:26 |
iurygregory | nope .-. I wasn't there | 13:27 |
TheJulia | It was... amusing | 13:27 |
TheJulia | but basically same basic messaging, same idolization of a golden period of prosperity | 13:27 |
TheJulia | and same basic painting as everyone else as the enemy | 13:27 |
TheJulia | And the internet kind of enabled us to start breaking down some of those walls of understanding | 13:28 |
* TheJulia should go eat breakfast before her 7 am meeting | 13:28 | |
dtantsur | enjoy! | 13:28 |
iurygregory | ++ for breakfast | 13:28 |
* dtantsur got a questionable habit of eating korean ramen for breakfast | 13:28 | |
iurygregory | now I'm jealous | 13:29 |
iurygregory | I miss ramen <3 | 13:29 |
dtantsur | give it a try :) just keep it mind - it's pretty hot. even the "mild" version | 13:29 |
dtantsur | got no ramen around you? | 13:29 |
iurygregory | I never had korean ramen, only the japanese | 13:30 |
dtantsur | it's pretty different, although the base idea is the same | 13:30 |
dtantsur | first and foremost, korean is SPICY | 13:30 |
iurygregory | dtantsur, in Brazil only in some very big cities you will be able to find korean food I would say | 13:30 |
iurygregory | so I will keep eating japanese ramen <3 since is not spicy | 13:31 |
iurygregory | I can't handle spicy food | 13:31 |
dtantsur | then forget it :) | 13:31 |
dtantsur | my wife can also eat only japanese ramen | 13:31 |
* iurygregory is wondering how he can travel to South Korea now... | 13:31 | |
dtantsur | so we have two separate stashes :) | 13:31 |
dtantsur | iurygregory: by a looooong flight | 13:31 |
iurygregory | dtantsur, well I'm thinking about the food now... | 13:32 |
iurygregory | if everything is spicy | 13:32 |
dtantsur | well | 13:32 |
dtantsur | right | 13:32 |
dtantsur | you'll have to stick to drinking :) | 13:32 |
iurygregory | I will need to do a lot of research :D | 13:32 |
iurygregory | Soju <3 | 13:32 |
dtantsur | I prefer Makgeoli (oh how is it spelled) | 13:32 |
iurygregory | soju + beer = amazing combination | 13:32 |
dtantsur | need to try | 13:33 |
* iurygregory googles | 13:33 | |
dtantsur | I even have a bottle of soju at home | 13:33 |
iurygregory | oh Makgeoli is the drink that is made with rice | 13:33 |
dtantsur | yep. pretty milky and sweet. | 13:34 |
dtantsur | can be mixed with juice | 13:34 |
iurygregory | dtantsur, I've tested soju + Hoegaarden beer | 13:34 |
dtantsur | an interesting idea | 13:34 |
dtantsur | I don't think we have hoegaarden here | 13:34 |
iurygregory | like 200ml of beer + 30-40ml of soju =) | 13:34 |
iurygregory | in germany you can probably find I think (at least in CZ it was pretty easy) | 13:35 |
dtantsur | the markets are saturated by local beer. we do have belgian beer as well, but mostly strong ones | 13:35 |
iurygregory | yeah, I wouldn't try with strong ones since soju is already 17% (at least the one I have) | 13:36 |
dtantsur | (we have Delirium in the local supermarket!) | 13:36 |
iurygregory | try with some light beers :D | 13:36 |
iurygregory | Delirium <3 we have here but is VERY expensive | 13:36 |
dtantsur | in Bavaria they have extra-light beers, that's really cool | 13:37 |
dtantsur | 2-3% of alcohol, perfect for summer | 13:37 |
iurygregory | nice! | 13:37 |
iurygregory | oh good, it will be summer next month right? | 13:38 |
iurygregory | <O> | 13:38 |
* iurygregory forgot seasons are different in EU... | 13:38 | |
dtantsur | yep, it's getting really warm. +20 today | 13:38 |
dtantsur | I'm looking forward towards camping without the temperature dropping to around or even below zero in the morning :) | 13:39 |
TheJulia | I was not expecting a ramen discussion | 13:39 |
iurygregory | TheJulia, well, it's friday | 13:39 |
TheJulia | True, true | 13:40 |
TheJulia | oh! which reminds me | 13:40 |
* TheJulia loads up grendade for a recheck | 13:40 | |
dtantsur | the combination of the news and reading Remarque make me shudder when reading "grenade" | 13:42 |
TheJulia | sorry | 13:42 |
TheJulia | :( | 13:42 |
TheJulia | maybe we should propose to rename it | 13:42 |
dtantsur | I sometimes wonder that | 13:42 |
TheJulia | or... just... send it to the bit bucket | 13:42 |
dtantsur | I'm not bothered too much, but I've seen quite a few people proposing to get rid of military terminology | 13:43 |
TheJulia | anyway, I *think* the multinode mixed state upgrade job should be fine moving forward | 13:43 |
TheJulia | but, the current recheck will let us know for sure | 13:43 |
TheJulia | ++ | 13:43 |
iurygregory | ++ | 13:43 |
TheJulia | Maybe a worthwhile inclusion in D&I efforts | 13:44 |
iurygregory | ++ ^ | 13:45 |
* iurygregory can't find spotz in this channel | 13:46 | |
TheJulia | email her :) | 13:53 |
* TheJulia has reached the point where she believes the sock gnomes are conspiring with the hairbrush thieves... | 13:54 | |
TheJulia | Possible sign I need a hair cut | 13:54 |
iurygregory | sock gnomes LOL | 13:55 |
TheJulia | https://twitter.com/ashinclouds/status/1522575866554769408 | 13:56 |
TheJulia | for the record... | 13:56 |
* TheJulia goes back to her regularly scheduled meeting programming. | 13:57 | |
opendevreview | Merged openstack/ironic master: Ironic Release 20.2 https://review.opendev.org/c/openstack/ironic/+/840671 | 13:57 |
iurygregory | I don't know any ... | 13:57 |
iurygregory | since this will be my first time in Berlin :D | 13:57 |
iurygregory | I've heard about Brewdog's (I think dtantsur mentioned last year in the irc :D ) | 13:58 |
iurygregory | ok, ironic release now \o/ | 13:59 |
iurygregory | yay... | 14:39 |
iurygregory | openstack-tox-validate is broken | 14:39 |
iurygregory | LIBVIRT_STORAGE_POOL_PATH didn't help | 14:41 |
opendevreview | Iury Gregory Melo Ferreira proposed openstack/ironic-inspector master: [DNM] Testing CI with LIBVIRT_STORAGE_POOL_PATH https://review.opendev.org/c/openstack/ironic-inspector/+/840891 | 14:45 |
iurygregory | facepalm, forgot to change the top commit to the one I pushed with the fix | 15:00 |
iurygregory | https://review.opendev.org/c/openstack/releases/+/840921 | 15:00 |
iurygregory | ironic release | 15:00 |
iurygregory | we should be good for the releases once https://review.opendev.org/c/openstack/releases/+/840919 merges | 15:01 |
iurygregory | feel free to ignore the validate failures =D | 15:01 |
* TheJulia glares at CI | 15:05 | |
TheJulia | why do you hate me networking-generic-switch | 15:48 |
dtantsur | have a nice weekend folks o/ | 16:20 |
opendevreview | Julia Kreger proposed openstack/networking-generic-switch master: CI: Swap legacy DSVM job for current grenade job https://review.opendev.org/c/openstack/networking-generic-switch/+/840964 | 16:33 |
iurygregory | z`+ | 16:36 |
TheJulia | okay, figured out why grenade is not happy in multinode | 18:14 |
iurygregory | ironic-inspector-tempest-managed-non-standalone https://zuul.opendev.org/t/openstack/build/77de77ef50cb471e971f355f512320bc : SUCCESS in 1h 00m 20s | 18:41 |
iurygregory | \o/ | 18:41 |
iurygregory | yay | 18:41 |
iurygregory | ohhhh the grenade failure looks like the same from the non-standalone... | 18:59 |
opendevreview | Julia Kreger proposed openstack/ironic master: DNM: Multinode Grenade https://review.opendev.org/c/openstack/ironic/+/840530 | 19:21 |
opendevreview | Iury Gregory Melo Ferreira proposed openstack/ironic-inspector master: [DNM] Testing CI with LIBVIRT_STORAGE_POOL_PATH https://review.opendev.org/c/openstack/ironic-inspector/+/840891 | 19:21 |
TheJulia | iurygregory: the last two lines on my multinode grenade change commit message should shed some light w/r/t multindoe | 19:21 |
iurygregory | TheJulia, ack o/ | 19:22 |
* TheJulia goes and lays down... cold is winning this afternoon | 19:23 | |
iurygregory | take care | 19:25 |
opendevreview | Alexander Lingo proposed openstack/ironic master: Cleanup submitted SNMP driver code for additional PDUs https://review.opendev.org/c/openstack/ironic/+/840986 | 20:34 |
* TheJulia does the grenade ci job seems to be working dance | 20:49 | |
iurygregory | interesting, https://review.opendev.org/c/openstack/ironic-inspector/+/840891 is green (except for l-c) | 20:56 |
iurygregory | TheJulia, should I just drop l-c in the same patch or put as non-voting? | 20:57 |
TheJulia | it is a half dozen either way | 20:59 |
TheJulia | do what makes the most sense, and we can just remove the l-c job in the next patch | 20:59 |
TheJulia | we can't backport it as-is with the l-c change though | 20:59 |
TheJulia | so maybe make it n-v | 20:59 |
TheJulia | and then nuke l-c | 20:59 |
TheJulia | and then undo n-v | 20:59 |
opendevreview | Iury Gregory Melo Ferreira proposed openstack/ironic-inspector master: Fix CI jobs https://review.opendev.org/c/openstack/ironic-inspector/+/840891 | 21:01 |
iurygregory | hummm | 21:01 |
iurygregory | I only removed from the zuul config | 21:02 |
iurygregory | do we need to backport to yoga? | 21:02 |
TheJulia | do we> | 21:03 |
TheJulia | ? | 21:03 |
TheJulia | dunno | 21:03 |
TheJulia | most likey... to be honest | 21:04 |
iurygregory | dunno also, you mentioned backport so I was wondering ... | 21:04 |
* TheJulia needs new sinues and a cure for the common cold | 21:04 | |
iurygregory | I have common cold also, I'm thinking about skipping the exercises today | 21:06 |
TheJulia | I'm waiting for groceries to be delivered... then likely going to bed early | 21:06 |
iurygregory | ++ | 21:06 |
TheJulia | That and the wife's requested ice cream will be in the groceries and she is far more sick than I today | 21:07 |
iurygregory | woot?! | 21:12 |
iurygregory | ice cream?! | 21:12 |
iurygregory | normally I try to avoid cold things when I have a cold | 21:13 |
TheJulia | well, the grenade tests failed, but appeared to get far furhter today | 21:17 |
TheJulia | I suspect we've got a race with neutron networking someplace | 21:17 |
opendevreview | Julia Kreger proposed openstack/ironic master: DNM: Multinode Grenade https://review.opendev.org/c/openstack/ironic/+/840530 | 21:37 |
opendevreview | Alexander Lingo proposed openstack/ironic master: Cleanup submitted SNMP driver code for additional PDUs https://review.opendev.org/c/openstack/ironic/+/840986 | 21:40 |
opendevreview | Alexander Lingo proposed openstack/ironic master: Cleanup submitted SNMP driver code for additional PDUs https://review.opendev.org/c/openstack/ironic/+/840986 | 21:58 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!