Thursday, 2020-05-07

*** rloo has quit IRC00:30
*** mcarden has joined #openstack-ironic00:48
*** xinliang has joined #openstack-ironic00:57
xinliangHello morning, one quick question if I deploy ironic with external dhcp server then how to set the dhcp_provider? neutrion or none?01:00
*** tzumainn has quit IRC01:28
openstackgerrityuanliu proposed openstack/ironic master: If the [conductor]XXX_timeout is less than 0,disable periodic task  https://review.opendev.org/72379501:40
openstackgerrityuanliu proposed openstack/ironic master: If the [conductor]XXX_timeout is less than 0,disable periodic task  https://review.opendev.org/72379501:46
openstackgerritMerged openstack/ironic master: Update grenade job  https://review.opendev.org/72536001:48
*** Qianbiao has joined #openstack-ironic01:51
*** Qianbiao is now known as QIANBIAO01:51
openstackgerritVerification of a change to openstack/networking-baremetal failed: BUILD_TIMEOUT is not needed  https://review.opendev.org/72001602:00
*** jdandrea has quit IRC02:43
*** mkrai has joined #openstack-ironic02:55
*** xinliang has quit IRC03:41
*** mkrai has quit IRC04:06
*** mkrai has joined #openstack-ironic04:09
*** k_mouza has joined #openstack-ironic04:12
*** k_mouza has quit IRC04:16
*** stevebaker_ has joined #openstack-ironic04:26
*** stevebaker has quit IRC04:26
*** QIANBIAO has quit IRC05:07
*** QIANBIAO has joined #openstack-ironic05:07
*** HagunKim has joined #openstack-ironic05:09
*** uzumaki has quit IRC05:19
*** mkrai has quit IRC05:47
*** mkrai has joined #openstack-ironic05:48
*** gyee has quit IRC06:07
*** ociuhandu has joined #openstack-ironic06:17
arne_wiebalckGood morning, ironic!06:52
iurygregorygood morning arne_wiebalck and Ironic o/07:08
*** ociuhandu has quit IRC07:19
*** xinliang has joined #openstack-ironic07:35
*** rpittau|afk is now known as rpittau07:47
rpittaugood morning ironic! o/07:47
*** gokhani has joined #openstack-ironic07:47
iurygregorymorning rpittau o/07:51
rpittauhey iurygregory :)07:52
iurygregorywe didn't have much lucky in inspector =(07:53
arne_wiebalckhey iurygregory and rpittau o/07:53
rpittauhey arne_wiebalck :)07:53
rpittaustill not passing gate ?07:53
rpittauah non-standalone failed us!07:54
iurygregoryrpittau, not because of grenade (well it failed only once I think) other jobs failling -.-'07:54
iurygregoryironic-inspector-non-standalone-tempest =(07:54
*** TheJulia has quit IRC07:56
*** mnasiadka has quit IRC07:56
*** Anticimex has quit IRC07:56
*** sziviani has quit IRC07:56
*** TheJulia has joined #openstack-ironic08:01
*** mnasiadka has joined #openstack-ironic08:01
*** Anticimex has joined #openstack-ironic08:01
*** sziviani has joined #openstack-ironic08:01
*** lucasagomes has joined #openstack-ironic08:06
*** ociuhandu has joined #openstack-ironic08:20
gokhanihi dtantsur|afk I solved my tftp issue and it is now reacheable from ironic node. but now it stuck at downloading NBP file. it can not download NBP file. what can be the reason for this problem ? I can see traffic on tftp server . tftp logs are in http://paste.openstack.org/show/793247/ and dhcp server logs are in08:36
gokhanihttp://paste.openstack.org/show/793254/. I can see pxelinux.0 file under the /tftpboot directory but ironic can not download it.08:36
*** alexmcleod has joined #openstack-ironic08:49
*** livelace has joined #openstack-ironic08:53
*** jtomasek has joined #openstack-ironic08:59
*** k_mouza has joined #openstack-ironic09:07
openstackgerritRiccardo Pittau proposed openstack/ironic master: [WIP] Fix grub2 pxe job with native bionic ovmf  https://review.opendev.org/71688909:15
*** livelace has quit IRC09:16
*** dtantsur|afk is now known as dtantsur09:18
dtantsurgokhani: TFTP was configured by openstack-ansible, right? could you double-check it against https://docs.openstack.org/ironic/latest/install/configure-pxe.html ?09:19
dtantsurgood morning, ironic09:19
openstackgerritDmitry Tantsur proposed openstack/ironic master: redfish: handle hardware that is unable to set persistent boot  https://review.opendev.org/72523909:26
openstackgerritDmitry Tantsur proposed openstack/ironic master: [Trivial] Fix awkward mocking in redfish boot tests  https://review.opendev.org/72591809:26
gokhanidtantsur, yes it vas configured by openstack-ansible. ok ı will check it.09:26
dtantsurrpittau: hey, could you check https://review.opendev.org/#/c/725239/ please?09:26
patchbotpatch 725239 - ironic - redfish: handle hardware that is unable to set per... - 9 patch sets09:26
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: [WIP] Build tinyipa on focal  https://review.opendev.org/72579909:28
iurygregorygood morning dtantsur o/09:32
dtantsurpeople who know or care about inspector: do we have a single reason not to deprecate the iptables PXE filter?09:32
dtantsurasking before I propose it on the ML09:32
iurygregorydo we have an idea how many people uses the filter?09:33
iurygregorywe can try to also ask in our meeting on monday09:34
dtantsurit's the default now, but the dnsmasq PXE filter allows HA configuration09:35
openstackgerritMerged openstack/metalsmith master: Upgrade flake8-import-order version to 0.17.1  https://review.opendev.org/72165809:35
dtantsurOoO defaults to dnsmasq https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/deployment/ironic/ironic-inspector-container-puppet.yaml#L25509:36
openstackgerritDmitry Tantsur proposed openstack/ironic-inspector master: [docs] remove the horribly outdated version support matrix  https://review.opendev.org/72607109:38
iurygregorywe have 3 options iptables, dnsmasq noop09:39
rpittaudefault is still iptables in inspector, but I think it makes sense to just move it to dnsmasq09:39
*** mkowalski[b] has quit IRC09:40
iurygregory++09:40
iurygregorydoes dnsmasq covers all scenarios where iptables would be used?09:40
dtantsurI *think* so (I wish Milan was around for context)09:41
*** irclogbot_1 has quit IRC09:41
*** irclogbot_3 has joined #openstack-ironic09:42
dtantsurat least TripleO has been using it for a couple of releases09:42
dtantsurhjensas: hey, do you have opinion on ^^^?09:42
*** jtomasek has quit IRC09:43
*** sshnaidm|afk is now known as sshnaidm09:44
*** jtomasek has joined #openstack-ironic09:45
*** QIANBIAO is now known as qianbiao|afk09:56
*** qianbiao|afk has quit IRC09:56
iurygregorydtantsur, for stable-queens I think I have and idea that would allow us to check-out the plugin09:56
* iurygregory checks the jobs in stable-queens09:56
*** mkowalski[b] has joined #openstack-ironic09:58
iurygregoryhttp://paste.openstack.org/show/793257/09:59
dtantsuriurygregory: that's probably what is required. can you update rpittau's patch to try it?10:00
iurygregorydtantsur, sure I can give a try10:00
iurygregorywhat version we want from our plugin?10:00
*** xinliang has quit IRC10:00
dtantsureeehhhmmmmm10:00
iurygregoryXD10:00
iurygregoryI'm looking here to see if I can figure out10:01
dtantsurit clearly worked a few months ago10:01
iurygregoryso maybe 1.5.0 or 1.5.110:02
rpittaudid we change default driver for the jobs ?10:02
rpittauso before 2.0.010:02
dtantsurI was about to propose 1.5.1, yes10:02
rpittauok10:02
dtantsurSep 2019, I think stable/queens worked back then\10:02
iurygregoryyou going to update rpittau?10:02
rpittauiurygregory: no, go ahead, you can even push a different patch as I guess with the cap my changes are not needed10:03
iurygregoryrpittau, ok I will give a try10:03
*** jtomasek has quit IRC10:04
*** rpittau is now known as rpittau|bbl10:10
openstackgerritVerification of a change to openstack/ironic failed: Silence debug messages from oslo_messaging  https://review.opendev.org/72578910:11
*** jtomasek has joined #openstack-ironic10:12
gokhanidtantsur, do ı need to install also networking-baremetal plugin and agent ? In my environment I am using linuxbridge10:13
dtantsurgokhani: ideally, you should. they're not strictly required, unless you're using routed networks.10:14
gokhanidtantsur, ok ı will install it and continue step step :)10:17
*** jtomasek has quit IRC10:17
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic stable/queens: Pin ironic-tempest-plugin version  https://review.opendev.org/72608310:18
dtantsurgokhani: if you encounter missing or incorrect setup, please do let the openstack-ansible folks know10:18
iurygregorylet's see how it goes10:18
*** jtomasek has joined #openstack-ironic10:18
dtantsurwe don't have constant contacts with them, so this sort of feedback is valuable10:18
dtantsurthanks iurygregory!10:18
iurygregorydtantsur, np o/ fingers crossed10:18
iurygregoryok seems i need to add "name" before the project -.-'10:20
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic stable/queens: Pin ironic-tempest-plugin version  https://review.opendev.org/72608310:20
*** derekh has joined #openstack-ironic10:21
hjensasdtantsur: iurygregory: regarding inspector filter's. Seems we don't have much issues with the dnsmasq filtering. So switching the default makes sense. Deprecating iptables however not so good, as use with other DHCP server software will break.10:29
dtantsurit's a good point, I wonder if anybody is using ironic-inspector with other DHCP server..10:30
*** ociuhandu has quit IRC10:32
*** ociuhandu has joined #openstack-ironic10:33
hjensashard to know, probably not. but we never stop being surprised of how someone quietly uses software in some corner.10:34
iurygregorytruth10:35
*** k_mouza has quit IRC10:35
iurygregorysounds like a good idea change the default at least =)10:35
dtantsurhjensas: thanks! do you by chance remember why we needed to create the dnsmasq filter?10:36
dtantsurI understand it scales much better, but I don't remember if there were other arguments10:36
*** ociuhandu has quit IRC10:38
iurygregorythe checkout seems to work let's see if the tests will run ok =)10:40
hjensasWhen using a dhcp relay we cannot filter on the MAC because it would be the realy servers mac address.10:40
dtantsurhjensas: so, how does the dnsmasq filter handle it?10:41
hjensasdtantsur: dnsmasq get's the mac from the dhcp payload.10:42
dtantsurah, nice. Thanks for refreshing my memory!10:42
*** ociuhandu has joined #openstack-ironic10:42
*** k_mouza has joined #openstack-ironic10:47
*** mkrai has quit IRC10:48
*** k_mouza has quit IRC10:58
*** ociuhandu has quit IRC11:04
*** ociuhandu has joined #openstack-ironic11:04
*** k_mouza has joined #openstack-ironic11:04
*** k_mouza has quit IRC11:05
*** k_mouza has joined #openstack-ironic11:05
*** ociuhandu has quit IRC11:10
*** livelace has joined #openstack-ironic11:38
openstackgerritMerged openstack/ironic master: Remove testscenarios, testrepository and Babel from test-requirements  https://review.opendev.org/72387111:43
bfourniedtantsur: good morning, so for https://review.opendev.org/725954, should we just make the retry limit configurable?  If we change command_retry_timeout to a lower default it still won't reflect how long command is taking - i.e. its taking 2 minutes when command_retry_limit is 60 seconds, although maybe that doesn't matter11:44
patchbotpatch 725954 - ironic - Limit the number of ipmitool retries - 2 patch sets11:44
iurygregorystable/queens green again \o/11:49
iurygregorybfournie, make it configurable would be good ++11:49
iurygregorydtantsur, it worked \o/ https://review.opendev.org/72608311:51
patchbotpatch 726083 - ironic (stable/queens) - Pin ironic-tempest-plugin version - 2 patch sets11:51
*** rh-jelabarre has joined #openstack-ironic11:55
*** alexmcleod has quit IRC12:03
*** alexmcleod has joined #openstack-ironic12:04
dtantsuriurygregory: nice job!12:10
iurygregoryo/ tks12:10
dtantsurbfournie: command_retry_limit defines the number of retries12:10
dtantsurthe 2 mins vs 60 mins issue is the ipmitool internal problem from our perspective12:10
dtantsurI quite regret having a timeout instead of a number of retries, but I'm not sure it's worth the deprecation dance12:11
*** rpittau|bbl is now known as rpittau12:11
iurygregoryI think the jobs in ironic-inspector had a meeting and they decided that they should fail in one after the other -.-12:14
dtantsurcooperating!12:14
iurygregoryyeah12:14
iurygregoryhey it's your turn to fail now, SURE!12:14
dtantsurwe need to limit the number of jobs for real12:14
iurygregoryyeah12:15
dtantsurI wonder why the inspector jobs are seemingly less stable than the ironic ones12:16
dtantsurI mean, we have fewer jobs on the former..12:16
iurygregoryyeah12:17
iurygregoryand we are still in bionic12:17
iurygregoryI'm just waitting for the nightmare with focal12:17
iurygregory=)12:17
dtantsuroh boy12:17
dtantsuriurygregory: look, what if we merge the "managed" job into the non-standalone one?12:17
dtantsurno, the other way around12:18
iurygregorynon-standalone in managed12:18
dtantsurlet's make the managed job run in split mode?12:18
iurygregorycan be12:18
iurygregoryI can push a patch for that12:18
dtantsurthanks, would be grat12:18
dtantsur* great12:18
iurygregorylet me just grab some coffe =)12:18
dtantsurcoffee++12:19
dtantsurI switched to decaf some time ago, but because the world is in flames, I've started adding strawberry baileys recently.12:20
dtantsurI hope it still counts as healthier?12:20
iurygregoryO.o wait12:20
iurygregorystrawberry + coffe?12:20
dtantsuris it the first time you notice I'm weird? :D12:20
rpittaudtantsur, iurygregory, I think the instability is related mainly in the different times of execution, we're adding complexity and preocesses with inspection and that adds a lot of time, adding variables where we can tweak the timeout I think it will help in the future12:21
iurygregorynah you are not weird12:21
dtantsurrpittau: yep. but it doesn't prevent us from having fewer jobs12:21
iurygregoryrpittau, having the timeouts configurables is a good approach12:21
bfourniedtantsur: ok, the only thing with just using command_retry_timeout is its also used with kill_on_timeout in addition to deriving the number of retries https://github.com/openstack/ironic/blob/master/ironic/drivers/modules/ipmitool.py#L49712:21
jrolldtantsur: I can get behind baileys, but I think caffeine is probably healthier than alcohol :P12:21
jrollmorning all :)12:21
iurygregorydtantsur, when I was at the university i had vodka + strawberry yogurt XD12:22
dtantsurmorning jroll12:22
dtantsuriurygregory: sounds about right12:22
dtantsurbfournie: ugh. that is not perfect.12:23
iurygregorymy friends were: WTF dude?! XD12:23
rpittaudtantsur: no, I'm totally for reducing the jobs, just saying that is one more way to help prevent failures12:23
iurygregorymorning jroll12:23
jroll\o12:23
iurygregorycaffeine with alcohol is better =)12:23
dtantsur... and this is not even Friday yet12:24
iurygregorythats why stouts are good =D12:24
rpittauiurygregory: we call that "caffè corretto" :)12:24
rpittaudtantsur: technically for iurygregory and me is friday :D12:24
dtantsurah, right12:24
bfourniedtantsur: yeah I'm not sure that kill_on_timeout is working as we expect, I don't see it killing ipmitool in this case even though we've exceeded that time /me investigates12:24
iurygregoryyeah12:24
iurygregoryfor me is friday XD12:24
dtantsurrpittau: Germans don't celebrate victory day for obvious reasons :D12:24
jrollhmm, iurygregory says I should add whisky to this coffee? I guess I must12:24
dtantsurbfournie: I *think* kill_on_timeout is off by default12:25
rpittaudtantsur: I don't blame them, Italians also don't :D12:25
iurygregoryjroll, some people mix whisky with beer so why not12:25
jrollindeed12:25
*** ociuhandu has joined #openstack-ironic12:25
dtantsurI'd go for rum with coffee then12:25
dtantsurbfournie: mmm, [ipmi]kill_on_timeout is True by default12:25
bfourniedtantsur: yeah12:26
rpittauwe put "abba ardente" (warm water) in coffee sometimes :)12:26
dtantsurkind of what people call americano?12:26
rpittauit's not literally warm water12:26
dtantsurah!12:26
rpittau:)12:26
dtantsurgotta like euphemisms12:26
jrollneat :)12:27
dtantsurblack tea with brandy is a more Russian thing12:27
dtantsur... and brown sugar if you like it sweet12:28
*** ociuhandu has quit IRC12:28
iurygregorywouldnt be white sugar? O.o12:28
*** ociuhandu has joined #openstack-ironic12:28
dtantsurwhy?12:29
iurygregorybrown sugar is less sweet I would say, or requires lager ammounts compare to the white sugar (but it's healthier)12:29
dtantsurwell, it may be my thing. it's the only case when I put any sugar in tea.12:29
bfourniedtantsur: checking why that kill didn't happen, but anyway my thought was that if we shorten to timeout to affect the num_retries it will also affect this kill_on_timeout functionality, so configurable retry_limit could be useful12:30
dtantsurbfournie: are we really out of options to make ipmitool NOT retry on cipher suite unavailability?12:31
iurygregoryif it provides an specific exception we can handle to not retry I would say12:31
dtantsurbfournie: I don't mind having retry_limit, but then we need to figure out how it's going to work with command_retry_timeout12:31
bfourniedtantsur: haven't heard much from the ipmitool guy except questioning why we do so many rertries12:32
dtantsuriurygregory: we cannot, it's inside ipmitool12:32
iurygregoryouch12:32
dtantsurbfournie: we may be playing on a safe side12:32
iurygregorywe can't check the result?12:32
dtantsuriurygregory: we can, after 2 minutes12:32
bfourniedtantsur: I think it could be used just an upper bound12:32
dtantsurbfournie: not sure I get it, how?12:33
dtantsuryou mean, for killing ipmitool?12:33
dtantsursure, but there is backward compatibility. people might have changed the timeout and expect it to affect the number of retries12:34
dtantsurif we introduce a separate option for retries, we need to be careful with such cases12:34
* dtantsur -> tea (without brandy, unfortunately)12:34
openstackgerritMerged openstack/networking-baremetal master: BUILD_TIMEOUT is not needed  https://review.opendev.org/72001612:36
*** Goneri has joined #openstack-ironic12:37
openstackgerritVerification of a change to openstack/ironic failed: Add timeout and retries to JSON RPC client  https://review.opendev.org/72588312:38
bfournieiurygregory: I meant use retries=command_retry_timeout/interval as we do now, and just not to exceed the new retry_limit, so any changes to timeout would still be used.  The retries wouldn't affect the kill_on_timeout12:38
bfourniesorry meant for dtantsur ^12:40
iurygregorybfournie, this would reduce the number of failures, but we probably want to not retry if the error is persistent (if we can of course)12:41
iurygregoryif the command fails and the output would tell that it was because of the cipher we can avoid running retry I think12:41
bfournieiurygregory: these are just the retries passed to ipmitool, if there is a peristent connection failure for example ipmitool will not retry12:42
iurygregoryoh12:42
iurygregorygotcha12:42
bfournieiurygregory: we're not doing the retry, ipmitool is12:42
iurygregoryok I thought we have the controll inside the python code =)12:43
bfournieiurygregory: unfortunately no12:43
iurygregoryok so that is a bit more complicated D:12:43
dtantsurbfournie: it won't cancel out the backward compatibility issue that will prevent this change from being backportable..12:46
dtantsuri.e. we'll have to default retry_limit=None (meaning, do as before)12:46
dtantsurI'm not against what you propose, just trying to think how to make it most useful12:46
bfourniedtantsur: yeah, we could also do rety_limit=timeout/interval as default, so there would be no change12:47
* dtantsur thinks12:47
bfourniedtantsur: doesn't like adding this extra config but trying to make it useful for users12:48
dtantsurbfournie: let's do what you propose (with a new option) and let's change the option to something smaller on master only (in a separate change with its own release note)12:49
dtantsurthen we can consider what to do with tripleo/downstream12:49
bfourniedtantsur: ok sounds good, should we backport rety_limit=timeout/interval as default in Train and keep it smaller by default in master?12:50
dtantsurbfournie: exactly (hence two patches)12:51
bfourniedtantsur: good, thanks12:51
dtantsurbfournie: np, thank you for looking into it. I still believe we need to solve it with ipmitool people. Whatever we use as a new timeout, it's not great to hit it literally every time.12:52
dtantsurwe can cut it 3x, but it's still 40 seconds12:53
*** jdandrea has joined #openstack-ironic12:53
bfourniedtantsur: yeah I think so to, there is definitely an ipmitool issue there12:54
dtantsurbfournie: I suggest we also add an option to specify a cipher suite explicitly (if we don't have one yet)12:54
dtantsurwanna look into that or should I?12:54
dtantsur(asking because it'll probably conflict with your patch)12:55
bfourniedtantsur: good point, we don't. HP works fine with CS 3, but supposedly others don't. I will look into this12:55
dtantsurgreat, thanks!12:55
bfourniedtantsur: it would have to be separate, no backport for that I would think12:56
dtantsuryeah, there are two sane suites in existence, 3 and some high number12:56
bfourniedtantsur: 17?12:56
dtantsurbfournie: it would have to bee separate and I can make a case to backport that even though it looks like a feature12:56
dtantsuryeah, 1712:56
dtantsur"My hardware does not work without specifying a suite explicitly" is a strong enough reason for backport12:56
iurygregory^ agree12:57
dtantsur(and something I'm trying to make official in the proposed release model)12:57
iurygregory"Why does Ironic hate me?" "It doesn't hate you, the hardware hates us all!"12:57
dtantsur+++12:58
iurygregorybest thing I saw yesterday =D12:58
dtantsuryeah :) I seriously want a t-shirt with that.12:58
iurygregory^ yup12:58
dtantsurI'd also send it to all people who assume they can make it simpler than ironic12:58
dtantsur(esp. by Just Rewriting It In Go (tm))12:58
iurygregoryand we can have the bear doing a heart  XD12:58
dtantsurI was thinking about a bear and a redfish eating each other12:59
dtantsura bit darker theme, but we can have variations :D12:59
iurygregoryhehehehe12:59
iurygregoryone fish in each hand12:59
iurygregoryone trying to bite the other12:59
iurygregoryhehehehe12:59
dtantsuryep12:59
* dtantsur wonders if any recent hardware still enables cipher 013:01
dtantsurcipher 3, I think, is AES256+MD5, cipher 17 is AES256+SHA256(?)13:02
TheJuliagood morning13:11
rpiosoGood morning, ironic13:11
rpiosoTheJulia: o/13:11
*** uzumaki has joined #openstack-ironic13:14
dtantsurmorning TheJulia13:15
dtantsurwe've declared Friday and started discussing drinks already13:15
dtantsuralso morning rpioso13:15
rpittaugood morning TheJulia and rpioso  :)13:15
uzumakimorning ironic! o/13:16
dtantsurhi uzumaki13:16
rpittauhey uzumaki :)13:17
uzumakihey dtantsur ! how's it oing?13:17
dtantsursee above :D13:17
TheJuliadtantsur: already?!?13:17
uzumakirpittau, hola! how are you?13:17
TheJuliadtantsur: should I even ask why?13:17
TheJuliacan I at least have coffee first13:17
TheJulia?13:17
uzumakidtantsur, all I see is the message about declaring friday as something, and what's that?13:17
TheJulia#amillionquestions13:17
dtantsurIt was mostly without context (although the CI is misbehaving)13:17
rpittauuzumaki: all's good, it's technically-friday :)13:18
dtantsuruzumaki: not Friday as something, but today as Friday :)13:18
dtantsurTheJulia: I think I started it when coffee was last mentioned with: $ I switched to decaf some time ago, but because the world is in flames, I've started adding strawberry baileys recently.13:18
uzumakioh, really? what timezone are you? here in Pakistan it's thursday evening13:18
dtantsuruzumaki: iurygregory and rpittau are in a timezone that has a public holiday tomorrow :)13:19
TheJuliaI'm in US Pacific, so just getting up13:19
dtantsur(May 8th, Victory day)13:19
dtantsurnot quite a victory day here though :D13:19
iurygregorygood morning TheJulia o/13:19
uzumakidtantsur, that's so cool! holidays are always great13:19
rpittauI'm stealing French victory day :P13:19
uzumakidtantsur, lol13:19
iurygregorymorning rpittau, uzumaki o/13:19
TheJuliarpittau: ++13:19
iurygregoryand I'm stealing Czech Victory day XD13:19
TheJuliarpittau: iurygregory: so no planning for you guys tomorrow?13:19
rpittauiurygregory: morning! :D13:19
uzumakimorning iurygregory ! o/ how's it going? you're going to be celebrating this victory day as well?13:19
iurygregoryTheJulia, I can show up without problems13:20
iurygregoryonly for the planning ofc =)13:20
TheJuliaI don't want to take away from celebration of a holiday or time away from the evil computers13:20
*** ociuhandu has quit IRC13:20
*** ociuhandu_ has joined #openstack-ironic13:20
iurygregoryuzumaki, I have nothing to celebrate hehehehe XD since I'm from Brazil lol13:20
dtantsurmove planning to Monday?13:20
dtantsursorry, we shouldn't be discussing downstream meetings here13:20
TheJuliahttps://giphy.com/gifs/evil-hacker-hEMF9k5UHh2U013:20
iurygregoryyeah13:21
rpittaumove Mondays ?13:21
uzumakiiurygregory, but you're in CZ, don't they share this holiday with other european countries?13:21
dtantsurnot with Germany for sure13:21
iurygregory^ yeah13:21
uzumakidtantsur, ah well, that's too bad13:21
TheJuliaI'll poke bfournie downstream13:21
iurygregoryI'm not even sure how was history here in Czech Republic13:21
dtantsuriurygregory: Czechia was on the right side of the conflict13:22
iurygregorydtantsur, gotcha13:22
dtantsurI don't remember when exactly it was freed, presumably early spring 194513:22
dtantsuror late winter13:23
* uzumaki thinks it's clever how dtantsur said "right side of the conflict" ;)13:23
TheJuliaquestion sent13:23
TheJulianow, caffination must occur13:23
dtantsuruzumaki: there is a wide consensus nowadays which side was right :)13:23
dtantsurthanks TheJulia13:23
uzumakii just like the pun xD dtantsur13:23
dtantsur:)13:24
openstackgerritMerged openstack/ironic-tempest-plugin master: Add stable/ussuri job on master gate  https://review.opendev.org/72572813:25
dtantsurwhen is the next SPUC by the way?13:26
TheJuliai don't konw13:26
TheJuliaI've been insanely busy and trying to battle off the daemons of depression13:27
dtantsurTheJulia: I hope you succeeded, these daemons are insanely fierce13:27
iurygregoryTheJulia, you can do it o/13:27
TheJuliaI'm fairly strong, just... yeah13:27
dtantsurthere is a mild consensus for this Friday https://doodle.com/poll/2q5zmv3g6uy2475e13:28
TheJuliait doesn't help there are like a million hanging threads in personal life13:28
iurygregoryand if you need help you can ask us \o/13:28
dtantsur++13:28
*** HagunKim has quit IRC13:29
iurygregoryajya, you had some problems in your backport to stable/queens if I do remember, after https://review.opendev.org/#/c/726083/ is merged you can put a recheck on your patches13:29
patchbotpatch 726083 - ironic (stable/queens) - Pin ironic-tempest-plugin version - 2 patch sets13:29
TheJuliaI guess the 9am winidow will work, I'm fairly sure they won't need me on the one conflict13:30
dtantsurTheJulia: 9am is 2pm UTC?13:30
dtantsur(the doodle is in local time for everyone)13:30
TheJuliauhh13:30
TheJulia4pm UTC13:31
*** tzumainn has joined #openstack-ironic13:31
dtantsurah, the one with 4 votes?13:31
TheJuliawell, if we move the downstream meeting to next week13:32
TheJuliathen we can start an hour earlier13:32
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: Change ownership of tce info dir  https://review.opendev.org/72611913:32
dtantsur++ I like the idea13:32
dtantsurasking people to work on the holiday is one thing, to wear a silly hat and chat - another13:32
TheJuliabob's moving the downstream meeting13:32
dtantsurcool. so, 3pm UTC? could you respond to the thread?13:33
TheJuliaon the ml?13:33
dtantsuryeah, I've just responded there, so it should be on the top of your inbox13:33
TheJuliak13:33
* iurygregory completely forgot about the II SPUC <O>13:34
* TheJulia gives the emails coffee to wkae it up13:34
dtantsuriurygregory: if this ever repeats, we'll have to remove you from the position of the SPUC Manager! *shakes his finger*13:35
rpittauheh I won't be there tomorrow for the SPUC :(13:35
dtantsur:D13:35
iurygregory=O13:35
dtantsurrpittau: :(13:35
iurygregoryI was a manager?!13:35
iurygregoryno no I'm only an engineer =P13:35
TheJulialol13:35
dtantsuriurygregory: this IT field, you just blink and they've already given you responsibilities, amiright?13:35
TheJulialol13:35
iurygregoryhehehehe13:35
uzumakiwhat's SPUC?13:36
iurygregorydtantsur, you are correct!13:36
uzumaki(that question might put me below the engineer in the heirarchy xD)13:36
dtantsuruzumaki: http://lists.openstack.org/pipermail/openstack-discuss/2020-March/013521.html13:36
iurygregoryuzumaki, Sanity Preservation Un-Conference13:36
dtantsura way to re-confirm that we're still humans, at least visually and vocally13:37
uzumakiI love that xD13:37
uzumakiwouldn't be surprised if iurygregory was the manager though xD13:37
iurygregoryI'm the manager13:38
dtantsuruzumaki: 3pm UTC may be a bit late for you.. but if you can make it, stop by tomorrow13:38
dtantsur(dunno if we have a video call link yet)13:38
uzumakisure, I'll try to stop by!13:38
iurygregoryuzumaki, I was basically helping TheJulia =)13:38
uzumakiiurygregory, now that's too modest13:39
iurygregoryuzumaki, well that's the truth =) since TheJulia sent the email with the whole idea =)13:40
iurygregoryI only sent an email with a doodle to get a timeslot for the II SPUC =P13:40
uzumakialright, humble human, I shall accept your explanation hereforth13:40
dtantsurJulia is a Principal SPUC Architect13:40
iurygregory^ this13:41
* dtantsur now suspects uzumaki is a cat13:41
iurygregoryLOL13:41
*** jhesketh has quit IRC13:43
*** jtomasek has quit IRC13:45
TheJuliaheh13:46
*** jhesketh has joined #openstack-ironic13:47
*** rloo has joined #openstack-ironic13:47
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic-inspector master: Merge jobs  https://review.opendev.org/72612113:47
TheJuliaso 2pm is 7 am for me, I can start at 8 am but I have a 7 am team leads call13:47
* iurygregory forgot git review in the terminal... -.-'13:47
TheJuliaso if you guys are cool with starting without me!13:47
dtantsurTheJulia: I think we can start at 3pm, most people voted yes for 3-413:47
dtantsurthen whoever can stay will stay13:47
iurygregoryyeah13:48
* dtantsur is not sure he'll last more than an hour anyway13:48
openstackgerritMerged openstack/ironic stable/queens: Pin ironic-tempest-plugin version  https://review.opendev.org/72608313:49
openstackgerritMerged openstack/ironic-inspector master: [docs] remove the horribly outdated version support matrix  https://review.opendev.org/72607113:49
iurygregoryyay stable/queens fixed \o/13:50
iurygregorydtantsur, I had a patch for Ironic to rename the job XD forgot to send13:51
iurygregoryand also the job is non-voting in ironic...13:51
dtantsuriurygregory: dunno, I'd just keep the name..13:51
dtantsurwe cannot encode every fact there anyway13:52
dtantsurbut as you wish13:52
iurygregoryI have the feeling that the name of the job should give an idea of what it does .-.13:52
openstackgerritIury Gregory Melo Ferreira proposed openstack/ironic master: Change the name of the inspector job  https://review.opendev.org/72612413:54
dtantsuriurygregory: okay. but it seems that we have to do a 3-way rename or we'll upset zuul13:56
dtantsurit may not like if we remove a job from under it, even a non-voting one13:56
iurygregoryoh13:56
iurygregory=O13:56
iurygregoryI wasn't aware of that I thougt the job would only TIMED_OUT13:56
iurygregoryand since it's non-voting we wouldn't get -1 from CI13:57
dtantsurdefinitely not, but I wondered if it can SKIP a job13:57
dtantsurit seems that not, see the failure on your ironic patch13:57
dtantsurlet's play it safe and create a temporary duplicate?13:57
iurygregoryyeah13:57
iurygregoryI will rebase the inspector-pacth in 33min if CI merges 72551413:58
iurygregorysince I will have merge conflict13:58
dtantsurwfm13:59
* iurygregory goes back to figure out the cinder deprecation =)13:59
TheJuliadtantsur: sounds good to me14:00
dtantsurTheJulia: wanna reply with the updated time and your bjeans link?14:01
TheJuliayup, doing that now14:01
bfourniedtantsur: not quite clear to me how this poll for kiil_on_timeout is supposed to work but we're not killing these ipmtool sessions because poll isn't set - https://github.com/openstack/ironic/blob/master/ironic/drivers/modules/ipmitool.py#L39614:09
*** ociuhandu_ has quit IRC14:09
*** ociuhandu has joined #openstack-ironic14:10
*** gokhani has quit IRC14:13
*** ociuhandu has quit IRC14:15
dtantsurOUCH14:19
*** uzumaki has quit IRC14:20
iurygregoryofc it will fail -.-' ironic-inspector-non-standalone-tempest tks!14:20
dtantsuriurygregory: is it also timeouts?14:21
iurygregoryDetails: Node c93d27d2-fe9c-4197-88ef-8c9058c6470d reached failure state inspect failed while waiting for provision_state=['manageable']. Error: None14:21
iurygregorylooks like14:21
dtantsur"Error: None", I've wanted to look into it for a while..14:21
dtantsuryou can check the inspector logs to be sure14:22
iurygregoryyeah doing now14:22
*** ociuhandu has joined #openstack-ironic14:24
dtantsuriurygregory: do you have a link to the tempest output? last_error should work, I don't get why it doesn't it14:27
iurygregorylast_error null14:27
iurygregory.-.14:27
dtantsurexactly this I don't understand..14:28
openstackgerritVerification of a change to openstack/ironic-inspector failed: Fix grenade job  https://review.opendev.org/72551414:28
*** ociuhandu has quit IRC14:29
iurygregorythe test fails after 3min it started14:29
*** ociuhandu has joined #openstack-ironic14:29
dtantsurehhmm, yeah14:29
dtantsurand ironic-inspector output has error:null, why is it failed in ironic? O__o14:30
dtantsurError contacting ironic-inspector for inspection of node c93d27d2-fe9c-4197-88ef-8c9058c6470d: HttpException: HttpException: 502: Server Error for url: http://158.69.64.186/baremetal-introspection/v1/introspection/c93d27d2-fe9c-4197-88ef-8c9058c6470d, error was encountered while trying to use an ErrorDocument to handle the request.: Apache/2.4.29 (Ubuntu) Server at 158.69.64.186 Port 80:14:31
dtantsurBad Gateway: response from an upstream server.: Additionally, a 202 Accepted: 502 Bad Gateway: The proxy server received an invalid: openstack.exceptions.HttpException: HttpException: 50214:31
iurygregoryhttps://6294497186881d7ba137-7f38bc6e36f1263ac9d91d77e56fe624.ssl.cf5.rackcdn.com/725514/4/gate/ironic-inspector-non-standalone-tempest/6a16fe9/controller/logs/ironic-bm-logs/node-0_console_log.txt14:31
iurygregorywut :O14:31
dtantsursomething is broken in inspector isefl14:31
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: Change ownership of tce info dir  https://review.opendev.org/72611914:32
dtantsurthere are actually two things problematic here: 1. inspector returns 502, 2. we don't retry it14:32
dtantsurwtf is this https://zuul.opendev.org/t/openstack/build/6a16fe9e33a340b691fe70e10778afb8/log/controller/logs/screen-ironic-inspector-api.txt#84614:32
rpittauwasn't  the job passing ?14:32
iurygregoryrpittau, it's passing14:32
iurygregorywhen it wants to14:32
dtantsurstupid rabbit14:33
rpittauthat looks like rabbit failing hard14:33
* dtantsur asks on #openstack-oslo14:34
iurygregorydtantsur, funny that when the job works there is also this problem14:36
iurygregoryhttps://zuul.opendev.org/t/openstack/build/12eacd0dba41423b8a6a343734517b02/log/controller/logs/screen-ironic-inspector-api.txt14:36
iurygregory=)14:36
*** dsneddon has quit IRC14:36
dtantsurokay, so it's not a root cause14:39
dtantsurwe need to understand why we're seeing HTTP 502 there and why it's not retried14:40
dtantsurI wonder if we can ignore failures while checking inspection status14:41
dtantsurworst case it will eventually time out14:41
dtantsurthoughts?14:41
iurygregorycan be something where we are running the job?14:42
*** tkajinam has quit IRC14:43
iurygregorycheck was running in rax, gate in ovh14:44
rpittaudtantsur: have you seen the DEBUG msg in inspector conductor about iptables ?14:47
dtantsurnope, link?14:49
rpittauhttps://6294497186881d7ba137-7f38bc6e36f1263ac9d91d77e56fe624.ssl.cf5.rackcdn.com/725514/4/gate/ironic-inspector-non-standalone-tempest/6a16fe9/controller/logs/screen-ironic-inspector-conductor.txt14:49
*** jtomasek has joined #openstack-ironic14:49
jrollboo, someone booked a meeting on top of the SPUC, I was going to come this time :(14:51
rpittaudtantsur: it seems the introspection starts btw14:53
iurygregoryhttps://zuul.opendev.org/t/openstack/build/6a16fe9e33a340b691fe70e10778afb8/log/controller/logs/apache/ipxe_access_log.txt14:53
iurygregorywe should be able to see more things no?14:54
dtantsuriurygregory: that's for ipxe only14:54
dtantsurI think inspector itself is run via uwsgi14:54
rpittauyeah14:54
iurygregoryhttps://zuul.opendev.org/t/openstack/build/12eacd0dba41423b8a6a343734517b02/log/controller/logs/apache/ipxe_access_log.txt14:54
iurygregorythis one is when the job is working14:54
*** dking has joined #openstack-ironic14:55
iurygregoryfinally got +1 from CI in the 1st patch of the chain https://review.opendev.org/#/c/687910/14:59
patchbotpatch 687910 - ironic - Add `network_data` field to ironic node object - 31 patch sets14:59
iurygregory\o/14:59
*** jtomasek has quit IRC15:10
JayFTheJulia: jroll: There's another SPUC? When?15:16
dtantsurJayF: tomorrow 3pm UTC15:16
JayFso in 23 hours and 45 minutes, yeah?15:17
dtantsurI believe so15:17
JayFoh crap, I have the same meeting as jroll, damn15:17
JayFsomeone download snap camera and wear a virtual funny hat for me15:17
dtantsur++ iurygregory is a SPUC Manager, he has to15:18
*** mkowalski[b] has left #openstack-ironic15:23
*** livelace has quit IRC15:26
jrolllol15:27
*** gyee has joined #openstack-ironic15:32
*** livelace has joined #openstack-ironic15:34
*** priteau has joined #openstack-ironic15:45
dtantsurrpittau: https://review.opendev.org/#/c/725357/ may (just may) be related to the inspector sadness15:55
patchbotpatch 725357 - ironic-inspector - Monkey patch original current_thread _active - 2 patch sets15:55
rpittauah15:56
rpittauwe need grenade back though first15:57
dtantsuryeah15:57
rpittauor we exclude grenade, merge it, reenable grenade? (piracy)15:58
*** lucasagomes has quit IRC16:08
*** diurnalist has joined #openstack-ironic16:12
openstackgerritBob Fournier proposed openstack/ironic master: Limit the number of ipmitool retries  https://review.opendev.org/72595416:16
iurygregorydtantsur, you think https://review.opendev.org/725357 would help?16:16
patchbotpatch 725357 - ironic-inspector - Monkey patch original current_thread _active - 2 patch sets16:16
iurygregorywe can deactivate grenade, merge it and I can re-enable grenade in my patch16:17
TheJuliarpittau: I'll +2 it if there is somehow a pirate flag attached16:17
TheJuliaascii pirate flag?!?16:18
rpittauarrrrrr16:18
dtantsurwe may need to disable both jobs and start re-enabling them as they get fixed..16:18
rpittaupiracy it is then16:18
iurygregoryLOL16:18
TheJuliait happens, sadly16:19
iurygregoryat least looking at the zuul results in the patch the non-standalone had 0 failures16:19
iurygregoryso maybe it helps and we don't need to put non-voting for it16:20
dtantsurI think what will help is that we should stop failing inspection if we cannot verify its status16:21
dtantsurat least not immediately16:21
dtantsurI'm planning on a patch tomorrow but wouldn't mind if somebody did it today16:22
iurygregorythat makes sense to me16:22
iurygregoryI would help but I need to drop to do the dinner and tomorrow is holiday .-.16:23
iurygregoryrpittau, are you pushing the patch to put the jobs non-voting ?16:23
rpittauiurygregory: yeah16:24
iurygregoryrpittau, ok o/16:24
dtantsurno worries, I'll take care of it tomorrow16:24
dtantsurwhat's so wrong with the CI today? post failures, timeouts, transient failures16:27
dtantsurI guess it's a sign for me to call it a day16:28
*** uzumaki has joined #openstack-ironic16:28
*** dtantsur is now known as dtantsur|afk16:28
dtantsur|afktake care16:28
openstackgerritRiccardo Pittau proposed openstack/ironic-inspector master: Temporary disbling grenade and non-standalone-tempest  https://review.opendev.org/72619816:29
rpittaudtantsur|afk, iurygregory, TheJulia ^16:29
dtantsur|afk+2 and leaving for real16:29
openstackgerritRiccardo Pittau proposed openstack/ironic-inspector master: Revert disable grenade and non-standalone-tempest  https://review.opendev.org/72620016:31
iurygregoryI was going to say it should have voting:false16:31
iurygregory.-.16:31
iurygregorybecause at least we would run with non-voting and we would see results16:31
iurygregoryrpittau, ^16:31
rpittauiurygregory: yeah, I thought the same while pressing enter, too quick16:32
rpittauI'll change that now16:32
iurygregoryrpittau, tks!16:32
iurygregoryI will +2 and will keep and eye to approve16:32
openstackgerritRiccardo Pittau proposed openstack/ironic-inspector master: Temporary disbling grenade and non-standalone-tempest  https://review.opendev.org/72619816:33
iurygregoryawesome!16:34
rpittauI put the revert on top, we should be fine16:34
rpittaubye everyone! o/16:34
*** rpittau is now known as rpittau|afk16:34
*** diurnalist has quit IRC16:35
openstackgerritVladyslav Drok proposed openstack/python-ironicclient master: Allow to pass global request id in node methods  https://review.opendev.org/72591916:35
openstackgerritVladyslav Drok proposed openstack/python-ironicclient master: Allow to pass global request id in port and volume  https://review.opendev.org/72593016:36
openstackgerritVladyslav Drok proposed openstack/python-ironicclient master: Allow to pass global request id for remaining objects  https://review.opendev.org/72594116:36
vdrokhey folks, if someone still willing to review some easy changes ^^ :) chain starts at https://review.opendev.org/725661. it does not look pretty, but conforms to what we had already so that backwards compatibilty is not broken. maybe it's worth to allow passing arbitrary headers in each method, not sure, so opinions welcome16:38
patchbotpatch 725661 - python-ironicclient - Add global_request_id into the base client methods - 3 patch sets16:38
*** sshnaidm is now known as sshnaidm|afk16:46
*** uzumaki has quit IRC16:51
*** derekh has quit IRC16:53
openstackgerritRiccardo Pittau proposed openstack/ironic-python-agent-builder master: Change ownership of tce info dir  https://review.opendev.org/72611916:55
arne_wiebalckbye everyone o/17:08
*** ociuhandu has quit IRC17:19
*** gmann is now known as gmann_afk17:25
*** priteau has quit IRC17:25
*** alexmcleod has quit IRC17:49
*** ociuhandu has joined #openstack-ironic17:57
*** ociuhandu has quit IRC18:03
*** ociuhandu has joined #openstack-ironic18:11
*** ociuhandu has quit IRC18:27
*** ociuhandu has joined #openstack-ironic18:32
*** uzumaki has joined #openstack-ironic18:32
*** ociuhandu has quit IRC18:39
*** ociuhandu has joined #openstack-ironic18:56
*** gmann_afk is now known as gmann19:06
*** ociuhandu has quit IRC19:07
*** ociuhandu has joined #openstack-ironic19:10
*** ociuhandu has quit IRC19:15
*** yaawang has quit IRC19:16
*** k_mouza has quit IRC19:16
openstackgerritVerification of a change to openstack/ironic failed: Silence debug messages from oslo_messaging  https://review.opendev.org/72578919:27
openstackgerritMerged openstack/ironic-inspector master: Fix grenade job  https://review.opendev.org/72551419:28
openstackgerritMerged openstack/ironic-inspector master: Temporary disbling grenade and non-standalone-tempest  https://review.opendev.org/72619819:28
iurygregorywtf CI O.o19:37
iurygregoryhow you merged Fix grenade before we disabled? O.o19:37
iurygregory*magic*19:37
*** livelace has quit IRC19:48
*** dsneddon has joined #openstack-ironic19:56
clarkbiurygregory: they are enqueued in order, it is determinstic19:58
clarkbat 10:28AM clarkb local time https://review.opendev.org/725514 was enqueued to the gate. https://review.opendev.org/726198 was enqueued at 11:20AM19:59
patchbotpatch 725514 - ironic-inspector - Fix grenade job (MERGED) - 4 patch sets19:59
patchbotpatch 726198 - ironic-inspector - Temporary disbling grenade and non-standalone-tempest (MERGED) - 2 patch sets19:59
clarkbthis meant the fix was ahead of the disable change in the queue19:59
*** ociuhandu has joined #openstack-ironic19:59
*** dsneddon has quit IRC20:00
*** k_mouza has joined #openstack-ironic20:05
*** yaawang has joined #openstack-ironic20:32
*** livelace has joined #openstack-ironic20:39
*** gokhani has joined #openstack-ironic20:42
*** stevebaker_ has quit IRC20:59
*** stevebaker has joined #openstack-ironic20:59
*** gokhani has quit IRC20:59
iurygregoryclarkb, gotcha =)21:08
*** ociuhandu has quit IRC21:13
*** ociuhandu has joined #openstack-ironic21:14
*** livelace has quit IRC21:14
*** ociuhandu has quit IRC21:19
*** ociuhandu has joined #openstack-ironic21:20
*** ociuhandu has quit IRC21:36
*** ociuhandu has joined #openstack-ironic21:36
*** ociuhandu has quit IRC21:42
TheJuliastevebaker: you around?22:03
openstackgerritMerged openstack/ironic-inspector master: Monkey patch original current_thread _active  https://review.opendev.org/72535722:04
stevebakerTheJulia: hey!22:16
TheJuliaso I was looking at addding basic auth to ironic's api22:26
*** rh-jelabarre has quit IRC22:27
TheJuliaand kind of wondering if you had some cycles to see what it might take to add native basic auth to ironic's api. I can see pluses to that, and I apache is just easier, but yeah22:28
*** hoonetorg has quit IRC22:34
stevebakerTheJulia: oh yeah that sounds fun. What would the credential store be?22:40
*** hoonetorg has joined #openstack-ironic22:46
*** tkajinam has joined #openstack-ironic22:49
TheJuliastevebaker: I really like the idea of just being able to read from a file using the same format as apache/nginx22:53
NobodyCamthat would be kinda cool22:54
stevebakerTheJulia: yep cool, I'm on it.22:54
TheJuliastevebaker: tagged you on a downstream jira, I don't remember if I've created an epic yet, but I think the key is just first step, think through it  and get a basic idea together22:55
TheJuliaalso... that makes it much easier to navigate our security differences around the ramdisk endpoint22:55
*** kbaegis has joined #openstack-ironic22:56
stevebakerTheJulia: ramdisk endpoint? is this a thing that exists?23:00
TheJuliayeah, /v1/ramdisk23:01
TheJuliaso /v1/ramdisk/lookup and /v1/ramdisk/heartbeat23:01
stevebakerTheJulia: ah, spec says /v1/lookup, /v1/heartbeat https://docs.openstack.org/api-ref/baremetal/#utility23:03
TheJuliaoh, it is ramdisk.py23:11
TheJuliaso yeah, your right about the actual endpoints23:14
TheJuliain the rest api, just brains23:14
*** spotz has quit IRC23:16
*** k_mouza has quit IRC23:18
*** dsneddon has joined #openstack-ironic23:18
stevebakerTheJulia: cool, so the ramdisk paths are public currently, but they would be covered by basic auth?23:23
TheJuliastevebaker: no, they can't be23:27
TheJuliabecause the ramdisk still needs to be able to call home23:27
stevebakerTheJulia: ok, I'll do some research23:35
*** kbaegis has quit IRC23:41
*** rloo has quit IRC23:51
*** gyee has quit IRC23:54

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!