Wednesday, 2017-11-01

leitanTheJulia: can be security groups an issue ?00:02
*** baoli has quit IRC00:03
*** rama_y has quit IRC00:06
*** penick has joined #openstack-ironic00:07
*** etingof has quit IRC00:13
*** links has joined #openstack-ironic00:20
*** charcol has joined #openstack-ironic00:43
*** penick has quit IRC00:43
*** etingof has joined #openstack-ironic00:51
*** zhangfei has joined #openstack-ironic00:57
*** baoli has joined #openstack-ironic01:02
*** baoli has quit IRC01:06
*** phuongnh has joined #openstack-ironic01:13
*** fragatina has quit IRC01:14
openstackgerritRuby Loo proposed openstack/python-ironic-inspector-client master: TEST. Please. Ignore.  https://review.openstack.org/51680501:21
*** leitan has quit IRC01:24
*** mjturek has quit IRC01:24
*** AlexeyAbashkin has joined #openstack-ironic01:26
*** AlexeyAbashkin has quit IRC01:31
*** baoli has joined #openstack-ironic01:44
zhangfeimorning01:45
zhangfeiCould you help review diskimage-builder on aarch6401:45
zhangfeihttps://review.openstack.org/51217401:45
zhangfeihttps://review.openstack.org/51217501:45
patchbotpatch 512174 - diskimage-builder - Fix grub2 dependency on arm6401:45
patchbotpatch 512175 - diskimage-builder - Add debian minimal requirement for arm6401:45
*** penick has joined #openstack-ironic01:49
*** namnh has joined #openstack-ironic01:53
*** hw_wutianwei has joined #openstack-ironic01:58
*** hshiina has joined #openstack-ironic02:00
*** baoli has quit IRC02:06
*** zshi has joined #openstack-ironic02:14
*** zhangfei has quit IRC02:18
*** zhangfei has joined #openstack-ironic02:19
*** zhangfei has quit IRC02:20
*** zhangfei has joined #openstack-ironic02:20
openstackgerritMerged openstack/ironic master: Update ironic.sample.conf  https://review.openstack.org/51624502:24
openstackgerritMerged openstack/ironic master: Small fixes in the common reference architecture docs  https://review.openstack.org/51637602:24
*** penick has quit IRC02:26
*** AlexeyAbashkin has joined #openstack-ironic02:26
*** AlexeyAbashkin has quit IRC02:30
*** yangyapeng has quit IRC02:42
*** yangyapeng has joined #openstack-ironic02:47
*** ijw has quit IRC02:50
*** ijw has joined #openstack-ironic02:50
*** rbudden has quit IRC02:50
*** ijw has quit IRC02:51
*** etingof has quit IRC02:57
*** hshiina has quit IRC02:58
*** dtantsur|afk has quit IRC03:01
*** etingof has joined #openstack-ironic03:10
*** rama_y has joined #openstack-ironic03:22
*** ijw has joined #openstack-ironic03:24
*** fragatina has joined #openstack-ironic03:26
openstackgerritNguyen Van Trung proposed openstack/ironic master: Add additional capabilities discovery for iRMC driver  https://review.openstack.org/41734703:26
*** fragatina has quit IRC03:28
*** fragatina has joined #openstack-ironic03:28
*** etingof has quit IRC03:31
*** fragatina has quit IRC03:33
*** etingof has joined #openstack-ironic03:43
*** etingof has quit IRC03:48
*** zhangfei has quit IRC03:54
*** etingof has joined #openstack-ironic04:01
*** gcb_ has quit IRC04:04
*** gcb_ has joined #openstack-ironic04:05
*** hshiina has joined #openstack-ironic04:12
*** zhangfei has joined #openstack-ironic04:14
openstackgerritNguyen Van Trung proposed openstack/ironic master: Add additional capabilities discovery for iRMC driver  https://review.openstack.org/41734704:14
*** ijw has quit IRC04:25
*** sasha2 has quit IRC04:30
*** zhangjl has quit IRC04:30
*** etingof has quit IRC04:30
*** zhangjl has joined #openstack-ironic04:31
*** udesale has joined #openstack-ironic04:39
*** etingof has joined #openstack-ironic04:44
*** crushil has joined #openstack-ironic05:10
*** ijw has joined #openstack-ironic05:14
*** ijw has quit IRC05:16
*** ijw has joined #openstack-ironic05:22
*** ijw has quit IRC05:27
*** ijw has joined #openstack-ironic05:36
*** marios has joined #openstack-ironic05:58
*** ijw has quit IRC06:04
*** udesale__ has joined #openstack-ironic06:12
openstackgerritOpenStack Proposal Bot proposed openstack/ironic-inspector master: Imported Translations from Zanata  https://review.openstack.org/51652806:13
*** udesale has quit IRC06:15
*** udesale__ has quit IRC06:18
*** udesale__ has joined #openstack-ironic06:19
*** udesale has joined #openstack-ironic06:21
*** udesale__ has quit IRC06:23
openstackgerritTuan Luong-Anh proposed openstack/ironic master: Follow up Secure boot support for irmc-virtual-media driver  https://review.openstack.org/51686106:44
*** d0ugal_ has quit IRC06:45
*** links has quit IRC06:53
*** d0ugal_ has joined #openstack-ironic06:55
*** jtomasek has joined #openstack-ironic06:56
*** mjura has joined #openstack-ironic07:08
*** mjura has quit IRC07:09
*** mjura has joined #openstack-ironic07:11
*** spectr-RH has joined #openstack-ironic07:12
*** spectr has quit IRC07:13
*** links has joined #openstack-ironic07:20
*** Dinesh_Bhor has joined #openstack-ironic07:23
openstackgerritTuan Luong-Anh proposed openstack/ironic master: Follow up Secure boot support for irmc-virtual-media driver  https://review.openstack.org/51686107:25
*** charcol has quit IRC07:25
*** zhangjl has quit IRC07:29
*** zhangjl has joined #openstack-ironic07:30
*** hoonetorg has quit IRC07:39
*** rcernin has quit IRC07:42
openstackgerritTuan Luong-Anh proposed openstack/ironic master: Follow up Secure boot support for irmc-virtual-media driver  https://review.openstack.org/51686107:42
*** tesseract has joined #openstack-ironic07:48
*** hoonetorg has joined #openstack-ironic07:55
pas-hamorning ironic :)07:57
*** AlexeyAbashkin has joined #openstack-ironic08:07
*** rbartal has joined #openstack-ironic08:11
*** rbartal__ has joined #openstack-ironic08:11
*** rbartal_ has joined #openstack-ironic08:12
*** e0ne has joined #openstack-ironic08:17
*** pcaruana has joined #openstack-ironic08:17
*** Goneri has joined #openstack-ironic08:18
*** dtantsur has joined #openstack-ironic08:23
dtantsurmorning ironic08:23
dtantsurlost part of scrollback, please re-ping if needed :)08:23
*** spectr-RH has quit IRC08:32
*** spectr has joined #openstack-ironic08:33
*** zshi has quit IRC08:39
*** zshi has joined #openstack-ironic08:39
*** d0ugal_ has quit IRC08:42
*** rcernin has joined #openstack-ironic08:42
*** d0ugal has joined #openstack-ironic08:44
*** d0ugal has quit IRC08:44
*** d0ugal has joined #openstack-ironic08:44
*** amarao has joined #openstack-ironic08:47
*** racedo_ has joined #openstack-ironic08:50
*** amarao has quit IRC08:59
*** ccamacho has quit IRC09:00
openstackgerritNguyen Van Trung proposed openstack/ironic master: Add additional capabilities discovery for iRMC driver  https://review.openstack.org/41734709:02
*** priteau has joined #openstack-ironic09:03
*** jistr_ is now known as jistr09:07
*** mgoddard_ has joined #openstack-ironic09:08
*** serlex has joined #openstack-ironic09:12
*** derekh has joined #openstack-ironic09:18
gcb_dtantsur: wondering  if ironic need method from ironic-lib  like  https://github.com/openstack/ironic-lib/blob/master/ironic_lib/utils.py#L6209:20
gcb_https://github.com/openstack/ironic/blob/master/ironic/common/utils.py#L5409:20
*** ralonsoh has joined #openstack-ironic09:20
openstackgerritChangBo Guo(gcb) proposed openstack/ironic master: Fix outdated docstring for _get_root_helper()  https://review.openstack.org/51689709:24
dtantsurgcb_: I think ironic should use one from ironic-lib, if that's your question09:26
*** sulliwan has joined #openstack-ironic09:27
gcb_dtantsur: yes, thanks09:27
gcb_will try to post a patch for that09:28
*** zhangfei has quit IRC09:29
*** lucas-afk is now known as lucasagomes09:31
*** milan has joined #openstack-ironic09:32
milanmorning Ironic! :)09:32
*** lifeless has quit IRC09:32
*** hw_wutianwei has quit IRC09:36
*** etingof has quit IRC09:37
*** ccamacho has joined #openstack-ironic09:37
*** rbartal_ has quit IRC09:37
*** rbartal_ has joined #openstack-ironic09:38
*** ralonsoh has joined #openstack-ironic09:39
*** zhangfei has joined #openstack-ironic09:43
*** rama_y has quit IRC09:43
*** etingof has joined #openstack-ironic09:55
*** jkilpatr has joined #openstack-ironic09:56
*** mat128 has joined #openstack-ironic09:56
*** links has quit IRC09:57
*** jkilpatr has quit IRC10:11
openstackgerritMerged openstack/ironic-inspector master: Imported Translations from Zanata  https://review.openstack.org/51652810:12
*** namnh has quit IRC10:12
dtantsurhey milan10:20
openstackgerritDmitry Tantsur proposed openstack/ironic master: Remove python-oneviewclient from Ironic OneView drivers  https://review.openstack.org/48028410:22
openstackgerritDmitry Tantsur proposed openstack/ironic master: Remove python-oneviewclient from Ironic OneView drivers  https://review.openstack.org/48028410:24
*** parlos has joined #openstack-ironic10:34
*** Goneri has quit IRC10:38
*** udesale has quit IRC10:50
milanmorning dtantsur! :)10:51
*** Goneri has joined #openstack-ironic10:53
milanaarefiev, morning, mind "finishing" review on https://review.openstack.org/#/c/510928/3..4/ironic_inspector/introspect.py? I've implemented your suggestion there10:53
patchbotpatch 510928 - ironic-inspector - Use db transactions when error-finish is called10:53
openstackgerritChangBo Guo(gcb) proposed openstack/ironic master: Simplify the logic of validate_network_port  https://review.openstack.org/51692810:54
*** makowals has quit IRC10:54
*** etingof has quit IRC10:54
*** zhangfei has quit IRC10:55
milandtantsur, btw would <3 your opinion on this one: https://review.openstack.org/#/c/516754/110:55
patchbotpatch 516754 - ironic-inspector - Relax last introspection lock10:55
aarefievmilan: morning, sure, I've missed it was updated10:56
* aarefiev is checking10:56
milanaarefiev, no worries, for some reason zuul removed it's results from it, I've rechecked it last night10:56
dtantsurmilan: to be honest, I feel like -2'ing things that remove locking from inspector.. we've already had enough pain in all parts of body from using a complex db-based schema instead of distributed lock...10:56
milandtantsur, hmmm10:57
*** rcernin has quit IRC10:57
milandtantsur, so you'd be more in favour of using tooz  locks there10:58
dtantsuranyway, this patch is plainly incorrect at first glance ;)10:58
milandtantsur, how comes? :)10:58
dtantsuroh wow, it's even worse at the 2nd glance10:59
*** sambetts|afk is now known as sambetts10:59
dtantsurinitially I thougt you're misunderstanding the goal of this lock. however, now I see you're replacing the wait with an error. that's a no-go.10:59
dtantsurand it seems racy10:59
dtantsurwell, yes, I've been advocating for not using database for locking since day 0, but I was in minority :-/11:00
milansort of a best-effort thing: 409 try later11:00
dtantsurno. no. no. no. no11:00
dtantsurno.11:00
dtantsurno.11:00
dtantsurplease11:00
dtantsurthis is a breaking change, and we have enough of this 409 in ironic11:01
milanthat would have been my argument: ironic does that O:-)11:01
* aarefiev hehm gerrit hangs and post msg few times11:02
sambettsyeah I'm seeing the same thing11:02
sambettsaarefiev: ^11:02
dtantsurmilan: search our bugzilla over "node is locked by host"11:02
*** lifeless has joined #openstack-ironic11:02
milanmorning sambetts! :)11:03
aarefievmorning sambetts, dtantsur11:03
milandtantsur, hmm, right but a 409 seems more fair towards the user than a 202 with an eventual failure ;)11:03
milanone can always retry in the client, server's more tricky11:04
dtantsurwhy eventual failure? it's working right now, e.g. in case of tripleo11:04
milanif fails, it's not reported11:04
milan* to the caller11:04
dtantsurmilan: please submit an update to tripleo workflows first then. that'll teach you how easy it is ;)11:04
milan:D11:04
dtantsursorry, what fails? we merely wait for several seconds, then proceed as normal. that make it work in 99% of cases.11:05
dtantsurif we do this, then we should just remove this option completely, and let the caller ensure this delay11:05
dtantsurwhich is something that caused users a lot of pain around Kilo or Liberty, I think11:05
milandtantsur, I mean if you have concurrent calls for same node , it is being retried, when ironic says: 409 node locked by .... what I meant... iirc it's some ~30 retries before giving up11:06
milanbut no worries11:06
* milan reads on :)11:06
milandtantsur, you mean like removing the lock altogether?11:07
*** etingof has joined #openstack-ironic11:07
dtantsurwe used to not have this lock, and it was painful11:08
dtantsurnow your change will break anyone who runs more than 4-5 introspections in parallel11:08
dtantsurwait, it will break anyone who runs even 2 in parallel11:08
milanactually I've just got a crazy idea: if dnsmasq and inspector are (in tripleo, eventually) packed together in a single container, then the lock actually protects the dnsmasq and can stay as it's still functional (mind the disjoint DHCP pools)11:09
dtantsurbut if you simply remove the lock and the feature, it will break people who run 4-5 introspections11:09
milandtantsur, why you think? I't would tell them: retry on one of them (it's inside a transaction)11:09
sambettsin kolla dnsmasq and inspector are separate containers, and IMO should be separate containers11:09
dtantsurmilan: yes, and their scripts will fail, because they don't handle 409 now11:10
dtantsurthis is what a breaking change means - what worked starts giving HTTP error11:10
milandtantsur, ahh....hmmmm11:10
dtantsursambetts: will our iptables magic work this way?11:10
milansambetts, why do you think it's better in separate containers?11:11
*** phuongnh has quit IRC11:11
milandtantsur, so if I implemented it with waiting, but with the select, would it be OK?11:12
sambettsdtantsur: yes, the inspecotr and dnsmasq containers have to run has net=host anyway so they share a net namespace11:12
sambettsmilan: because a dnsmasq container is reusable11:12
sambettsmilan: and pretty standard11:12
dtantsurmilan: I suspect the database code is racy. what if 2 processes do the same select?11:12
dtantsurand then the same check succeeds for them11:13
nicodemosgood morning, ironic.11:13
milandtantsur, it's in a transaction, one of them suppose to pass11:13
dtantsurmilan: selects? they're not affected by transactions in some transaction modes11:13
dtantsurhey nicodemos11:13
milandtantsur, it's inside of the start introspection11:13
milanmorning nicodemos! :)11:13
milandtantsur, which in turn is in write session so one of them should pass11:14
nicodemosthanks for the reviews and hey milan. :)11:15
nicodemosdtantsur :P11:15
dtantsurmilan: wait, what are we talking about? the "select" statement on line 659 can return the same result for 2 nodes, and these 2 nodes will run introspection simultaneously11:15
dtantsurfor 1 node - yes, transaction will prevent it, I think11:15
milandtantsur, but that's the point of a transaction, no?11:16
* milan might be missing some info though11:16
dtantsursorry, I don't get it. transaction does not lock tables completely IIRC11:16
dtantsuryou have 2 processes updating two different rows, why should any of these transactiosn fail?11:17
milandtantsur, yeah, fair point, that seems the bit I missed indeed: the transaction locks a row, not a table11:19
dtantsurright11:19
dtantsurif it locked a table, we would be in trouble with scaling :)11:19
milandtantsur, correct11:19
milanthough honestly the odds are quite low for a race at the same time ;) so it may be a good trade off (supposing I update docstrings and implement a waiting/retry logic), no? O:-)11:21
*** serlex has quit IRC11:21
* milan still hopes he could get away with it :D11:21
milanit's called relaxing after all ;)11:21
* dtantsur takes a deep breath11:21
milanlol :D11:21
dtantsurmilan: first, if we bother with HA work, "odds are low" is not an argument. weren't it you who was talking about thousands of introspections? ;)11:22
dtantsurmilan: second, the odds are not so low. it's a very common case to launch a lot of introspections at the same time11:22
milandtantsur, fair enough, the argument should be complete ;)11:23
milan* now, from my pov11:24
*** bfournie has quit IRC11:28
milansambetts, how about the container being a blackbox that ships both the parts of the service needed to complete the introspection11:28
milan* both/all including the config11:28
*** bfournie has joined #openstack-ironic11:28
sambettsdepends on your outlook on containers, from my perspective I'm working with k8s so in that case the containers are self contained processes, and the pod and helm chart includes all the configuration and provides it to the container at deploy time11:30
sambettsso in this case container == process separation11:30
sambettsand trasportability11:30
sambettsbut in your case a container == service separation and transportability11:31
milanhmmm, yeah, my point was more like service I think; esp. because both inspector and dnsmasq should be turned off together11:31
sambettsinspector can run without dnsmasq though11:32
milanto prevent unprotected dnsmasq interfering with e.g deploy11:32
*** e0ne has quit IRC11:32
sambettsand I could deploy a different DHCP servicer11:32
*** asane has joined #openstack-ironic11:32
*** bfournie has quit IRC11:32
sambettsin your case I'd have to completely rebuild and redeploy eveyrthing, in my case I'd just swap out the dnsmasq container for a differnet dhcp service11:33
sambettsand in cases when we're using vmedia for inspection (incomplete but on its way) you might not need dnsmasq/dhcp at all11:33
milanfair point, you'd just change a driver11:34
sambettsand when you are deploying bifrost, you just deploy one dnsmasq container11:34
milanhow about the turning off? isn't the configuration/dependency of this couple "leaking"?11:34
sambettsto serve for both ironic and inspector11:34
*** e0ne has joined #openstack-ironic11:35
milansambetts, because you may need the dnsmasq to serve ironic but the other dnsmasq to be shut off?11:35
*** asane_ has joined #openstack-ironic11:35
sambettsin the case of dnsmasq thats a configuration thing, not a service level thing, e.g. you should just change the config in dnsmasq not run two instnaces of DNSmasq11:37
sambettsthere are some scenarios when you might run two dnsmasq but then the ironic one and the inspector one will using the same container images, and just run two instances of it11:38
sambettswith different configs11:38
milanI may be missing some information, so if inspector fails how would the dnsmasq be reconfigured as to not allow the inspection image to boot? How is it done now in your case?11:40
sambettsif inspector fails? the service is broken?11:41
milanyup11:41
milanif e.g oom kills inspector11:41
*** asane has quit IRC11:43
sambettsyou'd just remove the default file from dnsmasq's config right?11:43
sambetts /from the tftpboot dir11:43
milanyeah, though I'd prefer it being removed automatically ;)11:44
milanI mean what process/controller/thing would disable the booting11:44
milanto prevent the collisions11:44
sambettsin the case of k8s, the containers are deployed as a pair, if one dieds then the pods is marked dead11:45
milanso the information about their mutual dependency "leaked" the container in favour of k8s configuration, no?11:46
milanbut maybe it's cool, I dunno11:46
*** ccamacho has quit IRC11:46
milanalso other thing, they always have to be scheduled on the same node, correct?11:46
*** jcoufal has joined #openstack-ironic11:47
milans/they/ inspector and it's dnsmasq sidekick11:47
sambettsyeah, in k8s thats what a pod does11:47
* dtantsur has to refill his coffee supply, back in an hour or two11:48
sambettsnp11:48
*** dtantsur is now known as dtantsur|bbl11:48
milanso to me it sounds the decoupling from other services  it's better if they're part of a single container rather than the case of a shared dnsmasq11:48
openstackgerritChangBo Guo(gcb) proposed openstack/ironic master: Leaverage oslo.log default log levels  https://review.openstack.org/51697011:48
milandtantsur|bbl, have a good one! :) thx for the feedback!11:49
milanthough I agree it sacrifices a bit of flexibility11:49
* milan prefers decoupling11:50
*** jcoufal_ has joined #openstack-ironic11:50
*** dprince has joined #openstack-ironic11:52
milanalso, if they're packed together it means they're integrated (tested, configured, debugged) and one should not worry about issues integrating on their own; so UX should be better11:53
sambettsmilan: yeah depends on your outlook on containers, like I said kolla focuses on microservice separation so you have ironic-api ironic-conductor ironic-inspector dnsmasq, and then OSA uses "fat" containers so you have an ironic container or a nova container11:53
*** jcoufal has quit IRC11:54
milansambetts, right, gonna be tradeoffs I guess, not a single solution that suits them all11:54
*** hw_wutianwei has joined #openstack-ironic11:54
*** jlabarre has joined #openstack-ironic11:54
milansambetts, do you think it would be possible to have both ways live together for the different usecases/outlooks?11:55
* milan very keen on having them packed together if the dnsmasq-based filter is used for inspector11:56
*** bfournie has joined #openstack-ironic12:04
*** lucasagomes is now known as lucas-hungry12:04
*** zhangfei has joined #openstack-ironic12:04
*** litao__ has quit IRC12:06
*** weshay|PTO is now known as weshay12:09
openstackgerritChangBo Guo(gcb) proposed openstack/ironic master: Simplify the logic of validate_network_port  https://review.openstack.org/51692812:09
openstackgerritChangBo Guo(gcb) proposed openstack/ironic master: Simplify the logic of validate_network_port  https://review.openstack.org/51692812:12
*** udesale has joined #openstack-ironic12:18
*** jcoufal_ has quit IRC12:21
*** jcoufal has joined #openstack-ironic12:23
*** trown|outtypewww is now known as trown12:25
*** rbudden has joined #openstack-ironic12:26
*** leitan has joined #openstack-ironic12:26
leitanMorning metalers12:27
leitananyone with experience with UCS fiber channel connected servers ?12:28
*** catintheroof has joined #openstack-ironic12:28
leitanim about to make it but ... Error finding the disk or partition device to deploy the image onto: No suitable device was found for deployment using these hints12:28
leitanso im guessing that the coreOS image is not finding via FC my disk12:28
leitani have hinted the wwn12:29
leitanbut maybe its a driver issue12:29
leitanmaybe TheJulia sambetts ?12:30
* TheJulia reads12:32
TheJuliaAlso o/ from somewhere over the pacific12:33
sambettsTheJulia: oooo nice views?12:33
TheJulialeitan: You likely need a different ipa image, maybe Debian or fedora. Something that ships the FC drivers12:33
TheJuliaFor the habit12:33
TheJuliaErr HBA12:34
Tengu-.- why did I read "For the hobbit" ?!12:34
sambettsleitan: I'm not sure on that one, I've had little experience with our (/me is from Cisco) FC stuff, but I would expect that it is a driver thing12:34
TheJuliasambetts: no view, call for a doctor or paramedic a little while ago : (12:34
sambetts:(12:34
TheJuliaWe didn’t turn, so I guess we’re not diverting to Hawaii12:36
leitanTheJulia:  :(  many hours to go ?12:36
TheJulia9-ish, I think12:36
leitannot that bad, i still remember my 36 hours flight + stops to the Hong Kong summit12:37
leitanok, ill try why another ipa image, and make sure that has the HBA driver12:37
leitanor maby try to use pxe_ucs and agent_ucs first12:39
leitanas driver for the node12:39
sambettsleitan: the ironic Cisco drivers won't make a difference to that, they only provide as much control as IPMItool12:39
*** zhangfei has quit IRC12:39
sambettsleitan: e.g. power, and boot device etc12:39
*** crushil has quit IRC12:40
leitansambetts: i was actually reading the driver code now, and yes, besides some api calls to the ucs manager12:40
leitannothing magical there12:40
*** asane_ has quit IRC12:40
leitanhmmm, i think ill go with the images shipped with the Red Hat director ...12:42
leitanif those guys doesnt have the FC driver on it12:42
leitannobody does :P12:42
sambettshaha, if not you can build an image using DIB and include additional packages that way (although I don't know what those packages names are)12:44
milanmorning leitan, Tengu, TheJulia! :)12:46
leitansambetts: haha, me neither, so ill go with that first ... director deploys bareemtal on UCS so should be there waiting for me to succeed on this12:47
* TheJulia should try and go back to sleep12:47
leitanMorning milan !12:47
leitanDid you take some sleeping pills TheJulia ?12:47
Tengu'ternoon milan :)12:47
milan:)12:48
leitan9:47 am here in Argentina :P12:48
milanTheJulia, what works for me it's 2xIPA (pun intended) ;)12:48
TheJulialeitan: I think I’ve gotten three or so hours, which is not horrible12:48
leitannot bad really12:49
TheJuliaYeah, Hopefully maybe ice cream will appear shortly12:49
leitansugar and sleeping are not friends :P12:50
TheJuliaIndeed12:50
leitanbuy your best friend maybe haha12:50
TheJuliaHmm... the cats must be up. I keep getting alerts for video12:50
leitanbuy -> but12:50
leitani remote feed my cats with and IR servo powered arduino :D12:52
openstackgerritMerged openstack/ironic master: Allow to set default ifaces in DevStack  https://review.openstack.org/51315212:52
openstackgerritMerged openstack/ironic master: Remove unnesessary description for config parameters in cinder group  https://review.openstack.org/51619212:52
TheJuliaI was in a store this week and one of the things they were selling was a cat camera with remote control laser pointer so you can  “play” with your cats remotely12:53
leitanhahaha, got to love iot startups12:55
*** gcb_ has quit IRC12:57
*** gcb_ has joined #openstack-ironic13:00
*** sasha21 has joined #openstack-ironic13:01
*** rloo has joined #openstack-ironic13:02
*** lucas-hungry is now known as lucasagomes13:08
*** fellypefca has joined #openstack-ironic13:10
*** baoli has joined #openstack-ironic13:16
fellypefcaGood morning everyone :)13:16
fellypefcaHey, is the zuul gate broken or did I just get a random error?13:22
sambettsfellypefca: there's nothing on the whiteboard https://etherpad.openstack.org/p/IronicWhiteBoard to indicate things are broken, link to patch?13:24
fellypefcasambetts https://review.openstack.org/#/c/468428/13:24
patchbotpatch 468428 - ironic - Migrate python-oneviewclient validations to Ironic...13:24
fellypefcait's on the multinode-multitenant13:25
sambettsfellypefca: that is a known race condition that can occur, and isn't fixed yet, so best bet is to recheck13:26
fellypefcasambetts oh, ok! thanks :)13:26
rloohi and good morning sambetts, fellypefca13:31
sambettso/ rloo13:31
fellypefcaGood morning rloo :D13:33
*** mat128 has quit IRC13:34
rloodtantsur|bbl: wrt https://review.openstack.org/#/c/516463/, because I authored it, and there are enuf +1 there, I think it is safe for you to +A. TheJulia is probably still on a flight...13:35
patchbotpatch 516463 - ironic (stable/pike) - Add missing job to gate13:35
*** zshi has quit IRC13:37
fellypefcaTheJulia Hi! If you have some time, could you take a look? https://review.openstack.org/#/c/480284/13:37
patchbotpatch 480284 - ironic - Remove python-oneviewclient from Ironic OneView dr...13:37
milanmorning fellypefca, rloo! :)13:48
rloohiya milan!13:49
milanaarefiev, just left you a comment on your comment so you can comment while commenting ;) Thx for the review!13:49
*** MattMan has quit IRC13:49
*** MattMan has joined #openstack-ironic13:49
milanaarefiev, so how about I squeeze the patches with a refactor of the finished?13:49
milanfor the record, milan is talking about https://review.openstack.org/#/c/510928/413:50
patchbotpatch 510928 - ironic-inspector - Use db transactions when error-finish is called13:50
*** Goneri has quit IRC13:51
fellypefcamorning milan :)13:52
*** amarao has joined #openstack-ironic13:53
*** Goneri has joined #openstack-ironic13:53
*** ralonsoh has quit IRC13:59
aarefievmilan: do we need one more method? Could we handle all the stuff in fsm_event?14:00
milanaarefiev, I failed to figure out how14:00
milani thought the same14:00
milanaarefiev, it wouldn't be new method but rather dropping the process_error in favour of a refactored node_info.finished14:01
*** hshiina has quit IRC14:04
*** crushil has joined #openstack-ironic14:04
*** rama_y has joined #openstack-ironic14:05
*** tesseract has quit IRC14:06
aarefievyeah, I thought about dropping process_error as well, but then fsm_event will "smell" I guess14:06
*** mat128 has joined #openstack-ironic14:06
openstackgerritRuby Loo proposed openstack/ironic-inspector master: Zuul: add file extension to playbook path  https://review.openstack.org/51699514:06
*** mat128 has quit IRC14:08
milanaarefiev, maybe, it's still good for the transitions that don't change more state fields; wait and process and maybe enrol (or maybe not)14:10
milanaarefiev, but believe me, I feel worse than you about it cause it's my code :DDD14:10
milan* that sucks14:11
aarefievmilan: it isn't so bad, I don't have better ideas in my mind14:12
aarefievso it works for me14:13
milanaarefiev, txh, you mean to refactor the finished?14:13
aarefievyep14:13
milanand to drop the process_error14:13
milanack14:13
milancool, I'll hack that14:13
aarefievthx14:14
milanaarefiev, btw if you could also revisit the dnsmasq thing that'd be awesome! :) sambetts too :P  https://review.openstack.org/#/c/466448/14:16
patchbotpatch 466448 - ironic-inspector - Introducing a dnsmasq PXE filter driver14:16
*** nicodemos has quit IRC14:16
*** rama_y has quit IRC14:16
* milan updated aarefiev 's input14:16
leitansorry guys quick question, im trying to update the deploy_kernel and ramdisk via openstack cli14:17
leitanim using node set , but can get it right14:18
aarefievmilan, ahh so what the plan for dnsmasq driver testing?14:18
leitansomebody that remember the syntax ?14:18
leitanforget it got it working --driver-info14:19
openstackgerritHugo Nicodemos proposed openstack/ironic master: Get a new OneView client when needed  https://review.openstack.org/51064414:24
*** nicodemos has joined #openstack-ironic14:25
milanaarefiev, so there's the patch that updates the devstack to deploy with that driver14:25
milanhttps://review.openstack.org/#/c/468712/5514:25
patchbotpatch 468712 - ironic-inspector - TEST check dnsmasq PXE filter in devstack14:25
milanthat's been passing for quite a while14:26
milanI've done some manual checks14:26
milanalso anupn did some testing if I'm not mistaken14:26
TheJuliaSo I found out that the current gerrit web-ui doesn’t let iPad users leave in-line comments anymore :(14:26
milanouch14:27
aarefievmilan: so are you planning to add new job?14:27
*** rfolco has quit IRC14:27
milanaarefiev, aah14:27
milanI didn't get your question14:27
aarefievyeah, I mean ci14:28
milandunno, do you think it's a blocker for the merge?14:28
milan:)14:28
milanI mean if you think we need one, let's have one14:28
milanbut so far it seems the patch isn't breaking anyone14:28
TheJuliafellypefca: w/r/t your requested review, I have a nit on the Reno so we don’t feel the need to edit it later. Commented on the review, but also +2’ed. I’d like to see oneview CI reply before wf+114:29
aarefievmilan: no it isn't, I guess, but for sure we need to test it on ci14:29
milanaarefiev, regularly you mean, so later on we'd deprecate the default iptables, correct?14:29
aarefievyeah, if we say that we support dnsmasq driver we need to test it regularly14:31
*** rama_y has joined #openstack-ironic14:31
aarefievor say it's experimental feature14:31
*** udesale has quit IRC14:31
milanTheJulia, how you solved the in-line comments? Firefox works? I'd say it's worth poking the infra about it :-/14:31
milanaarefiev, makes sense14:32
*** windsn has quit IRC14:32
*** fellypefca has quit IRC14:32
TheJuliamilan: you used to be able to go into single page diff view and be able to leave a comment14:32
TheJuliamilan: at least with safari on iOS.14:32
* milan 's OS X safari sometimes freaks out too btw14:33
milanTheJulia, I see, I guess it should be fixed14:33
TheJuliaI’ve never had it freak anymore than chrome on OS X.14:33
*** fellypefca has joined #openstack-ironic14:34
TheJuliamilan: likely, although I’ve been trying to encourage one of the iOS git client authors to add gerrit support.’14:34
*** windsn has joined #openstack-ironic14:34
milanTheJulia, that'd be nice14:35
fellypefcaTheJulia Thank you! We will fix the Reno and investigate the CI issue. :)14:36
milanTheJulia, mine sometimes fails to show the whole page so the control elements aren't accessible so no work unless restart  browser :)14:36
*** fellypefca has quit IRC14:37
*** fellypefca has joined #openstack-ironic14:37
milandtantsur|bbl, would have blamed me for using the OS X :P14:37
TheJuliamilan: fun! I need to go back to Linux native, although hopefully I’ll have a home lab again in a month or two and can just do dev on that.14:39
*** zhangfei has joined #openstack-ironic14:39
milanTheJulia, reminds me of the Dexter's Laboratory cartoon :D14:40
* TheJulia wonders if she could find a low cost cabinet and just sink bolts into the slab....14:40
*** markguz has quit IRC14:42
milanfrankenstein style ;)14:42
*** tesseract has joined #openstack-ironic14:43
rloohi (and good morning even if it isn't) TheJulia, where are you now? :)14:47
rloomilan and inspector folks, up to you to review zuul v3-related patches, eg: https://review.openstack.org/#/c/516784/14:48
patchbotpatch 516784 - python-ironic-inspector-client - Move legacy python-ironic-inspector-client jobs14:48
milanrloo, thx14:49
* milan looks14:49
rloomilan: this one too: https://review.openstack.org/#/c/516995/14:49
patchbotpatch 516995 - ironic-inspector - Zuul: add file extension to playbook path14:49
rloomilan: sorry, the latter one hasn't passed zuul yet14:50
milanrloo, i like the latter one more :DD14:50
milanouch14:50
rloomilan: heh. be glad you didn't submit the patches14:50
milanrloo, thanks for submitting actually14:50
* milan still fights HA these days14:50
rloomilan: we have too many ironic-related projects :-( https://etherpad.openstack.org/p/ironic-zuulv3-intree-tracking14:51
* rloo volunteers to backport inspector zuul-related patches to stable branches. sigh.14:52
milanomg we're the biggest project14:52
rloomilan: really? find that hard to believe14:52
rloomilan: define 'big' !14:52
milanwell based on the number of subprojects ;)14:53
rloomilan: cuz 'big in spirit', yeah, i believe it! :D14:53
milan:D14:53
TheJuliarloo: about 6 hours out from Sydney over the pacific14:53
rloomilan: oh. would have thought neutron would beat us; don't they have a lot of plugins14:53
rlooTheJulia: wow14:53
TheJuliaAnd Good morning14:53
* TheJulia needs to take a nap soon-ish14:53
* milan just saying from the impression of that etherpad ;)14:53
rloomilan: ha ha, good thing pas-ha started that!14:54
milanTheJulia, sleep well!14:54
milanpas-ha ++ :)14:54
milanTheJulia, btw when do you present?14:54
* milan would like to fingers-crossed that time, or what do you say ;)14:55
TheJuliamilan: no, likely what we call tapcon in the states, basically hex head concrete screw.14:55
sambettsneutron only doesn't have more sub-projects because they kicked us all out14:55
TheJuliamilan: uhh, which time :)14:55
milanwe say drzet palce (modulo the punctuation)14:56
milansambetts, there-there :D14:56
* rloo sees that sambetts is still bitter er happy about that neutron decision14:56
*** fragatina has joined #openstack-ironic14:56
milanTheJulia, no issues rounding it up to days :D14:56
milanmost likely gonna be night my time14:56
*** fragatina has quit IRC14:57
sambettsrloo: haha, /me has a business lunch with the new neutron PTL to discuss it in Syndey14:57
TheJuliamilan: Monday and Tuesday, I think.14:57
rloosambetts: good luck. you're paying, right? ;)14:57
milansambetts, that sounds like a serious business lunch :)14:57
*** fragatina has joined #openstack-ironic14:57
leitanguys quick question, i have switches de deploy image from CoreOS to redhat, it boots, the python ironic agent heartbeats ok to /v1/commands 200 OK, and the node is on clean_wait status14:57
leitanbut stays there ...14:57
milanTheJulia, good luck then! :)14:58
leitancan be possible that is actually cleaning ? :O14:58
leitanor just stuck in there doing nothing14:58
* milan -> downstream -> mtg14:58
TheJulialeitan: possibly, console output would be good to check14:58
*** mgoddard_ has quit IRC14:59
sambettsleitan: you could also check the node internal_driver_info field and see if it has clean steps lists14:59
sambettslisted14:59
* milan googled pics of tapcons, ack, should hold better than the frankenstein ones ;)15:00
leitanTheJulia: console output says http://i67.tinypic.com/jpk6f6.png15:01
*** Nisha_Agarwal has joined #openstack-ironic15:01
sambettsleitan: maintenance is false?15:01
rlooTheJulia: I'm good with the changes, but are the non-voting failures ok? https://review.openstack.org/#/c/516389/15:01
patchbotpatch 516389 - bifrost (stable/pike) - Move legacy bifrost jobs in-tree15:01
leitansambetts: is false yes15:01
sambettscool, just making sure :)15:02
leitansambetts TheJulia http://paste.openstack.org/show/625218/15:02
leitannode show with the internal info steps15:02
sambettsleitan:  in the clean_step field is shows you the running step15:04
*** fragatina has quit IRC15:04
sambettserase_devices can take a long time it runs a full shred of the disk15:04
*** rama_y has quit IRC15:04
TheJuliaA very long time, depending on the amount of storage present :(15:05
leitansambetts: maybe finally saw the HD via the fiber channel15:05
leitanand its erasing the 44gb LUN15:05
TheJuliaInteresting that it took such a long time to boot, at least by the second count on the screenshot unless you hit enter a few times and the login screen refreshed15:05
sambettsleitan: \o/15:06
leitanTheJulia: yes i hit enter several times, boot time was normal15:06
leitansambetts TheJulia the agent should be outputting on stdout if is actually erasing something ?15:07
TheJuliarloo: the non voting jobs have a high failure rate due to any transitory issue impacting them. I need to look at the logs, but that is not a in-flight satellite wifi thing.15:07
rlooTheJulia: ok, i looked at the master patch and it was the same there, so I +2'd it :)15:07
*** mat128 has joined #openstack-ironic15:08
TheJulialeitan: makes sense, so it is shredding then since we have no real support to detect if an attached San lun supports magical features, like to zero out the disk virtually15:08
* TheJulia wonders if we should write that, it should only be a few hundred lines of code.15:08
TheJuliaThen again... testing.... would be very difficult15:09
sambettsyeah its basically right now it basically doing dd from /dev/zero15:09
sambettsfor 44gb15:09
leitansambetts TheJulia it would be great if its actually executing it, that the agent log it15:09
leitanthat means that it found the HD15:10
leitanand its doing something and not stuck15:10
*** mjura has quit IRC15:10
*** zhangfei has quit IRC15:10
TheJulialeitan: It should be reporting it out to the console, maybe it was before the screen refreshed with the login prompt :(15:11
rloopas-ha: networking-generic-switch has stable branches? Were you going to backport the zuul v3-related stuff to them?15:11
leitanactually i found out about the FC drivers due to the ouput that ironic wasnt able to write to a disk that didnt found on the server15:11
leitanmaybe something similar for clenaing15:11
leitanTheJulia: ooh ok15:13
leitanmaybe i missed it15:13
leitanbut the peridiocal report ... doesnt say anything15:13
leitanmaybe there too ?15:13
leitani know its a heartbeat, but something like that there15:14
sambettsleitan: ironic itself actually checks if its running / not running and will keep the clean_step field up to date on every heartbeat from the agent15:15
TheJuliaI don’t remember exactly the mechanism used with the heartbeat to report status. We call an external utility to handle the wipe, and sadly it, as far as I’m aware, does not report anything while it is running. IPA is just waiting for the pid to exit 0 basically15:15
*** ijw has joined #openstack-ironic15:15
sambettsyeah there isn't a percentage progress or anything, only running or finished15:16
leitanTheJulia: ok, so if i can log in into the deploy image i can look up for a dd running command15:16
TheJuliasambetts: I wonder if it supports something like some of the versions of dd do with SIG_USR1/2 to get status/progress data...15:16
TheJulialeitan: it is actually using shred on the device, not dd.  Thus we support patterns like write random data, then zero out.  We also support things like ATA secure erase via different logic, but with FC we don’t have concept or ability to look up the capabilities over scsi and act accordingly15:18
sambettsI expect it does on things like coreos and other OSs but tinycore has the busybox version of all those utilities so it might not15:18
TheJuliaLack of hardware access is likely a big part of it15:18
leitanTheJulia: ill look for that then15:18
leitanis there a redhatter here ? the default password is not root/ROOTPW anymore :(15:20
sambettsdtantsur|bbl, milan ^15:20
* milan scrolls back15:20
*** catintheroof has quit IRC15:21
openstackgerritRuby Loo proposed openstack/ironic-inspector stable/pike: Add zuul3 jobs in-tree  https://review.openstack.org/51701015:24
milanleitan, here but dunno about passwd15:24
milanbtw etingof has a spec up for reporting the progress in these cases15:24
milanleitan, actually the user might be cloud-user but I dunno for the IPA, what the password might be15:25
milanthat's for the regular image (and I guess we make sure root can't log-in)15:25
*** rpioso|afk is now known as rpioso15:26
milans/IPA/IPA based on RHEL/15:26
* milan risen a downstream question15:27
*** AlexeyAbashkin has quit IRC15:29
openstackgerritRuby Loo proposed openstack/ironic-inspector stable/ocata: Add zuul3 jobs in-tree  https://review.openstack.org/51701115:30
*** rbartal_ has quit IRC15:32
*** rbartal__ has quit IRC15:32
*** rbartal has quit IRC15:32
milanbtw I guess a conductor doesn't execute anything on IPA over SSH... or?15:34
sambettsmilan: conducotr uses IPA rest API to control it15:35
milanyeah so that way no ssh keys one could piggy-back with15:35
sambettsansible driver uses ansible to do stuff on the baremetal which requires SSH, but only that the image has an authorized_key built into it15:36
sambettsso no private keys will be able to be stolen from the image15:36
openstackgerritRuby Loo proposed openstack/ironic-python-agent stable/pike: Move legacy jobs into tree  https://review.openstack.org/51701315:37
*** spectr has quit IRC15:37
openstackgerritRuby Loo proposed openstack/ironic-python-agent stable/ocata: Move legacy jobs into tree  https://review.openstack.org/51701415:38
rpiosoGood morning, ironicers15:38
milansambetts, ++ thought the same15:38
milanmorning rpioso15:38
milan:)15:38
*** Sukhdev_ has joined #openstack-ironic15:39
*** dprince has quit IRC15:43
milanrloo, how do I tell from the zuul log that your patch was "executed"? :)15:44
rpiosomilan: :)15:44
rloomilan: good question. dunno.15:44
milanlol :D15:44
rloomilan: i just look to see if zuul runs the same tests it ran before.15:44
rloomilan: i guess maybe i should look through all the test logs to see if they worked, but... that would be too much for me...15:45
* milan guess somewhere in the logs should be mentioned that it's picking the settings from the zuul.yaml15:45
*** hw_wutianwei has quit IRC15:45
rloomilan: the other way to look at it is, when the stuff is removed from project-config an openstack-zuul-whatever, the tests should still run :)15:45
milanrloo, basically  I'm looking for a line somewhere that would just prove the ./zuul.yaml was picked up15:46
milanaha15:46
milanso if the other patch fails, this one didn't work?15:46
milan:)15:46
rloomilan: i was just assuming it was picked up, cuz that's the pattern used by all the other projects :)15:46
rloomilan: yeah, there are 3 patches. but i don't know, until after the other two land, whether you will see failures...15:47
milanrloo, you mean assuming? ;)15:47
milan* that's the pattern...*15:47
sambettsit will be picked up, and loaded by zuulv3 (if not thats a bug in zuulv3) also the job names should be different from the legacy ones so you should see both jobs running while there is an overlap15:47
rloomilan: i mean, i don't know that we'll know if things fail, until *after* the other two patches land.15:47
*** dtantsur|bbl is now known as dtantsur15:47
milanrloo, cool, I'm just joking :)15:48
rloomilan: maybe I should have said 'I trust...' :D15:48
milandtantsur appeared. magic.15:48
milan:D15:48
dtantsurleitan: not sure what the question is about, but I doubt we have default passwords anywhere15:48
dtantsurmaaagical owlet!15:48
dtantsurmorning rloo, rpioso, TheJulia15:49
* milan would love to reddit dtantsur 's post about passwords :DDDD15:49
*** ralonsoh has joined #openstack-ironic15:50
*** rama_y has joined #openstack-ironic15:53
rpiosodtantsur: :)15:56
*** Sukhdev has joined #openstack-ironic15:57
milanrloo, +2 on that I'm not familiar with the details but I believe since it's running OK should be cool to merge16:00
rloomilan: thx. as sambetts mentioned, if it didn't work, you wouldn't see the additional two (same, but diff name) tests.16:01
* milan believes in what rloo trusts :)16:01
* rloo has trust that milan is a team player!16:02
milan:D16:02
*** ijw has quit IRC16:02
windsnHi, can anyone kindly tell me if a baremetal node is deployed via nova-compute, does the compute-manager always tried to bind the newly created neutron port to the node that is being used to spawn a baremetal node ? Thanks16:06
*** amarao1 has quit IRC16:06
sambettswindsn: that depends what version of OpenStack you are using16:06
sambettsI think we fixed that bug in the last release16:07
windsnsambetts: I am using Newton. According to the documentation, https://docs.openstack.org/ironic/latest/user/index.html , Nova compute manager creates (unbound) tenant virtual interfaces (VIFs) in the Networking service according to the network interfaces requested in the nova boot request16:07
leitandtantsur: about the ipa image user and password RH 7.416:07
*** catintheroof has joined #openstack-ironic16:07
openstackgerritMerged openstack/ironic stable/ocata: Add job definitions yaml to zuul configuration  https://review.openstack.org/51643816:07
rloodtantsur (and others): I've updated zuul v3 status on etherpad: zhttps://etherpad.openstack.org/p/ironic-zuulv3-intree-tracking16:08
leitanthanks milan16:08
rloodtantsur: I need to poke you to get sushy & virtualbmd ones done :)16:08
rloodtantsur: poke poke poke :D16:08
milanlol :D16:08
milandtantsur is talking right now on a meeting I should pay attention to :D16:09
leitanhey, node is available now sambetts TheJulia  :)16:09
sambettswindsn: yeah, so there are two things, if you are using the "neutron" network interface in Ironic for dynamic tenent network programming, then nova creates the port in neutron leaves it unbound and sends it to ironic and then ironic will bind it with the information it has about the baremetal and where its physically connected16:09
sambettsleitan: awesome!!!!16:09
leitanlets retry the nova boot16:09
windsnsambetts: Is this a bug in Newton ? nova-compute manager for ironic trying to bind to ports, because i keep getting the error "ERROR nova.compute.manager PortBindingFailed: Binding failed for port 3d21808c-fb7e-46a2-8631-68bb08d604ba, please check neutron logs for more information." ? Thanks16:10
*** trown is now known as trown|lunch16:10
sambettswindsn: yes16:10
*** mgoddard has joined #openstack-ironic16:10
sambettswindsn: it was fixed in Ocata16:11
dtantsurleitan: I'm pretty sure there is not any passwords by default16:11
dtantsurrloo: thanks :) ETOOMANYTHINGSTODO16:11
dtantsurif anybody wants to take over sushy and vbmc - go ahead16:11
dtantsurotherwise I'll get there by EOW16:11
leitandtantsur: thanks16:12
rloodtantsur: thx! heh16:12
sambettswindsn: that bug will occur if there is no neutron agent running on the Nova compute that is running the ironic agent, if there is a newton agent running in that location then it'll "fake" bind it to that host16:13
windsnsambetts: Can you kindly point me to the commit where this was fixed? I can try cherry-picking that commit to resolve this issue? Another thing, my enabled_network_interfaces = flat,noop, so when this is the case, only ironic binds, not nova compute-manager ?16:13
*** amarao has quit IRC16:13
windsnsambetts: Yeah i dont have an all-in-one system, instead i have a separate controller + compute node, and the compute node is running neutron dhcp/L2 agent etc...  whereas the ironic conductor is running on my controller node, so binding will fail for me16:14
sambettswindsn: where is your ironic-nova-compute running? on the controller?16:15
sambettswindsn: it was quite a significant change that fixed the bug, new APIs in ironic and everything so not an easy backport :/16:15
windsnsambetts: btw, in nova.conf when used for baremetal, should this be set "compute_manager=ironic.nova.compute.manager.ClusteredComputeManager" ?16:16
sambettsI don't think so, but dtantsur might be able to confirm ^16:17
windsnwindsn: Yeah the nova-compute for ironic is running on that controller16:17
windsnsambetts: Yeah the nova-compute for ironic is running on that controller16:17
*** windsn has quit IRC16:17
dtantsurwindsn: this is not required since IIRC Newton16:17
dtantsurrequired before that16:18
sambetts:/ windsn's DC'd...16:18
dtantsur:(16:18
*** windsn has joined #openstack-ironic16:19
leitanhmmm ... same results when nova boot16:20
leitanill remove the wwn attribute from the node16:20
*** Sukhdev has quit IRC16:20
windsnsambetts: With the bug fixed, would i still need to have neutron agents running on the controller node, which is running nova-compute ? No right ?16:22
*** efried is now known as efried_rollin16:22
dtantsurwindsn: in case you missed my comment, compute_manager was required before Newton16:23
sambettswindsn: correct, with it fixed there isn't a need to have a neutron agent running on the controller node16:23
*** markguz has joined #openstack-ironic16:24
*** ijw has joined #openstack-ironic16:24
sambettswindsn: you might be able to avoid this error being fatal by setting vif_plugging_is_fatal = false in your nova config16:25
sambettswindsn: the error will still occur by the deployment should continue16:26
windsndtantsur: Thanks for pointing that out, I missed your comment earlier16:26
sambettsand because its a port for baremetal thats pre-configured at actually should work as expected even though its "unbound"16:27
windsnsambetts: I can try setting "vif_plugging_is_fatal" and see what happens .. Unfortunately i dont have a choice here, since I am using Newton, I would have to manually port this bug in my system running Newton, would be really grateful if you can kindly point me to the commit -id for this16:28
*** serlex has joined #openstack-ironic16:28
sambettswindsn: if you missed the message above, I said it was quite a significant change (many commits in nova and ironic) that fixed the bug, new APIs in ironic etc so not such an easy backport :/16:29
leitananyone kwons if its extremely necesary specify the wwn to do a FC installation ?16:29
*** markguz has quit IRC16:30
leitancleaning seems to happen just fine16:30
sambettswindsn: https://github.com/openstack/nova/blame/stable/ocata/nova/virt/ironic/driver.py is the commit in nova, but that requires other things in ironic16:30
leitanill try to run the nova boot removing the wwn parameter16:30
sambettsleitan: depends if there are any other disks connected to the system16:30
leitansambetts: just one16:31
sambettsleitan: without any root device hints ironic will pick the first HDD it finds >4gb16:31
sambettsor the smallest HDD it finds > 4gb16:31
sambetts(i can't remeber which it is)16:31
leitangreat so should work on my sceneario without the wwn16:31
Nisha_Agarwaldtantsur, hi....is there any update from customer on the issue https://bugzilla.redhat.com/show_bug.cgi?id=146091516:31
openstackbugzilla.redhat.com bug 1460915 in python-proliantutils "The pxe_ilo driver ignores power requests under certain conditions with HP BL460" [High,Assigned] - Assigned to dtantsur16:31
leitanBTW i was able to catch the the cleaning running on the STDOUT of the server kvm now16:32
sambettsleitan: nice!!16:32
dtantsurNisha_Agarwal: hi! no private comments there, so I guess nothing..16:32
Nisha_Agarwaldtantsur, ok.16:32
openstackgerritMerged openstack/ironic master: Reword interface information in multitenancy docs  https://review.openstack.org/51668716:33
leitanok ill try doing that, removing the wwn16:33
leitansorry to be so "asky"16:33
*** markguz has joined #openstack-ironic16:34
sambettsleitan: no problem, its nice to talk to someone trying to run the software and hear their experiences because it can lead to us improving our docs (btw that patch about the interfaces merged) or discover issues we can improve16:35
leitancertaintly, i guess im used to other core services IRC hostility hahaha16:36
vdrokgood morning everyone!16:36
* vdrok was having fun debugging icehouse nova for the whole day16:36
dtantsurmorning vdrok, happy icehouse16:36
dtantsurleitan: ugh, I'm sorry for your past experience :(16:37
vdrokhey dtantsur :)16:37
*** tzumainn has joined #openstack-ironic16:37
leitanvdrok: thats fun, like neutron database deadlocking16:38
leitandtantsur: used to it, been here since B release16:38
dtantsurwow16:38
* dtantsur is here since I16:39
leitanfirst time trying Ironic though16:39
vdrokleitan: maybe you should have started with icehouse ironic? to better understand the project evolution :D16:40
dtantsurawesome :) I'm really glad to see more people interested in ironic16:40
dtantsuricehouse ironic LOL16:40
dtantsurironic in icehouse was VERY ironic16:40
windsnsambetts: Just by setting "vif_plugging_is_fatal=False  ", I still see this error which prevents deployment https://thepasteb.in/p/JZhpwqRLGRKcg16:40
sambettswindsn: see that error in nova?16:41
sambettswindsn: or in neutron?16:41
* Nisha_Agarwal agree with dtantsur :) .... 16:41
leitandtantsur: in icehouse most projects were ironic :P16:42
dtantsurtrue :)16:42
windsnsambetts: In nova its just a warning, i see this in openstack.log .. i think its coming from neutron16:42
openstackgerritHugo Nicodemos proposed openstack/ironic master: Remove python-oneviewclient from Ironic OneView drivers  https://review.openstack.org/48028416:42
leitanimage we deployed an almost 1000 node cloud with CACTUS release ...16:43
leitannova network ...16:43
leitangood times16:43
windsnsambetts: Actually nevermind, the error is still coming from nova  https://thepasteb.in/p/Q1hBPk8rERKf816:43
dtantsurleitan: heh, cool :) I think nova-network is still there, if you want to give it a try :D16:44
sambettswindsn: did you restart the ironic nova compute and other nova services after setting that value?16:45
sambettswindsn: my understanding is that settting that value *should* mean port binding failing doesn't break the deployment the port will just remain "DOWN" in neutron16:45
windsnsambetts: In nova-compute logs, there is just a warning that binding fails, but the scheduler still fails with the error.. Yeah i restarted ironic nova-compute and nova-scheduler16:45
*** catintheroof has quit IRC16:45
sambetts:/16:46
sambettsthat seems wrong16:46
*** markguz has quit IRC16:48
*** markguz has joined #openstack-ironic16:49
*** catintheroof has joined #openstack-ironic16:52
*** pcaruana has quit IRC16:52
*** marios has quit IRC16:54
*** ijw has quit IRC16:56
*** rama_y has quit IRC16:59
windsnsambetts: I've tried again by restarting all nova services, nova-compute doesn't see this as an error anymore, but the nova-scheduler can't get past this, and flags this as an Error and blocks deployment.... Would you think i may have to set some other flag along with "vif_plugging_is_fatal=False  " ? Thanks16:59
openstackgerritNguyen Van Trung proposed openstack/ironic master: Add additional capabilities discovery for iRMC driver  https://review.openstack.org/41734717:00
*** markguz has quit IRC17:02
*** e0ne has quit IRC17:02
*** openstackgerrit has quit IRC17:03
sambettswindsn: you might be able to repair it by setting both vif_plugging_is_fatal = False, and applying this diff to the ironic driver http://paste.openstack.org/show/625235/ which will prevent nova trying  to bind the port17:04
sambettsironic nova driver that is17:04
windsnsambetts: Thanks for the link... I'll try and repair it17:05
*** markguz has joined #openstack-ironic17:05
sambettswindsn: unfortunatly newton is now EOL so any bug fix can't be backported upstream any longer17:05
*** jcoufal has quit IRC17:07
*** jcoufal has joined #openstack-ironic17:07
windsnsambetts: I understand... will try your suggestion , hopefully it works17:09
sambettswindsn: i also ran into a similar issue a few months ago trying newton, luckly it was a new project and weren't too heavily tied to newton and were able to move to ocata instead17:11
*** serlex has quit IRC17:11
*** ijw has joined #openstack-ironic17:12
sambettswindsn: but I remeber that ^ was one of the possible solutions I came up with (but it wasn't accepted by upstream at the time because the port then remain forever "unbound" even though it actually works)17:13
*** lucasagomes is now known as lucas-afk17:13
*** fragatina has joined #openstack-ironic17:16
windsnsambetts: Yeah we are only moving to the next release in January , but need to demo ironic with our systems in a week or so and need to get past this using Newton17:17
*** jcoufal has quit IRC17:21
*** jcoufal has joined #openstack-ironic17:22
*** AlexeyAbashkin has joined #openstack-ironic17:22
*** Nisha_Agarwal has quit IRC17:30
*** trown|lunch is now known as trown17:34
*** AlexeyAbashkin has quit IRC17:36
leitansambetts: | provision_state        | active                                                                                                                                                                    |17:43
leitani think i did it17:43
sambettsleitan: :O!!!17:43
* leitan starts crying17:43
leitanTIP: do not overconfigure stuff17:43
*** openstackgerrit has joined #openstack-ironic17:44
openstackgerritJohn L. Villalovos proposed openstack/ironic master: devstack: Clean up some of the devstack code  https://review.openstack.org/51706317:44
dtantsurleitan: congrats! :)17:44
dtantsurand ++ to 'not overconfigure' :)17:44
jlvillalTheJulia: https://review.openstack.org/#/c/516463/ recheck finished and the jobs appear to be there now.17:46
patchbotpatch 516463 - ironic (stable/pike) - Add missing job to gate17:46
*** Sukhdev_ has quit IRC17:49
leitandtantsur: thanks, almost there, seems the booting process is not stuck on "raising network interfaces"17:50
leitannot = now17:51
sambettsleitan: which OS? and does it have cloud-init@17:51
sambetts?17:51
leitansambetts: ubuntu, i built the image with the dib17:52
leitanit has cloudinit17:52
leitannow its failing to reach the metadata ip17:52
leitancause seems to failed getting dhcp17:52
openstackgerritDmitry Tantsur proposed openstack/python-ironicclient master: Correct validation of RAID config in functional tests  https://review.openstack.org/51706517:53
sambettshmmm, does your network have a neutron router attached? because if it doesn't then it'll require the isolated_metadata flag to be enabled in neutron to allow metadata via the DHCP namespace instead of via router namespace17:53
openstackgerritDmitry Tantsur proposed openstack/python-ironicclient master: Switch the deprecated "ironic" CLI to "latest" API version by default  https://review.openstack.org/51506417:53
leitansambetts: yes but the faiulre is one step earlier17:53
leitanthe baremetal doesnt get ip17:53
leitanon the interfaces17:53
leitanafter deploying17:54
sambetts:/ oh... :/ weird... maybe a driver thing?17:54
dtantsurany reason not to use a configdrve?17:55
sambettsyeah ideally configdrive is the best option for metadata for baremetal17:56
sambettsmuch more reliable17:56
leitansambetts dtantsur i created the image this way: DIB_CLOUD_INIT_DATASOURCES="Ec2, ConfigDrive, OpenStack" disk-image-create -o baremetal-$DISTRO_NAME-$DIB_RELEASE $DISTRO_NAME baremetal bootloader17:56
sambettsis config drive enable by deffault in nova or if not you should use --config-drive on the nova boot command to pass config drive info17:57
sambettsbut if the baremetal isn't getting an IP thats a bigger concern17:57
sambettsleitan: on your DIB image create you will probably need to include the dhcp-all-interfaces element17:57
sambettsbecause otherwise ubuntu only brings up the first network interface it sees and if you have multiple interfaces that might not be the one that neutron has a port for17:58
sambettsand the mac won't match so then the machine won't get DHCP17:58
sambettsin newer ironic's we actually pass network interface configuration in via config drive to bring up the right interfaces17:59
*** penick has joined #openstack-ironic17:59
leitansambetts: that will be it18:00
*** ralonsoh has quit IRC18:01
leitanill recreate the image18:01
leitandisk-image-create dhcp-all-interfaces -o baremetal-$DISTRO_NAME-$DIB_RELEASE $DISTRO_NAME baremetal bootloader18:03
*** penick has quit IRC18:04
*** mgoddard has quit IRC18:04
* leitan running the image builder sponsored by mycrappyinternetconnection.com18:05
*** windsn has quit IRC18:05
* milan be gone :P18:06
*** milan has quit IRC18:06
sambettso/ milan_18:06
leitanmikal: njoy !18:10
leitanalready gone :P18:10
vdrokgood night everyone!18:14
fellypefcaGood night vdrok18:14
nicodemosnight vdrok18:17
*** Sukhdev has joined #openstack-ironic18:23
*** dprince has joined #openstack-ironic18:25
*** markguz_ has joined #openstack-ironic18:26
*** Sukhdev_ has joined #openstack-ironic18:28
*** tesseract has quit IRC18:28
*** Sukhdev_ has quit IRC18:29
*** markguz has quit IRC18:29
*** Sukhdev has quit IRC18:29
*** bnemec has quit IRC18:35
*** Sukhdev has joined #openstack-ironic18:35
*** rama_y has joined #openstack-ironic18:36
*** markguz_ has quit IRC18:41
*** rwsu has quit IRC18:42
*** markguz has joined #openstack-ironic18:42
*** rama_y has quit IRC18:43
*** e0ne has joined #openstack-ironic18:44
leitani dont image what guys with 300gb disk wait for the cleaning process18:44
* leitan waiting 45 minutes from test to test18:44
*** parlos has quit IRC18:46
dtantsurleitan: for testing, I usually switch to metadata cleaning only18:47
leitanwell well well helloooo, rushing to check that configgg18:48
*** mgoddard has joined #openstack-ironic18:48
sambettsyeah its in the ironic.conf to disable full erase18:48
* dtantsur learned about http://superuser.openstack.org/articles/deploying-ironic-openstack-tripleo/ in the meantime18:48
sambettsdtantsur: does that invole having a separate pool of equipment to enroll into the overcloud?18:50
sambettsdtantsur: or can the undercloud's pool and overcloud's pool be the same?18:50
sambettsfirst of those is "easy" second of those not so much18:50
dtantsursambetts: depending on your definition of "pool". node list does not overlap, if that's what you ask18:50
dtantsurI guess the easy one18:50
* sambetts has been working on some concepts for an overcloud/undercloud model where the baremetals can either be deployed by the undercloud as new computes or by the overcloud as baremetals 18:51
sambettsits starts to mess up your brain18:52
openstackgerritDmitry Tantsur proposed openstack/python-ironicclient master: Switch the deprecated "ironic" CLI to "latest" API version by default  https://review.openstack.org/51506418:52
leitan    erase_devices_priority = 018:52
leitan    erase_devices_metadata_priority = 1018:52
leitandtantsur sambetts for what im seeing settings that ones18:52
leitanshould be enough18:52
leitanon the [deploy] section18:53
dtantsursambetts: oh yeah, that would be fun18:53
sambettsI believe thats the right settings yup18:53
dtantsurleitan: looks good18:53
dtantsurtime to go, see you tomorrow18:53
sambettso/ dtantsur18:53
leitanhave a good one18:53
*** dtantsur is now known as dtantsur|afk18:53
*** fellypefca has quit IRC18:55
*** markguz_ has joined #openstack-ironic18:58
*** ricardoas has quit IRC19:00
* sambetts --> home 19:01
sambettsnight all o/19:01
*** markguz has quit IRC19:01
*** sambetts is now known as sambetts|afk19:02
leitansambetts|afk: night and thanks !19:02
rloojlvillal: let me know if you want to discuss https://review.openstack.org/#/c/515225/. I looked at it again, and I feel like the original is easier to understand/maintain. but i could be biased since I reviewed the orig, and maybe don't have an open-enuf-mind to change my thinking to your new way.19:02
patchbotpatch 515225 - python-ironicclient - Simplify logic for API version '1' and improve uni...19:02
*** openstackgerrit has quit IRC19:03
*** bnemec has joined #openstack-ironic19:03
*** markguz_ has quit IRC19:03
*** markguz has joined #openstack-ironic19:04
*** efried_rollin is now known as efried19:07
*** markguz_ has joined #openstack-ironic19:08
*** markguz has quit IRC19:08
*** crushil has quit IRC19:11
*** crushil has joined #openstack-ironic19:11
*** catintheroof has quit IRC19:16
*** AlexeyAbashkin has joined #openstack-ironic19:18
*** catintheroof has joined #openstack-ironic19:18
*** markguz_ has quit IRC19:20
*** markguz has joined #openstack-ironic19:20
*** ijw has quit IRC19:21
*** AlexeyAbashkin has quit IRC19:22
*** etingof has quit IRC19:24
*** Goneri has quit IRC19:25
*** Goneri has joined #openstack-ironic19:26
*** jcoufal_ has joined #openstack-ironic19:27
*** jcoufal has quit IRC19:30
*** jcoufal has joined #openstack-ironic19:31
*** jcoufal_ has quit IRC19:33
jlvillalrloo: Sure, I'd be happy to discuss the patch19:34
rloojlvillal: ok, let me know what you think after you read my comments.19:35
*** ijw has joined #openstack-ironic19:36
*** mgoddard has quit IRC19:36
*** adreznec has joined #openstack-ironic19:36
jlvillalrloo: Okay I have read the comments :)19:38
rloojlvillal: thoughts?19:39
jlvillalrloo: Well on the when we go to "2" thing. I'm kind of like, fix it when that happens.19:39
jlvillalrloo: There will need to be quite a few changes for that.19:39
rloojlvillal: ewww19:39
jlvillalrloo: A LOT of changes.19:39
rloojlvillal: really? a lot of changes?19:39
jlvillalrloo: Well like line 31 for example19:40
rloojlvillal: seems like it would be in that one place, where we change 1 to 1.something and 2 to 2.latestversion19:40
rloojlvillal: yeah, we'd need to add support for 2.x19:40
jlvillalrloo: And of course all of the code changes for the new API.19:40
rloojlvillal: that is regardless of this code19:40
rloojlvillal: i feel that your change ties 1 with 'latest' too tightly19:41
jlvillalrloo: And the changes to my patch would be relatively minor.19:41
rloojlvillal: minor, but i suspect in two diff places.19:41
jlvillalrloo: Yeah, just change '1' to '2' and then figure out what '1' should be.19:41
jlvillalrloo: Well my follow-on patch: https://review.openstack.org/#/c/515459/5  makes it in 1 place19:41
patchbotpatch 515459 - python-ironicclient - Refactor check for 'latest' version19:41
jlvillalrloo: I could combine those. But I was trying not to do too much in one patch.19:42
jlvillalrloo: Follow on patch: https://review.openstack.org/#/c/515459/5/ironicclient/osc/plugin.py19:42
patchbotpatch 515459 - python-ironicclient - Refactor check for 'latest' version19:42
jlvillalrloo: There is one function that takes care of determining latest19:42
rloojlvillal: with that latest patch, where would you put code to convert '1' to '1.x', after we had '2'?19:43
*** crushil has quit IRC19:44
jlvillalrloo: I'm not sure. Either rename that function to something more generic. _convert_special_versions()   or a new function?19:44
jlvillalrloo: Off the top of my head.19:44
rloojlvillal: i can try reviewing this later, in a week or two or three, but right now, it doesn't sit well with me. Maybe someone else can +2 it for you. If it had been an easy/obvious thing, I'd be good with it, but I feel like there's a lot of patches that need reviewing, and I shouldn't spend more time on this.19:46
jlvillalrloo: Okay19:46
*** bnemec has quit IRC19:53
*** makowals has joined #openstack-ironic19:55
*** rwsu has joined #openstack-ironic19:56
*** crushil has joined #openstack-ironic19:56
*** Goneri has quit IRC20:14
*** jcoufal_ has joined #openstack-ironic20:18
*** jcoufal__ has joined #openstack-ironic20:20
*** jcoufal has quit IRC20:20
*** jcoufal_ has quit IRC20:22
*** rwsu has quit IRC20:23
*** dprince has quit IRC20:26
*** jcoufal__ has quit IRC20:27
*** Goneri has joined #openstack-ironic20:30
*** bnemec has joined #openstack-ironic20:35
*** openstackgerrit has joined #openstack-ironic20:35
openstackgerritMerged openstack/ironic master: Migrate python-oneviewclient validations to Ironic OneView drivers  https://review.openstack.org/46842820:35
*** rwsu has joined #openstack-ironic20:42
*** adreznec has quit IRC20:51
*** windsn has joined #openstack-ironic20:52
*** makowals has quit IRC20:53
*** adreznec has joined #openstack-ironic20:53
*** derekh has quit IRC20:59
*** mat128 has quit IRC21:00
openstackgerritJohn L. Villalovos proposed openstack/python-ironicclient master: Simplify logic for API version '1' and improve unit tests  https://review.openstack.org/51522521:05
*** trown is now known as trown|outtypewww21:08
*** crushil has quit IRC21:08
*** priteau has quit IRC21:13
*** bfournie has quit IRC21:13
*** catintheroof has quit IRC21:16
*** adreznec has quit IRC21:20
*** leitan has quit IRC21:21
*** adreznec has joined #openstack-ironic21:22
openstackgerritAnup Navare proposed openstack/ironic-python-agent master: [Test]DNM Testing if TinyIPA builds with py3  https://review.openstack.org/50965221:25
*** crushil has joined #openstack-ironic21:29
*** e0ne has quit IRC21:29
*** adreznec has quit IRC21:31
*** adreznec has joined #openstack-ironic21:32
*** sasha22 has joined #openstack-ironic21:35
*** sasha21 has quit IRC21:35
*** rcernin has joined #openstack-ironic21:42
*** crushil has quit IRC21:46
*** Sukhdev has quit IRC21:51
*** adreznec has quit IRC21:55
*** etingof has joined #openstack-ironic21:55
*** adreznec has joined #openstack-ironic21:57
*** rwsu has quit IRC21:57
*** etingof has quit IRC22:00
*** rpioso is now known as rpioso|afk22:02
*** windsn has quit IRC22:13
*** jlabarre has quit IRC22:15
*** baoli has quit IRC22:19
openstackgerritMerged openstack/ironic master: Add ability to provide configdrive when rebuilding  https://review.openstack.org/50176122:27
*** markguz has quit IRC22:36
*** markguz has joined #openstack-ironic22:37
*** markguz has quit IRC22:41
*** ijw has quit IRC22:50
openstackgerritJohn L. Villalovos proposed openstack/python-ironicclient master: Simplify logic for API version '1' and improve unit tests  https://review.openstack.org/51522522:54
*** bfournie has joined #openstack-ironic22:55
*** adreznec has quit IRC22:57
*** adreznec has joined #openstack-ironic22:59
*** 5EXAAPFFA has joined #openstack-ironic23:01
openstackgerritJohn L. Villalovos proposed openstack/python-ironicclient master: Simplify logic for API version '1' and improve unit tests  https://review.openstack.org/51522523:07
*** bfournie has quit IRC23:11
*** charcol has joined #openstack-ironic23:15
*** mikal has quit IRC23:28
*** bfournie has joined #openstack-ironic23:43
*** 5EXAAPFFA has quit IRC23:50
*** jaypipes has quit IRC23:54
*** links has joined #openstack-ironic23:56
openstackgerritMerged openstack/ironic master: Ensure ping actually succed  https://review.openstack.org/51665623:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!