Wednesday, 2018-10-31

*** gabys has joined #openstack-ironic00:06
*** gabys has quit IRC00:10
*** gyee has quit IRC00:36
openstackgerritDigambar proposed openstack/ironic master: Fix CPU count returned by introspection in Ironic iDRAC driver  https://review.openstack.org/60998201:14
openstackgerritDigambar proposed openstack/ironic master: Fix CPU count returned by introspection in Ironic iDRAC driver  https://review.openstack.org/60998201:15
*** rloo has quit IRC01:26
*** MattMan_ has quit IRC01:49
*** MattMan_ has joined #openstack-ironic01:49
*** rh-jelabarre has quit IRC02:39
*** tiendc has joined #openstack-ironic05:18
*** pcaruana|elisa| has joined #openstack-ironic05:29
*** pcaruana|elisa| has quit IRC05:37
openstackgerritDigambar proposed openstack/ironic master: Fix CPU count returned by introspection in Ironic iDRAC driver  https://review.openstack.org/60998205:46
*** jaganathan has joined #openstack-ironic05:48
*** gabys has joined #openstack-ironic05:54
*** gabys has quit IRC06:04
*** gabys has joined #openstack-ironic06:04
*** gabys has quit IRC06:10
*** e0ne has joined #openstack-ironic06:16
*** e0ne has quit IRC06:18
*** skazi has joined #openstack-ironic06:47
*** adrianc has joined #openstack-ironic07:41
*** pcaruana|elisa| has joined #openstack-ironic07:45
*** tssurya has joined #openstack-ironic07:45
*** hjensas has quit IRC07:46
*** gkadam has joined #openstack-ironic07:54
*** jaganathan has quit IRC08:08
*** e0ne has joined #openstack-ironic08:12
*** jtomasek has joined #openstack-ironic08:18
*** skazi has quit IRC08:37
*** derekh has joined #openstack-ironic08:51
*** tiendc has quit IRC09:07
*** dougsz has joined #openstack-ironic09:08
openstackgerritDigambar proposed openstack/ironic master: Fix CPU count returned by introspection in Ironic iDRAC driver  https://review.openstack.org/60998209:09
openstackgerritDigambar proposed openstack/ironic master: Fix CPU count returned by introspection in Ironic iDRAC driver  https://review.openstack.org/60998209:10
iurygregorygood morning09:11
*** jovial[m] has quit IRC09:13
*** pcaruana|elisa| has quit IRC09:13
*** ajya[m] has quit IRC09:13
*** S4ren has joined #openstack-ironic09:15
*** pcaruana|elisa| has joined #openstack-ironic09:15
*** e0ne has quit IRC09:16
etingofgood morning iurygregory as well as anybody ironic \o09:20
iurygregoryetingof, o/09:20
*** e0ne has joined #openstack-ironic09:25
*** ajya[m] has joined #openstack-ironic09:26
*** hjensas has joined #openstack-ironic09:29
*** skazi has joined #openstack-ironic09:34
*** ianychoi has quit IRC09:51
*** ianychoi has joined #openstack-ironic09:52
*** mgoddard has joined #openstack-ironic09:54
*** zul has joined #openstack-ironic09:56
mgoddardo/10:00
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Advertise ComputerSystems by name or UUID  https://review.openstack.org/61445610:08
*** lenka has joined #openstack-ironic10:29
openstackgerritIlya Etingof proposed openstack/sushy-tools master: Advertise ComputerSystems by name or UUID  https://review.openstack.org/61445610:35
jiapei\o/10:43
*** dtantsur|afk is now known as dtantsur10:49
dtantsurmorning ironic10:50
iurygregorymorning dtantsur10:56
*** serlex has joined #openstack-ironic10:58
*** iurygregory is now known as iury|lunch11:00
*** adrianc has quit IRC11:05
*** e0ne has quit IRC11:15
*** e0ne has joined #openstack-ironic11:15
*** jtomasek has quit IRC11:16
*** adrianc has joined #openstack-ironic11:18
*** bfournie has quit IRC11:22
*** e0ne has quit IRC11:27
openstackgerritRajat Dhasmana proposed openstack/ironic master: Add ironic-status upgrade check command framework  https://review.openstack.org/61447211:34
*** jtomasek has joined #openstack-ironic11:38
*** rh-jelabarre has joined #openstack-ironic11:46
openstackgerritvinay kumar muddu proposed openstack/ironic master: Make iLO BIOS interface clean steps asynchronous  https://review.openstack.org/60794711:51
jrollmorning y'all11:52
*** bfournie has joined #openstack-ironic11:58
dtantsurmorning jroll11:59
*** iury|lunch is now known as iurygregory12:01
*** trown|outtypewww is now known as trown12:05
*** miniTurtle has quit IRC12:14
dtantsurjroll: wdyt about https://github.com/dtantsur/ironic-proxy#architecture ?12:19
jrolldtantsur: seems sensible12:21
jrollI wonder how this fits the HPC use case julia brought up12:21
jrollor rather, how it works for them12:21
dtantsurI'm learning this field as I go :)12:21
jrollI don't recall what the other use case was, honestly12:22
* jroll still doesn't love the federation idea in general12:22
dtantsurjroll: what would you do instead?12:24
jrolldtantsur: for edge things, I would do a single control plane. for HPC... not sure, but it feels like an edge case rather than something lots of people would use12:27
dtantsurjroll: single control plane with streteched AMQP/DB?12:29
jrolldtantsur: well, just centralized, with nodes takling to conductors at the hub12:29
jrollDHCP living in the edge, ideally12:30
dtantsurah, so virtual media for everything?12:32
dtantsurthis is what tripleo seems to lean towards as well12:32
jrollgood point, pxe might be difficult there12:33
jrollour model is ipxe on disk -> chainload to http -> boot a ramdisk12:34
jrollbut vmedia would also work12:34
jroll(see also https://github.com/yahoo/ironic-secureboot-driver#background )12:34
dtantsuryeah, http boot will also work, I guess12:35
dtantsurwe have a spec to do DHCP via vmedia though, this may come handy12:35
jrollindeed12:35
dtantsurjroll: is it all upstream iPXE (what you do)? or do you patch it for this fancy encryption stuff?12:36
jrolldtantsur: it's patched to add TPM support, plan to upstream once it's solid12:37
dtantsurnice12:37
jrollthis can be done without TPM / mutual TLS auth as well12:38
jroll(with upstream ipxe)12:38
jrolljust not as secure, of course :)12:38
* dtantsur thinks of coming up with a presention for the Forum with the potential options and their pros/cons12:38
*** lenka has quit IRC12:44
sambetts|afkany reason why we wouldn't put the conductors at the edge? with co-located TFTP and DHCP? with the ironic-api in the hub? (obviously it currently would require central DB/AMQP)12:45
*** dnuka has joined #openstack-ironic12:46
dnukaGood morning :)12:46
dtantsurmorning dnuka12:46
dtantsursambetts|afk: central DB/AMQP is probably the biggest blocker12:46
dnukaGood morning dtantsur :)12:46
jrollsambetts|afk: yeah, it's an option if we need pxe, just talking mysql/amqp over WAN isn't awesome12:47
dtantsurPXE provisioner as a service? :)12:48
sambetts|afkisn't that just ironic/12:48
sambetts|afk?12:48
dtantsursomebody actually asked me if it's possible to move PXE logic out of ironic into a service12:48
jrollheh12:49
dtantsurironic is so much more12:49
jrollthat's one of the things I've considered pulling out of the conductor as well12:49
sambetts|afkwhat we gunna do make a cobbler boot interface XD12:49
dtantsurmaybe? :D12:50
*** lenka has joined #openstack-ironic12:50
sambetts|afkif we did that I do see any point in the conductor being a separate thing12:50
jrollimo, the ideal edge architecture if you need to pxe boot is, api/conductor in the hub, tftp/pxe/etc in the edge12:51
sambetts|afk:/ I feel like the conductor is the ideal edge package though, as its responsible for a set of machines12:52
jrollwell12:52
sambetts|afkparticularly if we resolve the IPA <-> conductor comms12:52
dtantsurright12:52
jrollmaybe "splitting out pxe/tftp" means putting the conductor in the edge and splitting out the rabbit/mysql bits instead (and keeping those central)12:53
jrolland talking to conductor over something-not-amqp12:53
sambetts|afkthis ^12:53
jrollsame idea, different words :)12:53
* dtantsur wonders who thought that using amqp for rpc was a good idea..12:53
jrollheh12:54
sambetts|afk:-P how well does etcd work over WAN?12:54
openstackgerritDhanuka proposed openstack/sushy master: Add support for the `UpdateService` resource  https://review.openstack.org/61382812:54
jrollprobably fine, it's just http/grpc, right12:54
dtantsurbut I'd maybe leave managing the node records in database to the Hub location12:55
jrollI guess it depends how the application handles connection logs12:55
*** lenka has quit IRC12:55
dtantsurto reduce the traffic Hub<->Edge12:56
dtantsurimagine Nova has to poll all Edge conductors to list nodes...12:56
sambetts|afkjust thinking that one of the things that ties us to central rabbit is our conductors aliveness right?12:56
sambetts|afkthe same reason we can't switch to zmq?12:56
*** gkadam has quit IRC12:57
dtantsurI don't quite get how these are related12:57
jrollconductor liveness is all in the database, no rabbit involved12:58
dtantsuryeah12:58
sambetts|afkI'm sure there is some weird "we need pub-sub" in our code base somewhere12:58
dtantsurfor notifications - probably12:58
jrollwell, we only need the "pub" side for notifications :P12:59
dtantsurbut our RPC is really just RPC. it could be grpc or JSON-RPC12:59
jrollyep, I'm not sure we have any rpc casts12:59
sambetts|afkI sure there was an issue with using a non-central amqp based thing when people tired to swtich ironic to zmq12:59
jrolloh, we have two, there is continue_node_deploy and continue_node_clean13:00
sambetts|afkoslo messaging lets you select different backend for notifications and rpc, and zmq didn't work because of it13:00
dtantsurprobably because RPC != messaging, so we need to chagne the approach slightly?13:00
dtantsurI'm not sure what the problem was with zmq. long time ago I used it quite successfully for RPC.13:01
*** gkadam has joined #openstack-ironic13:03
sambetts|afkhttps://storyboard.openstack.org/#!/story/166924313:03
*** mbeierl has joined #openstack-ironic13:03
sambetts|afknot sure if this is still an issue ^13:03
sambetts|afkbut doesn't something like zmq (brokerless messaging) remove the need for a central messaging bus?13:05
dtantsurunclear if this is caused by zmq itself, or oslo.msg, or us13:05
dtantsurwell, it does. it's kind of just messages over TCP/IP13:05
*** e0ne has joined #openstack-ironic13:06
sambetts|afkso then we'd just need to work out the DB part right?13:09
*** v12aml has quit IRC13:10
dtantsurdo I get it right that we're inventing cells for ironic?13:11
dtantsurbecause we do, and we may just reuse nova's experience13:11
jrollheh13:11
dtantsure.g. two databases: for Hub and for Edge13:11
dtantsurcorrection: >=2 databases13:11
openstackgerritDhanuka proposed openstack/sushy master: Add support for the `UpdateService` resource  https://review.openstack.org/61382813:26
TheJuliagood morning everyone13:27
iurygregorymorning13:27
sambetts|afko/13:27
*** sambetts|afk is now known as sambetts13:28
dnukaGood morning TheJulia :)13:28
dnukaGood morning iurygregory :)13:28
*** rloo has joined #openstack-ironic13:39
*** rloo has quit IRC13:40
*** rloo has joined #openstack-ironic13:40
dtantsurmorning TheJulia13:48
TheJuliaI would like new sinuses. Anyone know where I can obtain new sinuses?13:59
*** sthussey has joined #openstack-ironic14:05
dtantsur:(14:08
* etingof feels like TheJulia needs good rest and care14:15
iurygregorytake some PTO Julia =)14:16
*** e0ne has quit IRC14:19
jiapeiHey14:20
iurygregoryho14:21
jiapeiTheJulia: For XClarity CI, should I use "ironic_tempest_plugin.tests.scenario.test_baremetal_basic_ops.BaremetalBasicOps.test_baremetal_server_ops " for the tempest test?14:24
*** e0ne has joined #openstack-ironic14:26
TheJuliajiapei: Generally yes. If you have specific features or needs that you need to test further down the road, you may wish to consider a local plugin that is also executed. That test should be good for general testing of a driver's interface to hardware14:34
TheJuliaetingof: ++14:34
TheJuliaiurygregory: after berlin....14:34
TheJuliaFor the next week or so I'll be doing the running around with my arms flailing trying to get things ready14:35
iurygregoryTheJulia, its close yay \o/ if you need help with something i can try to help too o/14:35
TheJuliaiurygregory: would you be up for reviewing slide decks?14:36
iurygregorysure =)14:37
jiapeiTheJulia: I run this "test_baremetal_server_ops" in a devstack VM deployed by Zuul, but it failed with error "No valid host"14:38
TheJuliajiapei: manually run the test in a devstack environment?14:38
jiapeiYes14:38
jiapeiI run the command in the devstack14:39
TheJuliaand was tempest fully configured with a tempest.conf settings representing your environment?14:40
jiapeiI have added baremetal node to the devstack, and can see it with "openstack baremetal node list"14:40
dtantsurjiapei: did you follow https://docs.openstack.org/ironic-tempest-plugin/latest/config/with-nova.html#configuration ?14:40
TheJuliadtantsur wins a free beer14:40
jiapeihttp://lxca-logs.electronicjungle.net/77/605577/1/check/lenovo-xclarity-ironic/2c62f81/ is the tempest.conf14:41
dtantsurheh14:41
*** e0ne has quit IRC14:41
*** dnuka has quit IRC14:41
dtantsurjiapei: if the configuration looks right, https://docs.openstack.org/ironic/latest/admin/troubleshooting.html#nova-returns-no-valid-host-was-found-error is your friend14:42
*** e0ne has joined #openstack-ironic14:44
jiapeidtantsur: it looks the same error I met, let me try it14:44
dtantsurjiapei: if you added the node manually (which you should not be doing for the CI), maybe something is wrong about its state?14:45
jiapeidtantsur: I add a baremetal node to test XClarity driver function(like get boot order)...14:47
jiapeiand its state I remember is "enroll"14:47
dtantsurjiapei: "enroll" is a state when nodes cannot be deployed onto14:48
dtantsurjiapei: I'd suggest you start with using devstack itself to enroll nodes (it does it by default)14:48
dtantsurthen start playing around more as you become more familiar with it14:49
jiapeidtantsur: and do you mean a devstack is deployed on a VM, and use this devstack to enroll node (like a baremetal one)?14:50
dtantsurjiapei: check what other 3rdparty CI are doing, they provided an inventory file, which is used by devstack to enroll nodes14:51
dtantsurjiapei: you'll need to add another 'if' block here though: https://github.com/openstack/ironic/blob/master/devstack/lib/ironic#L1916-L195614:52
jiapeidtantsur: Ah, but the XClarity driver hasn't implement deploy function ...14:53
openstackgerritJulia Kreger proposed openstack/ironic master: Change BFV job to use ipxe interface  https://review.openstack.org/61453514:53
dtantsurjiapei: you mean, it cannot deploy nodes? then what are you trying to test?14:53
* dtantsur notes that is_deployed_by_* name is slightly confusing14:54
jiapeidtantsur: I'm trying to test its "power" and "management" function14:54
dtantsurright, so are other drivers14:54
dtantsurwe've removed the only (IIRC) driver that had a custom deploy interface14:55
jiapeideploy is our next step14:55
TheJuliajiapei: can the xclarity driver not use the agent deploy driver as-is?14:56
*** baha has joined #openstack-ironic14:58
sambettsthe "is_deployed_by" flags are kind of left over from pre-driver-composition days, I think the devstack hardware enroll needs a refactor, maybe a yaml file format or something? I think there is a problem with hardware and setting the local_link_config for advanced networking stuff too14:59
sambettsit works today but isn't pretty :-P14:59
*** dsneddon has quit IRC14:59
*** ianychoi has quit IRC15:00
TheJuliarefactoring welcome :)15:00
jiapeiTheJulia:  I'm a bit confused, xclarity driver doesn't have deploy file, what is the "agent deploy driver" you mentioned?15:00
dtantsurjiapei: you inherit deploy interface from GenericHardware15:00
TheJuliajiapei: no worries. I misused terminology as well there because of pre-driver composition nomenclature15:00
dtantsur4 of them actually: https://github.com/openstack/ironic/blob/master/ironic/drivers/generic.py#L5015:01
*** gyee has joined #openstack-ironic15:01
TheJuliaWhat dtantsur said, 'agent' == direct in the old nomenclature.15:01
TheJulia'pxe_*' is the iscsi deployment interface15:02
TheJuliaiscsi and direct interfaces are the two most commonly used15:02
jiapeiAh, a bit more things for me to understand :)15:03
jrollTheJulia: dtantsur: I'm confused about this patch: https://review.openstack.org/#/c/590076/2 . kaifeng says "It seems dhcpv6 uses 547 at server side, we may not support ipv6 simply like this patch..". sounds to me like ipv6 doesn't work, even if we merge this. so why did we land it?15:04
patchbotpatch 590076 - ironic-inspector - Support manipulating iptables filter under IPv6 ne... - 2 patch sets15:04
dtantsurjiapei: :) but to begin with, you can use e.g. cimc as an example and adapt it for your needs: https://github.com/openstack/ironic/blob/master/devstack/lib/ironic#L1920-L192315:05
dtantsurwhich will mostly be s/cimc/xclarity/ :)15:05
*** jistr is now known as jistr|call15:05
jiapeidtantsur: I'll try it locally. And it seems I got several links and docs for me to take away15:07
jiapei:D15:07
*** dsneddon has joined #openstack-ironic15:08
TheJuliajroll: 547 is not what the actual RFC states afaik. I'm fairly sure our ipv6 support is very broken, and I'm trying to work on it at least in the conductor.15:08
TheJuliahmm, I didn't see kaifeng's comment15:09
jrollTheJulia: let me rephrase, the author says that the patch doesn't make ipv6 work, so why land it?15:09
jrollah15:09
TheJuliayeah, I think the port is 547, so we would need to address the port15:10
jrollnot opposed to it landing, just doesn't seem like there's any point to landing it15:10
TheJuliaI kind of see it as a building block15:10
jrollwell, and I think the config is unnecessary, now we have to go back and make sure we deprecate it eventually15:11
*** rpioso|afk is now known as rpioso15:11
rpiosoGood morning, ironicers15:11
TheJuliaor we could just revert15:12
TheJuliawe've not released it15:12
*** dsneddon has quit IRC15:12
jroll¯\_(ツ)_/¯15:12
jrollnot a big fan of reverts for things like this, but that's just me15:12
TheJuliayeah15:13
jrolllike I said, I'm fine with it, just confused15:13
TheJuliaI'm kind of feeling like just reverting it now, I mean, it doesn't hurt anything though15:13
TheJuliaand it could be a stepping stone to addressing the port(s)15:13
jrolloh, it isn't merged yet, can just -2 to block15:13
TheJuliathere you go15:13
TheJuliadone.15:14
dtantsurjroll: removed W+115:14
jrollah, thanks15:14
* jroll was writing a verbose message15:15
jrollthanks TheJulia15:15
TheJuliaverbose messages are ++15:15
*** jistr|call is now known as jistr15:35
openstackgerritMerged openstack/ironic master: [devstack] Allow setting TFTP max blocksize  https://review.openstack.org/52873715:50
*** baha has quit IRC15:54
*** baha has joined #openstack-ironic15:58
*** dsneddon has joined #openstack-ironic16:15
*** gkadam has quit IRC16:20
*** kencjohnston has quit IRC16:27
openstackgerritDmitry Tantsur proposed openstack/ironic-tempest-plugin master: [DNM] Testing the CI  https://review.openstack.org/61458316:29
*** kencjohnston has joined #openstack-ironic16:29
*** pcaruana|elisa| has quit IRC16:37
roger2I'm trying to deploy an overcloud. The controller failed to deploy. I'm following the troubleshooting docs, but need some help. "openstack stack resource list overcloud" says "Controller" got UPDATE_FAILED. "openstack stack resource show overcloud Controller" shows "resource_status_reason | UPDATE aborted (Task update from ResourceGroup "Controller" [4f50d4...] Stack "overcloud" [d31e3e...] Timed out)".16:38
roger2"openstack server list" shows overcloud-controller-0 with status BUILD and no networks.16:39
roger2My env is queens attempting to deploy to physical nodes with the baremetal flavor.16:40
*** trown is now known as trown|lunch16:40
roger2oops. I meant to post this to #tripleo16:47
*** gabys has joined #openstack-ironic16:49
*** gyee has quit IRC16:50
*** rh-jelabarre has quit IRC16:52
*** serlex has quit IRC16:59
*** rh-jelabarre has joined #openstack-ironic16:59
*** mgoddard has quit IRC17:03
*** e0ne has quit IRC17:08
*** dsneddon has quit IRC17:10
*** dsneddon has joined #openstack-ironic17:21
*** hjensas has quit IRC17:22
*** gyee has joined #openstack-ironic17:44
dtantsurTheJulia: judging by http://paste.openstack.org/show/733644/ ironic CI does not take too much resources to start eagerly removing jobs..17:44
dtantsurand none of our jobs got into top 2017:46
*** sambetts is now known as sambetts|afk17:46
*** dougsz has quit IRC17:59
*** derekh has quit IRC18:01
*** trown|lunch is now known as trown18:04
*** hjensas has joined #openstack-ironic18:09
*** gabys has quit IRC18:11
dtantsurholiday tomorrow, so see you on Fri18:17
*** dtantsur is now known as dtantsur|afk18:17
*** gabys has joined #openstack-ironic18:17
*** S4ren has quit IRC18:29
*** e0ne has joined #openstack-ironic18:31
*** e0ne has quit IRC18:32
*** tssurya has quit IRC18:39
TheJuliadtantsur|afk: I think that comparison is only because of patch throughput numbers. If there is anything in the gate, with the sheer number of jobs and time ours takes, it is 6+ hours before results are posted right now. :(18:45
NobodyCamgood morning Ironic'ers18:56
*** jcoufal has joined #openstack-ironic19:21
*** adrianc has quit IRC19:40
*** e0ne has joined #openstack-ironic19:44
*** betherly has joined #openstack-ironic19:45
*** e0ne has quit IRC19:45
*** jcoufal has quit IRC19:48
*** betherly has quit IRC19:49
*** trown is now known as trown|outtypewww20:29
*** e0ne has joined #openstack-ironic20:30
*** bfournie has quit IRC20:37
*** gabys has quit IRC20:40
*** e0ne has quit IRC20:50
*** gabys has joined #openstack-ironic20:51
*** S4ren has joined #openstack-ironic21:06
*** bfournie has joined #openstack-ironic21:15
*** baha has quit IRC21:17
*** betherly has joined #openstack-ironic21:27
*** betherly has quit IRC21:32
*** S4ren has quit IRC22:01
*** gyee has quit IRC22:19
*** gabys has quit IRC22:57
*** gabys has joined #openstack-ironic23:04
*** kaifeng has joined #openstack-ironic23:08
*** gabys has quit IRC23:09
*** kaifeng has left #openstack-ironic23:11
TheJuliaWhere did the day go?23:23
*** kaifeng has joined #openstack-ironic23:23
kaifengTesting23:24
*** ianychoi has joined #openstack-ironic23:35

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!