Friday, 2019-08-02

*** ianychoi has joined #openstack-ironic00:34
*** betherly has joined #openstack-ironic00:35
*** Lucas_Gray has quit IRC00:36
*** betherly has quit IRC00:39
*** betherly has joined #openstack-ironic00:55
*** betherly has quit IRC01:00
*** devx has quit IRC01:03
*** devx has joined #openstack-ironic01:04
kaifengmorning01:16
openstackgerritMerged openstack/ironic-python-agent master: Repair building tinyipa images after the move to ipa-builder  https://review.opendev.org/67402601:45
*** betherly has joined #openstack-ironic01:46
*** e0ne has joined #openstack-ironic01:48
*** betherly has quit IRC01:52
*** e0ne has quit IRC01:52
*** rloo has quit IRC02:11
openstackgerritpengyuesheng proposed openstack/networking-baremetal master: Bump the openstackdocstheme extension to 1.20  https://review.opendev.org/67397602:20
*** rloo has joined #openstack-ironic02:21
*** rh-jelabarre has quit IRC02:21
*** rloo has quit IRC02:21
*** rloo has joined #openstack-ironic02:22
TheJuliagood morning02:39
openstackgerritKaifeng Wang proposed openstack/ironic-inspector master: Adds tooz locking driver  https://review.opendev.org/67076302:42
kaifengmorning TheJulia see you again :)02:42
*** dsneddon has quit IRC02:46
*** betherly has joined #openstack-ironic02:59
*** dsneddon has joined #openstack-ironic02:59
*** betherly has quit IRC03:03
*** dsneddon has quit IRC03:04
*** ash2307 has left #openstack-ironic03:12
*** betherly has joined #openstack-ironic03:19
*** betherly has quit IRC03:24
*** gyee has quit IRC03:26
*** rloo has quit IRC03:29
*** betherly has joined #openstack-ironic03:39
*** betherly has quit IRC03:45
*** gkadam has joined #openstack-ironic03:49
*** betherly has joined #openstack-ironic03:50
*** betherly has quit IRC03:55
*** betherly has joined #openstack-ironic04:11
*** betherly has quit IRC04:16
*** betherly has joined #openstack-ironic04:21
*** betherly has quit IRC04:26
*** e0ne has joined #openstack-ironic04:30
*** verma-varsha has joined #openstack-ironic04:31
*** whoami-rajat has joined #openstack-ironic04:34
*** e0ne has quit IRC04:35
*** betherly has joined #openstack-ironic04:41
*** betherly has quit IRC04:46
*** diga has joined #openstack-ironic04:54
*** betherly has joined #openstack-ironic05:02
*** dsneddon has joined #openstack-ironic05:03
*** betherly has quit IRC05:07
*** Lucas_Gray has joined #openstack-ironic05:10
*** betherly has joined #openstack-ironic05:18
*** yaawang has quit IRC05:19
*** betherly has quit IRC05:22
*** yaawang has joined #openstack-ironic05:28
*** rachit7 has joined #openstack-ironic05:28
*** yaawang has quit IRC05:33
openstackgerritKaifeng Wang proposed openstack/ironic-inspector master: Split API and conductor services  https://review.opendev.org/67373205:51
*** iurygregory has quit IRC05:56
*** mkowalski has joined #openstack-ironic05:57
*** e0ne has joined #openstack-ironic06:04
openstackgerritpengyuesheng proposed openstack/python-ironic-inspector-client master: Blacklist sphinx 2.1.0 (autodoc bug)  https://review.opendev.org/67418506:10
*** Lucas_Gray has quit IRC06:13
openstackgerritpengyuesheng proposed openstack/python-ironic-inspector-client master: Bump the openstackdocstheme extension to 1.20  https://review.opendev.org/67418606:14
verma-varshaetingof: I think there's some problem with the Chassis and Manager resource emulation in sushy-tools here(https://github.com/openstack/sushy-tools/blob/master/sushy_tools/emulator/resources/chassis/staticdriver.py#L30). As in, no matter what we provide in the emulator.conf file, `app.config.get` still returns None and hence the default is being used every time06:18
openstackgerritpengyuesheng proposed openstack/virtualbmc master: Blacklist sphinx 2.1.0 (autodoc bug)  https://review.opendev.org/67418906:19
openstackgerritpengyuesheng proposed openstack/virtualbmc master: Bump the openstackdocstheme extension to 1.20  https://review.opendev.org/67419006:22
*** e0ne has quit IRC06:42
*** e0ne has joined #openstack-ironic06:45
*** verma-varsha has quit IRC06:49
*** jhesketh has joined #openstack-ironic06:54
*** dsneddon has quit IRC06:56
*** rcernin has quit IRC06:58
*** verma-varsha has joined #openstack-ironic06:59
*** sekharvajjula has quit IRC06:59
*** dsneddon has joined #openstack-ironic07:00
*** tesseract has joined #openstack-ironic07:17
verma-varshaetingof: I figured I was running into that error because I hadn't set the environment variable for the config file. Apologies for the false alarm.07:25
etingofverma-varsha, awesome! I just wanted to refer you to devstack/ironic where the config file is being used07:26
*** iurygregory has joined #openstack-ironic07:30
iurygregorygood morning Ironic o/07:30
*** e0ne has quit IRC07:31
etingofo/ iurygregory07:32
*** tssurya has joined #openstack-ironic07:38
*** jtomasek has joined #openstack-ironic07:47
*** jtomasek has quit IRC07:48
*** jtomasek has joined #openstack-ironic07:49
*** lucasagomes has joined #openstack-ironic07:52
*** kaifeng has quit IRC08:00
dtantsurmorning08:02
openstackgerritKaifeng Wang proposed openstack/ironic-inspector master: Split API and conductor services  https://review.opendev.org/67373208:07
*** kaifeng has joined #openstack-ironic08:09
kaifengdtantsur: have a test on etcd3gw, it seems working now o/08:09
dtantsur\o/08:11
dtantsurso, the problem was probably in eventlet08:11
kaifengnot sure, tooz is using a thread for the heartbeating08:12
openstackgerritSurya Seetharaman proposed openstack/ironic master: Support power state change callbacks to nova using ksa_adapter  https://review.opendev.org/66484208:26
*** dsneddon has quit IRC08:32
*** iurygregory has quit IRC08:35
*** jtomasek has quit IRC08:40
openstackgerritNisha Agarwal proposed openstack/ironic master: Implement basic interfaces for GraphicalConsole Interface  https://review.opendev.org/54735608:42
openstackgerritNisha Agarwal proposed openstack/ironic master: RPC changes for Graphical Console  https://review.opendev.org/64082708:48
*** Lucas_Gray has joined #openstack-ironic08:51
*** Goneri has joined #openstack-ironic08:54
kaifenghi dtantsur, I am not following your comment about the unnecessary api script09:01
*** dsneddon has joined #openstack-ironic09:01
dtantsurkaifeng: we don't need a script to launch API, we can provide a WSGI entry point so that people use a real WSGI container09:01
*** rachit7 has quit IRC09:02
dtantsurlike https://github.com/openstack/ironic/blob/master/setup.cfg#L50-L5109:02
*** e0ne has joined #openstack-ironic09:03
*** jtomasek has joined #openstack-ironic09:04
kaifenggot it, thanks, but having a console script seems handy for local debug or exercising, maybe adds a wsgi but still keeps the script?09:05
*** derekh has joined #openstack-ironic09:06
openstackgerritNisha Agarwal proposed openstack/ironic master: RPC changes for Graphical Console  https://review.opendev.org/64082709:22
openstackgerritMerged openstack/python-ironic-inspector-client master: CI: clean up required projects  https://review.opendev.org/67344209:22
kaifengdtantsur: okay, I think I have a general idea on what you mean, but in this patch, coordinator is started in the WSGIService, not flask itself.09:23
kaifengWSGIService itself can't be embedded into a container09:23
*** v12aml has joined #openstack-ironic09:32
openstackgerritMerged openstack/sushy master: Add MappedListField  https://review.opendev.org/67122809:35
dtantsurkaifeng: that's bad if so. we need to support the ability to run a wsgi application, that's how people run API services in production.09:36
dtantsurare you sure WSGIService cannot be used as a WSGI application? how does ironic handle it?09:37
kaifengWSGIService here is a subclass of oslo Service, while ironic is a pecan instance, they are different09:39
kaifengI just did a quick check, it said so, but maybe need further confirmation.09:40
openstackgerritDmitry Tantsur proposed openstack/metalsmith master: [WIP] Clean up exceptions metalsmith raises  https://review.opendev.org/67424709:42
openstackgerritDmitry Tantsur proposed openstack/python-ironic-inspector-client stable/stein: CI: clean up required projects  https://review.opendev.org/67424809:43
kaifengbye ironicers o/09:44
*** kaifeng has quit IRC09:44
*** Lucas_Gray has quit IRC09:49
*** dsneddon has quit IRC09:49
*** Lucas_Gray has joined #openstack-ironic09:51
*** v12aml has quit IRC09:52
*** ociuhandu has joined #openstack-ironic09:54
*** jawad_axd has joined #openstack-ironic09:56
*** Goneri has quit IRC09:56
*** priteau has joined #openstack-ironic10:13
*** verma-varsha has quit IRC10:25
*** ociuhandu has quit IRC10:34
*** ociuhandu has joined #openstack-ironic10:34
*** ociuhandu has quit IRC10:36
*** ociuhandu has joined #openstack-ironic10:37
openstackgerritVarsha Verma proposed openstack/sushy-tools master: Add Simple Storage resource support  https://review.opendev.org/66732810:45
*** iurygregory has joined #openstack-ironic10:47
*** Goneri has joined #openstack-ironic10:51
openstackgerritVarsha Verma proposed openstack/sushy-tools master: Add Simple Storage resource support  https://review.opendev.org/66732810:52
*** dsneddon has joined #openstack-ironic10:52
*** verma-varsha has joined #openstack-ironic10:54
openstackgerritMerged openstack/ironic master: RAID create fails if 'controller' is missing in 'target_raid_config'  https://review.opendev.org/67385410:56
*** ricolin has quit IRC11:00
dtantsuretingof: hey, do these snmp-related failures ring any bells? https://trunk.rdoproject.org/centos7/ad/80/ad802b441c5172c4a7a90138c04b0793fe73eb05_d0e11ceb/build.log11:05
dtantsurah, nevermind, it seems that a solution is mentioned in https://review.rdoproject.org/r/#/c/21681/11:05
openstackgerritShivanand Tendulker proposed openstack/ironic master: WIP: Add iDRAC RAID deploy steps  https://review.opendev.org/64173111:07
openstackgerritShivanand Tendulker proposed openstack/ironic master: Changes to enable execution of out of band deploy steps  https://review.opendev.org/67426811:07
openstackgerritShivanand Tendulker proposed openstack/ironic master: Add new method 'apply_configuration' to RAIDInterface  https://review.opendev.org/67426911:07
openstackgerritShivanand Tendulker proposed openstack/ironic master: Add deploy steps for Redfish BIOS interface  https://review.opendev.org/64206011:11
openstackgerritShivanand Tendulker proposed openstack/ironic master: Add deploy steps for iLO BIOS interface  https://review.opendev.org/67427011:12
openstackgerritShivanand Tendulker proposed openstack/ironic master: Add iLO RAID deploy steps  https://review.opendev.org/67427111:14
openstackgerritShivanand Tendulker proposed openstack/ironic master: WIP: Add iDRAC RAID deploy steps  https://review.opendev.org/64173111:16
openstackgerritMerged openstack/ironic master: Ansible driver: fix deployment with serial specified as root device hint  https://review.opendev.org/67253011:17
*** Wryhder has joined #openstack-ironic11:23
*** Lucas_Gray has quit IRC11:23
*** Wryhder is now known as Lucas_Gray11:24
*** iurygregory has quit IRC11:31
*** iurygregory has joined #openstack-ironic11:31
*** verma-varsha has quit IRC11:37
*** dsneddon has quit IRC11:37
etingofdtantsur, I am not sure... I've made a new release a couple of days back, so may be it's a regression. Do you see which pysnmp this job pulls?11:46
*** iurygregory has quit IRC11:47
*** iurygregory has joined #openstack-ironic11:48
*** Lucas_Gray has quit IRC11:51
dtantsuretingof: probably not a new one11:52
* etingof is relieved11:53
etingofdtantsur, but I found the answer -- https://stackoverflow.com/questions/47165894/pysnmp-returns-typeerror-with-anaconda-install-even-with-example-codehttps://stackoverflow.com/questions/47165894/pysnmp-returns-typeerror-with-anaconda-install-even-with-example-code11:53
*** rpittau|afk is now known as rpittau11:56
rpittaugood afternoon ironic! o/11:56
*** Lucas_Gray has joined #openstack-ironic12:00
openstackgerritDmitry Tantsur proposed openstack/metalsmith master: Clean up exceptions metalsmith raises  https://review.opendev.org/67424712:00
iurygregoryrpittau, o/ back to france?12:01
*** guilhermesp has joined #openstack-ironic12:02
rpittauiurygregory: yeah, same temperature, less sea :/12:03
iurygregoryrpittau, good luck =(12:03
guilhermespmorning all! We've been noticing that even setting up erase_devices_priority = 0, the cleaning process keeps stuck for hours ( http://paste.openstack.org/show/755327/ ). Is there any other setting to disable zeroing the disks during cleaning process?12:03
dtantsurguilhermesp: hi! are you sure 1. you set it in the right place, 2. the process is not stuck because of something else (like PXE timeout)?12:04
guilhermesphey man, how's going ? :P12:05
dtantsurguilhermesp: because this works: https://github.com/metal3-io/ironic-image/blob/master/ironic.conf#L27-L2812:05
dtantsuro/12:05
guilhermespwell. we are using openstack-ansible, that sets erase_devices_priority under [deploy] session12:05
guilhermesphttps://www.irccloud.com/pastebin/lztKgYBN/12:05
iurygregoryguilhermesp, its ansible fault =P12:06
guilhermespservices restarted and everything12:06
guilhermespnooooo LSD is using just fine with rocky :P12:06
dtantsurblame ansible! :D12:06
guilhermesposa + rocky12:06
iurygregoryLSD still using osa + rocky? oh god12:06
guilhermespcloud512:06
* dtantsur wonders what's it there about using LSD12:07
dtantsur:D12:07
guilhermespoh12:07
guilhermesphahahaha12:07
iurygregorydtantsur, its the lab at UFCG in Brazil =)12:07
guilhermespin portuguese: Laboratorio de Sistemas Distribuidos12:07
dtantsuranyway, you sure it's zeroing disks? you can look at node.clean_steps and node.driver_internal_info12:07
guilhermespbut yeah, there're lots of crazy ppl there12:07
dtantsurah! well, writing ansible under LSD sounded funnier12:07
dtantsurjust imaging THAT PLAYBOOK12:08
iurygregoryHAHAHAHAH12:08
iurygregoryomg12:08
guilhermespdtantsur: so we've been checking this http://paste.openstack.org/show/755327/ and seems to be stuck in this status12:08
*** Lucas_Gray has quit IRC12:08
guilhermespjust to be a bit more complete http://paste.openstack.org/show/755328/12:08
dtantsurguilhermesp: I don't remember be heart if these options are sent always or only with the step is enabled12:09
dtantsurthat's why I suggest checking the clean_steps attribute (or just paste the whole node record)12:09
guilhermespok so just for the record: which would be the sintax to check it? :P12:10
rpittauI turn my head 1 sec and people start talking about LSD?12:11
dtantsursorry, it was a clean step (substitute it instead of driver_internal_info)12:11
guilhermespah ok12:11
guilhermesplet me see12:11
iurygregoryrpittau, yeah https://www.lsd.ufcg.edu.br/#/ aka Distributed System Laboratory in english12:12
guilhermespups dtantsur seems that returned {}12:12
rpittauiurygregory: oh :/12:12
guilhermesphttp://paste.openstack.org/show/755329/12:12
iurygregoryrpittau, =P12:12
dtantsurguilhermesp: yeah.. I also don't see clean_steps in your driver_internal_info12:13
* rpittau cooking12:13
guilhermespwhich means: no cleaning being executed now12:13
dtantsurguilhermesp: it looks like cleaning hasn't started at all12:13
dtantsuryou probably need to track the node UUID through ironic-conductor logs to understand what's happening12:13
guilhermespyeah let me try to find it12:14
*** jawad_axd has quit IRC12:16
*** jjohnson42 has joined #openstack-ironic12:16
iurygregorynot sure how much time would take to wip 2TB ...12:17
*** rachit7 has joined #openstack-ironic12:18
guilhermespyeah nothing on conductor logs and yeah, disk is 2tb12:18
iurygregorywipe*12:18
rpittaureally depends on the type of erase12:20
TheJuliagood morning12:20
rpittauand tghe type of disk12:20
rpittaugood morning TheJulia :)12:20
* etingof can't help but wonder which cuisine rpittau is cooking - French or Italian...12:21
etingofTheJulia, o/12:21
guilhermespmorning TheJulia12:21
iurygregorymorning TheJulia12:21
guilhermesphuum I was wondering that disabling the erase_device_priority would ignore the type/size of disk12:21
rpittauetingof: I went for an easy and quick pasta :)12:21
*** rh-jelabarre has joined #openstack-ironic12:22
etingofthat sounds more Italian to me12:22
*** ricolin has joined #openstack-ironic12:23
rpittauetingof: definitely Italian, the pasta I used is typical from region, just smuggled it from Sardegna :D12:23
*** ociuhandu has quit IRC12:24
openstackgerritDmitry Tantsur proposed openstack/metalsmith master: Remove deprecations from 0.13  https://review.opendev.org/67429212:25
* iurygregory is going to make pasta for lunch also XD12:25
openstackgerritPavlo Shchelokovskyy proposed openstack/ironic master: Use HTTPProxyToWSGI middleware from oslo  https://review.opendev.org/67281912:25
*** gkadam has quit IRC12:26
*** priteau has quit IRC12:28
openstackgerritPavlo Shchelokovskyy proposed openstack/ironic master: Use HTTPProxyToWSGI middleware from oslo  https://review.opendev.org/67281912:29
dtantsurguilhermesp: a wild guess: do you even have ANY clean steps enabled?12:35
dtantsurguilhermesp: e.g. we enable removing metadata https://github.com/metal3-io/ironic-image/blob/master/ironic.conf#L2712:35
dtantsurI wonder if you see this behavior because you don't have any clean steps12:36
dtantsur(not saying it's the right behavior..)12:36
*** jjohnson42 has quit IRC12:38
openstackgerritSurya Seetharaman proposed openstack/ironic master: Support power state change callbacks to nova using ksa_adapter  https://review.opendev.org/66484212:39
*** jjohnson42 has joined #openstack-ironic12:46
*** mkowalski has quit IRC12:53
*** mkowalski has joined #openstack-ironic12:53
*** rh-jelabarre has quit IRC13:00
guilhermespnops dtantsur .... I wonder if this is relate to the drive I'm using... it is an nvme of 1.92TB13:02
guilhermespI just tried to clean again and it seems that clean_step is {}13:03
*** sthussey has joined #openstack-ironic13:04
dtantsurguilhermesp: did you add any clean steps? if you have zero clean steps enabled, you can just as well disable automated cleaning.13:05
dtantsurguilhermesp: but I'd recommend you enable the metadata cleaning.13:05
guilhermesphum, actually the only settings I have here is automated_clean = true and erase_device_priority = 0. You suggest to disable automated_clean and add https://github.com/metal3-io/ironic-image/blob/61e8c8a7b122d8bad9ffc45bb39eb927d258a059/ironic.conf#L27 as well?13:06
openstackgerritraphael.glon proposed openstack/ironic stable/stein: Ansible driver: fix deployment with serial specified as root device hint  https://review.opendev.org/67431013:07
openstackgerritraphael.glon proposed openstack/ironic stable/rocky: Ansible driver: fix deployment with serial specified as root device hint  https://review.opendev.org/67431113:08
*** mbeierl has quit IRC13:08
dtantsurguilhermesp: I suggest you keep automated_clean, but add erase_devices_metadata_priority != 013:08
guilhermespthe default value is 0 right? I can set it now as 10 following the link you sent me13:09
dtantsuryep13:10
guilhermespI will give a try13:10
*** priteau has joined #openstack-ironic13:10
*** ociuhandu has joined #openstack-ironic13:11
*** jcoufal has joined #openstack-ironic13:11
guilhermesphuum, seems that I'm still getting {} from cleaning steps13:18
TheJuliabraaaiiinsss13:19
*** rachit7 has quit IRC13:40
*** verma-varsha has joined #openstack-ironic13:43
guilhermespso the type of drive doesn't have any influence in the cleaning process right?13:47
*** verma-varsha has quit IRC13:47
*** jcoufal_ has joined #openstack-ironic13:47
dtantsurnot at this stage, I guess13:48
*** jcoufal has quit IRC13:48
*** verma-varsha has joined #openstack-ironic13:52
*** verma-varsha has quit IRC13:56
tssuryadtantsur: o/ whenever you have some time could you have a look at https://review.opendev.org/#/c/664842/10/zuul.d/ironic-jobs.yaml and tell me if that's how its done ? I guess I just did the same as we do in nova, but maybe in ironic its not the same since the CI fails13:58
patchbotpatch 664842 - ironic - Support power state change callbacks to nova using... - 10 patch sets13:58
tssuryathanks in advnace13:59
*** verma-varsha has joined #openstack-ironic14:10
*** kaiokmo has joined #openstack-ironic14:12
*** rh-jelabarre has joined #openstack-ironic14:19
*** verma-varsha has quit IRC14:20
dtantsurrpittau: we have a transient failure in sdk: https://logs.opendev.org/98/674298/1/check/openstacksdk-functional-devstack-ironic/f2521c2/testr_results.html.gz14:31
dtantsurnot guaranteed ordering. could you take a look?14:31
rpittaudtantsur: sure14:32
*** gkadam has joined #openstack-ironic14:32
dtantsurtssurya: let's maybe make it a devstack logic? something like `if is_service_enabled nova`?14:32
pas-ha@dtantsur https://review.opendev.org/#/c/672819/ unit test added14:37
patchbotpatch 672819 - ironic - Use HTTPProxyToWSGI middleware from oslo - 5 patch sets14:37
dtantsurthx! will check later14:37
pas-hathanks :-)14:38
*** gkadam has quit IRC14:38
tssuryadtantsur: I am not sure if I understand correctly, do you mean something seperate from `send_power_notifications`?14:38
*** Lucas_Gray has joined #openstack-ironic14:39
*** verma-varsha has joined #openstack-ironic14:40
openstackgerritMerged openstack/ironic master: Use openstacksdk for accessing ironic-inspector  https://review.opendev.org/66985514:48
*** iurygregory has quit IRC14:57
*** diga has quit IRC15:02
*** tssurya has quit IRC15:05
rpittaudtantsur: I think this https://review.opendev.org/674328 should sort the issue (pun intended)15:07
patchbotpatch 674328 - openstacksdk - Sort output of functional test trait - 1 patch set15:07
*** Goneri has quit IRC15:07
dtantsurlol15:07
*** ociuhandu has quit IRC15:09
*** ociuhandu has joined #openstack-ironic15:09
TheJuliagregwork: you around?15:16
gregworkTheJulia: hey15:17
TheJuliagregwork: is there a BZ for the other issue that you were encountering where the config drive build would fail on talking to keystone?15:18
gregworkno, we have a working theory as to what the issue might be15:18
gregworkwe redeployed the undercloud without ipa/ssl so just plain http and all the bad behaviour went away.  this is interesting because given that this is a virtualized environment and we adjusted storage/memory/cpu to well beyond what we need the only thing left that could account for the slowness is the vm running out of entropy for the crypto ops15:19
* TheJulia blinks15:20
gregworki think that because all the ssl/crypto ops were grinding to a snails pace while /dev/random caught up caused all the code to shake apart15:20
TheJuliaOH!15:20
TheJuliawow15:20
gregworkbecause they are not expecting all the ssl ops to be randomly slow15:20
TheJuliaso... yeah15:20
dtantsurwow indeed15:20
TheJuliawhy are we not using urandom?15:20
gregworkno rngd was running to help feed the vm15:20
gregworkand we were defaulting to whatever libvirt has for entropy15:21
gregworki think its 2kb/s15:21
gregworkits super conservative15:21
gregworkthis is the theory15:21
gregworkbut we have been swapping out everything15:21
gregworkand this is kind of whats left15:21
gregworkdedicated san cabinet for the director15:21
gregwork64gb for director15:21
gregwork16 vcpu15:21
gregworkno noisy vms15:21
gregworkonly thing left is stuff like crypto ops15:22
gregworkand ssl+kerberos is pretty crypto heavy15:22
gregworkwe dont get ANY of the errors we were seeing before15:22
gregworkno ironic/neutron fights on ports15:22
gregworkno nova scheduling issues15:22
gregworkwell we still see some failures with the power operations15:23
gregworkso we kept your 30s nova_api retry15:23
gregworkthat + the CUSTOM_BAREMETAL tagging on osdcompute15:23
gregworkseems to cause that random last man building to go away15:23
gregworkbut all that crazy other errors are gone15:23
dtantsurrpittau: we do use set() for traits https://github.com/openstack/ironic/blob/master/ironic/api/controllers/v1/node.py#L820-L82315:23
gregworkim asking gss for guidance on tuning entropy settings in RHV/libvirt for crypto heavy guests15:24
gregworkand director is an extremely heavy guest since its basically an all-in-one openstack deploy15:24
gregworkturning on tls+kerberos should probably require special handling15:25
gregworkat least recommend rngd be installed15:25
gregworkor havengd15:25
gregworkon the upside, i exposed latency sensitivity in the ironic/neutron/nova dance ?15:26
gregworkheh15:26
gregworksomething to think about i guess from a dev pov15:26
rpittaudtantsur: oh geez, ok :/15:26
TheJuliagregwork: oh wow..... so it is not 30 seconds, but 30 times btw, :)15:28
TheJuliagregwork: Well, thanks for the update, sorry you've been righting that pain. Perhaps enjoy a beer for international beer day?15:28
gregworkhaha15:29
gregworktalking with some redhat pros that do installs they said they always deploy the director on a vm because of the snapshotting they do15:29
gregworkso this is a real factor to consider15:29
gregworkgiven the time involved in setting up director and the value of snapping back to known clean states15:30
gregworki think its a good idea to consider it being a vm15:30
gregworkand subject to this15:30
*** dsneddon has joined #openstack-ironic15:34
*** dsneddon has quit IRC15:39
rpiosoGood morning, ironicers.15:45
openstackgerritDmitry Tantsur proposed openstack/ironic master: Update software RAID configuration documentation  https://review.opendev.org/67401915:50
dtantsurmorning rpioso15:51
rpiosodtantsur: Hey!15:51
*** ociuhandu has quit IRC15:56
*** ociuhandu has joined #openstack-ironic16:00
openstackgerritVarsha Verma proposed openstack/sushy-tools master: Add Storage and Storage Controllers resource support  https://review.opendev.org/67433916:05
*** sabedevops has joined #openstack-ironic16:05
*** gyee has joined #openstack-ironic16:06
*** lucasagomes has quit IRC16:06
openstackgerritVarsha Verma proposed openstack/sushy-tools master: Add Storage and Storage Controllers resource support  https://review.opendev.org/67433916:10
*** verma-varsha has quit IRC16:12
*** ash2307 has joined #openstack-ironic16:14
*** pcaruana has quit IRC16:14
*** ociuhandu has quit IRC16:21
*** ociuhandu has joined #openstack-ironic16:22
*** ociuhandu has quit IRC16:26
*** ociuhandu has joined #openstack-ironic16:27
*** altlogbot_0 has quit IRC16:29
*** verma-varsha has joined #openstack-ironic16:30
*** irclogbot_0 has quit IRC16:33
*** altlogbot_2 has joined #openstack-ironic16:36
*** dtantsur is now known as dtantsur|afk16:39
dtantsur|afkhave a great weekend, all! I'm out on Monday, so see you on Tuesday16:39
rpittauthanks! you too!16:39
*** irclogbot_0 has joined #openstack-ironic16:41
*** verma-varsha1 has joined #openstack-ironic16:45
*** verma-varsha has quit IRC16:46
*** verma-varsha1 is now known as verma-varsha16:46
*** rpittau is now known as rpittau|afk16:46
rpittau|afkbye all, have a great weekend!16:46
*** verma-varsha1 has joined #openstack-ironic16:55
*** verma-varsha has quit IRC16:57
*** verma-varsha1 is now known as verma-varsha16:57
*** ociuhandu has quit IRC16:57
*** ociuhandu has joined #openstack-ironic16:57
*** tesseract has quit IRC16:58
*** Goneri has joined #openstack-ironic16:59
*** derekh has quit IRC17:01
*** ociuhandu has quit IRC17:02
*** igordc has joined #openstack-ironic17:03
*** mkowalski has quit IRC17:04
*** verma-varsha has quit IRC17:06
*** ricolin has quit IRC17:07
*** bobmel has joined #openstack-ironic17:08
*** bobmel has quit IRC17:09
* etingof thinks that oem action support in sushy is broken even more severely than regular action support 17:10
* rpioso wonders why etingof thinks that?17:11
*** dougsz has joined #openstack-ironic17:12
etingofrpioso, most importantly, vendor ID is not picked from action namespace mixing up actions from multiple vendors17:12
* rpioso scratches his head17:13
etingofthat's on top of that oem action fields are not parsed in the same way as non-oem action fields17:13
etingofwhich is on top of the fact that sushy does not offer any reasonable abstraction for any action17:13
* rpioso pulls up the code17:13
*** verma-varsha has joined #openstack-ironic17:13
etingofrpioso, do not do that! enjoy your weekend!17:14
rpiosoetingof: LOL17:14
etingofrpioso, expanding on the first point: as far as I can understand Redfish, in Actions JSON you have it like {"Actions": {"Oem": {"Dell.v2_0#SomeInsanity": ...}}}17:16
*** verma-varsha has quit IRC17:16
etingof(I missed # before Dell)17:17
etingofso #Dell.v2_0 should tell us that this object belongs to Dell OEM17:17
etingofwhich sushy happily ignores17:17
* rpioso prefers {"Actions": {"Oem": {"#Dell.v2_0#Awesomeness": ...}}} or similar ;-)17:17
*** bobmel has joined #openstack-ironic17:18
etingofthat's what I mean indeed17:18
rpiosoI see https://opendev.org/openstack/sushy/src/commit/66a2af1fc2f45c94ab8a3fbd091b35eeec99918c/sushy/resources/oem/fake.py#L3017:21
rpiosoDoes stevedore and the sushy's OEM foundation care about the standard particulars or any specific implementation of it?17:21
*** openstackgerrit has quit IRC17:22
rpiosoetingof: Couldn't that code be: reset_action = base.Field(['Actions', 'Oem', 'Atypical.LetsGo'] ?17:23
*** bobmel has quit IRC17:23
*** bobmel has joined #openstack-ironic17:24
*** gyee has quit IRC17:24
* rpioso has read the code, but not played with it.17:24
etingofwell, here is how it'd done for the root resource -- https://opendev.org/openstack/sushy/src/branch/master/sushy/resources/system/system.py#L13617:26
*** ociuhandu has joined #openstack-ironic17:26
*** openstackgerrit has joined #openstack-ironic17:28
openstackgerritVarsha Verma proposed openstack/sushy-tools master: Add Storage and Storage Controllers resource support  https://review.opendev.org/67433917:28
rpiosoetingof: How is System._actions used?17:30
*** priteau has quit IRC17:31
etingofI think it's never used because 'reset' attribute is magically put in its place17:32
*** dougsz has quit IRC17:32
etingofso it feels messy to me17:33
*** sabedevops has quit IRC17:33
rpiosoetingof: It's used in the action-related methods defined by System.17:34
rpiosoetingof: It's not directly accessible to clients.17:34
*** dsneddon has joined #openstack-ironic17:34
etingofyes, that's what I mean17:34
etingofalso, I'm suspicious re OEM action properties naming... Name like 'OemManager.v1_0#OemManager....' does not carry any hint that this property belongs to Dell...17:35
etingofmy reading of Redfish spec gives me the feeling that it should better look like 'Dell_OemManager.v1_0#OemManager...'17:36
rpiosoetingof: Actions are by their very nature are messy -- "Actions are Redfish operations that do not easily map to RESTful interface semantics."17:36
*** gyee has joined #openstack-ironic17:36
etingofso in sushy we are well-aligned with the standard17:36
* etingof is referring to chapter 7.5.7.3 here -- https://www.dmtf.org/sites/default/files/standards/documents/DSP0266_1.5.0.pdf17:37
rpiosoetingof: That may look better, but I don't believe it functionally matters. The OEM content is defined by the vendor. The vendor needs to deal with name collisions, if any, within 'Oem'.17:38
*** dsneddon has quit IRC17:39
etingofsince Actions->Oem does not have any vendor isolation layer, the naming seems utterly important here17:39
etingofperhaps that's why they note naming conventions in 7.5.7.317:40
etingofinterestingly, it's different in Resource->Oem because there they have vendor ID i.e. Resource->Oem->Dell17:41
rpiosoetingof: It's a resource published by a Redfish service, which is often implemented by a vendor. The vendor needs to ensure there are no name collisions.17:42
*** jcoufal_ has quit IRC17:43
rpiosoetingof: If there's a name collision, then that would be problematic.17:43
etingofwell, how is Actions branch different from Resource branch? why they separate OEM resources per vendor, but do not do that explicitly for Actions...?17:44
rpiosoetingof: Doesn't 7.5.7.3 cover Oem property naming, instead of Oem action naming?17:45
* rpioso prefers the latest version of the spec -- https://www.dmtf.org/sites/default/files/standards/documents/DSP0266_1.7.0.pdf17:46
*** Lucas_Gray has quit IRC17:47
rpiosoetingof: 7.5.8.1 covers Oem action naming.17:48
rpiosoetingof: There appears to be a difference between the standard and implementation. Aside from tidiness, do you think it matters?17:49
*** ociuhandu has quit IRC17:49
*** ociuhandu has joined #openstack-ironic17:50
*** ociuhandu has quit IRC17:50
* etingof can't locate 7.5.8.1 in the latest rpioso's link17:50
rpiosoetingof: It's in your link :-)17:51
etingofah, it's now 8.7.517:52
rpiosoetingof: 9.7.517:53
etingofyes, that's what I wanted to paste17:54
rpiosoetingof: :-)17:54
etingofso they say the key should be 'QualifiedActionName'17:54
rpiosoetingof: And that's not formally defined :-(17:54
etingofafaik, that's empty for standard things17:55
*** mkowalski has joined #openstack-ironic17:55
rpiosoetingof: The description of 'QualifiedActionName' does state it should contain the namespace.17:55
etingofyes17:56
etingofthat makes me think that it should better look like #Dell_OemManager17:56
rpiosoetingof: Is that a nit or important?17:56
* rpioso wants to be sure he understands17:57
* rpioso keeps reminding himself that the spec and its implementations are evolving.17:58
etingofthat's hard to say now... I can offer you this scenario - two vendors come up with colliding non-namespaced keys. That worked fine till a new product is built incorporating hardware resources from both vendors...18:00
*** jcoufal has joined #openstack-ironic18:00
*** verma-varsha has joined #openstack-ironic18:04
rpiosoetingof: So if the System from vendor Foo contains components from itself and suppliers Bar and Baz, then those three vendors must not have name collisions in Oem. Vendor Foo must ensure that now and in the future, even as it changes its component suppliers.18:04
rpiosoetingof: However, System vendor Foo doesn't need to concern itself with System vendor LatestFoo.18:05
*** verma-varsha has quit IRC18:06
etingofrpioso, what if component suppliers have their redfish schemas already well-known and supported in client software? Meaning that renaming conflicting actions even being a part of a larger product may not be desirable?18:06
rpiosoetingof: I get that.18:07
etingofI have another argument18:07
rpiosoetingof: There will be issues and bugs.18:08
rpiosoetingof: I agree it would be better now and in the future.18:08
etingofit seems to me that existing way of getting hold of specific Action in sushy (https://opendev.org/openstack/sushy/src/commit/66a2af1fc2f45c94ab8a3fbd091b35eeec99918c/sushy/resources/oem/fake.py#L30) by fully specified key is somewhat rigid18:09
etingofbecause it might include schema version18:10
guilhermespso dtantsur|afk seems that is only working for me here with coreos images https://docs.openstack.org/ironic/stein/install/deploy-ramdisk.html18:10
etingofso if we have it hardcoded into client sw, it will stop working when server implementation change anything there18:10
*** e0ne has quit IRC18:11
rpiosoetingof: Isn't it both flexible and rigid?18:11
etingofit would probably be better to cut by # and use the tail piece as action name18:11
etingof(that's what is happening with standard resources - schema version is not in the key)18:12
rpiosoetingof: It accommodates today's interesting implementations.18:12
rpiosoetingof: Do you have concerns about https://review.opendev.org/#/c/463829/18:13
patchbotpatch 463829 - sushy - Add foundation for supporting Redfish OEMs (MERGED) - 20 patch sets18:13
etingofbut then we would have to take apart the leading token which includes unique namespace and schema version, drop schema version, match the desired action against vendor ID18:13
etingofthat's all to argue that 'Dell_v1.0#Oem.Awesomeness' would probably work better18:14
*** jtomasek has quit IRC18:15
etingofit can be even 'Dell_Oem_Awesome_ness_v1.0#Oem.Awesomeness', the only important thing is to have a way to get unique vendor ID18:15
etingofyes, that's the patch18:16
guilhermespdtantsur|afk: but I suspect the node that was stuck is with problems with the nvme device... because I'm using the same coreos images on it and it is still in clean wait ... anyways, thanks fro your help18:19
*** yaawang has joined #openstack-ironic18:57
*** portdirect has quit IRC19:13
*** portdirect has joined #openstack-ironic19:13
*** e0ne has joined #openstack-ironic19:13
*** sabedevops has joined #openstack-ironic19:19
*** yaawang has quit IRC19:25
*** mgoddard has quit IRC19:37
*** mgoddard has joined #openstack-ironic19:38
*** irclogbot_0 has quit IRC19:39
*** irclogbot_2 has joined #openstack-ironic19:43
*** sabedevops has quit IRC19:46
*** mkowalski has quit IRC19:49
*** whoami-rajat has quit IRC20:04
*** e0ne has quit IRC20:11
*** rh-jelabarre has quit IRC20:11
*** Lucas_Gray has joined #openstack-ironic20:12
*** jjohnson42 has quit IRC20:20
*** Lucas_Gray has quit IRC21:03
openstackgerritJulia Kreger proposed openstack/sushy master: Implements adapter checking  https://review.opendev.org/66996321:09
*** Lucas_Gray has joined #openstack-ironic21:09
rpiosoTheJulia: Where can I find the Ironic Train release schedule?21:11
TheJuliarpioso: we don't publish a specific schedule, but we have to create stable/train for RC121:11
TheJuliaas part o the openstack community RC1 release21:12
rpiosoTheJulia: When's our Train feature freeze?21:12
TheJuliarpioso: We generally soft freeze around ~2 weeks prior to having to cut that branch, but exceptions can and have been made in the past. The key is knowing sooner rather than later and communicating that need/want.21:14
TheJuliarpioso: That soft freeze is more so we don't break the gate, so if it is not directly upstream CI tested, then it is easier to accept21:15
openstackgerritMerged openstack/ironic master: Update software RAID configuration documentation  https://review.opendev.org/67401921:18
*** EmilienM is now known as EmilienM|afk21:28
*** EmilienM|afk is now known as EmilienM21:28
rpiosoTheJulia: Do you mean "so if it isn't directly exercised by the upstream CI testing, then it is easier to accept, because it doesn't introduce risk to the stability of the CI"?21:30
TheJuliarpioso: correct21:30
* rpioso is just trying to understand on a late Friday21:30
rpiosoTheJulia: Thank you so much!21:30
*** jcoufal_ has joined #openstack-ironic21:31
TheJuliarpioso: Any stability impact to CI during those last few weeks makes for grumpy cores trying to get things into a state where we can release21:31
TheJuliamainly because those weeks tend to be very very long weeks.21:31
*** jcoufal has quit IRC21:31
*** dsneddon has joined #openstack-ironic21:34
*** dsneddon has quit IRC21:39
* rpioso is all for keeping cores very, very happy and rested21:40
TheJuliadoesn't really work for end of cycle, but the thought counts! :)21:50
*** betherly has joined #openstack-ironic21:55
openstackgerritMerged openstack/sushy master: Action #Bios.ResetBios fails as POST request has no body  https://review.opendev.org/67141321:56
*** jcoufal_ has quit IRC22:01
*** betherly has quit IRC22:01
*** Lucas_Gray has quit IRC22:02
*** jistr has quit IRC22:02
openstackgerritJulia Kreger proposed openstack/ironic master: Add Redfish Virtual Media Boot support  https://review.opendev.org/63845322:05
*** Lucas_Gray has joined #openstack-ironic22:08
*** jistr has joined #openstack-ironic22:09
*** jistr has quit IRC22:17
*** jistr has joined #openstack-ironic22:19
rpiosoTheJulia: :-)22:19
openstackgerritMerged openstack/ironic master: Follow-up to the IntelIPMIHardware patch  https://review.opendev.org/67265223:08
*** betherly has joined #openstack-ironic23:26
*** betherly has quit IRC23:31
*** sthussey has quit IRC23:43
*** betherly has joined #openstack-ironic23:47
*** betherly has quit IRC23:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!