*** ianychoi has joined #openstack-ironic | 00:34 | |
*** betherly has joined #openstack-ironic | 00:35 | |
*** Lucas_Gray has quit IRC | 00:36 | |
*** betherly has quit IRC | 00:39 | |
*** betherly has joined #openstack-ironic | 00:55 | |
*** betherly has quit IRC | 01:00 | |
*** devx has quit IRC | 01:03 | |
*** devx has joined #openstack-ironic | 01:04 | |
kaifeng | morning | 01:16 |
---|---|---|
openstackgerrit | Merged openstack/ironic-python-agent master: Repair building tinyipa images after the move to ipa-builder https://review.opendev.org/674026 | 01:45 |
*** betherly has joined #openstack-ironic | 01:46 | |
*** e0ne has joined #openstack-ironic | 01:48 | |
*** betherly has quit IRC | 01:52 | |
*** e0ne has quit IRC | 01:52 | |
*** rloo has quit IRC | 02:11 | |
openstackgerrit | pengyuesheng proposed openstack/networking-baremetal master: Bump the openstackdocstheme extension to 1.20 https://review.opendev.org/673976 | 02:20 |
*** rloo has joined #openstack-ironic | 02:21 | |
*** rh-jelabarre has quit IRC | 02:21 | |
*** rloo has quit IRC | 02:21 | |
*** rloo has joined #openstack-ironic | 02:22 | |
TheJulia | good morning | 02:39 |
openstackgerrit | Kaifeng Wang proposed openstack/ironic-inspector master: Adds tooz locking driver https://review.opendev.org/670763 | 02:42 |
kaifeng | morning TheJulia see you again :) | 02:42 |
*** dsneddon has quit IRC | 02:46 | |
*** betherly has joined #openstack-ironic | 02:59 | |
*** dsneddon has joined #openstack-ironic | 02:59 | |
*** betherly has quit IRC | 03:03 | |
*** dsneddon has quit IRC | 03:04 | |
*** ash2307 has left #openstack-ironic | 03:12 | |
*** betherly has joined #openstack-ironic | 03:19 | |
*** betherly has quit IRC | 03:24 | |
*** gyee has quit IRC | 03:26 | |
*** rloo has quit IRC | 03:29 | |
*** betherly has joined #openstack-ironic | 03:39 | |
*** betherly has quit IRC | 03:45 | |
*** gkadam has joined #openstack-ironic | 03:49 | |
*** betherly has joined #openstack-ironic | 03:50 | |
*** betherly has quit IRC | 03:55 | |
*** betherly has joined #openstack-ironic | 04:11 | |
*** betherly has quit IRC | 04:16 | |
*** betherly has joined #openstack-ironic | 04:21 | |
*** betherly has quit IRC | 04:26 | |
*** e0ne has joined #openstack-ironic | 04:30 | |
*** verma-varsha has joined #openstack-ironic | 04:31 | |
*** whoami-rajat has joined #openstack-ironic | 04:34 | |
*** e0ne has quit IRC | 04:35 | |
*** betherly has joined #openstack-ironic | 04:41 | |
*** betherly has quit IRC | 04:46 | |
*** diga has joined #openstack-ironic | 04:54 | |
*** betherly has joined #openstack-ironic | 05:02 | |
*** dsneddon has joined #openstack-ironic | 05:03 | |
*** betherly has quit IRC | 05:07 | |
*** Lucas_Gray has joined #openstack-ironic | 05:10 | |
*** betherly has joined #openstack-ironic | 05:18 | |
*** yaawang has quit IRC | 05:19 | |
*** betherly has quit IRC | 05:22 | |
*** yaawang has joined #openstack-ironic | 05:28 | |
*** rachit7 has joined #openstack-ironic | 05:28 | |
*** yaawang has quit IRC | 05:33 | |
openstackgerrit | Kaifeng Wang proposed openstack/ironic-inspector master: Split API and conductor services https://review.opendev.org/673732 | 05:51 |
*** iurygregory has quit IRC | 05:56 | |
*** mkowalski has joined #openstack-ironic | 05:57 | |
*** e0ne has joined #openstack-ironic | 06:04 | |
openstackgerrit | pengyuesheng proposed openstack/python-ironic-inspector-client master: Blacklist sphinx 2.1.0 (autodoc bug) https://review.opendev.org/674185 | 06:10 |
*** Lucas_Gray has quit IRC | 06:13 | |
openstackgerrit | pengyuesheng proposed openstack/python-ironic-inspector-client master: Bump the openstackdocstheme extension to 1.20 https://review.opendev.org/674186 | 06:14 |
verma-varsha | etingof: I think there's some problem with the Chassis and Manager resource emulation in sushy-tools here(https://github.com/openstack/sushy-tools/blob/master/sushy_tools/emulator/resources/chassis/staticdriver.py#L30). As in, no matter what we provide in the emulator.conf file, `app.config.get` still returns None and hence the default is being used every time | 06:18 |
openstackgerrit | pengyuesheng proposed openstack/virtualbmc master: Blacklist sphinx 2.1.0 (autodoc bug) https://review.opendev.org/674189 | 06:19 |
openstackgerrit | pengyuesheng proposed openstack/virtualbmc master: Bump the openstackdocstheme extension to 1.20 https://review.opendev.org/674190 | 06:22 |
*** e0ne has quit IRC | 06:42 | |
*** e0ne has joined #openstack-ironic | 06:45 | |
*** verma-varsha has quit IRC | 06:49 | |
*** jhesketh has joined #openstack-ironic | 06:54 | |
*** dsneddon has quit IRC | 06:56 | |
*** rcernin has quit IRC | 06:58 | |
*** verma-varsha has joined #openstack-ironic | 06:59 | |
*** sekharvajjula has quit IRC | 06:59 | |
*** dsneddon has joined #openstack-ironic | 07:00 | |
*** tesseract has joined #openstack-ironic | 07:17 | |
verma-varsha | etingof: I figured I was running into that error because I hadn't set the environment variable for the config file. Apologies for the false alarm. | 07:25 |
etingof | verma-varsha, awesome! I just wanted to refer you to devstack/ironic where the config file is being used | 07:26 |
*** iurygregory has joined #openstack-ironic | 07:30 | |
iurygregory | good morning Ironic o/ | 07:30 |
*** e0ne has quit IRC | 07:31 | |
etingof | o/ iurygregory | 07:32 |
*** tssurya has joined #openstack-ironic | 07:38 | |
*** jtomasek has joined #openstack-ironic | 07:47 | |
*** jtomasek has quit IRC | 07:48 | |
*** jtomasek has joined #openstack-ironic | 07:49 | |
*** lucasagomes has joined #openstack-ironic | 07:52 | |
*** kaifeng has quit IRC | 08:00 | |
dtantsur | morning | 08:02 |
openstackgerrit | Kaifeng Wang proposed openstack/ironic-inspector master: Split API and conductor services https://review.opendev.org/673732 | 08:07 |
*** kaifeng has joined #openstack-ironic | 08:09 | |
kaifeng | dtantsur: have a test on etcd3gw, it seems working now o/ | 08:09 |
dtantsur | \o/ | 08:11 |
dtantsur | so, the problem was probably in eventlet | 08:11 |
kaifeng | not sure, tooz is using a thread for the heartbeating | 08:12 |
openstackgerrit | Surya Seetharaman proposed openstack/ironic master: Support power state change callbacks to nova using ksa_adapter https://review.opendev.org/664842 | 08:26 |
*** dsneddon has quit IRC | 08:32 | |
*** iurygregory has quit IRC | 08:35 | |
*** jtomasek has quit IRC | 08:40 | |
openstackgerrit | Nisha Agarwal proposed openstack/ironic master: Implement basic interfaces for GraphicalConsole Interface https://review.opendev.org/547356 | 08:42 |
openstackgerrit | Nisha Agarwal proposed openstack/ironic master: RPC changes for Graphical Console https://review.opendev.org/640827 | 08:48 |
*** Lucas_Gray has joined #openstack-ironic | 08:51 | |
*** Goneri has joined #openstack-ironic | 08:54 | |
kaifeng | hi dtantsur, I am not following your comment about the unnecessary api script | 09:01 |
*** dsneddon has joined #openstack-ironic | 09:01 | |
dtantsur | kaifeng: we don't need a script to launch API, we can provide a WSGI entry point so that people use a real WSGI container | 09:01 |
*** rachit7 has quit IRC | 09:02 | |
dtantsur | like https://github.com/openstack/ironic/blob/master/setup.cfg#L50-L51 | 09:02 |
*** e0ne has joined #openstack-ironic | 09:03 | |
*** jtomasek has joined #openstack-ironic | 09:04 | |
kaifeng | got it, thanks, but having a console script seems handy for local debug or exercising, maybe adds a wsgi but still keeps the script? | 09:05 |
*** derekh has joined #openstack-ironic | 09:06 | |
openstackgerrit | Nisha Agarwal proposed openstack/ironic master: RPC changes for Graphical Console https://review.opendev.org/640827 | 09:22 |
openstackgerrit | Merged openstack/python-ironic-inspector-client master: CI: clean up required projects https://review.opendev.org/673442 | 09:22 |
kaifeng | dtantsur: okay, I think I have a general idea on what you mean, but in this patch, coordinator is started in the WSGIService, not flask itself. | 09:23 |
kaifeng | WSGIService itself can't be embedded into a container | 09:23 |
*** v12aml has joined #openstack-ironic | 09:32 | |
openstackgerrit | Merged openstack/sushy master: Add MappedListField https://review.opendev.org/671228 | 09:35 |
dtantsur | kaifeng: that's bad if so. we need to support the ability to run a wsgi application, that's how people run API services in production. | 09:36 |
dtantsur | are you sure WSGIService cannot be used as a WSGI application? how does ironic handle it? | 09:37 |
kaifeng | WSGIService here is a subclass of oslo Service, while ironic is a pecan instance, they are different | 09:39 |
kaifeng | I just did a quick check, it said so, but maybe need further confirmation. | 09:40 |
openstackgerrit | Dmitry Tantsur proposed openstack/metalsmith master: [WIP] Clean up exceptions metalsmith raises https://review.opendev.org/674247 | 09:42 |
openstackgerrit | Dmitry Tantsur proposed openstack/python-ironic-inspector-client stable/stein: CI: clean up required projects https://review.opendev.org/674248 | 09:43 |
kaifeng | bye ironicers o/ | 09:44 |
*** kaifeng has quit IRC | 09:44 | |
*** Lucas_Gray has quit IRC | 09:49 | |
*** dsneddon has quit IRC | 09:49 | |
*** Lucas_Gray has joined #openstack-ironic | 09:51 | |
*** v12aml has quit IRC | 09:52 | |
*** ociuhandu has joined #openstack-ironic | 09:54 | |
*** jawad_axd has joined #openstack-ironic | 09:56 | |
*** Goneri has quit IRC | 09:56 | |
*** priteau has joined #openstack-ironic | 10:13 | |
*** verma-varsha has quit IRC | 10:25 | |
*** ociuhandu has quit IRC | 10:34 | |
*** ociuhandu has joined #openstack-ironic | 10:34 | |
*** ociuhandu has quit IRC | 10:36 | |
*** ociuhandu has joined #openstack-ironic | 10:37 | |
openstackgerrit | Varsha Verma proposed openstack/sushy-tools master: Add Simple Storage resource support https://review.opendev.org/667328 | 10:45 |
*** iurygregory has joined #openstack-ironic | 10:47 | |
*** Goneri has joined #openstack-ironic | 10:51 | |
openstackgerrit | Varsha Verma proposed openstack/sushy-tools master: Add Simple Storage resource support https://review.opendev.org/667328 | 10:52 |
*** dsneddon has joined #openstack-ironic | 10:52 | |
*** verma-varsha has joined #openstack-ironic | 10:54 | |
openstackgerrit | Merged openstack/ironic master: RAID create fails if 'controller' is missing in 'target_raid_config' https://review.opendev.org/673854 | 10:56 |
*** ricolin has quit IRC | 11:00 | |
dtantsur | etingof: hey, do these snmp-related failures ring any bells? https://trunk.rdoproject.org/centos7/ad/80/ad802b441c5172c4a7a90138c04b0793fe73eb05_d0e11ceb/build.log | 11:05 |
dtantsur | ah, nevermind, it seems that a solution is mentioned in https://review.rdoproject.org/r/#/c/21681/ | 11:05 |
openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: WIP: Add iDRAC RAID deploy steps https://review.opendev.org/641731 | 11:07 |
openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Changes to enable execution of out of band deploy steps https://review.opendev.org/674268 | 11:07 |
openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Add new method 'apply_configuration' to RAIDInterface https://review.opendev.org/674269 | 11:07 |
openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Add deploy steps for Redfish BIOS interface https://review.opendev.org/642060 | 11:11 |
openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Add deploy steps for iLO BIOS interface https://review.opendev.org/674270 | 11:12 |
openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: Add iLO RAID deploy steps https://review.opendev.org/674271 | 11:14 |
openstackgerrit | Shivanand Tendulker proposed openstack/ironic master: WIP: Add iDRAC RAID deploy steps https://review.opendev.org/641731 | 11:16 |
openstackgerrit | Merged openstack/ironic master: Ansible driver: fix deployment with serial specified as root device hint https://review.opendev.org/672530 | 11:17 |
*** Wryhder has joined #openstack-ironic | 11:23 | |
*** Lucas_Gray has quit IRC | 11:23 | |
*** Wryhder is now known as Lucas_Gray | 11:24 | |
*** iurygregory has quit IRC | 11:31 | |
*** iurygregory has joined #openstack-ironic | 11:31 | |
*** verma-varsha has quit IRC | 11:37 | |
*** dsneddon has quit IRC | 11:37 | |
etingof | dtantsur, I am not sure... I've made a new release a couple of days back, so may be it's a regression. Do you see which pysnmp this job pulls? | 11:46 |
*** iurygregory has quit IRC | 11:47 | |
*** iurygregory has joined #openstack-ironic | 11:48 | |
*** Lucas_Gray has quit IRC | 11:51 | |
dtantsur | etingof: probably not a new one | 11:52 |
* etingof is relieved | 11:53 | |
etingof | dtantsur, but I found the answer -- https://stackoverflow.com/questions/47165894/pysnmp-returns-typeerror-with-anaconda-install-even-with-example-codehttps://stackoverflow.com/questions/47165894/pysnmp-returns-typeerror-with-anaconda-install-even-with-example-code | 11:53 |
*** rpittau|afk is now known as rpittau | 11:56 | |
rpittau | good afternoon ironic! o/ | 11:56 |
*** Lucas_Gray has joined #openstack-ironic | 12:00 | |
openstackgerrit | Dmitry Tantsur proposed openstack/metalsmith master: Clean up exceptions metalsmith raises https://review.opendev.org/674247 | 12:00 |
iurygregory | rpittau, o/ back to france? | 12:01 |
*** guilhermesp has joined #openstack-ironic | 12:02 | |
rpittau | iurygregory: yeah, same temperature, less sea :/ | 12:03 |
iurygregory | rpittau, good luck =( | 12:03 |
guilhermesp | morning all! We've been noticing that even setting up erase_devices_priority = 0, the cleaning process keeps stuck for hours ( http://paste.openstack.org/show/755327/ ). Is there any other setting to disable zeroing the disks during cleaning process? | 12:03 |
dtantsur | guilhermesp: hi! are you sure 1. you set it in the right place, 2. the process is not stuck because of something else (like PXE timeout)? | 12:04 |
guilhermesp | hey man, how's going ? :P | 12:05 |
dtantsur | guilhermesp: because this works: https://github.com/metal3-io/ironic-image/blob/master/ironic.conf#L27-L28 | 12:05 |
dtantsur | o/ | 12:05 |
guilhermesp | well. we are using openstack-ansible, that sets erase_devices_priority under [deploy] session | 12:05 |
guilhermesp | https://www.irccloud.com/pastebin/lztKgYBN/ | 12:05 |
iurygregory | guilhermesp, its ansible fault =P | 12:06 |
guilhermesp | services restarted and everything | 12:06 |
guilhermesp | nooooo LSD is using just fine with rocky :P | 12:06 |
dtantsur | blame ansible! :D | 12:06 |
guilhermesp | osa + rocky | 12:06 |
iurygregory | LSD still using osa + rocky? oh god | 12:06 |
guilhermesp | cloud5 | 12:06 |
* dtantsur wonders what's it there about using LSD | 12:07 | |
dtantsur | :D | 12:07 |
guilhermesp | oh | 12:07 |
guilhermesp | hahahaha | 12:07 |
iurygregory | dtantsur, its the lab at UFCG in Brazil =) | 12:07 |
guilhermesp | in portuguese: Laboratorio de Sistemas Distribuidos | 12:07 |
dtantsur | anyway, you sure it's zeroing disks? you can look at node.clean_steps and node.driver_internal_info | 12:07 |
guilhermesp | but yeah, there're lots of crazy ppl there | 12:07 |
dtantsur | ah! well, writing ansible under LSD sounded funnier | 12:07 |
dtantsur | just imaging THAT PLAYBOOK | 12:08 |
iurygregory | HAHAHAHAH | 12:08 |
iurygregory | omg | 12:08 |
guilhermesp | dtantsur: so we've been checking this http://paste.openstack.org/show/755327/ and seems to be stuck in this status | 12:08 |
*** Lucas_Gray has quit IRC | 12:08 | |
guilhermesp | just to be a bit more complete http://paste.openstack.org/show/755328/ | 12:08 |
dtantsur | guilhermesp: I don't remember be heart if these options are sent always or only with the step is enabled | 12:09 |
dtantsur | that's why I suggest checking the clean_steps attribute (or just paste the whole node record) | 12:09 |
guilhermesp | ok so just for the record: which would be the sintax to check it? :P | 12:10 |
rpittau | I turn my head 1 sec and people start talking about LSD? | 12:11 |
dtantsur | sorry, it was a clean step (substitute it instead of driver_internal_info) | 12:11 |
guilhermesp | ah ok | 12:11 |
guilhermesp | let me see | 12:11 |
iurygregory | rpittau, yeah https://www.lsd.ufcg.edu.br/#/ aka Distributed System Laboratory in english | 12:12 |
guilhermesp | ups dtantsur seems that returned {} | 12:12 |
rpittau | iurygregory: oh :/ | 12:12 |
guilhermesp | http://paste.openstack.org/show/755329/ | 12:12 |
iurygregory | rpittau, =P | 12:12 |
dtantsur | guilhermesp: yeah.. I also don't see clean_steps in your driver_internal_info | 12:13 |
* rpittau cooking | 12:13 | |
guilhermesp | which means: no cleaning being executed now | 12:13 |
dtantsur | guilhermesp: it looks like cleaning hasn't started at all | 12:13 |
dtantsur | you probably need to track the node UUID through ironic-conductor logs to understand what's happening | 12:13 |
guilhermesp | yeah let me try to find it | 12:14 |
*** jawad_axd has quit IRC | 12:16 | |
*** jjohnson42 has joined #openstack-ironic | 12:16 | |
iurygregory | not sure how much time would take to wip 2TB ... | 12:17 |
*** rachit7 has joined #openstack-ironic | 12:18 | |
guilhermesp | yeah nothing on conductor logs and yeah, disk is 2tb | 12:18 |
iurygregory | wipe* | 12:18 |
rpittau | really depends on the type of erase | 12:20 |
TheJulia | good morning | 12:20 |
rpittau | and tghe type of disk | 12:20 |
rpittau | good morning TheJulia :) | 12:20 |
* etingof can't help but wonder which cuisine rpittau is cooking - French or Italian... | 12:21 | |
etingof | TheJulia, o/ | 12:21 |
guilhermesp | morning TheJulia | 12:21 |
iurygregory | morning TheJulia | 12:21 |
guilhermesp | huum I was wondering that disabling the erase_device_priority would ignore the type/size of disk | 12:21 |
rpittau | etingof: I went for an easy and quick pasta :) | 12:21 |
*** rh-jelabarre has joined #openstack-ironic | 12:22 | |
etingof | that sounds more Italian to me | 12:22 |
*** ricolin has joined #openstack-ironic | 12:23 | |
rpittau | etingof: definitely Italian, the pasta I used is typical from region, just smuggled it from Sardegna :D | 12:23 |
*** ociuhandu has quit IRC | 12:24 | |
openstackgerrit | Dmitry Tantsur proposed openstack/metalsmith master: Remove deprecations from 0.13 https://review.opendev.org/674292 | 12:25 |
* iurygregory is going to make pasta for lunch also XD | 12:25 | |
openstackgerrit | Pavlo Shchelokovskyy proposed openstack/ironic master: Use HTTPProxyToWSGI middleware from oslo https://review.opendev.org/672819 | 12:25 |
*** gkadam has quit IRC | 12:26 | |
*** priteau has quit IRC | 12:28 | |
openstackgerrit | Pavlo Shchelokovskyy proposed openstack/ironic master: Use HTTPProxyToWSGI middleware from oslo https://review.opendev.org/672819 | 12:29 |
dtantsur | guilhermesp: a wild guess: do you even have ANY clean steps enabled? | 12:35 |
dtantsur | guilhermesp: e.g. we enable removing metadata https://github.com/metal3-io/ironic-image/blob/master/ironic.conf#L27 | 12:35 |
dtantsur | I wonder if you see this behavior because you don't have any clean steps | 12:36 |
dtantsur | (not saying it's the right behavior..) | 12:36 |
*** jjohnson42 has quit IRC | 12:38 | |
openstackgerrit | Surya Seetharaman proposed openstack/ironic master: Support power state change callbacks to nova using ksa_adapter https://review.opendev.org/664842 | 12:39 |
*** jjohnson42 has joined #openstack-ironic | 12:46 | |
*** mkowalski has quit IRC | 12:53 | |
*** mkowalski has joined #openstack-ironic | 12:53 | |
*** rh-jelabarre has quit IRC | 13:00 | |
guilhermesp | nops dtantsur .... I wonder if this is relate to the drive I'm using... it is an nvme of 1.92TB | 13:02 |
guilhermesp | I just tried to clean again and it seems that clean_step is {} | 13:03 |
*** sthussey has joined #openstack-ironic | 13:04 | |
dtantsur | guilhermesp: did you add any clean steps? if you have zero clean steps enabled, you can just as well disable automated cleaning. | 13:05 |
dtantsur | guilhermesp: but I'd recommend you enable the metadata cleaning. | 13:05 |
guilhermesp | hum, actually the only settings I have here is automated_clean = true and erase_device_priority = 0. You suggest to disable automated_clean and add https://github.com/metal3-io/ironic-image/blob/61e8c8a7b122d8bad9ffc45bb39eb927d258a059/ironic.conf#L27 as well? | 13:06 |
openstackgerrit | raphael.glon proposed openstack/ironic stable/stein: Ansible driver: fix deployment with serial specified as root device hint https://review.opendev.org/674310 | 13:07 |
openstackgerrit | raphael.glon proposed openstack/ironic stable/rocky: Ansible driver: fix deployment with serial specified as root device hint https://review.opendev.org/674311 | 13:08 |
*** mbeierl has quit IRC | 13:08 | |
dtantsur | guilhermesp: I suggest you keep automated_clean, but add erase_devices_metadata_priority != 0 | 13:08 |
guilhermesp | the default value is 0 right? I can set it now as 10 following the link you sent me | 13:09 |
dtantsur | yep | 13:10 |
guilhermesp | I will give a try | 13:10 |
*** priteau has joined #openstack-ironic | 13:10 | |
*** ociuhandu has joined #openstack-ironic | 13:11 | |
*** jcoufal has joined #openstack-ironic | 13:11 | |
guilhermesp | huum, seems that I'm still getting {} from cleaning steps | 13:18 |
TheJulia | braaaiiinsss | 13:19 |
*** rachit7 has quit IRC | 13:40 | |
*** verma-varsha has joined #openstack-ironic | 13:43 | |
guilhermesp | so the type of drive doesn't have any influence in the cleaning process right? | 13:47 |
*** verma-varsha has quit IRC | 13:47 | |
*** jcoufal_ has joined #openstack-ironic | 13:47 | |
dtantsur | not at this stage, I guess | 13:48 |
*** jcoufal has quit IRC | 13:48 | |
*** verma-varsha has joined #openstack-ironic | 13:52 | |
*** verma-varsha has quit IRC | 13:56 | |
tssurya | dtantsur: o/ whenever you have some time could you have a look at https://review.opendev.org/#/c/664842/10/zuul.d/ironic-jobs.yaml and tell me if that's how its done ? I guess I just did the same as we do in nova, but maybe in ironic its not the same since the CI fails | 13:58 |
patchbot | patch 664842 - ironic - Support power state change callbacks to nova using... - 10 patch sets | 13:58 |
tssurya | thanks in advnace | 13:59 |
*** verma-varsha has joined #openstack-ironic | 14:10 | |
*** kaiokmo has joined #openstack-ironic | 14:12 | |
*** rh-jelabarre has joined #openstack-ironic | 14:19 | |
*** verma-varsha has quit IRC | 14:20 | |
dtantsur | rpittau: we have a transient failure in sdk: https://logs.opendev.org/98/674298/1/check/openstacksdk-functional-devstack-ironic/f2521c2/testr_results.html.gz | 14:31 |
dtantsur | not guaranteed ordering. could you take a look? | 14:31 |
rpittau | dtantsur: sure | 14:32 |
*** gkadam has joined #openstack-ironic | 14:32 | |
dtantsur | tssurya: let's maybe make it a devstack logic? something like `if is_service_enabled nova`? | 14:32 |
pas-ha | @dtantsur https://review.opendev.org/#/c/672819/ unit test added | 14:37 |
patchbot | patch 672819 - ironic - Use HTTPProxyToWSGI middleware from oslo - 5 patch sets | 14:37 |
dtantsur | thx! will check later | 14:37 |
pas-ha | thanks :-) | 14:38 |
*** gkadam has quit IRC | 14:38 | |
tssurya | dtantsur: I am not sure if I understand correctly, do you mean something seperate from `send_power_notifications`? | 14:38 |
*** Lucas_Gray has joined #openstack-ironic | 14:39 | |
*** verma-varsha has joined #openstack-ironic | 14:40 | |
openstackgerrit | Merged openstack/ironic master: Use openstacksdk for accessing ironic-inspector https://review.opendev.org/669855 | 14:48 |
*** iurygregory has quit IRC | 14:57 | |
*** diga has quit IRC | 15:02 | |
*** tssurya has quit IRC | 15:05 | |
rpittau | dtantsur: I think this https://review.opendev.org/674328 should sort the issue (pun intended) | 15:07 |
patchbot | patch 674328 - openstacksdk - Sort output of functional test trait - 1 patch set | 15:07 |
*** Goneri has quit IRC | 15:07 | |
dtantsur | lol | 15:07 |
*** ociuhandu has quit IRC | 15:09 | |
*** ociuhandu has joined #openstack-ironic | 15:09 | |
TheJulia | gregwork: you around? | 15:16 |
gregwork | TheJulia: hey | 15:17 |
TheJulia | gregwork: is there a BZ for the other issue that you were encountering where the config drive build would fail on talking to keystone? | 15:18 |
gregwork | no, we have a working theory as to what the issue might be | 15:18 |
gregwork | we redeployed the undercloud without ipa/ssl so just plain http and all the bad behaviour went away. this is interesting because given that this is a virtualized environment and we adjusted storage/memory/cpu to well beyond what we need the only thing left that could account for the slowness is the vm running out of entropy for the crypto ops | 15:19 |
* TheJulia blinks | 15:20 | |
gregwork | i think that because all the ssl/crypto ops were grinding to a snails pace while /dev/random caught up caused all the code to shake apart | 15:20 |
TheJulia | OH! | 15:20 |
TheJulia | wow | 15:20 |
gregwork | because they are not expecting all the ssl ops to be randomly slow | 15:20 |
TheJulia | so... yeah | 15:20 |
dtantsur | wow indeed | 15:20 |
TheJulia | why are we not using urandom? | 15:20 |
gregwork | no rngd was running to help feed the vm | 15:20 |
gregwork | and we were defaulting to whatever libvirt has for entropy | 15:21 |
gregwork | i think its 2kb/s | 15:21 |
gregwork | its super conservative | 15:21 |
gregwork | this is the theory | 15:21 |
gregwork | but we have been swapping out everything | 15:21 |
gregwork | and this is kind of whats left | 15:21 |
gregwork | dedicated san cabinet for the director | 15:21 |
gregwork | 64gb for director | 15:21 |
gregwork | 16 vcpu | 15:21 |
gregwork | no noisy vms | 15:21 |
gregwork | only thing left is stuff like crypto ops | 15:22 |
gregwork | and ssl+kerberos is pretty crypto heavy | 15:22 |
gregwork | we dont get ANY of the errors we were seeing before | 15:22 |
gregwork | no ironic/neutron fights on ports | 15:22 |
gregwork | no nova scheduling issues | 15:22 |
gregwork | well we still see some failures with the power operations | 15:23 |
gregwork | so we kept your 30s nova_api retry | 15:23 |
gregwork | that + the CUSTOM_BAREMETAL tagging on osdcompute | 15:23 |
gregwork | seems to cause that random last man building to go away | 15:23 |
gregwork | but all that crazy other errors are gone | 15:23 |
dtantsur | rpittau: we do use set() for traits https://github.com/openstack/ironic/blob/master/ironic/api/controllers/v1/node.py#L820-L823 | 15:23 |
gregwork | im asking gss for guidance on tuning entropy settings in RHV/libvirt for crypto heavy guests | 15:24 |
gregwork | and director is an extremely heavy guest since its basically an all-in-one openstack deploy | 15:24 |
gregwork | turning on tls+kerberos should probably require special handling | 15:25 |
gregwork | at least recommend rngd be installed | 15:25 |
gregwork | or havengd | 15:25 |
gregwork | on the upside, i exposed latency sensitivity in the ironic/neutron/nova dance ? | 15:26 |
gregwork | heh | 15:26 |
gregwork | something to think about i guess from a dev pov | 15:26 |
rpittau | dtantsur: oh geez, ok :/ | 15:26 |
TheJulia | gregwork: oh wow..... so it is not 30 seconds, but 30 times btw, :) | 15:28 |
TheJulia | gregwork: Well, thanks for the update, sorry you've been righting that pain. Perhaps enjoy a beer for international beer day? | 15:28 |
gregwork | haha | 15:29 |
gregwork | talking with some redhat pros that do installs they said they always deploy the director on a vm because of the snapshotting they do | 15:29 |
gregwork | so this is a real factor to consider | 15:29 |
gregwork | given the time involved in setting up director and the value of snapping back to known clean states | 15:30 |
gregwork | i think its a good idea to consider it being a vm | 15:30 |
gregwork | and subject to this | 15:30 |
*** dsneddon has joined #openstack-ironic | 15:34 | |
*** dsneddon has quit IRC | 15:39 | |
rpioso | Good morning, ironicers. | 15:45 |
openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: Update software RAID configuration documentation https://review.opendev.org/674019 | 15:50 |
dtantsur | morning rpioso | 15:51 |
rpioso | dtantsur: Hey! | 15:51 |
*** ociuhandu has quit IRC | 15:56 | |
*** ociuhandu has joined #openstack-ironic | 16:00 | |
openstackgerrit | Varsha Verma proposed openstack/sushy-tools master: Add Storage and Storage Controllers resource support https://review.opendev.org/674339 | 16:05 |
*** sabedevops has joined #openstack-ironic | 16:05 | |
*** gyee has joined #openstack-ironic | 16:06 | |
*** lucasagomes has quit IRC | 16:06 | |
openstackgerrit | Varsha Verma proposed openstack/sushy-tools master: Add Storage and Storage Controllers resource support https://review.opendev.org/674339 | 16:10 |
*** verma-varsha has quit IRC | 16:12 | |
*** ash2307 has joined #openstack-ironic | 16:14 | |
*** pcaruana has quit IRC | 16:14 | |
*** ociuhandu has quit IRC | 16:21 | |
*** ociuhandu has joined #openstack-ironic | 16:22 | |
*** ociuhandu has quit IRC | 16:26 | |
*** ociuhandu has joined #openstack-ironic | 16:27 | |
*** altlogbot_0 has quit IRC | 16:29 | |
*** verma-varsha has joined #openstack-ironic | 16:30 | |
*** irclogbot_0 has quit IRC | 16:33 | |
*** altlogbot_2 has joined #openstack-ironic | 16:36 | |
*** dtantsur is now known as dtantsur|afk | 16:39 | |
dtantsur|afk | have a great weekend, all! I'm out on Monday, so see you on Tuesday | 16:39 |
rpittau | thanks! you too! | 16:39 |
*** irclogbot_0 has joined #openstack-ironic | 16:41 | |
*** verma-varsha1 has joined #openstack-ironic | 16:45 | |
*** verma-varsha has quit IRC | 16:46 | |
*** verma-varsha1 is now known as verma-varsha | 16:46 | |
*** rpittau is now known as rpittau|afk | 16:46 | |
rpittau|afk | bye all, have a great weekend! | 16:46 |
*** verma-varsha1 has joined #openstack-ironic | 16:55 | |
*** verma-varsha has quit IRC | 16:57 | |
*** verma-varsha1 is now known as verma-varsha | 16:57 | |
*** ociuhandu has quit IRC | 16:57 | |
*** ociuhandu has joined #openstack-ironic | 16:57 | |
*** tesseract has quit IRC | 16:58 | |
*** Goneri has joined #openstack-ironic | 16:59 | |
*** derekh has quit IRC | 17:01 | |
*** ociuhandu has quit IRC | 17:02 | |
*** igordc has joined #openstack-ironic | 17:03 | |
*** mkowalski has quit IRC | 17:04 | |
*** verma-varsha has quit IRC | 17:06 | |
*** ricolin has quit IRC | 17:07 | |
*** bobmel has joined #openstack-ironic | 17:08 | |
*** bobmel has quit IRC | 17:09 | |
* etingof thinks that oem action support in sushy is broken even more severely than regular action support | 17:10 | |
* rpioso wonders why etingof thinks that? | 17:11 | |
*** dougsz has joined #openstack-ironic | 17:12 | |
etingof | rpioso, most importantly, vendor ID is not picked from action namespace mixing up actions from multiple vendors | 17:12 |
* rpioso scratches his head | 17:13 | |
etingof | that's on top of that oem action fields are not parsed in the same way as non-oem action fields | 17:13 |
etingof | which is on top of the fact that sushy does not offer any reasonable abstraction for any action | 17:13 |
* rpioso pulls up the code | 17:13 | |
*** verma-varsha has joined #openstack-ironic | 17:13 | |
etingof | rpioso, do not do that! enjoy your weekend! | 17:14 |
rpioso | etingof: LOL | 17:14 |
etingof | rpioso, expanding on the first point: as far as I can understand Redfish, in Actions JSON you have it like {"Actions": {"Oem": {"Dell.v2_0#SomeInsanity": ...}}} | 17:16 |
*** verma-varsha has quit IRC | 17:16 | |
etingof | (I missed # before Dell) | 17:17 |
etingof | so #Dell.v2_0 should tell us that this object belongs to Dell OEM | 17:17 |
etingof | which sushy happily ignores | 17:17 |
* rpioso prefers {"Actions": {"Oem": {"#Dell.v2_0#Awesomeness": ...}}} or similar ;-) | 17:17 | |
*** bobmel has joined #openstack-ironic | 17:18 | |
etingof | that's what I mean indeed | 17:18 |
rpioso | I see https://opendev.org/openstack/sushy/src/commit/66a2af1fc2f45c94ab8a3fbd091b35eeec99918c/sushy/resources/oem/fake.py#L30 | 17:21 |
rpioso | Does stevedore and the sushy's OEM foundation care about the standard particulars or any specific implementation of it? | 17:21 |
*** openstackgerrit has quit IRC | 17:22 | |
rpioso | etingof: Couldn't that code be: reset_action = base.Field(['Actions', 'Oem', 'Atypical.LetsGo'] ? | 17:23 |
*** bobmel has quit IRC | 17:23 | |
*** bobmel has joined #openstack-ironic | 17:24 | |
*** gyee has quit IRC | 17:24 | |
* rpioso has read the code, but not played with it. | 17:24 | |
etingof | well, here is how it'd done for the root resource -- https://opendev.org/openstack/sushy/src/branch/master/sushy/resources/system/system.py#L136 | 17:26 |
*** ociuhandu has joined #openstack-ironic | 17:26 | |
*** openstackgerrit has joined #openstack-ironic | 17:28 | |
openstackgerrit | Varsha Verma proposed openstack/sushy-tools master: Add Storage and Storage Controllers resource support https://review.opendev.org/674339 | 17:28 |
rpioso | etingof: How is System._actions used? | 17:30 |
*** priteau has quit IRC | 17:31 | |
etingof | I think it's never used because 'reset' attribute is magically put in its place | 17:32 |
*** dougsz has quit IRC | 17:32 | |
etingof | so it feels messy to me | 17:33 |
*** sabedevops has quit IRC | 17:33 | |
rpioso | etingof: It's used in the action-related methods defined by System. | 17:34 |
rpioso | etingof: It's not directly accessible to clients. | 17:34 |
*** dsneddon has joined #openstack-ironic | 17:34 | |
etingof | yes, that's what I mean | 17:34 |
etingof | also, I'm suspicious re OEM action properties naming... Name like 'OemManager.v1_0#OemManager....' does not carry any hint that this property belongs to Dell... | 17:35 |
etingof | my reading of Redfish spec gives me the feeling that it should better look like 'Dell_OemManager.v1_0#OemManager...' | 17:36 |
rpioso | etingof: Actions are by their very nature are messy -- "Actions are Redfish operations that do not easily map to RESTful interface semantics." | 17:36 |
*** gyee has joined #openstack-ironic | 17:36 | |
etingof | so in sushy we are well-aligned with the standard | 17:36 |
* etingof is referring to chapter 7.5.7.3 here -- https://www.dmtf.org/sites/default/files/standards/documents/DSP0266_1.5.0.pdf | 17:37 | |
rpioso | etingof: That may look better, but I don't believe it functionally matters. The OEM content is defined by the vendor. The vendor needs to deal with name collisions, if any, within 'Oem'. | 17:38 |
*** dsneddon has quit IRC | 17:39 | |
etingof | since Actions->Oem does not have any vendor isolation layer, the naming seems utterly important here | 17:39 |
etingof | perhaps that's why they note naming conventions in 7.5.7.3 | 17:40 |
etingof | interestingly, it's different in Resource->Oem because there they have vendor ID i.e. Resource->Oem->Dell | 17:41 |
rpioso | etingof: It's a resource published by a Redfish service, which is often implemented by a vendor. The vendor needs to ensure there are no name collisions. | 17:42 |
*** jcoufal_ has quit IRC | 17:43 | |
rpioso | etingof: If there's a name collision, then that would be problematic. | 17:43 |
etingof | well, how is Actions branch different from Resource branch? why they separate OEM resources per vendor, but do not do that explicitly for Actions...? | 17:44 |
rpioso | etingof: Doesn't 7.5.7.3 cover Oem property naming, instead of Oem action naming? | 17:45 |
* rpioso prefers the latest version of the spec -- https://www.dmtf.org/sites/default/files/standards/documents/DSP0266_1.7.0.pdf | 17:46 | |
*** Lucas_Gray has quit IRC | 17:47 | |
rpioso | etingof: 7.5.8.1 covers Oem action naming. | 17:48 |
rpioso | etingof: There appears to be a difference between the standard and implementation. Aside from tidiness, do you think it matters? | 17:49 |
*** ociuhandu has quit IRC | 17:49 | |
*** ociuhandu has joined #openstack-ironic | 17:50 | |
*** ociuhandu has quit IRC | 17:50 | |
* etingof can't locate 7.5.8.1 in the latest rpioso's link | 17:50 | |
rpioso | etingof: It's in your link :-) | 17:51 |
etingof | ah, it's now 8.7.5 | 17:52 |
rpioso | etingof: 9.7.5 | 17:53 |
etingof | yes, that's what I wanted to paste | 17:54 |
rpioso | etingof: :-) | 17:54 |
etingof | so they say the key should be 'QualifiedActionName' | 17:54 |
rpioso | etingof: And that's not formally defined :-( | 17:54 |
etingof | afaik, that's empty for standard things | 17:55 |
*** mkowalski has joined #openstack-ironic | 17:55 | |
rpioso | etingof: The description of 'QualifiedActionName' does state it should contain the namespace. | 17:55 |
etingof | yes | 17:56 |
etingof | that makes me think that it should better look like #Dell_OemManager | 17:56 |
rpioso | etingof: Is that a nit or important? | 17:56 |
* rpioso wants to be sure he understands | 17:57 | |
* rpioso keeps reminding himself that the spec and its implementations are evolving. | 17:58 | |
etingof | that's hard to say now... I can offer you this scenario - two vendors come up with colliding non-namespaced keys. That worked fine till a new product is built incorporating hardware resources from both vendors... | 18:00 |
*** jcoufal has joined #openstack-ironic | 18:00 | |
*** verma-varsha has joined #openstack-ironic | 18:04 | |
rpioso | etingof: So if the System from vendor Foo contains components from itself and suppliers Bar and Baz, then those three vendors must not have name collisions in Oem. Vendor Foo must ensure that now and in the future, even as it changes its component suppliers. | 18:04 |
rpioso | etingof: However, System vendor Foo doesn't need to concern itself with System vendor LatestFoo. | 18:05 |
*** verma-varsha has quit IRC | 18:06 | |
etingof | rpioso, what if component suppliers have their redfish schemas already well-known and supported in client software? Meaning that renaming conflicting actions even being a part of a larger product may not be desirable? | 18:06 |
rpioso | etingof: I get that. | 18:07 |
etingof | I have another argument | 18:07 |
rpioso | etingof: There will be issues and bugs. | 18:08 |
rpioso | etingof: I agree it would be better now and in the future. | 18:08 |
etingof | it seems to me that existing way of getting hold of specific Action in sushy (https://opendev.org/openstack/sushy/src/commit/66a2af1fc2f45c94ab8a3fbd091b35eeec99918c/sushy/resources/oem/fake.py#L30) by fully specified key is somewhat rigid | 18:09 |
etingof | because it might include schema version | 18:10 |
guilhermesp | so dtantsur|afk seems that is only working for me here with coreos images https://docs.openstack.org/ironic/stein/install/deploy-ramdisk.html | 18:10 |
etingof | so if we have it hardcoded into client sw, it will stop working when server implementation change anything there | 18:10 |
*** e0ne has quit IRC | 18:11 | |
rpioso | etingof: Isn't it both flexible and rigid? | 18:11 |
etingof | it would probably be better to cut by # and use the tail piece as action name | 18:11 |
etingof | (that's what is happening with standard resources - schema version is not in the key) | 18:12 |
rpioso | etingof: It accommodates today's interesting implementations. | 18:12 |
rpioso | etingof: Do you have concerns about https://review.opendev.org/#/c/463829/ | 18:13 |
patchbot | patch 463829 - sushy - Add foundation for supporting Redfish OEMs (MERGED) - 20 patch sets | 18:13 |
etingof | but then we would have to take apart the leading token which includes unique namespace and schema version, drop schema version, match the desired action against vendor ID | 18:13 |
etingof | that's all to argue that 'Dell_v1.0#Oem.Awesomeness' would probably work better | 18:14 |
*** jtomasek has quit IRC | 18:15 | |
etingof | it can be even 'Dell_Oem_Awesome_ness_v1.0#Oem.Awesomeness', the only important thing is to have a way to get unique vendor ID | 18:15 |
etingof | yes, that's the patch | 18:16 |
guilhermesp | dtantsur|afk: but I suspect the node that was stuck is with problems with the nvme device... because I'm using the same coreos images on it and it is still in clean wait ... anyways, thanks fro your help | 18:19 |
*** yaawang has joined #openstack-ironic | 18:57 | |
*** portdirect has quit IRC | 19:13 | |
*** portdirect has joined #openstack-ironic | 19:13 | |
*** e0ne has joined #openstack-ironic | 19:13 | |
*** sabedevops has joined #openstack-ironic | 19:19 | |
*** yaawang has quit IRC | 19:25 | |
*** mgoddard has quit IRC | 19:37 | |
*** mgoddard has joined #openstack-ironic | 19:38 | |
*** irclogbot_0 has quit IRC | 19:39 | |
*** irclogbot_2 has joined #openstack-ironic | 19:43 | |
*** sabedevops has quit IRC | 19:46 | |
*** mkowalski has quit IRC | 19:49 | |
*** whoami-rajat has quit IRC | 20:04 | |
*** e0ne has quit IRC | 20:11 | |
*** rh-jelabarre has quit IRC | 20:11 | |
*** Lucas_Gray has joined #openstack-ironic | 20:12 | |
*** jjohnson42 has quit IRC | 20:20 | |
*** Lucas_Gray has quit IRC | 21:03 | |
openstackgerrit | Julia Kreger proposed openstack/sushy master: Implements adapter checking https://review.opendev.org/669963 | 21:09 |
*** Lucas_Gray has joined #openstack-ironic | 21:09 | |
rpioso | TheJulia: Where can I find the Ironic Train release schedule? | 21:11 |
TheJulia | rpioso: we don't publish a specific schedule, but we have to create stable/train for RC1 | 21:11 |
TheJulia | as part o the openstack community RC1 release | 21:12 |
rpioso | TheJulia: When's our Train feature freeze? | 21:12 |
TheJulia | rpioso: We generally soft freeze around ~2 weeks prior to having to cut that branch, but exceptions can and have been made in the past. The key is knowing sooner rather than later and communicating that need/want. | 21:14 |
TheJulia | rpioso: That soft freeze is more so we don't break the gate, so if it is not directly upstream CI tested, then it is easier to accept | 21:15 |
openstackgerrit | Merged openstack/ironic master: Update software RAID configuration documentation https://review.opendev.org/674019 | 21:18 |
*** EmilienM is now known as EmilienM|afk | 21:28 | |
*** EmilienM|afk is now known as EmilienM | 21:28 | |
rpioso | TheJulia: Do you mean "so if it isn't directly exercised by the upstream CI testing, then it is easier to accept, because it doesn't introduce risk to the stability of the CI"? | 21:30 |
TheJulia | rpioso: correct | 21:30 |
* rpioso is just trying to understand on a late Friday | 21:30 | |
rpioso | TheJulia: Thank you so much! | 21:30 |
*** jcoufal_ has joined #openstack-ironic | 21:31 | |
TheJulia | rpioso: Any stability impact to CI during those last few weeks makes for grumpy cores trying to get things into a state where we can release | 21:31 |
TheJulia | mainly because those weeks tend to be very very long weeks. | 21:31 |
*** jcoufal has quit IRC | 21:31 | |
*** dsneddon has joined #openstack-ironic | 21:34 | |
*** dsneddon has quit IRC | 21:39 | |
* rpioso is all for keeping cores very, very happy and rested | 21:40 | |
TheJulia | doesn't really work for end of cycle, but the thought counts! :) | 21:50 |
*** betherly has joined #openstack-ironic | 21:55 | |
openstackgerrit | Merged openstack/sushy master: Action #Bios.ResetBios fails as POST request has no body https://review.opendev.org/671413 | 21:56 |
*** jcoufal_ has quit IRC | 22:01 | |
*** betherly has quit IRC | 22:01 | |
*** Lucas_Gray has quit IRC | 22:02 | |
*** jistr has quit IRC | 22:02 | |
openstackgerrit | Julia Kreger proposed openstack/ironic master: Add Redfish Virtual Media Boot support https://review.opendev.org/638453 | 22:05 |
*** Lucas_Gray has joined #openstack-ironic | 22:08 | |
*** jistr has joined #openstack-ironic | 22:09 | |
*** jistr has quit IRC | 22:17 | |
*** jistr has joined #openstack-ironic | 22:19 | |
rpioso | TheJulia: :-) | 22:19 |
openstackgerrit | Merged openstack/ironic master: Follow-up to the IntelIPMIHardware patch https://review.opendev.org/672652 | 23:08 |
*** betherly has joined #openstack-ironic | 23:26 | |
*** betherly has quit IRC | 23:31 | |
*** sthussey has quit IRC | 23:43 | |
*** betherly has joined #openstack-ironic | 23:47 | |
*** betherly has quit IRC | 23:51 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!