| openstackgerrit | Julia Kreger proposed openstack/ironic master: Pre-shared agent token https://review.opendev.org/692609 | 00:21 |
|---|---|---|
| openstackgerrit | Julia Kreger proposed openstack/ironic master: Add indicators REST API endpoints https://review.opendev.org/651785 | 00:22 |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: Enable agent_token for virtual media boot https://review.opendev.org/697584 | 00:22 |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: Send our token back to the agent https://review.opendev.org/697585 | 00:22 |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: Signal agent token is required https://review.opendev.org/699304 | 00:23 |
| *** bobmel has joined #openstack-ironic | 00:25 | |
| *** bobmel has quit IRC | 00:29 | |
| *** bobmel has joined #openstack-ironic | 00:37 | |
| *** bobmel has quit IRC | 00:42 | |
| *** yedongcan has joined #openstack-ironic | 01:05 | |
| *** rloo has quit IRC | 01:14 | |
| *** jerrywang1 has joined #openstack-ironic | 01:19 | |
| *** jerrywang1 has quit IRC | 01:43 | |
| *** jerrywang1 has joined #openstack-ironic | 01:44 | |
| *** jdandrea has joined #openstack-ironic | 02:15 | |
| *** k_mouza has joined #openstack-ironic | 02:31 | |
| *** jdandrea has quit IRC | 02:31 | |
| *** jdandrea has joined #openstack-ironic | 02:32 | |
| *** k_mouza has quit IRC | 02:35 | |
| *** bobmel has joined #openstack-ironic | 02:38 | |
| *** bobmel has quit IRC | 02:44 | |
| *** dsneddon_ has quit IRC | 02:52 | |
| *** gyee has quit IRC | 03:11 | |
| *** dsneddon_ has joined #openstack-ironic | 03:20 | |
| *** dsneddon_ has quit IRC | 03:36 | |
| *** yedongcan has quit IRC | 03:50 | |
| *** dsneddon_ has joined #openstack-ironic | 04:07 | |
| *** jerrywang1 has quit IRC | 04:10 | |
| *** jerrywang1 has joined #openstack-ironic | 04:11 | |
| *** dsneddon_ has quit IRC | 04:12 | |
| *** dking_desktop has quit IRC | 04:23 | |
| *** jerrywang1 has quit IRC | 04:31 | |
| *** mkrai has joined #openstack-ironic | 04:37 | |
| *** bobmel has joined #openstack-ironic | 04:39 | |
| *** bobmel has quit IRC | 04:44 | |
| *** dsneddon_ has joined #openstack-ironic | 04:48 | |
| *** goldyfruit has quit IRC | 04:49 | |
| *** dsneddon_ has quit IRC | 04:53 | |
| *** vesper has quit IRC | 05:18 | |
| *** dsneddon_ has joined #openstack-ironic | 05:20 | |
| *** vesper11 has joined #openstack-ironic | 05:23 | |
| *** dsneddon_ has quit IRC | 05:25 | |
| *** jerrywang1 has joined #openstack-ironic | 05:40 | |
| *** igordc has joined #openstack-ironic | 05:51 | |
| *** mkrai has quit IRC | 05:52 | |
| *** mkrai has joined #openstack-ironic | 05:54 | |
| *** dsneddon_ has joined #openstack-ironic | 05:58 | |
| *** igordc has quit IRC | 06:00 | |
| *** dsneddon_ has quit IRC | 06:03 | |
| *** jdandrea has quit IRC | 06:04 | |
| *** mkrai has quit IRC | 06:09 | |
| *** dsneddon_ has joined #openstack-ironic | 06:31 | |
| *** tzumainn has quit IRC | 06:35 | |
| *** dsneddon_ has quit IRC | 06:36 | |
| *** bobmel has joined #openstack-ironic | 06:40 | |
| *** bobmel has quit IRC | 06:45 | |
| iurygregory | good morning o/ | 06:53 |
| *** jtomasek has joined #openstack-ironic | 07:01 | |
| *** mkrai has joined #openstack-ironic | 07:05 | |
| *** dsneddon_ has joined #openstack-ironic | 07:09 | |
| *** dsneddon_ has quit IRC | 07:14 | |
| etingof | iurygregory, is not blown away - good morning! o/ | 07:23 |
| iurygregory | etingof, o/ I'm wfh XD | 07:27 |
| *** yedongcan has joined #openstack-ironic | 07:37 | |
| *** dsneddon_ has joined #openstack-ironic | 07:40 | |
| *** dsneddon_ has quit IRC | 07:46 | |
| *** Lucas_Gray has joined #openstack-ironic | 07:52 | |
| *** mkrai has quit IRC | 08:02 | |
| *** dsneddon_ has joined #openstack-ironic | 08:11 | |
| *** dsneddon_ has quit IRC | 08:17 | |
| *** priteau has joined #openstack-ironic | 08:28 | |
| *** tesseract has joined #openstack-ironic | 08:29 | |
| *** mkrai has joined #openstack-ironic | 08:37 | |
| *** Lucas_Gray has quit IRC | 08:39 | |
| *** bobmel has joined #openstack-ironic | 08:41 | |
| *** bobmel has quit IRC | 08:46 | |
| *** dsneddon_ has joined #openstack-ironic | 08:46 | |
| *** Lucas_Gray has joined #openstack-ironic | 08:47 | |
| *** dking_desktop has joined #openstack-ironic | 08:47 | |
| yolanda | mm etingof , seems that i still have the old ironic code. I have the urljoin bits on boot.py | 08:50 |
| yolanda | but i'm using latest ironic image, it's weird | 08:50 |
| etingof | yolanda, that's what Ii thought last night! | 08:50 |
| *** dsneddon_ has quit IRC | 08:51 | |
| yolanda | let me see where ironic-image pulls the code from | 08:52 |
| etingof | do not forget fresh sushy | 08:52 |
| yolanda | i have fresh sushy :) | 08:52 |
| yolanda | i had on the first tries as well, but as i removed all caches, all changes... i removed that local fixes i had | 08:52 |
| yolanda | ok... the ironic-image is just taking the code from rpms | 08:53 |
| yolanda | may be that the rpms are outdated | 08:53 |
| etingof | well, the crucial sushy patch is in master now | 08:53 |
| etingof | yolanda, oh, not all of them yet! | 08:54 |
| yolanda | etingof, all ironic code is just installed with dnf... so that's why the latest redfish code is not there. I will modify and install from github | 08:55 |
| etingof | yolanda, this one you still need to pull down - https://review.opendev.org/#/c/703825/ | 08:55 |
| patchbot | patch 703825 - sushy - Relax required Redfish fields handling - 6 patch sets | 08:55 |
| *** rpittau|afk is now known as rpittau | 08:55 | |
| rpittau | good morning ironic! o/ | 08:55 |
| etingof | o/ rpittau | 08:55 |
| rpittau | hey etingof :) | 08:56 |
| openstackgerrit | Verification of a change to openstack/ironic failed: Implement managed in-band inspection boot for ilo-virtual-media https://review.opendev.org/701516 | 08:56 |
| rpittau | yolanda: the ironic images are built with rpms based on latest osp16 | 08:57 |
| yolanda | rpittau, and the code that i need from redfish is not there... | 08:57 |
| yolanda | https://review.opendev.org/#/c/698734/ | 08:58 |
| patchbot | patch 698734 - ironic - Fix use of urlparse.urljoin (MERGED) - 2 patch sets | 08:58 |
| yolanda | how often are the images refreshed? can i add some repo to pick newer? i also looked at pip and latest tag seems to be from december | 08:59 |
| rpittau | yolanda: metal3-io or openshift ? | 08:59 |
| yolanda | metal3-io, ironic upstream images | 08:59 |
| rpittau | yolanda: ok, so those images are now using master tripleo, so the packages should be up-to-date, you can check on quay when the last one was built | 09:00 |
| yolanda | i am even building the images myself | 09:00 |
| yolanda | but the ironic code seems outdated | 09:00 |
| *** Lucas_Gray has quit IRC | 09:00 | |
| rpittau | yolanda: did you checkout the latest changes in the ironic-image repo ? | 09:01 |
| *** Lucas_Gray has joined #openstack-ironic | 09:01 | |
| yolanda | rpittau, yes. But the problem is ironic rpms. ironic-image installs the code with dnf... so those are the bits that seem to be outdated | 09:01 |
| *** dking_desktop has quit IRC | 09:02 | |
| rpittau | yolanda: trust me, I know very well how those images work :) let me check the version of the package in the repo | 09:02 |
| iurygregory | morning rpittau o/ | 09:03 |
| yolanda | ok... the patch i am looking for has a date of 8 weeks ago... and checked in ironic-conductor, and is not there :( | 09:03 |
| rpittau | hey iurygregory :) | 09:03 |
| *** amoralej|off is now known as amoralej | 09:03 | |
| rpittau | yolanda: unfortunately the latest package seems to be still pointing to the update in december | 09:06 |
| yolanda | Installing: | 09:07 |
| yolanda | openstack-ironic-api noarch1:13.1.0-0.20191218174223.6efcfd8.el8 delorean-component-baremetal 8.7 k | 09:07 |
| yolanda | openstack-ironic-conductor noarch1:13.1.0-0.20191218174223.6efcfd8.el8 delorean-component-baremetal 7.9 k | 09:07 |
| yolanda | i see that on logs | 09:07 |
| rpittau | yolanda: you can try building the image with the train branch, I see it has more recent packages | 09:07 |
| rpittau | the patch was backported to train, so the code should be there | 09:08 |
| rpittau | the conductor package has been built again yet | 09:09 |
| rpittau | in master | 09:09 |
| yolanda | ok | 09:09 |
| *** mkrai has quit IRC | 09:09 | |
| *** mkrai_ has joined #openstack-ironic | 09:10 | |
| yolanda | so how is train newer than master? any issue in the builds? | 09:10 |
| *** dtantsur|afk is now known as dtantsur | 09:12 | |
| dtantsur | yolanda: versions are auto-generated, so it can happen sometimes | 09:12 |
| rpittau | I see in train the most recent packages were built yesterday, so we might have new versions for master soon | 09:13 |
| *** dougsz has joined #openstack-ironic | 09:14 | |
| dtantsur | a useful link to bookmark: https://dashboards.rdoproject.org/rdo-dev | 09:16 |
| *** lucasagomes has joined #openstack-ironic | 09:16 | |
| rpittau | dtantsur: not sure that is also for centos8 though | 09:17 |
| dtantsur | yeah, not sure | 09:17 |
| rpittau | nah, it's just centos7 :( | 09:18 |
| dtantsur | sigh | 09:19 |
| dtantsur | this transition is a nightmare for everyone | 09:19 |
| *** dsneddon_ has joined #openstack-ironic | 09:20 | |
| yolanda | ok rebuilding with train | 09:20 |
| dtantsur | mgoddard: hey, around? I have a person here with DHCP timeouts with ironic on kolla-ansible. | 09:20 |
| mgoddard | hi dtantsur, yes I'm around | 09:21 |
| dtantsur | I'm not sure how exactly kolla works, is ironic_dnsmasq container only for inspector? | 09:21 |
| mgoddard | yes | 09:21 |
| *** k_mouza has joined #openstack-ironic | 09:21 | |
| mgoddard | what are they trying to do? provision/clean/inspect? | 09:21 |
| dtantsur | mgoddard: deploy | 09:21 |
| dtantsur | probably using the guide I linked yesterday | 09:22 |
| dtantsur | (same person) | 09:22 |
| mgoddard | what is their networking setup? | 09:22 |
| mgoddard | flat or vlans? | 09:22 |
| dtantsur | mgoddard: lemme see if he can join us here | 09:23 |
| mgoddard | that might be easier :) | 09:23 |
| mgoddard | dtantsur: is it dking_desktop? | 09:24 |
| dtantsur | no idea what you're asking :) | 09:25 |
| *** dsneddon_ has quit IRC | 09:25 | |
| mgoddard | that's the nick of someone asking about ironic in #openstack-kolla last night | 09:26 |
| dtantsur | ah, nick. maybe, although the timezone doesn't quite match. | 09:26 |
| *** ociuhandu has joined #openstack-ironic | 09:28 | |
| *** ociuhandu has quit IRC | 09:29 | |
| *** Michael_Silich has joined #openstack-ironic | 09:30 | |
| *** dsneddon_ has joined #openstack-ironic | 09:30 | |
| *** Lucas_Gray has quit IRC | 09:33 | |
| yolanda | ok i have that patch now on my container | 09:37 |
| yolanda | server is booting ironic now | 09:38 |
| yolanda | i get a deploy failed now, going to check logs | 09:40 |
| yolanda | mm... 'type': 'DeviceNotFound', 'details': "No suitable device was found for deployment using these hints {u'hctl': u'ATA'}"} | 09:41 |
| dtantsur | "ATA" is certainly not a valid hctl | 09:42 |
| yolanda | yep... i removed some code i hardcoded to have better device hints... as right now we just support hctl and name. Something wasn't totally removed from my patch | 09:43 |
| *** derekh has joined #openstack-ironic | 09:44 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-tempest-plugin master: Enable g-reg service in stable jobs https://review.opendev.org/707087 | 09:51 |
| dtantsur | this might work around the bug in the tempest plugin jobs ^^ | 09:51 |
| *** Lucas_Gray has joined #openstack-ironic | 09:51 | |
| Michael_Silich | Hello, I am trying to setup ironic with kolla-ansible (deployed on baremetal). I have also 1 BareMetal Server that I am tried to deploy with Ironic.I have setup flavor and the node in ironic, and trying to start it. The Node start and trying to obtain ip over pxe but this does not work.here is my log from | 09:52 |
| Michael_Silich | /var/log/kolla/neutronneutron-dhcp-agent.logI think the message is the real fault. binding_vif_type binding_failedI would be very happy about any help.2020-02-11 09:32:36.017 6 INFO neutron.agent.dhcp.agent [-] Trigger reload_allocations for port admin_state_up=True, allowed_address_pairs=[], binding:host_id=ce21cb55-b6ce-473c-b39b-e2a074de68b3, | 09:52 |
| Michael_Silich | binding:profile=, binding:vif_details=, binding:vif_type=binding_failed, binding:vnic_type=baremetal, created_at=2020-02-11T09:32:11Z, description=, device_id=a653b84c-422a-44c0-9a37-18a6e1973d7b, device_owner=compute:nova, extra_dhcp_opts=[{u'opt_value': u'172.16.5.16', u'ip_version': 4, u'opt_name': u'server-ip-address'}, {u'opt_value': | 09:52 |
| Michael_Silich | u'pxelinux.0', u'ip_version': 4, u'opt_name': u'67'}, {u'opt_value': u'172.16.5.16', u'ip_version': 4, u'opt_name': u'66'}, {u'opt_value': u'/tftpboot/', u'ip_version': 4, u'opt_name': u'210'}, {u'opt_value': u'172.16.5.16', u'ip_version': 4, u'opt_name': u'150'}], fixed_ips=[{u'subnet_id': u'764820f6-3b3e-44e8-80a7-1a4262df5e4d', u'ip_address': | 09:52 |
| Michael_Silich | u'192.168.17.183'}], id=766dbf20-f7e1-4662-a74d-86748079a2ea, mac_address=00:02:c9:56:a5:82, name=, network_id=27efe944-4526-4d07-a744-dc1832296fe2, port_security_enabled=True, project_id=c0e23261db4e4f319eab47ba257630f7, qos_policy_id=None, resource_request=None, revision_number=8, security_groups=[u'97f2fa92-f673-4f8d-b032-cd3057a854d0'], | 09:52 |
| Michael_Silich | status=DOWN, tags=[], tenant_id=c0e23261db4e4f319eab47ba257630f7, updated_at=2020-02-11T09:32:35Z2020-02-11 09:32:36.691 6 INFO neutron.agent.dhcp.agent [req-2bc55c49-a298-44a5-bc77-7182627153c8 - - - - -] DHCP configuration for ports set([u'766dbf20-f7e1-4662-a74d-86748079a2ea']) is completed | 09:52 |
| *** alexmcleod has joined #openstack-ironic | 09:53 | |
| dtantsur | cc mgoddard ^^ | 09:54 |
| openstackgerrit | Iury Gregory Melo Ferreira proposed openstack/ironic-prometheus-exporter master: Fix timeseries in redfish parser https://review.opendev.org/706296 | 09:54 |
| dtantsur | Michael_Silich: failure to bind a port is not necessary fatal. It has been the case until we got networking-baremetal (which I guess kolla doesn't have still?) | 09:55 |
| mgoddard | hi Michael_Silich. What type of neutron network are you using? flat or vlan? | 09:55 |
| Michael_Silich | flat | 09:55 |
| mgoddard | Have you set the 'physical_network' attribute on your ironic ports? | 09:56 |
| dtantsur | mgoddard: do you folks have networking-baremetal in kolla train? | 09:56 |
| mgoddard | dtantsur: yes, had it for a few releases | 09:56 |
| dtantsur | oook, that's weird | 09:56 |
| Michael_Silich | Hm, i dont think so. How can i check it? I followed a tutorial on this page https://docs.openstack.org/kolla-ansible/train/reference/bare-metal/ironic-guide.html | 09:56 |
| mgoddard | but the physnet need to match for it to bind | 09:56 |
| dtantsur | mgoddard: even without routed networks? | 09:57 |
| mgoddard | yes | 09:57 |
| dtantsur | gotcha | 09:57 |
| dtantsur | Michael_Silich: you don't have routed networks, do you? just a simple flat network? | 09:57 |
| mgoddard | openstack baremetal port set <port> --physical-network physnet1 | 09:57 |
| Michael_Silich | simple flat, i can also see an dhco request with tcpdump | 09:58 |
| mgoddard | (assuming you are using the default public1 network) | 09:58 |
| dtantsur | Michael_Silich: aha. request but no responses? | 09:58 |
| Michael_Silich | yes | 09:58 |
| mgoddard | Michael_Silich: try the above command | 09:59 |
| dtantsur | mac_address=00:02:c9:56:a5:82 <-- this is correct, right? | 09:59 |
| Michael_Silich | in ironic_dnsmasq i can also see this -> dnsmasq-dhcp: DHCPDISCOVER(ens2) 00:02:c9:56:a5:82 ignored | 09:59 |
| dtantsur | Michael_Silich: ignore ironic_dnsmasq, it's not involved in deployment, only inspection. you need neutron-dhcp-agent logs (mgoddard probably knows the right container) | 10:00 |
| mgoddard | neutron_dhcp_agent | 10:00 |
| dtantsur | predictable :) | 10:01 |
| Michael_Silich | openstack baremetal port set 9622c424-4773-49c0-b2a3-0f18b6a645f1 --physical-network physnet1 Error contacting Ironic server: Port 9622c424-4773-49c0-b2a3-0f18b6a645f1 can not have any connectivity attributes (pxe_enabled, local_link_connection, physical_network, portgroup_id) updated unless node ce21cb55-b6ce-473c-b39b-e2a074de68b3 is in a enroll, | 10:01 |
| Michael_Silich | inspecting, inspect wait, manageable state or in maintenance mode. (HTTP 409). Attempt 6 of 6Port 9622c424-4773-49c0-b2a3-0f18b6a645f1 can not have any connectivity attributes (pxe_enabled, local_link_connection, physical_network, portgroup_id) updated unless node ce21cb55-b6ce-473c-b39b-e2a074de68b3 is in a enroll, inspecting, inspect wait, | 10:01 |
| Michael_Silich | manageable state or in maintenance mode. (HTTP 409) | 10:01 |
| dtantsur | yeah, it cannot be done while the node is deployed or deploying, you need to tear it down first | 10:01 |
| dtantsur | (openstack server delete or whatever) | 10:01 |
| Michael_Silich | k, one moment please | 10:01 |
| Michael_Silich | hm, i can not set the port. still the same error, even after deleting the instance (the node itself is in the state available) | 10:05 |
| openstackgerrit | Ilya Etingof proposed openstack/sushy-cli master: Add system/manager/chassis inventory show command https://review.opendev.org/706005 | 10:05 |
| mgoddard | Michael_Silich: you can either set maintenance mode, or put it in the manageable state | 10:06 |
| *** ociuhandu has joined #openstack-ironic | 10:06 | |
| Michael_Silich | ah, now its worked (port set) trying to start the instance again | 10:08 |
| *** ociuhandu has quit IRC | 10:09 | |
| *** ociuhandu has joined #openstack-ironic | 10:09 | |
| *** mkrai__ has joined #openstack-ironic | 10:10 | |
| Michael_Silich | new error after creating new instance (Message No valid host was found.) | 10:10 |
| *** ociuhandu has quit IRC | 10:10 | |
| *** ociuhandu has joined #openstack-ironic | 10:11 | |
| dtantsur | if you used maintenance or manageable state, revert it back to available, no maintenance | 10:12 |
| *** mkrai_ has quit IRC | 10:13 | |
| Michael_Silich | same error, switch to (available) and startet new instance, but same issue, no dhcp answer | 10:17 |
| *** ociuhandu has quit IRC | 10:18 | |
| dtantsur | Michael_Silich: let's check for anything suspicious in neutron_dhcp_agent logs | 10:19 |
| *** ociuhandu has joined #openstack-ironic | 10:20 | |
| *** ociuhandu has quit IRC | 10:21 | |
| *** ociuhandu has joined #openstack-ironic | 10:26 | |
| Michael_Silich | looks "normal" to me | 10:27 |
| Michael_Silich | 2020-02-11 10:13:08.567 6 INFO neutron.agent.dhcp.agent [-] Trigger reload_allocations for port admin_state_up=True, allowed_address_pairs=[], binding:host_id=ce21cb55-b6ce-473c-b39b-e2a074de68b3, binding:profile=, binding:vif_details=connectivity=legacy, binding:vif_type=other, binding:vnic_type=baremetal, created_at=2020-02-11T10:12:47Z, | 10:27 |
| Michael_Silich | description=, device_id=b0e3c6f4-50d3-42b8-851f-675c06baa9c5, device_owner=compute:nova, extra_dhcp_opts=[], fixed_ips=[{u'subnet_id': u'764820f6-3b3e-44e8-80a7-1a4262df5e4d', u'ip_address': u'192.168.17.147'}], id=6bf77e23-f6bd-45f3-b93c-3ea8b1728342, mac_address=00:02:c9:56:a5:82, name=, network_id=27efe944-4526-4d07-a744-dc1832296fe2, | 10:27 |
| Michael_Silich | port_security_enabled=True, project_id=c0e23261db4e4f319eab47ba257630f7, qos_policy_id=None, resource_request=None, revision_number=7, security_groups=[u'97f2fa92-f673-4f8d-b032-cd3057a854d0'], status=DOWN, tags=[], tenant_id=c0e23261db4e4f319eab47ba257630f7, updated_at=2020-02-11T10:13:08Z2020-02-11 10:13:08.593 6 INFO neutron.agent.dhcp.agent | 10:27 |
| Michael_Silich | [req-6d42452a-d2db-46f8-9dc3-71855271511c - - - - -] DHCP configuration for ports set([u'6bf77e23-f6bd-45f3-b93c-3ea8b1728342']) is completed2020-02-11 10:13:09.303 6 INFO neutron.agent.dhcp.agent [req-ff6b3f33-8e09-49d3-ac4d-697c844f4c3c - - - - -] DHCP configuration for ports set([u'6bf77e23-f6bd-45f3-b93c-3ea8b1728342']) is completed2020-02-11 | 10:27 |
| Michael_Silich | 10:13:10.583 6 INFO neutron.agent.dhcp.agent [-] Trigger reload_allocations for port admin_state_up=True, allowed_address_pairs=[], binding:host_id=ce21cb55-b6ce-473c-b39b-e2a074de68b3, binding:profile=, binding:vif_details=connectivity=legacy, binding:vif_type=other, binding:vnic_type=baremetal, created_at=2020-02-11T10:12:47Z, description=, | 10:27 |
| Michael_Silich | device_id=b0e3c6f4-50d3-42b8-851f-675c06baa9c5, device_owner=compute:nova, extra_dhcp_opts=[{u'opt_value': u'172.16.5.16', u'ip_version': 4, u'opt_name': u'150'}, {u'opt_value': u'172.16.5.16', u'ip_version': 4, u'opt_name': u'server-ip-address'}, {u'opt_value': u'172.16.5.16', u'ip_version': 4, u'opt_name': u'66'}, {u'opt_value': u'/tftpboot/', | 10:27 |
| Michael_Silich | u'ip_version': 4, u'opt_name': u'210'}, {u'opt_value': u'pxelinux.0', u'ip_version': 4, u'opt_name': u'67'}], fixed_ips=[{u'subnet_id': u'764820f6-3b3e-44e8-80a7-1a4262df5e4d', u'ip_address': u'192.168.17.147'}], id=6bf77e23-f6bd-45f3-b93c-3ea8b1728342, mac_address=00:02:c9:56:a5:82, name=, network_id=27efe944-4526-4d07-a744-dc1832296fe2, | 10:27 |
| Michael_Silich | port_security_enabled=True, project_id=c0e23261db4e4f319eab47ba257630f7, qos_policy_id=None, resource_request=None, revision_number=9, security_groups=[u'97f2fa92-f673-4f8d-b032-cd3057a854d0'], status=ACTIVE, tags=[], tenant_id=c0e23261db4e4f319eab47ba257630f7, updated_at=2020-02-11T10:13:10Z2020-02-11 10:13:11.312 6 INFO neutron.agent.dhcp.agent | 10:27 |
| Michael_Silich | [req-5d0868a3-1363-4a6d-b942-07c47217870b - - - - -] DHCP configuration for ports set([u'6bf77e23-f6bd-45f3-b93c-3ea8b1728342']) is completed | 10:27 |
| *** ociuhandu has quit IRC | 10:27 | |
| *** priteau has quit IRC | 10:28 | |
| dtantsur | yeah, the port looks good now. are there dnsmasq log records there? | 10:28 |
| *** ociuhandu has joined #openstack-ironic | 10:29 | |
| dtantsur | mgoddard: maybe actually you know ^^^ | 10:29 |
| mgoddard | did the port get bound? | 10:30 |
| *** ociuhandu has quit IRC | 10:30 | |
| mgoddard | looks like yes | 10:30 |
| mgoddard | there should be dnsmasq logs in /var/log/kolla/neutron/ | 10:31 |
| Michael_Silich | yes, her is a log. but i cat see anything from this mac address | 10:31 |
| dtantsur | I'm starting to suspect that neutron-dhcp is attached to a wrong interface | 10:32 |
| mgoddard | it could be | 10:32 |
| mgoddard | what have you set as neutron_external_interface? | 10:33 |
| Michael_Silich | how can i check it? | 10:33 |
| *** dsneddon_ has quit IRC | 10:33 | |
| mgoddard | and api_interface | 10:33 |
| Michael_Silich | neutron_external_interface: "eno2" | 10:33 |
| Michael_Silich | api_interface: "ens2" | 10:33 |
| Michael_Silich | ironic_dnsmasq_interface: "eno2" | 10:34 |
| dtantsur | "dnsmasq-dhcp: DHCPDISCOVER(ens2) 00:02:c9:56:a5:82 ignored" -- seems to be coming from ens2, no? | 10:34 |
| Michael_Silich | looks like | 10:35 |
| yolanda | ok it's deploying now | 10:35 |
| dtantsur | Michael_Silich: all PXE firmwares behave differently when several NICs can PXE boot. Make sure there is exactly one where PXE boot is enabled. And that it corresponds to the expected interface. | 10:35 |
| mgoddard | ok, could be a problem there. the node needs to be on the same physical network as both OVS (for neutron dhcp) and the ironic API | 10:37 |
| Michael_Silich | jep, only 1 interface is active for pxe boot. and its it the same l2 network with neutron_external_interface (eno2) | 10:37 |
| Michael_Silich | so the problem is that api_interface: "ens2" != neutron_external_interface: "eno2" ? | 10:39 |
| rpittau | seems there are massive issues with tinyipa repos | 10:47 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: Consume virtualbmc from pip packages https://review.opendev.org/707101 | 10:49 |
| dtantsur | rpittau: is there something that doesn't have massive issues? :( | 10:49 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-tempest-plugin master: Enable g-reg service in stable jobs https://review.opendev.org/707087 | 10:49 |
| rpittau | dtantsur: we might diverge easily into philosophical here :) | 10:50 |
| dtantsur | indeed | 10:50 |
| dtantsur | rpittau: realistically thought, we probably need https://review.opendev.org/#/c/707101/ and https://review.opendev.org/#/c/707087/ for the ironic-tempest-plugin CI | 10:51 |
| patchbot | patch 707101 - ironic - Consume virtualbmc from pip packages - 1 patch set | 10:51 |
| patchbot | patch 707087 - ironic-tempest-plugin - Enable g-reg service in stable jobs - 2 patch sets | 10:51 |
| dtantsur | Michael_Silich: it may be (mgoddard can confirm for sure). worth trying setting them to the same value (ens2, I guess?) | 10:51 |
| mgoddard | Michael_Silich: have you tried using tcpdump to trace where packets are arriving? | 10:52 |
| rpittau | oh I didn't see the virtualbmc one | 10:52 |
| dtantsur | rpittau: just posted it. I hope to avoid doing it for Ussuri on, but stupid branchless tempest plugins..... | 10:53 |
| dtantsur | * hoped | 10:53 |
| mgoddard | Michael_Silich: a warning about setting those interfaces the same - OVS will swallow any IP assigned to neutron_external_interface. I typically use a bridge and a veth pair to allow me to put an IP on the native VLAN and also plug it into OVS | 10:53 |
| dtantsur | mgoddard: should we maybe document it in kolla? | 10:54 |
| mgoddard | another thing to watch out for with flat networking is ironic inspector PXE filtering. inspector may add iptables rules to filter DHCP packets from dnsmasq | 10:54 |
| mgoddard | dtantsur: yeah, kolla+ironic docs could be improved | 10:55 |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-inspector master: Use openstacksdk for ironic module https://review.opendev.org/672179 | 10:55 |
| etingof | how'd one depend on an unreleased package version? Depends-On? but that leaves wrong version in requirements.txt | 10:55 |
| dtantsur | etingof: you cannot :( to test something you can temporary add the project to required-projects. | 10:55 |
| rpittau | the entire pxe_enabled/is_pxe_enabled shenanigan is not fun :/ | 10:55 |
| dtantsur | rpittau: lol, true. I can understand where openstacksdk is coming from, but yes | 10:56 |
| dtantsur | ditto for is_maintenance, etc | 10:56 |
| etingof | dtantsur, so I just have to remember to bump requirements.txt before release? | 10:56 |
| dtantsur | etingof: after, you mean? | 10:56 |
| * dtantsur guesses sushy | 10:57 | |
| etingof | yeah | 10:57 |
| etingof | I can't have proper requirements.txt of sushy-cli now, so I have to remember to update it prior to sushy-cli release or after sushy release | 10:58 |
| openstackgerrit | Merged openstack/ironic master: Actually use ironic-python-agent from source in source builds https://review.opendev.org/706863 | 10:58 |
| Michael_Silich | dhcp packets are arriving on ens2, in the evening i can unconfigure the network and try it again (10:56:34.130834 00:02:c9:56:a5:82 > ff:ff:ff:ff:ff:ff, ethertype IPv4 (0x0800), length 438: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 00:02:c9:56:a5:82, length 396) | 10:58 |
| openstackgerrit | Merged openstack/ironic master: Fix up release notes for 14.0.0 https://review.opendev.org/706560 | 10:58 |
| dtantsur | etingof: or you can ask mgoddard to release sushy or whatever you need :) | 10:59 |
| etingof | we still have interesting patches to stuff into sushy roll | 11:00 |
| openstackgerrit | Ilya Etingof proposed openstack/sushy-cli master: Add system/manager/chassis inventory show command https://review.opendev.org/706005 | 11:00 |
| *** dsneddon_ has joined #openstack-ironic | 11:01 | |
| dtantsur | ah | 11:02 |
| dtantsur | then yes, you have to wait | 11:02 |
| dtantsur | Michael_Silich: ++ let us know how it goes | 11:02 |
| *** priteau has joined #openstack-ironic | 11:03 | |
| *** ociuhandu has joined #openstack-ironic | 11:04 | |
| *** dsneddon_ has quit IRC | 11:07 | |
| *** ociuhandu has quit IRC | 11:09 | |
| *** ociuhandu has joined #openstack-ironic | 11:13 | |
| openstackgerrit | Ilya Etingof proposed openstack/sushy-cli master: Add system/manager/chassis inventory show command https://review.opendev.org/706005 | 11:13 |
| dtantsur | etingof: FYI we need to have sushy-cli releasable by Thursday the latest (to be included in Ussuri). So please try to limit the scope of the next changes. | 11:14 |
| etingof | dtantsur, ack, let's just try to merge the pending patches | 11:15 |
| *** ociuhandu has quit IRC | 11:18 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-tempest-plugin master: Remove Rocky and Queens jobs https://review.opendev.org/707111 | 11:18 |
| dtantsur | a bit harsh, but I think necessary ^^^ | 11:18 |
| openstackgerrit | Merged openstack/ironic master: Update release mappings for Ussuri https://review.opendev.org/706565 | 11:18 |
| *** mkrai__ has quit IRC | 11:19 | |
| *** rpittau is now known as rpittau|bbl | 11:21 | |
| *** fungi has quit IRC | 11:24 | |
| *** fungi has joined #openstack-ironic | 11:26 | |
| openstackgerrit | Ilya Etingof proposed openstack/sushy-cli master: Add systems, managers and chassis listing commands https://review.opendev.org/706461 | 11:27 |
| gudrutis2 | o/ hi folks | 11:30 |
| openstackgerrit | Ilya Etingof proposed openstack/sushy-cli master: Add systems, managers and chassis listing commands https://review.opendev.org/706461 | 11:35 |
| openstackgerrit | Ilya Etingof proposed openstack/sushy-cli master: Add system boot device/mode commands https://review.opendev.org/706392 | 11:35 |
| *** yedongcan has left #openstack-ironic | 11:37 | |
| *** dsneddon_ has joined #openstack-ironic | 11:39 | |
| *** dsneddon_ has quit IRC | 11:44 | |
| *** ociuhandu has joined #openstack-ironic | 11:51 | |
| *** ociuhandu has quit IRC | 11:57 | |
| *** Lucas_Gray has quit IRC | 11:59 | |
| *** Michael_Silich has quit IRC | 12:01 | |
| *** ociuhandu has joined #openstack-ironic | 12:01 | |
| *** amoralej is now known as amoralej|lunch | 12:04 | |
| *** ricolin has quit IRC | 12:10 | |
| *** dsneddon_ has joined #openstack-ironic | 12:18 | |
| openstackgerrit | Ilya Etingof proposed openstack/ironic-specs master: Update L3 based deployment spec https://review.opendev.org/672780 | 12:22 |
| *** dsneddon_ has quit IRC | 12:23 | |
| *** dtantsur is now known as dtantsur|brb | 12:27 | |
| *** MIchael_Silich has joined #openstack-ironic | 12:27 | |
| *** ociuhandu has quit IRC | 12:31 | |
| *** ociuhandu has joined #openstack-ironic | 12:34 | |
| *** Lucas_Gray has joined #openstack-ironic | 12:36 | |
| *** bfournie has quit IRC | 12:44 | |
| *** mkrai__ has joined #openstack-ironic | 12:46 | |
| *** dsneddon_ has joined #openstack-ironic | 12:51 | |
| *** dsneddon_ has quit IRC | 12:56 | |
| *** rh-jelabarre has joined #openstack-ironic | 13:07 | |
| *** mkrai__ has quit IRC | 13:08 | |
| *** Lucas_Gray has quit IRC | 13:18 | |
| *** Lucas_Gray has joined #openstack-ironic | 13:18 | |
| *** amoralej|lunch is now known as amoralej | 13:18 | |
| *** goldyfruit has joined #openstack-ironic | 13:18 | |
| openstackgerrit | Merged openstack/ironic-python-agent master: Fix multiprocessing call in unit test https://review.opendev.org/703439 | 13:21 |
| openstackgerrit | Verification of a change to openstack/ironic failed: tell reno to ignore the kilo branch https://review.opendev.org/706784 | 13:21 |
| *** rpittau|bbl is now known as rpittau | 13:22 | |
| *** Lucas_Gray has quit IRC | 13:24 | |
| *** derekh has quit IRC | 13:27 | |
| *** dsneddon_ has joined #openstack-ironic | 13:31 | |
| *** rloo has joined #openstack-ironic | 13:32 | |
| *** dsneddon_ has quit IRC | 13:36 | |
| *** Lucas_Gray has joined #openstack-ironic | 13:37 | |
| *** dsneddon_ has joined #openstack-ironic | 13:38 | |
| jerrywang1 | Hi, all, when I run unstack.sh at a ironic-inspector devsatack config, hang at "sudo ovs-vsctl del-port qg-ef94fb3d-67", see detail at http://paste.openstack.org/show/789423/. What's the problem? Thanks. | 13:42 |
| jerrywang1 | I met this after I ran devstack many times, before most times of unstack.sh did not have any problems | 13:43 |
| *** bfournie has joined #openstack-ironic | 13:44 | |
| *** dtantsur|brb is now known as dtantsur | 13:49 | |
| *** Lucas_Gray has quit IRC | 13:50 | |
| *** Lucas_Gray has joined #openstack-ironic | 13:52 | |
| iurygregory | jerrywang1, I'm afraid thet the past doesn't provide details that would help .-. | 13:58 |
| *** tkajinam has joined #openstack-ironic | 13:59 | |
| *** mbeierl has joined #openstack-ironic | 14:01 | |
| *** derekh has joined #openstack-ironic | 14:01 | |
| *** Goneri has joined #openstack-ironic | 14:12 | |
| TheJulia | good morning | 14:15 |
| rpittau | good morning TheJulia :) | 14:16 |
| dtantsur | morning TheJulia | 14:16 |
| TheJulia | so how do we want to go about getting tempest fixes in so our ci failure rate goes down? | 14:17 |
| TheJulia | i also have a few ipa fixes that should also help with the failure issues | 14:18 |
| dtantsur | TheJulia: well, we need to fix the tempest plugin CI first | 14:18 |
| *** jerrywang1 has quit IRC | 14:19 | |
| dtantsur | i.e. https://review.opendev.org/#/c/707101/ and https://review.opendev.org/#/c/707087/ | 14:19 |
| patchbot | patch 707101 - ironic - Consume virtualbmc from pip packages - 1 patch set | 14:19 |
| patchbot | patch 707087 - ironic-tempest-plugin - Enable g-reg service in stable jobs - 2 patch sets | 14:19 |
| dtantsur | also https://review.opendev.org/#/c/707111/ just to save some CI time | 14:19 |
| patchbot | patch 707111 - ironic-tempest-plugin - Remove Rocky and Queens jobs - 1 patch set | 14:19 |
| TheJulia | ugh, all ssorts of small issues | 14:21 |
| dtantsur | indeed | 14:22 |
| TheJulia | my changes focus on failures related to the standalone job | 14:22 |
| TheJulia | fwiw | 14:22 |
| TheJulia | I didn't look at the other because I saw a note ?yesterday? or was it ?friday? that all the stable branches were borken | 14:22 |
| TheJulia | broken | 14:22 |
| *** jerrywang1 has joined #openstack-ironic | 14:24 | |
| jerrywang1 | hi, iurgregory, anyting else you need? | 14:24 |
| jerrywang1 | hi, iurgregory, anyting else you need? | 14:24 |
| dtantsur | TheJulia: I'm talking to gmann on #openstack-qa to see if we can do without explicitly enabling g-reg | 14:26 |
| TheJulia | k | 14:26 |
| *** tzumainn has joined #openstack-ironic | 14:27 | |
| jerrywang1 | iurgregory, I listed that port(qg-ef94fb3d-67)'s detail by sudo ovs-vsctl list | 14:27 |
| dtantsur | TheJulia: tl;dr we get all sorts of struggles because stable jobs on ironic-tempest-plugin use master zuul configuration (which is how things work, I guess) | 14:29 |
| jerrywang1 | iurgregory, or you could show some light on roughtly steps to debug such kind of issue, thx | 14:29 |
| *** jdandrea has joined #openstack-ironic | 14:29 | |
| TheJulia | dtantsur: there is that too... We need a "merge it, I don't want to start drinking this early" button | 14:30 |
| dtantsur | Time to complain about a missing option to recheck one job? | 14:30 |
| * TheJulia feels like she did not sleep | 14:30 | |
| dtantsur | ugh :( that sucks, get some rest later today | 14:30 |
| TheJulia | dtantsur: well, tempest specifically that wouldn't really work for, but for ironic itsself with the raid related failures on standalone.... that would be amazing | 14:31 |
| dtantsur | exactly | 14:31 |
| TheJulia | but what should get us to a lower failure rate are really much smaller changes | 14:31 |
| dtantsur | and I think we should once again and seriously discuss reducing the job count while keeping the same coverage | 14:32 |
| dtantsur | e.g. IPMI vs Redfish are orthogonal to whole disk vs partition | 14:32 |
| openstackgerrit | Verification of a change to openstack/ironic failed: Fix bash comparisons for grenade multinode switch https://review.opendev.org/705814 | 14:32 |
| dtantsur | of course it failed, why wouldn't it?.. | 14:32 |
| TheJulia | I didn't go to tearing down the raidset btw, but removing the root device hint seems to be magical :) | 14:33 |
| * TheJulia bets the standalone job | 14:33 | |
| TheJulia | I've been wondering if we should cut back anything ipmi related heavily | 14:33 |
| TheJulia | I'm seriously pondering changing bifrost to redfish because of the weird behavior we see | 14:34 |
| dtantsur | realistically we should have at least half of the jobs with redfish | 14:34 |
| dtantsur | given where the world is moving | 14:34 |
| TheJulia | yes, and we're not doing any active development in the ipmi code | 14:34 |
| TheJulia | We will likely add only one thing that I can think of... indicator light support | 14:35 |
| dtantsur | going next level, we should stop having essentially one test per job. this is ridiculous | 14:35 |
| TheJulia | ++ | 14:35 |
| dtantsur | I've already added this topic to the midcycle bts | 14:35 |
| dtantsur | * btw | 14:35 |
| dtantsur | and I'm ready to convince downstream to dedicate a good share of my time to it | 14:35 |
| TheJulia | well, we started to move away from it, we need to revamp the devstack plugin or maybe start using some ansible.. the modules and inventory data process could allow us to create two sets of VMs | 14:36 |
| TheJulia | ++ | 14:36 |
| *** goldyfruit has quit IRC | 14:38 | |
| dtantsur | mother of dragons, what is going on outside? Oo | 14:38 |
| *** goldyfruit has joined #openstack-ironic | 14:38 | |
| dtantsur | like, bright sun and centimeter-size heil Oo | 14:39 |
| TheJulia | oooh! | 14:40 |
| * TheJulia files "mother of dragons" away in memory | 14:40 | |
| TheJulia | Our wind is gusting quite a bit. sadly the weather station console is beyond reach on my desk. | 14:41 |
| openstackgerrit | Riccardo Pittau proposed openstack/bifrost master: Make CentOS 8 tinyipa job voting again https://review.opendev.org/703954 | 14:41 |
| openstackgerrit | Riccardo Pittau proposed openstack/bifrost master: [DNM] getting some libvirt info https://review.opendev.org/707162 | 14:41 |
| iurygregory | good morning TheJulia | 14:41 |
| TheJulia | Gusting to ~30 kph | 14:41 |
| dtantsur | TheJulia: this is how it looks https://www.instagram.com/p/B8birTdiM3o/ | 14:42 |
| dtantsur | (the 2nd photo shows the overall scale) | 14:43 |
| TheJulia | that is pretty | 14:43 |
| rpittau | the wind's kind of crazy here too since sunday | 14:43 |
| iurygregory | wind in Brno is a bit crazy | 14:43 |
| dtantsur | TheJulia: I think the record in German was 170 km/h (120 km/h in our region) | 14:46 |
| rpittau | north of Italy yesterday went up to 200 | 14:46 |
| dtantsur | mountain regions, amiright? | 14:47 |
| iurygregory | =O | 14:47 |
| rpittau | right after the Alps | 14:47 |
| iurygregory | omg | 14:47 |
| dtantsur | we have this construction crane in front of the house, at some point it was spinning as a freaking helicopter :D | 14:48 |
| TheJulia | I won't go up into the mountain pass near by house when it is windy int he valley here. 100-120 kph is "normal" gusty for up there. We've had trucks blown over | 14:48 |
| TheJulia | dtantsur: eek :( | 14:48 |
| TheJulia | Then again, wind is a very normal thing here | 14:48 |
| dtantsur | Well, now it's a normal thing everywhere. Welcome to the new age :) | 14:49 |
| dtantsur | (but yes, NRW is known for tornadoes, I knew where I was moving) | 14:50 |
| TheJulia | new age, much like old age... but lots of wind | 14:50 |
| dtantsur | and burning forests. and blooming trees in February :) | 14:51 |
| iurygregory | blooming trees already? o.o | 14:52 |
| * iurygregory thinks dtantsur started living in a another world | 14:52 | |
| dtantsur | iurygregory: right? We were jogging, so I didn't have my phone with me to make a picture | 14:52 |
| dtantsur | but yes, early trees (sakura?) and flowers (dunno the names) | 14:53 |
| iurygregory | woa =O nice | 14:53 |
| dtantsur | it's been more than +10 most of winter, I'm not surprised | 14:53 |
| dtantsur | it's still +7 today, despite all the craziness | 14:53 |
| rpittau | I was jogging today and it was not exactly nice getting branches in the face | 14:53 |
| dtantsur | :D | 14:54 |
| dtantsur | we abstained for now | 14:54 |
| etingof | iurygregory, we should expect those blooming trees flying over here anytime soon, no worries | 14:55 |
| iurygregory | etingof, yeah XD | 14:55 |
| dtantsur | I'm pretty sure they're already on the way! | 14:55 |
| * iurygregory is wondering if rpittau could avoid the branches... | 14:56 | |
| *** jerrywang1 has quit IRC | 14:56 | |
| rpittau | iurygregory: they were flying ninja branches | 14:56 |
| *** ociuhandu has quit IRC | 14:57 | |
| openstackgerrit | Riccardo Pittau proposed openstack/ironic-python-agent master: Convert apply_result to mock object https://review.opendev.org/707166 | 14:57 |
| rpittau | ^ dtantsur thanks for the hint and sorry I didn't see your comment in the other patch :/ | 14:58 |
| dtantsur | no worries, it's all very minor | 14:58 |
| iurygregory | rpittau, damm! XD ninjas everywhere | 14:58 |
| openstackgerrit | Rachit Kapadia proposed openstack/ironic master: DRAC: Upgraded RAID create_config clean step https://review.opendev.org/707169 | 15:04 |
| *** dking_desktop has joined #openstack-ironic | 15:07 | |
| dking_desktop | I'm confused about which images to use for IPA. According to the ironic-inspector documentation, we should be using disk-image-create with the ironic-agent element. However in the disk-image-create documentation for the ironic-agent element, it says that it is deprecated. | 15:09 |
| dtantsur | dking_desktop: the ironic-inspector documentation is outdated then. where do you see it? | 15:09 |
| dking_desktop | https://docs.openstack.org/ironic-inspector/latest/install/#configuring-ipa | 15:10 |
| dtantsur | dking_desktop: my bad, missed that. use https://docs.openstack.org/ironic-python-agent-builder/latest/admin/dib.html | 15:11 |
| dking_desktop | dtantsur: Great! Thanks. That looked like where the links were leading. So, I suppose it's just the documentation that needs to be updated. | 15:13 |
| dtantsur | yep, I'll fix it (or feel free to propose a patch if you have a minute) | 15:13 |
| dking_desktop | Thanks. I might have a chance later if it's not posted. I'm still trying to get my head around things. | 15:14 |
| dtantsur | sure, no worries | 15:14 |
| dking_desktop | Also, at the top of the link you sent, it says: "Images built using diskimage-builder are recommended for production use on real hardware." | 15:14 |
| dtantsur | this is our official position, yes | 15:15 |
| * TheJulia is reminded we need to scrub coreos references | 15:15 | |
| dtantsur | TheJulia: yep. caught one in kolla recently. | 15:15 |
| *** khansa has joined #openstack-ironic | 15:15 | |
| TheJulia | oh joy | 15:15 |
| TheJulia | starlingx | 15:16 |
| TheJulia | inspector | 15:16 |
| dtantsur | \o/ | 15:16 |
| TheJulia | kayobe | 15:16 |
| dtantsur | and hell lot of stable branches | 15:16 |
| TheJulia | indeed | 15:16 |
| dtantsur | dunno what to do about stable branches actually. IPA-builder can be used for them. | 15:16 |
| TheJulia | the path for them does change a little, but options exist. I'm going to go look at some of them and see what we can do because most of this looks like documentation | 15:17 |
| dking_desktop | ...so the most correct way is to install ironic-python-agent-builder, but then, rather than running it directly, set environment variables to use it, and then run disk-image-create? | 15:18 |
| dtantsur | dking_desktop: these are two ways. easy one - use IPA-builder directly. advanced one - use disk-image-create. | 15:18 |
| dtantsur | the IPA-builder script doesn't do much, really: https://opendev.org/openstack/ironic-python-agent-builder/src/branch/master/ironic_python_agent_builder/__init__.py | 15:19 |
| dking_desktop | Okay, but even with the later, we should be using ironic-python-agent-builder, rather than the default ironic-agent element that comes with it? | 15:19 |
| dtantsur | in both cases, yes. | 15:19 |
| dking_desktop | Okay. That makes sense. Thank you for helping clear that up for me. | 15:20 |
| dtantsur | np, we're glad to help | 15:20 |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: Pre-shared agent token https://review.opendev.org/692609 | 15:21 |
| *** khansa has quit IRC | 15:21 | |
| tzumainn | hi! I was playing with non-admin node deployments yesterday, and ran into two issues that I'll need to fix that I was wondering if I could get some feedback on | 15:21 |
| dtantsur | just two? not bad! :) | 15:21 |
| tzumainn | haha, yeah :) | 15:21 |
| tzumainn | the first is that metalsmith uses baremetal:allocation:get/delete/update, and those currently aren't exposed to allocation owners - that fix I think is straightforward | 15:21 |
| dtantsur | oh, yeah, it's a bug | 15:22 |
| tzumainn | the second is that deployment requires updating a node - something that a node owner maybe can be assumed to have, but not a lessee | 15:22 |
| tzumainn | for the second issue, I'm wondering - would it make sense to introduce a new policy like baremetal:node:update_for_deployment? | 15:22 |
| *** Lucas_Gray has quit IRC | 15:23 | |
| dtantsur | tzumainn: this why I'm working on the deployment API | 15:23 |
| dtantsur | tzumainn: https://storyboard.openstack.org/#!/story/2006910 | 15:23 |
| dtantsur | any help is appreciated, I'm torn in different directions as always | 15:23 |
| *** Lucas_Gray has joined #openstack-ironic | 15:25 | |
| tzumainn | oh, right! I remember looking at that, and I admit that my first thought was that I'm not even sure where one would get started with that | 15:25 |
| dtantsur | tzumainn: well, I've started with https://review.opendev.org/703778 | 15:26 |
| patchbot | patch 703778 - ironic - [WIP] RPC and conductor changes for deployment API - 5 patch sets | 15:26 |
| tzumainn | is it essentially porting metalsmith code into ironic? | 15:26 |
| dtantsur | sort of... | 15:26 |
| dtantsur | if you're interested to try finishing this patch, I can provide you all necessary pointers | 15:26 |
| dtantsur | tzumainn: this patch lacks the conductor manager parts. then we need API, but it will be mostly cargo-culting from something existing. | 15:28 |
| *** ociuhandu has joined #openstack-ironic | 15:28 | |
| tzumainn | I would actually be extremely interested - I'm wondering if it's possible to make the multistage approach work for non-owners first, or if that should just be left alone | 15:28 |
| dtantsur | tzumainn: multistage approach? | 15:29 |
| tzumainn | sorry, multiple steps | 15:29 |
| *** tkajinam has quit IRC | 15:29 | |
| tzumainn | er, sorry - what I mean is, making it work for non-owners through metalsmith | 15:29 |
| tzumainn | my words are not all here today | 15:29 |
| dtantsur | I'm a bit uneasy about adding such a policy.. maybe others have different opinions. | 15:30 |
| tzumainn | anyway, the only reason I thought that creating a new baremetal:node:update_whatever policy might be viable, is because other projects seem to do the same thing | 15:30 |
| tzumainn | but if you think it's a bad idea, I'm not unsatisfied with the idea that metalsmith can still work for owners, but we'll need the deployment API for lessees | 15:30 |
| dtantsur | I think the problem is the same for owners and lessees, no? | 15:31 |
| tzumainn | well, owners might logically have access to baremetal:node:update anyway | 15:31 |
| dtantsur | tzumainn: the new policy of yours, what will it cover? updating instance_uuid and instance_info? | 15:31 |
| tzumainn | I can't imagine lessees being able to update everything about a node | 15:31 |
| tzumainn | those, and I think - deploy-interface? | 15:32 |
| dtantsur | mmmmmm, interfaces.. | 15:32 |
| dtantsur | that's a can of worms potentially | 15:32 |
| dtantsur | I think I'm -1 to anything outside of instance_uuid and instance_info | 15:33 |
| tzumainn | oh, does that expose some vulnerability? | 15:33 |
| dtantsur | tzumainn: 1. it changes behavior quite seriously, 2. it may require changes to driver_info | 15:33 |
| tzumainn | dtantsur, ah, okay | 15:33 |
| dtantsur | if anything, I'd make it another policy | 15:33 |
| tzumainn | dtantsur, how about if I see if I can make it work with just instance_* first? if there's a never-ending series of needed updates, then I'll ditch the whole idea | 15:34 |
| dtantsur | tzumainn: you should be able to make it work with updating instance_* stuff and with VIF API | 15:34 |
| dtantsur | actually, with allocations you don't even need to update instance_uuid, only instance_infio | 15:34 |
| tzumainn | dtantsur, let me play with that and get back to you then! | 15:35 |
| dtantsur | sure, cool. lemme know if you're still interested in hacking on the deployment API | 15:35 |
| dtantsur | then people who don't use metalsmith will benefit from this work as well | 15:35 |
| tzumainn | I definitely would be, I love the idea of a single-use API | 15:35 |
| tzumainn | er, single-something | 15:36 |
| tzumainn | I don't know what I'm saying | 15:36 |
| tzumainn | but I know I like it | 15:36 |
| dtantsur | :D | 15:36 |
| dtantsur | tzumainn: ping me when you allocate some time, I'll update you on the status | 15:36 |
| tzumainn | but yeah, give me a week or two, and then I'll try and throw myself at it | 15:36 |
| dtantsur | cool | 15:37 |
| openstackgerrit | Julia Kreger proposed openstack/ironic-inspector master: Change CoreOS to Centos for IPA https://review.opendev.org/707174 | 15:37 |
| * TheJulia asks the starlingx folks about their docs | 15:40 | |
| TheJulia | I guess coreos-image-builder also needs to be killed | 15:41 |
| dtantsur | long time ago | 15:42 |
| *** mkrai__ has joined #openstack-ironic | 15:43 | |
| *** TxGirlGeek has joined #openstack-ironic | 15:50 | |
| TheJulia | https://review.opendev.org/707181 <-- seems like ironic-cores have rights on this repo :) | 15:52 |
| patchbot | patch 707181 - x/coreos-image-builder - Mark coreos-image-builder repo contents decomissioned - 1 patch set | 15:52 |
| TheJulia | step 1.... realistically | 15:52 |
| TheJulia | I believe step2 is just flag it as decommisioned in gerrit config | 15:53 |
| TheJulia | since it is not in governance | 15:53 |
| dtantsur | TheJulia: 2 nits in README | 15:53 |
| dtantsur | probably worth fixing before we pull the trigger | 15:53 |
| TheJulia | oh, no, did you not hear the CoreOS EOL? | 15:54 |
| dtantsur | wut | 15:54 |
| TheJulia | yeah | 15:54 |
| dtantsur | wasn't it reborn as Red Hat CoreOS or whatever? | 15:54 |
| TheJulia | https://coreos.com/os/eol/ | 15:54 |
| *** ociuhandu has quit IRC | 15:54 | |
| rpittau | oh wow.... | 15:55 |
| * TheJulia is surprised you guys didn't hear this | 15:56 | |
| rpittau | I'm also surprised | 15:56 |
| * iurygregory saw about coreos (1 week ago or something) | 15:56 | |
| dtantsur | TheJulia: well, I've heard about this | 15:56 |
| dtantsur | I'm trying to say that just "CoreOS" can also refer to "Fedora CoreOS" and "Red Hat CoreOS" | 15:57 |
| dtantsur | so the statement in README is slightly ambiguous | 15:57 |
| * TheJulia revises it further | 15:58 | |
| dtantsur | rpittau: hey, how do I make stuff like :ironic-python-agent-doc: work? Trying the same for builder, it refuses. | 16:00 |
| dtantsur | does it only work for branched projects? | 16:00 |
| *** Lucas_Gray has quit IRC | 16:02 | |
| TheJulia | dtantsur: i changed it to "CoreOS Container Linux" | 16:03 |
| dtantsur | ++ | 16:04 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-tempest-plugin master: Use override-checkout instead of override-branch https://review.opendev.org/707186 | 16:06 |
| dtantsur | another potential fix ^^^ | 16:06 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-tempest-plugin master: Use override-checkout instead of override-branch https://review.opendev.org/707186 | 16:07 |
| * iurygregory didn't know that override-checkout was better for projects that only have master =O | 16:09 | |
| iurygregory | ++ | 16:10 |
| *** ociuhandu has joined #openstack-ironic | 16:11 | |
| dtantsur | apparently? | 16:12 |
| *** ociuhandu has quit IRC | 16:12 | |
| *** ociuhandu has joined #openstack-ironic | 16:12 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-tempest-plugin master: Use override-checkout instead of override-branch https://review.opendev.org/707186 | 16:13 |
| iurygregory | it seems to help when we are using a job that comes from a project that has master and stable branches | 16:14 |
| dtantsur | yeah | 16:16 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-inspector master: Replace references to the deprecated ironic-agent element https://review.opendev.org/707191 | 16:22 |
| dtantsur | dking_desktop: ^^ | 16:22 |
| dking_desktop | Thank you very much! | 16:24 |
| rpittau | dtantsur: sorry was in a meeting, yeah I think that is for branched only | 16:26 |
| dtantsur | rpittau: actually, I figured it, but I wonder if I shouldn't have used it really | 16:26 |
| * dtantsur thinks | 16:27 | |
| TheJulia | since ironic-cores have domain over coreos-image-builder https://review.opendev.org/#/c/707181 could use another review | 16:27 |
| patchbot | patch 707181 - x/coreos-image-builder - Mark coreos-image-builder repo contents decomissioned - 3 patch sets | 16:27 |
| rpittau | well it's useful to link projects branch-to-branch | 16:27 |
| rpittau | not sure how useful it is for branchless projects | 16:28 |
| dtantsur | right | 16:29 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-inspector master: Replace references to the deprecated ironic-agent element https://review.opendev.org/707191 | 16:30 |
| rpittau | dtantsur: because 404 -> https://docs.openstack.org/ironic-python-agent-builder/train | 16:30 |
| dtantsur | yeah. changed that. | 16:31 |
| rpittau | ok | 16:31 |
| openstackgerrit | Riccardo Pittau proposed openstack/python-ironicclient master: Add --no-retired list option https://review.opendev.org/707196 | 16:31 |
| dtantsur | rpittau: release note please ^^ | 16:32 |
| *** gyee has joined #openstack-ironic | 16:32 | |
| rpittau | dtantsur: yep, realized once I pushed enter :D | 16:32 |
| dtantsur | :) | 16:32 |
| dtantsur | 4.0.0 has been released, so this is a new feature in the next release | 16:33 |
| rpittau | amazing new feature | 16:33 |
| *** dtantsur is now known as dtantsur|afk | 16:34 | |
| dtantsur|afk | see you tomorrow | 16:34 |
| rpittau | bye! | 16:35 |
| openstackgerrit | Riccardo Pittau proposed openstack/python-ironicclient master: Add --no-retired list option https://review.opendev.org/707196 | 16:36 |
| rpittau | good night! o/ | 16:59 |
| *** rpittau is now known as rpittau|afk | 17:00 | |
| *** priteau has quit IRC | 17:00 | |
| *** lucasagomes has quit IRC | 17:02 | |
| openstackgerrit | Riccardo Pittau proposed openstack/bifrost master: [DNM] getting some libvirt info https://review.opendev.org/707162 | 17:04 |
| openstackgerrit | Ilya Etingof proposed openstack/ironic master: Make `redfish_system_id` property optional https://review.opendev.org/707208 | 17:07 |
| *** gmann is now known as gmann_afk | 17:20 | |
| *** mkrai__ has quit IRC | 17:23 | |
| *** igordc has joined #openstack-ironic | 17:24 | |
| *** ociuhandu_ has joined #openstack-ironic | 17:26 | |
| *** ociuhandu has quit IRC | 17:29 | |
| *** ociuhandu_ has quit IRC | 17:30 | |
| *** alexmcleod has quit IRC | 17:41 | |
| *** k_mouza has quit IRC | 17:42 | |
| *** dougsz has quit IRC | 17:56 | |
| *** derekh has quit IRC | 17:58 | |
| *** igordc has quit IRC | 18:02 | |
| *** igordc has joined #openstack-ironic | 18:06 | |
| *** k_mouza has joined #openstack-ironic | 18:13 | |
| *** macz has joined #openstack-ironic | 18:15 | |
| *** macz has left #openstack-ironic | 18:15 | |
| TheJulia | whee for BMCs | 18:17 |
| *** k_mouza has quit IRC | 18:18 | |
| JayF | TheJulia: is there a BMC in the world that isn't made of 95% pure burning garbage? | 18:18 |
| JayF | I don't mean that sarcastically either, there's gotta be some that are done OK? The new redfish implementations helping with that at all? | 18:19 |
| TheJulia | This is actually an issue, it seems, in redfish support and behavior for BootSourceOverrideEnabled: 'Continious' | 18:20 |
| TheJulia | so... emailed one of the engineers that knows that bmc well with "Hi! Halp!?!?" | 18:20 |
| *** hjensas has quit IRC | 18:21 | |
| TheJulia | JayF: Redfish has made it a lot better in many ways | 18:24 |
| TheJulia | Like... stock redfish virtual media code basically works for HP gear out of the box | 18:24 |
| TheJulia | for dell, it requires a little more process, but essentially the same underlying code | 18:25 |
| JayF | that's really nice to hear! | 18:25 |
| TheJulia | and I think I've submitted all the patches to scrub old ipa image references | 18:35 |
| openstackgerrit | Zygimantas Matonis proposed openstack/ironic-inspector master: Added scope to introspection rules. https://review.opendev.org/702215 | 18:41 |
| *** hjensas has joined #openstack-ironic | 18:44 | |
| *** gmann_afk is now known as gmann | 18:49 | |
| *** amoralej is now known as amoralej|off | 18:51 | |
| openstackgerrit | Zygimantas Matonis proposed openstack/ironic-inspector master: Added scope to introspection rules. https://review.opendev.org/702215 | 19:05 |
| dking_desktop | I'm attempting to run "disk-image-create -o ironic-agent ironic-python-agent-ramdisk centos-minimal", and I'm receiving errors. I'm not sure how to troubleshoot. It seems the last useful one was "Could not find a version that satisfies the requirement oslo.service===2.0.0" | 19:16 |
| dking_desktop | I also saw a lot of these: markers 'python_version == "3.6"' don't match your environment | 19:16 |
| dking_desktop | I'm running python 3.6 from a virtualenv. | 19:16 |
| clarkb | dking_desktop: I think the install of some tool in the image is running into that | 19:22 |
| clarkb | dking_desktop: more context from the logs would help identify what exactly. | 19:22 |
| clarkb | ironic-agent probably | 19:23 |
| dking_desktop | Give me a moment and I'll grab some more of the logs. | 19:23 |
| dking_desktop | Yeah, that would be my guess, too. I'm not at all familiar with building these images, so I apologize if I'm missing something simple. | 19:27 |
| dking_desktop | clarkb: http://paste.openstack.org/show/789438/ | 19:28 |
| clarkb | dking_desktop: yup I believe my hunch was right. What disk image builder does is create a chroot that it then builds out to be an image and at the end of the process it copies the contents of that chroot into an image file. One of the steps there is to install the ironic python agent and it is doing so under python2 | 19:30 |
| clarkb | If ironic-python-agent can be installed under python3 that would probably fix this. Abother option is to have ironic-python-agent update its deps so that it doesn't try to install too new libraries for python2 | 19:30 |
| clarkb | I'm not sure what the ironic team would prefer though | 19:30 |
| *** naved002 has joined #openstack-ironic | 19:33 | |
| dking_desktop | I'm pretty sure that I installed it with python3, especially after the first round of errors. But all that I did was switch virtualenvs and re-installed all the pip installs. | 19:33 |
| *** naved002 has quit IRC | 19:34 | |
| dking_desktop | Hmm... I may not have installed ironic-python-agent-builder, only ironic-python-agent. I'll give that a try. | 19:34 |
| *** naved001 has joined #openstack-ironic | 19:35 | |
| *** alexmcleod has joined #openstack-ironic | 19:39 | |
| *** jtomasek has quit IRC | 19:48 | |
| dking_desktop | And I had that backwards. But now both are installed the same way, using the virtualenv with python3. | 19:51 |
| *** Goneri has quit IRC | 19:53 | |
| TheJulia | dking_desktop: you need to explicitly tell DIB to use python3 | 19:55 |
| TheJulia | at least... I think for centos | 19:56 |
| TheJulia | also, centos7 or centos8? | 19:56 |
| TheJulia | dking_desktop: btw, I found something you'll like | 19:56 |
| TheJulia | https://tarballs.openstack.org/ironic-python-agent-builder/dib/files/ | 19:56 |
| dking_desktop | Do you know how to tell it that? I just changed the system python to python3, and that did something different. | 19:57 |
| dking_desktop | Great. I might just download those instead. It would be nice to have things working, though. | 19:57 |
| dking_desktop | ...and the something different was to fail even earlier. :-/ | 20:04 |
| dking_desktop | Oh. disk-image-create made a ironic-agent.d directory, which I hadn't been cleaning. When I removed that, went back to global python2, and installed semanage, then it seemed to work. | 20:18 |
| TheJulia | interesting | 20:22 |
| *** alexmcleod has quit IRC | 20:29 | |
| *** Lucas_Gray has joined #openstack-ironic | 20:41 | |
| openstackgerrit | Julia Kreger proposed openstack/ironic-python-agent master: Ignore pyudev errors about device number https://review.opendev.org/706993 | 20:44 |
| *** Goneri has joined #openstack-ironic | 21:13 | |
| *** Lucas_Gray has quit IRC | 21:22 | |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: POC: idrac redfish bios? https://review.opendev.org/707254 | 21:30 |
| *** mmethot has quit IRC | 21:36 | |
| *** mmethot has joined #openstack-ironic | 21:37 | |
| *** mmethot has quit IRC | 21:38 | |
| TheJulia | rpioso: ^^^ is an idea I discussed with chris dearborn to try and provide operator visibility into bios settings via redfish with the idrac hardware until enough logic is implemented to support crafting and submitting a configuration job for bios settings. Thoughts are absolutely welcome :) | 21:38 |
| *** mmethot has joined #openstack-ironic | 21:38 | |
| *** mmethot has quit IRC | 21:42 | |
| *** dsneddon_ has quit IRC | 21:48 | |
| dking_desktop | This may be the wrong channel, but I'm having trouble getting the "openstack" cli to accept "baremetal". I pip installed python-openstackclient and python-ironicclient[cli] (and then a few others), but I get "WARNING: Failed to import plugin baremetal." Does anybody know the appropriate packages to install? | 21:48 |
| dking_desktop | I had it working on a different virtualenv, and it may still work there, but I'd like to figure out what I did wrong on this one. | 21:49 |
| openstackgerrit | khansa proposed openstack/sushy-cli master: Add system boot device/mode commands https://review.opendev.org/706392 | 21:51 |
| openstackgerrit | khansa proposed openstack/sushy-cli master: Add system boot device/mode commands https://review.opendev.org/706392 | 21:54 |
| *** dsneddon has joined #openstack-ironic | 21:59 | |
| *** rcernin has joined #openstack-ironic | 22:07 | |
| TheJulia | dking_desktop: that should be it... | 22:10 |
| TheJulia | did you install the whole of python- ironicclient ? | 22:11 |
| TheJulia | basically openstack cli searches python entrypoints for additional commands and loads the plugin from there | 22:11 |
| TheJulia | it wouldn't know about the command if it couldn't find the plugin... so that seems very odd | 22:12 |
| dking_desktop | Yeah. For now, I just went back to the old virtualenv where it's working. | 22:12 |
| dking_desktop | And I got a node to boot up the newly built ironic-python-agent images. However, I'm getting an error that there's no module named "ipaddress". Do you know where in the code I could find the list of modules the builder installs? I was hoping to see if it's not listed there, or if it helps to manually add it. | 22:14 |
| TheJulia | no module named ipaddress | 22:16 |
| TheJulia | that sounds like.... | 22:16 |
| TheJulia | err | 22:16 |
| dking_desktop | from ironic_python_agent/agent.py line 16: "import ipaddress" | 22:16 |
| TheJulia | its an stock python library | 22:17 |
| TheJulia | added in python 3.3 | 22:17 |
| TheJulia | are you using centos7? | 22:17 |
| TheJulia | or centos8? | 22:17 |
| TheJulia | i bet the centos7 one just needs to go *poof* | 22:19 |
| dking_desktop | Oh. I wonder if it's a version mismatch. The full path is "/opt/ironic-python-agent/lib/python2.7/site-packages/ironic_python_agent/agent.py". | 22:19 |
| dking_desktop | centos-minimal | 22:19 |
| dking_desktop | I was using Python 3.6 in a virtualenv to do the build using command: "disk-image-create -o ironic-agent ironic-python-agent-ramdisk centos-minimal" | 22:20 |
| dking_desktop | Which was the distro I would have chosen, anyway, but it was actually listed as the example command on the online documentation. | 22:20 |
| *** bfournie has quit IRC | 22:29 | |
| *** rh-jelabarre has quit IRC | 22:31 | |
| openstackgerrit | Julia Kreger proposed openstack/ironic-inspector master: Change CoreOS to Centos for IPA https://review.opendev.org/707174 | 22:37 |
| *** jdandrea has quit IRC | 22:37 | |
| *** jdandrea has joined #openstack-ironic | 22:39 | |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: Enable agent_token for virtual media boot https://review.opendev.org/697584 | 22:41 |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: Send our token back to the agent https://review.opendev.org/697585 | 22:41 |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: Signal agent token is required https://review.opendev.org/699304 | 22:41 |
| *** iurygregory has quit IRC | 22:52 | |
| TheJulia | so, the diskimage-builder ironic-agent element is deprecated, fwiw | 23:14 |
| openstackgerrit | Merged openstack/sushy master: Relax required Redfish fields handling https://review.opendev.org/703825 | 23:14 |
| TheJulia | env DIB_PYTHON_VERSION=3 disk-image-create blah | 23:14 |
| TheJulia | ironic-python-agent-builder -e <extra-element> --release 8 centos-minimal <-- should do the right thing wrapping and calling diskimage-builder's disk-image-create | 23:16 |
| *** mmethot has joined #openstack-ironic | 23:46 | |
| *** igordc has quit IRC | 23:46 | |
| *** jdandrea has quit IRC | 23:48 | |
| *** rcernin has quit IRC | 23:51 | |
| *** bfournie has joined #openstack-ironic | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!