| *** ijw has quit IRC | 00:00 | |
| *** yangyapeng has quit IRC | 00:22 | |
| *** yangyapeng has joined #openstack-ironic | 00:23 | |
| *** yangyapeng has quit IRC | 00:27 | |
| *** rbudden has joined #openstack-ironic | 00:54 | |
| *** harlowja has joined #openstack-ironic | 00:54 | |
| *** ijw has joined #openstack-ironic | 00:56 | |
| *** ijw has quit IRC | 00:57 | |
| *** ijw has joined #openstack-ironic | 00:58 | |
| *** ijw has quit IRC | 01:00 | |
| *** ijw has joined #openstack-ironic | 01:00 | |
| *** ijw has quit IRC | 01:01 | |
| *** ijw has joined #openstack-ironic | 01:02 | |
| *** ijw has quit IRC | 01:03 | |
| *** ijw has joined #openstack-ironic | 01:04 | |
| *** zhangfei has joined #openstack-ironic | 01:04 | |
| *** phuongnh has joined #openstack-ironic | 01:05 | |
| *** ijw has quit IRC | 01:09 | |
| *** ijw has joined #openstack-ironic | 01:09 | |
| *** ijw has quit IRC | 01:10 | |
| *** ijw has joined #openstack-ironic | 01:12 | |
| *** ijw has quit IRC | 01:12 | |
| *** ijw has joined #openstack-ironic | 01:13 | |
| *** yangyapeng has joined #openstack-ironic | 01:13 | |
| *** ijw has quit IRC | 01:14 | |
| *** ijw has joined #openstack-ironic | 01:16 | |
| *** ijw has quit IRC | 01:18 | |
| *** zhangfei has quit IRC | 01:18 | |
| *** ijw has joined #openstack-ironic | 01:21 | |
| *** AlexeyAbashkin has joined #openstack-ironic | 01:22 | |
| *** ijw has quit IRC | 01:22 | |
| *** ijw has joined #openstack-ironic | 01:22 | |
| *** ijw has quit IRC | 01:24 | |
| *** ijw has joined #openstack-ironic | 01:25 | |
| *** ijw has quit IRC | 01:26 | |
| *** AlexeyAbashkin has quit IRC | 01:27 | |
| *** ijw has joined #openstack-ironic | 01:27 | |
| *** ijw has quit IRC | 01:28 | |
| *** ijw has joined #openstack-ironic | 01:30 | |
| *** ijw has quit IRC | 01:31 | |
| *** ijw has joined #openstack-ironic | 01:31 | |
| *** zhangfei has joined #openstack-ironic | 01:32 | |
| *** ijw has quit IRC | 01:33 | |
| *** ijw has joined #openstack-ironic | 01:34 | |
| *** ijw has quit IRC | 01:38 | |
| *** ijw has joined #openstack-ironic | 01:38 | |
| *** ijw has quit IRC | 01:39 | |
| *** ijw has joined #openstack-ironic | 01:41 | |
| *** ijw has quit IRC | 01:42 | |
| *** ijw has joined #openstack-ironic | 01:43 | |
| *** ijw has quit IRC | 01:44 | |
| *** ijw has joined #openstack-ironic | 01:45 | |
| *** ijw has quit IRC | 01:47 | |
| *** ijw has joined #openstack-ironic | 01:47 | |
| *** ijw has quit IRC | 01:48 | |
| *** gcb has joined #openstack-ironic | 01:48 | |
| *** ijw has joined #openstack-ironic | 01:49 | |
| *** ijw has quit IRC | 01:51 | |
| *** ijw has joined #openstack-ironic | 01:52 | |
| *** gregwork has quit IRC | 01:53 | |
| *** betherly has quit IRC | 01:53 | |
| *** gregwork has joined #openstack-ironic | 01:54 | |
| *** ijw has quit IRC | 01:55 | |
| *** ijw has joined #openstack-ironic | 01:55 | |
| *** betherly has joined #openstack-ironic | 01:55 | |
| *** ijw has quit IRC | 01:56 | |
| *** ijw has joined #openstack-ironic | 01:58 | |
| *** namnh has joined #openstack-ironic | 02:01 | |
| *** ijw has quit IRC | 02:01 | |
| *** ijw has joined #openstack-ironic | 02:01 | |
| *** ijw has quit IRC | 02:02 | |
| *** ijw has joined #openstack-ironic | 02:03 | |
| *** ijw has quit IRC | 02:04 | |
| *** ijw has joined #openstack-ironic | 02:05 | |
| *** ijw has quit IRC | 02:07 | |
| *** ijw has joined #openstack-ironic | 02:07 | |
| *** ijw has quit IRC | 02:08 | |
| *** ijw has joined #openstack-ironic | 02:09 | |
| *** ijw has quit IRC | 02:11 | |
| *** ijw has joined #openstack-ironic | 02:12 | |
| *** ijw has quit IRC | 02:23 | |
| *** ijw has joined #openstack-ironic | 02:23 | |
| *** ijw has quit IRC | 02:24 | |
| *** ijw has joined #openstack-ironic | 02:26 | |
| *** ijw has quit IRC | 02:27 | |
| *** ijw has joined #openstack-ironic | 02:28 | |
| *** ijw has quit IRC | 02:29 | |
| *** ijw has joined #openstack-ironic | 02:30 | |
| *** ijw has quit IRC | 02:32 | |
| *** ijw has joined #openstack-ironic | 02:33 | |
| *** ijw has quit IRC | 02:36 | |
| *** ijw has joined #openstack-ironic | 02:36 | |
| *** ijw has quit IRC | 02:37 | |
| *** harlowja has quit IRC | 02:41 | |
| *** ijw has joined #openstack-ironic | 02:41 | |
| *** ijw has quit IRC | 02:42 | |
| *** gcb has quit IRC | 02:42 | |
| *** gcb has joined #openstack-ironic | 02:44 | |
| *** rbudden has quit IRC | 02:44 | |
| *** v12aml has quit IRC | 02:51 | |
| *** v12aml has joined #openstack-ironic | 03:00 | |
| *** dpawar has joined #openstack-ironic | 03:05 | |
| *** harlowja has joined #openstack-ironic | 03:33 | |
| *** ramineni has quit IRC | 03:41 | |
| *** ijw has joined #openstack-ironic | 03:43 | |
| *** ijw has quit IRC | 03:44 | |
| *** ramineni has joined #openstack-ironic | 03:58 | |
| *** dpawar has quit IRC | 04:16 | |
| *** ramineni has quit IRC | 04:24 | |
| *** harlowja has quit IRC | 04:24 | |
| *** mikal has quit IRC | 04:29 | |
| *** mikal has joined #openstack-ironic | 04:30 | |
| *** ijw has joined #openstack-ironic | 04:45 | |
| *** AlexeyAbashkin has joined #openstack-ironic | 04:46 | |
| *** AlexeyAbashkin has quit IRC | 04:50 | |
| *** ijw has quit IRC | 04:50 | |
| *** gcb has quit IRC | 04:57 | |
| *** phuongnh has quit IRC | 05:21 | |
| *** phuongnh has joined #openstack-ironic | 05:22 | |
| *** dpawar has joined #openstack-ironic | 05:24 | |
| *** gcb has joined #openstack-ironic | 05:40 | |
| *** ijw has joined #openstack-ironic | 05:47 | |
| *** ijw has quit IRC | 05:52 | |
| *** ijw has joined #openstack-ironic | 06:48 | |
| *** ijw has quit IRC | 06:49 | |
| *** jaganathan has joined #openstack-ironic | 06:57 | |
| *** mjura has joined #openstack-ironic | 07:01 | |
| *** trungnv has joined #openstack-ironic | 07:09 | |
| *** crushil_ has joined #openstack-ironic | 07:18 | |
| *** crushil has joined #openstack-ironic | 07:18 | |
| *** e0ne has joined #openstack-ironic | 07:22 | |
| pas-ha | now this is strange.. I presumed that the playbooks for the job would be taken from appropriate branch (otherwise why would we add them to all stable branches)... | 07:25 |
|---|---|---|
| pas-ha | but here http://logs.openstack.org/40/529640/3/check/ironic-dsvm-standalone-pike/4b3908f/logs/local.conf.txt.gz it obviously takes the playbook from master (from here acually) https://review.openstack.org/#/c/529383/) | 07:26 |
| patchbot | patch 529383 - ironic - Setup ansible interface in devstack | 07:26 |
| pas-ha | since it added 'ansible' to enabled_deploy_interfaces that only that change to master does | 07:27 |
| pas-ha | or is it due to depends-on? if so, how are we supposed to test changes when both ironic change and tempest plugin change are required? | 07:28 |
| *** e0ne has quit IRC | 07:33 | |
| *** phuongnh has quit IRC | 07:47 | |
| *** ijw has joined #openstack-ironic | 07:50 | |
| *** ijw has quit IRC | 07:51 | |
| *** trungnv has quit IRC | 07:57 | |
| *** serlex has joined #openstack-ironic | 08:06 | |
| *** e0ne has joined #openstack-ironic | 08:20 | |
| *** AlexeyAbashkin has joined #openstack-ironic | 08:23 | |
| *** e0ne has quit IRC | 08:25 | |
| *** ijw has joined #openstack-ironic | 08:52 | |
| *** ijw has quit IRC | 08:53 | |
| *** baoli has joined #openstack-ironic | 09:05 | |
| *** lucas-afk is now known as lucasagomes | 09:41 | |
| *** gcb has quit IRC | 09:45 | |
| *** ijw has joined #openstack-ironic | 09:53 | |
| *** ijw has quit IRC | 09:55 | |
| *** crushil__ has joined #openstack-ironic | 09:55 | |
| *** crushil_ has quit IRC | 09:59 | |
| *** crushil has quit IRC | 09:59 | |
| *** crushil has joined #openstack-ironic | 10:00 | |
| *** mgoddard has joined #openstack-ironic | 10:02 | |
| *** crushil__ has quit IRC | 10:13 | |
| *** namnh has quit IRC | 10:14 | |
| *** crushil has quit IRC | 10:14 | |
| *** mjura has quit IRC | 10:15 | |
| *** MattMan_1 has quit IRC | 10:16 | |
| *** MattMan_1 has joined #openstack-ironic | 10:16 | |
| *** e0ne has joined #openstack-ironic | 10:54 | |
| *** ijw has joined #openstack-ironic | 10:55 | |
| *** ijw has quit IRC | 10:56 | |
| openstackgerrit | Pavlo Shchelokovskyy proposed openstack/ironic master: Setup ansible interface in devstack https://review.openstack.org/529383 | 11:09 |
| *** AlexeyAbashkin has quit IRC | 11:28 | |
| *** AlexeyAbashkin has joined #openstack-ironic | 11:29 | |
| *** jaganathan has quit IRC | 11:49 | |
| *** ijw has joined #openstack-ironic | 11:57 | |
| openstackgerrit | Mark Goddard proposed openstack/networking-generic-switch master: Add physical network awareness https://review.openstack.org/524178 | 12:01 |
| *** ijw has quit IRC | 12:03 | |
| *** mgoddard has quit IRC | 12:09 | |
| *** jaganathan has joined #openstack-ironic | 12:16 | |
| *** amarao has joined #openstack-ironic | 12:18 | |
| *** jaganathan has quit IRC | 12:23 | |
| *** amarao has quit IRC | 12:26 | |
| *** yangyapeng has quit IRC | 12:40 | |
| *** yangyapeng has joined #openstack-ironic | 12:41 | |
| *** yangyapeng has quit IRC | 12:48 | |
| *** lucasagomes is now known as lucas-hungry | 12:52 | |
| *** ijw has joined #openstack-ironic | 12:59 | |
| *** ijw has quit IRC | 13:04 | |
| *** jistr has quit IRC | 13:14 | |
| *** yangyapeng has joined #openstack-ironic | 13:15 | |
| *** jistr has joined #openstack-ironic | 13:16 | |
| *** dpawar has quit IRC | 13:18 | |
| *** zhangfei has quit IRC | 13:20 | |
| *** jlabarre has joined #openstack-ironic | 13:24 | |
| *** dpawar has joined #openstack-ironic | 13:25 | |
| *** baoli has quit IRC | 13:30 | |
| serlex | hi, any way to relaunch provisioning after "deploy failed"? | 13:30 |
| *** baoli has joined #openstack-ironic | 13:30 | |
| *** zhangfei has joined #openstack-ironic | 13:32 | |
| *** baoli has quit IRC | 13:33 | |
| *** baoli has joined #openstack-ironic | 13:34 | |
| *** rbudden has joined #openstack-ironic | 13:35 | |
| *** baoli_ has joined #openstack-ironic | 13:58 | |
| *** ijw has joined #openstack-ironic | 14:00 | |
| *** baoli has quit IRC | 14:01 | |
| jroll | pas-ha: morning! seems you've found a couple odd edge cases eh | 14:02 |
| jroll | (now it's, how do we test new drivers on master but not on stable) | 14:02 |
| *** lucas-hungry is now known as lucasagomes | 14:03 | |
| jroll | I guess we could do a GET /v1/drivers there and only run the test if ansible exists - that will make the most sense for downstream consumers too as it will always work whether they have that driver enabled or not | 14:03 |
| jroll | oh neat, we have a skip_checks method exactly for that \o/ | 14:04 |
| jroll | good question on how to deal with depends-on though, hrm | 14:07 |
| *** ijw has quit IRC | 14:07 | |
| *** zhangfei has quit IRC | 14:17 | |
| *** baoli has joined #openstack-ironic | 14:33 | |
| *** zhangfei has joined #openstack-ironic | 14:33 | |
| *** baoli_ has quit IRC | 14:33 | |
| *** baoli has quit IRC | 14:37 | |
| *** baoli has joined #openstack-ironic | 14:38 | |
| *** SerenaFeng has joined #openstack-ironic | 14:41 | |
| *** dpawar has quit IRC | 14:42 | |
| pas-ha | jroll, morning | 14:44 |
| jroll | \o | 14:45 |
| pas-ha | jroll: actually not sure if this is a right way to do it - I mean to auto-detect of stuff in tempest. It still should be coupled with the config options for tempest plugin tho | 14:45 |
| pas-ha | like it is for services enabled | 14:45 |
| pas-ha | that is you deploy, set expectations on what was deployed and run tests | 14:45 |
| jroll | pas-ha: ah, so it would catch the case where you intend to have a working ansible driver, but forgot to enable it in ironic? | 14:46 |
| pas-ha | tests should not be skipped if something you wanted/expected to be deployed is not there - they must fail | 14:46 |
| jroll | right, gotcha | 14:46 |
| jroll | I'm not opposed to that | 14:47 |
| pas-ha | what could be done is dunno, again as services enabled in tempest - the list of 'features' (==drivers) to test must be the same as enabled ones (sans fake) | 14:48 |
| jroll | yep, that makes sense | 14:48 |
| *** baoli has quit IRC | 14:49 | |
| pas-ha | not sure if we can plug into tempest-verify from a plugin though, but at least a separate test for that might be good | 14:49 |
| jroll | could be nice, agree | 14:51 |
| *** serlex has quit IRC | 15:03 | |
| *** ijw has joined #openstack-ironic | 15:03 | |
| *** ijw has quit IRC | 15:05 | |
| *** livelace-link has joined #openstack-ironic | 15:12 | |
| *** livelace-link has quit IRC | 15:15 | |
| *** livelace-link has joined #openstack-ironic | 15:17 | |
| jroll | pas-ha: re your comment about skip_checks being run, looks like it only checks enabled drivers/hardware types, not deploy interfaces | 15:30 |
| jroll | https://github.com/openstack/ironic/blob/master/ironic_tempest_plugin/tests/scenario/baremetal_standalone_manager.py#L298 | 15:30 |
| jroll | oh, you changed that | 15:30 |
| jroll | ignore me | 15:30 |
| jroll | ahhhh | 15:31 |
| jroll | https://review.openstack.org/#/c/529639/1/ironic_tempest_plugin/tests/scenario/baremetal_standalone_manager.py@316 | 15:31 |
| patchbot | patch 529639 - ironic-tempest-plugin - Add ability to set deploy interface | 15:31 |
| jroll | sneaky little bug | 15:31 |
| pas-ha | got ya! :) | 15:39 |
| openstackgerrit | Pavlo Shchelokovskyy proposed openstack/ironic-tempest-plugin master: Add ability to set deploy interface https://review.openstack.org/529639 | 15:40 |
| openstackgerrit | Pavlo Shchelokovskyy proposed openstack/ironic-tempest-plugin master: Add ansible deploy interface test https://review.openstack.org/529640 | 15:40 |
| pas-ha | thanks Jim :) | 15:41 |
| jroll | :D | 15:41 |
| jroll | no problem | 15:41 |
| *** AlexeyAbashkin has quit IRC | 15:58 | |
| *** SerenaFeng has quit IRC | 15:58 | |
| *** zhangfei has quit IRC | 16:00 | |
| *** ijw has joined #openstack-ironic | 16:05 | |
| *** ijw has quit IRC | 16:06 | |
| *** e0ne has quit IRC | 16:19 | |
| *** lucasagomes is now known as lucas-afk | 16:45 | |
| *** ijw has joined #openstack-ironic | 17:07 | |
| *** ijw has quit IRC | 17:12 | |
| *** AlexeyAbashkin has joined #openstack-ironic | 17:27 | |
| *** AlexeyAbashkin has quit IRC | 17:31 | |
| *** e0ne has joined #openstack-ironic | 17:43 | |
| *** e0ne has quit IRC | 17:46 | |
| *** mgoddard has joined #openstack-ironic | 18:03 | |
| *** ijw has joined #openstack-ironic | 18:08 | |
| *** ijw has quit IRC | 18:10 | |
| *** etingof has quit IRC | 18:33 | |
| *** etingof has joined #openstack-ironic | 18:35 | |
| *** dyasny has quit IRC | 18:43 | |
| *** ijw has joined #openstack-ironic | 18:46 | |
| *** mdorman has joined #openstack-ironic | 19:02 | |
| mdorman | i am having an issue with bifrost, rabbitmq is failing to start in the bifrost-deploy container because epmd | 19:02 |
| mdorman | @0.0.0.0 is failing to start via systemd. anybody seen this before? i can get rmq running just fine if i start it outside of systemd. | 19:03 |
| TheJulia | mdorman: I've not seen that, seems odd that when starting via systemd that it is failing. It would be good to file a bug I guess to detail so we can try to reproduce | 19:08 |
| TheJulia | mdorman: I wonder if it something to do with rabbitmq's perception of hostname | 19:08 |
| mdorman | yeah i'm running it down. i am pretty sure it's a problem with epmd's interaction with teh systemd socket. when i run epmd manually after starting the socket in systemd, it says systemd isn't providing any sockets. | 19:08 |
| mdorman | i thought it was hostname stuff, too, but after going down that road i'm fairly certain that's not it. | 19:09 |
| TheJulia | anything getting logged when trying to start with systemd? | 19:11 |
| mdorman | not really. i'm trying to get it to log more verbosely now. this is all i get so far: https://gist.github.com/misterdorm/f3e16b277ea1395af38264ffd5e6861b | 19:13 |
| TheJulia | interesting... | 19:24 |
| TheJulia | and epmd definitely not running? | 19:24 |
| TheJulia | I have run into weird issues with epmd not starting because it was already started and doesn't exit when rabbitmq is stopped, but that was a long long time ago | 19:29 |
| mdorman | yeah, definitely not running. | 19:34 |
| *** aweeks has quit IRC | 19:39 | |
| mdorman | i'm sure this is something dumb and will be super obvious once i figure it out | 19:39 |
| TheJulia | maybe systemd just needs a cup of coffee? or a nap? | 19:45 |
| mdorman | TheJulia: figured it out | 19:46 |
| TheJulia | \o/ | 19:46 |
| mdorman | LimitNPROC=1 in the epmd.service unit file. but systemd spawns some other stuff, namely '/usr/bin/systemd-tty-ask-password-agent watch' (which was the only one i was actually able to observe), first, so spawning epmd after that exceeds the max nprocs. not sure what the logic of setting it to 1 is. but when i set it to at least 7 then it works just fine. | 19:54 |
| TheJulia | fun | 20:01 |
| mdorman | that build of erlang is coming from the centos-openstack-pike repo, but as far as i can tell that LimitNPROC=1 is there in the upstream redhat build of erlang as well. | 20:03 |
| *** dyasny has joined #openstack-ironic | 20:18 | |
| *** mgoddard has quit IRC | 20:19 | |
| mdorman | introduced here, I think. https://src.fedoraproject.org/rpms/erlang/c/aa1f4058788a077c37988c03230a47667b4089d5 although i still don't really see the point of limiting it to 1. | 20:28 |
| TheJulia | Two seems reasonable for the launch... although curious that the password agent would also be fired up :\ | 20:40 |
| mdorman | yeah i donno. i was not able to get it to work with a value less than 7. | 20:46 |
| *** e0ne has joined #openstack-ironic | 20:53 | |
| *** e0ne_ has joined #openstack-ironic | 21:02 | |
| *** e0ne_ has quit IRC | 21:05 | |
| *** e0ne has quit IRC | 21:13 | |
| *** e0ne has joined #openstack-ironic | 21:15 | |
| *** e0ne has quit IRC | 21:22 | |
| *** baoli has joined #openstack-ironic | 21:52 | |
| *** baoli has quit IRC | 21:52 | |
| mdorman | so this gets more "fun", but also more satisfying to have figured it out. the uid of the epmd user in the docker container was the same as the polkit user on the host. polkitd is running (on the host), with 6 threads. LimitNPROC sets the proc limit on the user id, which is not namespaced in the container. so normally that limit of 1 proc would be appropriate, except in this case where the uid happened to overlap and that | 22:04 |
| mdorman | had procs running on the host already. | 22:04 |
| mdorman | so that's why it only worked for me if i set the limit to >6 in the container. when i rejiggered the uids then it all works as expected with LimitNPROC=1 | 22:04 |
| *** rbudden has quit IRC | 22:16 | |
| *** rbudden has joined #openstack-ironic | 22:17 | |
| *** AlexeyAbashkin has joined #openstack-ironic | 22:21 | |
| *** rbudden has quit IRC | 22:24 | |
| *** AlexeyAbashkin has quit IRC | 22:25 | |
| *** rbudden has joined #openstack-ironic | 22:48 | |
| *** e0ne has joined #openstack-ironic | 23:07 | |
| *** e0ne has quit IRC | 23:09 | |
| *** Faster-Fanboi has joined #openstack-ironic | 23:57 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!