| *** dtrainor has quit IRC | 00:13 | |
| *** dsariel has quit IRC | 00:15 | |
| *** dmarlin_ has quit IRC | 00:28 | |
| *** dmacpher has joined #tripleo | 00:39 | |
| *** limao has joined #tripleo | 00:42 | |
| *** mhenkel has joined #tripleo | 01:10 | |
| *** mhenkel has quit IRC | 01:14 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Decouple swift-proxy from ceilometer https://review.openstack.org/409445 | 01:31 |
|---|---|---|
| openstackgerrit | Dan Prince proposed openstack/puppet-tripleo: Decouple swift-proxy from ceilometer packages https://review.openstack.org/409022 | 01:31 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates: Use the local collector to bootstrap deployed servers https://review.openstack.org/405032 | 02:30 |
| openstackgerrit | Steve Baker proposed openstack/tripleo-heat-templates: docker: expose agent mounts as template param https://review.openstack.org/409579 | 02:30 |
| *** cwolferh has quit IRC | 02:37 | |
| *** fragatina has joined #tripleo | 02:41 | |
| *** fragatina has quit IRC | 02:55 | |
| *** fragatina has joined #tripleo | 02:56 | |
| *** dtrainor has joined #tripleo | 02:58 | |
| *** fragatina has quit IRC | 03:11 | |
| *** cwolferh has joined #tripleo | 03:20 | |
| *** fragatina has joined #tripleo | 03:22 | |
| *** trozet has quit IRC | 03:46 | |
| *** sudipto has joined #tripleo | 03:53 | |
| *** nmathew has joined #tripleo | 04:09 | |
| *** noslzzp has quit IRC | 04:15 | |
| *** saneax-_-|AFK is now known as saneax | 04:23 | |
| *** udesale has joined #tripleo | 04:25 | |
| *** dmacpher has quit IRC | 05:08 | |
| *** dtrainor has quit IRC | 05:08 | |
| *** cwolferh has quit IRC | 05:12 | |
| *** Vijayendra has joined #tripleo | 05:14 | |
| *** numans has joined #tripleo | 05:19 | |
| *** dtrainor has joined #tripleo | 05:27 | |
| *** prateek has joined #tripleo | 05:28 | |
| *** numans has quit IRC | 05:31 | |
| *** bvandenh has quit IRC | 05:32 | |
| *** numans has joined #tripleo | 05:32 | |
| *** fragatina has quit IRC | 05:32 | |
| *** oshvartz has quit IRC | 05:37 | |
| *** fragatina has joined #tripleo | 05:42 | |
| *** dtrainor has quit IRC | 05:51 | |
| *** skramaja has joined #tripleo | 05:59 | |
| *** lifeless_ has quit IRC | 06:02 | |
| *** fragatina has quit IRC | 06:02 | |
| *** lifeless has joined #tripleo | 06:03 | |
| *** masco has joined #tripleo | 06:05 | |
| *** bkopilov_ has joined #tripleo | 06:15 | |
| *** bkopilov has quit IRC | 06:15 | |
| *** yamahata has joined #tripleo | 06:15 | |
| *** bkopilov_ is now known as bkopilov | 06:15 | |
| *** openstackgerrit_ has joined #tripleo | 06:23 | |
| *** jaosorior has joined #tripleo | 06:23 | |
| *** openstackgerrit_ has quit IRC | 06:25 | |
| *** openstackgerrit_ has joined #tripleo | 06:26 | |
| *** openstackgerrit_ has quit IRC | 06:27 | |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-common: Pin docutils version https://review.openstack.org/409630 | 06:34 |
| *** openstackgerrit_ has joined #tripleo | 06:34 | |
| *** mhenkel has joined #tripleo | 06:34 | |
| *** openstackgerrit_ has quit IRC | 06:35 | |
| *** mhenkel has quit IRC | 06:38 | |
| *** iranzo has joined #tripleo | 06:42 | |
| jaosorior | marios: hey dude, could you check this out again https://review.openstack.org/#/c/407999/ ? I removed the script you had commented on and put it in a separate patch to tripleo-common | 06:47 |
| marios | jaosorior: will do | 06:48 |
| *** lmiccini has joined #tripleo | 06:49 | |
| *** oshvartz has joined #tripleo | 06:53 | |
| *** dsariel has joined #tripleo | 06:57 | |
| *** yolanda has joined #tripleo | 06:58 | |
| *** openstackgerrit_ has joined #tripleo | 06:59 | |
| *** openstackgerrit_ has quit IRC | 07:00 | |
| *** florianf has joined #tripleo | 07:01 | |
| *** ramishra has quit IRC | 07:02 | |
| *** iranzo_ has joined #tripleo | 07:03 | |
| *** ramishra has joined #tripleo | 07:04 | |
| *** iranzo has quit IRC | 07:04 | |
| *** iranzo_ is now known as iranzo | 07:04 | |
| *** bvandenh has joined #tripleo | 07:07 | |
| *** ebarrera has joined #tripleo | 07:17 | |
| *** bvandenh has quit IRC | 07:19 | |
| *** ebarrera has quit IRC | 07:35 | |
| *** cwolferh has joined #tripleo | 07:37 | |
| *** jaosorior has quit IRC | 07:40 | |
| *** ccamacho has joined #tripleo | 07:41 | |
| *** jprovazn has joined #tripleo | 07:42 | |
| ccamacho | Morning TripleOers! | 07:44 |
| *** yprokule has joined #tripleo | 07:46 | |
| *** abehl has joined #tripleo | 07:48 | |
| *** mcornea has joined #tripleo | 07:49 | |
| *** abregman has joined #tripleo | 07:51 | |
| *** pgadiya has joined #tripleo | 07:54 | |
| *** udesale has quit IRC | 07:57 | |
| *** tremble has joined #tripleo | 07:58 | |
| *** hjensas has joined #tripleo | 07:59 | |
| *** hjensas has joined #tripleo | 07:59 | |
| *** jaosorior has joined #tripleo | 08:00 | |
| jaosorior | sshnaidm|away: you around? | 08:01 |
| *** rasca has joined #tripleo | 08:02 | |
| *** tremble has quit IRC | 08:03 | |
| *** fzdarsky has joined #tripleo | 08:04 | |
| ccamacho | jaosorior morning! | 08:05 |
| ccamacho | dude your reviews were merged/abandoned when I was going to check them last week, do you have something for checking this morning? | 08:06 |
| *** fzdarsky has joined #tripleo | 08:06 | |
| jaosorior | ccamacho: which reviews? | 08:08 |
| *** nyechiel has joined #tripleo | 08:09 | |
| *** morazi has quit IRC | 08:09 | |
| *** fzdarsky has quit IRC | 08:10 | |
| jaosorior | ccamacho: well, these two are the most important ones right now https://review.openstack.org/#/c/407999/ https://review.openstack.org/#/c/409165/ as they enable the CI job https://review.openstack.org/#/c/391738/ | 08:10 |
| ccamacho | jaosorior https://review.openstack.org/#/c/407891/ & https://review.openstack.org/#/c/327473/ | 08:10 |
| *** tremble has joined #tripleo | 08:11 | |
| *** flaper87 has quit IRC | 08:11 | |
| jaosorior | ccamacho: they used to run in the CI job, however, we can't run them at the moment because I moved the enrollment environment generator to tripleo cI, so now that patch has to merge, then we have to merge the addition of that script to the package's spec (in the RDO repo) and then we'll be able to run it again on CI | 08:11 |
| *** flaper87 has joined #tripleo | 08:11 | |
| ccamacho | ack, Ill check those right now | 08:13 |
| sshnaidm|away | jaosorior, hi | 08:13 |
| *** sshnaidm|away is now known as sshnaidm | 08:13 | |
| marios | ccamacho: o/ hey man was trying to ping you last week but realised you are away | 08:14 |
| marios | ccamacho: s/are/were | 08:14 |
| marios | ccamacho: can you checkout https://review.openstack.org/#/c/408631/ when you get a chance | 08:14 |
| ccamacho | marios morning, I was partially alive :P sure | 08:14 |
| marios | jaosorior: can you have a look at https://review.openstack.org/#/c/399708/ when you get a chance please | 08:14 |
| marios | ccamacho: i was thinking we could do an upgrades squad sync this week with shardy matbu chem and anyone else interested | 08:15 |
| jaosorior | marios: yessir | 08:15 |
| marios | ccamacho: this was just me trying to find something to add for the composable upgrades stuff after finally winding down on the 10 stuff | 08:16 |
| ccamacho | marios, awesome just one thing, since 2 weeks ago I lost the invite to the meeting, not sure If your are still doing them | 08:16 |
| marios | ccamacho: i think it makes sense to do that stuff (checks before the upgrade init) but we can talk about it some more ... also it depends on matbus patch which adds the ansible pacemaker module | 08:17 |
| *** ealcaniz has joined #tripleo | 08:18 | |
| *** fzdarsky has joined #tripleo | 08:18 | |
| *** fzdarsky has quit IRC | 08:18 | |
| *** hewbrocca_afk is now known as hewbrocca | 08:19 | |
| jaosorior | sshnaidm: hey dude, do you know what's going on with the OVB gate? Seems that it's failing to allocate environments every time :/ | 08:19 |
| hewbrocca | Morning folks | 08:20 |
| *** jlinkes has joined #tripleo | 08:20 | |
| sshnaidm | jaosorior, yeah, looking now, it's completely down.. | 08:20 |
| jaosorior | :( | 08:21 |
| sshnaidm | have you seen such errors before? http://paste.openstack.org/show/592066/ | 08:22 |
| jaosorior | I haven't | 08:23 |
| *** dsariel has quit IRC | 08:23 | |
| sshnaidm | I found some bug about openswitch with such error messages, but it's old.. | 08:23 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-common: Add FreeIPA enrollment environment generator https://review.openstack.org/409165 | 08:27 |
| *** aufi has joined #tripleo | 08:28 | |
| *** dsneddon__ has joined #tripleo | 08:30 | |
| *** pcaruana has joined #tripleo | 08:30 | |
| *** dsneddon__ is now known as dsneddon | 08:30 | |
| *** amoralej|off is now known as amoralej | 08:31 | |
| jaosorior | marios: commented on your patch | 08:32 |
| marios | jaosorior: thank you sir | 08:33 |
| *** jlinkes has quit IRC | 08:33 | |
| *** kodokuu has joined #tripleo | 08:34 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata https://review.openstack.org/404831 | 08:35 |
| *** pcaruana has quit IRC | 08:37 | |
| jaosorior | marios: yeah, basically my only remaining question is for this file https://review.openstack.org/#/c/399708/4/extraconfig/tasks/major_upgrade_compute.sh your commentw as a bit confusing | 08:37 |
| marios | jaosorior: (yah just replied but didn't publish yet sec ( | 08:38 |
| *** pcaruana has joined #tripleo | 08:38 | |
| jaosorior | marios: the other comment was a confusion on my side; it's fine in pacemaker_common_functions.sh | 08:38 |
| *** owalsh has joined #tripleo | 08:39 | |
| *** tremble has quit IRC | 08:40 | |
| *** owalsh has quit IRC | 08:40 | |
| *** owalsh has joined #tripleo | 08:40 | |
| marios | jaosorior: k thanks just replied when you get another pass | 08:40 |
| *** tremble has joined #tripleo | 08:41 | |
| ccamacho | hey marios, related to https://review.openstack.org/#/c/403441/ I was testing the upgrade scripts in that submission (Will abandone it later) I was checking if the ansible hook was actually working and it works correctly. So I want to check now matbu's patches | 08:43 |
| *** arxcruz has joined #tripleo | 08:44 | |
| openstackgerrit | Flavio Percoco proposed openstack/puppet-tripleo: Sync the db as part of the glance-api install https://review.openstack.org/408163 | 08:44 |
| marios | ccamacho: ack thanks makes sense... i wasn't sure about trying to invoke those .sh.1/2/3 scripts like that | 08:44 |
| openstackgerrit | Dirk Mueller proposed openstack/diskimage-builder: Switch to openSUSE Leap 42.2 release by default https://review.openstack.org/409071 | 08:45 |
| *** jpena|off is now known as jpena | 08:45 | |
| jaosorior | marios: why not move that function to a common_functions.sh, and add it to the needed SoftwareConfigs? like you do in https://review.openstack.org/#/c/399708/4/extraconfig/tasks/yum_update.yaml | 08:50 |
| *** paramite has joined #tripleo | 08:51 | |
| marios | jaosorior: the problem is we are writing out the function definition for the non controllers (i.e. we write out the upgrade script in the heredoc) but we don't invoke it .. the operator will do that later | 08:55 |
| *** jpena is now known as jpena|off | 08:56 | |
| marios | jaosorior: so here https://review.openstack.org/#/c/399708/4/extraconfig/tasks/major_upgrade_compute.sh ... we *could* maybe deliver _another_ script with the common function but i feel that will be messy/worse than having to repeat the function | 08:57 |
| jaosorior | oh damn | 08:57 |
| jaosorior | I see your point now | 08:57 |
| marios | jaosorior: so this is a slight improvement now anyway in that at least we do use a common definition where we can do | 08:58 |
| jaosorior | right | 08:58 |
| jaosorior | yeah | 08:58 |
| jaosorior | that makes sense | 08:58 |
| jaosorior | ok, I'm fine with it then | 08:59 |
| jaosorior | marios: +2 | 08:59 |
| jaosorior | sshnaidm: anything I can help with to deal with the CI issues? | 09:00 |
| marios | thanks for taking the time jaosorior appreciate | 09:01 |
| jaosorior | marios: no problem, let me know if you need more reviews | 09:01 |
| *** ohamada has joined #tripleo | 09:02 | |
| marios | jaosorior: thanks | 09:02 |
| *** shardy has joined #tripleo | 09:02 | |
| *** jpich has joined #tripleo | 09:03 | |
| *** flepied has quit IRC | 09:03 | |
| sshnaidm | jaosorior, I try to understand what is going on on controller of ovb, I think you don't have access there.. There is a problem with openstack of OVB itself. | 09:04 |
| *** jpena|off is now known as jpena | 09:05 | |
| *** yprokule_ has joined #tripleo | 09:06 | |
| openstackgerrit | yolanda.robla proposed openstack/tripleo-quickstart: Create directories with root https://review.openstack.org/384892 | 09:06 |
| *** sudipto has quit IRC | 09:08 | |
| *** yprokule has quit IRC | 09:08 | |
| *** yprokule_ is now known as yprokule | 09:08 | |
| sshnaidm | jaosorior, I suspect this is a main problem: http://paste.openstack.org/show/592072/ | 09:08 |
| *** d0ugal has quit IRC | 09:09 | |
| *** dbecker has joined #tripleo | 09:10 | |
| *** gfidente has joined #tripleo | 09:10 | |
| *** udesale has joined #tripleo | 09:10 | |
| *** udesale has quit IRC | 09:11 | |
| gfidente | morning | 09:12 |
| *** udesale has joined #tripleo | 09:12 | |
| *** shardy has quit IRC | 09:12 | |
| *** shardy has joined #tripleo | 09:12 | |
| *** d0ugal has joined #tripleo | 09:14 | |
| *** d0ugal has quit IRC | 09:14 | |
| *** d0ugal has joined #tripleo | 09:14 | |
| *** bogdando has joined #tripleo | 09:15 | |
| *** dsneddon has quit IRC | 09:16 | |
| jaosorior | sshnaidm: that's a bit cryptic | 09:16 |
| *** d0ugal has quit IRC | 09:17 | |
| *** limao has quit IRC | 09:17 | |
| *** d0ugal has joined #tripleo | 09:19 | |
| *** chem has joined #tripleo | 09:21 | |
| *** anton has quit IRC | 09:21 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Add FreeIPA enrollment template https://review.openstack.org/407999 | 09:22 |
| *** tremble has quit IRC | 09:23 | |
| *** tremble has joined #tripleo | 09:24 | |
| *** lucas-pto is now known as lucasagomes | 09:24 | |
| *** numans has quit IRC | 09:25 | |
| *** numans has joined #tripleo | 09:26 | |
| *** limao has joined #tripleo | 09:26 | |
| *** zoli|gone is now known as zoli|wfh | 09:27 | |
| *** hjensas has quit IRC | 09:27 | |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-common: Get config files for all openstack* packages https://review.openstack.org/409106 | 09:29 |
| zoli|wfh | good morning | 09:29 |
| *** karimb has joined #tripleo | 09:32 | |
| jaosorior | ccamacho: could you check this one out https://review.openstack.org/#/c/409165/ ? | 09:32 |
| *** hjensas has joined #tripleo | 09:32 | |
| sshnaidm | jaosorior, this also seems "suspicious" http://paste.openstack.org/show/592075/ | 09:33 |
| *** akrivoka has joined #tripleo | 09:33 | |
| *** yamahata has quit IRC | 09:33 | |
| jaosorior | sshnaidm: is mysql running fine? | 09:33 |
| jaosorior | sshnaidm: you might need to restart the openstack services in that case | 09:33 |
| jaosorior | so they can establish new connections to the database | 09:34 |
| *** ebarrera has joined #tripleo | 09:34 | |
| sshnaidm | mariadb.service loaded active running MariaDB 10.1 database server | 09:34 |
| yolanda | hi, i'm having some errors with ovb tests again... http://logs.openstack.org/86/407386/4/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/2deb935/console.html | 09:35 |
| jaosorior | sshnaidm: might be that it restarted or wasn't available at some point? so some connections were killed. Not sure really, but restarting services might be needed either way | 09:35 |
| yolanda | 2016-12-12 09:26:00.995697 | ERROR: the main setup script run by this job failed - exit code: 137 | 09:35 |
| yolanda | 2016-12-12 09:26:00.995756 | please look at the relevant log files to determine the root cause | 09:35 |
| yolanda | 2016-12-12 09:26:00.995786 | Running devstack worlddump.py | 09:35 |
| yolanda | 2016-12-12 09:26:01.045938 | /bin/sh: brctl: command not found | 09:35 |
| jaosorior | yolanda: yep, ovb tests are failing at the moment :( | 09:35 |
| sshnaidm | jaosorior, yeah, let's try windows way. | 09:35 |
| yolanda | ok | 09:35 |
| jaosorior | yolanda: oh, that error I hadn't seen before | 09:35 |
| yolanda | no more relevant errors in the logs folder | 09:35 |
| sshnaidm | jaosorior, db is ok.. problems were in 2016-09-15 | 09:37 |
| *** anton has joined #tripleo | 09:38 | |
| *** tremble has quit IRC | 09:38 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata https://review.openstack.org/404831 | 09:40 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Normalize parameters https://review.openstack.org/403422 | 09:41 |
| *** flepied has joined #tripleo | 09:41 | |
| *** tremble has joined #tripleo | 09:41 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Add CI matrix to THT https://review.openstack.org/409692 | 09:43 |
| openstackgerrit | Flavio Percoco proposed openstack/tripleo-common: Get config files for all openstack* packages https://review.openstack.org/409106 | 09:44 |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci: Remove the current CI matrix from tripleo-ci https://review.openstack.org/409697 | 09:45 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Normalize parameters https://review.openstack.org/403422 | 09:47 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Add panko to scenario 1 https://review.openstack.org/409701 | 09:50 |
| *** imranh has quit IRC | 09:50 | |
| *** jtomasek has quit IRC | 09:52 | |
| *** imranh has joined #tripleo | 09:53 | |
| *** derekh has joined #tripleo | 09:54 | |
| *** jtomasek has joined #tripleo | 09:55 | |
| *** imranh has quit IRC | 09:57 | |
| *** mhenkel has joined #tripleo | 09:57 | |
| *** imranh has joined #tripleo | 09:58 | |
| therve | derekh, testenv-client seems to hang, do you know what can be the cause? | 09:58 |
| *** mhenkel has quit IRC | 09:58 | |
| *** mhenkel has joined #tripleo | 09:59 | |
| *** tremble has quit IRC | 10:00 | |
| *** cschwede has quit IRC | 10:00 | |
| *** cschwede has joined #tripleo | 10:01 | |
| jaosorior | therve: ovb's openstack has issues; root cause is yet to be determined | 10:01 |
| *** dtantsur|afk is now known as dtantsur | 10:01 | |
| therve | jaosorior, Ah, ok | 10:02 |
| *** karimb has quit IRC | 10:03 | |
| *** tremble has joined #tripleo | 10:04 | |
| *** tremble has joined #tripleo | 10:04 | |
| *** yprokule_ has joined #tripleo | 10:04 | |
| jaosorior | jistr: if you have time can you check this out again https://review.openstack.org/#/c/409165/ ? | 10:04 |
| *** karimb has joined #tripleo | 10:05 | |
| *** yprokule has quit IRC | 10:05 | |
| *** yprokule_ is now known as yprokule | 10:05 | |
| *** cschwede has quit IRC | 10:06 | |
| *** cschwede has joined #tripleo | 10:07 | |
| *** cschwede has quit IRC | 10:09 | |
| *** cschwede has joined #tripleo | 10:09 | |
| *** athomas has joined #tripleo | 10:11 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Use versionless keystone endpoint for barbican-related configurations https://review.openstack.org/407898 | 10:11 |
| derekh | jaosorior: is somebody looking into it or should I? | 10:12 |
| jaosorior | sshnaidm: was looking into it, might want to sync | 10:15 |
| sshnaidm | derekh, hi | 10:15 |
| sshnaidm | derekh, found this: http://paste.openstack.org/show/592066/ http://paste.openstack.org/show/592072/ | 10:15 |
| jaosorior | thanks jistr | 10:16 |
| sshnaidm | derekh, but I couldn't locate the problem yet | 10:17 |
| derekh | sshnaidm: hi ya, ok, taking a look aswell | 10:17 |
| sshnaidm | derekh, I'm not sure if it's ok too: http://paste.openstack.org/show/592077/ | 10:22 |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata https://review.openstack.org/404831 | 10:23 |
| *** tosky has joined #tripleo | 10:25 | |
| derekh | sshnaidm: I think the keystone thing is ok as its running under httpd | 10:26 |
| jaosorior | sshnaidm: yeah, that should be fine, just make sure that httpd is up and running and you should probably see the keystone process group around there. | 10:28 |
| sshnaidm | jaosorior, derekh, yeah, I see processes in table now | 10:29 |
| *** sudipto has joined #tripleo | 10:30 | |
| *** dtantsur is now known as dtantsur|brb | 10:30 | |
| *** panda|pto is now known as panda | 10:31 | |
| derekh | sshnaidm: so the test envs are taking (for the random one I looked at) 28 minutes to get created, which is longer then out 20 minute timeout | 10:32 |
| derekh | sshnaidm: something is causing them to create a lot slower then is usual (possibly the error you pasted) | 10:32 |
| sshnaidm | derekh, also errors in glance, not sure they're critical: http://paste.openstack.org/show/592083/ | 10:34 |
| sshnaidm | derekh, the same about bmc_template image | 10:34 |
| derekh | sshnaidm: I think thats normal, iirc the image we add to the heat template for those, heat first tries it as a image id (hence the 404), then a image name which works | 10:36 |
| sshnaidm | derekh, oh, then it's fine.. | 10:36 |
| sshnaidm | so many errors, difficult to understand which one is real.. | 10:37 |
| derekh | sshnaidm: brb, then I'll see if I can narrow down what part of the test env heat stack is taking most time, I think that would be a good place to start | 10:37 |
| *** adarazs has quit IRC | 10:39 | |
| *** adarazs has joined #tripleo | 10:40 | |
| *** ebarrera has quit IRC | 10:43 | |
| *** kodokuuu has joined #tripleo | 10:47 | |
| *** kodokuu has quit IRC | 10:48 | |
| *** limao has quit IRC | 10:48 | |
| kodokuuu | HI, I try to deploy with triple O but I have kernel panic during the ramdisk inspection | 10:50 |
| *** milan has joined #tripleo | 10:51 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: When making sub-workflow calls, pass the queue_name https://review.openstack.org/406165 | 10:51 |
| kodokuuu | I use VM for compute or controller | 10:51 |
| yolanda | hi, i'm also getting errors on tripleo-quickstart ... https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-gate-master-delorean-full-minimal-22/console.txt.gz | 10:55 |
| yolanda | fatal: [172.19.2.116]: FAILED! => {"changed": true, "cmd": ["virt-resize", "--expand", "/dev/sda1", "/home/stack/.quickstart/undercloud.qcow2", "/home/stack/.quickstart/undercloud-resized.qcow2"], "delta": "0:00:01.769624", "end": "2016-12-12 09:52:32.142604", "failed": true, "rc": 1, "start": "2016-12-12 09:52:30.372980", "stderr": "virt-resize: error: libguestfs error: part_get_parttype: not a partitioned \ndevice\n\nIf reporting bugs, run virt-resize | 10:55 |
| yolanda | with debugging enabled and include the \ncomplete output:\n\n virt-resize -v -x [...]", "stdout": "[ 0.0] Examining /home/stack/.quickstart/undercloud.qcow2", "stdout_lines": ["[ 0.0] Examining /home/stack/.quickstart/undercloud.qcow2"], "warnings": []} | 10:55 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Pass hieradata for TLS in the internal network for Ceph RGW https://review.openstack.org/409728 | 10:58 |
| derekh | sshnaidm: nova instances are talking a long time to get created, I'm thinking maybe because of the size of the db table (although it could also be neutron related) | 11:00 |
| jaosorior | gfidente: do you happen to have a deployment with ceph RGW enabled? | 11:00 |
| derekh | sshnaidm: to start I'm going to archive the old instances from the nova table | 11:01 |
| sshnaidm | derekh, as I see it's about 5 min each server, right? | 11:01 |
| derekh | sshnaidm: it contains 250,000 entries, ya most of them a 5+ minutes | 11:01 |
| sshnaidm | derekh, great.. how do you archive them? | 11:01 |
| derekh | sshnaidm: I'll be running this on the overcloud controller (multiple times) "nova-manage db archive_deleted_rows --verbose --max_rows 10000" | 11:02 |
| derekh | sshnaidm: last time we tried this it didn't work because of a bug | 11:02 |
| derekh | sshnaidm: but since then the bug has been fixed, https://review.openstack.org/#/c/378650/ | 11:02 |
| derekh | sshnaidm: so I'll first apply that patch to the controller | 11:03 |
| sshnaidm | derekh, isn't it included in last package of mitaka? | 11:06 |
| *** pblaho has joined #tripleo | 11:07 | |
| jaosorior | derekh: seems like something that should be semi-regularly running in the controllers (probably as a cron job) | 11:08 |
| derekh | sshnaidm: ya, I'll go for the package instead | 11:08 |
| derekh | jaosorior: yup it should be didn't work when we last tried, | 11:08 |
| *** dsariel has joined #tripleo | 11:09 | |
| EmilienM | hello | 11:10 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Pass hieradata for internal TLS for RabbitMQ https://review.openstack.org/409143 | 11:10 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for RabbitMQ https://review.openstack.org/327482 | 11:10 |
| *** pblaho1 has joined #tripleo | 11:13 | |
| EmilienM | derekh, sshnaidm: have we created a launchpad bug for the OVB issue? | 11:13 |
| *** pblaho has quit IRC | 11:15 | |
| *** udesale has quit IRC | 11:15 | |
| derekh | EmilienM: I havn't | 11:15 |
| sshnaidm | EmilienM, nope | 11:16 |
| sshnaidm | EmilienM, I'm not sure it's a bug if the problem is in DB size.. | 11:16 |
| EmilienM | sshnaidm: we could have a bug with alert tag to let folks know CI is broken at this time | 11:16 |
| sshnaidm | EmilienM, oh, right, will create then now | 11:17 |
| jaosorior | sshnaidm, derekh should we increase the timeout a bit as well? | 11:17 |
| derekh | jaosorior: we could, but 20 minutes should be plenty of time if everything is working as expected, in reality 5 minutes should be loads | 11:18 |
| *** udesale has joined #tripleo | 11:19 | |
| sshnaidm | jaosorior, if it'll take about 30 mins like now, jobs anyway will end with timeout I think | 11:19 |
| sshnaidm | EmilienM, https://bugs.launchpad.net/tripleo/+bug/1649252 | 11:21 |
| openstack | Launchpad bug 1649252 in tripleo "CI: OVB jobs are failing in CI" [Undecided,New] | 11:21 |
| EmilienM | sshnaidm: thanks | 11:21 |
| *** karimb has quit IRC | 11:23 | |
| *** smalleni is now known as sai | 11:25 | |
| *** karimb has joined #tripleo | 11:25 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack/tripleo-heat-templates: neutron: don't set external_network_bridge option by default https://review.openstack.org/407943 | 11:26 |
| *** tremble has quit IRC | 11:26 | |
| *** tremble has joined #tripleo | 11:28 | |
| *** tremble has quit IRC | 11:28 | |
| *** tremble has joined #tripleo | 11:28 | |
| *** dtantsur|brb is now known as dtantsur | 11:31 | |
| *** nyechiel has quit IRC | 11:31 | |
| gfidente | jaosorior no but I think that I could bring one up | 11:32 |
| openstackgerrit | Sai Sindhur Malleni proposed openstack/python-tripleoclient: Make overcloud image upload honor --image-path https://review.openstack.org/407261 | 11:35 |
| openstackgerrit | Merged openstack/python-tripleoclient: Remove RHEL registration envrionment file from list https://review.openstack.org/408772 | 11:36 |
| *** nmathew has quit IRC | 11:38 | |
| *** b00tcat has quit IRC | 11:39 | |
| *** masco has quit IRC | 11:41 | |
| *** pblaho1 is now known as pblaho | 11:42 | |
| *** jkilpatr has quit IRC | 11:48 | |
| sshnaidm | derekh, as I see it worked, right? | 11:48 |
| sshnaidm | derekh, las stack was created in 2 minutes | 11:49 |
| derekh | shadower: wow, I'm havn't finished yet so hadn't checked, I'm running it to archive 200,000 rows at a time but it has lots of tables to work through | 11:50 |
| *** thrash|wknd is now known as thrash | 11:52 | |
| hewbrocca | heh | 11:52 |
| hewbrocca | we make all the same mistakes in our prod-like cloud that OpenStack operators make in their actual prod clouds | 11:52 |
| hewbrocca | shocking | 11:52 |
| *** pkovar has joined #tripleo | 11:53 | |
| *** b00tcat has joined #tripleo | 11:55 | |
| derekh | sshnaidm: I don't see any stack that took 2 minutes | 11:55 |
| *** karimb has quit IRC | 11:56 | |
| *** sshnaidm has quit IRC | 12:00 | |
| *** ooolpbot has joined #tripleo | 12:11 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:11 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 12:11 |
| openstack | Launchpad bug 1649252 in tripleo "CI: OVB jobs are failing in CI" [Critical,In progress] | 12:11 |
| *** ooolpbot has quit IRC | 12:11 | |
| *** karimb has joined #tripleo | 12:11 | |
| *** lhinds has joined #tripleo | 12:12 | |
| *** rnoriega has joined #tripleo | 12:13 | |
| *** abregman is now known as abregman|mtg | 12:14 | |
| *** mburned has joined #tripleo | 12:14 | |
| *** sshnaidm has joined #tripleo | 12:15 | |
| *** saibarspeis has joined #tripleo | 12:16 | |
| *** colonwq has joined #tripleo | 12:17 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Use TLS proxy for Glance API's internal TLS https://review.openstack.org/408536 | 12:17 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Clean TLS proxy-related setup for glance api profile https://review.openstack.org/408565 | 12:17 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Pass parameters for TLS proxy in front of Glance-API https://review.openstack.org/408562 | 12:17 |
| derekh | sshnaidm: finished, lets see how long the next ones take | 12:18 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for RabbitMQ https://review.openstack.org/327482 | 12:19 |
| *** rhallisey has joined #tripleo | 12:19 | |
| *** mburned has quit IRC | 12:21 | |
| *** jlinkes has joined #tripleo | 12:22 | |
| *** mburned has joined #tripleo | 12:22 | |
| *** abregman_ has joined #tripleo | 12:22 | |
| *** nmathew has joined #tripleo | 12:23 | |
| *** abregman_ has quit IRC | 12:25 | |
| *** abregman|mtg has quit IRC | 12:25 | |
| *** abregman has joined #tripleo | 12:25 | |
| *** jkilpatr has joined #tripleo | 12:26 | |
| *** tremble has quit IRC | 12:26 | |
| *** shardy is now known as shardy_lunch | 12:26 | |
| *** nyechiel has joined #tripleo | 12:26 | |
| *** jkilpatr has quit IRC | 12:26 | |
| *** jkilpatr has joined #tripleo | 12:27 | |
| *** bkopilov has quit IRC | 12:28 | |
| *** nmathew- has joined #tripleo | 12:29 | |
| openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo: Add Ceph RBD mirror Pacemaker profile https://review.openstack.org/407038 | 12:30 |
| *** oshvartz has quit IRC | 12:30 | |
| *** nmathew- has quit IRC | 12:32 | |
| jaosorior | gfidente: it's not urgent, but let me know if you do end up putting up an environment. | 12:32 |
| *** nmathew has quit IRC | 12:32 | |
| *** sshnaidm has quit IRC | 12:32 | |
| *** nmathew has joined #tripleo | 12:32 | |
| *** karimb has quit IRC | 12:32 | |
| *** florianf has quit IRC | 12:33 | |
| *** dprince has joined #tripleo | 12:33 | |
| *** saneax is now known as saneax-_-|AFK | 12:33 | |
| *** kodokuuu has quit IRC | 12:34 | |
| *** limao has joined #tripleo | 12:34 | |
| *** pgadiya has quit IRC | 12:35 | |
| openstackgerrit | Keith Schincke proposed openstack/tripleo-heat-templates: Add support for not using admin_token in Ceph/RGW https://review.openstack.org/405625 | 12:35 |
| *** tremble has joined #tripleo | 12:39 | |
| *** tremble has quit IRC | 12:39 | |
| *** tremble has joined #tripleo | 12:39 | |
| *** abregman is now known as abregman|mtg | 12:39 | |
| *** limao has quit IRC | 12:40 | |
| akrivoka | jtomasek: ping | 12:41 |
| jtomasek | akrivoka: hi | 12:42 |
| *** florianf has joined #tripleo | 12:43 | |
| akrivoka | jtomasek: hey, I'm working on plan import, thinking about how to handle importing plan-environment into mistral | 12:43 |
| *** nmathew has quit IRC | 12:43 | |
| *** zoli|wfh is now known as zoli|lunch | 12:43 | |
| akrivoka | jtomasek: I see that capabilities-map contains some things from mistral env (root template and environments) | 12:43 |
| akrivoka | jtomasek: do we want those to be overwritten by values from plan-environment.json? | 12:44 |
| akrivoka | jtomasek: or merged..? | 12:44 |
| panda | jaosorior: hey, can you check if this certificate is correct ? My procedure seems to be broken as usual ... https://review.openstack.org/402930 | 12:44 |
| *** lucasagomes is now known as lucas-hungry | 12:44 | |
| jaosorior | panda: sure, let me check | 12:46 |
| jtomasek | akrivoka: I need to look at your specs, but in general, there needs to be a file (plan-environment.json or it can be even called mistral-environment.json for clarity) and it should carry the contents of mistral environment, which is created from it or overwritten by it | 12:46 |
| *** pblaho has quit IRC | 12:46 | |
| jtomasek | akrivoka: imho | 12:46 |
| d0ugal | I think plan-environment.json is clearer :) | 12:46 |
| panda | jtomasek: thanks! | 12:47 |
| jtomasek | d0ugal: ok, naming is hard....:) | 12:47 |
| panda | whoops ... jaosorior ^ | 12:47 |
| *** udesale has quit IRC | 12:47 | |
| *** limao has joined #tripleo | 12:47 | |
| akrivoka | jtomasek: yeah, let me try to clarify my question :) | 12:48 |
| jaosorior | panda: so, the CN of the CA certificate seems to be the same than the server cert, can you change it to something else? | 12:48 |
| jaosorior | panda: actually, the CA cert doesn't even need to be different than the one we use for IPv4, it's just a certificate that signs other certs and is trusted by the nodes. | 12:48 |
| jtomasek | akrivoka: I think important part of that work is moving role_data.yaml and capabilities-map.yaml to be part of mistral environment (plan-environment.yaml) | 12:49 |
| panda | jaosorior: do we have the CA key to sign the IPv6 certificate ? | 12:49 |
| dtantsur | gfidente, hey! do you mind if I address your comment on https://review.openstack.org/405435 in a follow up? Don't want to lose 2x +2 and passed CI on a big patch :) | 12:49 |
| akrivoka | jtomasek: when a plan is created, the workflow looks into capabilities-map.yaml for root template and enviornments, and if they are set there, it puts them into mistral environment. my question is, what if the plan-environment.json also has these values set. do we want to overwrite or merge? | 12:49 |
| jtomasek | akrivoka: doing so at least with roles_data.yaml opens a possibility for UI to create roles etc | 12:49 |
| jaosorior | panda: good point, there isn't. I forget we didn't add it to the repo. | 12:49 |
| gfidente | dtantsur no indeed I left +2 as it's good as is, we can fix it later, if needed | 12:50 |
| akrivoka | jtomasek: https://github.com/openstack/tripleo-common/blob/master/tripleo_common/actions/plan.py#L88-L101 | 12:50 |
| jtomasek | akrivoka: plan-environment.json should hold that data instead of capabilities-map.yaml | 12:50 |
| dtantsur | gfidente, do you think you could approve it then? | 12:51 |
| akrivoka | jtomasek: oh I see, so we no longer want these thing to appear in capabilities-map | 12:51 |
| *** sshnaidm has joined #tripleo | 12:51 | |
| jaosorior | panda: anyway, openssl tends to have issues if the same CN is used for the CA cert and the leaf cert | 12:51 |
| jtomasek | doles_data.yaml + capabilities-map.yaml = plan-environment.yaml => mistral-environment | 12:52 |
| jtomasek | akrivoka: ^ | 12:52 |
| panda | jaosorior: maybe it's failing exactly for this. ok, I'll change it, thanks | 12:52 |
| jtomasek | akrivoka: imho we want to get rid of these files and have single one which holds all the information about the plan | 12:52 |
| jtomasek | akrivoka: and resembles to mistral-environment | 12:52 |
| *** tremble has quit IRC | 12:52 | |
| akrivoka | jtomasek: I see, cool, that makes sense and makes everything simpler | 12:52 |
| *** fzdarsky has joined #tripleo | 12:53 | |
| jtomasek | akrivoka: yeah, I think a discussion on that needs to happen, also I am not sure what needst to be done in terms of backwards compatibility, but I think this needs to get resolved before we implement import/export because of introducing more backward compatibility issues if we create some intermediate solution | 12:54 |
| *** tremble has joined #tripleo | 12:55 | |
| akrivoka | jtomasek: ok, I'll create a first draft patch, we can have a discussion there | 12:56 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-common: Validate nodes_json before trying to register or updates any nodes https://review.openstack.org/408581 | 12:57 |
| sshnaidm | derekh, last stack (if they were created) took about 15 mins | 12:57 |
| sshnaidm | derekh, but a lot of failures too | 12:58 |
| jtomasek | akrivoka: cool | 12:58 |
| derekh | sshnaidm: ya, I think times have improved but something else is going on causing failures | 12:58 |
| derekh | sshnaidm: I'm going to update nova the the same package I updated on the controller to rule that out, | 12:59 |
| *** kodokuuu has joined #tripleo | 12:59 | |
| sshnaidm | derekh, on computes? | 12:59 |
| derekh | sshnaidm: yes | 12:59 |
| *** karthiks has quit IRC | 13:00 | |
| *** iranzo has quit IRC | 13:03 | |
| *** iranzo has joined #tripleo | 13:03 | |
| *** iranzo has joined #tripleo | 13:03 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Use TLS proxy for Glance API's internal TLS https://review.openstack.org/408536 | 13:05 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Clean TLS proxy-related setup for glance api profile https://review.openstack.org/408565 | 13:05 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Add TLS proxy resource https://review.openstack.org/409782 | 13:05 |
| *** karimb has joined #tripleo | 13:07 | |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1649252 in tripleo "CI: OVB jobs are failing in CI" [Critical,In progress] | 13:10 |
| d0ugal | Why did I start trying to untangle the mocks in tripleoclient | 13:15 |
| * d0ugal is pulling his hair out | 13:15 | |
| *** karthiks has joined #tripleo | 13:16 | |
| *** rlandy has joined #tripleo | 13:16 | |
| *** Ng has quit IRC | 13:16 | |
| *** Ng has joined #tripleo | 13:16 | |
| *** ChanServ sets mode: +v Ng | 13:16 | |
| dtantsur | lol | 13:17 |
| jtomasek | florianf: https://github.com/este/este/blob/fd4f4785636de2cbf95c10e5ce2b7b92d5bf21fa/src/browser/notfound/NotFoundPage.js#L16 | 13:18 |
| *** pblaho has joined #tripleo | 13:18 | |
| jtomasek | florianf: <FormattedMessage {...messages.continue} /> | 13:18 |
| florianf | jtomasek: Yep, understood. Just wondering what the benefit is (in our concrete case) of using FormattedMessage | 13:19 |
| flaper87 | weshay: hey, u back? :D | 13:21 |
| weshay | flaper87, yes sir | 13:21 |
| flaper87 | weshay: w0000h0000 | 13:22 |
| flaper87 | weshay: welcome back | 13:22 |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata https://review.openstack.org/404831 | 13:22 |
| weshay | flaper87, I'll go through the container reviews I saw you wanted a name change, that is fine by me | 13:22 |
| flaper87 | weshay: I know you were out last week but I wanted to know if we could sync on the status of the CI job | 13:22 |
| flaper87 | weshay: niiice | 13:22 |
| flaper87 | weshay: please, let me know if I can help you in any way | 13:22 |
| jtomasek | florianf: see 'Formatting Data using React Components vs. the API' section in https://medium.freecodecamp.com/internationalization-in-react-7264738274a0#.x2x3uqrv2 | 13:23 |
| flaper87 | weshay: I know ansible, I've got 2 hands and I want this CI job to be up and running | 13:23 |
| weshay | flaper87, there was one outstanding bug, I need to check the status | 13:23 |
| weshay | flaper87, :) | 13:23 |
| weshay | great | 13:23 |
| flaper87 | weshay: the networking one ? | 13:23 |
| jtomasek | florianf: describes it quite well why FormattedMessage is better | 13:23 |
| weshay | ya | 13:23 |
| flaper87 | weshay: we might just switch to overcloud-full for now | 13:23 |
| flaper87 | weshay: https://review.openstack.org/#/c/395880/ | 13:24 |
| weshay | flaper87, ok.. I'll change my test job to hit that review | 13:24 |
| flaper87 | weshay: danke (ps 10) | 13:25 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Expose param to enable legacy ceilometer api https://review.openstack.org/409249 | 13:25 |
| florianf | jtomasek: yeah, I've already read that and it totally makes sense in general. I'm just not sure where we actually do benefit from that currently in our case. | 13:26 |
| *** trown|outtypewww is now known as trown | 13:26 | |
| *** shardy_lunch is now known as shardy | 13:28 | |
| jtomasek | florianf: for example here https://review.openstack.org/#/c/399626/13/src/js/components/deployment_plan/ConfigurePlanStep.js line 22 | 13:28 |
| EmilienM | panda: what is the status of ipv6 testing in tripleo CI now? | 13:29 |
| jtomasek | florianf: I'd expect a component rather than expression there. I am not saying that expression can't be used there, but according to the article, and I tend to agree, the rule of thumb should be use the component where possible and use api function if not possible (or not elegant) | 13:30 |
| *** florianf has quit IRC | 13:32 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Simplify Fetching the passwords from Mistral https://review.openstack.org/409791 | 13:32 |
| *** ansmith has joined #tripleo | 13:32 | |
| derekh | sshnaidm: so I've so far only update one compute node and nova-compute wont start on it | 13:34 |
| derekh | sshnaidm: also the load on the overcloud controller is 67.... | 13:34 |
| *** prateek has quit IRC | 13:34 | |
| derekh | anybod seen this before | 13:35 |
| derekh | root 8342 14054 0 13:31 pts/0 S+ 0:00 systemctl start openstack-nova-compute | 13:35 |
| derekh | root 8347 8342 0 13:31 pts/0 S+ 0:00 /usr/bin/systemd-tty-ask-password-agent --watch | 13:35 |
| derekh | root 8348 8342 0 13:31 pts/0 Sl+ 0:00 /usr/bin/pkttyagent --notify-fd 5 --fallback | 13:35 |
| derekh | is the systemctl start command waiting for a password to be input .... | 13:35 |
| *** florianf has joined #tripleo | 13:36 | |
| *** athomas has quit IRC | 13:36 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Simplify Fetching the passwords from Mistral https://review.openstack.org/409791 | 13:37 |
| openstackgerrit | Flavio Percoco proposed openstack/python-tripleoclient: Pin docutils version https://review.openstack.org/409794 | 13:37 |
| panda | EmilienM: I've been on PTO last week so my information may be a bit out of date. We are still testing IPv6 only on updates. My patch here https://review.openstack.org/403744 corrected an error in configuration and enabled IPv6, that was working fine by the time the fix was merged http://logs.openstack.org/44/403744/2/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-updates/08be417/console.html.gz. One of my | 13:38 |
| panda | task now is enabling ssl, I have a patch here https://review.openstack.org/402930, but it's not working yet | 13:38 |
| flaper87 | this should fix the tripleclient docs job https://review.openstack.org/#/c/409794/ | 13:38 |
| *** jcoufal has joined #tripleo | 13:39 | |
| d0ugal | thrash: ^ | 13:39 |
| EmilienM | panda: ok thanks | 13:39 |
| panda | EmilienM: but I'm seeing that periodic updates job from yesterday has failed. | 13:40 |
| EmilienM | panda: yes, ovb jobs are all failing now | 13:40 |
| EmilienM | florianf, jtomasek: I would be happy to have a review on https://review.openstack.org/#/c/409098/ please | 13:41 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Use os-net-config in multinode jobs https://review.openstack.org/409346 | 13:41 |
| *** rbowen has joined #tripleo | 13:41 | |
| *** athomas has joined #tripleo | 13:42 | |
| jtomasek | EmilienM, florianf: I wonder if we want to have i18n merged before this one ^^ or it does not matter? | 13:43 |
| jaosorior | slagle: which is the devstack gate related code that currently sets the networking for multinode jobs? | 13:43 |
| panda | sshnaidm: derekh do you need another pair of eyes ? I'll need credentials to the OVB deployment, message me in private internal. | 13:43 |
| EmilienM | jtomasek: order doesn't matter | 13:44 |
| florianf | jtomasek, EmilienM: I don't think the version change itself doesn't matter. as long as we don't release without i18n merged. | 13:44 |
| slagle | jaosorior: it's the ovs_vxlan_bridge function that is called from multinode_setup in tripleo.sh | 13:44 |
| EmilienM | florianf: indeed | 13:44 |
| jtomasek | ok, thanks | 13:44 |
| slagle | jaosorior: swithing that over to os-net-config will move us towards being able to test more networking configurations in multinode jobs | 13:44 |
| *** amoralej is now known as amoralej|lunch | 13:45 | |
| jaosorior | slagle: that's what I figured, sounds cool! | 13:45 |
| *** noslzzp has joined #tripleo | 13:46 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove dead mocks and dead code https://review.openstack.org/409130 | 13:46 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove the keystone_pki cert generation from tripleoclient https://review.openstack.org/409198 | 13:46 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove the unused get_config_value function https://review.openstack.org/409255 | 13:46 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Simplify Fetching the passwords from Mistral https://review.openstack.org/409791 | 13:46 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove the unused delete image function https://review.openstack.org/409258 | 13:46 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove the unused constant RESOURCE_REGISTRY_NAME https://review.openstack.org/409256 | 13:46 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Remove two unused Exception subclasses https://review.openstack.org/409257 | 13:46 |
| d0ugal | jpich: ^ | 13:46 |
| *** noslzzp has quit IRC | 13:46 | |
| jpich | d0ugal: Clean-up time? :) I'll add them to my list, thank you! | 13:47 |
| *** noslzzp has joined #tripleo | 13:47 | |
| d0ugal | jpich: Yeah, I got a bit mad at the code | 13:47 |
| jpich | Good, productive mad | 13:48 |
| *** jpena is now known as jpena|lunch | 13:48 | |
| derekh | panda: will ping you | 13:48 |
| dprince | EmilienM, shardy: this is finally passing CI https://review.openstack.org/#/c/396171/ | 13:49 |
| dprince | slagle: you too, that is a small deployed server fix | 13:49 |
| *** karthiks has quit IRC | 13:51 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras: [validate-tempest] use 'become' instead of "sudo" https://review.openstack.org/409798 | 13:52 |
| *** abregman|mtg has quit IRC | 13:53 | |
| *** abregman has joined #tripleo | 13:54 | |
| *** karimb has quit IRC | 13:55 | |
| *** rhallisey has quit IRC | 13:57 | |
| *** karimb has joined #tripleo | 13:58 | |
| *** trozet has joined #tripleo | 13:59 | |
| *** liverpooler has joined #tripleo | 13:59 | |
| *** tzumainn has joined #tripleo | 13:59 | |
| *** zoli|lunch is now known as zoli|wfh | 14:00 | |
| *** rhallisey has joined #tripleo | 14:01 | |
| derekh | sshnaidm: panda gonna keep track of anything we do here, we can trasfew the relevant bits to the launchpad afterwards | 14:01 |
| derekh | sshnaidm: panda https://etherpad.openstack.org/p/bug-1649252 | 14:02 |
| sshnaidm | derekh, great | 14:02 |
| *** lucas-hungry is now known as lucasagomes | 14:02 | |
| *** mhenkel_ has joined #tripleo | 14:04 | |
| *** karthiks has joined #tripleo | 14:04 | |
| yolanda | hi, can i get some reviews for https://review.openstack.org/406895 and https://review.openstack.org/408456 ? | 14:05 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras: [validate-upgrade] use 'become' instead of 'sudo' https://review.openstack.org/409801 | 14:05 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras: [validate-tempest] use 'become' instead of 'sudo' https://review.openstack.org/409798 | 14:05 |
| *** mhenkel has quit IRC | 14:06 | |
| openstackgerrit | Saravanan KR proposed openstack/os-net-config: Handle deployment update for DPDK nic changes https://review.openstack.org/373680 | 14:07 |
| *** abregman is now known as abregman|mtg | 14:08 | |
| *** egafford has joined #tripleo | 14:09 | |
| *** bvandenh has joined #tripleo | 14:09 | |
| *** florianf has quit IRC | 14:10 | |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 14:10 |
| openstack | Launchpad bug 1649252 in tripleo "CI: OVB jobs are failing in CI" [Critical,In progress] | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| akrivoka | EmilienM: ping, I have a question about deep dives | 14:10 |
| EmilienM | akrivoka: what's up? | 14:10 |
| *** mhenkel has joined #tripleo | 14:11 | |
| akrivoka | EmilienM: hey, I was thinking about doing a deep dive on how to contribute to the tripleo ui | 14:11 |
| *** yolanda has quit IRC | 14:11 | |
| EmilienM | akrivoka: that would be awesome | 14:11 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras: [validate-tempest] use 'become' instead of 'sudo' https://review.openstack.org/409798 | 14:12 |
| akrivoka | EmilienM: are deep dives still a thing? looking at the etherpad there doesn't seem to be anything there since august? https://etherpad.openstack.org/p/tripleo-deep-dive-topics | 14:12 |
| EmilienM | akrivoka: we haven't done any deep dive session since August, indeed | 14:12 |
| EmilienM | akrivoka: but yes, this is still a thing | 14:12 |
| EmilienM | akrivoka: it would be great to make the deep dive interactive | 14:12 |
| EmilienM | akrivoka: also, recording it so we can put it on youtube eventually | 14:12 |
| akrivoka | EmilienM: alright, I can do one about the ui, let's say in January | 14:13 |
| *** yolanda has joined #tripleo | 14:13 | |
| *** saneax-_-|AFK is now known as saneax | 14:13 | |
| panda | derekh: sshnaidm | 14:13 |
| *** mhenkel_ has quit IRC | 14:13 | |
| EmilienM | akrivoka: sounds like a plan | 14:13 |
| panda | 2016-12-12 14:12:39.493 37532 WARNING neutron.db.agents_db [req-fc205aee-d23f-4fe1-8dda-7139cd06c9a7 - - - - -] Agent healthcheck: found 5 dead agents out of 41: | 14:13 |
| panda | Type Last heartbeat host | 14:13 |
| panda | Open vSwitch agent 2016-09-07 16:53:02 overcloud-controller-0.localdomain | 14:13 |
| panda | Metadata agent 2016-09-07 16:52:50 overcloud-controller-0.localdomain | 14:13 |
| panda | Open vSwitch agent 2016-12-12 13:08:36 overcloud-novacompute-13.localdomain | 14:13 |
| panda | DHCP agent 2016-09-07 16:52:32 overcloud-controller-0.localdomain | 14:13 |
| panda | L3 agent 2016-09-07 16:52:46 overcloud-controller-0.localdomain | 14:13 |
| panda | is this any of you ? | 14:14 |
| akrivoka | EmilienM: great | 14:14 |
| *** yolanda has quit IRC | 14:15 | |
| *** yolanda has joined #tripleo | 14:15 | |
| *** ealcaniz has quit IRC | 14:16 | |
| *** bvandenh has quit IRC | 14:16 | |
| *** ealcaniz has joined #tripleo | 14:17 | |
| *** pmannidi has quit IRC | 14:18 | |
| derekh | panda: don't worry about the overcloud-controller-0.localdomain agents, they are from one time when the services were started with a different hostname | 14:18 |
| *** dtantsur has quit IRC | 14:18 | |
| derekh | panda: overcloud-novacompute-13.localdomain is probably me, thats the node I rebooted | 14:18 |
| panda | derekh: ok | 14:18 |
| *** morazi has joined #tripleo | 14:19 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras: [virthost-full-cleanup] use 'become' instead of 'sudo' https://review.openstack.org/409808 | 14:19 |
| *** sshnaidm has quit IRC | 14:19 | |
| *** Tristitia has quit IRC | 14:19 | |
| openstackgerrit | Saravanan KR proposed openstack/puppet-tripleo: Add support to changing the Rabbitmq password on update https://review.openstack.org/402061 | 14:20 |
| *** ealcaniz has quit IRC | 14:21 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-common: Remove remaining vendor plugins from default image YAML https://review.openstack.org/409809 | 14:22 |
| openstackgerrit | Merged openstack/tripleo-ui: Release Ocata-2 https://review.openstack.org/409098 | 14:22 |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata https://review.openstack.org/404831 | 14:23 |
| *** dtantsur has joined #tripleo | 14:23 | |
| trown | thrash: https://review.openstack.org/409809 blocks promotion if you have some time to review | 14:23 |
| *** morazi has quit IRC | 14:24 | |
| openstackgerrit | Saravanan KR proposed openstack/puppet-tripleo: Add support to changing the Rabbitmq password on update https://review.openstack.org/402061 | 14:25 |
| *** pmannidi has joined #tripleo | 14:25 | |
| *** florianf has joined #tripleo | 14:25 | |
| *** amoralej|lunch is now known as amoralej | 14:25 | |
| trown | amoralej: https://review.openstack.org/409809 should fix promote issue (if there are not others :p) | 14:26 |
| *** morazi has joined #tripleo | 14:26 | |
| *** milan has quit IRC | 14:28 | |
| jaosorior | EmilienM: could you check this out https://review.openstack.org/#/c/409165/ ? | 14:28 |
| EmilienM | jaosorior: does it pass OVB jobs? | 14:29 |
| *** milan has joined #tripleo | 14:29 | |
| EmilienM | jaosorior: we might want to wait that ovb jobs work again before merging patches | 14:30 |
| thrash | trown: looking | 14:30 |
| jaosorior | EmilienM: it does pass (it's not used), but it's needed for the TLS-everywhere job | 14:30 |
| jaosorior | EmilienM: it's what I've been using for that job, but I ended up moving it to tripleo-common, as recommended in a review (it was initially in t-h-t) | 14:31 |
| *** ayoung has joined #tripleo | 14:32 | |
| *** sshnaidm has joined #tripleo | 14:32 | |
| *** morazi has quit IRC | 14:32 | |
| jaosorior | EmilienM: but yeah, actually, it's not used by anything but the experimental TLS-everywhere job. So it shouldn't affect neither ovb nor multinode | 14:32 |
| jrist | EmilienM: there are some things that we know won't make it for Ocata, can we create a Pike milestone series? | 14:33 |
| jrist | EmilienM: I'm moving some stuff around right now | 14:33 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-quickstart: Increase undercloud ssh timeout from 5 to 10 minutes https://review.openstack.org/409813 | 14:33 |
| jrist | EmilienM: I can probably do it but I don't want to step on your toes | 14:33 |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Fix REPO_PREFIX handling of ceph repos https://review.openstack.org/409814 | 14:36 |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart-extras: Execute ping test role at the end of the upgrade https://review.openstack.org/409815 | 14:36 |
| *** Tristitia has joined #tripleo | 14:38 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui: Adds basic internationalization support https://review.openstack.org/399626 | 14:40 |
| EmilienM | jrist: I'm not sure how to create a serie | 14:41 |
| trown | mwhahaha: I think the hardcoded element and package stuff in tripleoclient is ignored if YAML config files are passed in https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_image.py#L598-L603 | 14:41 |
| *** udesale has joined #tripleo | 14:41 | |
| mwhahaha | yea but if you don't pass files in it doesn't work | 14:41 |
| mwhahaha | which the docs don't have files to pass in | 14:41 |
| mwhahaha | we need to clean it up | 14:41 |
| trown | ya | 14:41 |
| mwhahaha | same thing happened with the cisco stuff last time | 14:41 |
| mwhahaha | so oooq worked but following the docs did not | 14:42 |
| shardy | EmilienM, jrist: For newton/ocata I just created the series and milestones via the launchpad web UI | 14:42 |
| trown | maybe we should just fix docs to reference the example YAMLs? | 14:42 |
| shardy | there are some scripts which can do it too I think, but manually works fine | 14:42 |
| trown | thrash do we even need "legacy build" | 14:43 |
| thrash | trown: not sure what you mean? | 14:43 |
| jrist | EmilienM: I can do it if you don't mind | 14:43 |
| mwhahaha | trown: that's hiding the issue :D it should just work with 'openstack overcloud image build' adding more stuff is not very user friendly | 14:43 |
| jrist | EmilienM, shardy - so I can get going on Pike planning | 14:43 |
| jrist | de facto UI PTL? | 14:43 |
| jrist | heh | 14:43 |
| EmilienM | jrist: I see where it's done now. Feel free to create it, but you need to set the milestones also | 14:44 |
| trown | thrash: well, right now, if now config files get passed in we default to "legacy" build... which is all of the hardcoded stuff in tripleoclient | 14:44 |
| thrash | trown: this would help: updated docs: https://review.openstack.org/#/c/337669/ | 14:44 |
| trown | thrash: seems like default should actually be to use the example YAML, but then what would trigger "legacy" | 14:44 |
| shardy | jrist: thanks, agree it's good to start deferring things now to clearly communicate the actual status of ocata | 14:44 |
| jrist | EmilienM: do we have a pike schedule somewhere? | 14:44 |
| *** abregman|mtg is now known as abregman | 14:44 | |
| jrist | shardy: ^ | 14:44 |
| thrash | trown: unfortunaly, yes. It has to go through a deprecation period. | 14:45 |
| jrist | shardy: thanks | 14:45 |
| EmilienM | jrist: it seems like the schedule is not defined yet | 14:45 |
| thrash | trown: and there is no default with the yaml build. | 14:45 |
| shardy | jrist: Not yet - it will be finalized at the pike summit | 14:45 |
| shardy | https://releases.openstack.org/pike/schedule.html | 14:45 |
| shardy | jrist: you can just leave the milestone dates empty for now | 14:45 |
| thrash | trown: at least one config file is necessary. | 14:45 |
| EmilienM | let's create the serie first | 14:45 |
| EmilienM | yeah, and have milestones without dates | 14:45 |
| thrash | mwhahaha: see the docs review https://review.openstack.org/#/c/337669/ | 14:46 |
| shardy | IIRC that's what I did for ocata | 14:46 |
| *** morazi has joined #tripleo | 14:46 | |
| openstackgerrit | Chris Jones proposed openstack/tripleo-common: [WIP] Add tooling for obtaining Fencing data automatically. https://review.openstack.org/408601 | 14:46 |
| mwhahaha | thrash: yea i've seen it, but i still don't like the defaults not working. forcing people to always having to include some yaml file is not very user friendly that's all | 14:47 |
| *** prateek has joined #tripleo | 14:47 | |
| thrash | mwhahaha: what defaults are you talking about? | 14:47 |
| *** yprokule has quit IRC | 14:48 | |
| mwhahaha | openstack overcloud image build --config-file /usr/share/openstack-tripleo-common/image-yaml/overcloud-images.yaml --config-file $OS_YAML vs openstack overcloud image build | 14:48 |
| thrash | mwhahaha: We can't assume that's the location of it. | 14:48 |
| mwhahaha | why not | 14:48 |
| trown | thrash: why not? | 14:48 |
| thrash | don't want to hardcode a path. | 14:48 |
| mwhahaha | why | 14:48 |
| mwhahaha | there should always be some sane default | 14:49 |
| shardy | Yeah I agree - the main reason switching over to the new image build stuff is because we've not ensured the old CLI still "just works" | 14:49 |
| trown | it would only be the default | 14:49 |
| shardy | sorry that should be the main reason it's taken so long (IMHO) | 14:49 |
| shardy | we already have defaults e.g for the --templates path in the client | 14:50 |
| shardy | this doesn't seem different to me - we know the expected default due to the packaging | 14:50 |
| thrash | shardy: you agree with me or them? :) | 14:50 |
| trown | merged the docs review btw, I think that is good regardless of what we do with tripleoclient | 14:51 |
| shardy | thrash: I agree with mwhahaha - "openstack overcloud image build" should just work | 14:51 |
| shardy | same as it has with the old build tooling | 14:51 |
| shardy | then we can finally rip out all the old duplicate package/element lists from tripleoclient | 14:51 |
| trown | shardy: well it does today... just by using exactly the old tooling | 14:51 |
| trown | which is where we then have to fix things twice if we fix the YAML | 14:51 |
| mwhahaha | but it won't with https://review.openstack.org/#/c/409809/ | 14:52 |
| thrash | there never was a time that one could just run 'openstack overcloud image build' with no arguments. | 14:52 |
| trown | to me that is really not ideal | 14:52 |
| openstackgerrit | Merged openstack/tripleo-docs: Switch docs to use yaml with overcloud image build https://review.openstack.org/337669 | 14:52 |
| mwhahaha | that's where this conversation started | 14:52 |
| EmilienM | jrist: done | 14:52 |
| shardy | trown: Yeah, so lets fix that by just driving the new tooling with some sane defaults | 14:52 |
| jrist | EmilienM: ! | 14:52 |
| mwhahaha | we need to make sure that when we make changes like https://review.openstack.org/#/c/409809/ we also make sure that the tripleoclient still works | 14:52 |
| shardy | :) | 14:52 |
| *** jpena|lunch is now known as jpena | 14:52 | |
| flaper87 | weshay: did that patch work ? | 14:53 |
| *** karimb has quit IRC | 14:53 | |
| mwhahaha | thrash: the old build vs new yaml build hasn't been aligned such that making changes in the new is reflected in the old version that's all. | 14:53 |
| trown | k. so I think we are back to "lets make no args to `openstack overcloud image build` use some default YAML" ... however that means either getting rid of "legacy" mode, or making a switch for it | 14:53 |
| trown | to me if we make a switch for it, we might as well get rid of it | 14:53 |
| *** ealcaniz has joined #tripleo | 14:54 | |
| mwhahaha | trown: get rid of what specifically? | 14:54 |
| weshay | flaper87, been in 1-1's all morning, will try in a bit | 14:54 |
| thrash | trown: we can't just dump it. | 14:54 |
| trown | mwhahaha: right now if no config files are passed we get the old behavior: https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_image.py#L595-L596 | 14:55 |
| trown | mwhahaha: so if we instead want no config files passed to mean we get the new behavior with default config files... we need some other way to get the old behavior | 14:55 |
| shardy | FWIW I thought we had this exact debate like six months ago in https://review.openstack.org/#/c/337676/ | 14:56 |
| mwhahaha | trown: yea i'm not against getting rid of the old legacy build and using the yaml under the covers, i just want 'openstack overcloud image build' to work | 14:56 |
| shardy | I'm completely in favor of the new image build stuff, I just want to avoid any additional hurdles for new users | 14:56 |
| flaper87 | weshay: coolio, will stop polling :D | 14:56 |
| shardy | or those who've got familiar with the current CLI interfaces | 14:56 |
| *** karimb has joined #tripleo | 14:57 | |
| shardy | we don't have to maintain all existing arguments etc - we can deprecate them as needed, but I agree with mwhahaha that "openstack overcloud image build" should just work | 14:57 |
| shardy | how we do that under the covers doesn't matter to most new users | 14:57 |
| thrash | shardy: do we choose centos or rhel? | 14:57 |
| thrash | shardy: it's not that simple. | 14:58 |
| trown | ya, I am very skeptical that someone would choose the old behavior on purpose | 14:58 |
| mwhahaha | because you follow the docs | 14:58 |
| mwhahaha | and don't use oooq | 14:58 |
| * mwhahaha does it | 14:58 | |
| thrash | mwhahaha: the docs problem is fixed basically. | 14:58 |
| trown | ? | 14:59 |
| mwhahaha | just fixing the docs does not necessarily mean an improved UX | 14:59 |
| thrash | mwhahaha: again, it isn't simple. Which do we choose by default? CentOS or RHEL? | 14:59 |
| mwhahaha | centos | 14:59 |
| mwhahaha | this is tripleo | 14:59 |
| trown | mwhahaha: my comment was more that if the default of `openstack overcloud image build` changed to using YAML ... I would be extremely surprised if anyone noticed or complained | 14:59 |
| trown | ya, centos... we have docs for how to use RHEL | 15:00 |
| mwhahaha | trown: once again i'm not against switching to yaml under the covers | 15:00 |
| thrash | mwhahaha: trown ok. Give me a few. I'll put a patch together. | 15:00 |
| trown | it is not possible to default to RHEL anyways as you need a RHEL base image | 15:00 |
| thrash | trown: true | 15:00 |
| shardy | Sounds like we're all agreeing, and yes I think centos as a default is fine | 15:01 |
| flaper87 | weshay: you might also need https://review.openstack.org/#/c/408374/ btw | 15:01 |
| thrash | shardy: I just don't like hardcoding the paths... | 15:01 |
| trown | thrash: like https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/overcloud_image.py#L180-L181 :p | 15:01 |
| mwhahaha | as long as it's overridable it shouldn't matter | 15:01 |
| mwhahaha | it's just the default | 15:01 |
| thrash | trown: yeah.. Just like that. :) Why do you think I want to drop that code?? | 15:02 |
| mwhahaha | i'd rather drop all those package names than a simple default path | 15:02 |
| mwhahaha | :D | 15:02 |
| mwhahaha | anyway | 15:02 |
| shardy | thrash: it's just a default, which for many (all?) new users will be correct | 15:02 |
| shardy | exactly like --templates | 15:03 |
| * mwhahaha wanders off for a bit | 15:03 | |
| thrash | shardy: it won't be if you are not running from a package. | 15:03 |
| shardy | thrash: everyone is running from a package if they follow our docs | 15:03 |
| thrash | shardy: Fair enough. | 15:04 |
| *** pradk has joined #tripleo | 15:04 | |
| *** rbrady has quit IRC | 15:05 | |
| -openstackstatus- NOTICE: The Gerrit service on review.openstack.org is restarting now to address acute performance issues, and will be back online momentarily. | 15:08 | |
| derekh | sshnaidm: panda ok, I got services on comput13 to work again, by first deleting a bunch of journal logs and then rebooting again, not 100% sure if the log removal helped so going to find another compute node with problems to debug there a bit first | 15:08 |
| *** saneax is now known as saneax-_-|AFK | 15:08 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Fix bug when using multiple DeployArtifactURLs https://review.openstack.org/409822 | 15:09 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1649252 in tripleo "CI: OVB jobs are failing in CI" [Critical,In progress] | 15:10 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Fix bug when using multiple DeployArtifactURLs https://review.openstack.org/409822 | 15:10 |
| *** ayoung is now known as ayoung_afk | 15:11 | |
| *** karimb has quit IRC | 15:12 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Normalize parameters https://review.openstack.org/403422 | 15:12 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Update app state when parameters get updated https://review.openstack.org/409825 | 15:12 |
| *** jprovazn has quit IRC | 15:13 | |
| *** rajinir has joined #tripleo | 15:13 | |
| panda | derekh: loadavg on controller is still high, but I don't see anything unusual in the logs | 15:14 |
| derekh | panda: I think it might be because there are so many compute nodes failing, and ass a results all the retries are killing the controller | 15:15 |
| *** tosky has quit IRC | 15:15 | |
| derekh | panda: on the compute node I seeing logs of errors that sshnaidm pointed out this morning, ove commands timing out with | 15:15 |
| derekh | 2016-12-12 15:11:34.336 3882 ERROR nova.compute.manager [instance: a987fa21-359d-40e8-b4fb-3b45634af803] Stderr: u'2016-12-12T15:11:34Z|00002|fatal_signal|WARN|terminating with signal 14 (Alarm clock)\n'. | 15:15 |
| sshnaidm | derekh, which openvswitch version is there? maybe it requires an update | 15:16 |
| *** limao has quit IRC | 15:16 | |
| trozet | shardy: do you mind setting workflow +1 on https://review.openstack.org/#/c/407196/ ? | 15:17 |
| *** ccamacho has quit IRC | 15:18 | |
| *** tosky has joined #tripleo | 15:19 | |
| *** tosky has quit IRC | 15:20 | |
| *** rbrady has joined #tripleo | 15:20 | |
| *** rbrady has quit IRC | 15:20 | |
| *** rbrady has joined #tripleo | 15:20 | |
| *** tosky has joined #tripleo | 15:21 | |
| *** yprokule has joined #tripleo | 15:21 | |
| shardy | trozet: done | 15:22 |
| trozet | shardy: thanks | 15:22 |
| jpena | b00tcat: looking at the puppet-curator module (about your packaging request), I see it installs software from Pip. Is that required for you? Not sure about your use case, but mixing pip + rpm python packages is usually a recipe for disaster | 15:22 |
| *** abehl has quit IRC | 15:23 | |
| *** karimb has joined #tripleo | 15:23 | |
| matbu | shardy: according to your comment in the upgrade CI job review ( regarding the setting of the OC repo) | 15:23 |
| derekh | sshnaidm: openvswitch-2.5.0-2.el7.x86_64 | 15:24 |
| matbu | shardy: the job is passing right now, so should we merged as is ? and i'm making a new review for setting up the repo throught tripleo.sh --delorean-repo | 15:24 |
| pradk | can someone merge this please, pretty simple change https://review.openstack.org/#/c/407776/ | 15:24 |
| *** bnemec has joined #tripleo | 15:25 | |
| matbu | shardy: or should i make it in this review ? | 15:25 |
| matbu | shardy: (i prefer the solution number #1 :) ) | 15:25 |
| shardy | matbu: good that it's passing, nice work! :) | 15:25 |
| shardy | matbu: I'm fine with landing it and iterating - let me do another review pass | 15:26 |
| shardy | thanks for working on it! | 15:26 |
| sshnaidm | derekh, like in controller too. | 15:26 |
| matbu | shardy: ack no pb, thank you for the reviews :) | 15:26 |
| derekh | sshnaidm: yup | 15:27 |
| matbu | shardy: because i think, adding the repo with tripleo.sh would require to add a function (i prefer to split the work and keep reviews small) | 15:27 |
| shardy | matbu: ack, sure - I think we'll need a few more iterations on this, but it's a very good first-pass | 15:28 |
| jrist | jtomasek: still here? | 15:28 |
| jrist | jtomasek: wondering if we should for 11 go through and do updates on relevant underlying packages - react, redux etc | 15:28 |
| jrist | jtomasek: for instance https://github.com/facebook/react/issues/5506 is fixed | 15:29 |
| jrist | jtomasek: specifically https://github.com/facebook/react/pull/5451 | 15:29 |
| b00tcat | jpena: we're using this module as they say the recommended way to install is pip (although they have APT and Yum repos): https://www.elastic.co/guide/en/elasticsearch/client/curator/4.0/installation.html | 15:29 |
| *** aufi has quit IRC | 15:30 | |
| shardy | matbu: Did you see my question earlier - why are we setting https://review.openstack.org/#/c/404831/28/test-environments/upgrade.yaml resource_registry entries to OS::Heat::None? | 15:30 |
| *** arxcruz has quit IRC | 15:31 | |
| *** arxcruz has joined #tripleo | 15:31 | |
| matbu | shardy: nop i missed it sorry | 15:31 |
| *** saneax-_-|AFK is now known as saneax | 15:32 | |
| matbu | shardy: oh this is EmilienM who add this. afaik it was to be sure that the other services won't be installed | 15:32 |
| openstackgerrit | Brad P. Crochet proposed openstack/python-tripleoclient: Default image build to use yaml files https://review.openstack.org/409834 | 15:33 |
| thrash | trown: mwhahaha shardy ^^^^ | 15:33 |
| thrash | I'll work on updating the docs. | 15:33 |
| shardy | matbu: Ok, I'm confused - that's what ControllerServices does | 15:33 |
| jpena | b00tcat: I see. Anyway, in the TripleO context we should not install stuff from pypi, because dependencies could override packages installed via rpm and break it | 15:33 |
| shardy | so I don't see why we need the OS::Heat::None things unless that ControllerServices parameter is not working | 15:34 |
| trown | awesome thanks thrash++ | 15:34 |
| matbu | shardy: i think we can drop that | 15:34 |
| matbu | shardy: i'm not sure, but i think EmilienM added this because we were hitting a timeout on the overcloud deployment | 15:35 |
| matbu | shardy: and it didn't fix the timeout .. so i think it's safe to remove those | 15:35 |
| shardy | matbu: Ok, I've got a few more comments (minor) will add them to the review | 15:36 |
| shardy | this looks really close tho :) | 15:36 |
| EmilienM | matbu: yeah feel free to change what I did :) | 15:36 |
| matbu | shardy: ack cool :) EmilienM k thanks :) | 15:37 |
| *** dprince has quit IRC | 15:38 | |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-docs: Reflect default usage of image build https://review.openstack.org/409839 | 15:42 |
| thrash | trown: mwhahaha ^^^^ | 15:42 |
| openstackgerrit | Merged openstack/tripleo-quickstart: Increase undercloud ssh timeout from 5 to 10 minutes https://review.openstack.org/409813 | 15:42 |
| jtomasek | jrist: yes, we can, I was kind of holding on and waiting for new router | 15:43 |
| matbu | shardy: i will update after you post your comments (and after mtgs) :) | 15:43 |
| jrist | jtomasek: oh that's right. is it out? | 15:43 |
| *** dhill_ has quit IRC | 15:43 | |
| *** dhill_ has joined #tripleo | 15:44 | |
| jtomasek | jrist: 4.0 is still in alpha | 15:45 |
| jrist | k | 15:45 |
| *** abregman has quit IRC | 15:45 | |
| *** brault_ has joined #tripleo | 15:45 | |
| jtomasek | jrist: but we can update some deps sure | 15:45 |
| *** dhill_ has quit IRC | 15:45 | |
| *** dhill_ has joined #tripleo | 15:46 | |
| jrist | cool | 15:46 |
| rlandy | d0ugal: hello - has there been any further discussion on on the 'mistral-db-manage populate' step to avoid introspection failures? I am going ahead with logging the BZ to track the workaround but it's just a question of whether we want to keep the workaround in the CI code. | 15:47 |
| *** brault has quit IRC | 15:47 | |
| *** jprovazn has joined #tripleo | 15:47 | |
| trozet | shardy: it is not possible to run the deploy command multiple times to deploy different roles separately, is it? | 15:50 |
| karimb | hello buddies, so with the compsable roles feature, can i create a keystone only role? and point it to an external db+rabbit+haproxy ? | 15:50 |
| karimb | trozet didnt see any documentation around it, no | 15:51 |
| karimb | shardy you did mention a limitation around needing pacemaker resources grouped, but my understanding was that one could create a keystone only service ( without pacemaker, that is ) | 15:51 |
| *** trown is now known as trown|brb | 15:51 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Use os-net-config in multinode jobs https://review.openstack.org/409346 | 15:52 |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras: Enable cinder-backup service https://review.openstack.org/400787 | 15:53 |
| *** prateek has quit IRC | 15:54 | |
| b00tcat | jpena: right - I'll try to workaround the usage of this module by installing the RPM as you pointed out in bz | 15:54 |
| b00tcat | jpena: will update the ticket | 15:54 |
| d0ugal | rlandy: no, I don't really know what to do about it. I guess a BZ or launchpad bug is the way to go | 15:54 |
| jpena | b00tcat: ok, thanks! By the way, I know it's packaged in Fedora, but I'm not sure if it's available for centos yet (it could be built if needed, I guess) | 15:55 |
| jpich | Urgh what's the thing to do when you +2A something in a repo you shouldn't have? Is removing workflow enough? | 15:55 |
| *** yamahata has joined #tripleo | 15:55 | |
| shardy | karimb: keystone isn't managed by pacemaker anymore, so yes you can run keystone on a non-controller role | 15:55 |
| jpich | ( https://review.openstack.org/#/c/379958/ - just a typo fix but still not supposed to be my turf I suppose, sorry about this) | 15:56 |
| derekh | panda: sshnaidm ok, I think I know why nova compute and neutron-ovs-agent wouldn't start | 15:56 |
| EmilienM | jpich: don't worry, it happens. THis one is ok | 15:56 |
| EmilienM | jpich: keep approving it | 15:56 |
| derekh | panda: sshnaidm http://paste.openstack.org/show/592123/ | 15:57 |
| jpich | EmilienM: Understood, thank you for confirming | 15:57 |
| derekh | panda: sshnaidm neutron-ovs-cleanup, is still running (after the reboot) and the other services wait for it too finish | 15:57 |
| shardy | trozet: Yes it is, you could deploy one role, then add another one in a subsequent update | 15:57 |
| derekh | panda: sshnaidm Before=neutron-openvswitch-agent.service neutron-dhcp-agent.service neutron-l3-agent.service openstack-nova-compute.service | 15:57 |
| shardy | trozet: I think it's fair to say that path isn't well tested tho | 15:58 |
| karimb | shardy and what about pointing to an external db and rabbitmq ? | 15:58 |
| karimb | i think it was rather the real question :=) | 15:58 |
| trozet | shardy: what if you used a different file for -r, that did not include the already deployed role? | 15:58 |
| jrist | florianf: still here? | 15:58 |
| shardy | karimb: that might be possible, but it's not going to be easy - our architecture expects use of the DB/rabbit on the Controller role | 15:58 |
| shardy | or at least right now it does | 15:59 |
| derekh | sshnaidm: panda: I've rebooted compute27 if it eventually comes back ok, I'm going to update nova and reboot all nodes but 4 on the overcloud, this will likely makes things worse for the evening | 15:59 |
| derekh | sshnaidm: panda but once one things should be ok again | 15:59 |
| shardy | trozet: every time you do an update you'll need to pass a -r file, or make a copy of t-h-t and pass --templates path/to/copy | 15:59 |
| derekh | EmilienM: ^^ I wound't expect OVB jobs back until later tonight sometime | 16:00 |
| shardy | trozet: if you remove an already deployed role from the roles data, that role will be removed ;) | 16:00 |
| karimb | shardy allright, so the best one can do is remove all the api services from the controller nodes, move them to custom roles, and as such having a controller role only with "support" services. right ? | 16:00 |
| EmilienM | derekh: your night or my night? | 16:00 |
| trozet | shardy: ok that's what I thought. Thanks! | 16:00 |
| *** jkilpatr has quit IRC | 16:00 | |
| shardy | karimb: right now, yes, that's correct | 16:00 |
| karimb | shardy thanks | 16:00 |
| shardy | karimb: there's work ongoing to enable further decoupling the remaining controller pieces, but it's not finished yet | 16:01 |
| shardy | karimb: np :) | 16:01 |
| karimb | yeah, the bp around pacemaker | 16:01 |
| *** saneax is now known as saneax-_-|AFK | 16:01 | |
| derekh | EmilienM: late my night | 16:01 |
| *** tremble has quit IRC | 16:02 | |
| panda | derekh: loadavg on controller halved | 16:02 |
| kodokuuu | Hi all, I have issue during deploy of overcloud ==> NoValidHost: No valid host was found. There are not enough hosts available. | 16:02 |
| kodokuuu | I checked all checks on http://docs.openstack.org/developer/ironic/deploy/troubleshooting.html | 16:03 |
| kodokuuu | but nothing :/ | 16:03 |
| kodokuuu | Where can I find more detail for my issue ? | 16:03 |
| karimb | shardy also can those custom roles be scaled ? say you add an extra keystone node, would it be feasible for the haproxy setup to add it during the stack update ? | 16:06 |
| *** ealcaniz has quit IRC | 16:06 | |
| derekh | EmilienM: panda sshnaidm essentially each compute node has to be rebooted, after reboot "neutron-ovs-cleanup" goes about deleting unused ovs ports one by one, the compute node I'm looking at has well over 1000 of them and its taking time | 16:06 |
| shardy | karimb: In theory, yes | 16:06 |
| shardy | I've not tested that myself tho | 16:07 |
| weshay | apetrich, ping | 16:07 |
| shardy | kodokuuu: Have you seen http://docs.openstack.org/developer/tripleo-docs/troubleshooting/troubleshooting.html#no-valid-host-found-error ? | 16:07 |
| shardy | kodokuuu: normally it's a mismatch between the ironic node properties and the nova flavor | 16:07 |
| *** mcornea has quit IRC | 16:07 | |
| shardy | or nodes being in the wrong state, or just not having enough nodes | 16:08 |
| *** nyechiel has quit IRC | 16:08 | |
| derekh | then I'll have to see what other problems we have | 16:08 |
| kodokuuu | shardy Yes I see. I use fake_pxe driver. 1 compute, 1 CTRL. | 16:09 |
| *** nyechiel has joined #tripleo | 16:09 | |
| *** jaosorior has quit IRC | 16:10 | |
| *** ebarrera has joined #tripleo | 16:10 | |
| kodokuuu | shardy I tried to follow https://access.redhat.com/documentation/en/red-hat-openstack-platform/9/paged/director-installation-and-usage/chapter-6-configuring-advanced-customizations-for-the-overcloud | 16:10 |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 16:10 |
| openstack | Launchpad bug 1649252 in tripleo "CI: OVB jobs are failing in CI" [Critical,In progress] | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| sshnaidm | derekh, thanks.. do you know if it's supposed to be so? or ports should have been deleted when stack was deleted? | 16:10 |
| *** jaosorior has joined #tripleo | 16:11 | |
| panda | derekh: ouch | 16:11 |
| derekh | sshnaidm: not sure, we can take a look at that after the reboot to see what causes them to be left behind | 16:11 |
| openstackgerrit | Luke Hinds proposed openstack/tripleo-heat-templates: Manage disallow_iframe_embed https://review.openstack.org/409109 | 16:13 |
| derekh | [heat-admin@overcloud-novacompute-21 ~]$ sudo ovs-vsctl show | grep Port | wc | 16:13 |
| derekh | 1595 3190 47791 | 16:13 |
| trozet | shardy: Is there any plan to make creating custom networks/subnets easier/more dynamic? It looks like there is a dynamic way to create an extra network, but creating an extra subnet and assigning IPs to ports, creating a VIP seems like it involves changing THT code | 16:13 |
| *** dtantsur is now known as dtantsur|brb | 16:13 | |
| kodokuuu | shardy If I use --control-flavor baremetal --compute-flavor baremetal ... that delete flavor issue no ? | 16:14 |
| shardy | trozet: Yeah it's been discussed, along with making it easier to transparently enable network isolation in combination with custom roles | 16:15 |
| trozet | shardy: is there a blueprint for it? or a target release? | 16:15 |
| *** jayg|g0n3 is now known as jayg | 16:15 | |
| *** saneax-_-|AFK is now known as saneax | 16:16 | |
| shardy | trozet: https://bugs.launchpad.net/tripleo/+bug/1633090 is one part of it - dsneddon took that so I'd say check with him on the ETA | 16:16 |
| openstack | Launchpad bug 1633090 in tripleo "composable roles and network isolation" [Medium,In progress] - Assigned to Dan Sneddon (dsneddon) | 16:16 |
| sshnaidm | derekh, seems like real bug.. 1500 ports, omg | 16:17 |
| shardy | trozet: I suspect a side-effect of fixing that bug will be that it becomes easier to create custom networks | 16:17 |
| derekh | sshnaidm: yup | 16:17 |
| shardy | trozet: I thought there was a BP for custom networks, but I'm not finding it, so I'd assume probably not landing for Ocata unless dsneddon says otherwise | 16:17 |
| trozet | shardy: ok cool, thanks | 16:17 |
| *** ccamacho has joined #tripleo | 16:18 | |
| *** trown|brb is now known as trown | 16:18 | |
| *** shardy has quit IRC | 16:19 | |
| trozet | shardy: in OPNFV we use a flat networking file to define networks, and then we render that using python libs and jinja 2 into the nic ports, and network isolation templates...not sure if that is a direction OOO might be interested in going | 16:22 |
| trozet | shardy: so a user only needs to give this https://github.com/opnfv/apex/blob/master/config/network/network_settings.yaml | 16:24 |
| *** dtrainor has joined #tripleo | 16:24 | |
| trozet | shardy: then we use jinja2 like this to render the nic templates https://github.com/opnfv/apex/blob/master/build/nics-template.yaml.jinja2 | 16:24 |
| trozet | shardy: our use case is more narrow because we have a preset number of networks allowed in OPNFV, but I think you could expand on that idea to make OOO network settings more dynamic and a more simple interface for the user | 16:26 |
| *** pradk- has joined #tripleo | 16:28 | |
| *** pradk- has joined #tripleo | 16:29 | |
| *** pradk- has quit IRC | 16:29 | |
| *** pradk- has joined #tripleo | 16:30 | |
| *** pradk- has quit IRC | 16:30 | |
| *** pradk has quit IRC | 16:31 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Use os-net-config in multinode jobs https://review.openstack.org/409346 | 16:31 |
| *** pradk has joined #tripleo | 16:32 | |
| EmilienM | derekh: thanks for the updata | 16:32 |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata https://review.openstack.org/404831 | 16:34 |
| *** kodokuuu has quit IRC | 16:39 | |
| *** kodokuuu has joined #tripleo | 16:40 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Run upgrade steps before post-deploy config https://review.openstack.org/409857 | 16:42 |
| openstackgerrit | Ana Krivokapic proposed openstack/python-tripleoclient: Don't create swift container if plan creation fails https://review.openstack.org/409350 | 16:44 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: config for containerized-compute https://review.openstack.org/393348 | 16:52 |
| *** aufi has joined #tripleo | 16:53 | |
| *** dsneddon has joined #tripleo | 16:53 | |
| *** weshay is now known as weshay_brb | 16:54 | |
| *** dsneddon has quit IRC | 16:54 | |
| *** dsneddon has joined #tripleo | 16:54 | |
| *** owalsh is now known as owalsh-afk | 16:56 | |
| *** dtantsur|brb is now known as dtantsur | 16:56 | |
| openstackgerrit | Ben Nemec proposed openstack/diskimage-builder: Don't set the executable bit on dhcp-interface@.service https://review.openstack.org/409863 | 16:57 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras: Add workaround step to avoid introspection failure https://review.openstack.org/408748 | 16:58 |
| florianf | jrist: back! | 16:58 |
| *** pcaruana has quit IRC | 16:59 | |
| *** kodokuuu has quit IRC | 17:03 | |
| *** rhallisey has quit IRC | 17:04 | |
| openstackgerrit | Saverio Proto proposed openstack/diskimage-builder: openssh-server element: do nothing if sysv used by Debian Wheezy https://review.openstack.org/409866 | 17:05 |
| *** saneax is now known as saneax-_-|AFK | 17:06 | |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1649252 in tripleo "CI: OVB jobs are failing in CI" [Critical,In progress] | 17:10 |
| *** sudipto has quit IRC | 17:13 | |
| *** akuznetsov has joined #tripleo | 17:17 | |
| *** panda is now known as panda|afk | 17:18 | |
| *** b00tcat has quit IRC | 17:20 | |
| bnemec | Oh goody, all of our rh1 compute nodes just died. | 17:23 |
| bnemec | Well, all but one, but I'm sure that one will go down shortly too. | 17:23 |
| *** shardy has joined #tripleo | 17:24 | |
| shardy | mwhahaha: Hey when you get a sec could you please check out https://bugs.launchpad.net/tripleo/+bug/1649341 ? | 17:26 |
| openstack | Launchpad bug 1649341 in tripleo "Undercloud upgrade fails with "Cell mappings are not created, but required for Ocata"" [Undecided,Triaged] | 17:26 |
| mwhahaha | shardy: ok | 17:26 |
| shardy | unless I'm mistaken undercloud upgrades are currently broken due to a nova change not yet handled by puppet-nova | 17:26 |
| shardy | mwhahaha: thanks! | 17:26 |
| mwhahaha | sounds about right but that's a terrible nova feature | 17:27 |
| shardy | it's actually not that clear how to work around manually either, as it seems the nova-manage help text and release notes are wrong | 17:27 |
| shardy | Yeah, it should be transparently handled by the api DB sync | 17:27 |
| shardy | but it seems to need some magic which connects directly to the RPC | 17:27 |
| *** akuznetsov has quit IRC | 17:29 | |
| hewbrocca | wut | 17:30 |
| *** karimb has quit IRC | 17:30 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui: Adds basic internationalization support https://review.openstack.org/399626 | 17:31 |
| EmilienM | pradk: would you be interested to add Panko in CI scenario001? | 17:31 |
| EmilienM | pradk: like we have all other telemetry services already | 17:31 |
| EmilienM | pradk: you would need to patch THT and project-config also | 17:32 |
| *** nyechiel has quit IRC | 17:34 | |
| EmilienM | shardy: I plan to release tripleo ocata-2 on Thursday. Wdyt? | 17:34 |
| *** dprince has joined #tripleo | 17:35 | |
| *** jpich has quit IRC | 17:35 | |
| shardy | EmilienM: ack, sounds good | 17:35 |
| shardy | EmilienM: it'd be good to fix this undercloud upgrade issue if possible before then, or folks won't be able to consume ocata-2 | 17:35 |
| shardy | Or, at least, upgrade to it | 17:36 |
| *** b00tcat has joined #tripleo | 17:36 | |
| *** b00tcat has quit IRC | 17:36 | |
| *** b00tcat has joined #tripleo | 17:36 | |
| *** udesale has quit IRC | 17:37 | |
| bnemec | sshnaidm: Did you reboot all of the rh1 compute nodes? | 17:37 |
| bnemec | And is there somewhere besides https://bugs.launchpad.net/tripleo/+bug/1649252 that we're tracking the work to get rh1 working again? | 17:37 |
| openstack | Launchpad bug 1649252 in tripleo "CI: OVB jobs are failing in CI" [Critical,In progress] | 17:38 |
| EmilienM | shardy: that one ? https://bugs.launchpad.net/tripleo/+bug/1649341 | 17:39 |
| openstack | Launchpad bug 1649341 in tripleo "Undercloud upgrade fails with "Cell mappings are not created, but required for Ocata"" [Undecided,Triaged] | 17:39 |
| EmilienM | yeah it sounds critical to me too | 17:39 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras: Add workaround step to avoid introspection failure https://review.openstack.org/408748 | 17:39 |
| EmilienM | mwhahaha: ping me if you need help and/or quick review | 17:39 |
| shardy | EmilienM: Yeah - atm I've not found any workaround, but I assume figuring out what --transport-url expects is all we need for a manual workaround | 17:40 |
| mwhahaha | EmilienM: will do | 17:40 |
| mwhahaha | i've also dropped a note in #openstack-nova | 17:40 |
| shardy | it's confusing that argument doesn't handle the same format from nova.conf | 17:40 |
| mwhahaha | cause this seems wrong in general | 17:40 |
| EmilienM | mwhahaha: btw, about transport-url. Do we have some WIP to move tripleo using the new param? | 17:40 |
| mwhahaha | not that i'm aware of | 17:41 |
| sshnaidm | bnemec, I think derekh wanted to | 17:41 |
| sshnaidm | bnemec, https://etherpad.openstack.org/p/bug-1649252 | 17:41 |
| derekh | bnemec: https://etherpad.openstack.org/p/bug-1649252 | 17:42 |
| *** weshay_brb is now known as weshay | 17:43 | |
| sshnaidm | bnemec, we saw this error with ovs, seems like there is a bug, because there are about 1500 ports on compute hosts which are ovs leftovers | 17:43 |
| bnemec | Okay, thanks | 17:43 |
| EmilienM | mwhahaha: I can start hacking on this later today if you've not started it yet | 17:43 |
| *** athomas has quit IRC | 17:43 | |
| pradk | EmilienM, sure I can look into it | 17:43 |
| EmilienM | pradk: thx. let me know if you need guidance on something. | 17:44 |
| shardy | EmilienM: jaosorior already did it in https://review.openstack.org/#/c/324301/ for the undercloud | 17:44 |
| pradk | will do, thx | 17:44 |
| mwhahaha | EmilienM: i'm going to look at this nova thing first, so if you want to tackle the transport_url that'd be great | 17:44 |
| shardy | EmilienM: the problem is nova-manage doesn't read it from the nova.conf, and the --transport-url expects a different syntax | 17:44 |
| EmilienM | shardy: :'( | 17:45 |
| *** sanagikoki has joined #tripleo | 17:46 | |
| *** lucasagomes is now known as lucas-afk | 17:46 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras: add the containers prep role to the quickstart-extras https://review.openstack.org/400983 | 17:50 |
| *** ohamada has quit IRC | 17:51 | |
| *** milan has quit IRC | 17:51 | |
| EmilienM | weshay: what are remaining blockers to have container CI job with oooq in place? | 17:51 |
| EmilienM | weshay: is that your patches that we miss and that's it? | 17:51 |
| *** milan has joined #tripleo | 17:51 | |
| *** hewbrocca is now known as hewbrocca_afk | 17:52 | |
| weshay | EmilienM, two things.. one, I'm testing this patch w/ my latest runs https://review.openstack.org/#/c/395880/ | 17:53 |
| weshay | EmilienM, also flaper87 would like the role to be renamed | 17:53 |
| weshay | I hit a couple errors this morning w/ ssh timing out on the undercloud, but trown already fixed that | 17:53 |
| *** jlinkes has quit IRC | 17:54 | |
| openstackgerrit | Tomas Sedovic proposed openstack/tripleo-specs: Validations in TripleO Workflows https://review.openstack.org/393281 | 17:57 |
| *** openstack has joined #tripleo | 17:58 | |
| *** bkopilov has joined #tripleo | 17:59 | |
| *** fragatina has joined #tripleo | 17:59 | |
| *** fragatina has quit IRC | 17:59 | |
| *** fragatina has joined #tripleo | 18:00 | |
| *** aufi has quit IRC | 18:01 | |
| derekh | sshnaidm: panda|afk bnemec EmilienM nearly all of the compute nodes are back, the last few are still cleaning ovs ports, I'm popping out but will be back to finish things up in about an hour | 18:01 |
| *** ebarrera has quit IRC | 18:02 | |
| derekh | if anybody wants to continue, I'd suggest waiting for all the compute node to report as "UP" in nova service-list , then start deleting the ci testenv heat stacks | 18:02 |
| *** derekh is now known as derekh_afk | 18:02 | |
| *** jaosorior has quit IRC | 18:03 | |
| *** dtantsur is now known as dtantsur|afk | 18:05 | |
| weshay | anyone have the ip where the upstream images are housed? | 18:09 |
| weshay | http://66.187.229.139/builds/current-tripleo is currently down | 18:09 |
| *** jpena is now known as jpena|away | 18:09 | |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 18:10 |
| openstack | Launchpad bug 1649252 in tripleo "CI: rh1 compute nodes not spawning vms correctly" [Critical,In progress] | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| jrist | florianf: forgot my question :) | 18:12 |
| *** fzdarsky is now known as fzdarsky|afk | 18:17 | |
| openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras: Expose the tempest results to the top level of the collected logs https://review.openstack.org/404710 | 18:17 |
| *** derekh_afk is now known as derekh | 18:22 | |
| derekh | back, quick hour | 18:22 |
| *** yamahata has quit IRC | 18:23 | |
| panda|afk | derekh: tripleo.org and the ip with the stored images are down, I see there are three instances shutoff in nova list there | 18:23 |
| *** Vijayendra has quit IRC | 18:27 | |
| derekh | panda|afk: ya, I hadn't brought it back yet as I was waitong on the compute nodes to be ready | 18:28 |
| *** Vijayendra has joined #tripleo | 18:28 | |
| derekh | panda|afk: it should be up in a few seconds | 18:28 |
| derekh | was selinux on http://tripleo.org/ set to permissive? I've had to set it again so it would work... | 18:30 |
| *** jkilpatr has joined #tripleo | 18:31 | |
| florianf | jrist: :-) | 18:31 |
| panda|afk | derekh: I see it up, which of the other nodes is the one with the promoted images ? | 18:32 |
| *** ayoung_afk is now known as ayoung | 18:32 | |
| *** fragatina has quit IRC | 18:33 | |
| *** jkilpatr has quit IRC | 18:33 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui: Add dependencies for UI internationalisation https://review.openstack.org/401205 | 18:33 |
| *** jkilpatr has joined #tripleo | 18:33 | |
| derekh | panda|afk: the mirror server, I'll start it now | 18:34 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui: Adds basic internationalization support https://review.openstack.org/399626 | 18:34 |
| *** dprince has quit IRC | 18:36 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui: Fix blank overcloud credentials https://review.openstack.org/408138 | 18:36 |
| *** akrivoka has quit IRC | 18:38 | |
| *** flepied has joined #tripleo | 18:40 | |
| *** karimb has joined #tripleo | 18:40 | |
| *** rasca has quit IRC | 18:45 | |
| *** tosky has quit IRC | 18:46 | |
| panda|afk | derekh: thanks, is that in rh2 ? | 18:49 |
| derekh | panda|afk: rh1 | 18:49 |
| *** shardy is now known as shardy_afk | 18:50 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras: Add workaround step to avoid introspection failure https://review.openstack.org/408748 | 18:50 |
| *** derekh is now known as derekh_afk | 18:56 | |
| *** trown|lunch is now known as trown | 19:01 | |
| *** fragatina has joined #tripleo | 19:03 | |
| *** dsneddon has quit IRC | 19:06 | |
| *** bvandenh has joined #tripleo | 19:06 | |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1649252 in tripleo "CI: rh1 compute nodes not spawning vms correctly" [Critical,In progress] | 19:10 |
| *** jprovazn has quit IRC | 19:13 | |
| *** dsneddon has joined #tripleo | 19:17 | |
| *** dhill_ has quit IRC | 19:18 | |
| *** yamahata has joined #tripleo | 19:20 | |
| *** dhill_ has joined #tripleo | 19:23 | |
| *** fragatina has quit IRC | 19:23 | |
| *** fragatina has joined #tripleo | 19:24 | |
| *** rhallisey has joined #tripleo | 19:25 | |
| *** dsneddon_ has joined #tripleo | 19:27 | |
| *** lmiccini has quit IRC | 19:29 | |
| *** Goneri has joined #tripleo | 19:30 | |
| *** florianf has quit IRC | 19:31 | |
| *** dsariel has quit IRC | 19:31 | |
| *** amoralej is now known as amoralej|off | 19:51 | |
| EmilienM | multinode jobs are also failing, and will work when https://review.rdoproject.org/r/#/c/4060/ is merged | 19:57 |
| EmilienM | derekh_afk: how is rh1 doing now? | 19:58 |
| *** egafford has quit IRC | 19:58 | |
| *** Goneri has quit IRC | 20:00 | |
| *** dbecker has quit IRC | 20:00 | |
| stevebaker | morning | 20:02 |
| *** bvandenh has quit IRC | 20:09 | |
| EmilienM | mwhahaha: i'm doing the transport_url thing for overcloud/nova (once it's done i'll finish undercloud and other services in overcloud) | 20:09 |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1649252 in tripleo "CI: rh1 compute nodes not spawning vms correctly" [Critical,In progress] | 20:10 |
| *** egafford has joined #tripleo | 20:16 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Use os-net-config in multinode jobs https://review.openstack.org/409346 | 20:21 |
| *** oshvartz has joined #tripleo | 20:21 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo: WIP DO NOT MERGE Make bootstrap_node checks more robust https://review.openstack.org/408726 | 20:24 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: nova: use transport_url for rabbitmq https://review.openstack.org/409911 | 20:24 |
| EmilienM | mwhahaha: can you look ^ ? | 20:24 |
| *** saibarspeis has quit IRC | 20:26 | |
| derekh_afk | EmilienM: still working on things, shouldn't be much longer | 20:26 |
| EmilienM | derekh_afk: thanks for helping | 20:26 |
| *** derekh_afk is now known as derekh | 20:26 | |
| derekh | EmilienM: np | 20:26 |
| EmilienM | mwhahaha: wait, I did an error | 20:27 |
| Ng | am I right in thinking that an overcloud deploy using tripleoclient, will read in files from ~/.tripleo/environment/ ? | 20:28 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: nova: use transport_url for rabbitmq https://review.openstack.org/409911 | 20:29 |
| EmilienM | mwhahaha: if you like this patch, I can do for all other services ^ | 20:33 |
| mwhahaha | k let me look | 20:34 |
| mwhahaha | EmilienM: I don't like hiera calls in the class body | 20:34 |
| *** ctayal has joined #tripleo | 20:35 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart: Update OOOQ to ansible 2.2 https://review.openstack.org/398194 | 20:36 |
| EmilienM | mwhahaha: why? we do that everywhere already | 20:38 |
| mwhahaha | because tests | 20:38 |
| mwhahaha | i don't -1 haproxy because that thing is a mess, but just about everywhere else any new hiera calls should go in the params | 20:38 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo: WIP DO NOT MERGE Initial pacemaker remote profile support https://review.openstack.org/400967 | 20:39 |
| mwhahaha | trying to test things via hiera is a huge pain | 20:39 |
| EmilienM | mwhahaha: fair enough, let me add params | 20:39 |
| mwhahaha | also because you should add tests :D | 20:40 |
| EmilienM | mwhahaha: that's the moment where my IRC client disconnect? | 20:40 |
| mwhahaha | :D | 20:41 |
| mwhahaha | kidding, that class would be painful to add tests due to -> hiera lookups | 20:41 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: nova: use transport_url for rabbitmq https://review.openstack.org/409911 | 20:45 |
| EmilienM | mwhahaha: better? | 20:45 |
| mwhahaha | i don't think you need the any2array | 20:46 |
| mwhahaha | but yea better | 20:46 |
| mwhahaha | let me look | 20:46 |
| *** pkovar has quit IRC | 20:46 | |
| EmilienM | mwhahaha: well, it was here :D | 20:46 |
| EmilienM | mwhahaha: and I think it's safe to have it, since rabbit_hosts waits for an array | 20:46 |
| mwhahaha | i don't think it has to be an array | 20:47 |
| mwhahaha | in the function | 20:47 |
| mwhahaha | oh you're right | 20:47 |
| *** dsariel has joined #tripleo | 20:47 | |
| mwhahaha | hosts expects an array | 20:47 |
| mwhahaha | https://github.com/openstack/puppet-openstacklib/blob/master/lib/puppet/parser/functions/os_transport_url.rb#L71 | 20:48 |
| EmilienM | mwhahaha: right. We might want to transform the ssl thing in a boolean. Wdyt? | 20:48 |
| mwhahaha | wasn't someone looking into supporting amqp rather than just rabbit | 20:48 |
| bandini | mwhahaha: that would be jeckersb and ken giusti (at least) | 20:49 |
| *** shardy_afk has quit IRC | 20:49 | |
| mwhahaha | EmilienM: probably | 20:49 |
| EmilienM | mwhahaha: I'll look at that | 20:50 |
| mwhahaha | bandini: cool | 20:50 |
| mwhahaha | EmilienM: if we also add transport as a parameter, switching out amqp would be a simpel step (feature creep) :D | 20:50 |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci: Remove the current CI matrix from tripleo-ci https://review.openstack.org/409697 | 20:51 |
| mwhahaha | EmilienM: or maybe we want to rename them from rabbit_* | 20:51 |
| bandini | mwhahaha, EmilienM: https://review.openstack.org/#/c/408303/ can you guys tip me in the right direction to do that a bit more cleanly (if you have some time)? right now it feels pretty horrid to me | 20:51 |
| mwhahaha | bandini: use a fact? | 20:52 |
| EmilienM | mwhahaha: we still need to build this parameter | 20:52 |
| mwhahaha | bandini: https://review.openstack.org/#/c/408303/4/manifests/constraint/base.pp@117 is_pcmk_remote should probably be a fact or something | 20:53 |
| mwhahaha | EmilienM: right but if we make the var names generic (default to rabbit), switching to amqp is just a THT | 20:53 |
| bandini | mwhahaha: oh I see. I'll look up how to make one. Thanks! | 20:53 |
| mwhahaha | EmilienM: the os_transport_url would work for rabbit/zmq/amqp since they all share this param | 20:54 |
| mwhahaha | bandini: the only issue with facts are that they are calculated before the run so if pacemaker_remote is not installed prior to the puppet run the fact wouldn't be able to be looked up | 20:54 |
| mwhahaha | bandini: so i'm not sure if that's something where a fact would work here, but it seems like a central configuration option if we don't go down the fact route | 20:55 |
| EmilienM | mwhahaha: oh I see | 20:56 |
| EmilienM | mwhahaha: ok let me do another attempt :D | 20:56 |
| mwhahaha | EmilienM: I only ask since i know there's existing work to possibly support amqp and we're touching all this stuff anyway, why not future proof it a bit :) | 20:56 |
| *** karimb has quit IRC | 20:57 | |
| *** zoli|wfh is now known as zoli|gone | 20:57 | |
| bandini | mwhahaha: oh I see yeah that might be a problem (pacemaker_remote installation) I mean | 20:57 |
| mwhahaha | bandini: but if we have a flag on a class to install pacemaker vs pacemaker_remote then we might be able to look it up in the appropriate places | 20:57 |
| mwhahaha | bandini: so i guess the question is where does the pacemaker_remote installation occur? | 20:58 |
| *** dprince has joined #tripleo | 20:58 | |
| bandini | mwhahaha: ah righto, so the thing is I configure pacemaker_remote via a tripleo profile::base class, because the puppet pacemaker class did not support it | 20:59 |
| bandini | I guess I need to look into doing it via the puppet-pacemaker class which would solve this properly | 20:59 |
| mwhahaha | yea | 20:59 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: nova: use transport_url for rabbitmq https://review.openstack.org/409911 | 20:59 |
| *** chlong has joined #tripleo | 21:01 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: nova: use transport_url for rabbitmq https://review.openstack.org/409911 | 21:01 |
| *** yprokule has quit IRC | 21:01 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Make network-isolation environment rendered for all roles https://review.openstack.org/409920 | 21:02 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add network_data.yaml to encapsulate list of networks for j2 https://review.openstack.org/409921 | 21:02 |
| *** dprince has quit IRC | 21:03 | |
| derekh | EmilienM: bnemec sshnaidm panda|afk ok, I think we are back up and running, testenvs are being created in less then 3 minutes, I may have forgotten something I guess we'll know later if jobs don't start passing | 21:07 |
| EmilienM | derekh: excellent, thanks, sounds like CI should work again, we also fixed a puppet problem | 21:07 |
| derekh | cool | 21:08 |
| *** chom_ has joined #tripleo | 21:08 | |
| EmilienM | derekh: thx again for staying late | 21:08 |
| bnemec | derekh: Cool | 21:08 |
| sshnaidm | derekh, great news, thanks! | 21:08 |
| derekh | np | 21:09 |
| bnemec | I noticed we have a bunch of leftover resources (ports, networks, etc) from previous environments. | 21:09 |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1649252 in tripleo "CI: rh1 compute nodes not spawning vms correctly" [Critical,In progress] | 21:10 |
| bnemec | I've started a cleanup loop that should remove all of them, but it's going to take a long time to iterate through the 20000+ possible environment ids we had gone through. | 21:10 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Make network-isolation environment rendered for all roles https://review.openstack.org/409920 | 21:11 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Add network_data.yaml to encapsulate list of networks for j2 https://review.openstack.org/409921 | 21:11 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Add panko to scenario 1 https://review.openstack.org/409701 | 21:11 |
| *** ansmith has quit IRC | 21:12 | |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Add CI matrix to THT https://review.openstack.org/409692 | 21:14 |
| *** jpena|away is now known as jpena|off | 21:15 | |
| chom_ | anyone have any pointers as to logging into an overcloud node via console? i can't find stack or root passwords anywhere, just the ssh keys | 21:15 |
| chom_ | err, not "stack"- the "heat-admin" user password is what I'm looking for | 21:15 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Enable squid https://review.openstack.org/406927 | 21:17 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Enable test env services https://review.openstack.org/409930 | 21:17 |
| *** zaneb has quit IRC | 21:17 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Set the default event pipeline publisher https://review.openstack.org/409931 | 21:18 |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Do Not Merge - test https://review.openstack.org/409932 | 21:18 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Set the default event pipeline publisher https://review.openstack.org/409931 | 21:19 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Do Not Merge - test https://review.openstack.org/409933 | 21:19 |
| *** derekh is now known as derekh_afk | 21:21 | |
| jidar | don't think he has a password | 21:22 |
| jidar | when you spun up the undercloud node, you likely had to create a root account and password, no? | 21:22 |
| *** jayg is now known as jayg|g0n3 | 21:25 | |
| bnemec | chom_: By default there are no passwords set, so you can't log in to the console. | 21:26 |
| jidar | bnemec: yea but when you install the OS on the undercloud, you're likely creating a user with a password there, no? | 21:26 |
| bnemec | The simplest way I've found is to set a root password in the overcloud-full image and use that to get in. | 21:26 |
| jidar | oh crap, he said overcloud ndoe | 21:26 |
| bnemec | jidar: chom_ is asking about logging in to an overcloud node. | 21:26 |
| jidar | sorry! | 21:26 |
| *** egafford has quit IRC | 21:27 | |
| jidar | then yea, you'll need to set a password in the image otherwise ssh keys from the undercloud for the heat-admin user are the only way | 21:27 |
| *** fzdarsky|afk has quit IRC | 21:27 | |
| bnemec | You can virt-customize overcloud-full.qcow2 and then re-upload it to glance. | 21:27 |
| chom_ | yeah, i was afraid of that | 21:27 |
| chom_ | i have the situation in place now, was trying to avoid teardown | 21:27 |
| jidar | tip: the undercloud is very important :) | 21:27 |
| chom_ | haha yes! | 21:27 |
| jidar | I typically put all my artifacts in git, that is the templates I customize, the json file for the nodes, and my post-deploy customizations | 21:28 |
| bnemec | There's some dynamic-login functionality in the IPA ramdisk that I've been meaning to look into adding to overcloud-full, but I haven't gotten around to it yet. :-/ | 21:28 |
| *** egafford has joined #tripleo | 21:29 | |
| *** ccamacho has quit IRC | 21:30 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: nova: use transport_url for rabbitmq https://review.openstack.org/409911 | 21:32 |
| *** jkilpatr has quit IRC | 21:33 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Use df instead of findmnt in cephstorage upgrade scripts https://review.openstack.org/409940 | 21:38 |
| *** gfidente has quit IRC | 21:41 | |
| openstackgerrit | Ben Nemec proposed openstack/diskimage-builder: Use %i instead of %I in dhcp-interface@.service https://review.openstack.org/409947 | 21:49 |
| *** zaneb has joined #tripleo | 21:54 | |
| *** liverpooler has quit IRC | 21:58 | |
| *** zaneb has quit IRC | 22:00 | |
| *** trown is now known as trown|outtypewww | 22:05 | |
| *** jpena|off is now known as jpena | 22:05 | |
| sai | anyone happens to know if ci is broken? | 22:07 |
| sai | -1ing all patches | 22:07 |
| mwhahaha | yea i think it is | 22:10 |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1649252 in tripleo "CI: rh1 compute nodes not spawning vms correctly" [Critical,In progress] | 22:10 |
| *** zaneb has joined #tripleo | 22:12 | |
| bnemec | sai: It should be running again, but we haven't had time to get results back from it yet. | 22:16 |
| sai | bnemec: ack, thanks | 22:18 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart: Run extras playbook by default https://review.openstack.org/407555 | 22:20 |
| *** rhallisey has quit IRC | 22:20 | |
| mwhahaha | http://logs.openstack.org/18/409018/3/gate/gate-tripleo-ci-centos-7-scenario003-multinode-puppet/c9b65b0/logs/postci.txt.gz#_2016-12-12_20_14_11_000 | 22:20 |
| mwhahaha | is the hiera data hosed? or did that get fixed? | 22:20 |
| *** milan has quit IRC | 22:23 | |
| *** myoung is now known as myoung|bbl | 22:24 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Deploy network envs appropriate for the job https://review.openstack.org/347503 | 22:24 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Test with bonded public interface https://review.openstack.org/385562 | 22:24 |
| *** dmsimard has quit IRC | 22:26 | |
| *** dmsimard has joined #tripleo | 22:26 | |
| *** dmsimard has quit IRC | 22:27 | |
| *** dmsimard has joined #tripleo | 22:28 | |
| *** dmsimard has quit IRC | 22:29 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart: Run extras playbook by default https://review.openstack.org/407555 | 22:34 |
| EmilienM | mwhahaha: that error is terrible http://logs.openstack.org/31/404831/29/check/gate-tripleo-ci-centos-7-nonha-multinode/6b56bd0/logs/postci.txt.gz#_2016-12-12_17_09_32_000 | 22:34 |
| EmilienM | mwhahaha: puppetlabs-ntp from master fails even with puppet4 | 22:35 |
| mwhahaha | EmilienM: well the error was the hieradata was undef | 22:35 |
| mwhahaha | oh it's param failures | 22:35 |
| mwhahaha | either way, seems crappy | 22:35 |
| *** dmsimard has joined #tripleo | 22:37 | |
| *** egafford has quit IRC | 22:38 | |
| openstackgerrit | Koki Sanagi proposed openstack/puppet-tripleo: Add networking-fujitsu support to puppet-tripleo https://review.openstack.org/404938 | 22:40 |
| *** jkilpatr has joined #tripleo | 22:51 | |
| *** b00tcat has quit IRC | 22:51 | |
| *** paramite has quit IRC | 22:52 | |
| *** mhenkel has quit IRC | 22:53 | |
| *** morazi has quit IRC | 22:55 | |
| *** jpena is now known as jpena|off | 22:55 | |
| *** ctayal has quit IRC | 22:58 | |
| *** b00tcat has joined #tripleo | 23:04 | |
| *** pmannidi has quit IRC | 23:07 | |
| *** pmannidi has joined #tripleo | 23:07 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1649252 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1649252 in tripleo "CI: rh1 compute nodes not spawning vms correctly" [Critical,In progress] | 23:10 |
| *** thrash is now known as thrash|g0ne | 23:12 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: CI test - never merge https://review.openstack.org/409969 | 23:14 |
| *** chom_ has quit IRC | 23:17 | |
| *** sanagikoki has quit IRC | 23:19 | |
| *** iranzo has quit IRC | 23:37 | |
| *** pradk has quit IRC | 23:40 | |
| derekh_afk | EmilienM, bnemec: OK, I'm calling it a night, master still seems to be failing but I don't think is OVB related as the newton jobs are passing and introspection on master is passing | 23:44 |
| EmilienM | derekh_afk: we had the puppet issue just fixed | 23:44 |
| EmilienM | I think it should be fine now | 23:44 |
| EmilienM | i'll monitor that | 23:44 |
| EmilienM | derekh_afk: good night sir | 23:44 |
| derekh_afk | EmilienM: ok, cool, ttyl | 23:44 |
| *** derekh_afk has quit IRC | 23:45 | |
| bnemec | I saw some scheduling failures in the jobs I spot checked, but I'm kind of trying to wait until we have some more jobs completed before I try to guess at any trends. | 23:47 |
| bnemec | Also because rh1's controller was pegged for a while there when all the jobs started being consumed again and that will likely cause some spurious failures too. | 23:47 |
| *** mhenkel has joined #tripleo | 23:50 | |
| dhill_ | hey? | 23:53 |
| dhill_ | bnemec, still here? | 23:53 |
| dhill_ | bnemec, how are you? | 23:53 |
| dhill_ | bnemec, and how do I deploy a vxlan tunnel with ocata? :S | 23:53 |
| EmilienM | dhill_: a vxlan tunnel? can you be more specific? are you deploying neutron with vxlan mechanism driver? | 23:56 |
| EmilienM | err, openvswitch mechanism driver | 23:56 |
| *** rhallisey has joined #tripleo | 23:58 | |
| *** mhenkel has quit IRC | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!