openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK https://review.openstack.org/430277 | 00:00 |
---|---|---|
*** owalsh_ has joined #tripleo | 00:02 | |
*** owalsh_ has quit IRC | 00:04 | |
*** owalsh-afk has quit IRC | 00:04 | |
*** owalsh-afk has joined #tripleo | 00:05 | |
*** rlandy has quit IRC | 00:05 | |
*** owalsh-afk has quit IRC | 00:05 | |
*** rhallisey has quit IRC | 00:06 | |
*** rhallisey has joined #tripleo | 00:07 | |
*** ckyriakidou has quit IRC | 00:11 | |
*** rhallisey has quit IRC | 00:12 | |
*** rdopiera has quit IRC | 00:16 | |
*** rdopiera has joined #tripleo | 00:18 | |
*** owalsh has quit IRC | 00:21 | |
*** owalsh has joined #tripleo | 00:22 | |
*** limao has joined #tripleo | 00:23 | |
*** limao has quit IRC | 00:24 | |
*** limao has joined #tripleo | 00:25 | |
*** lucas-afk has quit IRC | 00:34 | |
*** smalleni has quit IRC | 00:35 | |
*** rook has quit IRC | 00:36 | |
*** lucasagomes has joined #tripleo | 00:37 | |
*** sai has joined #tripleo | 00:37 | |
*** saneax is now known as saneax-_-|AFK | 00:40 | |
*** jaganathan has quit IRC | 00:40 | |
*** rook has joined #tripleo | 00:42 | |
*** rook is now known as Guest49619 | 00:42 | |
*** kjw3 has joined #tripleo | 00:48 | |
*** lucasagomes has quit IRC | 00:48 | |
*** Guest49619 has quit IRC | 00:49 | |
*** sai has quit IRC | 00:49 | |
*** rook_ has joined #tripleo | 00:50 | |
*** lucasagomes has joined #tripleo | 00:50 | |
*** sai has joined #tripleo | 00:50 | |
*** jaganathan has joined #tripleo | 00:52 | |
bkero | EmilienM: Do you know if scenario003's overcloud pingtest is supposed to fail like this? http://logs.openstack.org/66/442066/6/check/gate-tripleo-ci-centos-7-scenario003-multinode/717d795/console.html#_2017-03-07_13_56_14_175809 | 00:57 |
bkero | actually that seems to be the cleanup failing, but that part should be skipped. Nevermind | 00:57 |
openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: WIP: Switch quickstart config from scenario to multinode-settings https://review.openstack.org/438695 | 00:59 |
openstackgerrit | Ben Kero proposed openstack/tripleo-quickstart-extras master: WIP: Test scenario jobs by manually setting deploy_args https://review.openstack.org/442595 | 01:00 |
*** liverpooler has quit IRC | 01:04 | |
*** kjw3 has quit IRC | 01:05 | |
*** jaganathan has quit IRC | 01:06 | |
*** portdirect is now known as sdake______ | 01:09 | |
*** sdake______ is now known as portdirect | 01:09 | |
*** flepied has joined #tripleo | 01:16 | |
*** rhallisey has joined #tripleo | 01:16 | |
*** jaganathan has joined #tripleo | 01:18 | |
*** dougbtv has quit IRC | 01:21 | |
openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: WIP: Switch quickstart config from scenario to multinode-settings https://review.openstack.org/438695 | 01:32 |
openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: WIP: Switch quickstart config from scenario to multinode-settings https://review.openstack.org/438695 | 01:33 |
*** Goneri has joined #tripleo | 01:43 | |
*** owalsh has quit IRC | 01:50 | |
*** remix_tj has quit IRC | 01:54 | |
*** remix_tj has joined #tripleo | 01:55 | |
*** owalsh has joined #tripleo | 01:57 | |
*** remix_tj has quit IRC | 01:59 | |
*** owalsh has quit IRC | 02:00 | |
*** owalsh has joined #tripleo | 02:00 | |
*** remix_tj has joined #tripleo | 02:01 | |
*** cdearborn has quit IRC | 02:09 | |
*** rhallisey has quit IRC | 02:12 | |
*** pliu has joined #tripleo | 02:15 | |
*** liupe__ has joined #tripleo | 02:17 | |
*** pliu has quit IRC | 02:20 | |
*** remix_tj has quit IRC | 02:20 | |
*** remix_tj has joined #tripleo | 02:23 | |
*** fzdarsky_ has joined #tripleo | 02:31 | |
*** remix_tj has quit IRC | 02:32 | |
*** remix_tj has joined #tripleo | 02:32 | |
*** fzdarsky|afk has quit IRC | 02:35 | |
*** lihi has quit IRC | 02:36 | |
*** remix_tj has quit IRC | 02:36 | |
*** remix_tj has joined #tripleo | 02:38 | |
*** lihi has joined #tripleo | 02:39 | |
*** remix_tj has quit IRC | 02:42 | |
*** remix_tj has joined #tripleo | 02:43 | |
*** owalsh has quit IRC | 02:45 | |
*** owalsh has joined #tripleo | 02:45 | |
*** liupe__ has quit IRC | 02:49 | |
*** remix_tj has quit IRC | 02:50 | |
*** pliu has joined #tripleo | 02:50 | |
*** remix_tj has joined #tripleo | 02:51 | |
*** liupe__ has joined #tripleo | 02:52 | |
openstackgerrit | Feng Pan proposed openstack/puppet-tripleo master: Move etcd to step 2 https://review.openstack.org/442608 | 02:52 |
openstackgerrit | Feng Pan proposed openstack/puppet-tripleo master: Add networking-vpp ML2 mechanism driver support https://review.openstack.org/442529 | 02:54 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements https://review.openstack.org/440124 | 02:55 |
*** owalsh has quit IRC | 02:55 | |
*** remix_tj has quit IRC | 02:56 | |
*** remix_tj has joined #tripleo | 02:58 | |
*** owalsh has joined #tripleo | 02:59 | |
*** owalsh_ has joined #tripleo | 03:06 | |
*** owalsh_ has quit IRC | 03:07 | |
*** remix_tj has quit IRC | 03:08 | |
*** remix_tj has joined #tripleo | 03:09 | |
*** chlong_ has joined #tripleo | 03:15 | |
*** chlong has quit IRC | 03:15 | |
*** remix_tj has quit IRC | 03:18 | |
*** remix_tj has joined #tripleo | 03:22 | |
*** Goneri has quit IRC | 03:26 | |
*** remix_tj has quit IRC | 03:27 | |
*** remix_tj has joined #tripleo | 03:28 | |
*** remix_tj has quit IRC | 03:31 | |
*** gbarros has joined #tripleo | 03:37 | |
*** remix_tj has joined #tripleo | 03:37 | |
*** remix_tj has quit IRC | 03:49 | |
*** remix_tj has joined #tripleo | 03:51 | |
*** dmacpher has joined #tripleo | 03:54 | |
*** gbarros has quit IRC | 03:56 | |
*** fragatin_ has joined #tripleo | 04:01 | |
*** yamahata has quit IRC | 04:02 | |
*** remix_tj has quit IRC | 04:02 | |
*** psahoo has joined #tripleo | 04:02 | |
*** fragatina has quit IRC | 04:04 | |
*** fragatina has joined #tripleo | 04:05 | |
*** remix_tj has joined #tripleo | 04:05 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: WIP, enable quickstart to work with clean base OS images. https://review.openstack.org/442764 | 04:05 |
*** fragatin_ has quit IRC | 04:05 | |
*** fragatina has quit IRC | 04:09 | |
*** jaganathan has quit IRC | 04:10 | |
*** limao has quit IRC | 04:11 | |
*** limao has joined #tripleo | 04:12 | |
*** limao has quit IRC | 04:17 | |
*** remix_tj has quit IRC | 04:20 | |
*** remix_tj has joined #tripleo | 04:22 | |
*** remix_tj has quit IRC | 04:27 | |
*** remix_tj has joined #tripleo | 04:28 | |
*** masterjcool has quit IRC | 04:30 | |
*** udesale has joined #tripleo | 04:31 | |
*** remix_tj has quit IRC | 04:32 | |
*** remix_tj has joined #tripleo | 04:33 | |
*** jaganathan has joined #tripleo | 04:38 | |
*** remix_tj has quit IRC | 04:38 | |
*** remix_tj has joined #tripleo | 04:39 | |
*** links has joined #tripleo | 04:41 | |
*** masterjcool has joined #tripleo | 04:42 | |
EmilienM | bkero: lookin | 04:44 |
*** tzumainn has quit IRC | 04:45 | |
EmilienM | bkero: http://logs.openstack.org/66/442066/6/check/gate-tripleo-ci-centos-7-scenario003-multinode/717d795/console.html#_2017-03-07_13_57_22_888033 | 04:45 |
EmilienM | the pingtest worked fine, isn't? | 04:45 |
*** dsariel has quit IRC | 04:46 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: CI test - never merge https://review.openstack.org/442066 | 04:50 |
openstackgerrit | Feng Pan proposed openstack/puppet-tripleo master: Add networking-vpp ML2 mechanism driver support https://review.openstack.org/442529 | 04:51 |
*** skramaja has joined #tripleo | 04:54 | |
*** remix_tj has quit IRC | 04:56 | |
*** remix_tj has joined #tripleo | 04:57 | |
*** limao has joined #tripleo | 04:57 | |
*** prateek has joined #tripleo | 04:59 | |
*** remix_tj has quit IRC | 05:06 | |
*** jaganathan is now known as jaganathan_afk | 05:06 | |
*** remix_tj has joined #tripleo | 05:08 | |
*** remix_tj has quit IRC | 05:12 | |
*** remix_tj has joined #tripleo | 05:13 | |
*** remix_tj has quit IRC | 05:22 | |
*** remix_tj has joined #tripleo | 05:24 | |
*** remix_tj has quit IRC | 05:29 | |
*** yamahata has joined #tripleo | 05:29 | |
*** remix_tj has joined #tripleo | 05:31 | |
*** remix_tj has quit IRC | 05:36 | |
*** jaganathan_afk is now known as jaganathan | 05:39 | |
*** remix_tj has joined #tripleo | 05:40 | |
skramaja | marios: fyi - in newton (10), after removing the ovs special case, minor update failed because of ovs restarting and and failing. | 05:40 |
*** remix_tj has quit IRC | 05:45 | |
*** fragatina has joined #tripleo | 05:46 | |
*** remix_tj has joined #tripleo | 05:46 | |
*** fragatin_ has joined #tripleo | 05:48 | |
*** fragatina has quit IRC | 05:51 | |
*** fragatin_ has quit IRC | 05:52 | |
*** remix_tj has quit IRC | 05:55 | |
*** yprokule has joined #tripleo | 06:00 | |
*** dmacpher has quit IRC | 06:01 | |
*** remix_tj has joined #tripleo | 06:01 | |
openstackgerrit | Peng Liu proposed openstack/puppet-tripleo master: Adds ability to disable kdump service https://review.openstack.org/442956 | 06:05 |
*** pkovar has joined #tripleo | 06:07 | |
*** limao has quit IRC | 06:13 | |
*** limao_ has joined #tripleo | 06:13 | |
*** abehl has quit IRC | 06:15 | |
openstackgerrit | Peng Liu proposed openstack/puppet-tripleo master: Adds ability to disable kdump service https://review.openstack.org/442956 | 06:16 |
*** remix_tj has quit IRC | 06:16 | |
*** remix_tj has joined #tripleo | 06:17 | |
*** Vijayendra has quit IRC | 06:28 | |
*** remix_tj has quit IRC | 06:30 | |
*** remix_tj has joined #tripleo | 06:31 | |
*** abregman_ has joined #tripleo | 06:33 | |
bkero | EmilienM: not in my case | 06:36 |
bkero | EmilienM: http://logs.openstack.org/95/442595/4/experimental/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-nv/9559d24/logs/oooq/multinode-overcloud-pingtest.txt.gz | 06:37 |
*** fultonj has joined #tripleo | 06:37 | |
bkero | ERROR: HEAT-E99001 Service cinder is not available for resource type OS::Cinder::Volume, reason: cinder volumev3 endpoint is not in service catalog. | 06:38 |
*** jaganathan has quit IRC | 06:38 | |
bkero | I'm wondering if Cinder would be expected to fail since it isn't in scenario003-multinode.yml | 06:41 |
*** skramaja_ has joined #tripleo | 06:42 | |
*** remix_tj has quit IRC | 06:42 | |
*** skramaja has quit IRC | 06:43 | |
*** pcaruana has joined #tripleo | 06:43 | |
*** remix_tj has joined #tripleo | 06:46 | |
*** remix_tj has quit IRC | 06:49 | |
*** abehl has joined #tripleo | 06:49 | |
*** fultonj has quit IRC | 06:50 | |
bkero | Ah, I'm guessing I'm not getting TENANT_PINGTEST_TEMPLATE set correctly | 06:50 |
bkero | Since MULTINODE_ENV_NAME might be wrong | 06:50 |
*** remix_tj has joined #tripleo | 06:51 | |
*** jaganathan has joined #tripleo | 06:51 | |
openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: WIP: Switch quickstart config from scenario to multinode-settings https://review.openstack.org/438695 | 06:53 |
openstackgerrit | John Fulton proposed openstack/puppet-tripleo stable/newton: Include nova::compute::libvirt::qemu from the libvirt profile https://review.openstack.org/442970 | 06:54 |
openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: WIP: Switch quickstart config from scenario to multinode-settings https://review.openstack.org/438695 | 06:55 |
*** dparkes has joined #tripleo | 07:00 | |
*** ealcaniz has joined #tripleo | 07:00 | |
*** remix_tj has quit IRC | 07:00 | |
*** remix_tj has joined #tripleo | 07:01 | |
*** saneax-_-|AFK is now known as saneax | 07:05 | |
*** remix_tj has quit IRC | 07:05 | |
*** remix_tj has joined #tripleo | 07:06 | |
*** aufi has joined #tripleo | 07:06 | |
*** skramaja_ is now known as skramaja | 07:07 | |
openstackgerrit | Merged openstack/puppet-tripleo stable/ocata: Stop the chronyd service https://review.openstack.org/442514 | 07:08 |
bkero | Yep, that seems to be the case. That last patchset fixes it ^ | 07:09 |
*** remix_tj has quit IRC | 07:10 | |
*** remix_tj has joined #tripleo | 07:11 | |
*** iranzo has joined #tripleo | 07:14 | |
*** dsneddon has quit IRC | 07:14 | |
*** jtomasek has joined #tripleo | 07:16 | |
*** hjensas has quit IRC | 07:17 | |
*** remix_tj has quit IRC | 07:19 | |
*** remix_tj has joined #tripleo | 07:21 | |
*** dsneddon has joined #tripleo | 07:22 | |
*** jprovazn has joined #tripleo | 07:27 | |
*** skramaja_ has joined #tripleo | 07:34 | |
*** skramaja has quit IRC | 07:35 | |
*** leanderthal|afk is now known as leanderthal | 07:35 | |
*** saibarspeis has joined #tripleo | 07:35 | |
*** masco has joined #tripleo | 07:37 | |
*** skramaja_ is now known as skramaja | 07:38 | |
*** pgadiya has joined #tripleo | 07:38 | |
*** rcernin has joined #tripleo | 07:40 | |
*** remix_tj has quit IRC | 07:40 | |
*** remix_tj has joined #tripleo | 07:40 | |
*** tesseract has joined #tripleo | 07:43 | |
*** remix_tj has quit IRC | 07:45 | |
*** remix_tj has joined #tripleo | 07:46 | |
*** jaosorior has joined #tripleo | 07:50 | |
*** george_goh|afk has quit IRC | 07:51 | |
*** b00tcat has joined #tripleo | 07:51 | |
*** athomas has joined #tripleo | 07:54 | |
*** remix_tj has quit IRC | 07:57 | |
*** pkovar has quit IRC | 07:58 | |
*** pkovar has joined #tripleo | 07:59 | |
*** b00tcat is now known as b00tcat|away | 07:59 | |
*** hewbrocca_afk is now known as hewbrocca | 08:00 | |
*** remix_tj has joined #tripleo | 08:00 | |
*** b00tcat|away is now known as b00tcat | 08:01 | |
*** suuuper has joined #tripleo | 08:01 | |
*** florianf has quit IRC | 08:03 | |
*** tremble has joined #tripleo | 08:04 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job with MySQL https://review.openstack.org/425295 | 08:05 |
*** george_goh has joined #tripleo | 08:05 | |
*** jaganathan has quit IRC | 08:05 | |
*** gfidente has joined #tripleo | 08:06 | |
*** gfidente has quit IRC | 08:06 | |
*** gfidente has joined #tripleo | 08:06 | |
*** remix_tj has quit IRC | 08:06 | |
*** b00tcat has quit IRC | 08:07 | |
*** b00tcat has joined #tripleo | 08:07 | |
*** milan has joined #tripleo | 08:08 | |
*** remix_tj has joined #tripleo | 08:08 | |
*** florianf has joined #tripleo | 08:08 | |
*** agurenko has joined #tripleo | 08:09 | |
*** jlinkes has joined #tripleo | 08:10 | |
*** hjensas has joined #tripleo | 08:10 | |
*** hjensas has quit IRC | 08:10 | |
*** hjensas has joined #tripleo | 08:10 | |
*** fultonj has joined #tripleo | 08:11 | |
*** fzdarsky_ is now known as fzdarsky | 08:11 | |
*** remix_tj has quit IRC | 08:13 | |
*** remix_tj has joined #tripleo | 08:13 | |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Respond to multiple messages from workflow executions https://review.openstack.org/406178 | 08:15 |
d0ugal | Can somebody land this requirements fix? https://review.openstack.org/#/c/440337 | 08:17 |
d0ugal | Unit tests are failing without it for me | 08:17 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: barbican: Use versionless keystone endpoints https://review.openstack.org/442987 | 08:18 |
*** chlong_ has quit IRC | 08:18 | |
d0ugal | jaosorior: thanks! | 08:18 |
d0ugal | matbu: you too :) | 08:18 |
d0ugal | marios: * | 08:18 |
* d0ugal fails | 08:18 | |
marios | o/ | 08:18 |
marios | d0ugal: its ok apparently bandini now has to change his nick to banidini | 08:19 |
d0ugal | lol | 08:19 |
d0ugal | why? | 08:19 |
hewbrocca | marios: or he could just change it to MR-PSE | 08:19 |
marios | d0ugal: i accidentally wrote that in an email this morning | 08:19 |
*** zoli|gone is now known as zoli | 08:19 | |
d0ugal | aha | 08:19 |
*** zoli is now known as zoli|wfh | 08:20 | |
bandini | ahahah I did not even notice | 08:20 |
matbu | d0ugal: no pb, thank you too :) | 08:21 |
*** jaganathan has joined #tripleo | 08:22 | |
d0ugal | lol | 08:22 |
jaosorior | ccamacho, marios: I'm in a review round. Got anything you would like checked? | 08:25 |
*** fultonj has quit IRC | 08:25 | |
marios | jaosorior: thanks jaosorior will let you know.. most things have landed for the upgrades stuff... i have https://review.openstack.org/#/c/436990/ if you want to check it ... once it lands we have to get it to ocata ... and probably newton but that is tbd (actually assaf said this morning we would get it into osp10, i mean ovs 2.6 but i need to check if rdo repos already have it/not) | 08:27 |
*** paramite has joined #tripleo | 08:27 | |
*** mcornea has joined #tripleo | 08:28 | |
matbu | marios: are you fine to land this : https://review.openstack.org/#/c/440337 ? | 08:30 |
matbu | marios: im about to submit it | 08:30 |
*** amoralej|off is now known as amoralej | 08:31 | |
marios | matbu: yeah i already voted there i mean +2A did you mean a differentone? | 08:31 |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-heat-templates master: DON'T MERGE: testin oooq scenario https://review.openstack.org/438858 | 08:34 |
*** bogdando has joined #tripleo | 08:34 | |
matbu | marios: nop that fine | 08:36 |
matbu | marios: erf sorry, /me needs coffee | 08:36 |
matbu | marios: i was not talking about this review :) | 08:37 |
matbu | let me find the right one | 08:37 |
matbu | marios: https://review.gerrithub.io/#/c/351387/ | 08:37 |
matbu | this ^ :) | 08:37 |
marios | matbu: ah yeah sure, i mean i am really not an expert on ansible modules so i can't even commment on the convention (e.g. things like check_and_fail ;) ) i will be including latest in my runs today but if you already ran it then go ahead. i did include it yesterday but was v12 | 08:39 |
matbu | marios: ack, ok | 08:40 |
*** pkovar has quit IRC | 08:40 | |
*** ealcaniz has quit IRC | 08:40 | |
*** jpena|away is now known as jpena | 08:41 | |
*** shardy has joined #tripleo | 08:43 | |
*** sshnaidm|off is now known as sshnaidm | 08:45 | |
*** karimb has joined #tripleo | 08:46 | |
*** gchamoul|afk is now known as gchamoul | 08:46 | |
*** jpich has joined #tripleo | 08:48 | |
*** liupe__ has joined #tripleo | 08:49 | |
*** sudipto has joined #tripleo | 08:50 | |
*** sudipto_ has joined #tripleo | 08:50 | |
*** pmannidi has quit IRC | 08:51 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Merge "Run indent checks in diskimage_builder/lib" into feature/v2 https://review.openstack.org/441723 | 08:52 |
*** abregman_ is now known as abregman | 08:53 | |
ccamacho | hey jaosorior not for today :) but thanks! | 08:55 |
ccamacho | jaosorior, maybe this one https://review.openstack.org/#/c/438959/ | 08:56 |
*** pgadiya has quit IRC | 08:59 | |
*** zzzeek has quit IRC | 09:00 | |
*** ealcaniz has joined #tripleo | 09:00 | |
*** zzzeek has joined #tripleo | 09:00 | |
*** openstackgerrit has quit IRC | 09:03 | |
chem | matbu: hi, commented on your review. This is what is returned http://ix.io/oOp | 09:04 |
*** karimb has quit IRC | 09:05 | |
matbu | chem: ha yep nice | 09:07 |
matbu | chem: i thought it was a string message | 09:07 |
matbu | chem: the module was modified on my test env | 09:07 |
*** limao_ has quit IRC | 09:07 | |
matbu | chem: i landed it and pushed a new release, the new module should available soon via rpm | 09:07 |
chem | matbu: cool, you're the rpm master | 09:08 |
matbu | chem: lol yep, i click on a button and some magics happen then, but idk how :D | 09:09 |
*** openstackgerrit has joined #tripleo | 09:09 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: glance: deploy services with Keystone v3 endpoints https://review.openstack.org/442798 | 09:09 |
*** fultonj has joined #tripleo | 09:09 | |
*** dtantsur|afk is now known as dtantsur | 09:12 | |
*** pgadiya has joined #tripleo | 09:12 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/443013 | 09:13 |
ccamacho | hey bandini! morning, are you around? | 09:14 |
ccamacho | morning all **** (~˘▾˘)~ | 09:14 |
bandini | ccamacho: hola carlos. sortof (in a call atm) | 09:14 |
ccamacho | Wont bug you then, I'll do it in 30 mins :P | 09:15 |
ccamacho | bandini^ | 09:15 |
*** karimb has joined #tripleo | 09:16 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui stable/ocata: Imported Translations from Zanata https://review.openstack.org/443015 | 09:16 |
bandini | ccamacho: feel free to pm stuff and then we'll chat ;) | 09:16 |
*** snecklifter has joined #tripleo | 09:18 | |
*** jaosorior is now known as jaosorior_brb | 09:19 | |
*** ukalifon has joined #tripleo | 09:24 | |
*** ukalifon has quit IRC | 09:25 | |
*** ealcaniz has quit IRC | 09:29 | |
*** fzdarsky is now known as fzdarsky|afk | 09:30 | |
*** ealcaniz has joined #tripleo | 09:30 | |
*** derekh has joined #tripleo | 09:32 | |
*** dtantsur is now known as dtantsur|bbl | 09:34 | |
*** bogdando has quit IRC | 09:37 | |
*** bogdando has joined #tripleo | 09:38 | |
*** lmasiero has joined #tripleo | 09:40 | |
*** ckyriaki has joined #tripleo | 09:47 | |
*** tosky has joined #tripleo | 09:47 | |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates stable/ocata: Remove ha-by-default release note in Ocata https://review.openstack.org/443041 | 09:50 |
openstackgerrit | Merged openstack/python-tripleoclient master: Update to a newer hacking library https://review.openstack.org/440337 | 09:51 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Remove the openvswitch special case upgrade code https://review.openstack.org/436990 | 09:51 |
*** karimb has quit IRC | 09:52 | |
openstackgerrit | Merged openstack/tripleo-common stable/newton: Update to a newer hacking library https://review.openstack.org/439804 | 09:52 |
*** salmankhan has joined #tripleo | 09:52 | |
*** karimb has joined #tripleo | 09:56 | |
openstackgerrit | Merged openstack/python-tripleoclient master: Show stack failures on error https://review.openstack.org/435491 | 10:01 |
openstackgerrit | Merged openstack/python-tripleoclient stable/ocata: Fixed overcloud stack update workflow name error https://review.openstack.org/436535 | 10:01 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Enable the HA deployment by default https://review.openstack.org/359060 | 10:01 |
*** yamahata has quit IRC | 10:02 | |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: [LINTERS] Fix ansible-lint.sh and lint issues https://review.openstack.org/443044 | 10:02 |
*** remix_tj has quit IRC | 10:05 | |
*** remix_tj has joined #tripleo | 10:06 | |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart master: Fix ansible-lint.sh script for roles and playbooks https://review.openstack.org/431456 | 10:07 |
*** iranzo has quit IRC | 10:07 | |
*** iranzo has joined #tripleo | 10:07 | |
*** iranzo has joined #tripleo | 10:07 | |
skramaja | shardy: can you approve this backports for ocata - https://review.openstack.org/#/c/439486/, https://review.openstack.org/#/c/439706/ | 10:07 |
*** fzdarsky|afk is now known as fzdarsky | 10:08 | |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Adding env file for a non-ha deployment https://review.openstack.org/443050 | 10:08 |
openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-common stable/ocata: Fix typo in package_update.yaml https://review.openstack.org/440675 | 10:09 |
*** iranzo has quit IRC | 10:11 | |
*** iranzo has joined #tripleo | 10:12 | |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Respond to multiple messages from workflow executions https://review.openstack.org/406178 | 10:12 |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Update the baremetal workflows to use the multiple message interface https://review.openstack.org/443053 | 10:12 |
openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: Enable the HA deployment by default https://review.openstack.org/415179 | 10:16 |
*** bogdando has quit IRC | 10:17 | |
*** bogdando has joined #tripleo | 10:17 | |
*** bogdando has quit IRC | 10:20 | |
*** bogdando has joined #tripleo | 10:23 | |
*** karthiks has quit IRC | 10:25 | |
*** liupe__ has quit IRC | 10:27 | |
*** karimb has quit IRC | 10:29 | |
*** akrivoka has joined #tripleo | 10:32 | |
openstackgerrit | Merged openstack/tripleo-ui stable/ocata: Imported Translations from Zanata https://review.openstack.org/443015 | 10:33 |
shardy | skramaja: sure, looking | 10:33 |
rook_ | shardy gfidente heya - not sure if either of you saw my message, however I am pretty much stuck hard on a deployment... Seems to be something with Ceph, but I am not sure how to pinpoint what. | 10:34 |
*** udesale has quit IRC | 10:34 | |
*** rook_ is now known as rook | 10:42 | |
rook | i did just look at the heat-engine logs on the undercloud and caught this " | 10:43 |
rook | 2017-03-07 20:46:14.951 65502 ERROR oslo_db.sqlalchemy.exc_filters DataError: (1406, u"Data too long for column 'resource_properties' at row 1") | 10:43 |
rook | shardy ^ and prior to the traceback, it is a huge dumping ground of text. | 10:43 |
shardy | rook: hey, yeah sorry saw your message but not got to it yet | 10:45 |
rook | shardy https://gist.github.com/jtaleric/6dec8d19a0eb591cd3e9dee1262b0b08 -- there are about 4 screens worth of dumping going on here. | 10:45 |
shardy | rook: that heat error sounds wrong, lets see what caused it | 10:45 |
rook | shardy: sure -- hoping the additional research this morning helpes pinpoint things. | 10:46 |
shardy | rook: so, yeah, in the past we had some non-critical errors where event data got truncated | 10:47 |
shardy | rook: but here, it's truncating resource_properties | 10:47 |
shardy | that is probably very bad | 10:47 |
bogdando | hi folks. I'd like to make a scratch deploy with oooq AND containers, and gonna ask stupid questions now, so please be kind. Here is what I have on my mind, please correct the list to guide me in the best direction: | 10:47 |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: undercloud-deploy: export undercloud_network_cidr https://review.openstack.org/442862 | 10:47 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 10:49 |
shardy | rook: actually wait - this is an event - what version of heat is this? | 10:49 |
rook | shardy: whatever we are currently shipping | 10:49 |
bogdando | So a scratch deploy: | 10:49 |
bogdando | - with openstack containers enabled, only a controller node with only a keystone component | 10:49 |
bogdando | - with oooq & ansible runner at my ubuntu xenial host OR https://github.com/dprince/undercloud_containers/blob/master/doit.sh in centos7 priv/nethost container or in a VM? | 10:49 |
bogdando | - with current promoted repo https://trunk.rdoproject.org/centos7-master/current-tripleo-rdo/ OR consistent? | 10:49 |
bogdando | - with undercloud vm running which image undercloud.qcow2 ? | 10:49 |
bogdando | - with overcloud vm's running which images overcloud-full.qcow2 ? (don't want to wait for building to complete) | 10:49 |
bogdando | later, I'd want to deploy only a component under dev, like etcd in containers | 10:49 |
bogdando | note, for now I have only my laptop which runs xenial. I will have another one with RHEL, or what else options I have to deploy, like OVB? | 10:49 |
rook | openstack-heat-engine-7.0.1-2.el7ost.noarch shardy | 10:49 |
shardy | rook: can you share the log lines before/after that error pls? | 10:49 |
shardy | therve: ^^ Hey are you aware of any new issues when storing events? | 10:50 |
shardy | I thought we fixed that a while ago | 10:50 |
bogdando | what is the closest development approach you use normally? I'd like to not reinvent wheels for oooq etc. | 10:50 |
therve | shardy, We changed the model, maybe it broke it again... | 10:50 |
rook | shardy therve this only happened after a ton of scaling up ,and some scaling down. | 10:50 |
rook | not it seems wedged | 10:51 |
shardy | https://github.com/openstack/heat/commit/57c5aae88b908002d84a933738293c5917926174 | 10:51 |
shardy | therve: ah, so yeah I see we moved/removed the truncation workaround | 10:52 |
shardy | removed by the look of it, I guess that is the problem - AFAICS we also removed the test for storing oversized properties :( | 10:53 |
therve | shardy, :/ | 10:53 |
shardy | rook, therve: I raised https://bugs.launchpad.net/heat/+bug/1671043 | 10:58 |
openstack | Launchpad bug 1671043 in heat "Storing events can fail (again) due to oversized properties" [Undecided,New] | 10:58 |
therve | shardy, Thanks, I'll have a look | 10:58 |
shardy | therve: thanks, much appreciated! | 10:58 |
rook | shardy: giving that this is a live env -- what is the best path forward to keep it going | 10:59 |
rook | this is in the CNCF lab and we were hoping to take things to 900 baremetal nodes. | 10:59 |
openstackgerrit | Merged openstack/diskimage-builder master: Merge "Run indent checks in diskimage_builder/lib" into feature/v2 https://review.openstack.org/441723 | 11:01 |
*** fragatina has joined #tripleo | 11:01 | |
rook | therve ^^ | 11:03 |
rook | so as soon as something hits, I should be able to see if it helps this deployment | 11:03 |
*** karthiks has joined #tripleo | 11:04 | |
shardy | rook: I could suggest hacky workarounds, but can we give therve a while to propose a proper fix? | 11:05 |
*** fragatina has quit IRC | 11:06 | |
shardy | rook: this is a regression from newton, so it'd be best to fix it in heat properly I think | 11:06 |
* shardy goes to grab a coffee | 11:06 | |
*** akrivoka has quit IRC | 11:07 | |
openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Send custom parameters in bootloader to GRUB_CMDLINE https://review.openstack.org/441086 | 11:07 |
*** akrivoka has joined #tripleo | 11:10 | |
*** fultonj has quit IRC | 11:12 | |
rook | ack shardy - it is just that we don't have this lab full time, and we are going to get the rest of the nodes soon... I am not trying to push the proper fix to not be good, but I would like to continue working on this lab if possible. | 11:13 |
rook | The current bug has me at a hard stop. | 11:14 |
rook | but I understand where you are coming from. | 11:14 |
*** hjensas has quit IRC | 11:15 | |
openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Send custom parameters in bootloader to GRUB_CMDLINE https://review.openstack.org/441086 | 11:16 |
*** jprovazn has quit IRC | 11:17 | |
*** athomas has quit IRC | 11:18 | |
shardy | rook: ack, I get it's time sensitive, I think there are some possible workaround, e.g in the DB the heat.event.resource_properties column in blob, but the resource.properties_data column is longtext | 11:23 |
shardy | I suspect the DB schema for event could be modified to longblob and it'd work | 11:24 |
shardy | but really we want a way to not store giant properties for every event as it's probably not super useful | 11:24 |
*** athomas has joined #tripleo | 11:25 | |
rook | shardy: sure, however I worry that the fix will require me to nuke things and start over | 11:25 |
rook | which is a noop... | 11:26 |
*** karthiks has quit IRC | 11:26 | |
rook | shardy: maybe I am wrong about the fix though? | 11:26 |
shardy | rook: a heat fix wont - the previous fix that got removed in the commit I mentioned just truncated the data | 11:26 |
shardy | basically some refactoring removed the limit we put in place some time ago | 11:26 |
shardy | we need to put it back again | 11:27 |
rook | ah ha ok, good | 11:27 |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Detect CREATE_COMPLETE instead of CREATE_FAILED https://review.openstack.org/443076 | 11:27 |
shardy | rook: that's why I'd rather go for the heat fix first vs messing with the DB | 11:27 |
rook | thanks -- ill capture the heat-engine log and share it - maybe there is other things we can identify | 11:27 |
rook | shardy: ack. | 11:28 |
shardy | rook: thanks, you can link any further info to https://bugs.launchpad.net/heat/+bug/1671043 | 11:28 |
openstack | Launchpad bug 1671043 in heat "Storing events can fail (again) due to oversized properties" [Critical,Triaged] - Assigned to Thomas Herve (therve) | 11:28 |
shardy | rook: thanks for finding this, and sorry for the inconvenience | 11:29 |
*** chem has quit IRC | 11:29 | |
*** ansmith has quit IRC | 11:29 | |
*** dtantsur|bbl is now known as dtantsur | 11:37 | |
*** karthiks has joined #tripleo | 11:37 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: undercloud-deploy: export undercloud_network_cidr https://review.openstack.org/442862 | 11:38 |
*** hjensas has joined #tripleo | 11:40 | |
openstackgerrit | Merged openstack/os-net-config stable/ocata: Restart Openvswitch after adding DPDK ports https://review.openstack.org/439486 | 11:40 |
openstackgerrit | Christian Schwede proposed openstack/tripleo-heat-templates master: [WIP] Migrate Glance DB on upgrades https://review.openstack.org/443080 | 11:42 |
*** karthiks has quit IRC | 11:43 | |
b00tcat | Hi, an example SERVICE_node_names variable of mine is ["overcloud-controller-0.internalapi.localdomain"] , however `hostname -f` returns "overcloud-controller-0.localdomain" | 11:47 |
b00tcat | is it because in node_names the network segment is added in the middle in those variables? | 11:47 |
*** user` has joined #tripleo | 11:48 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart master: break out general_config into config and topology https://review.openstack.org/425451 | 11:48 |
*** user` is now known as chem | 11:48 | |
*** chem has quit IRC | 11:48 | |
*** chem has joined #tripleo | 11:48 | |
*** zoli|wfh is now known as zoli|lunch | 11:49 | |
lmasiero | hello guys, i'm facing some issues with ooo/newton when deploying in HA (3controllers). The nova-conductor on the compute nodes is timing out | 11:51 |
lmasiero | any similiar issues anyone? | 11:51 |
lmasiero | i'm about to collect data and submit as a bug request, bugs.launchpad.net/tripleo? | 11:52 |
*** pkovar has joined #tripleo | 11:53 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: pass the topology of the overcloud w/ topology vs extra-args https://review.openstack.org/425453 | 11:53 |
*** jprovazn has joined #tripleo | 11:55 | |
*** karthiks has joined #tripleo | 11:55 | |
*** dprince has joined #tripleo | 11:55 | |
*** adarazs is now known as adarazs_lunch | 11:59 | |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Add option not to skip building images https://review.openstack.org/443085 | 11:59 |
*** dparkes has quit IRC | 12:00 | |
EmilienM | hello | 12:02 |
*** jaosorior_brb is now known as jaosorior | 12:03 | |
openstackgerrit | Martin André proposed openstack/tripleo-common master: Add heat-api-cloudwatch container https://review.openstack.org/443093 | 12:03 |
jaosorior | EmilienM: updated your commit here https://review.openstack.org/#/c/442798/ it needs a fix in glance_store | 12:04 |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Move nova-scheduler data into puppet_config https://review.openstack.org/442664 | 12:04 |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Enable Docker service for Compute role https://review.openstack.org/442549 | 12:04 |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Docker service for heat-api-cloudwatch https://review.openstack.org/443095 | 12:04 |
EmilienM | jaosorior: you rocks, you know? | 12:05 |
EmilienM | jaosorior: I mean, thx for your help | 12:05 |
jaosorior | EmilienM: we shouldn't be using Admin anymore | 12:05 |
EmilienM | jaosorior: why? | 12:05 |
jaosorior | it's not necessary at all for keystone | 12:05 |
EmilienM | ahhh | 12:05 |
EmilienM | jaosorior: ok | 12:05 |
jaosorior | for v3 | 12:05 |
jaosorior | for v2 it is though | 12:05 |
EmilienM | jaosorior: thx for the info | 12:06 |
jaosorior | EmilienM: I can explain when you're back | 12:06 |
jaosorior | anyway | 12:06 |
jaosorior | enjoy Boston! | 12:06 |
*** dparkes has joined #tripleo | 12:06 | |
EmilienM | jaosorior: thanks | 12:07 |
*** dprince has quit IRC | 12:07 | |
EmilienM | jaosorior: can you update https://review.openstack.org/#/c/442620/ ? | 12:07 |
EmilienM | jaosorior: and https://review.openstack.org/#/c/442793/ | 12:08 |
jaosorior | EmilienM: will do | 12:08 |
*** nyechiel has joined #tripleo | 12:08 | |
EmilienM | jaosorior: not urgent otherwise I'll do it tonight | 12:08 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: sahara: configure keystone_authtoken parameters https://review.openstack.org/442620 | 12:09 |
EmilienM | jaosorior: if you have time to review https://review.openstack.org/#/c/442802/ also | 12:09 |
jaosorior | ack | 12:09 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: gnocchi: deploy services with Keystone v3 endpoints https://review.openstack.org/442793 | 12:11 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job with RabbitMQ https://review.openstack.org/426307 | 12:13 |
jaosorior | marios, shardy: hey, when do you think it's appropriate to add configuration options to undercloud.conf? | 12:15 |
*** flepied has quit IRC | 12:17 | |
marios | not something i've spend any time thinking about (maybe it came up at PTG?) jaosorior ... i guess you have a specific use case in mind | 12:17 |
*** lmasiero has quit IRC | 12:18 | |
jaosorior | marios: https://review.openstack.org/#/c/442610/ | 12:20 |
marios | thanks jaosorior will check it out | 12:21 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/diskimage-builder master: Updated from global requirements https://review.openstack.org/440038 | 12:22 |
*** gkadam has quit IRC | 12:25 | |
*** dprince has joined #tripleo | 12:25 | |
*** ckyriaki has quit IRC | 12:25 | |
*** lucasagomes is now known as lucas-hungry | 12:25 | |
*** dparkes has quit IRC | 12:26 | |
*** david-lyle has quit IRC | 12:30 | |
*** dprince has quit IRC | 12:31 | |
*** flepied has joined #tripleo | 12:32 | |
*** david-lyle has joined #tripleo | 12:33 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements https://review.openstack.org/440124 | 12:33 |
*** shardy has quit IRC | 12:34 | |
*** egafford has quit IRC | 12:35 | |
*** gkadam has joined #tripleo | 12:36 | |
*** jkilpatr has joined #tripleo | 12:36 | |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-specs master: Deployment plan management changes https://review.openstack.org/438918 | 12:37 |
openstackgerrit | Ana Krivokapic proposed openstack/tripleo-common master: Enhance plan creation and update with plan-environment https://review.openstack.org/414169 | 12:37 |
openstackgerrit | Ana Krivokapic proposed openstack/tripleo-common master: Add plan export action and workflow https://review.openstack.org/422789 | 12:37 |
therve | rook, Hum that's strange, not storing events shouldn't block anything AFAIR | 12:37 |
*** dparkes has joined #tripleo | 12:38 | |
*** dmacpher has joined #tripleo | 12:40 | |
*** karimb has joined #tripleo | 12:41 | |
*** psahoo has quit IRC | 12:41 | |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: test multinode, pingtest https://review.openstack.org/443111 | 12:43 |
*** gkadam has quit IRC | 12:43 | |
akrivoka | jtomasek: spec looks good to me, I'll wait for some more review before going ahead with creating blueprints in case somebody comes up with changes to work items | 12:43 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: glance: deploy services with Keystone v3 endpoints https://review.openstack.org/442798 | 12:44 |
*** snecklifter has quit IRC | 12:45 | |
*** snecklifter has joined #tripleo | 12:46 | |
*** rhallisey has joined #tripleo | 12:46 | |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Keep existing data for containerized Swift https://review.openstack.org/443112 | 12:46 |
openstackgerrit | Luke Hinds proposed openstack/puppet-tripleo master: SSHD Service extensions https://review.openstack.org/443113 | 12:49 |
*** lmasiero has joined #tripleo | 12:52 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 12:52 |
*** bfournie has quit IRC | 12:54 | |
*** dprince has joined #tripleo | 12:54 | |
*** rhallisey has quit IRC | 12:54 | |
jtomasek | akrivoka, thanks! | 12:55 |
jtomasek | akrivoka, will Depends-On prevent this one to merge before dependent patch is merged? https://review.openstack.org/#/c/437676/ | 12:55 |
therve | rook, Ping me when you get back | 12:56 |
*** lmasiero has quit IRC | 12:57 | |
hjensas | shardy: Is it possible to read in introspection data from a heat template? I can see OS::Swift::Container, but it looks like it is there to create a swift container. not read from one? | 12:57 |
*** abregman has quit IRC | 12:58 | |
akrivoka | jtomasek: I think so | 12:58 |
*** adarazs_lunch is now known as adarazs | 12:59 | |
*** abregman has joined #tripleo | 12:59 | |
therve | hjensas, He's not around. And for sure the container resource is only to create one | 13:00 |
openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart-extras master: Add ability to set novajoin_read|connect timeout https://review.openstack.org/442626 | 13:00 |
hjensas | therve: ok, thanks. | 13:01 |
*** ansmith has joined #tripleo | 13:01 | |
*** abregman has quit IRC | 13:02 | |
*** ccamacho is now known as ccamacho|lunch | 13:02 | |
jaosorior | d0ugal: does mistral run multinode jobs from tripleo? | 13:03 |
*** abregman has joined #tripleo | 13:03 | |
*** jayg|g0n3 is now known as jayg | 13:04 | |
d0ugal | jaosorior: yeah, well, it runs gate-tripleo-ci-centos-7-scenario003-multinode-puppet | 13:05 |
*** noslzzp has quit IRC | 13:05 | |
jaosorior | great | 13:05 |
*** zoli|lunch is now known as zoli|wfh | 13:05 | |
*** noslzzp has joined #tripleo | 13:05 | |
*** morazi has joined #tripleo | 13:07 | |
*** rhallisey has joined #tripleo | 13:07 | |
*** Baggypants12000 has quit IRC | 13:08 | |
rook | therve: pong | 13:12 |
therve | rook, So to confirm, this is newton right? | 13:12 |
rook | yes therve, what we ship today | 13:12 |
akrivoka | d0ugal: I was wondering why these operations are not documented with their CLI commands but rather with calling actions/workflows directly? https://docs.openstack.org/developer/tripleo-docs/mistral-api/mistral-api.html | 13:13 |
therve | rook, OK so Steven diagnosis is probably wrong | 13:13 |
*** morazi has quit IRC | 13:13 | |
akrivoka | d0ugal: AFAICT, we have corresponding CLI commands available for all of them | 13:13 |
therve | rook, This shouldn't be a fatal error. What's the problem that you have precisely? | 13:13 |
rook | therve so the deployment seems stuck on some Ceph action - if You have a moment, I can explain via bluejeans? | 13:13 |
akrivoka | d0ugal: or is it just that these docs were added before the commands, and now need to be updated? | 13:13 |
rook | therve: there is quite a bit of information | 13:13 |
*** pgadiya has quit IRC | 13:14 | |
therve | rook, In a meeting right now for 45 mins | 13:14 |
*** dougbtv has joined #tripleo | 13:16 | |
*** jkilpatr has quit IRC | 13:17 | |
openstackgerrit | Merged openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/443013 | 13:17 |
openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart-extras master: Add ability to set novajoin_read|connect timeout https://review.openstack.org/442626 | 13:18 |
jpich | akrivoka: I think the goal was to document how to drive deployments, etc only using Mistral and illustrate how that API works | 13:20 |
bandini | matbu: are you going to cut a new release of ansible-pacemaker and check with the rdo folks to get a new package in ocata or do other things need to happen? | 13:23 |
bandini | chem: ^ | 13:23 |
*** liupe__ has joined #tripleo | 13:24 | |
chem | bandini: matbu told me that he pushed a button that should trigger a rebuild of the rpm | 13:24 |
*** amoralej is now known as amoralej|lunch | 13:24 | |
bandini | chem: ah nice. will the rpm appear in the ocata repos as well? | 13:24 |
matbu | bandini: it's done | 13:24 |
matbu | bandini: yep | 13:24 |
matbu | bandini: i think it's a matter of hours | 13:25 |
bandini | matbu: awesome, thanks! :) | 13:25 |
*** links has quit IRC | 13:25 | |
*** morazi has joined #tripleo | 13:25 | |
*** lucas-hungry is now known as lucasagomes | 13:27 | |
d0ugal | akrivoka: Yeah, what jpich said. That documentation is intended for people writing something like a GUI or integrating externally | 13:27 |
akrivoka | ah I see, thanks jpich d0ugal | 13:27 |
d0ugal | I guess I failed to make that clear :) | 13:27 |
*** nyechiel has quit IRC | 13:28 | |
d0ugal | akrivoka: I do think the documentation is lacking coverage for many of the CLI commands - maybe worth a bug report | 13:29 |
*** bfournie has joined #tripleo | 13:30 | |
akrivoka | d0ugal: nah, the first sentence clearly states the intent so that's clear, I was just think in a little bit different direction (why do we mention in the docs how to e.g. create a plan calling a mistral wofklow, but no mention of how to do it via a CLI command) | 13:30 |
akrivoka | d0ugal: yes, exactly, I think many of the CLI commands are still undocumented | 13:31 |
d0ugal | +1 | 13:32 |
d0ugal | akrivoka: I think that is partly because the plan management story from the CLI isn't that complete. | 13:32 |
akrivoka | d0ugal: true | 13:32 |
akrivoka | d0ugal: so a section for plan management in the docs could make sense (once all the commands are there)? | 13:33 |
d0ugal | akrivoka: yup - starting the docs might even be a good way to figure out what is missing. I'm not sure. | 13:33 |
akrivoka | cool | 13:33 |
openstackgerrit | Merged openstack/tripleo-quickstart master: Add centos-opstools repo to default config for master https://review.openstack.org/431189 | 13:34 |
*** prateek has quit IRC | 13:34 | |
akrivoka | d0ugal: https://bugs.launchpad.net/tripleo/+bug/1671094 | 13:35 |
openstack | Launchpad bug 1671094 in tripleo "Document plan management using the CLI" [Medium,Triaged] | 13:35 |
d0ugal | akrivoka: thanks! | 13:35 |
*** rbrady-afk is now known as rbrady | 13:39 | |
*** suuuper has quit IRC | 13:39 | |
*** pblaho has joined #tripleo | 13:40 | |
*** eck` is now known as eck`gone | 13:40 | |
jpich | yay more docs | 13:41 |
openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Use tmp env path when rewriting absolute resource paths https://review.openstack.org/443131 | 13:41 |
openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Send custom parameters in bootloader to GRUB_CMDLINE https://review.openstack.org/443132 | 13:41 |
openstackgerrit | Merged openstack/tripleo-ui master: Update version for Pike https://review.openstack.org/441943 | 13:42 |
*** egafford has joined #tripleo | 13:43 | |
openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: WIP: Switch quickstart config from scenario to multinode-settings https://review.openstack.org/438695 | 13:43 |
*** karimb has quit IRC | 13:43 | |
openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: WIP: Switch quickstart config from scenario to multinode-settings https://review.openstack.org/438695 | 13:43 |
*** liverpooler has joined #tripleo | 13:44 | |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Nic config mappings for deployed-server https://review.openstack.org/442170 | 13:44 |
*** rhallisey has quit IRC | 13:46 | |
*** karimb has joined #tripleo | 13:46 | |
*** jcoufal has joined #tripleo | 13:46 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: extras-common: add undercloud_network_cidr as common var https://review.openstack.org/442862 | 13:47 |
*** jkilpatr has joined #tripleo | 13:48 | |
*** suuuper has joined #tripleo | 13:51 | |
*** gbarros has joined #tripleo | 13:55 | |
*** tzumainn has joined #tripleo | 13:55 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: New ovb playbook and settings https://review.openstack.org/431567 | 13:57 |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: [WIP] Upgrade to webpack 2 https://review.openstack.org/443137 | 14:00 |
*** jaosorior has quit IRC | 14:01 | |
*** rhallisey has joined #tripleo | 14:01 | |
*** jjung has joined #tripleo | 14:02 | |
*** gbarros has quit IRC | 14:02 | |
*** rbowen has joined #tripleo | 14:04 | |
openstackgerrit | Honza Pokorny proposed openstack/puppet-tripleo master: Refactor enabled languages from an array to an object https://review.openstack.org/442683 | 14:04 |
*** gbarros has joined #tripleo | 14:05 | |
ansiwen | dprince: https://bpaste.net/show/59f2d3d24827 | 14:05 |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Simplify addition of new languages https://review.openstack.org/440788 | 14:05 |
ansiwen | dprince: it's docker/post.yaml | 14:06 |
ansiwen | dprince: ha! there is a "<<<<<<< HEAD" inside... obviously a patch didn't work | 14:07 |
dprince | ansiwen: weird, I've not seen that locally. | 14:07 |
dprince | ansiwen: oh, right. That'll do it :) | 14:07 |
ansiwen | dprince: actually the post.j2.yaml already has it... | 14:09 |
ansiwen | dprince: I will just rerun your doit.sh and hope it's gone by now :-) | 14:09 |
openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui master: Fix nodes actions toolbar https://review.openstack.org/443139 | 14:09 |
*** jmelvin has joined #tripleo | 14:10 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: extras-common: add undercloud_network_cidr as common var https://review.openstack.org/442862 | 14:13 |
*** ccamacho|lunch is now known as ccamacho | 14:13 | |
*** shardy has joined #tripleo | 14:13 | |
*** karimb_ has joined #tripleo | 14:13 | |
trozet | shardy: hi | 14:15 |
*** dparkes has quit IRC | 14:15 | |
*** karimb has quit IRC | 14:15 | |
*** dparkes has joined #tripleo | 14:16 | |
*** jkilpatr has quit IRC | 14:17 | |
*** pradk has quit IRC | 14:17 | |
*** karimb_ has quit IRC | 14:19 | |
openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Send mail tool https://review.openstack.org/423340 | 14:20 |
shardy | trozet: Hi! | 14:22 |
*** Goneri has joined #tripleo | 14:22 | |
trozet | shardy: hey man, can you help me out with some reviews? | 14:23 |
shardy | trozet: sure | 14:24 |
openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: WIP: Switch quickstart config from scenario to multinode-settings https://review.openstack.org/438695 | 14:24 |
trozet | shardy: this one passed everything except containers job, I thought that was non-voting, maybe it got moved recently https://review.openstack.org/#/c/435081/ | 14:26 |
trozet | shardy: can you review, and do I need to recheck it? | 14:26 |
*** amoralej|lunch is now known as amoralej | 14:26 | |
openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: Correct haproxy's stat unix socket path https://review.openstack.org/443148 | 14:27 |
*** karimb has joined #tripleo | 14:29 | |
ansiwen | dprince: it's because this has been merged already: https://review.openstack.org/#/c/431746 | 14:34 |
dprince | ansiwen: ack, we should remove those | 14:34 |
*** saibarspeis has quit IRC | 14:34 | |
chem | matbu: scrum ? | 14:35 |
dprince | ansiwen: https://github.com/dprince/undercloud_containers/commit/18a23e5e192c0c5c2a33b8172f55052c15b5f414 | 14:37 |
matbu | chem: yep im in | 14:37 |
ansiwen | dprince: cool | 14:38 |
shardy | trozet: I think the containers job is broken ref https://review.openstack.org/#/c/442549/ and it's probably unrelated to your patch | 14:39 |
trozet | shardy: ok cool | 14:39 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Add a generic interface to create nested stacks before the steps https://review.openstack.org/404499 | 14:40 |
*** cdearborn has joined #tripleo | 14:40 | |
shardy | trozet: it looks OK to me although the interface is kinda weird, e.g why an "IncreaseFileLimit" boolean vs a number like MysqlFileLimit ? | 14:40 |
*** lblanchard has joined #tripleo | 14:40 | |
shardy | I guess it's related to the underlying puppet interfaces? | 14:40 |
trozet | shardy: yeah I had the same comment | 14:40 |
trozet | shardy: look at my comment here https://review.openstack.org/#/c/408250/ | 14:40 |
trozet | shardy: apparently there is a different way it gets set to that value in pacemaker version | 14:41 |
openstackgerrit | Toure Dunnon proposed openstack/tripleo-specs master: [WIP] Plan Upgrade and Update Workflow https://review.openstack.org/443152 | 14:41 |
*** dsariel has joined #tripleo | 14:41 | |
trozet | shardy: so Damien said we should just do this as a fix then change how it is set for both in another patch + support providing an int | 14:41 |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Remove karma, jasmine, and phantomjs dependencies https://review.openstack.org/443153 | 14:41 |
*** ckyriakidou has joined #tripleo | 14:42 | |
openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Update the baremetal workflows to use the multiple message interface https://review.openstack.org/443053 | 14:42 |
shardy | trozet: Ok thanks for clarifying, sounds like it's OK as a first step then | 14:43 |
openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Send custom parameters in bootloader to GRUB_CMDLINE https://review.openstack.org/443132 | 14:44 |
*** eck`gone is now known as eck` | 14:44 | |
trozet | shardy: yeah I agree it is ugly though | 14:44 |
trozet | shardy: I'll try to find some time to dig into how it gets set in HA and then provide a master only patch to change it to be int and set it in both types of deployments | 14:44 |
trozet | shardy: then if you could also review this one please: https://review.openstack.org/#/c/419648/ | 14:45 |
shardy | trozet: small comment but looks good | 14:47 |
trozet | shardy: ah yes missed that | 14:48 |
*** chlong_ has joined #tripleo | 14:48 | |
*** markmc` is now known as markmc | 14:48 | |
trozet | shardy: ok will fix, thanks | 14:48 |
shardy | trozet: or is the intention that you'd override the default ovs resource? | 14:48 |
shardy | trozet: ack, thanks | 14:48 |
trozet | shardy: yeah wait | 14:49 |
trozet | shardy: yeah override the regular OVS | 14:49 |
shardy | trozet: Ok so maybe adding an environment file is enough? | 14:50 |
trozet | shardy: yeah I can add one | 14:51 |
shardy | trozet: Ok thanks, at least then it's a bit clearer how it should be enabled | 14:51 |
trozet | shardy: np thanks for reviews | 14:51 |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Fix failure when id_rsa_undercloud doesn't exist https://review.openstack.org/442492 | 14:52 |
*** gbarros has quit IRC | 14:53 | |
*** dmacpher is now known as dmacpher-afk | 14:55 | |
honza | jpich: did you have any ideas on what the visual highlight would be? bold? a different color? https://bugs.launchpad.net/tripleo/+bug/1669485 | 14:57 |
openstack | Launchpad bug 1669485 in tripleo "Highlight the language currently in use" [Medium,Triaged] - Assigned to Honza Pokorny (hpokorny) | 14:57 |
jpich | honza: I was thinking the background of the cell would become black and the text white for the one currently selected, but your "bold" suggestion sounds just as good to me | 14:59 |
honza | looks like upgrade jobs are now succeeding on ui jobs? nice | 14:59 |
honza | jpich: k, i'll play around a bit (there is something in patternfly for all i know) | 14:59 |
*** yamahata has joined #tripleo | 15:00 | |
jpich | honza: If you ask lblanchard for her input she'll probably have super awesome ideas too :) | 15:01 |
*** jaosorior has joined #tripleo | 15:01 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: [WIP] collect-logs: add rename task for uncompressed files too https://review.openstack.org/443163 | 15:02 |
* lblanchard looking | 15:03 | |
*** saneax is now known as saneax-_-|AFK | 15:04 | |
*** jcoufal has quit IRC | 15:04 | |
lblanchard | honza, jpich: what do you guys think about using the treatment that's used in the Multiple Select widget in PatternFly? http://www.patternfly.org/pattern-library/widgets/#bootstrap-select | 15:05 |
*** jcoufal has joined #tripleo | 15:06 | |
lblanchard | blue highlight with a check next to the language that's selected. | 15:06 |
*** abregman is now known as abregman|mtg | 15:06 | |
*** prateek has joined #tripleo | 15:07 | |
honza | lblanchard: that definitely looks nice | 15:07 |
honza | lblanchard: right now, that part of the ui is handled by a dropdown widget though http://www.patternfly.org/pattern-library/widgets/#dropdowns | 15:08 |
lblanchard | honza: think you could replicate the check and blue if I get you an icon and hex value? | 15:08 |
honza | lblanchard: i'm not sure if we could replace it with a select easily (might look out of place) | 15:08 |
*** tdasilva- has joined #tripleo | 15:08 | |
lblanchard | honza: yeah I don't think we'd want a multi-select widget…just the same style for selection :) | 15:09 |
honza | lblanchard: I think you're overestimating my css skills :) | 15:09 |
lblanchard | honza: hahahah…I think you are just being modest! | 15:09 |
lblanchard | honza: maybe start with the blue highlight…stretch goal is adding the check? :) | 15:09 |
honza | lblanchard: good idea! i'm looking at the code and we actually have a generic dropdown item which supports an "active" state | 15:10 |
lblanchard | honza: oh perfect | 15:11 |
*** Vijayendra has joined #tripleo | 15:13 | |
*** pradk has joined #tripleo | 15:13 | |
*** tdasilva- has quit IRC | 15:13 | |
openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Send mail tool https://review.openstack.org/423340 | 15:13 |
*** gbarros has joined #tripleo | 15:14 | |
honza | florianf: apparently, this needs your +1 https://review.openstack.org/#/c/440546/ :) | 15:18 |
*** karimb has quit IRC | 15:19 | |
florianf | honza: huh. interesting | 15:19 |
honza | yeah | 15:20 |
florianf | honza: done | 15:20 |
honza | florianf: thanks | 15:20 |
*** karimb has joined #tripleo | 15:21 | |
openstackgerrit | Holger Smolinski proposed openstack/diskimage-builder master: Add zipl support for s390x architecture https://review.openstack.org/443171 | 15:21 |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Keep existing data for containerized Libvirt https://review.openstack.org/443172 | 15:22 |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Keep existing data for containerized ironic-conductor https://review.openstack.org/443173 | 15:22 |
*** dprince has quit IRC | 15:24 | |
openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: WIP: Switch quickstart config from scenario to multinode-settings https://review.openstack.org/438695 | 15:26 |
*** tdasilva- has joined #tripleo | 15:28 | |
*** ealcaniz has quit IRC | 15:32 | |
beagles | dsneddon: did you see my reply to your comments on https://review.openstack.org/#/c/434472/ | 15:34 |
beagles | dsneddon: basically it was a backport and just kept it "intact"... I can remove the sample files from the backport if you prefer however | 15:34 |
*** links has joined #tripleo | 15:35 | |
*** fultonj has joined #tripleo | 15:36 | |
rook | gfidente: you open to a ceph question? | 15:37 |
gfidente | rook, pong | 15:39 |
*** fultonj has quit IRC | 15:39 | |
rook | https://gist.github.com/jtaleric/e6dcbd77a22a93ac12747e1f88e235b0 gfidente | 15:39 |
rook | gfidente: how can i repair this node, then hand it back to OOO ? | 15:40 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Add support for deploying Ceph using ceph-ansible via external workflow https://review.openstack.org/441137 | 15:41 |
gfidente | rook, so it looks like nothing generated ceph.conf on the node at all? | 15:41 |
rook | gfidente: yup, nothing there | 15:42 |
gfidente | rook, so what is launching ceph-disk ? which role is this? | 15:42 |
*** yprokule has quit IRC | 15:42 | |
rook | this is the ceph-storage role gfidente | 15:43 |
rook | root@overcloud-cephstorage-0 | 15:43 |
gfidente | rook, ok it's strange I am not sure why puppet should be trying to run ceph-disk but not creating the config | 15:44 |
gfidente | rook, any chance I can login on the node and we use tmux/tmate to check things together? | 15:45 |
jtomasek | florianf, which nodes action do you see that bug happening on? | 15:45 |
rook | yes gfidente | 15:45 |
*** dmarlin has joined #tripleo | 15:46 | |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: Deploy multinode scenarios with deploy args https://review.openstack.org/443188 | 15:46 |
honza | lblanchard: so, it works great, thanks for leading me down the right path :) | 15:46 |
jpich | lblanchard rocks \o/ | 15:47 |
lblanchard | honza: woo hoo!! Happy I could be helpful :) | 15:47 |
openstackgerrit | Luke Hinds proposed openstack/puppet-tripleo master: SSHD Service extensions https://review.openstack.org/443113 | 15:48 |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Highlight current i18n language in navbar https://review.openstack.org/443191 | 15:49 |
*** sudipto has quit IRC | 15:52 | |
*** sudipto_ has quit IRC | 15:52 | |
openstackgerrit | Holger Smolinski proposed openstack/diskimage-builder master: Oops, left the (C) statement erronoeously in the patch. https://review.openstack.org/443197 | 15:53 |
*** mcornea has quit IRC | 15:54 | |
jaosorior | shardy: I think the bug with the priorities is also affecting python packages https://review.openstack.org/#/c/443104/ this failure's stack trace matches the line numbers of the package before my change, so it seems it didn't take into account the depends-on | 15:54 |
florianf | jtomasek: introspection, provide | 15:54 |
openstackgerrit | Holger Smolinski proposed openstack/diskimage-builder master: Add zipl support for s390x architecture https://review.openstack.org/443171 | 15:54 |
*** jaganathan has quit IRC | 15:55 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 15:57 |
*** rcernin has quit IRC | 15:58 | |
shardy | jaosorior: yeah ref my mail to openstack-dev I think everything is affected | 15:59 |
shardy | jaosorior: I think priorities don't help on upgrade because we've already installed the newer version | 15:59 |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK https://review.openstack.org/430277 | 16:00 |
jaosorior | shardy: oh, hadn't checked your mail | 16:00 |
*** jjung has quit IRC | 16:00 | |
openstackgerrit | Monty Taylor proposed openstack/diskimage-builder master: Include systemd-sysv for debian stretch https://review.openstack.org/443201 | 16:01 |
*** nyechiel has joined #tripleo | 16:01 | |
*** fragatina has joined #tripleo | 16:02 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Set multinode scenarios with quickstart https://review.openstack.org/443204 | 16:02 |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: Deploy multinode scenarios with deploy args https://review.openstack.org/443188 | 16:03 |
*** cwolferh has quit IRC | 16:05 | |
*** fragatina has quit IRC | 16:06 | |
*** ckyriakidou has quit IRC | 16:07 | |
openstackgerrit | Elise Gafford proposed openstack/tripleo-heat-templates master: Default to empty list for CinderNfsServers https://review.openstack.org/442038 | 16:08 |
*** ckyriakidou has joined #tripleo | 16:08 | |
openstackgerrit | Monty Taylor proposed openstack/diskimage-builder master: Include systemd-sysv for debian stretch https://review.openstack.org/443201 | 16:09 |
*** adarazs is now known as adarazs_afk | 16:10 | |
*** dsariel has quit IRC | 16:11 | |
openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci master: Fix REVIEW_RELEASE: unbound variable error https://review.openstack.org/443216 | 16:12 |
openstackgerrit | Monty Taylor proposed openstack/diskimage-builder master: Include systemd-sysv for debian stretch https://review.openstack.org/443201 | 16:14 |
*** ealcaniz has joined #tripleo | 16:17 | |
*** dsneddon has quit IRC | 16:20 | |
*** jkilpatr has joined #tripleo | 16:21 | |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: test multinode, pingtest https://review.openstack.org/443111 | 16:24 |
*** dsneddon has joined #tripleo | 16:24 | |
*** jaosorior has quit IRC | 16:24 | |
openstackgerrit | Toure Dunnon proposed openstack/tripleo-specs master: [WIP] Plan Upgrade and Update Workflow https://review.openstack.org/443152 | 16:27 |
*** dsneddon has quit IRC | 16:28 | |
dtantsur | EmilienM, hey! mind removing -2 from https://review.openstack.org/#/c/408581/ please? | 16:30 |
*** jkilpatr has quit IRC | 16:30 | |
sshnaidm | slagle, hi, isn't it enough? https://review.openstack.org/#/c/441706/2 | 16:30 |
*** lucasagomes is now known as lucas-afk | 16:30 | |
*** karimb has quit IRC | 16:31 | |
openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-common master: Validate nodes_json before trying to register or updates any nodes https://review.openstack.org/408581 | 16:31 |
slagle | sshnaidm: you said "it wasn't ideal" :) | 16:31 |
sshnaidm | slagle, yeah, that's why I use $HOME if no root :) | 16:32 |
slagle | sshnaidm: what you've done is enough and an improvement, but the whole point of this issue is that $HOME is not guaranteed to be correct | 16:33 |
*** ckyriakidou has quit IRC | 16:35 | |
slagle | was just suggesting a different approach, it's fine what you have | 16:35 |
sshnaidm | slagle, I think it may have problem only if you use "sudo -u non_root_user instack ..." | 16:35 |
sshnaidm | slagle, the improvement will be using arguments for all these options and not env variables | 16:36 |
slagle | sure, that would work | 16:37 |
*** apevec has joined #tripleo | 16:37 | |
trozet | slagle: can you please review https://review.openstack.org/#/c/435081/ ? | 16:40 |
*** nyechiel has quit IRC | 16:40 | |
mwhahaha | anyone know where the various steps (1 through 5) are documented? | 16:41 |
shardy | mwhahaha: https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/README.rst#deployment-steps | 16:41 |
*** jcoufal_ has joined #tripleo | 16:42 | |
mwhahaha | ah ha | 16:42 |
shardy | it's pretty sparse, we could perhaps use more detailed docs in tripleo-docs but I don't think there are any atm | 16:42 |
mwhahaha | we should document some of these core concepts a bit better in tripleo-docs | 16:42 |
d0ugal | Is there an easy way to add --debug to the CLI commands in CI? | 16:43 |
shardy | mwhahaha: also a FAQ has been how can we map the steps to what is included in puppet-tripleo, e.g at stepN [$services] are enabled | 16:43 |
shardy | mwhahaha: any ideas on how we could do that would be good, so far I've not found a good way to do it on the puppet side, e.g a dry-run to catch all the includes for each step | 16:44 |
slagle | trozet: +2, but i dont think you answered bnemec's question | 16:44 |
mwhahaha | shardy: yea that'd be trickey since we do some splitting of service configuration between the steps as well | 16:44 |
shardy | mwhahaha: if anyone can solve that, I know how we can preview the generation of the composable manifest via t-h-t | 16:44 |
slagle | trozet: he was asking if now that fd's are raised, is max connections going to be an issue? | 16:44 |
slagle | trozet: e.g, is there some 1:1 fd per connection? | 16:44 |
trozet | slagle: oh crap | 16:45 |
trozet | slagle: hes asking about max connections? | 16:45 |
bnemec | Yes :-) | 16:45 |
slagle | trozet: his comment was under that parameter :) | 16:45 |
*** jcoufal has quit IRC | 16:45 | |
trozet | bnemec: sorry | 16:45 |
bnemec | I don't think it's 1:1, but I seem to recall needing to raise max_connections in big deployments. | 16:45 |
openstackgerrit | Dmitry Tantsur proposed openstack/instack-undercloud master: Revert "Revert "Deploy and Upgrade Ironic to run in mod_wsgi"" https://review.openstack.org/351803 | 16:46 |
trozet | bnemec: i think it does have an effect, but dciabrin would know better than I | 16:46 |
* dciabrin is reading... | 16:46 | |
bnemec | trozet: np. I think we're still better off after the change because by default we're limited to 1024. | 16:47 |
*** dparkes has quit IRC | 16:47 | |
trozet | dciabrin: bnemec is asking about the max connections, it is listed here https://review.openstack.org/#/c/435081/1/puppet/services/database/mysql.yaml as 4096 | 16:47 |
bnemec | I just suspect we'll never be able to use the full open-file-limit with 4096 max_connections. | 16:47 |
trozet | bnemec: well even though this is set to 4096 max connections, is that actually what gets configure in HA and non ha deployments | 16:47 |
bnemec | But that is configurable and I think big deployments will already be setting it. | 16:47 |
*** tremble has quit IRC | 16:48 | |
trozet | bnemec: i think there are system limits for that as well | 16:48 |
dciabrin | trozet, bnemec so currently in HA we have max_connections set to 4096 and open-file-limit to 16384 | 16:49 |
dciabrin | there's no 1:1, one connection can consumes many fd | 16:50 |
trozet | bnemec: in my noha deployment it is 4096 connections, so I guess that is working OK | 16:50 |
trozet | dciabrin:^ | 16:50 |
*** myoung is now known as myoung|lunch | 16:51 | |
*** myoung|lunch is now known as myoung | 16:51 | |
dciabrin | trozet yes I think 4096 is what we expect. I have the same in my fresh nonha deploy | 16:52 |
bnemec | Yeah, I was just wondering if we had removed one bottleneck while leaving another. | 16:53 |
*** jlinkes has quit IRC | 16:54 | |
dciabrin | bnemec, i think in the long run you're right, we should have it configurable as well, but for both nanha and ha. however the vast majority if not all deploy that i've seen are ok with that number | 16:54 |
*** rhallisey has quit IRC | 16:54 | |
trozet | dciabrin, bnemec: Keep in mind that too many connections can cause high RAM usage and lock up your MySQL server. Usually small websites will require between 100-200 connections while larger may require 500-800 or even more. The value you apply here strongly depends on your particular MySQL/MariaDB usage. | 16:54 |
*** links has quit IRC | 16:55 | |
trozet | dciabrin, bnemec: from that statement, it seems pretty high already | 16:55 |
*** milan has quit IRC | 16:55 | |
dciabrin | trozet, yeah true, but in openstack we eat connections like crazy, due to having many unix processes per service, i.e. we can't do connection pooling at that level | 16:56 |
bnemec | dciabrin: It should already be configurable, so if people need to change it they can. | 16:56 |
bnemec | This was an honest question, not a passive-aggressive "I think something is wrong" question. :-) | 16:56 |
dciabrin | bnemec, oh no offense taken :) | 16:56 |
bnemec | I know it can be hard to tell since I do the latter so often. ;-) | 16:57 |
dciabrin | haha! | 16:57 |
trozet | dciabrin: after backporting this fix...we need to submit another patch to master to make it into an integer. Can you tell me where the HA value is configured/limit raised? | 16:57 |
bogdando | PTAL https://review.openstack.org/#/c/442608/2 I hope my point is valid | 16:57 |
bogdando | a related question for heat/tht/ooo steps and matching of those in puppet https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/README.rst#deployment-steps . Are there docs for pre/post steps as well? | 16:57 |
bogdando | also related, how could we check a similar change request for a consistency across related repos and places? Backwards compatibility should be ok, thanks to mwhahaha for clarification on that: "there really isn't backwards compatibility as it is assumed that for each release you get matching puppet-tripleo and THT" | 16:57 |
dciabrin | trozet, so that's a question i haven't asked yet on https://review.openstack.org/#/c/435081/. will changing the type of this parameter have any adverse effect on minor updates? | 16:58 |
*** athomas has quit IRC | 16:58 | |
*** bfournie has quit IRC | 16:58 | |
trozet | dciabrin: minor updates to what? | 16:59 |
shardy | Hrm, anyone know what creates /tmp/profiledir.* on the undercloud? | 16:59 |
openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui master: Fix nodes actions toolbar https://review.openstack.org/443139 | 16:59 |
shardy | I've got 729689 of them, and growing fast | 16:59 |
dciabrin | trozet, sorry.. I mean if you "overcloud deploy" with that patch, and then you "overcloud deploy" on the same stack a second time when we use an integer instead of a bool in MysqlIncreaseFileLimit. will heat validation pass if type changed? | 17:01 |
* shardy adds audit rule | 17:02 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: [WIP] collect-logs: add rename task for uncompressed files too https://review.openstack.org/443163 | 17:02 |
*** dprince has joined #tripleo | 17:02 | |
*** ansmith has quit IRC | 17:02 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 17:02 |
mwhahaha | shardy: my goolging shows it might happen during the install (as part of dib processes) | 17:03 |
mwhahaha | shardy: are you currently installing? | 17:03 |
trozet | dciabrin: that heat parameter will change names to like MysqlMaxOpenFilesLimit | 17:03 |
mandre | shardy: I believe it's dib-run-parts | 17:03 |
trozet | dciabrin: but it will require changes to puppet-tripleo as well | 17:03 |
trozet | dciabrin: it will only change in master, the current fix is good for backporting to stable branches so at least they dont fail after a couple days of running in noha | 17:04 |
shardy | mwhahaha: No my undercloud has been running for about a week | 17:04 |
mwhahaha | shardy: weird mine doesn't have any of those files | 17:04 |
trozet | dciabrin: i'm just not sure what is setting the value for HA deployments, I thought you may how that is being done | 17:04 |
mandre | shardy: I *only* have 6000 or so, my undercloud is fresher :) | 17:05 |
dciabrin | trozet, yeah we pass that value to a pacemaker resource attribute, and changing it will most probably make pacemaker restart the galera resource on all node. i'm not sure yet how to update that without a small service outage :( | 17:05 |
*** prateek_ has joined #tripleo | 17:05 | |
trozet | dciabrin: ok cool. I'll look into that | 17:07 |
shardy | Hmm, something is running mktemp every second and not cleaning up | 17:07 |
shardy | according to auditd | 17:07 |
*** cwolferh has joined #tripleo | 17:08 | |
*** leanderthal is now known as leanderthal|afk | 17:08 | |
*** prateek has quit IRC | 17:08 | |
openstackgerrit | Saravanan KR proposed openstack/os-net-config stable/ocata: Network service is failing with DPDK https://review.openstack.org/443237 | 17:10 |
mandre | shardy: my undercloud has about 1000 defunct instack-haproxy processes too :-/ | 17:11 |
shardy | http://paste.openstack.org/show/601969/ | 17:14 |
shardy | dtantsur: ^^ is ironic-inspector likely to be doing mktemp calls related to that perioidic task? | 17:15 |
*** skramaja has quit IRC | 17:15 | |
shardy | the batches of mktemps seem correlated when you combine the auditd and messages logs | 17:15 |
trozet | shardy: with upgrades, what step does puppet actually run again for the service? | 17:15 |
shardy | trozet: after all the upgrade_tasks are finished | 17:16 |
shardy | we then run the normal puppet steps | 17:16 |
trozet | shardy: ok so after step 5 | 17:16 |
shardy | yup | 17:16 |
*** jpich has quit IRC | 17:16 | |
dtantsur | shardy, not unless it's hidden somewhere in processutils | 17:16 |
trozet | shardy: is there any special handling for database stuff like mysql: https://github.com/openstack/tripleo-heat-templates/blob/stable/ocata/puppet/services/database/mysql.yaml#L103 | 17:16 |
trozet | shardy: where puppet doesnt get run for mysql ? | 17:16 |
shardy | trozet: No puppet is run for all services, exactly the same as on create | 17:17 |
trozet | shardy: ok thanks | 17:17 |
*** ealcaniz has quit IRC | 17:18 | |
*** bfournie has joined #tripleo | 17:18 | |
*** tesseract has quit IRC | 17:18 | |
*** jaganathan has joined #tripleo | 17:19 | |
*** dbecker has quit IRC | 17:20 | |
shardy | dtantsur: Ok thanks, will keep digging | 17:20 |
*** masco has quit IRC | 17:20 | |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Updating skip file mechanism https://review.openstack.org/438465 | 17:20 |
*** aufi has quit IRC | 17:21 | |
*** adarazs_afk is now known as adarazs | 17:23 | |
*** fragatina has joined #tripleo | 17:24 | |
*** fragatina has quit IRC | 17:24 | |
*** abregman|mtg has quit IRC | 17:24 | |
*** fragatina has joined #tripleo | 17:25 | |
*** gfidente has quit IRC | 17:25 | |
*** ansmith has joined #tripleo | 17:27 | |
dciabrin | shardy so quick question: I'd like to ensure that the fix in https://review.openstack.org/#/c/435081 will work on an existing nonha overcloud. To simulate that, I'm assuming I just need to update t-h-t on the undercloud, and retrigger "openstack overcloud deploy". am I correct? | 17:28 |
*** nyechiel has joined #tripleo | 17:29 | |
shardy | dciabrin: yes, assuming you have the related puppet-tripleo change in your image or have otherwise deployed it to the nodes (e.g via deploy artifacts) | 17:29 |
*** yamahata has quit IRC | 17:30 | |
dciabrin | shardy, right, all my controllers are deployed with the latest ocata image and they have the puppet-tripleo change in already. ok so i obviously did something wrong, I don't see the new systemd dropin file being generated after I reran "overcloud deploy". investigating :) | 17:32 |
*** ansmith has quit IRC | 17:33 | |
*** ansmith has joined #tripleo | 17:34 | |
*** kjw3 has joined #tripleo | 17:36 | |
openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui master: Fix nodes actions toolbar https://review.openstack.org/443139 | 17:36 |
*** florianf has quit IRC | 17:37 | |
*** prateek_ has quit IRC | 17:37 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: WIP, enable quickstart to work with clean base OS images. https://review.openstack.org/442764 | 17:37 |
*** bogdando has quit IRC | 17:39 | |
*** cwolferh has quit IRC | 17:45 | |
*** shardy has quit IRC | 17:45 | |
*** dtantsur is now known as dtantsur|afk | 17:45 | |
*** zoli|wfh is now known as zoli|gone | 17:46 | |
*** nyechiel has quit IRC | 17:47 | |
*** derekh has quit IRC | 17:52 | |
*** milan has joined #tripleo | 17:58 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: update master skip list for introspection test https://review.openstack.org/443255 | 17:58 |
*** yamahata has joined #tripleo | 17:59 | |
*** hewbrocca is now known as hewbrocca_afk | 18:03 | |
*** jaganathan has quit IRC | 18:04 | |
*** milan has quit IRC | 18:05 | |
*** b00tcat has quit IRC | 18:06 | |
*** jpena is now known as jpena|off | 18:07 | |
*** karimb has joined #tripleo | 18:07 | |
openstackgerrit | Merged openstack/tripleo-ui master: Add jest dependencies https://review.openstack.org/440546 | 18:12 |
*** salmankhan has quit IRC | 18:15 | |
openstackgerrit | Tim Rozet proposed openstack/tripleo-puppet-elements stable/newton: Adds puppet-systemd https://review.openstack.org/443261 | 18:15 |
*** fzdarsky is now known as fzdarsky|afk | 18:17 | |
*** rbrady is now known as rbrady-food | 18:18 | |
*** dtrainor has quit IRC | 18:25 | |
*** fragatina has quit IRC | 18:25 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: [WIP] collect-logs: add rename task for uncompressed files too https://review.openstack.org/443163 | 18:26 |
bnemec | I see a bunch of multinode jobs failing on /tmp/tmpwolX3I/extra-data.d/10-create-pkg-map-dir: line 11: get_image_element_array: command not found | 18:27 |
openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: WIP: Switch quickstart config from scenario to multinode-settings https://review.openstack.org/438695 | 18:29 |
*** pkovar has quit IRC | 18:32 | |
*** chlong_ has quit IRC | 18:37 | |
*** dsneddon_ has joined #tripleo | 18:38 | |
*** rcernin has joined #tripleo | 18:42 | |
bkero | bnemec: I see those too. Did dib get a push that removed that command? | 18:47 |
bkero | Looks like it was added in this commit back in September: https://review.openstack.org/gitweb?p=openstack/diskimage-builder.git;a=commit;h=37a53354ec51a1d20c3ac7bfa70744fa858dcb88 | 18:52 |
openstackgerrit | Luke Hinds proposed openstack/tripleo-heat-templates master: SSHD Service extensions https://review.openstack.org/443289 | 18:53 |
*** chlong_ has joined #tripleo | 18:53 | |
openstackgerrit | Luke Hinds proposed openstack/tripleo-heat-templates master: SSHD Service extensions https://review.openstack.org/443289 | 18:54 |
openstackgerrit | Luke Hinds proposed openstack/tripleo-heat-templates master: SSHD Service extensions https://review.openstack.org/443289 | 18:55 |
*** tosky has quit IRC | 18:58 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: [WIP] collect-logs: add rename task for uncompressed files too https://review.openstack.org/443163 | 19:06 |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: extras-common: add undercloud_network_cidr as common var https://review.openstack.org/442862 | 19:06 |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart master: break out general_config into config and topology https://review.openstack.org/425451 | 19:07 |
*** karimb has quit IRC | 19:08 | |
openstackgerrit | Merged openstack/os-cloud-config stable/ocata: Updated from global requirements https://review.openstack.org/431681 | 19:08 |
openstackgerrit | Merged openstack/os-collect-config stable/ocata: Updated from global requirements https://review.openstack.org/431682 | 19:08 |
*** rwsu has quit IRC | 19:09 | |
*** rlandy has joined #tripleo | 19:10 | |
*** pcaruana has quit IRC | 19:13 | |
*** bkopilov_ has joined #tripleo | 19:14 | |
*** bkopilov has quit IRC | 19:14 | |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: update master skip list for introspection test https://review.openstack.org/443255 | 19:16 |
*** fragatina has joined #tripleo | 19:17 | |
openstackgerrit | Leehom Li proposed openstack/diskimage-builder master: Fix problem unable disable iptables service https://review.openstack.org/419703 | 19:18 |
*** tosky has joined #tripleo | 19:20 | |
honza | jtomasek: I don't really think the new error handling buys you that much. For some reason, I was expecting a bigger difference? | 19:21 |
honza | jtomasek: What's the best part of it from your POV? | 19:21 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: tripleo docs have overcloud image build instructions, add that option https://review.openstack.org/443294 | 19:21 |
*** abehl has quit IRC | 19:22 | |
openstackgerrit | Paul Belanger proposed openstack/diskimage-builder master: DNM: testing nodepool-dsvm job https://review.openstack.org/443296 | 19:26 |
*** Goneri has quit IRC | 19:27 | |
*** agurenko has quit IRC | 19:28 | |
*** suuuper has quit IRC | 19:34 | |
*** karthiks has quit IRC | 19:35 | |
openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: WIP: Switch quickstart config from scenario to multinode-settings https://review.openstack.org/438695 | 19:37 |
*** amoralej is now known as amoralej|off | 19:39 | |
*** dsneddon_ has quit IRC | 19:41 | |
*** percevalbot` has quit IRC | 19:47 | |
*** karthiks has joined #tripleo | 19:47 | |
*** dsneddon has joined #tripleo | 19:50 | |
*** alop has joined #tripleo | 19:53 | |
*** dparkes has joined #tripleo | 19:56 | |
*** noslzzp has quit IRC | 20:05 | |
*** noslzzp has joined #tripleo | 20:05 | |
*** noslzzp has quit IRC | 20:05 | |
*** noslzzp has joined #tripleo | 20:06 | |
*** dtrainor has joined #tripleo | 20:06 | |
*** karimb has joined #tripleo | 20:06 | |
*** gbarros_ has joined #tripleo | 20:12 | |
*** gchamoul is now known as gchamoul|afk | 20:12 | |
*** gbarros has quit IRC | 20:13 | |
*** chlong_ has quit IRC | 20:16 | |
*** noslzzp has quit IRC | 20:17 | |
*** noslzzp has joined #tripleo | 20:17 | |
*** rbrady-food is now known as rbrady | 20:18 | |
*** iranzo has quit IRC | 20:26 | |
trozet | mwhahaha: hi | 20:27 |
*** chlong_ has joined #tripleo | 20:28 | |
mwhahaha | trozet: hey | 20:28 |
trozet | mwhahaha: need some input from a puppet master :) | 20:28 |
mwhahaha | trozet: sure what are you running into? | 20:29 |
trozet | mwhahaha: https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/database/mysql.pp#L153 in newer versions of puppet I think this works, but in older versions there is an error with the hash key and i have to put it in single quotes to work around it | 20:29 |
mwhahaha | trozet: ah yea it should probably be quoted | 20:30 |
sai | dprince: hey, during stack update one of the novacomputes goes into error..but in order to track the node i cant seem to find the associated isntance uuid in ironic node-list as in https://gist.github.com/smalleni/f26c9760cd56e2fed5f59e670ace80ea | 20:30 |
sai | any idea whats going on? | 20:30 |
trozet | mwhahaha: for only older versions? | 20:30 |
mwhahaha | trozet: for consistency all versions | 20:31 |
openstackgerrit | Paul Belanger proposed openstack/diskimage-builder master: DNM: testing nodepool-dsvm job https://review.openstack.org/443296 | 20:31 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Move ironic into services-docker https://review.openstack.org/443308 | 20:31 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Move mistral into services-docker https://review.openstack.org/443309 | 20:31 |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Move zaqar into services-docker https://review.openstack.org/443310 | 20:31 |
trozet | mwhahaha: crap | 20:31 |
trozet | mwhahaha: so can i just submit another puppet-tripleo patch to fix it for master and backport to ocata, then the original cherry pick for newton ( still havent posted that I can just do it now in the cherry pick) ? | 20:31 |
mwhahaha | trozet: you could probably just fix it in the cherry picks for puppet 3 | 20:32 |
trozet | mwhahaha: ok | 20:32 |
mwhahaha | trozet: for puppet 4 it's more of a best practice | 20:33 |
openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates master: Enables increasing mariadb open files for noha deployments https://review.openstack.org/435081 | 20:33 |
mwhahaha | trozet: I'll see if I can find some doc's around it | 20:33 |
trozet | mwhahaha: best practice to use quotes? | 20:34 |
openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci master: Update to use new service-docker environments https://review.openstack.org/443311 | 20:34 |
trozet | mwhahaha: the reason I didnt was cause in the puppet guide it doesnt use them | 20:34 |
mwhahaha | Yea and the puppet 3 vs 4 | 20:34 |
trozet | https://docs.puppet.com/puppet/4.9/lang_data_hash.html | 20:34 |
mwhahaha | Upstream has moved on from 3 so probably why the docs don't have it | 20:35 |
mwhahaha | But for our case we still need to support 3 | 20:35 |
mwhahaha | 3 eoled in December | 20:35 |
*** rcernin has quit IRC | 20:36 | |
dprince | sai: ironic node-list should show an 'Instance UUID' column that has what you are looking for I think right? | 20:36 |
openstackgerrit | Tim Rozet proposed openstack/puppet-tripleo stable/newton: mariadb: Move generation of systemd drop-in to puppet-tripleo https://review.openstack.org/443312 | 20:37 |
bkero | slagle: do you remember anything about tripleo-build-images? I think that dib had a release recently that broke multinode jobs | 20:37 |
sai | dprince: grep returns nothing, hence the confusion | 20:37 |
* bkero has been git blaming trying to figure out if anybody actually knows anything about this system anymore | 20:37 | |
thrash | bkero: what about it? | 20:39 |
thrash | bkero: have a link to a job? | 20:39 |
bkero | thrash: the dib calls it makes seem to be failing http://logs.openstack.org/95/442595/4/experimental/gate-tripleo-ci-centos-7-scenario002-multinode-oooq-nv/e375def/console.html#_2017-03-08_18_43_55_412052 | 20:39 |
openstackgerrit | Tim Rozet proposed openstack/puppet-tripleo stable/newton: mariadb: Move generation of systemd drop-in to puppet-tripleo https://review.openstack.org/443312 | 20:39 |
bnemec | bkero: The thing I don't understand is that a bunch of jobs have passed since I started seeing this. | 20:39 |
bkero | bnemec: was it transient? | 20:40 |
thrash | bkero: that doesn't look like a problem with tripleo-build-images tbh | 20:40 |
thrash | unless I'm missing something | 20:40 |
bnemec | bkero: I don't think so, because 3 of the last 4 multinode jobs on the cistatus page failed on it. | 20:40 |
bkero | thrash: tripleo.sh's --bootstrap-subnodes calls calls tripleo-ci/scripts/bootstrap-overcloud-full.sh which calls tripleo-build-images | 20:40 |
bnemec | Although it's possible there's some weird ordering on the status page. | 20:41 |
thrash | bkero: sure, but there is nothing in tripleo-build-images that calls that 'get_image_element_array' directly. | 20:41 |
thrash | bkero: looks like a problem with a specific element perhaps | 20:41 |
bkero | thrash: and during that tripleo-build-images it's sourcing in element-info, which should create the bash function get_image_element_array, but doesn't | 20:41 |
bnemec | It's a very strange function. Apparently it's generated by a different dib command: https://github.com/openstack/diskimage-builder/blob/master/diskimage_builder/lib/common-functions#L276 | 20:42 |
bkero | Yes, it's generated here: http://git.openstack.org/cgit/openstack/diskimage-builder/tree/diskimage_builder/lib/common-functions#n253 | 20:42 |
bkero | That was rewritten in V2 | 20:42 |
bkero | Sorry, generated here: http://git.openstack.org/cgit/openstack/diskimage-builder/tree/diskimage_builder/element_dependencies.py#n293 | 20:43 |
*** rbrady is now known as rbrady-afk | 20:43 | |
thrash | bkero: the deepest tripleo-build-images (and the code in tripleo-common) goes is calling disk-image-create | 20:43 |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-specs master: blueprint tripleo-routed-networks-deployment https://review.openstack.org/421009 | 20:44 |
bkero | thrash: do other tripleo jobs still use tripleo-build-images? | 20:44 |
thrash | bkero: tbh, I'm not sure which ones do. | 20:44 |
thrash | was gonna ask trown|outtypewww but... | 20:45 |
trozet | mwhahaha: so i just added you to the cherry pick for newton | 20:45 |
trozet | mwhahaha: and quoted it there | 20:45 |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Containerize Redis service https://review.openstack.org/442151 | 20:45 |
trozet | mwhahaha: however, stable/ocata was already merged. So should I submit a patch to master to quote it and then backport that to stable ocata, can i just propose a change directly to ocata to quote it? | 20:45 |
*** paramite has quit IRC | 20:46 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: [WIP] collect-logs: add rename task for uncompressed files too https://review.openstack.org/443163 | 20:51 |
bkero | bnemec: Since it's intermittent like it is, I wonder if it's a race condition. | 20:51 |
*** ealcaniz has joined #tripleo | 20:55 | |
*** karimb has quit IRC | 20:55 | |
*** hjensas has quit IRC | 20:55 | |
thrash | bkero: did the cli to disk-image-create change at all? | 20:59 |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: Create repos configs for stable branches tripleoci https://review.openstack.org/439503 | 21:01 |
*** ealcaniz has quit IRC | 21:01 | |
*** b00tcat has joined #tripleo | 21:02 | |
mwhahaha | trozet: ocata should be puppet 4 | 21:02 |
trozet | mwhahaha: really? dciabrin just checked his ocata deployment and said it was 3.8 | 21:02 |
*** eck` is now known as eck`gone | 21:03 | |
mwhahaha | trozet: pretty sure it's supposed to be puppet 4 | 21:03 |
trozet | mwhahaha: oh it is it looks like..im on his setup | 21:03 |
*** jprovazn has quit IRC | 21:03 | |
bkero | thrash: I don't know | 21:03 |
dciabrin | trozet, mwhahaha I checked the available packages in http://mirror.centos.org/centos/7/cloud/x86_64/openstack-ocata/common/ | 21:03 |
*** Goneri has joined #tripleo | 21:04 | |
apevec | dciabrin, it's not in common | 21:04 |
dciabrin | but yeah, trozet's right, my env is ocata and puppet-4 is installed | 21:04 |
dciabrin | apevec, oh! | 21:04 |
apevec | since older rdo releases are not puppet4 ready | 21:05 |
dciabrin | apevec, makes sense indeed, thx | 21:05 |
apevec | it's one level up, in release specific tag | 21:05 |
trozet | mwhahaha: well then something is broken with puppet 4? | 21:05 |
thrash | bkero: tripleo-build-image's interfacing with diskimage-builder stops at 'disk-image-create'. It appears to me that this issue lies within dib itself. | 21:05 |
mwhahaha | trozet: link to error message? | 21:05 |
apevec | currently 4.6.2 http://cbs.centos.org/koji/buildinfo?buildID=12721 | 21:06 |
trozet | mwhahaha: https://paste.fedoraproject.org/paste/OuBKl-iS0w7A1VI13KYSZV5M1UNdIGYhyRLivL9gydE=/raw | 21:06 |
apevec | but we have 4.8 candidate, not sure what was blocking it http://cbs.centos.org/koji/buildinfo?buildID=15305 | 21:06 |
dciabrin | apevec, got it on http://mirror.centos.org/centos/7/cloud/x86_64/openstack-ocata/ thx | 21:06 |
thrash | bkero: perhaps in the pkg-map element? | 21:06 |
bkero | thrash: That's where I was looking before, looking back at it again | 21:07 |
*** thrash is now known as thrash|biab | 21:07 | |
*** salmankhan has joined #tripleo | 21:08 | |
mwhahaha | trozet: might be a puppet issue it's ok on 4.9 | 21:09 |
dciabrin | apevec, and it's puppet-3.8.7-2.el7 on newton and older, correct? | 21:09 |
trozet | mwhahaha: is master OOO on puppet 4.9? | 21:09 |
mwhahaha | trozet: no but my local env is | 21:09 |
trozet | mwhahaha: crap | 21:09 |
mwhahaha | trozet: so propose a fix with quotes for ocata/master | 21:09 |
trozet | mwhahaha: ok will do | 21:10 |
apevec | dciabrin, yes, from common http://cbs.centos.org/koji/buildinfo?buildID=11425 | 21:10 |
apevec | mwhahaha, so we need to update puppet to 4.9 ? | 21:10 |
*** dprince has quit IRC | 21:10 | |
mwhahaha | apevec: eventually, but in this case we should just quote the data | 21:11 |
apevec | ok | 21:11 |
mwhahaha | trozet: https://docs.puppet.com/puppet/4.9/lang_data_string.html#bare-words | 21:11 |
trozet | well thanks dciabrin: for testing this out and finding these issues | 21:11 |
apevec | I've tagged 4.8.2 build from Jan in common-pending, please test it | 21:11 |
mwhahaha | trozet: i think it's because it starts with a capital L | 21:11 |
mwhahaha | yea that's the problem | 21:12 |
mwhahaha | TIL | 21:12 |
trozet | mwhahaha: ah! | 21:12 |
mwhahaha | Unquoted words that begin with upper case letters are interpreted as data types or resource references, not strings. | 21:12 |
trozet | mwhahaha: damn.. | 21:12 |
dciabrin | oh wow | 21:12 |
mwhahaha | trozet: in the future cover with spec test | 21:12 |
mwhahaha | it would have uncovered this | 21:12 |
* mwhahaha shakes fist | 21:12 | |
trozet | mwhahaha: but in 4.9 it doesn't happen? | 21:12 |
mwhahaha | trozet: no it still happens | 21:12 |
trozet | mwhahaha: when you just tested it | 21:12 |
mwhahaha | i wasn't testing that combination | 21:13 |
*** salmankhan has quit IRC | 21:13 | |
mwhahaha | http://paste.openstack.org/show/601989/ | 21:13 |
trozet | mwhahaha: do you want me to add a test when i submit this patch to master to fix the quotes? | 21:13 |
apevec | so moral: quoting is good ? | 21:13 |
mwhahaha | yes quoting is good | 21:13 |
mwhahaha | trozet: yes it would be a good idea | 21:13 |
*** liupe__ has quit IRC | 21:13 | |
trozet | mwhahaha: ok will do, thanks | 21:14 |
* mwhahaha will start -1 anything without tests that can be tested easily | 21:14 | |
bnemec | bkero: Hmm, this has been happening a lot today: http://logstash.openstack.org/#dashboard/file/logstash.json?query=build_name%3A%20*tripleo-ci*%20AND%20build_status%3A%20FAILURE%20AND%20message%3A%20%5C%22get_image_element_array%3A%20command%20not%20found%5C%22 | 21:15 |
bkero | bnemec: So it does | 21:17 |
bnemec | Hmm, I wonder if that's a red herring. Maybe we get that particular message in every multinode job. | 21:17 |
*** jayg is now known as jayg|g0n3 | 21:17 | |
bkero | oh? | 21:18 |
bnemec | The thing that actually fails is the next script that gets run, on the AttributeError. | 21:19 |
bkero | bnemec: I don't see it here: http://logs.openstack.org/43/409143/17/check/gate-tripleo-ci-centos-7-nonha-multinode/ccad6ce/logs/var/log/bootstrap-subnodes.txt.gz | 21:19 |
bnemec | Although I'm getting the same number of results for that query, so they're probably related. | 21:19 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Set multinode scenarios with quickstart https://review.openstack.org/443204 | 21:20 |
bkero | bnemec: this sounds like what happens when one of the element arrays would be blank | 21:20 |
*** lblanchard has quit IRC | 21:20 | |
mwhahaha | it's something new cause my undercloud change is now throwing this error and it wasn't previously | 21:21 |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: Deploy multinode scenarios with deploy args https://review.openstack.org/443188 | 21:21 |
mwhahaha | http://logs.openstack.org/43/442143/1/check/gate-tripleo-ci-centos-7-nonha-multinode/6b95dae/console.html#_2017-03-08_18_43_07_091077 | 21:22 |
bkero | bnemec: args_to_elements is only called after disk-image-create checks that at least 1 element has been specified | 21:24 |
bkero | Although it mixes $* and $@ | 21:25 |
bkero | bnemec: if this gets bad enough I can add a DIB_DEBUG_TRACE and see if that makes a diff, but the turnaround time for that is long | 21:27 |
bkero | Do you suppose it's the IMAGE_ELEMENT_YAML that's being referenced in the traceback? | 21:29 |
*** salmankhan has joined #tripleo | 21:29 | |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: test pingtest with scenarios https://review.openstack.org/443327 | 21:29 |
bnemec | bkero: Oh, this is interesting. The passing job has COMMON_ELEMENTS_PATH=/usr/share/diskimage-builder/elements | 21:30 |
bnemec | The failing one is COMMON_ELEMENTS_PATH=/usr/lib/python2.7/site-packages/diskimage_builder/elements | 21:31 |
bkero | I just checked overcloud-images.yaml and overcloud-images-centos7.yaml, but as expected both apssed a linter | 21:31 |
bkero | hmm | 21:31 |
bkero | We don't back up /usr from jobs, so can't really inspect that :< | 21:31 |
bnemec | bkero: I don't think this is actually happening in tripleo-build-images. I think that's doing its job. It's the instack call that immediately follows that is failing. | 21:32 |
bnemec | I wonder if there's an assumption in instack somewhere that the elements live at /usr/share/diskimage-builder | 21:32 |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DON'T MERGE: testing pingtest scenario https://review.openstack.org/443328 | 21:33 |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: test pingtest with scenarios https://review.openstack.org/443327 | 21:34 |
bkero | bnemec: I think that's it | 21:34 |
bkero | bnemec: look at this | 21:34 |
bkero | http://git.openstack.org/cgit/openstack/instack/tree/instack/main.py#n100 | 21:34 |
bkero | Hmm, that's for lib though, not elements\ | 21:35 |
bnemec | bkero: Yep, that looks promising. | 21:35 |
bkero | There's also http://git.openstack.org/cgit/openstack/instack/tree/instack/main.py#n44 | 21:36 |
openstackgerrit | Tim Rozet proposed openstack/tripleo-heat-templates stable/ocata: Adds upgrade tasks for OpenDaylight services https://review.openstack.org/443329 | 21:37 |
openstackgerrit | Joe Talerico proposed openstack/puppet-tripleo master: Tuned should be configured properly https://review.openstack.org/437698 | 21:37 |
bkero | bnemec: I don't see how COMMON_ELEMENTS_PATH is sourced in | 21:37 |
bnemec | bkero: It's just added to ELEMENTS_PATH directly: http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/bootstrap-overcloud-full.sh#n46 | 21:38 |
bkero | Ah, yes it's there | 21:38 |
*** egafford has quit IRC | 21:41 | |
*** leanderthal|afk has quit IRC | 21:45 | |
*** ansmith has quit IRC | 21:47 | |
*** flepied has quit IRC | 21:50 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: tripleo docs have overcloud image build instructions, add that option https://review.openstack.org/443294 | 21:54 |
*** ccamacho has quit IRC | 21:55 | |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: Add possibility to clean up image cache directory https://review.openstack.org/439198 | 22:02 |
apevec | any containers folks around? How do I use/apply contrib/tripleo_kolla_template_overrides.j2 ? | 22:04 |
apevec | I've have not found an example usage in tripleo-ci | 22:05 |
*** eck`gone is now known as eck` | 22:06 | |
stevebaker | apevec: we use this wrapper script https://github.com/dprince/undercloud_containers/blob/master/build_kolla.sh | 22:08 |
*** thrash|biab is now known as thrash | 22:08 | |
openstackgerrit | Alex Schultz proposed openstack/puppet-tripleo stable/newton: Stop the chronyd service https://review.openstack.org/443333 | 22:08 |
apevec | stevebaker, thanks! Could that be moved/documented in tripleo-common ? | 22:08 |
stevebaker | apevec: I don't think the script is needed, but we should document a kolla-build example in tripleo-common | 22:09 |
apevec | that works | 22:09 |
*** ooolpbot has joined #tripleo | 22:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1671262 | 22:10 |
*** ooolpbot has quit IRC | 22:10 | |
openstack | Launchpad bug 1671262 in tripleo "Multinode jobs fail with "get_image_element_array: command not found"" [Critical,Triaged] | 22:10 |
apevec | stevebaker, this is for experiment mentioned last day of ptg, to run kolla-build during tripleo-common rpm build | 22:10 |
*** ccamacho has joined #tripleo | 22:11 | |
openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates stable/newton: Deploy NTP with puppet-tripleo profile https://review.openstack.org/443334 | 22:11 |
stevebaker | apevec: ah. can you run kolla-build with --template-only? No need to build the images I think. Also I really think we shouldn't package the resulting templates | 22:12 |
apevec | yeah, just templates | 22:12 |
apevec | why not? | 22:12 |
apevec | anyway, it's an experiment, we'll see if it makes sense or not | 22:14 |
apevec | stevebaker, review will tell, and you'll be in CC :) | 22:14 |
openstackgerrit | Pradeep Kilambi proposed openstack/puppet-tripleo master: Restrict mongodb memory usage https://review.openstack.org/419090 | 22:14 |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: [WIP] collect-logs: add rename task for uncompressed files too https://review.openstack.org/443163 | 22:16 |
*** akrivoka has quit IRC | 22:17 | |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: high level design doc for tripleo quickstart https://review.openstack.org/441480 | 22:17 |
stevebaker | apevec: I don't think there will be a general set of templates useful to all users. Whatever we produce will be quite opinionated. The changes done by kolla_template_overrides.j2 are a good example of that | 22:17 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 22:18 |
apevec | stevebaker, it would be templates for tripleo, in openstack-tripleo-common-containers subpkg | 22:18 |
apevec | not in openstack-kolla | 22:18 |
apevec | it will be easier to see once I have patch ready for review tomorrow | 22:19 |
*** kjw3 has quit IRC | 22:20 | |
*** salmankhan has quit IRC | 22:21 | |
*** b00tcat has quit IRC | 22:21 | |
*** artom has quit IRC | 22:21 | |
openstackgerrit | Michael Johnson proposed openstack/diskimage-builder master: squash-package-install to use the correct python https://review.openstack.org/443336 | 22:22 |
stevebaker | apevec: ah, that would be alright. The next challange would be to build images from those templates - I can't see a way to do that with kolla-build currently | 22:22 |
slagle | bnemec: bkero : pretty sure it has something to do with new diskimage-builder | 22:23 |
*** jcoufal_ has quit IRC | 22:23 | |
bnemec | slagle: Yeah, it looks like dib hasn't been building properly in delorean for a while, so it's anybody's guess when the breakage actually happened. :-/ | 22:24 |
slagle | bnemec: yep, exactly | 22:24 |
*** jcoufal has joined #tripleo | 22:24 | |
*** chlong_ has quit IRC | 22:24 | |
bnemec | The logs don't even go back far enough to find the last successful build. | 22:24 |
*** jcoufal has quit IRC | 22:24 | |
slagle | so i suspect this: https://review.openstack.org/#/c/431237/ | 22:24 |
slagle | which is a bunch of stuff | 22:24 |
slagle | bnemec: actually if you look at the build's repo right before the diskimage-builder pass, it has this version: diskimage-builder-1.27.1-0.20170302015627.65c6da5.el7.centos.noarch.rpm | 22:25 |
slagle | so i guess march 2nd | 22:25 |
slagle | maybe not that big commit then | 22:25 |
bnemec | Ah, good point. | 22:25 |
openstackgerrit | Merged openstack/instack master: Remove link to modindex https://review.openstack.org/426060 | 22:26 |
*** artom has joined #tripleo | 22:27 | |
*** salmankhan has joined #tripleo | 22:27 | |
apevec | DIB has merged v2 feature branch I think today? | 22:27 |
apevec | we had to pin it to 1.27 in stable branches | 22:28 |
apevec | https://review.rdoproject.org/r/5653 | 22:29 |
apevec | correction 1.28 | 22:29 |
*** flepied has joined #tripleo | 22:29 | |
slagle | yes, something with the huge merge | 22:30 |
bnemec | Except we're still getting 1.28 in ci. | 22:30 |
bnemec | And I don't see the big scary merge v2 commit yet. | 22:30 |
apevec | you'll get it in next current-tripleo promotion I guess | 22:31 |
bnemec | I don't think we promote dib. | 22:31 |
*** rwsu has joined #tripleo | 22:31 | |
bnemec | It's supposed to be gated on tripleo, although I don't think we run the multinode jobs on it. Which is something we should fix after this. | 22:31 |
apevec | ah you take it from "current" | 22:32 |
bnemec | So the last successful build before today was https://github.com/openstack/diskimage-builder/commit/65c6da58c3498c92633860dccdc506bd15b5912c | 22:32 |
bnemec | The next commit after that was https://github.com/openstack/diskimage-builder/commit/f1776d72aad14140d4bbf2be94729923eacc9fcd | 22:33 |
bnemec | The only really suspicious thing I see there is the rather broken-looking change to 04-install-pip, which affects centos7 for reasons I can't fathom at the moment. | 22:34 |
bnemec | (opensuse}fedora|centos|centos7|rhel|rhel7) | 22:34 |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 22:34 |
bnemec | Pretty sure that should be s/}/|/ | 22:34 |
bnemec | \o/ regexes | 22:34 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 22:35 |
mwhahaha | so where is the undercloud stackrc generated? | 22:35 |
* mwhahaha is lost | 22:35 | |
slagle | bnemec: have you heard of my new distro? | 22:35 |
slagle | bnemec: i'm calling it opensuse}fedora | 22:35 |
* bnemec thinks about taking up a new career in trademark law | 22:36 | |
*** apevec has quit IRC | 22:37 | |
*** dougbtv has quit IRC | 22:37 | |
bnemec | mwhahaha: It's an os-apply-config template | 22:37 |
bnemec | https://github.com/openstack/instack-undercloud/blob/master/elements/undercloud-install/os-apply-config/root/stackrc | 22:37 |
ianw | bnemec: so i think what has to happen is that instack needs to merge it's feature/v2 branch to master to work with dib master | 22:39 |
ianw | is that something you can do? | 22:39 |
*** apevec has joined #tripleo | 22:39 | |
mwhahaha | bnemec: thanks. I guess I should have used find instead of grep :D | 22:39 |
ianw | the tripelo tests are passing on dib's feature/v2 branch | 22:39 |
apevec | bnemec, so DLRN generated diskimage-builder-1.28.1-0.20170308163502.958ea8a.el7 | 22:40 |
apevec | b/c 1.28.0 is what PBR sees as latest tag from current master head | 22:40 |
apevec | python ./setup.py --version | 22:40 |
apevec | 1.28.1.dev5 | 22:40 |
apevec | but | 22:40 |
apevec | git describe | 22:41 |
apevec | 2.0.0rc1-13-g958ea8a | 22:41 |
apevec | PBR is super confused with those merges | 22:41 |
*** karthiks has quit IRC | 22:42 | |
apevec | ianw, ^ | 22:42 |
ianw | apevec: hmm, 2.0.0rc1 was tagged on the feature/v2 branch | 22:42 |
* mwhahaha has version flashbacks and RU a away | 22:42 | |
apevec | ianw, yes, and that branch was merged to master, right? | 22:42 |
ianw | yes | 22:42 |
bnemec | ianw: I don't think that's it. There's only one commit on instack's v2 branch, and it's already in master too. | 22:42 |
apevec | anyway, commit is right, 958ea8a is current master head | 22:43 |
ianw | apevec: if it helps, I can tag 2.0.0 | 22:43 |
apevec | bnemec, so ignoring version part, you have latest DIB in rdo trunk master | 22:43 |
apevec | ianw, it would, just to clear confusion | 22:43 |
ianw | ok, i was going to wait on that incase we had to slip anything else in before a 2.0.0 release, but it seems to make more problems than it helps | 22:44 |
apevec | ianw, you could push rc2 | 22:44 |
*** jmelvin has quit IRC | 22:44 | |
ianw | well since it's on master it's not really rc any more :) | 22:45 |
ianw | i think at this point we just move to point releases | 22:45 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/instack master: Updated from global requirements https://review.openstack.org/431951 | 22:45 |
apevec | whatever you prefer, in projects following cycle, final rc is retagged as final | 22:46 |
apevec | so you could have rc2 if you want to wait some more | 22:46 |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Containerize Redis service https://review.openstack.org/442151 | 22:46 |
*** ccamacho has quit IRC | 22:46 | |
apevec | then just retag as 2.0.0 | 22:46 |
ianw | apevec: alright, sounds reasonable to do rc2 | 22:47 |
ianw | ok, i have pushed a 2.0.0rc2 tag, hopefully that helps pbr | 22:48 |
ianw | now, back to the instack issue ... if we don't think it's a feature/v2 merge | 22:49 |
slagle | i think it is | 22:50 |
slagle | it's got to do with the changes in element_dependencies.py | 22:51 |
*** apevec has quit IRC | 22:53 | |
*** karthiks has joined #tripleo | 22:54 | |
slagle | i think we probably just ought to pin to 1.28.0 in dlrn trunk for now | 22:54 |
ianw | i'm sorry, i did think that the dib jobs were using from master, but others used requirements | 22:55 |
ianw | that was why i was not surprised the tripleo dib jobs failed on master after the merge, and i thought we had a window to fix that | 22:55 |
bnemec | ianw: We were missing some test coverage on dib. We run an image building job, but not a multinode job where instack gets used in a unique way. | 22:56 |
ianw | ok, this might explain why i'm not able to correlate the error between the multinode job and the failing dib jobs | 22:57 |
slagle | bnemec: even on the ovb jobs we run instack to install the undercloud, where i think we would hit this | 22:58 |
slagle | but maybe not | 22:58 |
bnemec | slagle: I'm only seeing it in multinode jobs: http://logstash.openstack.org/#/dashboard/file/logstash.json?query=build_name:%20*tripleo-ci*%20AND%20build_status:%20FAILURE%20AND%20message:%20%5C%22Cannot%20allocate%20memory%5C%22 | 22:58 |
slagle | if the undercloud install is passing, we could merge this: https://review.openstack.org/#/c/425888/ | 22:58 |
bnemec | Whoops, that's the wrong url | 22:59 |
bnemec | http://logstash.openstack.org/#dashboard/file/logstash.json?query=build_name%3A%20*tripleo-ci*%20AND%20build_status%3A%20FAILURE%20AND%20message%3A%20%5C%22get_image_element_array%3A%20command%20not%20found%5C%22 | 22:59 |
slagle | which eliminates instack from bootstrapping subnodes | 22:59 |
slagle | let me recheck it | 22:59 |
slagle | if it passes, we could merge it to "fix" | 22:59 |
ianw | for this error -> http://logs.openstack.org/95/442595/4/experimental/gate-tripleo-ci-centos-7-scenario002-multinode-oooq-nv/e375def/console.html#_2017-03-08_18_43_55_412016 | 22:59 |
ianw | the "arg_to_elements" function needs to be called to provide that variable in the environment -> https://git.openstack.org/cgit/openstack/diskimage-builder/tree/diskimage_builder/lib/common-functions#n253 | 23:00 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 23:00 |
slagle | ianw: ok, i'm not sure how to do that | 23:00 |
slagle | ianw: instack calls dib-run-parts to run the hooks | 23:00 |
slagle | so...maybe we could string a call together to call arg_to_elements first | 23:01 |
ianw | well presumable instack should call it before running elements ... this is part of the dib standard environment | 23:01 |
ianw | instack must be setting up a bunch of other stuff disk-image-create does too, looking... | 23:01 |
slagle | yes, it sets up an environment | 23:02 |
slagle | putting stuff into os.environ before calling dib-run-parts | 23:02 |
slagle | not sure you can wedge a bash fuction in there though :) | 23:02 |
slagle | bnemec: maybe the undercloud install is passing b/c pkg-map/svc-map aren't used | 23:03 |
slagle | bnemec: anyway, keep an eye on https://review.openstack.org/#/c/425888/ | 23:04 |
slagle | if that passes, we should just merge that | 23:04 |
slagle | gotta go, but will check back later | 23:04 |
bnemec | slagle: Yeah, although that will still leave multinode-upgrades broken. | 23:04 |
bnemec | Because of https://review.openstack.org/#/c/425888/13/toci_gate_test.sh | 23:04 |
ianw | there is a function to create these env vars -> https://git.openstack.org/cgit/openstack/diskimage-builder/tree/diskimage_builder/element_dependencies.py#n293 | 23:04 |
ianw | in theory we could make a version to populate os.environ with them i guess | 23:05 |
ianw | currently they are printed, assuming bash will eval them because disk-image-create is doing the driving | 23:05 |
slagle | i guess we should just capture stdout of _output_env_vars to a tmp file, and source it in the call to dib-run-parts | 23:05 |
ianw | slagle: well the interface to get them would be to call "element-info --env $ELEMENTS" | 23:08 |
ianw | that could be done before dib-run-parts | 23:08 |
ianw | you basically need to eval() the output of that command and it sets up the environment vars that describe [[element,path],...] | 23:09 |
*** ooolpbot has joined #tripleo | 23:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1671262 | 23:10 |
*** ooolpbot has quit IRC | 23:10 | |
openstack | Launchpad bug 1671262 in tripleo "Multinode jobs fail with "get_image_element_array: command not found"" [Critical,Triaged] | 23:10 |
ianw | we did this because we had multiple elements that would walk the element list and none of them supported overriding elements in the same way | 23:10 |
*** salmankhan has quit IRC | 23:10 | |
ianw | now we have a canonical list of elements and path to the element, and we leave all processing up to element-info | 23:10 |
*** dmarlin has quit IRC | 23:10 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 23:10 |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: [WIP] collect-logs: add rename task for uncompressed files too https://review.openstack.org/443163 | 23:11 |
ianw | ok, instack is using expand_dependencies() | 23:13 |
bkero | slagle: so are you going forth with the removing-instack-from-multinode approach? | 23:13 |
ianw | ahh, that's right, we fiddled with that | 23:13 |
bkero | That would fix it for me, although might not fix the more general case | 23:13 |
ianw | what should really happen here is that dib should have a python-based element runner that instack could call instead of doing it itself | 23:15 |
ianw | that way we could func test that in the dib gate and be sure we're not breaking it, and have an api | 23:15 |
bnemec | bkero: Yeah, we're rechecking https://review.openstack.org/#/c/425888/ to see if it fixes this. | 23:15 |
bnemec | ianw: I like the sound of that. :-) | 23:16 |
ianw | bnemec: i think i can roughly see what needs doing in instack/runner.py . i'm not clear though; does it need fixing or is it worked around? | 23:18 |
bnemec | ianw: Actually, thinking some more about it https://review.openstack.org/#/c/425888/ might fix all the jobs. In the multinode-upgrades job I was worried about we'll deploy the previous stable release first. | 23:20 |
*** cdearborn has quit IRC | 23:20 | |
bnemec | Which won't have dib 2.0, so the bootstrap should work. | 23:20 |
*** saneax-_-|AFK is now known as saneax | 23:21 | |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-specs master: blueprint tripleo-routed-networks-deployment https://review.openstack.org/421009 | 23:22 |
*** dparkes has quit IRC | 23:22 | |
bnemec | ianw: So I think at this point we just need to wait for results on that patch. If it passes everything then the problem is worked around. | 23:22 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: replace toci_gate_test.sh https://review.openstack.org/431029 | 23:22 |
bkero | bnemec: That looks like it should work for me | 23:23 |
ianw | bnemec: alright, so that gives us time to fix instack/dib2 | 23:24 |
*** morazi has quit IRC | 23:25 | |
* bnemec is going to wait for ci results elsewhere | 23:25 | |
bnemec | Will check back later tonight | 23:25 |
bkero | bnemec: let me know since I have some work that's dependent on this | 23:27 |
*** pmannidi has joined #tripleo | 23:27 | |
bkero | I'm eager in seeing this merged asap, so need someone around for +W whenever jobs return | 23:27 |
*** rlandy is now known as rlandy|bbl | 23:31 | |
*** bfournie has quit IRC | 23:35 | |
*** Goneri has quit IRC | 23:38 | |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-specs master: blueprint tripleo-routed-networks-ironic-inspector https://review.openstack.org/421011 | 23:39 |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-specs master: Spec: tripleo-routed-networks-deployment - Routed Spine and Leaf https://review.openstack.org/421009 | 23:47 |
openstackgerrit | Dan Sneddon proposed openstack/tripleo-specs master: blueprint tripleo-routed-networks-ironic-inspector https://review.openstack.org/421011 | 23:47 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: DO NOT MERGE -1 WIP tripleo docs have overcloud image build instructions, add that option https://review.openstack.org/443294 | 23:49 |
*** pradk has quit IRC | 23:55 | |
*** david-lyle has quit IRC | 23:56 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!