Wednesday, 2018-03-14

« Tuesday, 2018-03-13 Index Thursday, 2018-03-15 »
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403600:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]00:10
*** pchavva has joined #tripleo00:24
*** egallen has quit IRC00:34
openstackgerritzenghui.shi proposed openstack/tripleo-common master: Defaults to parent_resource name correctly  https://review.openstack.org/55227400:45
*** yamahata_ has quit IRC00:49
*** yamahata_ has joined #tripleo00:49
*** wolverineav has quit IRC00:56
*** wolverineav has joined #tripleo00:57
*** jbadiapa_ has quit IRC01:00
*** wolverineav has quit IRC01:02
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Add Ceph upgrade steps for FFU  https://review.openstack.org/55211401:04
*** mcornea has quit IRC01:04
*** pchavva has quit IRC01:06
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403601:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]01:10
*** itlinux has quit IRC01:12
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/newton: WIP: Make deployed-server resource upward comptatible.  https://review.openstack.org/55256101:13
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: DNM: Testing newton deployed-server mechanism hack.  https://review.openstack.org/55256501:15
*** jbadiapa_ has joined #tripleo01:16
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: WIP: oooq transformation, make sure to use the same deployed server file.  https://review.openstack.org/55206101:19
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: DNM: Add debug and don't fail on validation for ffu.  https://review.openstack.org/55206301:19
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: DNM: Testing FFU from queens branch.  https://review.openstack.org/55206401:19
*** ihrachys has quit IRC01:20
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: WIP: oooq transformation, make sure to use the same deployed server file.  https://review.openstack.org/55206101:20
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: DNM: Add debug and don't fail on validation for ffu.  https://review.openstack.org/55206301:20
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: DNM: Testing FFU from queens branch.  https://review.openstack.org/55206401:20
*** assassin has joined #tripleo01:29
*** assassin has quit IRC01:34
openstackgerritMerged openstack/tripleo-heat-templates master: Enable aodh-api health check  https://review.openstack.org/54285001:36
openstackgerritMerged openstack/tripleo-heat-templates master: Enable gnocchi-api health check  https://review.openstack.org/53824701:36
*** gbarros has quit IRC01:36
*** lblanchard has quit IRC01:38
*** rlandy|afk is now known as rlandy01:53
*** tzumainn has quit IRC01:55
*** noslzzp has joined #tripleo01:55
rlandymwhahaha: myoung|snow|bbl: my reproducer failed to install the undercloud - "oslo_config.cfg.NoSuchOptError: no such option 1350 in group [DEFAULT]"01:57
*** rlandy has quit IRC02:06
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403602:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]02:10
*** myoung|snow|bbl is now known as myoung|rover02:15
*** myoung|rover is now known as myoung|afk02:17
openstackgerritzenghui.shi proposed openstack/os-net-config stable/newton: ifcfg: don't restart ovs if --no-activate is specified  https://review.openstack.org/55272702:19
*** yamahata_ has quit IRC02:35
*** fragatina has quit IRC02:46
*** psachin has joined #tripleo02:48
*** fragatina has joined #tripleo02:51
*** fragatina has quit IRC02:51
*** psachin has quit IRC02:59
*** psachin has joined #tripleo03:03
*** psachin has quit IRC03:05
*** psachin has joined #tripleo03:09
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403603:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]03:10
*** zshi has quit IRC03:17
*** psachin has quit IRC03:17
*** zshi has joined #tripleo03:17
*** pliu has joined #tripleo03:30
*** cshastri has joined #tripleo03:36
*** psachin has joined #tripleo03:36
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Add Ceph upgrade steps for FFU  https://review.openstack.org/55211403:38
openstackgerritMerged openstack/tripleo-heat-templates master: Enable ceilometer-agent-central health check  https://review.openstack.org/54279403:39
*** psahoo has joined #tripleo03:41
openstackgerritMerged openstack/tripleo-heat-templates master: Enable gnocchi-metricd health check  https://review.openstack.org/53822903:43
openstackgerritMerged openstack/tripleo-heat-templates master: Enable cinder-api health check  https://review.openstack.org/54289603:43
*** skramaja has joined #tripleo03:50
*** yamahata_ has joined #tripleo03:51
*** ykarel|afk has joined #tripleo03:51
*** skramaja has quit IRC03:54
*** skramaja has joined #tripleo03:55
*** gkadam has joined #tripleo03:59
*** janki has joined #tripleo04:02
*** khyr0n has joined #tripleo04:02
*** udesale has joined #tripleo04:05
*** atoth has quit IRC04:05
*** dhill__ has quit IRC04:05
*** fragatina has joined #tripleo04:08
*** fragatina has quit IRC04:09
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403604:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]04:10
*** ooolpbot has quit IRC04:10
*** fragatina has joined #tripleo04:10
*** ebarrera has quit IRC04:13
openstackgerritMatt Young proposed openstack/tripleo-quickstart-extras master: Fix overcloud_nodes check failing branch FF  https://review.openstack.org/55136904:13
*** wolverineav has joined #tripleo04:17
*** wolverineav has quit IRC04:21
*** shreshtha has joined #tripleo04:22
*** links has joined #tripleo04:22
*** moshele has joined #tripleo04:28
openstackgerritMerged openstack/tripleo-heat-templates master: Enable collectd health check  https://review.openstack.org/53829404:32
openstackgerritMerged openstack/tripleo-heat-templates master: Enable memcached health check  https://review.openstack.org/54400904:33
openstackgerritMerged openstack/tripleo-heat-templates master: Enable iscsid health check  https://review.openstack.org/54345104:33
openstackgerritMerged openstack/tripleo-heat-templates master: Enable nova-migration-target health check  https://review.openstack.org/53826104:33
openstackgerritMerged openstack/tripleo-heat-templates master: Enable nova placement health check  https://review.openstack.org/53597804:33
openstackgerritMerged openstack/puppet-tripleo master: mistral/api: include cron_trigger  https://review.openstack.org/55169604:33
*** dmacpher has joined #tripleo04:34
*** moshele has quit IRC04:36
*** L2IM2Isighmon has joined #tripleo04:50
*** zshi has quit IRC04:51
*** ramishra has quit IRC04:51
*** zshi has joined #tripleo04:51
jankihi. Can I plz get workflow +1 for https://review.openstack.org/#/c/531322/ and https://review.openstack.org/#/c/547961/04:52
*** L2IM2Isighmon has quit IRC04:55
*** ramishra has joined #tripleo04:58
*** pgadiya has joined #tripleo04:59
*** sanjayu has joined #tripleo05:09
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403605:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]05:10
*** pdeore has joined #tripleo05:14
*** ratailor has joined #tripleo05:14
openstackgerritMerged openstack/os-collect-config master: Updated from global requirements  https://review.openstack.org/55236905:16
*** dpawar has joined #tripleo05:17
openstackgerritMerged openstack/os-apply-config master: Updated from global requirements  https://review.openstack.org/55236705:17
openstackgerritMerged openstack/os-refresh-config master: Updated from global requirements  https://review.openstack.org/55237005:17
*** karthiks has quit IRC05:18
openstackgerrityatin proposed openstack/instack-undercloud master: Ensure mtu is set correctly on ctlplane  https://review.openstack.org/55269305:24
openstackgerritOpenStack Proposal Bot proposed openstack/instack-undercloud master: Updated from global requirements  https://review.openstack.org/55148405:30
*** mdnadeem has joined #tripleo05:31
*** anilvenkata has quit IRC05:46
*** ykarel|afk is now known as ykarel05:47
*** karthiks has joined #tripleo05:51
*** ramishra has quit IRC05:51
openstackgerritOpenStack Proposal Bot proposed openstack/os-collect-config master: Updated from global requirements  https://review.openstack.org/55277705:54
*** ramishra has joined #tripleo05:58
*** anilvenkata has joined #tripleo06:00
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-quickstart-extras master: Use TLS by default with autogenerated certificate in the undercloud  https://review.openstack.org/55278106:00
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-quickstart-extras master: Use TLS by default with autogenerated certificate in the undercloud  https://review.openstack.org/55278106:02
*** karthiks has quit IRC06:05
openstackgerritChandan Kumar proposed openstack/tripleo-heat-templates master: Added release notes of tempest container  https://review.openstack.org/55197006:06
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Extract local CA if it expired  https://review.openstack.org/55040306:07
*** jfrancoa has joined #tripleo06:08
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403606:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]06:10
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common master: Updated from global requirements  https://review.openstack.org/55165906:11
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-common-tempest-plugin master: Updated from global requirements  https://review.openstack.org/55240606:11
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-validations master: Updated from global requirements  https://review.openstack.org/55240806:12
*** anilvenkata has quit IRC06:18
*** anilvenkata has joined #tripleo06:19
*** karthiks has joined #tripleo06:19
*** waleedm has joined #tripleo06:19
*** dbecker has quit IRC06:28
*** pkovar has joined #tripleo06:29
*** yurii has joined #tripleo06:31
*** mdnadeem_ has joined #tripleo06:32
*** jbadiapa_ has quit IRC06:33
*** moshele has joined #tripleo06:33
*** mdnadeem has quit IRC06:33
*** assassin has joined #tripleo06:36
*** radeks has joined #tripleo06:38
*** karthiks has quit IRC06:39
*** mdnadeem_ has quit IRC06:39
*** quiquell has joined #tripleo06:43
*** jbadiapa_ has joined #tripleo06:48
*** gkadam has quit IRC06:50
*** quiquell has quit IRC06:50
*** mdnadeem_ has joined #tripleo06:50
*** karthiks has joined #tripleo06:51
*** suuuper has joined #tripleo06:55
*** dmacpher has quit IRC06:56
*** aufi_ has joined #tripleo07:00
*** pcaruana has joined #tripleo07:04
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403607:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]07:10
*** quiquell has joined #tripleo07:12
*** egallen has joined #tripleo07:14
*** marios has joined #tripleo07:22
*** quiquell_ has joined #tripleo07:28
*** quiquell has quit IRC07:29
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add novajoin service  https://review.openstack.org/46950307:29
*** quiquell_ has quit IRC07:29
openstackgerritJuan Antonio Osorio Robles proposed openstack/python-tripleoclient master: Containerized undercloud: Set --local-domain from undercloud.conf  https://review.openstack.org/55281507:29
openstackgerritJuan Antonio Osorio Robles proposed openstack/python-tripleoclient master: Containerized undercloud: Enable novajoin if configured  https://review.openstack.org/55281607:29
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: WIP Allow haproxy custom endpoints  https://review.openstack.org/55281907:32
openstackgerritJuan Antonio Osorio Robles proposed openstack/python-tripleoclient master: Containerized undercloud: Set --local-domain from undercloud.conf  https://review.openstack.org/55281507:32
openstackgerritJuan Antonio Osorio Robles proposed openstack/python-tripleoclient master: Containerized undercloud: Enable novajoin if configured  https://review.openstack.org/55281607:32
openstackgerritJuan Antonio Osorio Robles proposed openstack/python-tripleoclient master: Containerized undercloud: Set --local-domain from undercloud.conf  https://review.openstack.org/55281507:36
openstackgerritJuan Antonio Osorio Robles proposed openstack/python-tripleoclient master: Containerized undercloud: Enable novajoin if configured  https://review.openstack.org/55281607:37
bandinijaosorior: on https://review.openstack.org/#/c/552819 I have a question for you :)07:37
jaosoriorbandini: what's up?07:37
bandiniam a little torn as to the approach07:37
jaosoriorbandini: what's the goal?07:37
bandinijaosorior: the goal is to allow users to customize the listen options on a per service basis in haproxy07:38
jaosoriorbandini: uhm... sure, I get that; but what's the use-case? You would normally do that by setting the service net map, and changing the service's network, then haproxy would listen on that network07:38
bandinijaosorior: one use case I was thrown at was that cinder operations time out if you use a specific storage backend and so custy needs to customize the timeouts for that service07:40
*** gkadam has joined #tripleo07:40
bandinijaosorior: so I was looking for a more generic solution where an operator might want to customize options07:40
*** yurii has quit IRC07:40
*** dpawar has quit IRC07:41
jaosoriorbandini: oh, now I get it07:41
jaosoriorTengu: hadn't you done something like that? ^^07:41
bandiniI think in general the idea has merit07:42
*** assassin has quit IRC07:42
jaosoriorbandini: it does (now that I understand it)07:42
bandiniam just not yet sure on the approach a) add a gazillion options in tripleo::haproxy b) hook into tripleo::haproxy::endpoint via some hiera keys07:42
*** assassin has joined #tripleo07:42
bandiniI kind of like the little code needed with b), but it's not very discoverable07:43
jaosoriorbandini: you could do something like this: http://paste.openstack.org/show/700864/07:43
jaosoriorwithout the underscore after options07:44
jaosoriorbandini: yeah... that's a general problem with that module07:44
bandinijaosorior: yeah your pastebin is pretty much my option b)07:45
jaosoriorbandini: up to you; I like the idea though07:46
bandinijaosorior: I'll start polishing variant b) then and then we can always cycle back to a) (or something else) if we want/need07:46
jaosoriorI know it could be done better, but it's more a limitation of the haproxy puppet module itself.07:46
bandinijaosorior: thanks!07:46
bandiniyeah07:46
jaosoriorbandini: ideally, I wanna move to start setting the endpoints via hiera07:46
jaosoriorand remove all the hardcoded shit we have in manifests/haproxy.pp07:46
bandinijaosorior: yeah a cleanup there would be quite nice07:47
jaosorioryou can set dynamic endpoints with this https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy.pp#L85007:47
*** dpawar has joined #tripleo07:48
*** yurii has joined #tripleo07:49
*** ledo_ has joined #tripleo07:50
openstackgerritJiri Tomasek proposed openstack/tripleo-ui stable/queens: Add nova to appConfig immutable record  https://review.openstack.org/55282507:50
*** masco has quit IRC07:50
bandiniah yes I saw that this morning07:51
*** ledo_ has quit IRC07:51
*** waleedm_ has joined #tripleo07:51
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add novajoin service  https://review.openstack.org/46950307:52
mandrehonza: please see my comment in https://review.openstack.org/#/c/552649/, there is additional work to get the nova connection to tripleo-ui in containers. Can you take care of it?07:53
chandankumarmandre: hello07:54
mandrehi chandankumar07:54
chandankumarmandre: is it possible to manage these stuffs https://review.openstack.org/#/c/551441/2/roles/validate-tempest/templates/configure-tempest.sh.j2@49 through tht07:55
chandankumar?07:55
chandankumarmandre: if tempest is runned on undercloud, few files might not be available, then i need to do if else condition in validate tempest role07:57
*** cylopez has joined #tripleo07:57
chandankumarmandre: is there anyother way around for the same07:57
mandrelet me look07:57
*** quiquell has joined #tripleo07:59
mandrechandankumar: instead of copying the files to a dir and bind mount that directory, you can mount each file individually so you can spare the copy07:59
mandreis that what you're after?07:59
*** quiquell has quit IRC07:59
*** cylopez has left #tripleo07:59
Tengujaosorior: like what?08:00
Tengujaosorior: ah, a listener option for haproxy ? I think there is already something08:01
*** quiquell has joined #tripleo08:01
*** mdnadeem has joined #tripleo08:02
*** masco has joined #tripleo08:02
mandrechandankumar: something like "docker run [...] -v {{ working_dir }}/stackrc:{{ working_dir }}/stackrc -v {{ working_dir }}/overcloudrc:{{ working_dir }}/overcloudrc [...]"08:02
*** shardy has joined #tripleo08:03
*** dbecker has joined #tripleo08:04
*** mdnadeem_ has quit IRC08:05
*** stendulker has joined #tripleo08:05
openstackgerritMerged openstack/python-tripleoclient master: undercloud-deploy: Use process-templates.py from t-h-t root  https://review.openstack.org/55201908:08
openstackgerritMerged openstack/python-tripleoclient master: Updated from global requirements  https://review.openstack.org/55239208:08
openstackgerritMerged openstack/tripleo-common stable/queens: Don't notify zaqar in publish_ui_logs_to_swift  https://review.openstack.org/55245208:08
*** yurii has quit IRC08:10
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403608:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]08:10
*** dsariel has quit IRC08:11
openstackgerritJuan Badia Payno proposed openstack/tripleo-heat-templates master: [WIP]logging: read non-containerized logs  https://review.openstack.org/54584108:11
*** yurii has joined #tripleo08:11
chandankumarmandre: yup that would be doable.08:11
*** dmacpher has joined #tripleo08:13
shardyMorning all08:13
shardylooking for reviews on two patches if anyone has a moment - https://review.openstack.org/#/q/topic:bug/175552508:13
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add novajoin service  https://review.openstack.org/46950308:13
*** tesseract has joined #tripleo08:14
*** ebarrera has joined #tripleo08:16
*** khrystoph has quit IRC08:16
chandankumarmandre: let me update the patch08:16
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: Re-use undercloud upgrades tasks.  https://review.openstack.org/55230308:16
*** chlong has quit IRC08:17
shardythanks jaosorior :)08:17
*** bogdando has joined #tripleo08:18
jaosoriorshardy: no biggie. Let me know if you need more reviews.08:18
*** ebarrera has quit IRC08:19
shardyjaosorior: thanks - I'll address the timeout thing in a follow-up patch08:19
*** ebarrera has joined #tripleo08:19
shardyit's actually a bit harder than just passing the value, as we end up passing the same timeout to multiple workflows, meaning the overall timeout could be much longer than the --timeout argument08:19
openstackgerritShangXiao proposed openstack/tripleo-validations master: Update the doc links to the newest ones  https://review.openstack.org/55283508:19
shardywhich clearly won't work well e.g in CI and may confuse operators08:20
shardystill thinking about how to solve that08:20
jaosoriorshardy: I think it should be fine. With the config-download approach, the heat timeout shouldn't be an issue, and the timeout should be focused on ansible... however, ansible is quite slow, so I'm not sure if the same timeout applies08:20
shardyjaosorior: well it's better than a hard-coded timeout, but I still think it should eventually be more accurate08:20
jaosoriorshardy: maybe we're gonna need to configure timeouts per-phase08:20
jaosorioransible-timeout, heat-stack timeout (which will be tricky cause, as you mentioned yesterday, we'll move to separate stacks)08:21
*** florianf has joined #tripleo08:21
shardyjaosorior: yeah, that's one option, but it still doesn't help with how to handle the global --timeout CLI argument08:22
jaosoriorshardy: if we're still thinking about having the global timeout, it could perhaps be handled outside of the workflows.08:23
shardyI'm thinking we may want an abstraction to running the workflows in the client that tracks the execution time08:23
shardyjaosorior: it could, but then we need to duplicate it in tripleoclient and the UI08:23
jaosoriordon't we already have some sort of abstraction? where tripleoclient is tracking zaqar messages to get output of the commands?08:23
shardyI guess that may be the only option though08:23
shardyjaosorior: sort of, we wrap each individual workflow08:23
jaosoriorthe timeout would need to be handled there I think08:23
jaosoriorand then we need an equivalent for the UI... so it'll end up duplicated, but it's the easiest way to do it (I think)08:24
*** quiquell has quit IRC08:24
shardyjaosorior: yeah you may well be right, I was looking for a more server-side solution but seems we may have to just do it in tripleoclient08:24
shardyI'll push a patch for it later08:24
*** yamahata_ has quit IRC08:24
*** quiquell has joined #tripleo08:24
jaosoriorshardy: we set up the hostname and the DnsServers in t-h-t via os-net-config, right?08:25
jaosoriorshardy: does that run before the host_prep_tasks?08:25
d0ugaldtantsur|afk: so I have an answer for you08:25
*** jpena|off is now known as jpena08:25
d0ugaldtantsur|afk: you are not gonna like it :(08:25
shardyjaosorior: not the hostname, but yes the dns servers08:25
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Prepare t-h-t for undercloud in a work dir  https://review.openstack.org/54287508:26
shardybut yes it runs before host_prep_tasks08:26
jaosoriorexcellent08:26
shardyit runs before everything except PreNetworkConfig08:26
jaosoriorok, that's exactly what I needed08:26
jaosoriorthanks08:26
shardysounds good :)08:26
shardybrb, school run08:26
*** quiquell has quit IRC08:28
*** quiquell has joined #tripleo08:30
openstackgerritMerged openstack/tripleo-puppet-elements stable/pike: Create element to purge resolv.conf  https://review.openstack.org/54631008:30
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: [CVE-2018-1000115] memcached: restrict to TCP & internal_api network  https://review.openstack.org/55138708:30
*** quiquell has quit IRC08:31
*** quiquell has joined #tripleo08:31
*** egallen has quit IRC08:33
*** ansiwen has quit IRC08:33
*** amoralej|off is now known as amoralej08:36
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add novajoin service  https://review.openstack.org/46950308:41
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: [CVE-2018-1000115] memcached: restrict to TCP & internal_api network  https://review.openstack.org/55138008:44
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: [CVE-2018-1000115] memcached: restrict to TCP & internal_api network  https://review.openstack.org/55138508:44
*** khyr0n_ has joined #tripleo08:45
*** athomas has joined #tripleo08:47
*** khyr0n has quit IRC08:47
*** kopecmartin has joined #tripleo08:50
*** ccamacho has joined #tripleo08:55
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: [CVE-2018-1000115] memcached: restrict to TCP & internal_api network  https://review.openstack.org/55138208:56
openstackgerritMerged openstack/tripleo-heat-templates master: Updated from global requirements  https://review.openstack.org/55240708:56
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: Add reno for manila generic driver removal  https://review.openstack.org/55181708:56
openstackgerritMerged openstack/puppet-tripleo stable/newton: firewall: don't reload IPtables after cleanup  https://review.openstack.org/55175108:56
openstackgerritMerged openstack/puppet-tripleo stable/ocata: firewall: don't reload IPtables after cleanup  https://review.openstack.org/55175008:56
openstackgerritMerged openstack/puppet-tripleo stable/pike: firewall: don't reload IPtables after cleanup  https://review.openstack.org/55174908:56
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Fixes certificate generation error for Neutron agents  https://review.openstack.org/55143308:56
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Replacing the count with loop.index for indexing  https://review.openstack.org/55242108:56
openstackgerritMerged openstack/tripleo-heat-templates master: Configure firewall rules for Zaqar  https://review.openstack.org/55212408:58
openstackgerritMerged openstack/tripleo-heat-templates master: Set firewall rules for the tacker service  https://review.openstack.org/55212808:58
openstackgerritMerged openstack/tripleo-upgrade stable/queens: FFU upgrade issue with the release loop var.  https://review.openstack.org/55205108:58
openstackgerritMerged openstack/puppet-tripleo master: firewall: don't reload IPtables after cleanup  https://review.openstack.org/55174708:58
*** fzdarsky has joined #tripleo08:58
*** fzdarsky has quit IRC08:59
*** panda|off is now known as panda09:01
*** jpich has joined #tripleo09:04
openstackgerritMerged openstack/python-tripleoclient stable/queens: Clarify minor update CLI and split minor and major classes  https://review.openstack.org/55004109:04
openstackgerritMerged openstack/puppet-tripleo stable/queens: Fix stack update with rabbitmq containers  https://review.openstack.org/55074109:04
openstackgerritMerged openstack/os-net-config master: ifcfg: don't restart ovs if --no-activate is specified  https://review.openstack.org/54800609:04
openstackgerritMerged openstack/tripleo-quickstart-extras master: queens: Add failing barbican tempest test to skip list  https://review.openstack.org/55252909:04
*** fzdarsky has joined #tripleo09:08
openstackgerritzenghui.shi proposed openstack/os-net-config stable/newton: ifcfg: don't restart ovs if --no-activate is specified  https://review.openstack.org/55272709:09
*** holser__ has joined #tripleo09:09
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403609:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]09:10
*** sid1 has joined #tripleo09:10
*** dbecker has quit IRC09:10
*** lucas-afk is now known as lucasagomes09:11
*** dbecker has joined #tripleo09:11
EmilienMhello09:12
EmilienMhjensas: hey, you around?09:12
*** akane has joined #tripleo09:12
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add novajoin service  https://review.openstack.org/46950309:14
EmilienMbogdando: I've done https://review.openstack.org/#/c/552682/ but I'm not sure it's really what we want09:14
EmilienMI need inputs from hjensas  on this one09:14
EmilienMyou can see the output: http://logs.openstack.org/82/552682/2/check/tripleo-ci-centos-7-undercloud-containers/0e95e81/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-03-13_22_17_1809:15
EmilienMbogdando: it sounds like now it fails when deploying the overcloud, so progress09:17
bogdandoEmilienM: yay09:17
EmilienMhttps://review.rdoproject.org/jenkins/job/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/7687/console09:17
EmilienMwe have logs shortly09:17
bogdandocan't test it with local ovb yet though09:17
*** dougbtv has quit IRC09:17
bogdandolibvirt path is blocked by provisioning issues, rdo cloud looks not very happy with ovb jobs as well :)09:17
openstackgerritbinhong.hua proposed openstack/tripleo-quickstart master: clean ansible facts cache  https://review.openstack.org/55284509:19
*** ffiore has joined #tripleo09:23
*** khrystoph has joined #tripleo09:25
*** akane has quit IRC09:27
EmilienMbogdando: it fails here https://logs.rdoproject.org/56/542556/64/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Z265fc78065de4f98af8bdd91b06e9766/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2018-03-14_09_05_5109:27
*** udesale_ has joined #tripleo09:27
rnoriegaHello folks! anyone could give this a go? :-) Thankksss!! https://review.openstack.org/#/c/551270/09:29
*** oscar___ has joined #tripleo09:29
*** udesale__ has joined #tripleo09:29
*** udesale has quit IRC09:29
bogdandoEmilienM: that's really cool, so we have ovb deployed overcloud now09:29
bogdandojust a final steps failed09:30
EmilienM/usr/share/openstack-tripleo-heat-templates/deployed-server/scripts/enable-ssh-admin.sh failed.09:30
openstackgerritNuman Siddique proposed openstack/tripleo-heat-templates master: Remove vxlan iptable firewall rule for ovn-controller service  https://review.openstack.org/55285009:30
bogdandooh, that's basically the very initial step :[09:30
*** ffiore_ has joined #tripleo09:31
*** ffiore has quit IRC09:32
*** udesale_ has quit IRC09:32
EmilienM"Starting workflow to create ssh admin on deployed servers"09:32
EmilienMI'm wondering if we need that on OVB09:32
*** derekh has joined #tripleo09:34
*** sid1 has quit IRC09:35
*** gfidente has joined #tripleo09:37
EmilienMok the workflow is run on OVB, so we probably missed some setup09:38
*** jcoufal has joined #tripleo09:38
EmilienMI wonder if there are some things in elements/undercloud-install/os-refresh-config/post-configure.d/98-undercloud-setup that we haven't ported09:38
*** nyechiel has joined #tripleo09:39
*** tosky has joined #tripleo09:41
bogdandoEmilienM: I wonder if those ironic errors is a thing or just a noise https://logs.rdoproject.org/56/542556/64/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Z265fc78065de4f98af8bdd91b06e9766/undercloud/home/jenkins/docker_journalctl.log.txt.gz#_Mar_14_08_02_5609:41
bogdandodtantsur|afk, derekh: ^^ here perchance?..09:42
openstackgerritMarios Andreou proposed openstack/tripleo-docs master: WIP: Add docs for Q upgrade workflow  https://review.openstack.org/53585909:42
*** holser__ has quit IRC09:42
*** holser__ has joined #tripleo09:43
*** sid1 has joined #tripleo09:46
*** dsariel has joined #tripleo09:46
derekhbogdando: doesn't look like noise to me, can you run the iptables command that failing in the logs on the command line to see if you can get a better idea of why it failed?09:48
bogdandoderekh: will do once I have a live env09:48
*** zoli is now known as zoli|lunch09:49
*** zoli|lunch is now known as zoli09:49
*** akane has joined #tripleo09:49
*** paramite has joined #tripleo09:54
bogdandoderekh: more errors dug out from that ovb job https://logs.rdoproject.org/56/542556/64/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master//Z265fc78065de4f98af8bdd91b06e9766/undercloud/var/log/containers/neutron/server.log.txt.gz#_2018-03-14_08_35_33_98809:55
*** egallen has joined #tripleo09:56
*** jcoufal_ has joined #tripleo09:56
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: Do not record host identification for reproducer ssh commands.  https://review.openstack.org/55043709:58
bogdandoand https://logs.rdoproject.org/56/542556/64/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Z265fc78065de4f98af8bdd91b06e9766/undercloud/var/log/containers/nova/nova-compute.log.txt.gz#_2018-03-14_08_56_13_34409:58
bogdandofor the latter, though, elastic recheck shows 96% SUCCESS of total hits: 37892 lol09:59
*** jcoufal has quit IRC09:59
bogdandoa grey failure/noise...10:00
derekhbogdando: where is the job failing? during node deployment?10:00
openstackgerritChandan Kumar proposed openstack/python-tripleoclient master: Added fake tempest docker service to undercloud config  https://review.openstack.org/55127110:01
derekhor inspection?10:01
bogdandoderekh: nope, it failed later, with unrelated error to those neutron/ironic things: real failure is https://logs.rdoproject.org/56/542556/64/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Z265fc78065de4f98af8bdd91b06e9766/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2018-03-14_09_05_5110:01
bogdandoso it passed intorspection and provisioning10:01
bogdandojust trying to identify real errors to be fixed later10:02
bogdandoas well10:02
derekhbogdando: ack10:03
bogdandoderekh: and wrt https://logs.rdoproject.org/56/542556/64/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Z265fc78065de4f98af8bdd91b06e9766/undercloud/home/jenkins/docker_journalctl.log.txt.gz#_Mar_14_08_02_56, elastic recheck says it is not a failure as well total hits: 45 97% SUCCESS10:05
bogdandoe.g. http://logs.openstack.org/00/550100/5/check/tripleo-ci-centos-7-undercloud-containers/66a44c4/logs/undercloud/var/log/extra/errors.txt#_2018-03-08_13_11_12_83310:06
bogdandoor I may be wrong, cuz that job is the only shown in stats, and it does not verify provisioning10:06
bogdandoit does not deploy overclouds, thus passing10:07
derekhbogdando: ack, even if it is just noise we should probably file it so it can be clean up anyways10:07
bogdandoyeah, looks like a bug10:07
bogdandoreal one, with unknown impact :)10:08
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: [CVE-2018-1000115] memcached: restrict to TCP & internal_api network  https://review.openstack.org/55129210:09
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403610:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]10:10
*** karthiks has quit IRC10:10
*** rcernin has quit IRC10:13
ykarelbogdando, AFAIK this is a known bug10:15
ykarellet me find the bug link10:15
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: Allow custom per-service listen_options for haproxy  https://review.openstack.org/55281910:18
ykarelbogdando, can you check is the bug: https://bugs.launchpad.net/tripleo/+bug/1750874 similar to Errors you mentioned10:21
openstackLaunchpad bug 1750874 in tripleo "[queens promotion] fs001 fails overcloud deploy with 'Authentication failed'" [Critical,Fix released] - Assigned to Alex Schultz (alex-schultz)10:21
jaosoriorCould someone check this patch https://review.openstack.org/#/c/550001/ ? It merely adds the security squad to the squads doc.10:24
*** karthiks has joined #tripleo10:27
*** skramaja has quit IRC10:27
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: Fix rabbitmq haproxy configuration  https://review.openstack.org/55286910:27
bogdandoykarel: thanks! looks like it is, EmilienM^^10:27
ykarelmay be similar fixes required for containerized undercloud10:28
EmilienMit was done afik10:29
jaosoriorthanks EmilienM10:29
EmilienMwith https://review.openstack.org/#/c/548401/410:30
bogdandoEmilienM, mwhahaha, ykarel, hjensas: which brings us back to https://trello.com/c/K9ENCFid/37-fix-bootstrap-nat#comment-5aa8fa29cd1e873f6721109d it seems10:32
bogdandoor NAT fixes was not enough to close that bug10:32
EmilienMI'm not sure it's the same issue but it's possible10:33
*** salmankhan has joined #tripleo10:33
openstackgerritMerged openstack/tripleo-specs master: Add security squad to document  https://review.openstack.org/55000110:35
*** khrystop_ has joined #tripleo10:35
*** khrystoph has quit IRC10:35
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: ironic/undercloud: align configuration with instack-undercloud  https://review.openstack.org/55063810:37
*** shreshtha_ has joined #tripleo10:40
*** shreshtha_ has quit IRC10:41
*** shreshtha_ has joined #tripleo10:41
jaosoriorAlso, if I could get some reviews for these https://review.openstack.org/#/q/topic:novajoin-container+(status:open+OR+status:merged) they add novajoin support for the containerized undercloud10:42
*** shreshtha has quit IRC10:42
*** cshastri has quit IRC10:43
EmilienMjaosorior: one small comment on https://review.openstack.org/#/c/469503/15/docker/services/novajoin.yaml10:44
*** dciabrin has quit IRC10:46
hjensasbogdando: So the fix-bootstrap-nat fixes, on undercloud containers all that is done is set enable routing(forwarding) in the kernel? The rule to accept packages are not added.10:50
bogdandohjensas: I'm not sure I can follow, I hope I'll have a live env soon10:52
bogdandowith the issue reproduced10:52
hjensasbogdando: Fix for non containerized: https://review.openstack.org/#/c/547281/ - Fixes for containerized: https://review.openstack.org/548401 .. The latter does not create any rules to explicitly allow traffic on the FORWARD chain.10:53
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add novajoin service  https://review.openstack.org/46950310:54
jaosoriorEmilienM: thanks for the comment. Fixed.10:54
EmilienMcool10:54
hjensasbogdando: although, I am not in a position to say that is the problem in this case ...10:55
d0ugaljtomasek: Hey, got a moment?10:57
EmilienMhjensas: can you please look at https://review.openstack.org/#/c/552682/ and tell me if that's what we want?10:57
jtomasekd0ugal: hi, I am about to start a meeting, can it wait 1 hour?10:57
d0ugaljtomasek: sure - I just want to chat about this swift message stuff.10:58
hjensasEmilienM: looking.10:58
d0ugaljtomasek: let me know when you are free.10:58
bogdandohjensas, EmilienM: that fix was in place for that OVB job AFAICT10:58
bogdandoyet the issues had happened10:59
bogdandothe issue*10:59
*** shrjoshi has joined #tripleo10:59
bogdandoor do you mean it for another context, to review as unrelated to the subject?10:59
jtomasekd0ugal: ok10:59
*** shreshtha_ has quit IRC11:01
EmilienMhjensas, bogdando : I wonder if we're missing https://review.openstack.org/#/c/547281/5/instack_undercloud/undercloud.py for the containerized undercloud11:02
*** nyechiel has quit IRC11:05
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403611:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]11:10
*** janki has quit IRC11:10
honzamandre: yes, of course, thanks for the reminder11:11
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Standardise Workflow messaging and optionally persist messages  https://review.openstack.org/42506011:12
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Refactor the Baremetal workflows to use the new messaging workflows  https://review.openstack.org/55246011:12
hjensasEmilienM: bogdando: excactly, I think we are missing 547281 as well. (and that is not related to the other masqurading.)11:14
*** stendulker has quit IRC11:15
bogdandoI wish I could see missing "features" to be adopted or purged from instack for containerized UC, like you folks can do!.. :D11:17
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: WIP: Set TripleoUI bind_host via ServiceNetMap  https://review.openstack.org/55287911:17
bogdandothe latter option, to purge, it that I especially like11:17
bogdandois that*11:17
*** brault has joined #tripleo11:19
*** lblanchard has joined #tripleo11:21
*** dtantsur|afk is now known as dtantsur11:26
dtantsurbogdando: hey! InventoryInUse is IIRC bogus. The neutron problem is fixed by using networking-baremetal, which is something hjensas is working on11:28
dtantsurd0ugal: ugh :(11:28
dtantsurd0ugal: okay, I see the problem now. I think your workaround is quite acceptable though. are you working on a patch or should I?11:30
*** jcoufal_ is now known as jcoufal11:31
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: DNM: Add debug and don't fail on validation for ffu.  https://review.openstack.org/55206311:32
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: DNM: Testing FFU from queens branch.  https://review.openstack.org/55206411:34
EmilienMhjensas: thanks for https://review.openstack.org/#/c/552682/11:35
EmilienMit helps.11:35
d0ugaldtantsur: if you could fix that one it'd be great. I'll try and find time to fix the others11:36
dtantsurd0ugal: okie, I'll get to it today11:37
*** noslzzp has quit IRC11:37
jaosoriorshardy: hey, regarding the merging of docker/puppet templates discussion from the PTG: We were talking about still supporting the baremetal deployment but for the overcloud, right? If a service is only meant to be used for the t-h-t-deployed undercloud, it in theory only use the docker template, right? So no need to write the puppet one.11:39
jaosoriorwas gonna poke dprince about it too, but he's not online yet.11:41
*** shrjoshi has quit IRC11:42
*** janki has joined #tripleo11:43
*** ratailor has quit IRC11:43
*** udesale__ has quit IRC11:45
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: DNM: Add debug and don't fail on validation for ffu.  https://review.openstack.org/55206311:47
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: DNM: Testing FFU from queens branch.  https://review.openstack.org/55206411:47
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: [FFU] For deployed server in CI, make sure to get the compta layer.  https://review.openstack.org/55288311:47
shardyjaosorior: personally I was arguing that we should only support the container templates for both undercloud and overcloud, but AIUI dprince has a different view and wants to support both, including for undercloud/single-node use11:49
shardyjaosorior: so, probably it's best to write both for now, but I'd chat with dprince about it11:49
*** dsariel has quit IRC11:50
shardyI think dprince's argument is it gives flexibility wrt what we can support in the future, but personally I'm not sure we can deal with the runtime and CI cost of maintaining both long term11:50
shardyuntil we actually deprecate baremetal support I don't see much option though11:51
*** eck` is now known as eck`gone11:52
*** nyechiel has joined #tripleo11:57
jaosoriorshardy: I agree with your concerns. Gotta poke dprince then. I recently wrote t-h-t support for novajoin, and just wrote it for docker only https://review.openstack.org/#/c/469503/ . With the thought that I didn't really want to support a baremetal version through t-h-t.11:57
*** gfidente is now known as gfidente|not11:58
shardyjaosorior: yeah I'd chat with dprince about it, we should probably formally deprecate baremetal support if not all new services will be added to it11:59
shardywhich may be acceptable for Rocky - I wasn't really clear on the outcome of the various PTG discussions on this topic11:59
jaosoriorshardy: what's the argument again for keeping support for baremetal?12:00
jaosoriorwe're not really supporting it downstream for t-h-t :/12:00
shardyjaosorior: you'll have to ask dprince that - IIRC it was about providing a "packstack replacement" mode for the single-node use-case12:00
shardypersonally I don't see why that can't be container only12:00
jaosoriorright12:00
jaosoriorI really dig the all-in-one installer idea12:01
jaosoriorbut why not make it for containers only12:01
*** kopecmartin_ has joined #tripleo12:01
shardyYeah that's pretty much my view too12:01
*** noslzzp has joined #tripleo12:01
*** salmankhan has quit IRC12:02
*** salmankhan has joined #tripleo12:02
EmilienMI don't think we have the resources to maintain 2 architectures12:02
*** lucasagomes is now known as lucas-hungry12:03
*** kopecmartin has quit IRC12:03
*** masco has quit IRC12:03
EmilienMso far, only dprince wanted to keep some baremetal support12:03
jtomasekd0ugal: ready12:04
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: FFU: Introduce post FFU steps and use them for qeens switch  https://review.openstack.org/54778512:05
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: [FFU] Hook to allow user to pass a custom script for repo switching.  https://review.openstack.org/53950312:05
*** dsariel has joined #tripleo12:05
*** raildo has joined #tripleo12:07
*** PhilSliderS has quit IRC12:07
*** trown|outtypewww is now known as trown12:08
*** trown is now known as trown|ruck12:08
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403612:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]12:10
*** dprince has joined #tripleo12:10
*** PhilSliderS has joined #tripleo12:12
*** pchavva has joined #tripleo12:14
*** PhilSliderS has quit IRC12:15
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: undercloud: add support for masquerade  https://review.openstack.org/55268212:15
EmilienMhjensas, holser__ : could you please review again ^ ?12:15
EmilienMholser__: let me know if we can refactor the iptables rules, I might have missed some of your comments.12:16
openstackgerritMarios Andreou proposed openstack/tripleo-docs master: WIP: Add docs for Q upgrade workflow  https://review.openstack.org/53585912:18
EmilienMalso dprince, FYI https://review.openstack.org/55268212:19
*** morazi has joined #tripleo12:19
holser__EmilienM Firstly, remove || true12:23
holser__Secondly, the main problem is DROP in FORWARD12:23
EmilienMholser__: I'm in meeting now, maybe you can comment on gerrit12:23
holser__Already commented12:23
EmilienMoh thanks12:24
holser__you cannot delete chain with || true then try to create it without || true12:24
holser__either both command should fail or pass12:24
EmilienMyeah12:25
EmilienMholser__: I took it from instack-undercloud, we should improve it for sure12:25
holser__that's logically12:25
holser__however, the problem is not in that12:26
holser__try to ping from node12:26
holser__you will see the packet comes from 10.0.0.0 ( and it's default)12:26
*** atoth has joined #tripleo12:26
holser__However, we try to MASQ 192.168.24.0/2412:26
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Generate and mount wrappers for dnsmasq and keepalived  https://review.openstack.org/55082312:26
dprinceEmilienM: I see the rules, we need to address them. My point is the proposed changes to the config file setting don't appears to aling12:27
dprincealign12:27
*** jpena is now known as jpena|lunch12:27
dprinceEmilienM: like the only thing I proposed here was https://review.openstack.org/#/c/546620/12:28
EmilienMdprince: I saw your -2, I'll switch to use the new parameters12:28
holser__the fix is simple12:28
holser__[heat-admin@overcloud-controller-foo-0 ~]$ sudo ip route del default via 10.0.0.1 dev vlan1012:28
holser__[heat-admin@overcloud-controller-foo-0 ~]$ sudo ip route add default via 192.168.24.1 dev br-ex12:28
holser__routing is ... weird12:28
dprinceEmilienM: but you are suggesting we re-add it in the new installer here: https://review.openstack.org/#/c/552680/12:28
holser__and  iptables -P FORWARD ACCEPT12:29
dprinceEmilienM: what are the new parameters?12:29
EmilienMdprince: the routed networks?12:29
holser__yeah12:29
EmilienMwe need the mechanism to create these rules12:29
dprinceEmilienM: oh, the new, new parameters12:29
EmilienMwhere would you do it otherwise??12:29
dprinceEmilienM: I haven't been following the feature closely. But also note I think some of the iptables rules in that file are un-related12:29
dprinceEmilienM: we need to "tease" this apart a bit... like lets clearly list all the routed parameter stuff in one place. https://trello.com/c/kFtIkto1/17-routed-ctlplane-networking12:30
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Prepare t-h-t for undercloud in a work dir  https://review.openstack.org/54287512:31
*** mdnadeem_ has joined #tripleo12:31
dprinceEmilienM: that feature seems still under development to me12:31
EmilienMdprince: I'm just trying to port https://git.openstack.org/cgit/openstack/instack-undercloud/tree/elements/undercloud-install/os-apply-config/var/opt/undercloud-stack/masquerade for the containerized undercloud12:32
EmilienMwhich is required for baremetal deployments12:32
dprinceEmilienM: It is not12:32
*** rlandy has joined #tripleo12:32
dprinceEmilienM: It may be required for some CI reasons12:32
EmilienMyes, for OVB12:32
dprinceEmilienM: right!12:32
dprinceEmilienM: it belongs in quickstart. It is perhaps the only thing that would work better there12:33
*** sid1 has quit IRC12:33
dprinceEmilienM: you don't need it for real deployments on baremetal though12:33
*** pkovar has quit IRC12:33
EmilienMwhy was it in instack-undercloud then?12:33
dprinceEmilienM: I think it has been there for years. We need to audit it and "tease" apart what is actually required12:34
EmilienMok works for me, cool12:34
slagleit's there b/c we don't require quickstart to setup virt environments12:34
slaglethat would be something "new" that is being proposed12:34
*** mdnadeem has quit IRC12:35
dprinceEmilienM: initial commit was a1a15201d5868163038756fbc8cc20c86daf7306. A consolidation of a bunch of rules12:36
dprinceslagle: ack, thanks12:36
dprinceEmilienM: I think my take is if we want to add these into the overcloud. Lets wrap it, and make it clear what they are actually for12:36
dprinceEmilienM: as-is they just get installed. And as we now see it is a bit confusing12:37
hjensasEmilienM: dprince: I am all for removing the masquerading config feature from undercloud. But we have users that use it, so question is if we can just drop it from container undercloud, or if they need be deprecated?12:38
chandankumarEmilienM: mwhahaha jaosorior please have a look at this review https://review.openstack.org/#/c/551271/ what is missing12:38
*** sid1 has joined #tripleo12:38
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: Wire up a --skip-tags parameter for overcloud upgrade run cli  https://review.openstack.org/55197612:38
dprincehjensas: it hasn't been doing anything at all though12:38
dprincehjensas: has it?12:38
dprincehjensas: sorry, it is deprecated12:39
hjensasdprince: ? If a user enables masquerading the overcloud nodes will reach the outside network this way.12:39
dprincehjensas: so are we now re-thinking this?12:39
*** egallen has quit IRC12:39
*** dsariel has quit IRC12:39
hjensasdprince: so if we just drop it, how do the overcloud nodes reach yum repos, or docker registry etc?12:39
dprincehjensas: we don't want these rules on Overcloud nodes at all. The stuff here would only apply to the undercloud machine right12:39
hjensasdprince: yes, this is the undercloud being the router for overcloud nodes.12:40
dprincehjensas: no, in a production deployment that would be bad12:40
dprincehjensas: only CI environments would require this12:40
dprincehjensas: production deployments would typically have all the Overcloud traffic going through a router instead12:41
hjensasdprince: yeah, it is a spof so typically prod environments would not use the undercloud as router. But if there are prod environments using it, we should deprecate it properly.12:41
*** derekh has quit IRC12:41
dprincehjensas: like for example you can set ControlPlaneDefaultRoute (a heat parameter) and that would allow you to use something other than the undercloud12:41
dprincehjensas: it has been deprecated. sec.12:42
slagleit's not deprecated. and it's not just for CI12:42
hjensasdprince: masquerading was replaced by a new parameter, the configuration of masquerading is still there.12:43
dprincehjensas: http://git.openstack.org/cgit/openstack/instack-undercloud/tree/undercloud.conf.sample#n10612:43
slagleit's also for dev/test. it needs to be properly supported in the installer w/o having to use quickstart12:43
hjensasdprince: # Reason: With support for routed networks, masquerading of the12:43
hjensas# provisioning networks is moved to a boolean option for each subnet.12:43
hjensasdprince: http://git.openstack.org/cgit/openstack/instack-undercloud/tree/undercloud.conf.sample#n6012:44
dprinceslagle: we can do that. My suggestion to Emilien here is that we make it composable though: https://review.openstack.org/#/c/552682/12:44
dprinceslagle: this is more about aligning the parameters I think12:44
*** dougbtv has joined #tripleo12:44
dprincethe parameter names and the files which are getting copied. We now have 3 trello cards mucking with similar things12:45
slagleyea wfm, just as long as it can be done w/o requiring quickstart12:45
dprinceslagle: ++. If it is only for OVB though I would reconsider12:45
EmilienM++ to not require quickstart12:46
dprinceslagle: but if it applies to dev/testing in general I think it is good12:46
EmilienMextraconfig/post_deploy/undercloud_post.sh can be used I think12:46
*** PhilSliderS has joined #tripleo12:47
dprinceEmilienM: wrap it. Somehow. It should be possible to disable it12:47
EmilienMI'm not in favor of solving it in oooq because downstream will have to deal with the same problem12:47
hjensasdev, test, poc environments all use this.12:47
EmilienMyes sure, I can do that12:47
EmilienMwe can have a boolean, disabled by default, etc12:47
EmilienMI guess I need a bit of guidance what rules we actually need as of today12:47
hjensasEmilienM: in the config handling we will need something like http://git.openstack.org/cgit/openstack/instack-undercloud/tree/instack_undercloud/undercloud.py#n127712:47
dprinceEmilienM: the reasons I suggested OOQ was you mentioned it was for OVB. ANything that is OVB specific I actually think should perhaps go only in ooq12:47
hjensasEmilienM: that will be passed to the Heat parameter. If the list is empty we do nothing?12:48
EmilienMhjensas: yeah, it's good12:48
openstackgerritHonza Pokorny proposed openstack/tripleo-heat-templates master: docker: add support for TripleO UI  https://review.openstack.org/51549012:49
*** eck`gone is now known as eck`12:49
EmilienMhjensas: which parameter from instack-undercloud should I use? Since we have sections for each network, etc...12:49
dprinceEmilienM, hjensas: might be worth a quick meeting to sync on these cards and our approaches here12:49
EmilienMdprince: yes, I can schedule something12:50
dprinceEmilienM: tomorrow? This time?12:50
EmilienMyes12:50
EmilienMI'll take care of it12:50
*** pblaho has joined #tripleo12:50
dprincehjensas: works for you? slagle and anyone else interested can come too12:50
EmilienMdprince: done12:51
* EmilienM brb lunch12:51
dprinceEmilienM, hjensas: appologies for any confusiong I've caused. hopefully this meeting helps12:51
*** panda is now known as panda|lunch12:52
*** dsariel has joined #tripleo12:52
hjensasdprince: EmilienM: ack, meeting tomorrow would be good.12:53
EmilienMdprince: tbh I wasn't aware about all of this background12:54
*** zoli is now known as zoli|afk12:54
EmilienMwhich is why I asked hjensas to help a bit on this one, because I was like http://my1.fr/files/emilien-right-now.jpg12:54
*** zoli|afk is now known as zoli12:55
*** mcornea has joined #tripleo12:55
dprinceEmilienM: yeah, some confusiong myself as well. I think it is because we are trying to hit a moving target12:55
jaosoriorEmilienM: lol @ the pic12:55
dprinceyeah, nice pic12:56
*** jmelvin has joined #tripleo12:56
dprinceHow did our pic from the PTG turn out btw?12:56
* dprince forget to look for it12:56
dprincebandini: was totally stepping on that field btw12:57
dprincelike he touched it with his foot several times12:57
*** pdeore has quit IRC12:57
* bandini chuckles12:57
jaosoriordammit bandini12:57
jaosoriorI'm dissapointed12:57
jaosorior:P12:57
bandinithe anarchist in me could not resist :P12:58
bandinithat, and the evil influence from dprince ;)12:58
dprincebandini: doit.sh baby12:58
bandinieheh12:58
lhinds#start meeting security-squad13:00
lhindsderp13:00
lhinds#startmeeting security-squad13:00
openstackMeeting started Wed Mar 14 13:00:37 2018 UTC and is due to finish in 60 minutes.  The chair is lhinds. Information about MeetBot at http://wiki.debian.org/MeetBot.13:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.13:00
*** openstack changes topic to " (Meeting topic: security-squad)"13:00
openstackThe meeting name has been set to 'security_squad'13:00
jaosoriorthanks lhinds13:00
lhinds#chair jaosorior13:00
openstackCurrent chairs: jaosorior lhinds13:00
raildoo/13:00
lhindshey raildo13:00
jaosoriorLets wait some minutes for more folks to show up13:01
raildohey lhinds, what's up?13:01
lhindsgood thanks raildo , ack jaosorior13:01
*** artom has quit IRC13:01
dprincemandre: +2 from me here https://review.openstack.org/#/c/515490/13:03
*** pblaho has quit IRC13:03
dprincehonza: ^^13:03
honzanice, thanks13:04
dprincemandre, honza: patch is in the ballpark. Lets get it in as having it would be helpful to a few teams at this point13:04
jaosoriorlhinds: well, maybe we can start.13:04
lhinds#link https://etherpad.openstack.org/p/tripleo-security-squad13:04
jaosorior#topic Proposal/Work item (continued from last meeting)13:04
*** jmelvin is now known as jmelvin|bomgar13:04
*** openstack changes topic to "Proposal/Work item (continued from last meeting) (Meeting topic: security-squad)"13:04
aleeo/13:04
openstackgerritMerged openstack/tripleo-common master: add option --gather-facts  https://review.openstack.org/54865113:04
lhindshey alee13:04
honzadprince: yes, that's what i thought --- let's fix any issues as they come up13:04
aleelhinds, morning13:04
jaosoriorSo, continuing last week's meeting, we were going through the Work items/proposals13:04
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: New major upgrade workflow implementation.  https://review.openstack.org/54833613:05
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: [DNM]: Apply workaround for P->Q upgrades.  https://review.openstack.org/54922013:05
*** pkovar has joined #tripleo13:05
jaosoriorthere were namely two left: TripleO Threat Analysis and Limit TripleO users13:05
jaosoriorlhinds: any preference on whic to talk about first?13:05
lhindscan go in the order you said them.13:06
*** pkovar has quit IRC13:06
*** anilvenkata has quit IRC13:06
jaosoriorOK13:06
jaosorior#topic TripleO Threat Analysis13:06
*** openstack changes topic to "TripleO Threat Analysis (Meeting topic: security-squad)"13:06
lhindsso this is for us to chew over, and will need an discussion on the ML too.13:06
*** pkovar has joined #tripleo13:06
jaosoriorlhinds: how is this normally done in the Security SIG?13:07
*** pblaho has joined #tripleo13:07
*** lucas-hungry is now known as lucasagomes13:07
lhindsIn the Security SIG we offer threat Analysis for projects. This consists of a series of steps, such as the architecture is laid out, and we then start to walk through a series of questions to look for weaknesses in endpoints, auth, access control.13:08
lhindsWe did this for Barbican before, and the result was a CVE was raised, so it well worthwhile.13:08
lhindsOnce a TA is complete, a project can then be VMT managed13:08
lhindsVMT = vulnerabilty management team.13:08
lhindsThis means if an issue is found, it can be dealt with 'under embargo'13:09
aleelhinds, have any other teams taken advantage of this?13:09
lhindsso that way downstream stakeholders have a window to prepare patches without their systems being at risk between the time of exposure and patching.13:09
lhindsalee: Barbican is one, we also just did Keystone middleware client13:10
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403613:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]13:10
lhindsa number of others too.13:10
lhindsso as I say, it is a uncovering process and results in VMT covereage.13:10
lhindsI know tripleo has downstream coverage in RH for vulns, but they won't handle anything upstream that has not yet landed in a downstream release.13:11
*** tzumainn has joined #tripleo13:11
*** pdeore has joined #tripleo13:12
lhindsthat's essentially it13:12
*** Goneri has joined #tripleo13:13
jaosoriorwell, I think it would be beneficial for TripleO. As you mentioned, perhaps the best way to start is to propose it in the mailing list, could you do that?13:13
lhindsit then needs an architect in tripleo, and someone in the SIG (that can be me), but I can help with both13:13
lhindsjaosorior: I agree. Let me take that as an action13:13
*** akane has quit IRC13:13
openstackgerritMerged openstack/instack-undercloud master: Remove cloud-init and disable os-collect-config  https://review.openstack.org/55096613:13
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: DPDK deployment fails when there is no deprecated parameters  https://review.openstack.org/55230413:13
rlandymwhahaha: the reproducer I ran using the promotion master and https://review.openstack.org/#/c/552693/ failed to install the undercloud 'oslo_config.cfg.NoSuchOptError: no such option 1350 in group [DEFAULT]. I see the gates passed though13:13
lhinds#action lhinds to mail ooo ML about TA13:13
*** pliu has quit IRC13:13
jaosoriorlhinds: I'm also interested in taking part of the TA; and hopefully the mailing list proposal will get other folks interested as well.13:14
lhindsjaosorior: yep13:14
jaosoriorshardy: I know you have a lot on your plate, but would you be interested in taking part? ^^13:14
*** amoralej is now known as amoralej|lunch13:15
openstackgerritMerged openstack/tripleo-ui stable/queens: Add nova to appConfig immutable record  https://review.openstack.org/55282513:15
jaosoriorwell, maybe he'll answer later.13:15
jaosoriorlhinds: anything else in that topic?13:15
lhindsjaosorior: that's it for now13:16
jaosoriorlets move to the next item then.13:16
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: FFU: Fix gnocchi FFU tasks  https://review.openstack.org/54863513:16
jaosorior#topic     Limit TripleO users13:16
*** openstack changes topic to "Limit TripleO users (Meeting topic: security-squad)"13:16
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: FFU: Introduce post FFU steps and use them for qeens switch  https://review.openstack.org/54778513:16
jaosoriorlhinds: you were gonna start working on this at some point soon, right?13:17
lhindsSo this one is essentially around the sudo levels avaliable to stack, heat-admin and validations.13:17
lhindsjaosorior: hope to start the later point of this week.13:17
lhindssome users such as validations have WHEEL (ALL):NOPASSWD13:18
EmilienMlol bandini the rebel13:18
lhindsso that means they can do `sudo su`, or `sudo  rm -rf --no-preserve-root /`13:18
jaosorior:(13:18
lhindsa lot of power.13:18
lhindsso the result of the audit will mean we instead limit `sudo` use to specific commands / actions.13:19
*** jcoufal_ has joined #tripleo13:19
lhindsalso we will look for passwords, private keys...13:19
openstackgerritMerged openstack/python-tripleoclient master: Update the doc links to the right ones  https://review.openstack.org/53521713:20
openstackgerritMerged openstack/tripleo-heat-templates master: Minor update steps for ODL  https://review.openstack.org/53690713:20
lhindsin places such as hieradata, enviroment files etc.13:20
openstackgerritMerged openstack/tripleo-heat-templates master: Convert ServiceNetMap evals to hiera interpolation  https://review.openstack.org/52669213:20
lhindsthats mainly it13:20
openstackgerritLukas Bezdicka proposed openstack/tripleo-heat-templates master: FFU: Fix Cinder services action order  https://review.openstack.org/54863313:20
jaosoriorI guess the best way to start is to come up with the list of users and proposed privileges13:21
aleelhinds, and metadata ..13:21
lhindsalee: yep, ack!13:21
jaosoriorshould we set up an etherpad to collaborate on such list?13:21
*** etingof has quit IRC13:21
lhindsjaosorior: yep..let me do it now quickly so we can get it in the minutes.13:22
jaosoriorgreat13:22
*** jcoufal has quit IRC13:22
lhinds#link https://etherpad.openstack.org/p/tripleo-audit-limit-track13:22
aleelhinds, would the eventual idea be to identify the "red, yellow and green" users and feed those into the security hardening ansible modules?13:22
openstackgerritDmitry Tantsur proposed openstack/tripleo-common master: Rework set_provision_state/set_power_state workflows  https://review.openstack.org/55255413:23
*** anilvenkata has joined #tripleo13:23
dtantsurd0ugal: that's what I ended up with ^^^13:23
dtantsurwill test after lunch13:23
jaosorioralee: how is that usually done in openstack-hardening (the ansible module)?13:24
lhindsalee: don't have a category plan yet, but changes would go into master / releases rather then be a seperate hardening action. We could then possible have a tag to in oooq to allow developers to get a looser environment for debugging13:24
*** psahoo has quit IRC13:24
lhindswe can flesh out the approach in the etherpad13:25
jaosoriorsounds good to me13:25
aleeack13:25
lhindsso feedback / ideas welcome13:25
jaosorioranything else someone would like to add on this topic?13:26
*** dhill_ has joined #tripleo13:26
jaosorior#topic Public TLS proposal work status13:26
*** openstack changes topic to "Public TLS proposal work status (Meeting topic: security-squad)"13:27
*** jpena|lunch is now known as jpena13:27
jaosoriorI started doing some work on enabling TLS by default13:27
jaosoriornote that the proposal is for public TLS only13:27
jaosoriorI sent a notice about it to the mailing list13:27
jaosorior#link http://lists.openstack.org/pipermail/openstack-dev/2018-March/128252.html13:27
*** pgadiya has quit IRC13:28
*** eck` is now known as eck`gone13:28
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Add Ceph upgrade steps for FFU  https://review.openstack.org/55211413:28
jaosoriorAnd proposed some patches for the undercloud already13:28
jaosorior#link https://review.openstack.org/#/q/topic:public-tls-default+(status:open+OR+status:merged)13:28
jaosoriorSo, if folks have time to review those, it would be appreciated13:28
*** pchavva has quit IRC13:29
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Set TripleoUI bind_host via ServiceNetMap  https://review.openstack.org/55287913:29
*** mdnadeem has joined #tripleo13:29
jaosoriorThe remaining items there are: the overcloud and the containerized undercloud13:29
lhindssounds good jaosorior13:29
jaosoriorFor the overcloud we would require a mistral workflow that would create the cert and create the necessary yaml files (this way it would work with the UI as well)13:29
aleejaosorior, so this is using self signed certs unless ipa is around?13:30
aleejaosorior, or using the certmonger local ca?13:30
jaosorioralee: certmonger's local CA13:30
jaosoriorthat would be the default13:30
aleeok13:30
jaosoriorof course, folks can provide their own cert, or use FreeIPA if needed.13:31
jaosoriorthat's still there.13:31
jaosoriorAlso, help is welcome, so if someone wants to contribute to this work, please let me know13:31
*** pchavva has joined #tripleo13:32
lhinds#help jaosorior looking for people to help with Public TLS13:32
*** egallen has joined #tripleo13:32
*** mdnadeem_ has quit IRC13:32
jaosoriorany questions/feedback ?13:33
*** eck`gone is now known as eck`13:33
aleejaosorior, this may be into the weeds a bit, but why mistral instead of ansible?13:34
jaosorioralee: we would need to set the regular enable-tls.yaml templates before heat is called (which gathers and generates the ansible tasks)13:34
*** myoung|afk is now known as myoung|rover13:35
aleeok13:35
jaosorioralee: also, the UI doesn't call ansible directly. As far as I've understood, they rely on mistral workflows.13:35
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates stable/queens: Minor update steps for ODL  https://review.openstack.org/55290313:36
aleejaosorior, as I've been delving lately into the mistral workflows, I can probably help out with this one.13:37
jaosoriorthat would be great13:37
jaosoriorAnother thing to consider is, do we want to allow folks to deploy without TLS?13:37
jankiHi. I can please get reviews for https://review.openstack.org/#/c/552903/. its a cherry-pick13:38
jaosoriorthat would probably also need to be taken into account in the resulting workflow.13:38
aleeis ipsec just for internal tls?13:38
*** dpawar has quit IRC13:38
gunixshardy: are you around?13:38
jaosorioralee: the current IPSec solution is an alternative to encrypt the internal traffic.13:38
gunixremember i was bitching a few days ago that bt-ctlplane didn't get an IP after the reboot and that openstack api was not working?13:38
gunixshardy: ^13:39
jaosoriorso yeah, right now it's only meant for the internal network13:39
*** derekh has joined #tripleo13:40
aleeseems like a good ML item ..13:41
jaosorioralee: wasn't planning on proposing that as a default, since it's for more specific cases.13:41
jaosorioralee: true that.13:41
shardygunix: Hi, yes I remember13:41
*** florianf has quit IRC13:41
gunixshardy: the resolution was just using ip addr add to add the ip to the bridge13:41
jaosorior#action jaosorior to ask for feedback in the ML about allowing deployments without TLS13:41
gunixwell, to the port13:41
*** dsariel has quit IRC13:41
shardygunix: Ok, could it be you have a problem with your config applied via os-net-config which that works around?13:42
shardysounds like it?13:42
jaosorior#topic Secret identification for TripleO session proposal (for the Secret Management work item)13:42
*** openstack changes topic to "Secret identification for TripleO session proposal (for the Secret Management work item) (Meeting topic: security-squad)"13:42
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: [CVE-2018-1000115] memcached: restrict to TCP & internal_api network  https://review.openstack.org/55129213:42
*** ykarel is now known as ykarel|afk13:43
jaosoriorSimilarly to the "Limit TripleO users" item mentioned earlier, the "Secret Management" item needs us to do an audit and identify the deployment's secrets before coming up with a strategy to secure them13:43
jaosoriorI created an etherpad to follow through with this https://etherpad.openstack.org/p/tripleo-audit-secrets13:43
jaosorior#link https://etherpad.openstack.org/p/tripleo-audit-secrets13:44
d0ugaldtantsur: looks good! I think the "return" value for a workflow might be different. So I am not 100% the break-on will work, but if you have tested that already then it is fine.13:44
gunixshardy: i have no idea what os-net-config does13:44
gunixshardy: i followed the default tutorial for deploying undercloud, than rebooted, than noticed the issue13:44
jaosoriorTo folks interested in this item:13:44
gunixshardy: should i open any bug for this? I also have the resolution (adding the ip)13:44
jaosoriorshould we schedule a time to go through the deployment and identify the sensitive data?13:44
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Set TripleoUI bind_host via ServiceNetMap  https://review.openstack.org/55287913:45
gunixshardy: well there probably is a proper way of solving this (making it reboot-persistent)13:45
jaosorioror should we work on it async?13:45
lhindsjaosorior: I can certainly try to help13:45
aleeditto13:45
jaosoriorlhinds, alee great. So, do you guys wanna work on it async? or should we schedule a time to go through this together?13:46
shardygunix: os-net-config is the tool we use to do network configuration13:46
shardygunix: sure please raise a bug with as much detail, so we can figure out if it's a bug or a misconfiguration, thanks!13:46
gunixshardy: where do i raise the bug?13:47
shardygunix: https://bugs.launchpad.net/tripleo/13:47
lhindsjaosorior: I am not sure, I might not be able to lead much on this one, but will make best efforts to help out where its needed13:47
dtantsurd0ugal: I will test it soon, yes. I also have doubts about return values13:47
aleejaosorior, I'm good either way -- a quick meeting not be a bad idea to identify areas to look at.13:47
moguimarjaosorior: async is fine for me13:47
aleewhich we could go back and work on individually13:47
shardygunix: please attach your undercloud.conf (sanitized of any sensitive data) and /etc/os-net-config/config.json, as well as the manual changes you made13:48
lhinds+113:48
jaosorioralright13:48
jaosoriorsounds good to me13:48
jaosoriora quick meeting to identify main areas, and from there work async on the etherpad13:48
moguimar+113:48
jaosorior#topic Any other business13:49
*** openstack changes topic to "Any other business (Meeting topic: security-squad)"13:49
lhindsnothing from me13:49
jaosoriorAnything else that folks would like to bring up to the meeting?13:49
moguimarme neither13:49
jaosorioralright13:50
jaosoriorthanks for joining folks!13:50
jaosorior#endmeeting13:50
*** openstack changes topic to "Welcome to Rocky. CI status: Promotions - Yellow; check/gate - RDO CI jobs Green | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest/"13:50
openstackMeeting ended Wed Mar 14 13:50:20 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)13:50
openstackMinutes:        http://eavesdrop.openstack.org/meetings/security_squad/2018/security_squad.2018-03-14-13.00.html13:50
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/security_squad/2018/security_squad.2018-03-14-13.00.txt13:50
lhindsthanks all o/13:50
openstackLog:            http://eavesdrop.openstack.org/meetings/security_squad/2018/security_squad.2018-03-14-13.00.log.html13:50
*** chlong has joined #tripleo13:50
aleeweshay, ping13:51
moguimarjaosorior: does the meeting invitation is set up to repeat weekly?13:51
aleeweshay, got a couple questions about the barbican cix issue.13:51
jaosoriormoguimar: at least that's what I tried13:51
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Add Ceph upgrade steps for FFU  https://review.openstack.org/55211413:52
jaosoriormoguimar: sent the invite again13:52
aleeweshay, was this showing up only in queens ro in master as well ?13:52
*** amoralej|lunch is now known as amoralej13:52
aleeweshay, when did the problem start?13:52
weshayalee, I think just queens.. trown|ruck ^13:53
moguimarjaosorior: cool, now it is weekly for me as well13:53
moguimarthanks13:53
weshayalee, we've put in the skip list so that we're not on fire with it13:53
aleeweshay, yup - I saw that13:53
*** jcoufal has joined #tripleo13:54
trown|ruckweshay: alee .. afaik just queens, but it has been a while since we have been able to run that job in master13:54
trown|ruckweshay: alee ... so it might show up in master too once we get that far13:54
aleetrown|ruck, I thought it had been running in master?13:54
EmilienMjaosorior: really cool stuffs wrt security nice work folks13:55
openstackgerritJuan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Add novajoin service  https://review.openstack.org/46950313:55
jaosoriorEmilienM: thanks13:55
trown|ruckalee: no we have had an issue on master which prevented even getting to the point where containers are built, so that job has not even run for a week or so... (this is only promote jobs btw)13:56
*** dsariel has joined #tripleo13:56
aleetrown|ruck, things had been broken until we could get a promotion - but that was resolved iirc13:56
aleeso yeah -- its only been a week - but it was still running !13:56
weshaywhat's a brotha gotta do for a promotion13:57
*** jcoufal_ has quit IRC13:57
trown|ruckalee: ya I am probably confusing you ... sorry13:57
trown|ruckalee: the master fs17 promotion job is not running... check/gate is working fine for both queens and master13:57
aleeweshay, trown|ruck  I'm just trying to get a couple of reviews to look at -- to see where its working and where it isn't13:57
trown|ruckalee: https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-queens/13:58
weshaytrown|ruck, this looks ready for review https://review.openstack.org/#/c/551369/413:58
trown|ruckalee: latest one passed because we skip the test, but previous failures have the issue13:58
*** gbarros has joined #tripleo13:58
*** atoth has quit IRC13:59
openstackgerritmathieu bultel proposed openstack/tripleo-heat-templates stable/queens: FFU: Add memcached fast forward upgrade tasks  https://review.openstack.org/55120714:00
aleetrown|ruck, ok - now I just need to find a job where we dont skip the test but its working ..14:00
*** liverpooler has joined #tripleo14:00
weshayalee, are you comfortable w/ the recreate script and have access to rdo-cloud?14:00
aleeweshay, is rdo-cloud working these days?14:01
trown|ruckalee: https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-queens/b32bae8/ is from a week ago and it worked14:01
aleetrown|ruck, cool14:01
jaosoriordprince: I remember you had a patch to enable docker by default (not sure if it's downstream); could you pass it?14:01
jaosoriordprince: I want to have something similar for TLS.14:02
aleeweshay, I guess I'll find out ..14:02
*** liverpooler has quit IRC14:02
trown|ruckalee: hmm maybe not... that job doesnt look like it actually ran the test https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-queens/b32bae8/tempest.html.gz14:02
EmilienMslagle: hey, I'm debugging containerized-undercloud + OVB and it fails here : https://logs.rdoproject.org/56/542556/64/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Z265fc78065de4f98af8bdd91b06e9766/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2018-03-14_09_05_51 - I was wondering why we don't have the logs in /var/log for the script run. Is there anywhere else to14:02
EmilienMdebug? (mistral logs, etc)14:02
*** liverpooler has joined #tripleo14:02
trown|ruckalee: maybe something changed on tempest side and we were not running that test before?14:02
*** shrjoshi has joined #tripleo14:02
aleetrown|ruck, but its working in check/gate right?14:04
aleetrown|ruck, weshay I saw some interesting debug messages from castellan before -- wanted to compare with a working case to see if they're a red herring or not14:05
trown|ruckalee: ya trying to find a queens check job for that to see if the test is run14:07
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Don't stop openvswitch when deploying OpenShift  https://review.openstack.org/54799114:07
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Adjust openshift-ansible ansible config  https://review.openstack.org/55290914:07
*** agurenko has quit IRC14:08
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403614:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]14:10
trown|ruckalee: ok it is running and working in check jobs: http://logs.openstack.org/61/552461/1/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/ec0d36b/logs/14:11
*** ykarel|afk has quit IRC14:12
*** atoth has joined #tripleo14:12
*** dsariel has quit IRC14:13
dtantsurd0ugal: my testing started with a syntax error #success :D14:14
d0ugaldtantsur: haha14:14
d0ugaldtantsur: did you get no error from the CLI when that happened?14:14
aleetrown|ruck, thanks14:14
dtantsurand another one, what a lovely day!14:14
dtantsurd0ugal: I had to use --debug to get something useful out of it14:14
d0ugaldtantsur: oh, I didn't know --debug helped. That behaviour has changed. I only noticed today. https://bugs.launchpad.net/mistral/+bug/175571014:14
openstackLaunchpad bug 1755710 in Mistral "mistral workbook-create not showing users the error" [Critical,Confirmed] - Assigned to Dougal Matthews (d0ugal)14:14
dtantsurd0ugal: well, the error can be found in the HTTP logs14:15
d0ugaldtantsur: yeah, that is what I had to do14:15
d0ugalThere was a time when we showed it to the user14:15
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: Allow custom per-service listen_options for haproxy  https://review.openstack.org/55281914:15
*** waleedm_ has quit IRC14:15
*** waleedm has quit IRC14:15
dtantsurd0ugal: so you were right, I have problems using task().result in break-on14:17
dtantsurd0ugal: does a workflow publish something by default? in case of a failure?14:17
d0ugaldtantsur: I think you can make it work by doing this: https://github.com/openstack/tripleo-common/blob/master/workbooks/baremetal.yaml#L430-L43114:17
numansEmilienM, Hi, can you please take a look at this review - https://review.openstack.org/#/c/530890/ whenever you get some time14:18
dtantsurneat, lemme try14:18
*** trown|ruck is now known as trown|brb14:18
*** trown|brb is now known as trown|ruck14:20
dtantsurd0ugal: mmm, still result: null14:21
*** rbrady has joined #tripleo14:22
dtantsurd0ugal: is it possible to get the result of a particular task execution?14:23
dtantsurhmmm, 'openstack task execution list', this wasn't too hard to guess :)14:23
d0ugaldtantsur: lol, you can pass the execution id to filter it14:25
dtantsurd0ugal: okay, this 'output' thing does not seem to work with failures...14:26
d0ugalgah14:26
d0ugalMaybe there is something else we can use...14:26
*** dsariel has joined #tripleo14:26
dtantsursomething like on-error: publish14:26
d0ugaldtantsur: output-on-error14:27
d0ugalhttps://github.com/openstack/mistral/blob/master/mistral/lang/v2/workflows.py#L38-L3914:27
d0ugalTIL14:27
dtantsuroh14:27
dtantsurlemme try :)14:27
d0ugalI should maybe add this to the _introspect workflow.14:28
aleetrown|ruck, is that check job on master or queens?14:28
trown|ruckalee: that is a queens job14:28
aleetrown|ruck, ok thanks14:28
*** morazi has quit IRC14:29
*** moshele has quit IRC14:30
*** psachin has quit IRC14:30
d0ugaldtantsur: we have various "output" properties on workflow, but no "output-on-error" - I wonder how many of them will handle failures well... :/14:30
*** morazi has joined #tripleo14:32
dtantsurd0ugal: now all looks correctly, but it still fails:14:32
dtantsur Can not evaluate YA14:32
dtantsurQL expression [expression=task().result.provision_state in $.error_states, error=u\'provision_state\', data={}]\n'}]14:32
dprincejaosorior: downstream we are now using plan-environment.yaml14:32
dprincejaosorior: but once the latest upstream patches land we can use that approach instead I think14:33
d0ugaldtantsur: That usually means result doesn't have "provision_state" - maybe the output still isn't working?14:33
jaosoriordprince: but we don't use plan-environment.yaml upstream, or do we?14:33
dtantsurd0ugal: well, it looks correct via CLI...14:33
dprincejaosorior: we aren't going to14:33
jaosoriorok\14:34
*** pblaho has quit IRC14:34
*** gfidente|not is now known as gfidente14:37
*** chlong has quit IRC14:37
*** salmankhan has quit IRC14:38
dtantsurd0ugal: what is keep-result on a task?14:39
d0ugaldtantsur: no idea, where did you see that?14:39
dtantsurd0ugal: https://github.com/openstack/mistral/blob/master/mistral/lang/v2/tasks.py#L8314:39
*** chlong has joined #tripleo14:40
d0ugaldtantsur: "Boolean value allowing to not store action results after task completion (e.g. if they are large and not needed afterwards). Optional. By default is 'true'."14:40
dtantsurah14:40
d0ugalhttps://github.com/openstack/mistral/blob/master/doc/source/user/wf_lang_v2.rst#common-task-attributes14:41
* dtantsur bangs his head on the table14:42
d0ugaldtantsur: seems about right, want to push what you have and I'll take a look?14:43
dtantsurd0ugal: yep14:43
openstackgerritDmitry Tantsur proposed openstack/tripleo-common master: Rework set_provision_state/set_power_state workflows  https://review.openstack.org/55255414:44
dtantsurd0ugal: ^^^14:44
d0ugalWorkflow Squad meeting in 15 mins. https://etherpad.openstack.org/p/tripleo-workflows-squad-status /cc rbrady,d0ugal,apetrich,thrash,toure,jtomasek14:45
*** pblaho has joined #tripleo14:47
*** salmankhan has joined #tripleo14:49
EmilienMnumans : ok14:50
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: New major upgrade workflow implementation.  https://review.openstack.org/54833614:53
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: [DNM]: Apply workaround for P->Q upgrades.  https://review.openstack.org/54922014:53
*** artom has joined #tripleo14:54
*** elgxl has joined #tripleo14:56
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: Ensure ceph-ansible playbooks are run one at a time  https://review.openstack.org/55292014:57
*** ykarel|afk has joined #tripleo14:58
*** ykarel|afk is now known as ykarel14:58
*** mdnadeem has quit IRC15:02
slagleEmilienM: log for what?15:02
*** numans_ has joined #tripleo15:04
*** fzdarsky has quit IRC15:05
*** numans has quit IRC15:05
*** aufi_ has quit IRC15:08
slagleEmilienM: i dont see any logs for overcloud nodes at all in any ovb jobs15:09
slaglei'd start with getting those15:09
*** aufi has joined #tripleo15:10
*** oscar___ has quit IRC15:10
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403615:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]15:10
*** ooolpbot has quit IRC15:10
*** ihrachys has joined #tripleo15:12
*** itlinux has joined #tripleo15:12
d0ugaldtantsur: okay, so there might be a much easier way to solve this. thrash is schooling me.15:12
*** fzdarsky has joined #tripleo15:13
dtantsuroh, thrash rocks :)15:13
*** panda|lunch is now known as panda15:16
*** links has quit IRC15:18
dtantsurfolks, do we have some magical thing generating tempest.conf for the overcloud?15:19
dtantsurand if yes, how do I hack it to enable ironic stuff there?15:19
*** salmankhan has quit IRC15:20
*** salmankhan has joined #tripleo15:20
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Fix newton compat mode for deployed sever.  https://review.openstack.org/55292315:20
*** suuuper has quit IRC15:23
*** rlandy has quit IRC15:24
*** rlandy has joined #tripleo15:24
EmilienMslagle: I was looking at the logs for the deployed-server/scripts/enable-ssh-admin.sh execution15:26
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: New major upgrade workflow implementation.  https://review.openstack.org/54833615:26
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: [DNM]: Apply workaround for P->Q upgrades.  https://review.openstack.org/54922015:26
slagleEmilienM: what you linked is the log15:26
slagleEmilienM: the output goes to stdout, so it's captured in overcloud_deploy.log15:26
d0ugaldtantsur: so my understanding that retry is only triggered if there is a failure is wrong.15:26
EmilienMslagle: ack, thx. I'll reproduce and find out.15:27
d0ugaldtantsur: I blame the previous PTL, he told me this!15:27
d0ugaldtantsur: Patchset 1 on https://review.openstack.org/#/c/552554 should work IMO - maybe there is a Mistral bug here.15:27
d0ugaldtantsur: I think we could maybe try this... continue-on: <% task().result.provision_state != $.target_state and task().result.provision_state not in $.failure_states %>15:28
dtantsurd0ugal: okay, I'll get back to it later15:29
dtantsurthanks for investigation15:29
d0ugaldtantsur: np, sorry for the wasted time.15:29
*** morazi has quit IRC15:29
d0ugaldtantsur: I just commented on patchset 115:29
thrashd0ugal: looking at the mistral code, retry will fire as long as 1) there are retries left (count), 2) the break-on clause isn't true, 3) there is a continue-on clause, and it is *true*15:31
d0ugaldtantsur: ^15:31
*** mcornea_ has joined #tripleo15:32
thrashd0ugal: it *may* be more nuanced than that, but that's how I read it.15:32
thrashd0ugal: https://github.com/openstack/mistral/blob/master/mistral/engine/policies.py#L282-L40415:32
dtantsurwhat's the default of continue-no? just true?15:32
thrashdtantsur: if you don't specify it, it doesn't take it into account15:33
thrashdtantsur: if the action returns SUCCESS, and there is no continue-on, then it stops the loop15:33
*** ihrachys_ has joined #tripleo15:34
dtantsurhmm, okay. I don't quite get why my patch does not work then...15:34
thrashdtantsur: So, if you have an action that will return SUCCESS, but you need it to loop, you *must* specify a continue-on15:34
*** quiquell has quit IRC15:34
thrashdtantsur: tbh, neither do I. :D15:34
*** moshele has joined #tripleo15:34
dtantsurwell, I guess returning success is no-go, because in this case it will not fail after the last iteration...15:35
*** mcornea has quit IRC15:35
thrashdtantsur: You may need to have a next task that if it gets to the end of the retries, it checks the outcome, and errors then.15:35
thrashdtantsur: I've only ever used just continue-on, I haven't used it combined with break-on, so I can't speak to how that would work.15:36
*** ihrachys has quit IRC15:37
thrashdtantsur: from what I can tell though, the break will only trigger if the action itself throws an error15:37
thrashdtantsur: https://github.com/openstack/mistral/blob/master/mistral/engine/policies.py#L383-L38615:37
dtantsurmaaaagiiiic15:37
thrashdtantsur: that may be the magic that we are missing.15:38
thrashd0ugal: ^^^15:38
*** ykarel is now known as ykarel|afk15:39
d0ugalthrash: ugh, I wonder why15:39
d0ugalthrash: maybe this is what Renat was trying to tell me15:40
thrashd0ugal: perhaps...15:40
*** morazi has joined #tripleo15:42
thrashd0ugal: dtantsur so, I may summarize it as saying: Use break-on if you expect your action to be in ERROR and it may eventually go to SUCCESS. Use continue-on if your action will always be in SUCCESS, and you have some other trigger as to whether to continue or not15:42
thrashd0ugal: dtantsur I doubt you would ever want to use both.15:42
d0ugalno, not with that logic :)15:43
thrashdtantsur: Use the continue-on with the yaql that d0ugal mentioned (with all of the conditions in continue-on), then in on-success you can branch based on the actual outcome (in target_state or in error_state)15:44
dtantsurokay, thanks folks. I'll see what we should do here15:44
thrashI'll update the lp15:45
*** quiquell has joined #tripleo15:46
d0ugalthrash: thanks15:46
thrashd0ugal: I'll try to sort out some docs on this...15:46
d0ugalthrash: I think something like your summary would make a good addition, that wraps it up well.15:47
thrashd0ugal: ack15:47
*** sid1 has quit IRC15:47
*** sid1 has joined #tripleo15:47
*** ihrachys__ has joined #tripleo15:49
*** ihrachys_ has quit IRC15:51
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: Include new CLI changes for overcloud update.  https://review.openstack.org/55051715:52
*** quiquell has quit IRC15:52
*** etingof has joined #tripleo15:53
*** bfournie has joined #tripleo15:55
tbarronmwhahaha: are there outstanding iptables/nat/ipforwarding issues still on master and stable/queens from https://bugs.launchpad.net/tripleo/+bug/1750194 ? Or should they all be resolved with current code?15:55
openstackLaunchpad bug 1750194 in tripleo "newer versions of docker switch FORWARD chain to DROP by default" [Critical,Fix released] - Assigned to Alex Schultz (alex-schultz)15:55
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260715:56
tbarronmwhahaha: I'm asking because a current stable/queens (and a few days ago on master) when I15:56
tbarronmwhahaha: deploy ceph with isolated network configuration on a virthost15:57
*** jmelis has joined #tripleo15:57
tbarronmwhahaha: my resolver IPs (one of which is virthost br-ext) are not reachable from overcloud nodes,15:57
dtantsurthrash, d0ugal, how to express "not in" in yaql?15:57
tbarronmwhahaha: nor is the usual default route there15:57
mwhahahatbarron: that sounds like a different issue15:57
tbarronmwhahaha: well earlier I hit iptables on undercloud with a big hammer and added default route and all became reachable, that's why I ask15:58
tbarronmwhahaha: may do that again, just wanted to check if there are any known residual issues first15:58
*** dsariel has quit IRC15:59
*** jmelis has left #tripleo15:59
mwhahahatbarron: that sounds slightly different15:59
mwhahahatbarron: so the overcloud will NAT via the undercloud15:59
mwhahahatbarron: so if you don't properly configure the network that would result in what you've explained15:59
tbarronmwhahaha: I suspect iptables on undercloud since all is reachable from undercloud15:59
d0ugaldtantsur: oh I forgot, it is backwards (imo)  "not x in y"15:59
dtantsurugh, ugly15:59
mwhahahatbarron: if you get me an iptables -vnL i can check15:59
tbarronmwhahaha: ack, I'm just using quickstart15:59
*** elgxl_ has joined #tripleo16:01
*** elgxl_ has quit IRC16:02
*** elgxl__ has joined #tripleo16:02
*** yamahata has joined #tripleo16:03
*** mcornea_ has quit IRC16:04
*** atoth has quit IRC16:04
*** elgxl has quit IRC16:05
*** elgxl__ has quit IRC16:06
*** mcornea has joined #tripleo16:07
*** ledo_ has joined #tripleo16:08
*** waleedm has joined #tripleo16:08
*** nyechiel has quit IRC16:08
tbarronmwhahaha: https://paste.fedoraproject.org/paste/yOb6W-IkiE0UMSGrrjWrjg16:08
mwhahahatbarron: it has the fixes applied so something else is going on in your config16:08
tbarronmwhahaha: looking at that, the missing default route in overcloud would by itself be sufficient to cause the issue but16:08
tbarronmwhahaha: before iptable seemed to be in the mix as well.  Now iiuc you are saying the undercloud iptables look sane so that's not part of the issue.16:09
openstackgerritMatthew Thode proposed openstack/diskimage-builder master: enable systemd profile for Gentoo  https://review.openstack.org/55295216:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403616:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]16:10
*** ooolpbot has quit IRC16:10
tbarronmwhahaha: I guess I need to chase why default route ins't getting set up.  Do we have CI that runs with isolated networks that I can compare with?16:10
mwhahahatbarron: yup, so to explain what i was looking for is that the default FORWARD policy is ACCEPt and there are 2 140 rules under the FORWARD chain (destination ctlplane-subnet and source ctlplane-subnet)16:10
mwhahahatbarron: OVB16:11
tbarronmwhahaha: no virthost based though16:11
dtantsurd0ugal: I finally get something: Exception registering nodes: {u'status': u'FAILED', u'message': [{u'result': None}], u'result': None}16:11
mwhahahatbarron: not upstream16:11
dtantsurnow I need to figure out a meaningful error message :)16:11
tbarronmwhahaha: this used to work on virthost16:11
tbarronmwhahaha: ok, I'll try virthost deploy with isolated networks w/o ceph and see if the issue reproduces16:12
*** dprince has quit IRC16:13
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: Re-use undercloud upgrades tasks.  https://review.openstack.org/55230316:14
*** atoth has joined #tripleo16:17
mwhahahagfidente, fultonj: do you want https://review.openstack.org/#/c/546084/ merged?16:17
gfidentemwhahaha yep16:17
mwhahahak16:17
mwhahahai figured but just wanted to check16:18
*** radeks has quit IRC16:18
gfidentethanks16:18
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Add pre_upgrade_rolling_tasks  https://review.openstack.org/55207316:18
*** kopecmartin_ has quit IRC16:18
*** shrjoshi has quit IRC16:19
fultonjyes, thanks mwhahaha16:19
*** udesale has joined #tripleo16:20
*** fzdarsky has quit IRC16:21
bogdandoEmilienM: So I have a live env to debug that create ssh keys issue. But I do not understand how to debug that http://git.openstack.org/cgit/openstack/python-tripleoclient/tree/tripleoclient/workflows/deployment.py#n117 code/retrigger it ?16:22
bogdandowith a proper data passed16:22
bogdandomistral workflows excecs/actions show nothing like that admin things16:23
*** panda is now known as gabriele16:23
bogdandoand there is no CREATE_FAILED resources in heat16:23
mwhahahabogdando: so the way we had to troubleshoot the iptables thing was get on the console and figure out what was happening to the network16:23
mwhahahabogdando: unfortunately it make it really hard to debug in an ovb environment16:23
openstackgerritMerged openstack/instack-undercloud stable/queens: [CVE-2018-1000115] memcached: restrict to TCP & localhost  https://review.openstack.org/55138816:23
openstackgerritMerged openstack/tripleo-common master: Pass plan_name into get_config action  https://review.openstack.org/55256316:23
bogdandomwhahaha: ok right, but first I would like to know how to re-trigger that action gracefully16:23
openstackgerritMerged openstack/python-tripleoclient master: Pass plan/stack name into config_download workflow  https://review.openstack.org/55256416:23
mwhahahaand by really hard i mean impossible16:23
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Fix typo in network templates  https://review.openstack.org/55244916:23
mwhahahabogdando: it's just run from the undercloud i think16:24
bogdandomwhahaha: http://git.openstack.org/cgit/openstack/python-tripleoclient/tree/tripleoclient/workflows/deployment.py#n99 , right?16:24
bogdandoSo any ideas how to debug that? slagle jistr ? ^^ perchance please?..16:25
bogdandoso it failed like https://logs.rdoproject.org/56/542556/64/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Z265fc78065de4f98af8bdd91b06e9766/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2018-03-14_09_05_51 how may I retrigger that in-place?16:25
*** udesale has quit IRC16:26
mwhahahabogdando: os it's just running in tripleo client when you deploy so you'd probably just want to manually execute the command16:26
bogdandosigh16:26
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: Allow for passing boot-time vars/args to OC nodes  https://review.openstack.org/55296716:26
openstackgerritDmitry Tantsur proposed openstack/tripleo-common master: Fix error handling in set_provision_state/set_power_state workflows  https://review.openstack.org/55255416:26
dtantsurd0ugal, thrash, this works for me finally ^^^16:27
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: Allow for passing boot-time vars/args to OC nodes  https://review.openstack.org/55296716:27
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy OpenShift+CNS  https://review.openstack.org/54393316:27
mwhahahabogdando: because it's just shelling out to run it, you'd just have to set your local env vars correctly16:27
*** gfidente is now known as gfidente|not16:27
bogdandoright, ok...16:27
bogdandothanks16:27
trozetmwhahaha: do you mind reviewing this cherry pick real quick? it's critical for ODL https://review.openstack.org/#/c/552903/16:27
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: ffu: Introduce Neutron fast-forward upgrade tasks  https://review.openstack.org/55121016:28
shardyd0ugal: hey I did some testing on your messaging patch, got a bit stuck so added some questions on the patch16:28
mwhahahabogdando: also debugging ssh is a giant pain in the butt :D you could also try adding some -vvv in a change to get some output, but the real info might come from the ssh daemons on the overcloud nodes16:28
*** gfidente has joined #tripleo16:29
mwhahahatrozet: might want to get some folks with more experiance with the update stuff like marios or holser__  to review that16:29
*** ykarel|afk has quit IRC16:30
bogdandomwhahaha: I'll have hard time ssh'ing into those to debug ssh issues from logs :D16:31
openstackgerritSteven Hardy proposed openstack/tripleo-common stable/queens: Pass plan_name into get_config action  https://review.openstack.org/55296916:31
mwhahahabogdando: pretty much16:32
bogdandodid you use vnc?16:32
bogdandonova console16:32
bogdandobut what is a password?..16:32
*** dprince has joined #tripleo16:32
mwhahahabogdando: i ended up working with weshay to get a libvirt reproducer16:33
mwhahahayou'd have to set the password with virt-customize on the overcloud-full.qcow216:33
bogdandomwhahaha: heh, that's in progress occasionally16:33
mwhahahais not convient16:33
bogdandotrying to deploy a host cloud with quickstart, on libvirt, to get ovb there locally...16:33
*** ebarrera has quit IRC16:34
mwhahahadon't forget to buy a lottery ticket16:34
*** ebarrera has joined #tripleo16:35
*** elgxl has joined #tripleo16:35
*** mcornea has quit IRC16:35
*** mcornea has joined #tripleo16:36
*** hjensas has quit IRC16:40
*** elgxl has quit IRC16:40
openstackgerritMerged openstack/tripleo-quickstart-extras master: Enable undercloud upgrade using tripleo-upgrade role.  https://review.openstack.org/54917916:42
openstackgerritMerged openstack/puppet-tripleo stable/queens: firewall: don't reload IPtables after cleanup  https://review.openstack.org/55174816:42
openstackgerritMerged openstack/python-tripleoclient master: Refactor some common code between overcloud_upgrade and update  https://review.openstack.org/55079916:42
*** arxcruz is now known as arxcruz|off16:42
*** yamahata has quit IRC16:42
*** hjensas has joined #tripleo16:42
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Configure qemu group setting as hugetlbfs for ovs-dpdk  https://review.openstack.org/53132216:44
openstackgerritMerged openstack/tripleo-quickstart master: Add featureset for upgrade undercloud.  https://review.openstack.org/54896916:45
*** karthiks has quit IRC16:46
openstackgerritMerged openstack-infra/tripleo-ci master: Update feed location on planet  https://review.openstack.org/55088716:46
*** janki has quit IRC16:47
*** pkovar has quit IRC16:48
*** sid1 has quit IRC16:50
*** aufi has quit IRC16:51
*** tosky has quit IRC16:53
*** radeks has joined #tripleo16:54
*** trown|ruck is now known as trown|lunch16:55
*** marios has quit IRC16:56
*** karthiks has joined #tripleo16:59
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/queens: Fix newton compat mode for deployed sever.  https://review.openstack.org/55298017:00
*** nyechiel has joined #tripleo17:02
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Fix default nic config file names  https://review.openstack.org/55123717:03
openstackgerritMerged openstack/instack-undercloud master: Add configuration for the Nova proxy endpoint  https://review.openstack.org/55264917:03
openstackgerritMerged openstack/instack-undercloud master: Make user-provided cert take priority over autogenerated one  https://review.openstack.org/55238117:03
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Enable containers by default  https://review.openstack.org/55096517:03
openstackgerritMerged openstack/python-tripleoclient master: Remove nargs="+" from --nodes and --roles expect "comma, string"  https://review.openstack.org/55252817:03
openstackgerritMerged openstack/tripleo-heat-templates master: mistral/undercloud: align configuration with instack-undercloud  https://review.openstack.org/55170017:03
openstackgerritMerged openstack/tripleo-heat-templates master: undercloud_post: manage post mistral config  https://review.openstack.org/55100917:03
openstackgerritMerged openstack/tripleo-heat-templates master: neutron: rename db when upgrading a containerized undercloud  https://review.openstack.org/54960917:03
openstackgerritMerged openstack/tripleo-quickstart-extras master: Fix overcloud_nodes check failing branch FF  https://review.openstack.org/55136917:03
openstackgerritMerged openstack/python-tripleoclient stable/queens: Adds Overcloud Upgrade class and entry points for major upgrade  https://review.openstack.org/54996817:03
*** yurii has quit IRC17:04
mwhahahaso much merging17:04
* mwhahaha wonders what will be broken o17:04
*** gkadam has quit IRC17:05
*** radeks has quit IRC17:06
*** radeks has joined #tripleo17:07
*** radeks has quit IRC17:08
*** radek_ has joined #tripleo17:09
*** radek_ has quit IRC17:10
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403617:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]17:10
*** ooolpbot has quit IRC17:10
*** radeks has joined #tripleo17:10
*** jpich has quit IRC17:14
*** yamahata has joined #tripleo17:15
*** gbarros has quit IRC17:16
openstackgerritMerged openstack/tripleo-specs master: support Vitrage(RCA) service in TripleO  https://review.openstack.org/55242517:16
*** gbarros has joined #tripleo17:17
*** pcaruana has quit IRC17:18
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: FFU: Change order of shutdown in README.rst  https://review.openstack.org/54863217:21
*** gbarros has quit IRC17:21
*** moshele has quit IRC17:22
*** moshele has joined #tripleo17:23
*** zoli is now known as zoli|gone17:23
*** zoli|gone is now known as zoli17:24
*** moshele has quit IRC17:25
*** gbarros has joined #tripleo17:26
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: eslint: use as-needed for arrow-body-style  https://review.openstack.org/54670717:27
*** thrash is now known as thrash|biab17:30
openstackgerritChris Jones proposed openstack/python-tripleoclient master: Deprecate the action parameter for fencing generation.  https://review.openstack.org/55002917:33
*** gfidente has quit IRC17:36
*** gfidente|not is now known as gfidente17:38
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: FFU: Add mongodb fast forward upgrade tasks  https://review.openstack.org/54778717:39
*** khyr0n_ has quit IRC17:40
*** gabriele is now known as panda17:43
*** panda is now known as panda|off17:43
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/queens: FFU: Fix nova fast forward steps  https://review.openstack.org/55120517:44
*** moshele has joined #tripleo17:46
*** dtantsur is now known as dtantsur|afk17:47
*** lblanchard has quit IRC17:47
*** waleedm_ has joined #tripleo17:49
*** ledo__ has joined #tripleo17:49
*** itlinux has quit IRC17:50
*** etingof has quit IRC17:50
*** rbowen has joined #tripleo17:51
*** ledo_ has quit IRC17:52
*** waleedm has quit IRC17:52
*** moshele has quit IRC17:54
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: FFU: Fix glance tasks  https://review.openstack.org/54863417:54
*** pdeore has quit IRC17:55
*** ledo__ has quit IRC17:56
*** waleedm_ has quit IRC17:56
*** wolverineav has joined #tripleo17:57
*** links has joined #tripleo17:57
openstackgerritMarius Cornea proposed openstack/tripleo-heat-templates master: FFU: Upgrades: fix pacemaker checks  https://review.openstack.org/54778917:57
*** itlinux has joined #tripleo17:58
*** jpena is now known as jpena|off18:01
weshayEmilienM, https://review.openstack.org/#/c/548874/ when you have a sec18:02
*** lucasagomes is now known as lucas-afk18:02
EmilienMweshay: ok18:03
*** wolverineav has quit IRC18:03
*** jfrancoa has quit IRC18:04
*** derekh has quit IRC18:04
*** wolverineav has joined #tripleo18:09
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403618:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]18:10
*** waleedm has joined #tripleo18:10
*** ledo_ has joined #tripleo18:10
*** pblaho has quit IRC18:11
*** pradk has joined #tripleo18:11
*** gbarros has quit IRC18:12
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: DNM: Testing FFU from queens branch.  https://review.openstack.org/55206418:12
*** salmankhan has quit IRC18:13
*** wolverineav has quit IRC18:14
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: [CVE-2018-1000115] memcached: restrict to TCP & internal_api network  https://review.openstack.org/55129218:15
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: ironic/undercloud: align configuration with instack-undercloud  https://review.openstack.org/55063818:15
*** fragatina has quit IRC18:15
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: ironic/undercloud: align configuration with instack-undercloud  https://review.openstack.org/55063818:15
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade master: [FFU] For deployed server in CI, make sure to get the compta layer.  https://review.openstack.org/55301218:15
*** fragatina has joined #tripleo18:16
*** gbarros has joined #tripleo18:17
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart-extras master: Add support to mixed upgrade for overcloud-prep-container role.  https://review.openstack.org/54047318:18
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: Take mixed upgrade into account for boostrap_subnode_minimal.  https://review.openstack.org/54424918:20
openstackgerritAthlan-Guyot sofer proposed openstack-infra/tripleo-ci master: DNM: testing ffu upstream as rdo-cloud doesn't collect log when timeout.  https://review.openstack.org/54528118:21
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/queens: Fix newton compat mode for deployed sever.  https://review.openstack.org/55298018:22
*** myoung|rover is now known as myoung|lunch18:23
*** radeks has quit IRC18:24
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Use tripleo-upgrade role in undercloud upgrades job.  https://review.openstack.org/54897418:26
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Use tripleo-upgrade role in undercloud upgrades job.  https://review.openstack.org/54897418:26
*** holser__ has quit IRC18:27
*** ffiore_ has quit IRC18:28
*** ffiore_ has joined #tripleo18:28
*** cylopez has joined #tripleo18:28
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Support SshKnownHostsDeployment with config-download  https://review.openstack.org/53931518:32
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Add spacing for readability  https://review.openstack.org/53938218:32
*** bogdando has quit IRC18:34
*** thrash|biab is now known as thrash18:34
*** trown|lunch is now known as trown|ruck18:38
*** bugzy_ has joined #tripleo18:39
*** bugzy has quit IRC18:42
*** wolverineav has joined #tripleo18:43
*** athomas_ has joined #tripleo18:44
*** sanjayu has quit IRC18:46
*** shardy has quit IRC18:48
*** gbarros has quit IRC18:49
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates master: Fix newton compat mode for deployed server.  https://review.openstack.org/55292318:52
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/queens: Fix newton compat mode for deployed server.  https://review.openstack.org/55298018:53
*** chem is now known as chem|eod18:54
openstackgerritMerged openstack/tripleo-quickstart master: Add chrooted to the common vars  https://review.openstack.org/55257918:55
*** itlinux has quit IRC18:57
*** itlinux_ has joined #tripleo18:57
*** fragatina has quit IRC19:01
*** ihrachys has joined #tripleo19:02
*** ihrachys__ has quit IRC19:02
*** egallen has quit IRC19:05
*** ihrachys has quit IRC19:07
*** ihrachys has joined #tripleo19:07
*** ffiore_ has quit IRC19:08
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403619:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]19:10
*** ooolpbot has quit IRC19:10
openstackgerritMerged openstack/tripleo-quickstart-extras master: Do not attempt install kernel when chrooted  https://review.openstack.org/55258419:12
*** waleedm_ has joined #tripleo19:12
*** ledo__ has joined #tripleo19:12
*** ledo_ has quit IRC19:15
*** waleedm has quit IRC19:15
*** gbarros has joined #tripleo19:17
*** myoung|lunch is now known as myoung|rover19:18
openstackgerritMerged openstack/puppet-tripleo master: Add flag to enable SELinux in docker profile  https://review.openstack.org/55198519:19
openstackgerritMerged openstack/instack-undercloud stable/newton: Fix bootstrap NAT  https://review.openstack.org/55134019:19
openstackgerritMerged openstack/tripleo-heat-templates master: docker-puppet.py: don't pull if image exists  https://review.openstack.org/55095919:19
openstackgerritMerged openstack/tripleo-quickstart master: Revert "fs030: disable tempest"  https://review.openstack.org/53089019:19
openstackgerritMerged openstack/tripleo-common stable/queens: Include active nodes when matching nodes by profile  https://review.openstack.org/55201819:19
openstackgerritMerged openstack/instack-undercloud master: Ensure mtu is set correctly on ctlplane  https://review.openstack.org/55269319:19
openstackgerritMerged openstack/tripleo-quickstart master: Explicitly specify if to run validation in undercloud  https://review.openstack.org/55243319:19
*** tesseract has quit IRC19:20
*** athomas_ has quit IRC19:22
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: update tempest defaults, move workers to tempest role  https://review.openstack.org/55213819:28
openstackgerritMerged openstack/tripleo-heat-templates master: Assignning a value to NeutronServiceName propertiy in neutron-ovs-dpdk-agent.yaml  https://review.openstack.org/55082419:28
openstackgerritMichele Baldessari proposed openstack/instack-undercloud master: Disable libvirtd on the undercloud  https://review.openstack.org/51091119:33
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Explicitly set tempest workers for full tempest featureset  https://review.openstack.org/55301919:34
trown|ruckweshay: ^19:34
*** links has quit IRC19:34
weshaytrown|ruck, thanks19:35
*** moshele has joined #tripleo19:35
*** egallen has joined #tripleo19:35
weshaytrown|ruck, gate queue is back down to 3hr :)19:36
trown|ruckweird19:37
openstackgerritAlan Bishop proposed openstack/tripleo-common stable/pike: Include active nodes when matching nodes by profile  https://review.openstack.org/55302119:37
tbarronmwhahaha: aha! https://review.openstack.org/#/c/552449 gets me beyond the missing default route issue I was bothering you about before19:38
mwhahahatbarron: ah those pesky typos19:39
tbarronmwhahaha: when I first hit the issue we had bad undercloud iptablea *and* missing default route, but they're independent problems19:39
*** moshele has quit IRC19:40
*** itlinux_ has quit IRC19:40
*** moshele has joined #tripleo19:41
*** pchavva has quit IRC19:44
*** jcoufal has quit IRC19:44
*** amoralej is now known as amoralej|off19:45
openstackgerritEmilien Macchi proposed openstack/instack-undercloud stable/queens: Ensure mtu is set correctly on ctlplane  https://review.openstack.org/55302419:45
*** ledo__ has quit IRC19:49
*** waleedm_ has quit IRC19:49
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: undercloud: configure mtu when creating neutron network  https://review.openstack.org/55302619:50
*** vpickard is now known as vpickard_19:51
*** itlinux has joined #tripleo19:52
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: Fix gnocchi-upgrade Table <..> already exists errors  https://review.openstack.org/55302819:54
openstackgerritAndy Smith proposed openstack/puppet-tripleo master: WIP Support separate oslo.messaging services for RPC and Notifications  https://review.openstack.org/51068419:59
*** atoth has quit IRC19:59
itlinuxhello guys.. I have this command openstack overcloud generate fencing --ipmi-lanplus --ipmi-level administrator --output fencing.yaml  instackenv_full.json but it only outputs one server..20:01
itlinuxany tips? Thanks20:01
*** artom has quit IRC20:01
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: Add steps to allow downstream to use featuresets  https://review.openstack.org/53645220:07
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403620:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]20:10
*** morazi has quit IRC20:11
*** eck` is now known as eck`gone20:15
*** ledo_ has joined #tripleo20:16
*** waleedm has joined #tripleo20:16
trozethey guys, can someone remind what waht /var/lib/config-data/ contains for the container config.  Is it the container config after puppet is run (but not limited to just the puppet-generated files) ?20:17
trozetflaper87:^20:21
trozetbtw I mean /var/lib/config-data/<container> not /var/lib/config-data/puppet-generated/20:21
*** etingof has joined #tripleo20:25
aleeweshay, ping20:28
openstackgerritwes hayutin proposed openstack/tripleo-heat-templates stable/queens: A keystone only controller deployment  https://review.openstack.org/55304820:28
openstackgerritBob Fournier proposed openstack/tripleo-heat-templates master: Add check for old-style nic config files  https://review.openstack.org/55020120:28
*** egallen has quit IRC20:29
weshayalee, howdy20:29
aleeweshay, quick question -- I'm trying to reproduce the barbican ci error on rdo-cloud.  I ran the toci_gate_test-oooq.sh and it succeeded20:29
aleebut I realized that the test was blacklisted20:29
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Wrap gnocchi db_sync with bootstrap_host_exec  https://review.openstack.org/55305120:29
aleeso is it sufficient for me to comment out the test in the blacklist and rerun the script?20:30
aleeor do I need to do any cleanup?20:30
weshayalee, ya.. I think we hit that before.. def check to clean up the overcloud, and then rerun20:31
weshayalee, if there are no running instances or storage you are probably fine20:31
weshaythere is not a lot of space on these nodes20:31
aleeweshay, ok - yeah - I still see an overcloud stack -- so openstack stack delete overcloud and then we're good?20:32
weshayalee, oh no20:33
weshaydon't delete your overcloud20:33
weshaysource overcloudrc20:33
weshaythen poke around20:33
aleeweshay, ok - I see no servers ..20:34
*** ledo_ has quit IRC20:34
weshayopenstack server list --all-tenants or something like that20:37
*** raildo has quit IRC20:38
*** fragatina has joined #tripleo20:39
openstackgerritwes hayutin proposed openstack/tripleo-heat-templates master: fix the scenario chart  https://review.openstack.org/55306020:40
*** em1l3ee has joined #tripleo20:43
*** dparkes has quit IRC20:45
*** sid1 has joined #tripleo20:46
*** pchavva has joined #tripleo20:48
*** em1l3ee has left #tripleo20:50
*** dparkes has joined #tripleo20:51
*** dprince has quit IRC20:52
*** _jbadiapa has joined #tripleo20:54
*** moshele has quit IRC20:56
*** jbadiapa_ has quit IRC20:57
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: Integrate Validate-HA work into OVB jobs  https://review.openstack.org/53766920:58
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: DNM: Add feature set file to run HA validations  https://review.openstack.org/53895220:58
openstackgerritMerged openstack/puppet-tripleo stable/ocata: Set rgw_keystone_revocation_interval to 0 for ceph::rgw::keystone  https://review.openstack.org/54608421:00
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: Test feature sets with downstream  https://review.openstack.org/53645721:01
*** trown|ruck is now known as trown|outtypewww21:03
*** eck`gone is now known as eck`21:05
*** rcernin has joined #tripleo21:08
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: [FFU] For deployed server in CI, make sure to get the compta layer.  https://review.openstack.org/55288321:08
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403621:11
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]21:11
*** ooolpbot has quit IRC21:11
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: DNM: Add debug and don't fail on validation for ffu.  https://review.openstack.org/55206321:11
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: DNM: Testing FFU from queens branch.  https://review.openstack.org/55206421:12
*** Goneri has quit IRC21:12
*** elgxl has joined #tripleo21:13
*** elgxl has quit IRC21:17
openstackgerritTim Rozet proposed openstack/tripleo-heat-templates master: Fixes ODL container failing to start due to missing etc config  https://review.openstack.org/55307921:18
*** dparkes has quit IRC21:20
*** noslzzp has quit IRC21:23
*** dparkes has joined #tripleo21:26
*** nyechiel has quit IRC21:32
*** pchavva has quit IRC21:34
*** thrash is now known as thrash|g0ne21:36
*** social has quit IRC21:38
*** ihrachys_ has joined #tripleo21:38
*** itlinux has quit IRC21:40
*** ihrachys has quit IRC21:40
*** liverpooler has quit IRC21:48
*** sid1 has quit IRC21:54
*** sid1 has joined #tripleo21:55
*** wolverineav has quit IRC21:59
*** wolverineav has joined #tripleo22:00
*** wolverineav has quit IRC22:01
*** wolverin_ has joined #tripleo22:01
*** mcornea has quit IRC22:04
*** waleedm has quit IRC22:05
*** owalsh_ has joined #tripleo22:06
*** owalsh has quit IRC22:10
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403622:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]22:10
*** ooolpbot has quit IRC22:10
*** owalsh_ has quit IRC22:11
*** myoung|rover is now known as myoung|afk22:13
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: New featureset for fast forward upgrade testing.  https://review.openstack.org/52568622:13
*** owalsh has joined #tripleo22:16
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-quickstart master: Use tripleo-upgrade role for p->q job.  https://review.openstack.org/54007222:19
*** sid1 has quit IRC22:23
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: New major upgrade workflow implementation.  https://review.openstack.org/55208222:23
*** fragatina has quit IRC22:23
*** fragatina has joined #tripleo22:24
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: [DNM]: Apply workaround for P->Q upgrades.  https://review.openstack.org/55208422:26
openstackgerritBob Fournier proposed openstack/tripleo-heat-templates master: Add check for old-style nic config files  https://review.openstack.org/55020122:27
*** ayoung has joined #tripleo22:28
ayoungHad a successful deploy (OSP 12) and then my overcloud crashed.  Cannot curl to services, more than just Keystone.  How do I debug?22:28
*** fragatina has quit IRC22:29
ayoungI assume I should pull the ssh passwords for the overcloud out of the undercloud server somewhere, ssh in, and check the status of the containers running in docker.  WHere is that ssh password, or is there a better approach?22:29
*** owalsh has quit IRC22:32
*** owalsh has joined #tripleo22:33
mwhahahaayoung: you should be able to ssh from the undercloud to the heat-admin on the nodes22:33
ayoungso use the heat-admin password in the  undercloud-passwords.conf  file, I thought22:34
mwhahahano22:34
mwhahahassh key22:34
openstackgerritBob Fournier proposed openstack/tripleo-heat-templates master: Add check for old-style nic config files  https://review.openstack.org/55020122:34
mwhahahafrom the user you ran the deploy from (probably stack)22:34
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: docker: add support for TripleO UI  https://review.openstack.org/51549022:35
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Set TripleoUI bind_host via ServiceNetMap  https://review.openstack.org/55287922:35
ayoungok, I see the controllers using openstack server list...get the ip22:35
ayoungand...it let me in...no password, must be keys?22:35
ayoungthanks22:35
mwhahahayes ssh key from the stack user22:36
*** fragatina has joined #tripleo22:36
ayoungok, and I see that, for example, the keystone container is working22:36
*** fragatina has quit IRC22:36
ayoung$ sudo docker ps | grep keystone22:36
ayoung02c0d71026b5        172.16.0.11:8787/rhosp12/openstack-keystone:12.0-20171122.1                  "/bin/bash -c '/usr/l"   2 hours ago         Up 2 hours (healthy)                       keystone_cron22:37
ayoungb27cd9dbe342        172.16.0.11:8787/rhosp12/openstack-keystone:12.0-20171122.1                  "kolla_start"            2 hours ago         Up 2 hours (healthy)                       keystone22:37
ayoungso that seems to indicate that the problem is HA proxy?22:37
*** bfournie has quit IRC22:37
ayoung172.16.0.11:8787/rhosp12/openstack-haproxy:pcmklatest22:37
ayoungthat is running, too22:37
mwhahahaayoung: so maybe a vip issue?22:37
ayoungand now it seems back22:38
mwhahahait might have taken a bit for the health checks to mark the services up22:38
ayoungyeah...it was up, then down, now back up22:38
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-upgrade stable/queens: DNM: Testing P->Q from queens branch.  https://review.openstack.org/55208022:38
*** fragatina has joined #tripleo22:38
ayoungOK, thanks for the help...think that is all for now22:39
*** fragatina has quit IRC22:40
*** fragatina has joined #tripleo22:46
*** waleedm has joined #tripleo22:48
*** pkovar has joined #tripleo22:56
*** pkovar has quit IRC22:56
mwhahahaso looks like we have a new failure in the promotion process, undercloud is failing with https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/fe704f0/undercloud/home/jenkins/undercloud_install.log.txt.gz#_2018-03-14_10_01_0622:56
mwhahahalikely a change in neutronclient has broken stuff22:57
mwhahahaor openstacksdk i guess22:58
mwhahahai have no idea why that's specific to fs 2022:58
* mwhahaha gives up23:00
*** dparkes has quit IRC23:01
*** waleedm has quit IRC23:02
*** waleedm has joined #tripleo23:05
*** waleedm_ has joined #tripleo23:06
*** liverpooler has joined #tripleo23:08
*** wolverin_ has quit IRC23:09
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/175403623:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1754036 in tripleo "fs020, tempest, image corrupted after upload to glance (checksum mismatch)" [Critical,Triaged]23:10
*** wolverineav has joined #tripleo23:10
*** waleedm has quit IRC23:10
*** wolverineav has quit IRC23:11
*** wolverin_ has joined #tripleo23:11
*** artom has joined #tripleo23:17
*** liverpooler has quit IRC23:27
*** waleedm_ has quit IRC23:42
*** itlinux has joined #tripleo23:47
*** dprince has joined #tripleo23:51
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260723:56
*** hamzy has quit IRC23:56
*** hamzy has joined #tripleo23:58
*** liverpooler has joined #tripleo23:59
« Tuesday, 2018-03-13 Index Thursday, 2018-03-15 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!