*** owalsh has joined #tripleo | 00:01 | |
*** ooolpbot has joined #tripleo | 00:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
---|---|---|
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 00:10 |
openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 00:10 |
*** ooolpbot has quit IRC | 00:10 | |
*** samdoran has joined #tripleo | 00:10 | |
*** samdoran has quit IRC | 00:15 | |
*** fragatina has joined #tripleo | 00:19 | |
*** fragatina has quit IRC | 00:24 | |
*** limao has joined #tripleo | 00:33 | |
*** bugzy_ has joined #tripleo | 00:38 | |
*** funzo_ has quit IRC | 00:39 | |
*** bugzy has quit IRC | 00:40 | |
*** dmacpher has joined #tripleo | 00:50 | |
*** dixiaoli has joined #tripleo | 01:04 | |
*** ooolpbot has joined #tripleo | 01:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 01:10 |
openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 01:10 |
*** ooolpbot has quit IRC | 01:10 | |
*** fragatina has joined #tripleo | 01:20 | |
*** achadha has joined #tripleo | 01:22 | |
*** achadha_ has joined #tripleo | 01:23 | |
*** fragatina has quit IRC | 01:25 | |
*** achadha has quit IRC | 01:26 | |
*** gbarros_ has quit IRC | 01:46 | |
*** fzdarsky_ has joined #tripleo | 01:53 | |
*** fzdarsky__ has quit IRC | 01:56 | |
*** gbarros has joined #tripleo | 02:03 | |
*** achadha_ has quit IRC | 02:05 | |
*** gbarros has quit IRC | 02:08 | |
*** ooolpbot has joined #tripleo | 02:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 02:10 |
*** ooolpbot has quit IRC | 02:10 | |
openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 02:10 |
*** panda has quit IRC | 02:25 | |
*** panda has joined #tripleo | 02:27 | |
*** zzzeek_ has joined #tripleo | 02:30 | |
*** limao has quit IRC | 02:33 | |
*** limao has joined #tripleo | 02:34 | |
*** ecerquei has quit IRC | 02:35 | |
*** limao_ has joined #tripleo | 02:35 | |
*** limao has quit IRC | 02:38 | |
*** eck` is now known as eck`gone | 02:47 | |
*** limao_ has quit IRC | 02:57 | |
*** limao has joined #tripleo | 02:57 | |
*** cmyster has quit IRC | 02:58 | |
*** fragatina has joined #tripleo | 02:58 | |
*** ykarel has joined #tripleo | 03:01 | |
*** limao has quit IRC | 03:02 | |
*** fragatina has quit IRC | 03:03 | |
*** fragatina has joined #tripleo | 03:09 | |
*** ooolpbot has joined #tripleo | 03:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 03:10 |
openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 03:10 |
*** ooolpbot has quit IRC | 03:10 | |
*** fragatina has quit IRC | 03:13 | |
*** udesale has joined #tripleo | 03:36 | |
*** ramishra has joined #tripleo | 03:38 | |
*** gbarros has joined #tripleo | 03:45 | |
*** psachin has joined #tripleo | 03:56 | |
*** achadha has joined #tripleo | 04:06 | |
*** dsariel has joined #tripleo | 04:06 | |
*** ooolpbot has joined #tripleo | 04:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 04:10 |
openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 04:10 |
*** ooolpbot has quit IRC | 04:10 | |
*** achadha has quit IRC | 04:11 | |
*** dmacpher has quit IRC | 04:12 | |
*** gbarros has quit IRC | 04:24 | |
*** dmacpher has joined #tripleo | 04:25 | |
*** mdnadeem has joined #tripleo | 04:28 | |
*** cmyster has joined #tripleo | 04:43 | |
*** cmyster has quit IRC | 04:43 | |
*** cmyster has joined #tripleo | 04:43 | |
*** dpawar has joined #tripleo | 04:50 | |
*** dparkes has quit IRC | 05:05 | |
*** janki has joined #tripleo | 05:08 | |
*** achadha has joined #tripleo | 05:08 | |
*** achadha has quit IRC | 05:10 | |
*** ooolpbot has joined #tripleo | 05:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 05:10 |
openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 05:10 |
*** ooolpbot has quit IRC | 05:10 | |
*** fragatina has joined #tripleo | 05:10 | |
*** achadha has joined #tripleo | 05:10 | |
*** achadha has quit IRC | 05:11 | |
*** achadha has joined #tripleo | 05:11 | |
*** fultonj has joined #tripleo | 05:13 | |
*** fultonj has quit IRC | 05:13 | |
*** fultonj has joined #tripleo | 05:14 | |
*** fultonj has quit IRC | 05:14 | |
*** fultonj has joined #tripleo | 05:15 | |
*** fragatina has quit IRC | 05:16 | |
*** samdoran has joined #tripleo | 05:16 | |
*** skramaja has joined #tripleo | 05:20 | |
*** samdoran has quit IRC | 05:21 | |
*** nyechiel has joined #tripleo | 05:22 | |
*** aufi has joined #tripleo | 05:22 | |
*** dmacpher has quit IRC | 05:24 | |
*** pgadiya has joined #tripleo | 05:28 | |
*** nyechiel has quit IRC | 05:28 | |
*** MrWilson has joined #tripleo | 05:32 | |
*** MrWilson is now known as Guest38128 | 05:33 | |
*** prateek has joined #tripleo | 05:36 | |
*** marios has joined #tripleo | 05:37 | |
*** dmacpher has joined #tripleo | 05:37 | |
*** lmiccini has joined #tripleo | 05:41 | |
*** jbadiapa has joined #tripleo | 05:43 | |
*** bhushan has joined #tripleo | 05:45 | |
*** ratailor has joined #tripleo | 05:46 | |
*** Guest38128 has quit IRC | 05:46 | |
*** achadha has quit IRC | 05:50 | |
*** achadha has joined #tripleo | 05:51 | |
*** achadha has quit IRC | 05:55 | |
*** yprokule has joined #tripleo | 05:57 | |
*** gbarros has joined #tripleo | 06:01 | |
*** agurenko has joined #tripleo | 06:04 | |
*** iranzo has joined #tripleo | 06:05 | |
*** iranzo has joined #tripleo | 06:05 | |
*** bandini has joined #tripleo | 06:05 | |
*** gbarros has quit IRC | 06:07 | |
*** jprovazn has joined #tripleo | 06:07 | |
*** ooolpbot has joined #tripleo | 06:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 06:10 |
openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 06:10 |
*** ooolpbot has quit IRC | 06:10 | |
*** samdoran has joined #tripleo | 06:17 | |
*** dixiaoli has quit IRC | 06:18 | |
*** dixiaoli has joined #tripleo | 06:18 | |
cmyster | 134 | 06:20 |
cmyster | oops | 06:20 |
*** samdoran has quit IRC | 06:22 | |
*** masco has joined #tripleo | 06:23 | |
*** ebarrera has joined #tripleo | 06:23 | |
*** panda has quit IRC | 06:23 | |
*** bkopilov has joined #tripleo | 06:25 | |
*** jtomasek has joined #tripleo | 06:26 | |
*** panda has joined #tripleo | 06:28 | |
*** jfrancoa has joined #tripleo | 06:32 | |
*** matbu has quit IRC | 06:32 | |
*** matbu has joined #tripleo | 06:35 | |
*** janki has quit IRC | 06:38 | |
*** asalkeld has joined #tripleo | 06:41 | |
*** jaganathan has joined #tripleo | 06:45 | |
*** coolsvap has joined #tripleo | 06:47 | |
*** rcernin has joined #tripleo | 06:47 | |
*** dparkes has joined #tripleo | 06:53 | |
*** dparkes has quit IRC | 06:54 | |
*** mcornea has joined #tripleo | 06:55 | |
*** dparkes has joined #tripleo | 06:59 | |
*** dparkes has quit IRC | 06:59 | |
*** ccamacho has joined #tripleo | 07:02 | |
*** fzdarsky has joined #tripleo | 07:05 | |
*** ffiore has joined #tripleo | 07:07 | |
*** cschwede has joined #tripleo | 07:09 | |
*** ooolpbot has joined #tripleo | 07:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 07:10 |
openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 07:10 |
*** ooolpbot has quit IRC | 07:10 | |
*** jlinkes has joined #tripleo | 07:11 | |
*** gbarros has joined #tripleo | 07:12 | |
*** fragatina has joined #tripleo | 07:13 | |
*** shardy has joined #tripleo | 07:14 | |
*** jfrancoa has quit IRC | 07:14 | |
*** jfrancoa has joined #tripleo | 07:15 | |
*** amoralej|off is now known as amoralej | 07:16 | |
*** fragatina has quit IRC | 07:17 | |
*** samdoran has joined #tripleo | 07:18 | |
*** samdoran has quit IRC | 07:23 | |
*** bogdando has joined #tripleo | 07:23 | |
*** dparkes has joined #tripleo | 07:24 | |
*** anshul has joined #tripleo | 07:28 | |
*** chem has joined #tripleo | 07:28 | |
*** dparkes has quit IRC | 07:28 | |
*** gbarros has quit IRC | 07:29 | |
*** oidgar has joined #tripleo | 07:33 | |
*** yprokule_ has joined #tripleo | 07:35 | |
*** tesseract has joined #tripleo | 07:36 | |
*** tristanC has joined #tripleo | 07:36 | |
*** yprokule has quit IRC | 07:37 | |
*** yprokule_ is now known as yprokule | 07:37 | |
tristanC | sshnaidm: hello, so regarding overcloud logs collection, would it be possible to run the ovb playbook with step_delete_overcloud=false ? | 07:37 |
*** egonzalez has joined #tripleo | 07:38 | |
chandankumar | sshnaidm: around? | 07:38 |
sshnaidm | tristanC, hi, it runs in different ovb periodic job | 07:38 |
sshnaidm | chandankumar, hi | 07:38 |
chandankumar | sshnaidm: tempest cleanup command will generate two files i want to store in ci results just like tempest logs | 07:39 |
*** ffiore has quit IRC | 07:39 | |
chandankumar | sshnaidm: how can i do that? | 07:39 |
chandankumar | sshnaidm: both the files will be created in tempest workspace | 07:39 |
sshnaidm | chandankumar, where are they created? | 07:40 |
*** paramite has joined #tripleo | 07:40 | |
sshnaidm | chandankumar, ~/tempest/ ? | 07:40 |
tristanC | sshnaidm: i mean, run ovb without deleting overcloud, collect logs and then delete the overcloud... or add logs collection in ovb.yml before deleting the overcloud | 07:40 |
chandankumar | sshnaidm: {{ working_dir }}/tempest | 07:41 |
sshnaidm | tristanC, afaik it's planned, but not highest priority right now, because we have ovb jobs that don't run overcloud delete and have logs, like periodic-tripleo-ci-centos-7-ovb-updates | 07:42 |
*** suuuper has joined #tripleo | 07:42 | |
sshnaidm | chandankumar, what are names? | 07:43 |
*** ffiore has joined #tripleo | 07:43 | |
tristanC | sshnaidm: ok good, it's not urgent at all | 07:44 |
*** fzdarsky has quit IRC | 07:44 | |
sshnaidm | tristanC, I mean, if you have solution - it's great and we'll definitely be happy to review it, but if it's a bug, I'm not sure it will be solved soon | 07:45 |
*** dixiaoli has quit IRC | 07:45 | |
sshnaidm | chandankumar, we collect all log, xml, html from tempest dir: https://github.com/openstack/tripleo-quickstart-extras/blob/300b892bb9d0ab1fc92da9bac5a335808282db9d/roles/collect-logs/defaults/main.yml#L26-L30 | 07:46 |
*** dixiaoli has joined #tripleo | 07:46 | |
*** jpich has joined #tripleo | 07:47 | |
*** dsariel has quit IRC | 07:48 | |
chandankumar | sshnaidm: thanks, done :-) | 07:51 |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Add tempest cleanup to validate-tempest role https://review.openstack.org/481939 | 07:51 |
openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud https://review.openstack.org/471759 | 07:53 |
*** ffiore has quit IRC | 07:54 | |
*** radeks has joined #tripleo | 07:56 | |
openstackgerrit | Tristan Cacqueray proposed openstack-infra/tripleo-ci master: Delete overcloud after collecting logs https://review.openstack.org/482039 | 07:56 |
*** ffiore has joined #tripleo | 07:56 | |
tristanC | sshnaidm: context is I'm working on a tool to reduce log size by comparing with successs logs, and it doesn't works well with ovb because success run doesn't have overcloud logs | 07:58 |
*** yprokule_ has joined #tripleo | 07:58 | |
sshnaidm | tristanC, it's true only for one job in CI, all the rest have logs usually | 07:59 |
*** zzzeek has quit IRC | 08:00 | |
sshnaidm | tristanC, periodic job runs once a day, so it shouldn't be an issue for logs size | 08:00 |
*** yprokule has quit IRC | 08:01 | |
*** yprokule_ is now known as yprokule | 08:01 | |
tristanC | here is what the tool produced so far: https://fedorapeople.org/~tdecacqu/tripleo-ci-2017-07-10/ | 08:01 |
*** zzzeek has joined #tripleo | 08:02 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Disable network validation in multinode jobs https://review.openstack.org/479406 | 08:05 |
panda | I need an introspection guru | 08:05 |
*** shardy has quit IRC | 08:06 | |
*** shardy has joined #tripleo | 08:07 | |
*** snecklifter has joined #tripleo | 08:07 | |
*** snecklifter has quit IRC | 08:07 | |
panda | (I need to reach nirvana) | 08:08 |
*** ooolpbot has joined #tripleo | 08:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 08:10 |
openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 08:10 |
*** ooolpbot has quit IRC | 08:10 | |
*** fzdarsky_ has quit IRC | 08:11 | |
*** fragatina has joined #tripleo | 08:13 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: WIP: enable containers periodic job https://review.openstack.org/475745 | 08:16 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 08:16 |
*** fragatina has quit IRC | 08:18 | |
*** samdoran has joined #tripleo | 08:19 | |
*** yprokule_ has joined #tripleo | 08:22 | |
*** samdoran has quit IRC | 08:24 | |
*** yprokule has quit IRC | 08:25 | |
*** yprokule_ is now known as yprokule | 08:25 | |
*** jistr|off is now known as jistr | 08:25 | |
*** fzdarsky has joined #tripleo | 08:26 | |
*** milan has joined #tripleo | 08:28 | |
*** afazekas|away is now known as afazekas | 08:34 | |
*** snecklifter has joined #tripleo | 08:36 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 08:36 |
*** yprokule_ has joined #tripleo | 08:36 | |
*** dmacpher has quit IRC | 08:39 | |
*** yprokule has quit IRC | 08:39 | |
*** yprokule_ is now known as yprokule | 08:39 | |
*** ffiore has quit IRC | 08:39 | |
*** SlickNik has joined #tripleo | 08:41 | |
*** cylopez has joined #tripleo | 08:45 | |
*** radeks has quit IRC | 08:47 | |
*** gfidente has joined #tripleo | 08:49 | |
*** gfidente has quit IRC | 08:49 | |
*** gfidente has joined #tripleo | 08:49 | |
*** ckyriakidou has joined #tripleo | 08:51 | |
*** tosky has joined #tripleo | 08:52 | |
gfidente | jistr marios shardy I know it's monday but https://review.openstack.org/#/c/479857/ is the alternative to https://review.openstack.org/#/c/476602/ which doesn't require a new property into every service | 08:54 |
shardy | gfidente: nice! will look | 08:55 |
marios | gfidente: ack added to queue (may be tomorrow though or later this afternoon done a few reviews already today) | 08:56 |
gfidente | thanks guys :D | 08:56 |
gfidente | I ran a check experimental and passed all jobs too | 08:57 |
gfidente | then there is this guy https://review.openstack.org/#/c/479790 to push config_settings into the execution env | 08:57 |
*** tvignaud has quit IRC | 08:58 | |
skramaja | gfidente: hi! saw your comment on jaganathan's patch (https://review.openstack.org/#/c/468989/) regarding reducing tasks and adding actions. i will comment on the patch... but would like to provide input on why this approach, if you have few mins | 08:58 |
skramaja | gfidente: this approach has been dsicussed with shardy and fultonj on ptg. we decide to keep most of the formula's part in mistral so that it can be easily customizable on need bassis. | 08:59 |
skramaja | gfidente: may for a customer they/we could write a formula workflow specific to their need. | 09:00 |
skramaja | gfidente: the current forumla will be the recommendation from tripleo but could be customized. | 09:00 |
skramaja | gfidente: what has been done on this patch is, the tasks which are merely calculation based on inputs are moved as actions, and the input to those actions and deriving data for it is kept with tasks so tha it can be customized | 09:02 |
*** radeks has joined #tripleo | 09:02 | |
skramaja | gfidente: currently i feel the blend of tasks and actions is good for customization. but it would get more better shape going further with inputs from users. | 09:03 |
*** nyechiel has joined #tripleo | 09:03 | |
*** dsariel has joined #tripleo | 09:04 | |
gfidente | skramaja my feeling is that customizing the formula is one thing, implementing it in yaql in the worflow is another | 09:04 |
*** pblaho has joined #tripleo | 09:05 | |
gfidente | skramaja and turning errors into successful failure messages is meh | 09:05 |
skramaja | gfidente: when it is in yaql it is more easy to customize, rather that actions | 09:06 |
gfidente | skramaja I am also not sure how the user can customize the workflow? | 09:06 |
skramaja | gfidente: tripleo.derive_params_formulas.v1.dpdk_derive_params can be updated based on the requirement. | 09:07 |
skramaja | for example, a customer can choose to write this formula for his need, which will be used in all his deployments. | 09:08 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: PlanList and PlanCard updates https://review.openstack.org/476942 | 09:08 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Remove CurrentPlanReducer https://review.openstack.org/476939 | 09:08 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Plans routing refactor https://review.openstack.org/476904 | 09:08 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Fix Logout and authentication loop https://review.openstack.org/478424 | 09:08 |
*** adarazs has joined #tripleo | 09:08 | |
gfidente | so users would need to download the workflow, make a copy and stick with it for future release unless ... which on upgrades becomes problematic as well | 09:09 |
*** ooolpbot has joined #tripleo | 09:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 09:10 |
openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 09:10 |
*** ooolpbot has quit IRC | 09:10 | |
gfidente | skramaja assuming one know which parts of the workflow need to be changed ... anyway it looka like it's late to change anything for pike | 09:11 |
*** tvignaud has joined #tripleo | 09:11 | |
skramaja | gfidente: yes for upgrade it would be an problem which should be solved if required. with pike we are providing the option to customize, based on the feedback, we could decide on it. | 09:11 |
*** yprokule has quit IRC | 09:12 | |
skramaja | gfidente: i agree. | 09:12 |
*** yprokule has joined #tripleo | 09:13 | |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Copy only generated puppet files into the container https://review.openstack.org/476153 | 09:14 |
skramaja | gfidente: shardy fyi - https://asciinema.org/a/127903 - i have created a demo integrating all the patches for deriving parameters. ptal. | 09:15 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: Add settings for ovb in rdocloud https://review.openstack.org/480950 | 09:18 |
openstackgerrit | Merged openstack/tripleo-ui master: Imported Translations from Zanata https://review.openstack.org/481898 | 09:23 |
openstackgerrit | Prateek Arora proposed openstack/tripleo-common master: Tempest container image https://review.openstack.org/480353 | 09:25 |
*** gbarros has joined #tripleo | 09:27 | |
*** ffiore has joined #tripleo | 09:28 | |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Add network/cidr mapping into ServiceNetMap https://review.openstack.org/479857 | 09:28 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: PlanList and PlanCard updates https://review.openstack.org/476942 | 09:34 |
openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Fix Logout and authentication loop https://review.openstack.org/478424 | 09:34 |
fzdarsky | Hi all, any concerns if I proposed to add 'os-net-config' to global-requirements.txt? | 09:37 |
*** karthiks has joined #tripleo | 09:38 | |
*** SlickNik has quit IRC | 09:38 | |
fzdarsky | Motivation is to make the schema validation lib therein available to tripleo-validations. | 09:38 |
flaper87 | shardy: good morning. Could you help me figure out why kubernetes_*_ctlplane_ips are not in the service_ips map? https://review.openstack.org/#/c/471759/ | 09:38 |
*** SlickNik has joined #tripleo | 09:38 | |
flaper87 | shardy: it only happens on that patch. It works on my local env | 09:38 |
flaper87 | so, I must be missing something in the CI env setup for sure | 09:39 |
flaper87 | shardy: actually, only kubernetes_worker_ctlplane_ip is missing | 09:39 |
flaper87 | shardy: http://logs.openstack.org/59/471759/16/experimental/gate-tripleo-ci-centos-7-scenario006-multinode-oooq-nv/3b2977b/logs/undercloud/var/log/mistral/api.log.txt.gz | 09:39 |
flaper87 | mmh, I'll just move the ComputeService list to the scenario environment | 09:42 |
shardy | https://review.openstack.org/#/c/471759/16/ci/environments/scenario006-multinode.yaml | 09:45 |
openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud https://review.openstack.org/471759 | 09:46 |
shardy | flaper87: is it because you don't have the worker service in ControllerServices? | 09:46 |
flaper87 | shardy: mmh, but the worker should only be in the ComputeServices. It's a way to identify which roles are supposed to be kubernetes workers | 09:47 |
flaper87 | Unless I misunderstood how service_ips work | 09:47 |
shardy | flaper87: but multinode CI jobs via oooq only suport two nodes atm, the undercloud and an all-in-one overcloud? | 09:47 |
shardy | or has that changed? | 09:47 |
shardy | last time I looked the 3nodes job wasn't converted to quickstart | 09:48 |
shardy | so if that's still the case you have to put everything into ControllerServices for CI | 09:48 |
flaper87 | shardy: OH! See, that's the piece I was missing | 09:49 |
* flaper87 hits his head against the wall | 09:50 | |
*** gbarros has quit IRC | 09:50 | |
flaper87 | shardy: thank | 09:50 |
flaper87 | shardy: you | 09:50 |
shardy | flaper87: yeah I think you'll find that job has undercloud on one node, then subnode-2 which is the overcloud | 09:50 |
shardy | flaper87: np! | 09:50 |
openstackgerrit | Flavio Percoco proposed openstack/tripleo-heat-templates master: WIP: Deploy kubernetes using TripleO on the overcloud https://review.openstack.org/471759 | 09:50 |
openstackgerrit | Or Idgar proposed openstack/tripleo-validations master: WIP adapt neutron sanity check to containerized environment https://review.openstack.org/475173 | 09:53 |
openstackgerrit | Or Idgar proposed openstack/tripleo-validations master: WIP adapt neutron sanity check to containerized environment https://review.openstack.org/475173 | 09:54 |
*** dtantsur is now known as dtantsur|bbl | 09:59 | |
*** fandrieu has quit IRC | 10:00 | |
*** sri_ has joined #tripleo | 10:00 | |
*** asalkeld has quit IRC | 10:00 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 10:03 |
*** ffiore has quit IRC | 10:05 | |
*** ooolpbot has joined #tripleo | 10:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 10:10 |
openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 10:10 |
*** ooolpbot has quit IRC | 10:10 | |
*** ffiore has joined #tripleo | 10:12 | |
*** achadha has joined #tripleo | 10:14 | |
*** fragatina has joined #tripleo | 10:16 | |
*** radeks has quit IRC | 10:18 | |
*** achadha has quit IRC | 10:18 | |
*** fragatina has quit IRC | 10:20 | |
openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Enable tempest on scenario001-multinode job https://review.openstack.org/482087 | 10:23 |
*** panda has quit IRC | 10:23 | |
*** panda has joined #tripleo | 10:24 | |
*** ffiore has quit IRC | 10:30 | |
*** fzdarsky has quit IRC | 10:30 | |
*** akrivoka has joined #tripleo | 10:33 | |
*** udesale has quit IRC | 10:44 | |
*** fandrieu has joined #tripleo | 10:48 | |
openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: Add a new role for ComputeOvsDpdk and clean-up parameters https://review.openstack.org/478427 | 10:49 |
openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: Added OvS permission workaround for enabling DPDK https://review.openstack.org/478163 | 10:49 |
*** anshul has quit IRC | 10:50 | |
*** anshul has joined #tripleo | 10:50 | |
chandankumar | arxcruz: hello | 10:52 |
arxcruz | chandankumar: hey | 10:52 |
chandankumar | arxcruz: regarding this https://review.openstack.org/#/c/481939/ review | 10:52 |
chandankumar | arxcruz: you mean adding a flip switch to enable or disable in validate-tempest? | 10:53 |
arxcruz | chandankumar: yes, you can put in validate-tempest/defaults/main.yml | 10:53 |
chandankumar | arxcruz: ack sir doing that. | 10:53 |
arxcruz | chandankumar: you can set it to true by default | 10:53 |
arxcruz | chandankumar: remember the readme as well | 10:54 |
chandankumar | arxcruz: but one questions how to handle it in the collect-logs role? | 10:54 |
chandankumar | if we add a switch | 10:54 |
*** gbarros has joined #tripleo | 10:55 | |
arxcruz | chandankumar: in collect-logs you just added /home/*/tempest/*.json | 10:55 |
arxcruz | if the file doesn't exist, won't trow an error | 10:55 |
arxcruz | ;) | 10:55 |
chandankumar | arxcruz: ah it is, ok then :-) | 10:55 |
*** dtantsur|bbl is now known as dtantsur | 10:57 | |
*** ansmith has quit IRC | 10:58 | |
*** dixiaoli has quit IRC | 11:00 | |
*** jkilpatr has joined #tripleo | 11:01 | |
*** lucasagomes is now known as lucas-hungry | 11:03 | |
openstackgerrit | Julie Pichon proposed openstack/tripleo-docs master: Document how to deploy with the UI https://review.openstack.org/476146 | 11:03 |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Adding tempest .testrepository directory in collect-logs https://review.openstack.org/482096 | 11:04 |
*** ooolpbot has joined #tripleo | 11:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 11:10 |
openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 11:10 |
*** ooolpbot has quit IRC | 11:10 | |
*** gbarros has quit IRC | 11:10 | |
gfidente | shardy jistr when you guys are around maybe we find a conclusion about the subnets stuff in tht ;D | 11:11 |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Add tempest cleanup to validate-tempest role https://review.openstack.org/481939 | 11:11 |
jtomasek | akrivoka: when plan-environment.yaml is not provided when plan is created, it gets created automatically? | 11:12 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Adds network/cidr mapping into a new service property https://review.openstack.org/476602 | 11:13 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 11:13 |
akrivoka | jtomasek: yes, that's what the migrate plan action does https://github.com/openstack/tripleo-common/blob/master/tripleo_common/actions/plan.py#L74 | 11:14 |
*** fandrieu has quit IRC | 11:15 | |
jtomasek | akrivoka: ok thanks | 11:15 |
akrivoka | jtomasek: it creates the plan-env yaml file from mistral env; from the Q cycle on every plan should have a plan-env yaml file though | 11:15 |
*** rhallisey has joined #tripleo | 11:16 | |
*** atoth has joined #tripleo | 11:17 | |
*** panda has quit IRC | 11:19 | |
*** panda has joined #tripleo | 11:19 | |
*** amoralej is now known as amoralej|lunch | 11:24 | |
shardy | gfidente, jistr: Yeah I think we discussed on Friday the same idea proposed by jistr, e,g migrate to network_data, but we've been trying to find a way forward that doesn't break every service plugin | 11:28 |
shardy | we haven't documented the interfaces as stable yet, but they've been out there for a couple of releases, and there are a few cases of out of tree things I think | 11:28 |
shardy | so we'd have to ensure migration was documented carefully, at least | 11:28 |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Bind mount needed cert for haproxy for HA too https://review.openstack.org/482102 | 11:28 |
shardy | jistr, gfidente: I think we're learning the limitations of our current service plugin interface here, e.g the outputs are all accessed via role_data which is quite flexible, but the input paramter interface is quite fragile | 11:30 |
jistr | hm yea.. fwiw i can remove the -1 if we think we should go this way right now, but it doesn't seem like a good long term solution, it feels like tech debt to me at least... | 11:34 |
jistr | i wonder is it worth eventually converging on something fully generic | 11:34 |
jistr | like ServiceData parameter | 11:34 |
jistr | essentially bypassing the static parameter interface of Heat, and making it dynamic by having a single all-encompassing json parameter | 11:35 |
shardy | jistr: yeah, or at least some more generic mappings, which would make it clearer what is passed from the parent vs from the user via parameter_defaults | 11:35 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 11:36 |
shardy | jistr: yeah, I agree that would be better, I'm just a bit worried about backwards compatibility | 11:36 |
shardy | I suppose we already broke all plugins with the role specific data additions this cycle tho | 11:36 |
*** Guest75308 is now known as rook | 11:37 | |
gfidente | though if we want it to be an container | 11:38 |
*** ffiore has joined #tripleo | 11:38 | |
gfidente | it shouldn't be NetworkData either | 11:38 |
jistr | yea | 11:38 |
gfidente | but ServiceData | 11:38 |
jistr | should be even more generic | 11:38 |
jistr | +1 for ServiceData | 11:39 |
* shardy thinks about naming | 11:39 | |
gfidente | so I am thinking I like the idea of having all non-user-provided params into a single container | 11:40 |
*** ffiore has quit IRC | 11:40 | |
jistr | about how to introduce this -- if we already broke the interface in Pike, then i think we can just put one more param right away. Or if we want to keep compatibility, we can say all services/plugins should introduce new ServiceData (or better name?) parameter and default to {}, then in Q release we can start passing all the data that way and migrate all the services/plugins to take data from there, and in R | 11:43 |
jistr | we can remove the old params | 11:43 |
jistr | so we could be through with all this either in R or in Q, depending on when we introduce the new parameter.. | 11:45 |
gfidente | I am unsure about endpointmap, are user-given customizations meant to take effect into the service template? or is it safe to pass it to the endpoint_map.yaml ? | 11:47 |
shardy | jistr: yeah that sounds like a reasonable compromise although it means we'd need to leave the old deprecated parameters in-tree, even if they are unused, for a release | 11:47 |
jistr | yea | 11:47 |
jistr | gfidente: can you explain what you mean by the endpointmap issue in a bit more detail? | 11:51 |
gfidente | jidar yeah sorry | 11:51 |
*** sri_ has quit IRC | 11:52 | |
gfidente | jistr I was looking at if user-provided EndpointMap parameter is consumed within the service template or only within endpoint_map.yaml | 11:54 |
gfidente | jistr shardy but I think the version which the service templates get is the one passed by overcloud.j2 and not the one given by the user when the user uses parameter_defaults ? | 11:56 |
*** janki has joined #tripleo | 11:56 | |
*** jkilpatr has quit IRC | 11:57 | |
*** mcornea has quit IRC | 11:57 | |
*** udesale has joined #tripleo | 11:58 | |
*** abishop has joined #tripleo | 11:58 | |
jistr | gfidente: yes i think that's correct, i was just looking into the code | 11:59 |
jistr | https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud.j2.yaml#L297 | 11:59 |
jistr | this will override parameter_defaults | 11:59 |
gfidente | ack | 11:59 |
shardy | Yeah values from the parent template always take precedence over parameter_defaults | 12:00 |
jistr | also looking e.g. at https://github.com/openstack/tripleo-heat-templates/blob/master/environments/tls-endpoints-public-dns.yaml | 12:00 |
jistr | it needs the IP_ADDRESS and CLOUDNAME parts replaced | 12:00 |
jistr | so it looks like we don't really expect these values to be passed raw into the services, without being processed by endpoint_map.yaml first | 12:00 |
shardy | yeah that's true I think, we don't have an easy way for users to e.g plug new services into the endpoint map atm | 12:01 |
*** pradk has joined #tripleo | 12:02 | |
*** pkovar has joined #tripleo | 12:02 | |
*** ratailor has quit IRC | 12:04 | |
*** d0ugal has joined #tripleo | 12:04 | |
*** hjensas has quit IRC | 12:05 | |
*** fandrieu has joined #tripleo | 12:05 | |
gfidente | jistr shardy so do I change to use ServiceData instead https://review.openstack.org/#/c/476602/ ? | 12:05 |
*** hjensas has joined #tripleo | 12:05 | |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Add subnet property to ctlplane network for server resources https://review.openstack.org/473817 | 12:06 |
*** jcoufal has joined #tripleo | 12:06 | |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Adding keystone test to skip list https://review.openstack.org/481616 | 12:06 |
*** dougbtv has joined #tripleo | 12:07 | |
*** mcornea has joined #tripleo | 12:07 | |
*** dprince has joined #tripleo | 12:07 | |
*** jayg|g0n3 is now known as jayg | 12:07 | |
*** fzdarsky has joined #tripleo | 12:07 | |
*** lucas-hungry is now known as lucasagomes | 12:08 | |
gfidente | jistr shardy sounds like if we can use this cycle to add a third new propery, hopefully generic enough, tjat | 12:10 |
*** ooolpbot has joined #tripleo | 12:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1680167 | 12:10 |
*** ooolpbot has quit IRC | 12:10 | |
openstack | Launchpad bug 1680167 in tripleo ""15.184.64.1 is not pingable" in multinode jobs" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 12:10 |
gfidente | that's not too bad? | 12:10 |
*** d0ugal has quit IRC | 12:12 | |
*** mcornea has quit IRC | 12:12 | |
colonwq | gfidente, does the proposed changes work with networks that are not /24? | 12:13 |
openstackgerrit | Martin Mágr proposed openstack/tripleo-quickstart-extras master: Fix conditional in undercloud-deploy role https://review.openstack.org/472609 | 12:14 |
gfidente | colonwq it does yes it's pretty much unrelated to the data which it eventually transports | 12:14 |
openstackgerrit | Steven Hardy proposed openstack/puppet-tripleo master: Remove dependency on memcached_node_ips_v6 https://review.openstack.org/481083 | 12:14 |
*** sbrzozow has joined #tripleo | 12:14 | |
colonwq | gfidente, thanks. | 12:15 |
*** fragatina has joined #tripleo | 12:17 | |
*** jprovazn has quit IRC | 12:18 | |
*** fragatina has quit IRC | 12:22 | |
*** rlandy has joined #tripleo | 12:22 | |
*** liverpooler has joined #tripleo | 12:23 | |
jistr | gfidente, shardy: yea i'd be +1 on that. Interfaces of all plugins already have to be updated because of this, right? https://github.com/openstack/tripleo-heat-templates/commit/a096ddab348d296994838e02169662ca916e09da | 12:25 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Adds network/cidr mapping into a new service property https://review.openstack.org/476602 | 12:26 |
*** jwb_ has joined #tripleo | 12:26 | |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Fix ironic-pxe startup issues https://review.openstack.org/481343 | 12:28 |
*** morazi has joined #tripleo | 12:28 | |
sshnaidm | EmilienM, let's discuss please https://review.openstack.org/#/c/478924/ when you're around | 12:28 |
*** jkilpatr has joined #tripleo | 12:29 | |
*** samdoran has joined #tripleo | 12:31 | |
*** mcornea has joined #tripleo | 12:34 | |
shardy | jistr: yeah, any out of tree services will need those new parameters | 12:34 |
*** dmacpher has joined #tripleo | 12:35 | |
openstackgerrit | Alan Bishop proposed openstack/tripleo-common master: Derive deployment parameters for HCI https://review.openstack.org/471462 | 12:35 |
*** samdoran has quit IRC | 12:36 | |
*** brandor5 has joined #tripleo | 12:38 | |
openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Drop ComputeServices from environments/docker.yaml https://review.openstack.org/481747 | 12:38 |
*** jprovazn has joined #tripleo | 12:38 | |
brandor5 | Hello everyone: I'm attempting to follow the guide at https://access.redhat.com/documentation/en-us/reference_architectures/2017/html-single/hyper-converged_red_hat_openstack_platform_10_and_red_hat_ceph_storage_2/ to build a stack. I'm running into an issue where my "osdcompute" nodes are consuming my "control" nodes and the deploy fails. I've created an "osdcompute" flavor and set profile info there and on the baremetal nodes acc | 12:40 |
brandor5 | gly but I still can't figure out what is going wrong. Anyone have any ideas? | 12:40 |
*** pchavva has joined #tripleo | 12:42 | |
*** ansmith has joined #tripleo | 12:44 | |
*** ecerquei has joined #tripleo | 12:45 | |
*** ffiore has joined #tripleo | 12:47 | |
*** Guest9640 is now known as beagles | 12:47 | |
*** rbowen has joined #tripleo | 12:48 | |
*** jmelvin has joined #tripleo | 12:51 | |
*** trown|outtypewww is now known as trown | 12:52 | |
*** remix_tj has joined #tripleo | 12:53 | |
*** jmelvin has quit IRC | 12:54 | |
*** dsavineau has left #tripleo | 12:54 | |
*** jmelvin has joined #tripleo | 12:54 | |
*** d0ugal has joined #tripleo | 12:54 | |
*** d0ugal has quit IRC | 12:54 | |
*** d0ugal has joined #tripleo | 12:54 | |
jtomasek | honza: hi, what's the bug behind this fix? https://review.openstack.org/#/c/481725/ | 12:56 |
*** fultonj has quit IRC | 12:56 | |
*** dsavineau has joined #tripleo | 12:56 | |
honza | jtomasek: sorry for the lack of context, jrist was experiencing some ironic-related weirdness in the UI, and it was caused by a misconfigured URL in tripleo_ui_config.js | 12:58 |
*** fultonj has joined #tripleo | 12:58 | |
*** masco has quit IRC | 12:58 | |
honza | jtomasek: so i thought it would be simple to always remove the trailing slash to prevent this from happening | 12:58 |
*** d0ugal has quit IRC | 12:59 | |
honza | jtomasek: is that dumb? :) | 12:59 |
EmilienM | hello | 12:59 |
*** mdnadeem has quit IRC | 12:59 | |
mandre | jistr: do you feel comfortable landing https://review.openstack.org/#/c/476153/ with the containers-multinode-upgrade job being red? | 12:59 |
EmilienM | sshnaidm: yes, I'll ping you when available | 12:59 |
mandre | jistr: I don't know what this issue is, http://logs.openstack.org/53/476153/14/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/9577376/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-07-10_10_08_24 | 12:59 |
mandre | doesn't seem to be related with my patch | 13:00 |
jistr | fmandre: looks like a timeout http://logs.openstack.org/53/476153/14/check/gate-tripleo-ci-centos-7-multinode-upgrades-nv/e25861c/console.html#_2017-07-10_11_55_14_872946 | 13:00 |
jistr | mandre: ^ | 13:00 |
*** fxpester has quit IRC | 13:00 | |
*** tzumainn has joined #tripleo | 13:01 | |
* jistr looking closer at the patch | 13:01 | |
*** funzo has joined #tripleo | 13:01 | |
*** mcornea_ has joined #tripleo | 13:01 | |
*** fxpester has joined #tripleo | 13:01 | |
jtomasek | honza: I don't know, it is potentially adding another place to check when some url error occurs (just in case at some case the trailing slash is required - not saying it is ever going to happen) | 13:01 |
jtomasek | honza: an incorrect url is incorrect url... | 13:01 |
mandre | jistr: the containers-multinode-upgrades is different, it's an issue with missing bm-deploy-ramdisk image | 13:02 |
mandre | jistr: http://logs.openstack.org/53/476153/14/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/9577376/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-07-10_10_08_24 | 13:02 |
jtomasek | honza: I don't have a strong opinion though:) | 13:02 |
honza | jtomasek: all of our urls start with a slash (API calls), and the errors you get are non-obvious | 13:02 |
honza | jtomasek: It took me about 5mins to write that patch so I'm not exactly emotionally attached to it :) | 13:03 |
*** bvandenh has joined #tripleo | 13:03 | |
*** mcornea has quit IRC | 13:03 | |
mandre | jistr: so many fixes depend on that patch, and look at the number of patch it conflicts with... I really want to land it as quickly as possible | 13:03 |
mandre | dprince, shardy: if you're around, I think https://review.openstack.org/#/c/476153/ is ready | 13:04 |
*** oidgar has quit IRC | 13:04 | |
dprince | mandre: ack | 13:04 |
*** samdoran has joined #tripleo | 13:05 | |
openstackgerrit | Damien Ciabrini proposed openstack/puppet-tripleo master: Let pacemaker bind-mount needed cert for haproxy bundle https://review.openstack.org/482135 | 13:08 |
*** gbarros has joined #tripleo | 13:08 | |
gfidente | mandre yeah I was mounting /etc/ceph for the services needing ceph.conf , like https://review.openstack.org/#/c/465066/28/docker/services/glance-api.yaml | 13:08 |
jistr | mandre: it passed the upgrade job on PS12, the changes from there were fairly small so i'm hoping we can land it. I wouldn't call it "feel comfortable" :D but considering the context it's probably the best path forward :) | 13:09 |
gfidente | mandre I guess I should move that into config_files as well then? | 13:09 |
*** amoralej|lunch is now known as amoralej | 13:11 | |
*** mcornea_ has quit IRC | 13:11 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Modify generic role template to support custom networks https://review.openstack.org/469854 | 13:11 |
*** mcornea has joined #tripleo | 13:13 | |
*** eck`gone is now known as eck` | 13:16 | |
*** trozet has joined #tripleo | 13:17 | |
*** udesale has quit IRC | 13:17 | |
*** gbarros has quit IRC | 13:18 | |
*** oidgar has joined #tripleo | 13:19 | |
*** agopi|away has joined #tripleo | 13:25 | |
*** Goneri has joined #tripleo | 13:30 | |
mandre | gfidente: yeah, look at how I did for https://review.openstack.org/#/c/476153/14/docker/services/cinder-backup.yaml | 13:30 |
*** sshnaidm is now known as sshnaidm|mtg | 13:30 | |
mandre | gfidente: I suppose you just need to change the path from /var/lib/config-data/puppet-generated/ceph/ to /etc/ceph | 13:31 |
gfidente | mandre yeah | 13:31 |
*** gbarros has joined #tripleo | 13:31 | |
*** zzzeek_ has quit IRC | 13:34 | |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Add DeployedServerEnvironmentOutput https://review.openstack.org/461399 | 13:36 |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Use ServerOsCollectConfigData value in output https://review.openstack.org/481594 | 13:36 |
*** lblanchard has joined #tripleo | 13:37 | |
*** lblanchard has quit IRC | 13:38 | |
*** lblanchard has joined #tripleo | 13:39 | |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart master: enable container periodic job https://review.openstack.org/475743 | 13:39 |
*** samdoran has quit IRC | 13:40 | |
*** samdoran has joined #tripleo | 13:40 | |
*** samdoran has quit IRC | 13:41 | |
*** samdoran has joined #tripleo | 13:41 | |
*** maeca has joined #tripleo | 13:45 | |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations https://review.openstack.org/403576 | 13:48 |
openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart master: Add ability to run tripleo-validations tests https://review.openstack.org/403731 | 13:48 |
*** maeca has left #tripleo | 13:50 | |
gfidente | mandre though in ceph-ansible scenario the config is generated by ansible not puppet, so not docker-puppet.py | 13:53 |
gfidente | mandre which makes me think this will still be good for ceph-ansible https://review.openstack.org/#/c/465066/28/docker/services/glance-api.yaml ? | 13:53 |
gfidente | or are there reasons for mounting it at kolla_config still? | 13:54 |
mandre | gfidente: commented on your review, I think there is no reason it could not work with ceph-ansible | 13:54 |
mandre | gfidente: actually, since they're not generated with docker-puppet we'll likely have uid/gid mismatch | 13:57 |
gfidente | mandre but ceph-ansible uses its own docker images where uid/gid match with baremetal I thin | 13:58 |
mandre | gfidente: ohhhh right, this is not a tripleo image, I forgot! | 13:58 |
mandre | so it wouldn't work | 13:59 |
gfidente | yeah which is why I thought I can just bindmount /etc/ceph | 13:59 |
*** cylopez has joined #tripleo | 13:59 | |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 14:00 |
gfidente | no wait sorry, so we won't have uid/gid mismatches in the ceph daemon images, but we might have mismatches in the tripleo/openstack images | 14:00 |
gfidente | mandre but then again, I don't see why I shouldn't just bindmount /etc/ceph ? | 14:00 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 14:00 |
mandre | gfidente: right, hoping that puppet doesn't generate anything in /etc/ceph for any of the containers | 14:01 |
gfidente | mandre right and it should not because we don't pull in the puppet-tripleo profiles anymore | 14:01 |
gfidente | depending on which service we map to ceph in heat registry | 14:01 |
*** skramaja has quit IRC | 14:02 | |
mandre | gfidente: actually, the cinder, glance, etc. containers are all kolla based, so the approach would work if you don't want to bindmount /etc/ceph | 14:03 |
mandre | gfidente: who needs to read the ceph config in the cinder and glance containers? is it the cinder/glance user or a ceph user? | 14:05 |
gfidente | mandre only cinder/glance | 14:05 |
gfidente | not ceph daemons | 14:05 |
gfidente | mandre maybe you can merge the changes for the openstack services I have https://review.openstack.org/#/c/465066/ in your existing patch? | 14:06 |
*** jkilpatr has quit IRC | 14:06 | |
fxpester | hi all, got this error - http://paste.openstack.org/show/614922/ - what is it ? :D no real error msg given | 14:08 |
fxpester | centos 7.3, Ocata, error is at `overcloud image build` | 14:08 |
fxpester | agent image builds well | 14:09 |
mandre | gfidente: I'd rather land https://review.openstack.org/#/c/476153/ as it, and refine in your patch | 14:12 |
gfidente | mandre ok | 14:12 |
*** jaganathan has quit IRC | 14:13 | |
chandankumar | sshnaidm|mtg: regarding https://review.openstack.org/#/c/481939/3/ cleanup variable name, i am not getting. | 14:13 |
*** ebarrera has quit IRC | 14:13 | |
openstackgerrit | Arx Cruz proposed openstack-infra/tripleo-ci master: Adding tempest .testrepository directory in collect-logs https://review.openstack.org/482096 | 14:13 |
*** janki has quit IRC | 14:13 | |
*** ebarrera has joined #tripleo | 14:14 | |
*** limao has joined #tripleo | 14:16 | |
*** oidgar has quit IRC | 14:16 | |
*** sshnaidm|mtg is now known as sshnaidm | 14:18 | |
sshnaidm | chandankumar, tempest_cleanup is not what this code actually does | 14:19 |
*** fragatina has joined #tripleo | 14:19 | |
sshnaidm | chandankumar, either I don't understand - where does it do "clean up"? | 14:19 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Adds network/cidr mapping into a new service property https://review.openstack.org/476602 | 14:19 |
tosky | sshnaidm: tempest cleanup removes the artifacts created after its initialization step | 14:20 |
*** limao_ has joined #tripleo | 14:20 | |
openstackgerrit | Or Idgar proposed openstack/tripleo-validations master: WIP adapt neutron sanity check to containerized environment https://review.openstack.org/475173 | 14:21 |
tosky | when you call with the initialization parameters, it creates a json file with the description of projects and users | 14:21 |
*** limao has quit IRC | 14:21 | |
tosky | when you call it afterwards, everything which is not in that file is removed | 14:21 |
*** beekneemech is now known as bnemec | 14:22 | |
*** jfrancoa has quit IRC | 14:22 | |
sshnaidm | tosky, does "cleanup --dry-run" remove it? | 14:22 |
tosky | sshnaidm: the file or the artifacts? I think it should just show the expected actions, but I don't think I used --dry-run too much | 14:23 |
sshnaidm | that's what I'm talking about | 14:23 |
*** chlong_ has joined #tripleo | 14:23 | |
*** jfrancoa has joined #tripleo | 14:23 | |
*** jfrancoa has quit IRC | 14:24 | |
chandankumar | sshnaidm: tosky dry--run will crates a dry_run.json what tenenats /resources is going to be removed | 14:24 |
*** fragatina has quit IRC | 14:24 | |
*** fragatina has joined #tripleo | 14:24 | |
sshnaidm | chandankumar, right, so it does not clean up anything actually, right? | 14:24 |
chandankumar | sshnaidm: yes | 14:25 |
*** jfrancoa has joined #tripleo | 14:25 | |
chandankumar | sshnaidm: but we can diff two file saved_state and dyr_run to find what got changed | 14:25 |
sshnaidm | chandankumar, so it's better to choose different variable than "tampest_cleanup" | 14:25 |
*** pgadiya has quit IRC | 14:25 | |
*** jfrancoa has quit IRC | 14:26 | |
sshnaidm | chandankumar, I was talking about parameter name only | 14:26 |
chandankumar | sshnaidm: you mean this variable name https://review.openstack.org/#/c/481939/3/roles/validate-tempest/defaults/main.yml@38 ? | 14:26 |
*** jfrancoa has joined #tripleo | 14:27 | |
sshnaidm | chandankumar, yes | 14:27 |
chandankumar | sshnaidm: i kept tempest_cleanup for easy visibilyt | 14:27 |
*** zzzeek_ has joined #tripleo | 14:28 | |
chandankumar | sshnaidm: some other name like cleanup or something else? | 14:28 |
*** psachin has quit IRC | 14:28 | |
*** oidgar has joined #tripleo | 14:30 | |
*** ykarel has quit IRC | 14:30 | |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-ui master: Change tripleo-ui login images https://review.openstack.org/474710 | 14:31 |
openstackgerrit | Carlos Camacho proposed openstack/tripleo-ui master: Add favicon icons https://review.openstack.org/420111 | 14:31 |
chandankumar | sshnaidm: what about enable_cleanup? | 14:32 |
*** dixiaoli has joined #tripleo | 14:33 | |
*** dixiaoli has quit IRC | 14:33 | |
*** dixiaoli has joined #tripleo | 14:34 | |
*** jwb_ is now known as jwb | 14:35 | |
openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates master: Start using nic-configs from THT repo instead of tripleo-ci https://review.openstack.org/476708 | 14:36 |
*** fragatina has quit IRC | 14:36 | |
openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Replace outdated instruction with link to upstream doc https://review.openstack.org/482160 | 14:36 |
*** dixiaoli has quit IRC | 14:38 | |
openstackgerrit | Merged openstack/instack-undercloud master: Add ssl development headers to bindep https://review.openstack.org/481115 | 14:38 |
dprince | mandre: +A on https://review.openstack.org/#/c/476153/14 | 14:38 |
dprince | mandre: I will rebase some things behind this now... | 14:39 |
dprince | mandre: so hey, would be good to get this patch in next https://review.openstack.org/#/c/478628/ | 14:39 |
dprince | mandre: or soon | 14:39 |
dprince | jistr: ^^^ | 14:39 |
mandre | dprince: woohoo \o/ | 14:39 |
dprince | Ian's patch to cleanup the DockerNamespace stuff simplifyings lots of things related to pulling images | 14:40 |
mandre | dprince, jistr: we also have https://review.openstack.org/#/c/477535/ on the same topic as my big patch | 14:40 |
dprince | like pulling containers from different registry's, etc. We need this capability | 14:40 |
*** agurenko has quit IRC | 14:40 | |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Add tempest cleanup to validate-tempest role https://review.openstack.org/481939 | 14:41 |
dprince | mandre: +2 there as well | 14:41 |
mandre | dprince: ack, I'm all for Slower's patch | 14:42 |
jistr | ok will take a look shortly. Trying to fix upgrades now, we probably need to backport the scenarios to Ocata in the end... | 14:42 |
jistr | https://bugs.launchpad.net/tripleo/+bug/1703391 | 14:42 |
openstack | Launchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] | 14:42 |
sshnaidm | dprince, hi, did you have a chance to look at my mail about domain name? | 14:43 |
shardy | dprince: hey for https://review.openstack.org/#/c/478628/ where does the environment file with the image references live? | 14:43 |
shardy | dprince: I expected to see a new environments/foo.yaml added | 14:43 |
dprince | sshnaidm: got it, will take care of it today | 14:43 |
sshnaidm | dprince, great, thanks | 14:43 |
*** trown is now known as trown|brb | 14:43 | |
shardy | ah overcloud container image prepare? | 14:44 |
dprince | shardy: it is a patch series, I think we added one on the previous patch so as not to break CI | 14:44 |
dprince | shardy: also, eventually we'll use pythin-tripleoclient to generate it everywhere too | 14:44 |
shardy | dprince: Ok cool - we'll have to be a bit careful of the mistral/tripleoclient split there to avoid breaking the UI | 14:44 |
dprince | shardy: environments/docker-centos-tripleoupstream.yaml | 14:45 |
dprince | shardy: ack on not breaking the UI | 14:45 |
shardy | dprince: ah, thanks I didn't spot it as it's already merged | 14:45 |
shardy | all the *Image entries are commented there tho | 14:45 |
dprince | shardy: well, it is commented out. The point was to wire it into CI first and proceed with making it live | 14:45 |
shardy | dprince: ack thanks for clarifying, just wanted to understand what pieces I need to test locally | 14:46 |
dprince | shardy: as we are changing the meaning of some of these parameters | 14:46 |
EmilienM | sshnaidm: what's up | 14:47 |
sshnaidm | EmilienM, hey | 14:47 |
dprince | shardy: I advocated that we just cut over to the new format and not worry about upgrades. | 14:47 |
*** trown|brb is now known as trown | 14:47 | |
sshnaidm | EmilienM, wrt ovb-updates job name | 14:47 |
dprince | shardy: as most of these parameters are unreleased anyways other than milestones | 14:47 |
shardy | dprince: well we've not released a major version with all the docker stuff yet so I'd agree | 14:47 |
shardy | dprince: +1 | 14:47 |
sshnaidm | EmilienM, I thought it's better to mention topology since this combination of featureset and topology actually makes job unique | 14:48 |
sshnaidm | EmilienM, the same fs file could be used with various topologies | 14:48 |
openstackgerrit | Oliver Walsh proposed openstack/puppet-tripleo master: Refactor iscsi initiator-name reset into separate profile https://review.openstack.org/482166 | 14:49 |
openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates stable/ocata: Backport container CI environments to Ocata https://review.openstack.org/482167 | 14:49 |
openstackgerrit | Alex Schultz proposed openstack/instack-undercloud master: Switch from oslosphinx to openstackdocstheme https://review.openstack.org/478263 | 14:49 |
openstackgerrit | Attila Darazs proposed openstack-infra/tripleo-ci master: Add a static README for debugging quickstart logs https://review.openstack.org/482168 | 14:49 |
dciabrin | bandini, hey, could you help with +2 on https://review.openstack.org/#/c/477535/ ? | 14:50 |
*** ratailor has joined #tripleo | 14:51 | |
openstackgerrit | Alex Schultz proposed openstack/instack-undercloud stable/ocata: Add ssl development headers to bindep https://review.openstack.org/482169 | 14:53 |
openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Refactor iscsi initiator-name reset into separate service https://review.openstack.org/482170 | 14:53 |
openstackgerrit | Zane Bitter proposed openstack/tripleo-heat-templates master: Add dependency relationship between nested get_attr targets https://review.openstack.org/482172 | 14:56 |
*** rcernin has quit IRC | 14:57 | |
*** udesale has joined #tripleo | 14:57 | |
openstackgerrit | Ben Nemec proposed openstack/tripleo-docs master: Clean up admonition problems https://review.openstack.org/426969 | 14:58 |
EmilienM | sshnaidm: I gave you my feedback on this topic, but I'm not sure others gave it too | 14:59 |
*** yamahata has quit IRC | 14:59 | |
EmilienM | sshnaidm: I would seek for more feedback as to me it's a major change | 14:59 |
*** yamahata has joined #tripleo | 15:00 | |
sshnaidm | EmilienM, I've got only jistr mail about it in ML | 15:00 |
sshnaidm | EmilienM, seems like others just don't care much | 15:00 |
EmilienM | sshnaidm: it's just ovb right? | 15:01 |
*** mcornea has quit IRC | 15:01 | |
*** udesale has quit IRC | 15:02 | |
*** oidgar has quit IRC | 15:02 | |
*** achadha has joined #tripleo | 15:03 | |
sshnaidm | EmilienM, what exactly? | 15:03 |
sshnaidm | EmilienM, this patch is about previous ovb-updates job, yes | 15:03 |
sshnaidm | EmilienM, but we have to rename ovb-ha-oooq accordingly to new name convention too | 15:04 |
*** achadha has quit IRC | 15:04 | |
sshnaidm | EmilienM, and then multinode jobs too.. | 15:04 |
openstackgerrit | Ben Nemec proposed openstack/tripleo-docs master: Update No Valid Host doc link https://review.openstack.org/481709 | 15:05 |
*** ebarrera has quit IRC | 15:05 | |
EmilienM | sshnaidm: mhh ok | 15:05 |
*** limao_ has quit IRC | 15:05 | |
*** limao has joined #tripleo | 15:06 | |
*** jkilpatr has joined #tripleo | 15:06 | |
jistr | maybe it would get more attention in a separate thread? i wonder if some folks don't read through the CI squad meeting summary e-mails | 15:06 |
*** dpivonka has quit IRC | 15:09 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Test level3s dns servers for RDO Cloud https://review.openstack.org/482176 | 15:09 |
openstackgerrit | Alex Schultz proposed openstack/instack-undercloud stable/newton: Clear any previous environment in stackrc https://review.openstack.org/479033 | 15:09 |
sshnaidm | maybe.. although it may mean these folks are not interested in CI much and so don't care about job names :) | 15:09 |
jistr | i do view it as a step back to name jobs "featureset001" ... "featureset021" instead of "HA", "TLS" etc... It would be pretty inconvenient to try and memorize what the FS numbers map to, or to look it up every time... | 15:09 |
openstackgerrit | Alex Schultz proposed openstack/instack-undercloud stable/newton: Remove backslash from awk command in stackrc https://review.openstack.org/479034 | 15:09 |
*** dtrainor has joined #tripleo | 15:09 | |
*** dtrainor has quit IRC | 15:09 | |
*** dtrainor has joined #tripleo | 15:10 | |
sshnaidm | jistr, that was my concern too | 15:10 |
jistr | also given that the FS numbers are given out in "first come first serve" manner, not really guaranteeing that related jobs have related numbers | 15:10 |
jistr | (close to one another) | 15:10 |
*** ooolpbot has joined #tripleo | 15:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1703391 | 15:10 |
openstack | Launchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] | 15:10 |
*** ooolpbot has quit IRC | 15:10 | |
*** fzdarsky is now known as fzdarsky|afk | 15:11 | |
*** mcornea has joined #tripleo | 15:11 | |
*** limao_ has joined #tripleo | 15:12 | |
*** bfournie has joined #tripleo | 15:13 | |
*** bfournie has quit IRC | 15:14 | |
*** limao has quit IRC | 15:14 | |
openstackgerrit | Ilya Etingof proposed openstack/tripleo-quickstart master: Fixed typos in English words https://review.openstack.org/482179 | 15:16 |
*** chlong_ has quit IRC | 15:16 | |
*** bfournie has joined #tripleo | 15:16 | |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Explicitly set REVIEW_RELEASE on master https://review.openstack.org/451445 | 15:18 |
*** oidgar has joined #tripleo | 15:20 | |
*** d0ugal has joined #tripleo | 15:20 | |
*** gbarros has quit IRC | 15:25 | |
*** gbarros has joined #tripleo | 15:26 | |
*** fragatina has joined #tripleo | 15:26 | |
*** ccamacho has quit IRC | 15:27 | |
openstackgerrit | Merged openstack/tripleo-quickstart master: Fix conditional in environment/setup role https://review.openstack.org/472606 | 15:28 |
openstackgerrit | Oliver Walsh proposed openstack/puppet-tripleo master: Refactor iscsi initiator-name reset into separate profile https://review.openstack.org/482166 | 15:29 |
*** ccamacho has joined #tripleo | 15:29 | |
*** chlong_ has joined #tripleo | 15:30 | |
*** lblanchard has quit IRC | 15:30 | |
openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Refactor iscsi initiator-name reset into separate service https://review.openstack.org/482170 | 15:30 |
ccamacho | jpich jtomasek honza, do you think https://review.openstack.org/#/c/474710 is now in good shape to be merged? | 15:31 |
jpich | ccamacho: LGTM, gave it my +1 earlier, will let the experts comment now! lblanchard sounds happy enough with the latest version too | 15:33 |
ccamacho | cool thanks! | 15:33 |
chandankumar | sshnaidm: need some suggestion on this https://review.openstack.org/#/c/481939/4/roles/validate-tempest/README.md: whether to store tempest resources leftovers after tempest run? | 15:34 |
*** vfarias has joined #tripleo | 15:36 | |
sshnaidm | chandankumar, which leftovers? | 15:37 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Fix master-tripleo-ci release config https://review.openstack.org/482187 | 15:38 |
*** ramishra has quit IRC | 15:38 | |
fxpester | hi all, anyone using fake_pxe driver to provision overcloud ? | 15:38 |
fxpester | looks like it is broken in ocata, getting this error - 'UnsupportedDriverExtension: Driver fake_pxe does not support management (disabled or not implemented).' | 15:38 |
chandankumar | sshnaidm: resources created after running tempest tests. | 15:38 |
sshnaidm | chandankumar, sorry, I don't follow | 15:39 |
*** oidgar has quit IRC | 15:40 | |
fxpester | or this error '2017-07-10 11:35:20.949 3706 DEBUG oslo.messaging._drivers.impl_rabbit [-] Timed out waiting for RPC response: Timeout while waiting on RPC response - topic: "<unknown>", RPC method: "<unknown>" info: "<unknown>" _raise_timeout /usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py:1052' | 15:40 |
*** ffiore has quit IRC | 15:41 | |
*** suuuper has quit IRC | 15:41 | |
*** suuuper has joined #tripleo | 15:42 | |
*** paramite has quit IRC | 15:43 | |
*** fzdarsky|afk is now known as fzdarsky | 15:44 | |
gfidente | shardy jistr I think this https://review.openstack.org/#/c/476602/ is what we discussed about | 15:46 |
gfidente | provided it has to pass CI, I'd be happy if you could leave a vote there | 15:46 |
*** yprokule has quit IRC | 15:46 | |
chandankumar | sshnaidm: we are doing two things with tempest clean up 1.saving the previous state of resorces before running the tempest and second creating a report of the projects what will be get deleted once we run tempest clean up is executed, in the end we are not running tempest cleanup command to avoid what resources are going to get deleted | 15:47 |
*** ccamacho has quit IRC | 15:47 | |
*** iranzo has quit IRC | 15:48 | |
chandankumar | sshnaidm: what should i say to this. | 15:48 |
*** jkilpatr has quit IRC | 15:48 | |
sshnaidm | chandankumar, ok, that I understand | 15:49 |
openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Add role_configs into workflow executions environment https://review.openstack.org/479790 | 15:49 |
sshnaidm | chandankumar, so what is the actual question..? how to name the parameter? | 15:49 |
chandankumar | sshnaidm: there are two things: 1] variable name 2] description of the variable in README | 15:50 |
chandankumar | on which we are not agreeing | 15:50 |
chandankumar | https://review.openstack.org/#/c/481939/ | 15:50 |
*** mcornea has quit IRC | 15:51 | |
*** jlinkes has quit IRC | 15:53 | |
sshnaidm | gchamoul, ping me please tomorrow about it | 15:53 |
gchamoul | sshnaidm: ack | 15:53 |
*** d0ugal has quit IRC | 15:56 | |
chandankumar | sshnaidm: yes | 15:56 |
*** achadha has joined #tripleo | 15:56 | |
*** achadha has quit IRC | 15:57 | |
*** achadha has joined #tripleo | 15:57 | |
openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart-extras master: Ensure the tripleo-ui-config.js file exits prior to modifying https://review.openstack.org/476613 | 15:58 |
*** rhallisey is now known as rhallisey-biab | 15:58 | |
*** rhallisey-biab has quit IRC | 15:59 | |
*** noslzzp has joined #tripleo | 16:02 | |
fultonj | ipa_images.tar from http://66.187.229.139/builds/current-tripleo is missing ironic-python-agent.vmlinuz (it has initramfs and kernel) | 16:03 |
fultonj | quickstart fails when it cannot find this file https://github.com/openstack/tripleo-quickstart/blob/master/roles/libvirt/setup/undercloud/tasks/main.yml#L229 | 16:03 |
*** ffiore has joined #tripleo | 16:03 | |
*** egonzalez has quit IRC | 16:03 | |
fultonj | does this sound like a bug because ipa_images.tar needs the missing vmlinuz file? | 16:04 |
*** achadha has quit IRC | 16:04 | |
fultonj | has anyone seen this? trown weshay ^ ? | 16:04 |
*** achadha has joined #tripleo | 16:05 | |
trown | fultonj: ya, found that this morning https://review.openstack.org/#/c/482187/ | 16:05 |
*** lmiccini has quit IRC | 16:05 | |
fultonj | trown: thank you i will just remove that from my local playbook until this merges. | 16:06 |
*** chlong_ has quit IRC | 16:06 | |
trown | fultonj: ya we should get it merged quickly since it breaks a bunch of our gates | 16:06 |
*** marios has quit IRC | 16:06 | |
sshnaidm | chandankumar, if it saves state of resources, let's call it like "tempest_track_resources" | 16:06 |
trown | sshnaidm: panda adarazs https://review.openstack.org/#/c/482187/ fixes broken master-tripleo-ci gates of quickstart | 16:07 |
*** achadha has quit IRC | 16:09 | |
*** panda is now known as panda|break | 16:09 | |
*** ooolpbot has joined #tripleo | 16:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1703391 | 16:10 |
openstack | Launchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 16:10 |
*** ooolpbot has quit IRC | 16:10 | |
adarazs | trown: +2 | 16:10 |
adarazs | trown, panda|break, sshnaidm: can you also take a look at this: https://review.openstack.org/482168 -- very simple, just adding a static readme that I plan to use for the upstream logs. | 16:10 |
adarazs | same as the one that is in collect-logs. | 16:11 |
*** bogdando has quit IRC | 16:11 | |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Track the tempest resources before and after tempest run https://review.openstack.org/481939 | 16:12 |
*** jkilpatr has joined #tripleo | 16:12 | |
chandankumar | sshnaidm: done, Thanks :-) | 16:12 |
*** ffiore has quit IRC | 16:14 | |
*** nyechiel has quit IRC | 16:15 | |
*** coolsvap has quit IRC | 16:16 | |
*** social has quit IRC | 16:17 | |
bnemec | EmilienM: tripleo.org is just taking me to the docs now. We've lost all of the other stuff that was in the header of the site, ci status, zuul queue status, etc. | 16:18 |
bnemec | Was that intentional? | 16:18 |
EmilienM | bnemec: not at all | 16:18 |
openstackgerrit | Merged openstack/tripleo-common master: Remove the unused scale module https://review.openstack.org/478872 | 16:19 |
bnemec | EmilienM: Are you seeing the same thing? Just want to confirm this isn't just a weird browser quirk on my end. | 16:19 |
bnemec | It wouldn't be the first time. :-) | 16:19 |
openstackgerrit | Merged openstack/tripleo-common master: Remove the unused exception PlanOperationError https://review.openstack.org/478874 | 16:19 |
openstackgerrit | Lokesh Jain proposed openstack/puppet-tripleo stable/newton: Addition of Nuage as mechanism driver for ML2 https://review.openstack.org/481751 | 16:19 |
EmilienM | bnemec: indeed, I see the same thing :( | 16:19 |
EmilienM | bnemec: we switched tripleo.org to the new theme and lost headers | 16:20 |
bnemec | Hmm :-( | 16:20 |
*** chlong_ has joined #tripleo | 16:20 | |
*** limao_ has quit IRC | 16:20 | |
*** dsariel has quit IRC | 16:20 | |
EmilienM | bnemec: don't tell dprince | 16:20 |
EmilienM | I'm wondering how can we restore the tripleo theme just on tripleo.org | 16:21 |
*** ratailor has quit IRC | 16:21 | |
* bnemec deletes dprince's irc history | 16:21 | |
*** fragatina has quit IRC | 16:21 | |
bnemec | I'm tempted to say let's just revert the change for now. | 16:21 |
bnemec | It's just a theme. The content is the same regardless of what style it's presented in. | 16:22 |
bnemec | And the new theme is completely broken for that site. | 16:22 |
EmilienM | if we could have the headers back at least | 16:22 |
*** dmacpher has quit IRC | 16:22 | |
*** jpich has quit IRC | 16:22 | |
bnemec | I would not be surprised if this is the same basic problem as the admonition selector. I'm pretty sure we were customizing the theme in the website. | 16:22 |
EmilienM | it's not completely broken imho, some features are missing maybe, like the headers | 16:22 |
EmilienM | I've checked and the content still looks good | 16:23 |
*** suuuper has quit IRC | 16:23 | |
bnemec | Discoverability of the other content is completely broken. | 16:23 |
bnemec | You have to already know about the cistatus page in order to find it now. | 16:23 |
bnemec | First rule of tripleo.org... ;-) | 16:23 |
EmilienM | bnemec: "Discoverability of the other content" you mean headers? | 16:24 |
bnemec | EmilienM: Yeah, there are no links to the ci status pages or the zuul status page now. | 16:24 |
bnemec | If you don't already know their addresses you can't find them. | 16:24 |
EmilienM | I agree | 16:25 |
EmilienM | bnemec: can you file a bug? I'll try to fix this thing this week | 16:26 |
* EmilienM brb 10 min | 16:26 | |
bnemec | EmilienM: Yep | 16:26 |
*** achadha has joined #tripleo | 16:31 | |
*** jfrancoa has quit IRC | 16:32 | |
bnemec | EmilienM: https://bugs.launchpad.net/tripleo/+bug/1703407 | 16:32 |
openstack | Launchpad bug 1703407 in tripleo "tripleo.org is missing its headers" [Critical,Triaged] | 16:32 |
shardy | dumb puppet question - how do I run an rspec test individually vs bundle exect rake spec which runs them all? | 16:34 |
openstackgerrit | Lokesh Jain proposed openstack/puppet-tripleo stable/ocata: Remove unnecessary references to neutron core plugin hiera https://review.openstack.org/482211 | 16:35 |
*** shardy is now known as shardy_afk | 16:37 | |
openstackgerrit | Lokesh Jain proposed openstack/puppet-tripleo stable/newton: Remove unnecessary references to neutron core plugin hiera https://review.openstack.org/481774 | 16:38 |
*** anshul has quit IRC | 16:38 | |
*** chlong_ has quit IRC | 16:38 | |
*** achadha has quit IRC | 16:39 | |
EmilienM | bnemec: thx | 16:39 |
*** hjensas has quit IRC | 16:41 | |
*** fragatina has joined #tripleo | 16:42 | |
*** hjensas has joined #tripleo | 16:42 | |
*** hjensas has quit IRC | 16:42 | |
*** hjensas has joined #tripleo | 16:42 | |
*** aufi has quit IRC | 16:46 | |
dprince | EmilienM, bnemec: The website uses a custom tripleosphinx style | 16:48 |
dprince | EmilienM, bnemec: it wasn't designed to share themes. Either we use one or the other | 16:49 |
dprince | EmilienM, bnemec: the patch to update the theme for our website should just be reverted | 16:49 |
*** fragatina has quit IRC | 16:49 | |
*** pkovar has quit IRC | 16:50 | |
openstackgerrit | Ana Krivokapic proposed openstack/tripleo-ui master: PlanList and PlanCard updates https://review.openstack.org/476942 | 16:54 |
openstackgerrit | Ana Krivokapic proposed openstack/tripleo-ui master: Add plan description to plan cards https://review.openstack.org/479404 | 16:54 |
openstackgerrit | Ana Krivokapic proposed openstack/tripleo-ui master: Remove CurrentPlanReducer https://review.openstack.org/476939 | 16:54 |
openstackgerrit | Ana Krivokapic proposed openstack/tripleo-ui master: Plans routing refactor https://review.openstack.org/476904 | 16:54 |
openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci master: Fix website style per openstackdocstheme changes https://review.openstack.org/482215 | 16:55 |
dprince | EmilienM, bnemec: ^^^ | 16:55 |
*** lblanchard has joined #tripleo | 17:01 | |
*** dciabrin has quit IRC | 17:01 | |
EmilienM | dprince: cool | 17:01 |
*** tesseract has quit IRC | 17:01 | |
*** dciabrin has joined #tripleo | 17:02 | |
*** lblanchard has quit IRC | 17:04 | |
openstackgerrit | Rajini Karthik proposed openstack/puppet-tripleo master: PS Cinder: Added support for password less login https://review.openstack.org/477628 | 17:04 |
*** lblanchard has joined #tripleo | 17:04 | |
*** lucasagomes is now known as lucas-afk | 17:06 | |
openstackgerrit | Rajini Karthik proposed openstack/tripleo-heat-templates master: Ps Cinder: Added support for password less login https://review.openstack.org/477641 | 17:08 |
weshay | matbu, https://review.openstack.org/#/c/459993/ | 17:09 |
*** ooolpbot has joined #tripleo | 17:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1703391 | 17:10 |
openstack | Launchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 17:10 |
*** ooolpbot has quit IRC | 17:10 | |
openstackgerrit | Dan Prince proposed openstack-infra/tripleo-ci master: Fix website style per openstackdocstheme changes https://review.openstack.org/482215 | 17:11 |
*** achadha has joined #tripleo | 17:12 | |
*** achadha has quit IRC | 17:13 | |
*** achadha has joined #tripleo | 17:13 | |
openstackgerrit | Ana Krivokapic proposed openstack/tripleo-ui master: PlanList and PlanCard updates https://review.openstack.org/476942 | 17:14 |
*** fragatina has joined #tripleo | 17:15 | |
*** fragatina has quit IRC | 17:15 | |
*** fragatina has joined #tripleo | 17:17 | |
*** sshnaidm has quit IRC | 17:17 | |
*** fragatina has quit IRC | 17:18 | |
*** fragatina has joined #tripleo | 17:18 | |
*** jkilpatr has quit IRC | 17:19 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Copy only generated puppet files into the container https://review.openstack.org/476153 | 17:20 |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Add a new docker centos Heat environment https://review.openstack.org/479400 | 17:20 |
openstackgerrit | Merged openstack/tripleo-quickstart master: add doc to help users with split playbooks https://review.openstack.org/478624 | 17:20 |
*** ckyriakidou has quit IRC | 17:20 | |
*** trown is now known as trown|lunch | 17:24 | |
slagle | EmilienM: are you good to +2 this one now? https://review.openstack.org/#/c/477542/ | 17:30 |
dmsimard | dprince, panda|break, Slower: So, just want to confirm. Let's use the same container tags as DLRN for promotions to make it simpler to understand ? i.e, current-tripleo, current-tripleo-rdo | 17:32 |
*** amoralej is now known as amoralej|off | 17:32 | |
dprince | dmsimard: use them where? | 17:32 |
dmsimard | I ask because I had initially went off on the docker "convention" of using "latest" instead so I tagged them as "latest-passed-ci" | 17:32 |
dmsimard | dprince: private registry | 17:32 |
dprince | dmsimard: okay, sounds good to me | 17:33 |
dmsimard | dprince: using "latest" is awful :) | 17:33 |
dprince | dmsimard: for upstream it isn't I think | 17:33 |
dprince | dmsimard: we are removing the image defaults entirely anyways | 17:33 |
dprince | dmsimard: there will be no default | 17:34 |
EmilienM | slagle: yes | 17:34 |
dprince | dmsimard: | 17:34 |
dmsimard | dprince: well, there is still room for "latest" -- what I mean is that the gate shouldn't be using something like "latest" which is unstable | 17:34 |
dprince | dmsimard: https://review.openstack.org/#/c/478628/ | 17:34 |
EmilienM | slagle: I think it won't merge until https://review.openstack.org/#/c/480625/ is landed though | 17:35 |
dmsimard | dprince: the flow would be something like this.. periodic build job -> latest -- if it passes, tagged current-tripleo | 17:35 |
EmilienM | because of the depends-on | 17:35 |
dprince | dmsimard: by removing the default we are forcing the user to set it. what we set for tripleo-ci is a different thing | 17:35 |
dprince | dmsimard: using a 'current-tripleo' tag there sounds great to me though | 17:36 |
dmsimard | dprince: well, it's the same thing as using the current-tripleo DLRN repo in the gates | 17:36 |
*** tosky has quit IRC | 17:37 | |
dprince | dmsimard: correct, which is why I think it is fine | 17:38 |
*** rhallisey has joined #tripleo | 17:38 | |
dprince | dmsimard: the only way I like it though is by removing the tripleo-heat-template defaults | 17:38 |
dmsimard | sure | 17:38 |
dprince | dmsimard: I would not be a fan of updating the default tags in t-h-t for example to say 'current-tripleo' | 17:38 |
dmsimard | dprince: so what'll be default, then ? latest ? | 17:39 |
slagle | EmilienM: ah darn, blocked by the backport | 17:39 |
dprince | dmsimard: no, there will be no default. None | 17:39 |
slagle | EmilienM: actually, i'll just remove that dependson from the commit message as it is merged on master | 17:39 |
dprince | dmsimard: you have to specify the container images | 17:39 |
dmsimard | dprince: ah. | 17:39 |
*** dpawar has quit IRC | 17:39 | |
openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates master: Revert "Revert "Blacklist support for ExtraConfig"" https://review.openstack.org/477542 | 17:40 |
*** fandrieu has quit IRC | 17:40 | |
*** MVenesio has joined #tripleo | 17:47 | |
*** dprince has quit IRC | 17:48 | |
*** yamahata has quit IRC | 17:49 | |
EmilienM | slagle: yeah, depends-on doesn't understand branches | 17:53 |
EmilienM | slagle: let's merge it now | 17:53 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: add featureset for containerized undercloud https://review.openstack.org/476242 | 17:55 |
*** ebarrera has joined #tripleo | 17:57 | |
*** cschwede has quit IRC | 17:57 | |
*** dtantsur is now known as dtantsur|afk | 18:00 | |
*** tosky has joined #tripleo | 18:01 | |
*** milan has quit IRC | 18:01 | |
*** lblanchard has quit IRC | 18:04 | |
dmsimard | jidar: np, thanks for pinging us about it. | 18:05 |
jidar | you betcha :) | 18:05 |
*** dpawar has joined #tripleo | 18:05 | |
*** cylopez has joined #tripleo | 18:07 | |
openstackgerrit | James Slagle proposed openstack/tripleo-docs master: Add documentation for split-stack https://review.openstack.org/461871 | 18:07 |
*** cylopez has quit IRC | 18:07 | |
openstackgerrit | James Slagle proposed openstack/tripleo-docs master: Additional docs for using deployed servers https://review.openstack.org/460652 | 18:08 |
*** sshnaidm has joined #tripleo | 18:08 | |
openstackgerrit | James Slagle proposed openstack/tripleo-docs master: Document DeploymentSwiftDataMap for deployed-server https://review.openstack.org/481339 | 18:08 |
*** rlandy is now known as rlandy|brb | 18:10 | |
*** ooolpbot has joined #tripleo | 18:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1703391 | 18:10 |
*** ooolpbot has quit IRC | 18:10 | |
openstack | Launchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 18:10 |
*** thrash is now known as thrash|biab | 18:12 | |
openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Set nodes to manageable before introspecting https://review.openstack.org/482235 | 18:15 |
openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: allow tqe roles to work in sync with ARA https://review.openstack.org/482237 | 18:18 |
*** dprince has joined #tripleo | 18:19 | |
*** yamahata has joined #tripleo | 18:24 | |
openstackgerrit | Victoria Martinez de la Cruz proposed openstack/tripleo-heat-templates master: Containerize Manila Share service https://review.openstack.org/471527 | 18:32 |
*** akrivoka has quit IRC | 18:36 | |
*** rlandy|brb is now known as rlandy | 18:44 | |
*** trown|lunch is now known as trown | 18:45 | |
*** paramite has joined #tripleo | 18:49 | |
*** dsariel has joined #tripleo | 18:49 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Test level3s dns servers for RDO Cloud https://review.openstack.org/482176 | 18:50 |
openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DONT REVIEW: Test commit to check periodic multinode jobs https://review.openstack.org/481222 | 18:53 |
*** ansmith_ has joined #tripleo | 18:58 | |
*** ansmith_ has quit IRC | 18:58 | |
*** shardy_afk is now known as shardy | 18:59 | |
*** ansmith_ has joined #tripleo | 19:01 | |
pradk | mwhahaha, Hi, do we bounce haproxy or apache between steps 4 and 5? | 19:03 |
mwhahaha | we shouldn't be bouncing apache | 19:03 |
mwhahaha | can't vouch for haproxy but i don't think so | 19:03 |
pradk | mwhahaha, re: https://review.openstack.org/#/c/481743/1 .. I agree that this probably wont fix.. I'm not sure though why keystone is throwing 503 when it should be up | 19:04 |
mwhahaha | pradk: so we do preconfigure all the hosts so it could be a timing thing. and if we don't have a proper health check (functionaly check) it may just add the host as soon as apache starts listening | 19:04 |
*** zaneb has quit IRC | 19:05 | |
pradk | we could perhaps curl to ensure keystone is alive before running upgrade in step5 | 19:05 |
*** bfournie has quit IRC | 19:05 | |
mwhahaha | we should have proper health checks in haproxy so that's the case | 19:06 |
*** bfournie has joined #tripleo | 19:06 | |
pradk | re-running failed deploy succeeds, that perhaps explains the timing thing | 19:06 |
*** liverpooler has quit IRC | 19:06 | |
*** raissa has quit IRC | 19:07 | |
*** bfournie has quit IRC | 19:08 | |
pradk | mwhahaha, i see something like this in haproxy log .. haproxy[35773]: Server keystone_public/overcloud-controller-2. is DOWN, reason: Layer4 connection problem, info: "Connection refused", check duration: 0ms. | 19:09 |
pradk | could be related | 19:09 |
*** bugzy has joined #tripleo | 19:09 | |
pradk | where do we do these haproxy health checks? in puppet-tripleo? | 19:09 |
mwhahaha | wonder if it's network connectivity interuptions | 19:09 |
mwhahaha | puppet-tripleo haproxy profile | 19:09 |
mwhahaha | most are just basic http checks | 19:09 |
*** lblanchard has joined #tripleo | 19:09 | |
mwhahaha | i had a patch in earlier in the cycle to switch them all to http check | 19:10 |
*** ooolpbot has joined #tripleo | 19:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1703391 | 19:10 |
openstack | Launchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 19:10 |
*** ooolpbot has quit IRC | 19:10 | |
*** lblanchard has quit IRC | 19:10 | |
*** lblanchard has joined #tripleo | 19:10 | |
*** liverpooler has joined #tripleo | 19:11 | |
mwhahaha | pradk: https://github.com/openstack/puppet-tripleo/blob/master/manifests/haproxy.pp#L909 | 19:11 |
mwhahaha | pradk: we are checking for /v3 is responding | 19:11 |
*** bugzy_ has quit IRC | 19:12 | |
pradk | lemme see if there are any health check failures during this time frame when 503 happens | 19:15 |
*** rhallisey is now known as rhallisey-biab | 19:16 | |
*** jmelvin has quit IRC | 19:19 | |
pradk | i dont see any health check error from what i can tell .. just the conn refused ones | 19:19 |
mwhahaha | iptables issue perhaps? | 19:19 |
pradk | hmm why would a rerun work in that case.. | 19:20 |
pradk | running upgrade manually succeeds apparently | 19:21 |
pradk | also re runs fix the issue and deploy succeeds | 19:21 |
pradk | so this definitely seems like a race somewhere between step 4 and 5 | 19:21 |
openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Split quickstart-extras.yml into sub-playbooks https://review.openstack.org/475813 | 19:24 |
pradk | 2017-07-02 14:48:11.803 123807 ERROR ceilometer ClientException: {"message": "The server is currently unavailable. Please try again at a later time.<br /><br />\n\n\n", "code": "503 Service Unavailable", "title": "Service Unavailable"} | 19:25 |
pradk | is the error ceilo-upgrade gets | 19:25 |
pradk | so keystone is definitely down when this request happens | 19:26 |
*** morazi has quit IRC | 19:29 | |
*** dpawar has quit IRC | 19:30 | |
*** atoth has quit IRC | 19:30 | |
*** gfidente is now known as gfidente|afk | 19:36 | |
openstackgerrit | Itzik Brown proposed openstack/tripleo-heat-templates master: Fixing a bug when setting a password for ODL controller https://review.openstack.org/480971 | 19:37 |
*** prateek has quit IRC | 19:38 | |
pradk | mwhahaha, looks like we enable fencing in step 5 .. could that come in the way? | 19:40 |
mwhahaha | i don't think so, but that might be a better question for the pidone guys on that impact | 19:40 |
pradk | i opened a upstream bug here https://bugs.launchpad.net/tripleo/+bug/1703444 | 19:42 |
openstack | Launchpad bug 1703444 in tripleo "ocata deploy fails randomly with ceilo upgrade failing with keystone" [High,Triaged] | 19:42 |
pradk | will add more info when i find | 19:42 |
*** agopi has joined #tripleo | 19:44 | |
*** agopi has quit IRC | 19:44 | |
weshay | pradk, we're hitting https://bugs.launchpad.net/tripleo/+bug/1703444 on master | 19:44 |
openstack | Launchpad bug 1703444 in tripleo "ocata deploy fails randomly with ceilo upgrade failing with keystone" [High,Triaged] | 19:44 |
*** eck` is now known as eck`gone | 19:44 | |
*** agopi|away has quit IRC | 19:45 | |
pradk | weshay, on master? | 19:45 |
*** agopi has joined #tripleo | 19:45 | |
pradk | weshay, hmm why is collector even running on master.. that is deprecated in pike and disabled by default | 19:45 |
*** jmelvin has joined #tripleo | 19:46 | |
pradk | weshay, https://review.openstack.org/#/c/450885/ | 19:47 |
weshay | thanks pradk /me looks | 19:47 |
pradk | cool, but yea we need to chase this race condition down | 19:47 |
pradk | tbh i have no idea where the race is so far :/ | 19:48 |
* weshay has too many tabs open | 19:48 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 19:48 |
*** trozet has quit IRC | 19:51 | |
*** nyechiel has joined #tripleo | 19:54 | |
openstackgerrit | Merged openstack/paunch master: Add health check support to paunch. https://review.openstack.org/478228 | 19:57 |
*** fzdarsky is now known as fzdarsky|afk | 19:58 | |
*** d0ugal has joined #tripleo | 19:58 | |
weshay | myoung, can we get on that overcloud? | 19:58 |
myoung | pradk, weshay: the most current ocata promotions are reproducing this now, last 2 jobs hit same issue. will update the LP with links | 19:58 |
weshay | myoung, sure.. but you also hit in master | 19:59 |
weshay | myoung, let's discuss only master for a minute | 19:59 |
myoung | weshay: I might have caused some confusion with getting links and cards crossed...the current ocata BM job is hitting this, I pasted into the wrong card :( | 19:59 |
*** zaneb has joined #tripleo | 20:01 | |
*** gbarros has quit IRC | 20:01 | |
*** eck`gone is now known as eck` | 20:02 | |
myoung | weshay: master is hitting another intermittent OC deploy failure, but not sure if it's the same root cause - this is on the same config, and we're not using disable-telemetry there as well, still digging on that one (https://thirdparty-logs.rdoproject.org/jenkins-tripleo-quickstart-master-delorean-baremetal-dell_pe_r630-bond_with_vlans-199/undercloud/home/stack/failed_deployment_list.log.gz) | 20:03 |
*** nyechiel has quit IRC | 20:04 | |
*** trozet has joined #tripleo | 20:04 | |
*** liverpooler has quit IRC | 20:04 | |
weshay | myoung, at any rate.. follow the configs from upstream for sure.. is my summary | 20:04 |
*** dparkes has joined #tripleo | 20:04 | |
pradk | mwhahaha, this is one the patches we recently merged in ocata https://review.openstack.org/#/c/473735/ ... and we only started seeing this random failure issue recently (in last two weeks) | 20:06 |
pradk | might not be related, but i'm just wondering if this has any potential side effects in step 5 | 20:06 |
*** pchavva has quit IRC | 20:06 | |
mwhahaha | but we don't enable fencing in ci do we? | 20:07 |
pradk | this was not an issue until recently so.. | 20:07 |
mwhahaha | it's more likely that there is an upstream dep that might be slowing down keystone such that we're just noticing this | 20:07 |
pradk | i have not seen it fail in ci ocata job *yet* | 20:07 |
mwhahaha | but i'm not sure | 20:07 |
*** jkilpatr has joined #tripleo | 20:07 | |
mwhahaha | pradk: can you point me to some logs and i'll poke at it? | 20:08 |
*** sbrzozow has quit IRC | 20:09 | |
*** Goneri has quit IRC | 20:09 | |
*** nyechiel has joined #tripleo | 20:10 | |
*** ooolpbot has joined #tripleo | 20:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1703391 | 20:10 |
*** ooolpbot has quit IRC | 20:10 | |
openstack | Launchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 20:10 |
pradk | myoung, if you can add your ci failure logs that would be helpful | 20:10 |
*** morazi has joined #tripleo | 20:11 | |
*** anshul has joined #tripleo | 20:12 | |
myoung | pradk: aye...weshay linked the log from today in the LP already | 20:14 |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart master: enable container periodic job https://review.openstack.org/475743 | 20:15 |
openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: WIP: enable containers periodic job https://review.openstack.org/475745 | 20:15 |
pradk | myoung, cool thx | 20:15 |
*** ebarrera_ has joined #tripleo | 20:15 | |
openstackgerrit | Luigi Toscano proposed openstack/tripleo-quickstart-extras master: validate-tempest: fixes in the configuration-only workflow https://review.openstack.org/477613 | 20:16 |
myoung | weshay, pradk: so to be concrete, do you want me to leave the config for the Bm config as is (telemetry enabled), or include disable-telemetry.yaml, to match what RDO/upstream CI is doing? | 20:16 |
myoung | pradk: also do you need a live debug, I can attempt to repro and yank the config offline so you can debug it live....if that helps | 20:16 |
*** eck` is now known as eck`gone | 20:17 | |
pradk | myoung, yea that would be helpful.. this is ocata correct? | 20:17 |
pradk | not master? | 20:17 |
*** eck`gone is now known as eck` | 20:17 | |
myoung | pradk: correct, | 20:17 |
*** paramite has quit IRC | 20:18 | |
myoung | weshay, pradk: I had a paste fail into a card (for intermittent master failures...not root caused yet) with ocata links, sorry for the confusion. I'm not seeing this *specific* error on master | 20:18 |
myoung | I am seeing general 60% deploy fails to this BM config, which also (still) is running with telemetry enabled during OC deploy | 20:19 |
*** eck` is now known as eck`gone | 20:19 | |
*** eck`gone is now known as eck` | 20:19 | |
myoung | ^^ exhibiting as general timeouts / 500 yielding OC deploy fail | 20:19 |
*** zaneb has quit IRC | 20:20 | |
*** jkilpatr has quit IRC | 20:21 | |
pradk | myoung, the link weshay put in the bug doesnt seem to indicate the same race condition issue.. in this case it failed because swift seems to be down in this deployment | 20:22 |
weshay | myoung, looking at the jobs in ci.centos it's disabled in both non-ha and ha configs | 20:22 |
*** atheurer has quit IRC | 20:23 | |
*** atheurer_ has joined #tripleo | 20:23 | |
*** anshul has quit IRC | 20:24 | |
weshay | myoung, rlandy afaict.. to follow upstream I think disabling it should be done here as well http://replace_me/git/tripleo-environments.git/tree/hardware_environments/dell_pe_r630/network_configs/bond_with_vlans/config_files/config.yml | 20:24 |
myoung | weshay: ack, working on that patch now | 20:24 |
*** toure is now known as toure|biab | 20:26 | |
*** toure|biab is now known as toure | 20:26 | |
* rlandy reads back as to what we're disabling | 20:29 | |
*** rhallisey has joined #tripleo | 20:30 | |
mwhahaha | looks like containers job is broken | 20:35 |
mwhahaha | keystone problems in the validate, saw it on several jobs now http://logs.openstack.org/97/477697/3/gate/gate-tripleo-ci-centos-7-containers-multinode/ec4ab27/logs/undercloud/home/jenkins/overcloud_validate.log.txt.gz#_2017-07-10_20_01_25 | 20:35 |
*** zaneb has joined #tripleo | 20:36 | |
*** gbarros has joined #tripleo | 20:37 | |
EmilienM | oops | 20:37 |
*** ansmith has quit IRC | 20:38 | |
EmilienM | mwhahaha: is it only container jobs? | 20:38 |
*** ansmith_ has quit IRC | 20:38 | |
mwhahaha | yes | 20:38 |
bnemec | Wow, an ovb-updates job that passed in 2:52? That must have come in _just_ under the timeout. | 20:38 |
mwhahaha | at least as i've seen | 20:38 |
EmilienM | I see a bunch of success | 20:38 |
* bnemec stops getting sidetracked | 20:38 | |
*** agopi has quit IRC | 20:38 | |
EmilienM | bnemec: yes the job is timeouting a lot in promotion pipeline | 20:39 |
bnemec | Hmm, data on the containers job on http://status-tripleoci.rhcloud.com/ seems stale. | 20:41 |
bnemec | Stops on the 6th. | 20:41 |
bnemec | sshnaidm: ^ | 20:41 |
EmilienM | yeah | 20:42 |
EmilienM | mwhahaha: I'm doing pkg diff now | 20:42 |
EmilienM | and I don't see anything yet | 20:42 |
bnemec | http://tripleo.org/cistatus.html doesn't show an abnormal number of failures though. | 20:42 |
mwhahaha | i don't see that change on cistatus.html | 20:42 |
bnemec | Interesting. Maybe our project list is incomplete? | 20:43 |
mwhahaha | and i saw it on 2 or 3 different reviews that just posted | 20:43 |
mwhahaha | so let me see | 20:43 |
bnemec | Ah, maybe it's broken since the last time cistatus updated? | 20:43 |
mwhahaha | bnemec: that was your adminstateup patch btw | 20:43 |
EmilienM | it weird, we haven't promoted in 3 days | 20:44 |
bnemec | Ah, the one I blindly rechecked. :-) | 20:44 |
mwhahaha | bnemec: i had seen it on a previous change as well which is the reason i mentioned it | 20:44 |
bnemec | Weird that it doesn't show up on cistatus though. Maybe the failure was too old? | 20:44 |
mwhahaha | https://review.openstack.org/#/c/471950/8 | 20:45 |
mwhahaha | failed same reason | 20:45 |
bnemec | No, that's quite recent actually. About half an hour ago. | 20:45 |
mwhahaha | https://review.openstack.org/#/c/469116/ | 20:45 |
mwhahaha | same | 20:45 |
mwhahaha | er not tha tone | 20:45 |
EmilienM | but https://review.openstack.org/#/c/479790/7 worked | 20:45 |
* bnemec runs the cistatus script locally to get the new hotness | 20:45 | |
EmilienM | sounds like a race condition in container job | 20:46 |
mwhahaha | http://logs.openstack.org/50/471950/8/check/gate-tripleo-ci-centos-7-containers-multinode/3f27302/logs/undercloud/home/jenkins/overcloud_validate.log.txt.gz#_2017-07-10_19_00_07 | 20:46 |
mwhahaha | just as an aside, why is it using v2? :D | 20:46 |
gbarros | I was about to ask if CI is broken, is that what you guys are talking about? | 20:46 |
*** jkilpatr has joined #tripleo | 20:46 | |
mwhahaha | gbarros: containers job? | 20:46 |
gbarros | is gate-tripleo-ci-centos-7-ovb-containers-oooq what you mean? | 20:47 |
gbarros | (unfamiliar with the terminology, sry) | 20:47 |
mwhahaha | gate-tripleo-ci-centos-7-containers-multinode | 20:48 |
EmilienM | https://review.openstack.org/#/c/479790/7 | 20:48 |
mwhahaha | is what i'm looking at at the moment | 20:48 |
*** jkilpatr has quit IRC | 20:48 | |
EmilienM | err wrong link | 20:48 |
EmilienM | yeah this ^ | 20:48 |
*** jkilpatr has joined #tripleo | 20:48 | |
mwhahaha | http://logs.openstack.org/42/478842/1/check/gate-tripleo-ci-centos-7-containers-multinode/7b327f0/logs/undercloud/home/jenkins/overcloud_validate.log.txt.gz#_2017-07-10_19_34_41 | 20:48 |
mwhahaha | also failed | 20:48 |
mwhahaha | recently | 20:48 |
mwhahaha | so something is unhappy | 20:48 |
bnemec | Weird. I ran the cistatus page locally and it still doesn't include my adminstate patch. | 20:48 |
bnemec | It does show a number of recent containers job failures, although it's hard to make any definite statements based on the few jobs there. | 20:49 |
EmilienM | mwhahaha: I'm trying to see the root cause | 20:49 |
EmilienM | ie, apache down etc | 20:49 |
gbarros | im seeing a problem in overcloud_prep_images | 20:50 |
mwhahaha | EmilienM: [Errno 113] No route to host | 20:50 |
mwhahaha | EmilienM: would point to something else (ie networking problems) | 20:50 |
*** jprovazn has quit IRC | 20:50 | |
EmilienM | yeah | 20:50 |
*** abishop has quit IRC | 20:50 | |
bnemec | gbarros: When did your job run? It looks like the ovb-containers job was pretty broken until sometime on Friday. | 20:51 |
gbarros | hmm, interesting. my recheck from this morning did not run | 20:51 |
gbarros | https://review.openstack.org/#/c/475045/10 | 20:51 |
bnemec | Maybe we shouldn't have shut off network validation in multinode... :-) | 20:51 |
mwhahaha | ha | 20:51 |
gbarros | and here is only partially run https://review.openstack.org/#/c/475048/ | 20:52 |
bnemec | Oh my, the check-tripleo queue is empty? | 20:52 |
*** d0ugal has quit IRC | 20:52 | |
bnemec | That seems suspicious. | 20:52 |
EmilienM | I don't find docker logs | 20:52 |
EmilienM | for each containersq | 20:52 |
EmilienM | weshay, sshnaidm : do you know where are container logs in http://logs.openstack.org/97/477697/3/gate/gate-tripleo-ci-centos-7-containers-multinode/ec4ab27/logs/ ? | 20:53 |
mwhahaha | gbarros: http://logs.openstack.org/45/475045/10/check-tripleo/gate-tripleo-ci-centos-7-ovb-containers-oooq/5638ea5/logs/undercloud/home/jenkins/overcloud_prep_images.log.txt.gz#_2017-07-06_17_51_05 some mistral problems finding the introspection action | 20:53 |
*** MVenesio has quit IRC | 20:53 | |
bnemec | Ah, looks like a zuul restart is happening/did happen. | 20:53 |
gbarros | mwhahaha forgive my ignorance but is that something broke in the review or CI? | 20:53 |
bnemec | gbarros: I think that was a known bug. You probably just need to recheck. | 20:54 |
gbarros | bnemec yes, recheck sent this morning and it didnt run | 20:54 |
mwhahaha | i don't thikn it's related to your change | 20:54 |
bnemec | gbarros: It may have been in the queue when zuul went down. | 20:54 |
gbarros | i can recheck again to see if it goes through now? | 20:54 |
*** ecerquei has quit IRC | 20:56 | |
EmilienM | mwhahaha: I failed to find container logs - I wonder if they were reachable or something | 20:56 |
bnemec | gbarros: You might want to wait. It sounds like zuul is still coming back up. | 20:56 |
bnemec | The jobs may all get requeued after it's done too. | 20:56 |
bnemec | gbarros: Maybe give it half an hour and if your job still doesn't show up on http://zuul-status.tripleo.org go ahead and recheck. | 20:58 |
gbarros | sounds good, ty | 20:58 |
*** thrash|biab is now known as thrash | 20:59 | |
*** zaneb has quit IRC | 20:59 | |
bnemec | Oh, my job probably isn't showing on cistatus because it failed on the gate step, not the check step. | 20:59 |
bnemec | We should probably fix it so it reports gate jobs too. That's arguably more important since failures there are more painful. | 21:00 |
*** gbarros has quit IRC | 21:01 | |
openstackgerrit | Frank A. Zdarsky proposed openstack/os-net-config master: Add schema-based config data validation https://review.openstack.org/423230 | 21:01 |
* bnemec is starting to have too many windows open again | 21:01 | |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Include gate jobs in the cistatus page https://review.openstack.org/482316 | 21:03 |
bnemec | ^ is why my patch wasn't showing up on cistatus | 21:03 |
bnemec | The last check jobs on that patch were from two weeks ago so they had aged out. | 21:04 |
*** nyechiel has quit IRC | 21:09 | |
*** ooolpbot has joined #tripleo | 21:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1703391 | 21:10 |
openstack | Launchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 21:10 |
*** ooolpbot has quit IRC | 21:10 | |
*** trown is now known as trown|outtypewww | 21:11 | |
*** jkilpatr has quit IRC | 21:17 | |
*** fragatina has quit IRC | 21:18 | |
*** chem has quit IRC | 21:19 | |
*** fragatina has joined #tripleo | 21:19 | |
*** fragatin_ has joined #tripleo | 21:21 | |
openstackgerrit | Oliver Walsh proposed openstack/puppet-tripleo master: Refactor iscsi initiator-name reset into separate profile https://review.openstack.org/482166 | 21:23 |
*** fragatina has quit IRC | 21:25 | |
*** fragatin_ has quit IRC | 21:25 | |
*** fragatina has joined #tripleo | 21:25 | |
*** tzumainn has quit IRC | 21:26 | |
*** oanson has quit IRC | 21:28 | |
weshay | EmilienM, that is really weird | 21:28 |
*** oanson has joined #tripleo | 21:29 | |
weshay | EmilienM, oh.. that is an old job | 21:30 |
weshay | nvrmind | 21:30 |
weshay | should be in /var/log/extra/docker http://logs.openstack.org/50/480950/6/check/gate-tripleo-ci-centos-7-containers-multinode/f452cd1/logs/undercloud/var/log/extra/docker/ | 21:32 |
weshay | EmilienM, and http://logs.openstack.org/50/480950/6/check/gate-tripleo-ci-centos-7-containers-multinode/f452cd1/logs/subnode-2/var/log/containers/ | 21:33 |
weshay | http://logs.openstack.org/50/480950/6/check/gate-tripleo-ci-centos-7-containers-multinode/f452cd1/logs/subnode-2/var/log/extra/docker/containers/ | 21:33 |
*** trozet has quit IRC | 21:33 | |
*** brandor5 has quit IRC | 21:36 | |
*** zzzeek_ has quit IRC | 21:37 | |
*** nyechiel has joined #tripleo | 21:37 | |
*** zzzeek_ has joined #tripleo | 21:40 | |
*** lblanchard has quit IRC | 21:42 | |
*** jmelvin has quit IRC | 21:59 | |
openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras https://review.openstack.org/472607 | 22:00 |
*** dprince has quit IRC | 22:01 | |
*** panda|break is now known as panda | 22:01 | |
*** dparkes has quit IRC | 22:06 | |
*** ebarrera_ has quit IRC | 22:08 | |
*** bvandenh has quit IRC | 22:08 | |
openstackgerrit | Ian Main proposed openstack/tripleo-heat-templates master: Use a single configuration file for specifying docker containers. https://review.openstack.org/478628 | 22:09 |
*** ooolpbot has joined #tripleo | 22:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1703391 | 22:10 |
*** ooolpbot has quit IRC | 22:10 | |
openstack | Launchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 22:10 |
openstackgerrit | Ian Main proposed openstack/tripleo-heat-templates master: Remove DockerNamespace references https://review.openstack.org/479398 | 22:11 |
*** bvandenh has joined #tripleo | 22:13 | |
*** ebarrera has quit IRC | 22:14 | |
*** nyechiel has quit IRC | 22:14 | |
*** gfidente|afk has quit IRC | 22:19 | |
*** deep-book-gk_ has joined #tripleo | 22:19 | |
*** deep-book-gk_ has left #tripleo | 22:20 | |
*** shardy has quit IRC | 22:22 | |
*** lblanchard has joined #tripleo | 22:27 | |
*** zzzeek_ has quit IRC | 22:32 | |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 22:37 |
*** zzzeek_ has joined #tripleo | 22:50 | |
*** atheurer_ has quit IRC | 22:55 | |
*** lblanchard has quit IRC | 22:56 | |
*** atheurer has joined #tripleo | 23:04 | |
*** fragatin_ has joined #tripleo | 23:07 | |
*** jcoufal has quit IRC | 23:09 | |
*** ooolpbot has joined #tripleo | 23:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1703391 | 23:10 |
*** ooolpbot has quit IRC | 23:10 | |
openstack | Launchpad bug 1703391 in tripleo "Containers upgrade job broken by missing all-nodes-validation-disabled.yaml" [Critical,Triaged] - Assigned to Jiří Stránský (jistr) | 23:10 |
*** fragatina has quit IRC | 23:10 | |
*** fragatin_ has quit IRC | 23:14 | |
*** fragatina has joined #tripleo | 23:15 | |
openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates stable/ocata: TEST OCATA DEPLOY https://review.openstack.org/482360 | 23:18 |
openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 23:19 |
*** rhallisey has quit IRC | 23:20 | |
*** zaneb has joined #tripleo | 23:20 | |
*** panda is now known as panda|Zz | 23:20 | |
*** jkilpatr has joined #tripleo | 23:23 | |
*** fandrieu has joined #tripleo | 23:38 | |
*** fandrieu_ has joined #tripleo | 23:40 | |
*** fandrieu has quit IRC | 23:42 | |
*** fandrieu_ is now known as fandrieu | 23:42 | |
*** bkopilov has quit IRC | 23:57 | |
*** oanson has quit IRC | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!