*** betherly has joined #tripleo | 00:03 | |
*** betherly has quit IRC | 00:08 | |
*** bcafarel has quit IRC | 00:09 | |
*** ooolpbot has joined #tripleo | 00:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
---|---|---|
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 00:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 00:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 00:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 00:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 00:10 |
*** ooolpbot has quit IRC | 00:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 00:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 00:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 00:10 |
pvc_ | stevebaker yes im upgrading from queens to rocky | 00:22 |
pvc_ | may i know if you can help me? | 00:22 |
*** betherly has joined #tripleo | 00:23 | |
*** betherly has quit IRC | 00:28 | |
stevebaker | pvc_: yes I think I answered your question already | 00:29 |
pvc_ | may i know if you're familiar with this error | 00:31 |
pvc_ | http://paste.openstack.org/show/732455/ stevebaker | 00:31 |
pvc_ | im running openstack undercloud upgrade --use-heat | 00:31 |
*** beagles has left #tripleo | 00:31 | |
*** beagles has joined #tripleo | 00:31 | |
stevebaker | pvc_: I think you'll need to raise a bug and attach the file /home/stack/undercloud-ansible-X4IwJD/Undercloud/upgrade_tasks.yaml https://bugs.launchpad.net/tripleo/+filebug | 00:35 |
pvc_ | noted on this | 00:37 |
pvc_ | wait | 00:37 |
stevebaker | I'll be back in a bit | 00:41 |
*** lblanchard has joined #tripleo | 00:54 | |
*** ooolpbot has joined #tripleo | 01:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 01:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 01:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 01:10 |
*** ooolpbot has quit IRC | 01:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 01:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 01:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 01:10 |
*** beekneemech has joined #tripleo | 01:17 | |
*** bnemec has quit IRC | 01:19 | |
*** jhebden_ has quit IRC | 01:21 | |
*** mrsoul has quit IRC | 01:25 | |
*** mschuppert has quit IRC | 01:26 | |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: Ensure the needed openshift resources are set https://review.openstack.org/610886 | 01:41 |
openstackgerrit | Merged openstack/python-tripleoclient master: Fix misspelling in deployment complete message. https://review.openstack.org/606134 | 01:41 |
openstackgerrit | Merged openstack/os-net-config master: Replace coremask with cpu_list in vrouter schema https://review.openstack.org/601615 | 01:41 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Revert "Convert *tasks from bootstrap_nodeid to short_bootstrap_node_name" https://review.openstack.org/611518 | 01:53 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: Run online migrations via "external-upgrade run" https://review.openstack.org/611382 | 01:53 |
*** tzumainn has quit IRC | 02:02 | |
*** ooolpbot has joined #tripleo | 02:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 02:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 02:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 02:10 |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 02:10 |
*** ooolpbot has quit IRC | 02:10 | |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 02:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 02:10 |
*** bnemec has joined #tripleo | 02:13 | |
openstackgerrit | Merged openstack/puppet-tripleo stable/queens: Fix ceph-nfs duplicate property https://review.openstack.org/611274 | 02:15 |
*** beekneemech has quit IRC | 02:15 | |
*** beekneemech_ has joined #tripleo | 02:15 | |
*** bnemec has quit IRC | 02:18 | |
*** betherly has joined #tripleo | 02:26 | |
*** bnemec has joined #tripleo | 02:26 | |
*** ec0 has joined #tripleo | 02:27 | |
openstackgerrit | Merged openstack/tripleo-quickstart master: Add ctlplane_masquerade for fs21 failing in ovb for ntp issue https://review.openstack.org/610009 | 02:29 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Use nova_api DB for [placement_database] -> connection https://review.openstack.org/609452 | 02:29 |
*** beekneemech_ has quit IRC | 02:29 | |
openstackgerrit | Andriy Shevchenko proposed openstack/ansible-role-chrony master: Update min tox version to 2.0 https://review.openstack.org/611744 | 02:29 |
*** betherly has quit IRC | 02:30 | |
*** beekneemech has joined #tripleo | 02:31 | |
openstackgerrit | Andriy Shevchenko proposed openstack/ansible-role-container-registry master: Update min tox version to 2.0 https://review.openstack.org/611746 | 02:33 |
*** huynq has joined #tripleo | 02:34 | |
*** bnemec has quit IRC | 02:34 | |
*** saneax has joined #tripleo | 02:42 | |
*** bcafarel has joined #tripleo | 02:45 | |
*** bnemec has joined #tripleo | 02:48 | |
*** rfolco|rucker has quit IRC | 02:50 | |
openstackgerrit | Merged openstack/diskimage-builder master: Move common ubuntu environment setting to ubuntu-common element https://review.openstack.org/563731 | 02:50 |
*** beekneemech has quit IRC | 02:51 | |
*** lblanchard has quit IRC | 02:55 | |
*** betherly has joined #tripleo | 02:56 | |
*** betherly has quit IRC | 03:00 | |
*** phuongnh has joined #tripleo | 03:02 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Remove non-container zaqar-server on upgrade https://review.openstack.org/611541 | 03:08 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Set octavia log directory permissions to octavia user https://review.openstack.org/611207 | 03:08 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: Disable Swift auditors/replicators on undercloud https://review.openstack.org/610909 | 03:08 |
openstackgerrit | Merged openstack/puppet-tripleo stable/queens: Copytruncate containerized logrotate configuration https://review.openstack.org/607510 | 03:08 |
*** ooolpbot has joined #tripleo | 03:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 03:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 03:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 03:10 |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 03:10 |
*** ooolpbot has quit IRC | 03:10 | |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 03:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 03:10 |
*** saneax has quit IRC | 03:19 | |
openstackgerrit | Merged openstack/diskimage-builder master: ubuntu-common: Update default DIB_RELEASE to bionic https://review.openstack.org/603940 | 03:23 |
openstackgerrit | Merged openstack/diskimage-builder master: Allow debootstrap to cleanup without a kernel https://review.openstack.org/604692 | 03:23 |
pvc_ | hi | 03:29 |
pvc_ | how can i reinstall undercloud | 03:29 |
*** betherly has joined #tripleo | 03:47 | |
*** betherly has quit IRC | 03:52 | |
huynq | pvc_ : Are you installing tripleo? | 04:01 |
openstackgerrit | Merged openstack/diskimage-builder master: Fix DIB_DISTRIBUTION_MIRROR_UBUNTU_IGNORE regex typo https://review.openstack.org/611559 | 04:01 |
pvc_ | huynq yes but my upgrade failed i just want to reinstall the undercloud and use rocky by default | 04:06 |
huynq | pvc_ : which version did you install successfully? | 04:10 |
*** ooolpbot has joined #tripleo | 04:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 04:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 04:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 04:10 |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 04:10 |
*** ooolpbot has quit IRC | 04:10 | |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 04:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 04:10 |
*** beekneemech has joined #tripleo | 04:10 | |
pvc_ | im using queens for now and i try to upgrade to rocky | 04:10 |
pvc_ | but failed | 04:10 |
huynq | pvc_ : I'm trying with queens (use quickstart), but failed | 04:10 |
pvc_ | ocata to pike to queens then failed to rocky | 04:10 |
huynq | pvc_: so, you have installed successfully with queens? Do you use quickstart? | 04:11 |
*** bnemec has quit IRC | 04:13 | |
*** phuongnh has quit IRC | 04:20 | |
*** jaosorior has joined #tripleo | 04:24 | |
*** bnemec has joined #tripleo | 04:45 | |
*** beekneemech has quit IRC | 04:48 | |
jaosorior | Good morning! | 04:49 |
*** bnemec has quit IRC | 04:51 | |
*** bnemec has joined #tripleo | 04:51 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Add sample designate environment for ha https://review.openstack.org/584026 | 04:52 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Apply variable to task not the block https://review.openstack.org/611588 | 04:52 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/rocky: check mode: docker_puppet https://review.openstack.org/611336 | 04:54 |
openstackgerrit | Merged openstack/tripleo-common stable/rocky: Set workflow status to success when manipulating deployment status https://review.openstack.org/611152 | 04:54 |
openstackgerrit | Merged openstack/python-tripleoclient stable/rocky: Update deployment status when deploying or failed https://review.openstack.org/611154 | 04:54 |
openstackgerrit | Merged openstack/python-tripleoclient stable/rocky: Disable SSH password authentication during tripleo-admin enablement. https://review.openstack.org/609021 | 04:54 |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/queens: Don't run host_prep_tasks from {{role}}HostPrepDeployment https://review.openstack.org/589522 | 04:54 |
jaosorior | holy crap, the gate is quite packed. | 04:59 |
jaosorior | marios: how's CI been this week? :D | 04:59 |
*** beekneemech has joined #tripleo | 05:03 | |
Tengu | hello there :) | 05:05 |
Tengu | jaosorior: heyyyy welcome back :) | 05:05 |
jaosorior | thanks! | 05:06 |
*** bnemec has quit IRC | 05:06 | |
Tengu | jaosorior: hey, an easy review for your come back: https://review.openstack.org/#/c/611302/ :D | 05:07 |
*** ooolpbot has joined #tripleo | 05:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 05:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 05:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 05:10 |
*** ooolpbot has quit IRC | 05:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 05:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 05:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 05:10 |
*** andreaf has quit IRC | 05:10 | |
*** zaneb has quit IRC | 05:15 | |
*** andreaf has joined #tripleo | 05:15 | |
*** rlandy has quit IRC | 05:17 | |
*** zaneb has joined #tripleo | 05:19 | |
*** iranzo has joined #tripleo | 05:32 | |
*** quiquell|off is now known as quiquell | 05:36 | |
openstackgerrit | zhulingjie proposed openstack/tripleo-quickstart master: Make the playbook's yaml file start with "---" https://review.openstack.org/611779 | 05:43 |
*** apetrich has joined #tripleo | 05:47 | |
*** jfrancoa has joined #tripleo | 05:51 | |
openstackgerrit | zhulingjie proposed openstack/tripleo-quickstart master: Make the playbook's yaml file start with "---" https://review.openstack.org/611779 | 05:52 |
*** aufi has joined #tripleo | 05:57 | |
*** jtomasek has quit IRC | 05:58 | |
openstackgerrit | Tobias Henkel proposed openstack/diskimage-builder master: Also get DIB_IMAGE_SIZE variable from block-device phase https://review.openstack.org/611780 | 05:58 |
openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: Adjust templating for upgrade scripts. https://review.openstack.org/583917 | 06:02 |
*** jtomasek has joined #tripleo | 06:04 | |
*** ooolpbot has joined #tripleo | 06:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 06:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 06:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 06:10 |
*** ooolpbot has quit IRC | 06:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 06:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 06:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 06:10 |
*** pcaruana has joined #tripleo | 06:14 | |
*** ksambor has joined #tripleo | 06:15 | |
*** mschuppert has joined #tripleo | 06:17 | |
pvc_ | hi | 06:29 |
pvc_ | may i know what will i do if i want to install undercloud as rocky? | 06:29 |
jaosorior | pvc_: the docs mention how to set up the specific release http://tripleo.org/install/installation/installation.html | 06:31 |
*** jaosorior has quit IRC | 06:32 | |
*** jaosorior has joined #tripleo | 06:34 | |
openstackgerrit | Thomas Herve proposed openstack/tripleo-heat-templates stable/rocky: Remove non-container zaqar-server on upgrade https://review.openstack.org/611784 | 06:37 |
pvc_ | i use tripleo-repos -b rocky | 06:37 |
pvc_ | jaosorior | 06:37 |
Tengu | jaosorior: hey, small news/info: podman+standalone ♥ selinux :D | 06:39 |
jaosorior | Tengu: saw EmilienM, nice work! | 06:39 |
*** holser_ has joined #tripleo | 06:40 | |
Tengu | jaosorior: not only deploy :). Tempest is happily running against the standalone «o/ | 06:41 |
Tengu | jaosorior: so I'm aready a foot in the overcloud deploy, with that standalone :). I'll dig further. | 06:44 |
*** gfidente has joined #tripleo | 06:45 | |
*** ccamacho has joined #tripleo | 06:45 | |
jaosorior | Tengu: nice! Let me know how that goes | 06:47 |
Tengu | jaosorior: I just git checkout -b podman/overcloud :). | 06:47 |
jaosorior | bandini: hey! any progress on the deep_compare issue https://review.openstack.org/#/c/609998/ ? | 06:48 |
bandini | jaosorior: no. I have three other blockers I am being pushed around with | 06:49 |
bandini | I have a plan but it will be a bit of work | 06:49 |
jaosorior | bandini: anything you need help with? | 06:49 |
bandini | well right now I am on https://bugzilla.redhat.com/show_bug.cgi?id=1638398 | 06:51 |
openstack | bugzilla.redhat.com bug 1638398 in openstack-tripleo "overcloud nodes have incorrect hostname - OC deploy fails on pacemaker/corosync" [High,New] - Assigned to jslagle | 06:51 |
openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Add fedora28 standalone non-voting job definition https://review.openstack.org/611636 | 06:54 |
openstackgerrit | Yurii Prokulevych proposed openstack/tripleo-upgrade master: Add ContainerImagePrepare to custom roles_data https://review.openstack.org/611788 | 06:58 |
quiquell | jaosorior: +w to put undercloud-upgrade back at gates https://review.openstack.org/#/c/611526/ | 06:59 |
quiquell | bandini, Tengu: ^ | 07:01 |
Tengu | erfff..... fluentd container wants to get read-write access to the host /etc/rsyslog.d ...... | 07:04 |
Tengu | what about "Nope" ? | 07:04 |
*** cylopez has joined #tripleo | 07:07 | |
*** pcaruana has quit IRC | 07:09 | |
*** shardy has joined #tripleo | 07:10 | |
*** ooolpbot has joined #tripleo | 07:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 07:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 07:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 07:10 |
*** ooolpbot has quit IRC | 07:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 07:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 07:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 07:10 |
Tengu | quiquell: stop merging things, that's the best way to prevent gate issues :D | 07:11 |
* Tengu runs away | 07:11 | |
quiquell | Tengu: then let's have a noop job that passes there | 07:11 |
*** rcernin has quit IRC | 07:17 | |
openstackgerrit | Kamil Sambor proposed openstack/tripleo-heat-templates stable/queens: Allow setting physical network MTU via heat template https://review.openstack.org/611794 | 07:20 |
*** pcaruana has joined #tripleo | 07:28 | |
openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: WIP: Run reproducer at zuulv3 workflow https://review.openstack.org/606881 | 07:29 |
jistr | quiquell, marios, panda, sshnaidm: hi folks, can you review these two please? https://review.openstack.org/606996/ https://review.openstack.org/611601/ | 07:30 |
*** pcaruana is now known as pcaruana|elisa| | 07:30 | |
pvc_ | hi anyone im stacking on step 3 | 07:30 |
pvc_ | TASK [Start containers for step 3] *********. | 07:30 |
quiquell | jistr: Have them at my queue | 07:30 |
jistr | chem: i think your patch is good, i just wonder about the value for newest -- "current" vs "delorean-current". I think we are using the latter currently (posted a link in the review). | 07:30 |
jistr | chem: i actually don't know what's the difference between them | 07:31 |
jistr | quiquell: thanks | 07:31 |
Tengu | pvc_: hello. when I got this behavior, it was due to a failed container, namely "haproxy". Care to check the state on your deploy? docker ps -a will show you all the containers, and I bet at least one is in "Exited (non-0 value)" | 07:31 |
pvc_ | hi chem are you familiar why im stack on TASK [Start containers for step 3] ********* | 07:31 |
pvc_ | noted on this Tengu | 07:31 |
Tengu | step 3 has some DB sync, and if haproxy is crashed, there's no DB access, and it can hold on that. | 07:32 |
*** slaweq has quit IRC | 07:32 | |
*** slaweq has joined #tripleo | 07:33 | |
pvc_ | haproxy is up and running | 07:34 |
Tengu | any other non-0 container ? | 07:34 |
pvc_ | yes many non-0 container | 07:34 |
Tengu | so check `docker logs <container-id>' | 07:34 |
pvc_ | keepalived is restarting | 07:35 |
Tengu | bandini: -^^ :) | 07:35 |
pvc_ | Tengu | 07:36 |
pvc_ | why mysql host IP is not set on my local ip? | 07:36 |
*** tosky has joined #tripleo | 07:36 | |
Tengu | pvc_: mysql server listen on an internal IP, on a specific port, and haproxy is used as an entry point - your mysql clients should hence point to the haproxy container IP | 07:37 |
Tengu | this is due to the fact mysql is in a cluster mode (with galera), and haproxy plays the load-balancer. | 07:37 |
pvc_ | i need to change this on my local ip? undercloud_admin_host | 07:37 |
Tengu | shouldn't be necessary. | 07:37 |
pvc_ | OperationalError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.168.24.3' (timed out)") (Background on this error at: http://sqlalche.me/e/e3q8) | 07:37 |
Tengu | well, I bet the .3 IP is the one of the haproxy container. if keepalived is restarting, it might create some network issue as it manages the VIP, among other things. | 07:38 |
Tengu | VIP being attached to the haproxy container.... | 07:38 |
pvc_ | Wait i'll check the haproxy container | 07:39 |
Tengu | and used by the services for, at least, connect to mysql and other API things. | 07:39 |
*** bogdando has joined #tripleo | 07:39 | |
Tengu | pvc_: if it's running, I'd say "not there" - more the other containers exited as non-0, and digg why keepalived is restarting. | 07:39 |
pvc_ | Here Tengu http://paste.openstack.org/show/732469/ | 07:40 |
pvc_ | other exited container doesnt have logs | 07:40 |
pvc_ | just for the mistral that cannot connect to the database | 07:41 |
Tengu | bandini: any idea on that one? http://paste.openstack.org/show/732469/ keepalived container restarting with this log. | 07:41 |
pvc_ | WARNING - default user 'keepalived_script' for script execution does not exist - please create. | 07:42 |
bandini | Tengu: no idea, seems the config is wrong/malformed | 07:43 |
pvc_ | Status just changing to Up and restarting | 07:44 |
Tengu | pvc_: well, if the config is wrong as bandini just said, no surprise there. | 07:44 |
pvc_ | i didnt change any config tengu | 07:44 |
Tengu | what version are you deploying? | 07:45 |
pvc_ | im using rocky | 07:45 |
quiquell | jistr: Bout standalone upgrade review | 07:46 |
quiquell | jistr: If we merge this https://review.openstack.org/#/c/585649/ | 07:46 |
Tengu | pvc_: weird... didn't get that one while playing with the deploy.. | 07:47 |
quiquell | jistr: We will be able to remove stuff regarding hash names from releases files | 07:47 |
pvc_ | it is okay not to change to this to my ip address? undercloud_admin_host | 07:49 |
jistr | quiquell: oh but are we completely missing UNDERCLOUD_DEPLOY_NEWEST_HASH in emit_releases.py then? I think that by switching to emit_releases.py we'll drop delorean-current from baremetal | 07:49 |
jistr | marios, sshnaidm, panda ^ | 07:50 |
jistr | quiquell: we probably need to add that to emit_releases before we can switch all jobs to it | 07:50 |
quiquell | jistr: ack | 07:50 |
*** rdopiera has joined #tripleo | 07:51 | |
jistr | (same for OVERCLOUD_ | 07:51 |
jistr | ) | 07:51 |
*** jbadiapa has quit IRC | 07:53 | |
pvc_ | you think this is because of keepalvied Tengu? Step 3 deployment is not taking much logn right? | 07:53 |
marios | jistr: thanks | 07:57 |
pvc_ | sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '192.168.24.3' (timed out)") (Background on this error at: http://sqlalche.me/e/e3q8) | 08:00 |
openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO https://review.openstack.org/567224 | 08:00 |
openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO https://review.openstack.org/604298 | 08:00 |
Tengu | pvc_: as said: if for some reason keepalived isn't working properly, step 3 won't go further. | 08:00 |
openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates stable/rocky: GATE CHECK for TripleO https://review.openstack.org/604293 | 08:00 |
pvc_ | it cannot connect to this IP 192.168.24.3 | 08:00 |
pvc_ | undercloud_admin_host = 192.168.24.3 | 08:00 |
pvc_ | the sync | 08:00 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-quickstart-extras master: OVB job's need to masquerade 10.0.0.0/24 https://review.openstack.org/609830 | 08:01 |
pvc_ | is this IP for keepalived? 192.178.24.3 | 08:02 |
openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Revert "Revert "Convert *tasks from bootstrap_nodeid to short_bootstrap_node_name"" https://review.openstack.org/611800 | 08:02 |
jistr | quiquell, marios, sshnaidm, panda: so we can probably start by merging chem's patch and then add the UNDERCLOUD_* and OVERCLOUD_* bits | 08:02 |
openstackgerrit | Merged openstack/python-tripleoclient master: Honor blacklist during temp key injection https://review.openstack.org/610104 | 08:07 |
openstackgerrit | Bogdan Dobrelya proposed openstack/puppet-tripleo stable/pike: Copytruncate containerized logrotate configuration https://review.openstack.org/607512 | 08:07 |
pvc_ | http://paste.openstack.org/show/732472/ anyone can help me why keepalived is restarting | 08:08 |
openstackgerrit | Bogdan Dobrelya proposed openstack/paunch master: Add missing default-runtime support bits https://review.openstack.org/608632 | 08:08 |
*** jbadiapa has joined #tripleo | 08:08 | |
*** ooolpbot has joined #tripleo | 08:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 08:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 08:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 08:10 |
*** ooolpbot has quit IRC | 08:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 08:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 08:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 08:10 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-quickstart-extras master: [WiP] - OVB - external network masquerading https://review.openstack.org/609830 | 08:10 |
openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Adapt reproducer to new workflow https://review.openstack.org/606879 | 08:12 |
openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-heat-templates master: Set setype for log and persistant data directories https://review.openstack.org/611801 | 08:15 |
Tengu | jaosorior: -^^ | 08:16 |
* Tengu can die now | 08:16 | |
openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Switch default neutron ML2 mechanism driver to OVN https://review.openstack.org/593056 | 08:16 |
openstackgerrit | Sorin Sbarnea proposed openstack-infra/tripleo-ci master: Add fedora28 standalone non-voting job definition https://review.openstack.org/611636 | 08:16 |
jaosorior | Tengu: why did you disable labeling for fluentd? | 08:17 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Add stack output ansible_group_vars https://review.openstack.org/596427 | 08:17 |
openstackgerrit | Merged openstack/tripleo-common master: Add ansible_group_vars to config download https://review.openstack.org/596429 | 08:17 |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Enable use of python3 and dnf https://review.openstack.org/610018 | 08:17 |
Tengu | jaosorior: because that nasty boy wants to write in /etc/rsyslog.d | 08:17 |
jaosorior | got it | 08:17 |
Tengu | at least it mounts that volume rw... | 08:17 |
jaosorior | Tengu: and why is /var/lib/ironic mounted as shared? | 08:18 |
*** jbadiapa has quit IRC | 08:18 | |
Tengu | jaosorior: it was already mounted as shared from other containers - I also took the opportunity to make it more consistent. | 08:19 |
jaosorior | ok | 08:19 |
Tengu | i.e. nova and ironic seem to access this volume | 08:19 |
Tengu | I guess it's "only" for the undercloud, but still.... | 08:19 |
pvc_ | Tengu cat: /var/lib/kolla/config_files/src/etc/keepalived/keepalived.conf: No such file or directory | 08:20 |
pvc_ | bash: cd: /var/lib/kolla/config_files/src/: No such file or directory | 08:20 |
Tengu | pvc_: it's a volume in the container. the "host" path is somewhere else, you might want to `docker inspect keepalived | less' | 08:20 |
Tengu | it will show you the different volumes. | 08:21 |
pvc_ | noted on this wait | 08:21 |
jaosorior | Tengu: and you tested that with the undercloud or the overcloud? | 08:21 |
Tengu | jaosorior: for now, no test. Just dumped that, have to wait a bit before running an overcloud. | 08:21 |
Tengu | jaosorior: just put a w-1 on my own for now. | 08:22 |
pvc_ | i dont know why keepalvied is restarting :( | 08:22 |
Tengu | I'm pretty sure I'll need some more work on that patch ;). One can't simply enter SELinux. | 08:22 |
jaosorior | Tengu: sure, I retracted the +2 in favor of a +1 while you test. | 08:22 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - data + env (1/3) https://review.openstack.org/582180 | 08:23 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - network.j2 (2/3) https://review.openstack.org/582181 | 08:23 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Replace tripleo_common/utils/roles.py validate_role_yaml() https://review.openstack.org/608471 | 08:23 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - subnet fixed_ips (3/3) https://review.openstack.org/582301 | 08:23 |
*** huynq has quit IRC | 08:24 | |
jaosorior | hjensas: how far is that work? ^^ | 08:25 |
*** derekh has joined #tripleo | 08:26 | |
hjensas | jaosorior: I have been working with benemec to get support in OVB to test it. So, the code is there. But needs testing. | 08:27 |
jaosorior | hjensas: so, with that we can get segmented networks for the internal API and storage networks? | 08:28 |
hjensas | jaosorior: yes | 08:28 |
jaosorior | that's pretty cool | 08:29 |
jaosorior | I'll add myself to those reviewx | 08:29 |
*** akrivoka has quit IRC | 08:29 | |
hjensas | jaosorior: good thing you mentioned storage net, I need to update the code to pass the list of CIDR's to ceph. | 08:29 |
gfidente | guys, someone to merge a backport? https://review.openstack.org/#/c/608300/ | 08:29 |
gfidente | remove ceph-ansible from the mistral container | 08:30 |
*** akrivoka has joined #tripleo | 08:30 | |
hjensas | jaosorior: thanks! | 08:30 |
pvc_ | Tengu http://paste.openstack.org/show/732474/ | 08:31 |
openstackgerrit | Jiri Stransky proposed openstack/python-tripleoclient master: Stop using deprecated docker.yaml https://review.openstack.org/611805 | 08:32 |
Tengu | pvc_: that's probably not the full log... | 08:33 |
Tengu | the "warning" for hiera isn't important. | 08:34 |
pvc_ | i change the admin_host to my ip and the step start 3 continue | 08:34 |
Tengu | yeah, but you pasted a failure for the undercloud, and it's not complete. | 08:35 |
openstackgerrit | Tobias Henkel proposed openstack/diskimage-builder master: Add a post-root.d phase https://review.openstack.org/611806 | 08:35 |
pvc_ | ProgrammingError: (pymysql.err.ProgrammingError) (1146, u\"Table 'nova_api.cell_mappings' doesn't exist\") [SQL: u'INSERT INTO cell_mappings (created_at, updated_at, uuid, name, transport_url, database_connection, disabled) VALUES (%(created_at)s, %(updated_at)s, %(uuid)s, %(name)s, %(transport_url)s, %(database_connection)s, %(disabled)s)'] [parameters: {'database_connection': u'mysql+pymysql://nova:D6ZTpyHjsw6QXah6oA9Iw2TzM@10.178.86 | 08:35 |
*** jbadiapa has joined #tripleo | 08:36 | |
pvc_ | Tengu http://paste.openstack.org/show/732475/ | 08:36 |
Tengu | without any context, can't say anything...... | 08:36 |
Tengu | anyway, have to flee. | 08:36 |
jaosorior | hjensas: let me know when you need some reviews and I can start checking them out. | 08:43 |
openstackgerrit | Sorin Sbarnea proposed openstack-infra/tripleo-ci master: Add fedora28 standalone non-voting job definition https://review.openstack.org/611636 | 08:44 |
quiquell | jaosorior: We are adding a non voting job to start working at standalone + f28, can you help us merge it ? https://review.openstack.org/#/c/611636/ | 08:46 |
quiquell | jaosorior: We want ot merge it failing, to start working, without the dependency on it | 08:46 |
ssbarnea | bogdando: ^^ or maybe you can help with f28 one? | 08:46 |
jaosorior | quiquell: done | 08:47 |
ssbarnea | thanks! | 08:47 |
quiquell | jaosorior: thanks mate | 08:47 |
quiquell | ssbarnea: we have it | 08:47 |
quiquell | :-) | 08:47 |
*** salmankhan has joined #tripleo | 08:51 | |
naturalblue | Morning everyone. Can someone help me out with a tripleo UI issue. I am having. | 08:57 |
*** paramite has joined #tripleo | 09:03 | |
*** gfidente is now known as gfidente|giulivo | 09:07 | |
*** eponymos has joined #tripleo | 09:09 | |
*** ooolpbot has joined #tripleo | 09:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 09:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 09:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 09:10 |
*** ooolpbot has quit IRC | 09:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 09:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 09:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 09:10 |
*** eponymos has quit IRC | 09:12 | |
*** yprokule has joined #tripleo | 09:15 | |
*** huynq has joined #tripleo | 09:18 | |
*** huynq has quit IRC | 09:22 | |
*** quiquell is now known as quiquell|bbl | 09:30 | |
*** quiquell|bbl has quit IRC | 09:30 | |
*** huynq has joined #tripleo | 09:31 | |
openstackgerrit | Marios Andreou proposed openstack/tripleo-docs master: Fix links to sova and add grafana in promoter stages overview https://review.openstack.org/611820 | 09:35 |
*** huynq_ has joined #tripleo | 09:36 | |
ssbarnea | jaosorior: another f28 one that can go https://review.openstack.org/#/c/610491/ | 09:39 |
ssbarnea | i am sure there will be many more | 09:40 |
hjensas | any CI people around? afaict we have variables set when deploying ovb undercloud, what do I have to do to get those defined so they can be used in role/undercloud-deploy when building undercloud.conf? (see: https://review.openstack.org/609830) | 09:53 |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-heat-templates master: Add tempest workspace volume for tempest https://review.openstack.org/605980 | 10:06 |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Enable full tempest api and scenario tests for basic services https://review.openstack.org/606046 | 10:06 |
*** quiquell has joined #tripleo | 10:10 | |
*** ooolpbot has joined #tripleo | 10:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 10:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 10:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 10:10 |
*** ooolpbot has quit IRC | 10:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 10:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 10:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 10:10 |
*** sambetts|afk is now known as sambetts | 10:14 | |
openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: Ensure correct tmp ownership for Gnocchi https://review.openstack.org/611827 | 10:15 |
sambetts | ping is there anyone around to answer some questions about tripleo FFU, I'm running into some issues | 10:18 |
*** rfolco|rucker has joined #tripleo | 10:18 | |
*** iurygregory is now known as iurygregory|lunc | 10:19 | |
*** iurygregory|lunc is now known as iury|lunch | 10:19 | |
*** morazi has quit IRC | 10:23 | |
openstackgerrit | Sorin Sbarnea proposed openstack-infra/tripleo-ci master: Avoids sort: write failed: standard output: Broken pipe with du https://review.openstack.org/609413 | 10:24 |
*** huynq has quit IRC | 10:32 | |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/ocata: [Ocata/Pike] Pass DeployIdentifier in upgrade tasks. https://review.openstack.org/611834 | 10:32 |
chkumar|off | Tengu: hello | 10:33 |
Tengu | chkumar|off: hey :) | 10:34 |
chkumar|off | Tengu: regarding no floating ip issue on tempest standalone https://review.openstack.org/608939 | 10:34 |
chkumar|off | Tengu: It will fix it | 10:34 |
Tengu | chkumar|off: \o/ thanks! | 10:34 |
chkumar|off | Tengu: regarding poadman tempest update, did we used podman or docker to run tempest? | 10:35 |
Tengu | chkumar|off: ah, for quickstart "only". ok. I'll add the requested option to my code then. | 10:35 |
Tengu | chkumar|off: so for now I've used tempest package to run against the podman deployed standalone | 10:36 |
chkumar|off | Tengu: https://review.openstack.org/#/q/topic:tempest_podman+(status:open+OR+status:merged) | 10:36 |
chkumar|off | Tengu: feel free to reuse it | 10:36 |
Tengu | oh, even better :) | 10:36 |
quiquell | Sofer have reviewed the standalone upgrade | 10:36 |
Tengu | chkumar|off: so for now I did not use containerized tempest. | 10:36 |
chkumar|off | Tengu: Today is holiday here, so I will go again go to sleep, will see stuff tomororw or on monday :-) | 10:37 |
chkumar|off | Tengu: stnadalone is using package format | 10:37 |
Tengu | chkumar|off: no problem ;). see you on Monday, and take a good rest :) | 10:37 |
chkumar|off | Tengu: Here https://review.openstack.org/606046 is running full tempest | 10:37 |
chkumar|off | it will pass this time | 10:37 |
chkumar|off | see ya | 10:37 |
*** paramite has quit IRC | 10:40 | |
*** dtantsur|afk is now known as dtantsur | 10:43 | |
openstackgerrit | Marios Andreou proposed openstack/tripleo-docs master: Fix links to sova and add grafana in promoter stages overview https://review.openstack.org/611820 | 10:43 |
openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-heat-templates master: Set setype for log and persistant data directories https://review.openstack.org/611801 | 10:45 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/ocata: [Ocata/Pike] Pass DeployIdentifier in upgrade tasks. https://review.openstack.org/611834 | 10:49 |
openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci master: Reduce unit testing changes required for emit_releases_file https://review.openstack.org/611842 | 10:51 |
jistr | this might come in handy as we add the undercloud_ and overcloud_ delorean-current bits | 10:53 |
jistr | https://review.openstack.org/#/c/611842 | 10:53 |
jistr | chem FYI ^ | 10:53 |
quiquell | Jistr we can mock the list of releases | 10:57 |
quiquell | So we dont have to test new releases | 10:57 |
quiquell | Names | 10:57 |
Tengu | o_O weird... I get a stuck undercloud deploy at "** Performing Heat stack create.. **" | 10:58 |
Tengu | I thought that one was solved/merged...... | 10:58 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Fix Module did not set no_log for influxdb_password https://review.openstack.org/611844 | 10:58 |
quiquell | Jistr it will also simplify tests | 10:59 |
jaosorior | Tengu: I thought that too. Is it stuck waiting for a notification? | 11:00 |
sambetts | is there anyone around to answer some questions about tripleo FFU, I'm running into some issues?? | 11:01 |
Tengu | jaosorior: wait, maybe I have some not-up-to-date mirror. | 11:01 |
Tengu | jaosorior: trying with the proxy instead of local mirrors. | 11:01 |
jistr | quiquell: i'm not 100% sure what you mean, but if it will be better solution than the above and still reduce the typing we need to do comparably, i'm all for it :) | 11:01 |
openstackgerrit | Merged openstack/python-tripleoclient master: Fix defaults to templates, roles-file and plan-environment https://review.openstack.org/611189 | 11:02 |
naturalblue | I have installed the undercloud 3 times and done the overcloud image build and upload. when I try to import any nodes I get http 503 error resource termporarily unavailable | 11:04 |
quiquell | Jistr will try to put a review, doing all permutations for all the reviews is too black box testing | 11:04 |
naturalblue | it worked fine last week. Has there been any updates that may have caused this | 11:04 |
jistr | quiquell: ack thanks | 11:04 |
quiquell | Jistr also what did you say about merging stuff before this ? | 11:05 |
jistr | quiquell: that i want to merge this one soon if possible https://review.openstack.org/#/c/606996/ | 11:05 |
jistr | and then we can pile on the undercloud_ overcloud_ dlrn-current repo changes too | 11:06 |
jistr | after we make the unit tests saner | 11:06 |
jistr | quiquell: i get what you mean by mocking releases now... i'm not sure if i'd do that though. The fewer mocking the better IMO :) | 11:06 |
quiquell | And remov the featuresers if statement | 11:06 |
jistr | but perhaps that's just my personal approach to unit testing | 11:07 |
jistr | i've been schooled by tests with too many mocks, which were happily passing, but the real code was broken | 11:07 |
quiquell | Jistr less mock more black boxing | 11:07 |
*** naturalblue has quit IRC | 11:07 | |
jistr | quiquell: yes but also less real testing :) | 11:07 |
quiquell | Jistr yep, will t | 11:07 |
jistr | more mocks == more testing of tests, less testing of real code | 11:08 |
*** naturalblue has joined #tripleo | 11:08 | |
chem | jistr: quiquell having coverage stats would help here | 11:08 |
quiquell | Jisrt really true | 11:08 |
naturalblue | :) | 11:08 |
quiquell | I miss not | 11:08 |
quiquell | Not really true | 11:08 |
openstackgerrit | Christian Schwede proposed openstack/tripleo-heat-templates master: Change Swift storage directory to /srv/node/d1 https://review.openstack.org/611309 | 11:08 |
quiquell | The problem with mocks is thar you need to know the logic | 11:08 |
naturalblue | i should mention the version I am trying is rocky | 11:09 |
chem | quiquell: jistr well if we add a lot of very small doing only a few things then we could unit test them in separation and mock them when there are called | 11:09 |
*** ooolpbot has joined #tripleo | 11:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 11:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 11:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 11:10 |
*** ooolpbot has quit IRC | 11:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 11:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 11:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 11:10 |
chem | quiquell: jistr I found that hard to refactor tests are the symptome of too big function | 11:10 |
quiquell | Chem yep, test grow is abour permutarions bigger functions bigger permutations | 11:12 |
chem | quiquell: jistr I had a linter that told me to go to hell when my function was more than ~15 loc :) Make you think more about your design | 11:13 |
jistr | chem, quiquell: ack, i don't fully agree but i won't block anything, after all it's repo mainly maintained by other folks. This would be a really interesting discussion for a call or in person i think, IRC is too cumbersome. E.g. in static languages like Rust you can't do any mocks at all (dynamic "surgery" on code at runtime is not an option) and it's possible to unit test too, and IMO the resulting unit | 11:14 |
quiquell | Chem then ooo can go to hell hehe | 11:14 |
jistr | tests are much better. Just my 2 cents though :) | 11:14 |
*** iury|lunch is now known as iurygregory | 11:14 | |
quiquell | Jiste is another tool | 11:14 |
jistr | chem: +1 on the "too big function" | 11:14 |
jistr | that's how i'd do it, make a smaller function and test in/out rather than mocking internals | 11:15 |
chem | quiquell: well I don't think you win the longest function contest | 11:15 |
chem | quiquell: there are other serious contender around :) | 11:15 |
chem | jistr: rigth | 11:15 |
quiquell | Chem I agree with you | 11:15 |
quiquell | Big functions sux | 11:15 |
Tengu | jaosorior: erf..... apparently, it wasn't my mirror -.-. | 11:16 |
quiquell | Jisrt we can put a code coverage thing and check your review | 11:16 |
quiquell | If we get enough coveragw we are good | 11:16 |
*** aufi has quit IRC | 11:17 | |
jistr | quiquell: ack that would be nice. I'm not too familiar with Python tooling around coverage so i'm probably not the best person to implement that, but i like the idea. | 11:17 |
Tengu | damn, it's actually running - heat-launcher produces logs.... but we don't see anything in the main install log. | 11:18 |
Tengu | that's creepy. | 11:18 |
quiquell | Jistr can I change your review ro add it to tox? | 11:18 |
jistr | quiquell: sure | 11:18 |
quiquell | So we see it from the same place | 11:18 |
quiquell | Cool | 11:18 |
quiquell | We can even enforce coverage by failing | 11:19 |
quiquell | Of someone remove testing it fails | 11:19 |
*** quiquell has quit IRC | 11:23 | |
*** quiquell has joined #tripleo | 11:23 | |
*** hjensas has quit IRC | 11:32 | |
*** huynq_ has quit IRC | 11:32 | |
naturalblue | tripleo will not import any nodes and I cannot find any info on the issue | 11:34 |
openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Adapt reproducer to new workflow https://review.openstack.org/606879 | 11:34 |
openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Adapt reproducer to new workflow https://review.openstack.org/606879 | 11:37 |
openstackgerrit | Thomas Herve proposed openstack-infra/tripleo-ci master: Install ncat in toci_gate_test.sh https://review.openstack.org/611850 | 11:37 |
openstackgerrit | Merged openstack/tripleo-common master: Add tht to mistral_executor (for plan create) https://review.openstack.org/553982 | 11:38 |
jistr | naturalblue: sorry i haven't hit that, but 503 sounds like what haproxy would give if the backend is down | 11:38 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Fix runtime Ansible warnigns https://review.openstack.org/611844 | 11:39 |
jistr | naturalblue: so i think next step would be figuring out which service is down | 11:40 |
naturalblue | jistr: i will try to see if th ironic container is down. This only happened when since I tred to get tripleo_ui working. it installs but appears on the provision NIC instead of the MGMT NIC, even with SSL set to being enabled. ALso hiera gives back a nil reply for the admin password. weird. | 11:41 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Fix runtime Ansible warnings https://review.openstack.org/611844 | 11:43 |
openstackgerrit | Dmitry Tantsur proposed openstack/diskimage-builder master: Add an element to configure iBFT network interfaces https://review.openstack.org/391787 | 11:43 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Fix runtime Ansible warnings https://review.openstack.org/611853 | 11:43 |
naturalblue | jistr: lookng at docker it appears the ironic-conductor container is in a restarting state. i will attempt a stop and start | 11:43 |
*** morazi has joined #tripleo | 11:48 | |
openstackgerrit | Quique Llorente proposed openstack-infra/tripleo-ci master: Reduce unit testing changes required for emit_releases_file https://review.openstack.org/611842 | 11:50 |
quiquell | jistr: ^coverage | 11:50 |
*** iurygregory has quit IRC | 11:51 | |
quiquell | jistr: 85% with your stuff | 11:51 |
jistr | quiquell: thanks for the edit, nice | 11:51 |
jistr | what about w/o my stuff :) | 11:51 |
quiquell | jistr: doing now | 11:52 |
quiquell | jistr: comparing with parent | 11:52 |
* jistr hoping for 85% too :)) | 11:53 | |
*** panda is now known as panda|lunch | 11:53 | |
quiquell | jistr: Samge coverage | 11:53 |
quiquell | jistr: I think you can configure it to give you a report of the missing code | 11:54 |
quiquell | jistr: I mean the 25% not exercises | 11:54 |
jistr | quiquell: good, yea i thought it would be the same. The automatic tools can only measure syntactic coverage, not semantic. | 11:54 |
openstackgerrit | James Slagle proposed openstack/python-tripleoclient stable/rocky: Honor blacklist during temp key injection https://review.openstack.org/611855 | 11:57 |
*** EmilienM is now known as EvilienM | 11:58 | |
slagle | bogdando: could you review https://review.openstack.org/#/c/603254/? | 12:00 |
yolanda | hi, good afternoon. Is there any issue with tripleo ci? i'm looking at gate queue... i see some patches there for 14 hours... mine has been there for 7 hours | 12:01 |
naturalblue | jistr: when i try to import node the ironic_conductor container reboots | 12:04 |
openstackgerrit | Quique Llorente proposed openstack/tripleo-quickstart-extras master: WIP: Adapt reproducer to new workflow https://review.openstack.org/606879 | 12:05 |
Tengu | jaosorior: yeah, so it was just running fine without any feedback: The Undercloud has been successfully installed. | 12:05 |
quiquell | yolanda: We have timeouts | 12:06 |
naturalblue | when you are enablng ssl on the undercloud do you have to set undercloud_public_vip to the hostname rather than IP | 12:06 |
quiquell | yolanda: Undercloud is taking 2 hours sometimes | 12:06 |
quiquell | rfolco|rucker: ^ | 12:06 |
*** sshnaidm is now known as sshnaidm|off | 12:06 | |
*** abishop has joined #tripleo | 12:06 | |
yolanda | quiquell,for deploying undercloud? | 12:06 |
quiquell | yolanda: "undercloud-deploy : Install the undercloud" | 12:07 |
jaosorior | naturalblue: you can do that, but not necessarily. | 12:07 |
yolanda | quiquell ok, thanks for the info... so i'll wait, no rechecks | 12:07 |
quiquell | yolanda: http://logs.openstack.org/68/583868/25/check/tripleo-ci-centos-7-undercloud-containers/60dc92e/ for example | 12:07 |
jaosorior | quiquell: do we know why? | 12:07 |
rfolco|rucker | yolanda, quiquell yes, I am still trying to find a pattern for the issue. One issue is that containers taking too long to start | 12:08 |
quiquell | jaosorior: Do we know if we can activate ARA at undercloud ? | 12:08 |
rfolco|rucker | http://logs.openstack.org/47/611447/2/gate/tripleo-ci-centos-7-containers-multinode/66b7730/logs/undercloud/home/zuul/install-undercloud.log.txt.gz#_2018-10-18_18_42_19_934 | 12:08 |
quiquell | jaosorior: Maybe podman new stuff ? | 12:08 |
jaosorior | quiquell: do we know why we get these timeouts? | 12:08 |
jaosorior | quiquell: we can't activate ARA for the undercloud AFAIK, there were issues where the concurrent running of playbooks would make ARA crash | 12:09 |
*** ooolpbot has joined #tripleo | 12:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 12:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 12:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 12:10 |
*** ooolpbot has quit IRC | 12:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 12:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 12:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 12:10 |
*** gfidente|giulivo has quit IRC | 12:11 | |
rfolco|rucker | jaosorior, I see 17min gap in starting containers in the log above, but not sure this really means anything | 12:11 |
*** apetrich has quit IRC | 12:14 | |
quiquell | jaosorior, rfolco|rucker: We have to put undercloud ARA in place | 12:14 |
jaosorior | quiquell: not sure if we can actually | 12:15 |
jaosorior | quiquell: mwhahaha would have more details about it | 12:15 |
quiquell | jaosorior: ok | 12:18 |
sambetts | Hi tripleo team, is there anyone around that can answer some questions I have about newton to queens FFU? | 12:22 |
chem | quiquell: about the if refactoring, If I do that I have no chance of seeing emit_release merged today, would it be ok If I make a review on top if it ? | 12:28 |
quiquell | chem: Yep totally that's why I have add my little +1 | 12:28 |
*** rdopiera has quit IRC | 12:29 | |
chem | quiquell: oki, I'll add the review then and remove the todo as well. thanks. | 12:29 |
EvilienM | bogdando: have you seen that before ? http://paste.openstack.org/show/732490/ (cc therve) | 12:30 |
EvilienM | (I haven't) | 12:30 |
Tengu | dtantsur: heya! small question: I see a lot of logs like this one while doing the introspection: The PXE filter driver DnsmasqFilter, state=initialized enters the fsm_reset_on_error context fsm_reset_on_error | 12:30 |
openstackgerrit | Daniel Alvarez proposed openstack/tripleo-heat-templates master: Switch default neutron ML2 mechanism driver to OVN https://review.openstack.org/593056 | 12:30 |
dtantsur | Tengu: ignore them :) | 12:31 |
Tengu | dtantsur: I'm trying to find why it's taking so long... and in fact I have timeouts and it has to retry 2-3 times :( | 12:31 |
dtantsur | Tengu: I don't think these log lines will help you. The problem is somewhere around networking, I suspect. | 12:32 |
Tengu | dtantsur: hmm ok. so I'm in a libvirt env, overcloud nodes are VM managed with the nice vbmc, and it's all running on the same computer (computer resources aren't an issue imho) | 12:33 |
Tengu | and apparently I'm not hitting the issue we get on the CI where vbmc is unable to provide the power state. | 12:34 |
dtantsur | Tengu: can you look what is happening with nodes consoles when trying to introspect them? | 12:35 |
Tengu | dtantsur: hmm apparently I don't have any output. maybe I missed something for the console -.-' | 12:36 |
EvilienM | bogdando, please remove -2 on https://review.openstack.org/#/c/606908/, blocker was resolved | 12:37 |
bogdando | EvilienM: we don't need that patch | 12:38 |
*** rlandy has joined #tripleo | 12:38 | |
bogdando | we need only https://review.openstack.org/#/c/607512 | 12:39 |
quiquell | Hello there anyone has issues with python3 and libselinux-python ? | 12:39 |
*** raildo has joined #tripleo | 12:39 | |
*** lblanchard has joined #tripleo | 12:39 | |
bogdando | EvilienM: no, never observed yet such an error | 12:40 |
EvilienM | bogdando: ack & ack | 12:40 |
Tengu | quiquell: I'm working on selinux, but I didn't do anything with python3 so far. | 12:40 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: [Ocata/Pike/Queens] Make rhel-registration scripts location absolute. https://review.openstack.org/611857 | 12:40 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/pike: [Queens/Pike] Re-registry with new rhel_reg parameters on upgrade. https://review.openstack.org/611858 | 12:40 |
EvilienM | bogdando: also, see brent's review on https://review.openstack.org/#/c/606095/ | 12:40 |
*** trown|outtypewww is now known as trown | 12:41 | |
*** eck`gone is now known as eck` | 12:41 | |
EvilienM | quiquell: not sure if you guys noticed but the ARA database for undercloud playbooks has gone away http://logs.openstack.org/97/611597/2/check/tripleo-ci-centos-7-containers-multinode/6c8f45b/logs/ | 12:43 |
EvilienM | quiquell: we used to have ARA for the undercloud deployment | 12:43 |
EvilienM | panda|lunch: ^ | 12:43 |
Tengu | EvilienM: I think it was dropped because it created too much stress and CI ended with time_out | 12:44 |
EvilienM | oh ok | 12:44 |
Tengu | I think weshay_pto was the one providing the patch. There was a discussion about that a few days ago | 12:45 |
*** dansmith is now known as SteelyDan | 12:45 | |
therve | EvilienM, bogdando: templates are localized somehow? | 12:45 |
trown | mandre: I couldnt get quay.io to work with the container inspection code in tripleo-common... I uploaded all the containers to tripleomaster and tripleorocky like https://hub.docker.com/r/tripleomaster/coreos-cluster-monitoring-operator/ | 12:46 |
*** paramite has joined #tripleo | 12:47 | |
mandre | trown: hmm ok, I guess this is one way to solves the two immediate issues :) | 12:47 |
quiquell | EvilienM: looks like mwhahaha has more details as jaosorior stated | 12:47 |
mandre | trown: is the job going further now? | 12:48 |
EvilienM | therve: not that I'm aware of | 12:48 |
trown | mandre: ya, want me to fix up your tripleo-common patch to point to the new containers? | 12:48 |
therve | EvilienM: I mean, that's what it shows, I printed the string | 12:48 |
trown | mandre: in my local env I get to the same spot I was getting before | 12:48 |
*** social has quit IRC | 12:48 | |
trown | mandre: the seeming SSL issue... started a run with full debug on in openshift... | 12:48 |
EvilienM | therve: what's your `locale` is saying? | 12:48 |
therve | EvilienM: LANG=fr_FR.UTF-8 | 12:49 |
mandre | trown: should we really change the default images to be the ones you uploaded to the dockerhub or instead just modify the variables for the CI jobs | 12:49 |
EvilienM | therve: but you could deploy a first time right? (your failure is when you retry to deploy on the same system) | 12:50 |
mandre | trown: that would mean a patch to oooqe to expose the variables | 12:50 |
therve | EvilienM: Right, first time it probably didn't use it? | 12:50 |
trown | mandre: I think we have to make those default :(... it is not only for CI | 12:50 |
trown | mandre: tripleo-common code doesnt work with quay.io API | 12:51 |
mandre | right... until we figure out how to consume images from quay.io | 12:51 |
mandre | trown: are you working on updating the tripleo-common patch? | 12:52 |
*** gkadam has joined #tripleo | 12:52 | |
trown | mandre: 100% we should do it in CI code if it was only to have a mirror for CI | 12:52 |
*** paramite|clone has joined #tripleo | 12:52 | |
trown | mandre: I have it in my local env I can push it | 12:52 |
mandre | trown: push it! | 12:53 |
EvilienM | therve: can you paste /var/log/yum.log please ? | 12:54 |
EvilienM | therve: I want to see if you updates something in the meantime | 12:54 |
openstackgerrit | John Trowbridge proposed openstack/tripleo-common master: Add container images for openshift 3.11 https://review.openstack.org/610663 | 12:54 |
*** paramite has quit IRC | 12:55 | |
therve | EvilienM: http://paste.openstack.org/show/732496/ is the end | 12:56 |
EvilienM | therve: that's all? | 12:57 |
therve | EvilienM: That's the end | 12:57 |
*** slaweq has quit IRC | 12:57 | |
EvilienM | therve: THT was updated | 12:58 |
therve | EvilienM: Yeah dlrn | 12:58 |
EvilienM | therve: I feel like it's something we merged yesterday | 12:58 |
EvilienM | therve: one sec | 12:58 |
therve | EvilienM: I'd be surprised, but tell me :) | 12:58 |
therve | I fixed tripleo_common in the mean time | 12:59 |
EvilienM | therve: could it be https://review.openstack.org/#/c/596427/5/common/services.yaml ? | 12:59 |
therve | EvilienM: Why? | 13:00 |
openstackgerrit | Cédric Jeanneret proposed openstack/tripleo-heat-templates master: Set setype for log and persistant data directories https://review.openstack.org/611801 | 13:00 |
EvilienM | therve: I hate YAQL. | 13:00 |
therve | Heh | 13:00 |
mandre | trown: did you raise a bug re tripleo-common and quay.io? | 13:00 |
trown | mandre: i didnt ... do we care in general? ie is quay.io generally used? | 13:01 |
EvilienM | therve: can you run the command with strace and grab output in a file? | 13:01 |
*** rdopiera has joined #tripleo | 13:01 | |
EvilienM | therve: then we check the last 300 lines or something | 13:01 |
trown | mandre: I guess it couldnt hurt... I will make one today | 13:02 |
therve | EvilienM: That sounds a bit heavy, why do you need all of that? | 13:02 |
mandre | trown: I think we care yeah | 13:02 |
EvilienM | therve: it seems like it fails at f.write(template_data) | 13:03 |
therve | EvilienM: Right, because it contains french accents | 13:03 |
openstackgerrit | Dmitry Tantsur proposed openstack/diskimage-builder master: Add an element to configure iBFT network interfaces https://review.openstack.org/391787 | 13:03 |
EvilienM | therve: you frenchs | 13:03 |
EvilienM | wait | 13:03 |
EvilienM | nevermind | 13:03 |
*** iurygregory has joined #tripleo | 13:04 | |
EvilienM | therve: give me 2 min | 13:05 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Fix haproxy mounts when TLS everywhere is enabled https://review.openstack.org/611862 | 13:06 |
*** slaweq has joined #tripleo | 13:07 | |
*** agopi|brb is now known as agopi | 13:08 | |
jaosorior | quick review if folks ahve time https://review.openstack.org/#/c/611862/ | 13:09 |
*** ooolpbot has joined #tripleo | 13:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 13:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 13:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 13:10 |
*** ooolpbot has quit IRC | 13:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 13:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 13:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 13:10 |
*** derekh has quit IRC | 13:11 | |
*** derekh has joined #tripleo | 13:11 | |
openstackgerrit | Evilien Macchi proposed openstack/tripleo-common master: write_config: force utf8 https://review.openstack.org/611866 | 13:16 |
EvilienM | therve: something like this maybe?? ^ | 13:16 |
therve | EvilienM: I'll test it | 13:16 |
*** rdopiera has quit IRC | 13:17 | |
*** rdopiera has joined #tripleo | 13:17 | |
*** slaweq has quit IRC | 13:27 | |
openstackgerrit | Natal Ngétal proposed openstack/tripleo-quickstart master: [Documentation] Migrate to list table. https://review.openstack.org/611871 | 13:30 |
*** mcornea has joined #tripleo | 13:30 | |
therve | EvilienM: That's what I thought, it's a py3 only keyword :D | 13:32 |
*** mcornea has quit IRC | 13:34 | |
*** mcornea has joined #tripleo | 13:35 | |
mwhahaha | so we can get full tempest runs with the standalone -> https://review.openstack.org/#/c/610596/ | 13:37 |
Hobbestigrou | hi | 13:42 |
openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci master: [WIP] Testing ansible-ml2 job https://review.openstack.org/582294 | 13:42 |
Hobbestigrou | i have make a patch to migrate on list table https://review.openstack.org/#/c/611871/ | 13:43 |
Hobbestigrou | feel free to check and maybe validate | 13:44 |
mwhahaha | yea i don't know if that's any better | 13:45 |
Hobbestigrou | mwhahaha, ok | 13:48 |
mwhahaha | others can review but i'm not sure having to count the number of - is better :D i hate that table anyway | 13:48 |
Hobbestigrou | for me it's better, but i'm not the good person i have made the patch :) | 13:48 |
Hobbestigrou | mwhahaha, i understand, in all case table is not easy to maintain | 13:49 |
*** slaweq has joined #tripleo | 13:50 | |
EvilienM | therve: damn so it won't pass CI | 13:51 |
therve | No :) | 13:51 |
*** paramite has joined #tripleo | 13:51 | |
bogdando | beagles: replied to https://review.openstack.org/#/c/606095/15 | 13:52 |
*** Vorrtex has joined #tripleo | 13:53 | |
sambetts | mwhahaha: I've got some issues with newton to queens FFU in particular how config-download converts the deployments in heat into ansible tasks, the first issue is that it assumes all deployments run for a specific server should run for every server of that role type, and the second issue is that it loads the inputs from the software deployments but that doesn't seem to pick up the correct inputs for | 13:53 |
sambetts | scenarios where the output of one task in heat is used as the input to another task | 13:53 |
*** paramite|clone has quit IRC | 13:54 | |
mwhahaha | sambetts: yea i'm not familar with the ffu stuff, i'd have to defer to someone else | 13:54 |
bogdando | technically, agents are not aware of containers running child processes. The wrappers task is to ensure the process started, whatever name has given to that poor mortal a shell around it | 13:54 |
bogdando | beagles: ^^ | 13:54 |
sambetts | mwhahaha: ah, I saw you'd contributed to the config.py part, any idea whos the kinda expert of that stuff? | 13:55 |
bogdando | it shall not fail on the containers name collisions therefore, that's my understanding. It just makes the process started | 13:55 |
mwhahaha | sambetts: try chem or holser_ maybe? Though what you describe in terms of the role items seems to be the way it should be as we don't really have server specific tasks but rather things grouped by roles | 13:57 |
mwhahaha | EvilienM: i commented on what i think you want for that utf8 patch | 13:58 |
*** vinaykns has joined #tripleo | 13:58 | |
EvilienM | mwhahaha: codecs.open | 13:59 |
mwhahaha | EvilienM: i think my comment is simplier as it works for both | 14:00 |
EvilienM | mwhahaha: did you find it on stackoverflow? | 14:00 |
EvilienM | I only take stackoverflow code today | 14:00 |
sambetts | mwhahaha: I've hit the role issue with a AllNodesExtraConfig template that runs a software deployment to process an input only on the first controller (little point generating the same data N times), and then uses that output as an input to another software deployment, it works great in heat because you can do "server: {get_param [servers, Controller, 0]}" but the download config logic doesn't actually | 14:00 |
sambetts | look at that info | 14:00 |
mwhahaha | (maybe) also i recall having to do it with the py3 testing stuff | 14:00 |
mwhahaha | sambetts: yea not sure, seems like you've got a complex thing there and there might be a better way to achieve what you want to handle the single node execution. we have the concept of a bootstrap node that we've used that perhaps you could use instead | 14:02 |
mwhahaha | sambetts: slagle might have an idea on what you're running into as well | 14:03 |
openstackgerrit | Evilien Macchi proposed openstack/tripleo-common master: write_config: force utf8 https://review.openstack.org/611866 | 14:03 |
slagle | sambetts: the heat deployment input/outputs don't work with config-download. i was under the impression though that it wasn't an issue for ffu | 14:06 |
sambetts | slagle: part of my deploy uses https://github.com/openstack/tripleo-heat-templates/blob/master/extraconfig/all_nodes/mac_hostname.j2.yaml and if the DistributeMacDeploymentController deployment is run by the ansible with the missing inputs (which should come from the other deployment) it overrides the file with empty data | 14:09 |
*** ooolpbot has joined #tripleo | 14:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 14:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 14:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 14:10 |
*** ooolpbot has quit IRC | 14:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 14:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 14:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 14:10 |
slagle | sambetts: hmm, yea, i see. that definitely won't work as-is with config-download. the recommendation would be to use a service template that can define equivalent ansible tasks via the different interfaces there, host_prep_tasks, external_deploy_tasks, etc | 14:10 |
slagle | sambetts: looks like we may have overlooked this template. sorry about that. we added some checks to see where input/outputs were used, but i don't think it considered deploy_stdouts | 14:11 |
slagle | sambetts: i can work on updating this | 14:12 |
*** mjturek has joined #tripleo | 14:12 | |
sambetts | slagle: the other issue I was discribing to mwhahaha, was caused by this: https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/extraconfig/all_nodes/neutron-ml2-cisco-nexus-ucsm.j2.yaml#L307 | 14:13 |
mwhahaha | yea i'm pretty much sure no one tested that with ffu | 14:13 |
openstackgerrit | Evilien Macchi proposed openstack/tripleo-common master: write_config: force utf8 https://review.openstack.org/611866 | 14:13 |
mwhahaha | we definitely do not test that upstream | 14:13 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/queens: WIP: [Queens only] Use rhel-registration tool in Rhsm to update repos before upgrade https://review.openstack.org/611879 | 14:14 |
sambetts | slagle: basically the "MappingToNexusDeploymentsController" task file only gets generated for one server because that all it runs for, but then the pre tasks for all Controllers end up getting populated with that task | 14:14 |
slagle | sambetts: right, i could see how that would happen based on how the code works | 14:14 |
sambetts | slagle: so you get a file not found error from ansible for all Controller except the first one | 14:14 |
slagle | i think that could be fixed by writing the *_pre_deployments vars under host_vars instead of group_vars. and make them server specific | 14:15 |
sambetts | regarding the Cisco template, I'm testing it out now to verify it works (unfortunatly we've been a bit off the ball keeping out template up to date) | 14:16 |
sambetts | s/out/our | 14:17 |
slagle | as for the template though, i don't see how we'd make config-download support the input/outputs | 14:17 |
slagle | given that you could transform the data anyway you wanted in Heat, and config-download wouldn't know | 14:17 |
openstackgerrit | Evilien Macchi proposed openstack/paunch master: podman: stop the docker container during upgrade https://review.openstack.org/608319 | 14:17 |
openstackgerrit | Evilien Macchi proposed openstack/tripleo-quickstart master: fs050: upgrade the undercloud to Podman containers https://review.openstack.org/608463 | 14:18 |
sambetts | yeah, its tricky, unless there is a way to mimic the inputs/outputs in the ansible, e.g. a "set_fact" task or something | 14:18 |
slagle | sambetts: yea maybe, but it wouldn't work for everything generically | 14:18 |
slagle | it'd probably by easier to just convert to a service template which I can help with | 14:19 |
slagle | it's something we definitely need to fix in rocky. but i didn't even think this code was getting used for ffu to queens | 14:20 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates stable/queens: WIP: [Queens only] Use rhel-registration tool in Rhsm to update repos before upgrade https://review.openstack.org/611879 | 14:20 |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Add podman support to validate-tempest role https://review.openstack.org/605356 | 14:20 |
slagle | b/c i thought the last step was to do the stack converge at the end with config-download disabled | 14:21 |
slagle | so the deployments should run in the traditional heat fashion | 14:21 |
openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart-extras master: Create tempest networks for standalone https://review.openstack.org/608939 | 14:21 |
sambetts | slagle: I'm doing OSP10 to OSP13 (newton to queens) and it seems to be running it during the "openstack overcloud upgrade run --roles Controller" step | 14:22 |
sambetts | pre converge | 14:22 |
beagles | bogdando, thanks, saw and commented :) | 14:23 |
sambetts | however my systems logs have just decided to run over their limit and clear the info about which task it was *face palm* | 14:24 |
slagle | sambetts: yea maybe it runs everything in that step. but it ought to run everything via Heat in the last step | 14:24 |
slagle | however, perhaps that sequence breaks things | 14:25 |
slagle | we'd need to get some ffu engineers involved here i'd think | 14:25 |
sambetts | slagle: in that case the input/output part might not hurt if the heat gets rerun after, but the file not found kills it dead | 14:25 |
slagle | that will need to be fixed in the config-download code | 14:26 |
slagle | i can work on a patch | 14:26 |
sambetts | slagle: that would be great! | 14:28 |
slagle | EvilienM: what's the story behind https://review.openstack.org/#/c/582626/? | 14:28 |
slagle | EvilienM: was that something you were doing on your own, or had you worked with someone from cisco on that? | 14:28 |
slagle | sambetts: see as well ^ | 14:28 |
*** vinaykns has quit IRC | 14:28 | |
sambetts | slagle: takes a look now | 14:29 |
sambetts | taking* | 14:29 |
EvilienM | slagle: Cisco pinged me and shardy about that work, they needed some help. I took a quick look in July and never came back to it. | 14:29 |
*** jistr is now known as jistr|call | 14:29 | |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Avoid ignore_error with image fetching https://review.openstack.org/611887 | 14:29 |
slagle | EvilienM: ok. i can take a look at finishing it off | 14:30 |
slagle | we might need it backported to rocky and queens | 14:30 |
EvilienM | slagle: you can take over the patch or do it separated if you'll like | 14:30 |
EvilienM | slagle: right I believe they wanted to backport it to queens | 14:31 |
slagle | sure | 14:31 |
EvilienM | thanks for helping on this one | 14:31 |
slagle | yea i missed the usage of deploy_stdouts when i was searching for templates that config-download would break | 14:31 |
slagle | any out of tree templates wouldn't work either | 14:32 |
sambetts | if it was backported to queens, I can understand how we'd use it on a fresh install, but how would it interact with ffu e.g. migrating from the old template to this one? | 14:33 |
slagle | sambetts: on the upgrade, the resources in the old template would get deleted by Heat. and then config-download would run the ansible tasks. | 14:35 |
slagle | sambetts: there are also native Heat resources that run the ansible tasks if not using config-download in queens | 14:35 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Display output of package install in case of failure https://review.openstack.org/595576 | 14:35 |
slagle | sambetts: i think it should work ok. in theory | 14:36 |
sambetts | slagle: ah ok cool, yeah my current workaround (still testing it out) is that I was going to delete the template from my newton install, run the ffu, then readd the template | 14:36 |
*** apetrich has joined #tripleo | 14:36 | |
slagle | that would be an option as well | 14:36 |
slagle | but we need to fix this template for rocky anyway | 14:37 |
sambetts | 100% there were additional issues with the Cisco template for queens too, https://review.openstack.org/#/c/600396/ | 14:37 |
sambetts | and https://review.openstack.org/#/c/600713 | 14:38 |
slagle | i also see the Controller role is hardcoded. should probably use {{primary_role_name}} there. see overcloud.j2.yaml for setting that at the top of the templates | 14:38 |
ssbarnea | Any Firefox user around willing to test https://github.com/openstack/coats for improving the build log browsing experience? I am looking for a beta tester / reviewer. | 14:39 |
*** slaweq has quit IRC | 14:40 | |
quiquell | jistr|call: http://logs.openstack.org/42/611842/2/check/openstack-tox-py35/2bba45d/job-output.txt.gz#_2018-10-19_12_01_16_020909 | 14:41 |
quiquell | jistr|call: Now is in the job don't know if we want to take if furter | 14:41 |
*** apetrich has quit IRC | 14:43 | |
*** apetrich has joined #tripleo | 14:44 | |
*** social has joined #tripleo | 14:44 | |
*** mjturek has quit IRC | 14:46 | |
slagle | therve: is there a way in the resource_registry to force a resource to map back to it's original value? | 14:46 |
slagle | therve: something like this: https://etherpad.openstack.org/p/46Fw2Yjn7L | 14:46 |
*** jistr|call is now known as jistr | 14:47 | |
therve | slagle: No, that's why we have OS::TripleO::Heat::SoftwareDeployment | 14:47 |
*** vinaykns has joined #tripleo | 14:48 | |
jistr | quiquell: personally i'd leave it until we can find some hi-value benefit from continuing further. It's good that now we have a number to look at when we want to check. (just my 2 cents :) ) | 14:48 |
slagle | therve: right. but everything might not use that. i guess we could make it though. except for any out-of-tree templates | 14:49 |
*** panda|lunch is now known as panda | 14:49 | |
therve | slagle: I mean, that's what you need to use to revert to the original value | 14:49 |
*** mjturek has joined #tripleo | 14:50 | |
slagle | maybe that would be a good idea though. so a user could opt-in to making their template run via config-download, otherwise it runs in the traditional fashion | 14:50 |
therve | We should have used that in the first place and not override existing resources | 14:50 |
*** mjturek has quit IRC | 14:50 | |
therve | I think at that point it's probably too late, we can't override that particular resource | 14:50 |
*** ksambor has quit IRC | 14:52 | |
slagle | therve: you mean OS::Heat::SoftwareDeployment? | 14:52 |
therve | slagle: No I mean we can't override OS::TripleO::Heat::SoftwareDeployment | 14:53 |
therve | That's what we use to revert to the "original" class | 14:53 |
quiquell | jistr: Agree | 14:53 |
slagle | therve: so you think we should have a different resource, OS::TripleO::ConfigDownloadSoftwareDeployment that maps to config-download-software.yaml? | 14:54 |
therve | slagle: Not sure, what are you trying to fix? | 14:54 |
slagle | therve: i was wondering if it'd be possible to have deployments be the config-download nested stack by default, but then allow for mapping specific ones back to the real OS::Heat::SoftwareDeployment if it was needed | 14:56 |
slagle | they might run out of order in that case, but that might be ok for some AllNodesExtraConfig templates | 14:56 |
*** pcaruana|elisa| has quit IRC | 14:56 | |
therve | slagle: OK, so yeah create another alias sounds like a good idea | 14:57 |
slagle | i think it could be done, would just need to use different mappings, and not remap the builtin resource by deault | 14:57 |
*** pcaruana|elisa| has joined #tripleo | 14:57 | |
*** yprokule has quit IRC | 14:58 | |
*** quiquell is now known as quiquell|off | 14:58 | |
*** gfidente has joined #tripleo | 15:01 | |
*** jfrancoa has quit IRC | 15:01 | |
*** pcaruana|elisa| has quit IRC | 15:08 | |
*** pcaruana has joined #tripleo | 15:08 | |
*** ooolpbot has joined #tripleo | 15:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 15:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 15:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 15:10 |
*** ooolpbot has quit IRC | 15:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 15:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 15:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 15:10 |
*** gkadam has quit IRC | 15:18 | |
openstackgerrit | Sorin Sbarnea proposed openstack-infra/tripleo-ci master: Corrected release config location for log collection https://review.openstack.org/610038 | 15:19 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: DNM: test change https://review.openstack.org/610119 | 15:19 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: DNM: test change https://review.openstack.org/610119 | 15:20 |
openstackgerrit | Marius Cornea proposed openstack/tripleo-heat-templates master: Switch OpenShiftGlusterDisks to a single disk https://review.openstack.org/611906 | 15:21 |
*** rbrady has joined #tripleo | 15:23 | |
*** pcaruana has quit IRC | 15:31 | |
*** rpioso|afk is now known as rpioso | 15:36 | |
openstackgerrit | Merged openstack/tripleo-docs master: Fix links to sova and add grafana in promoter stages overview https://review.openstack.org/611820 | 15:43 |
*** paramite has quit IRC | 15:48 | |
openstackgerrit | Sorin Sbarnea proposed openstack-infra/tripleo-ci master: Avoids sort: write failed: standard output: Broken pipe with du https://review.openstack.org/609413 | 15:51 |
*** ccamacho has quit IRC | 15:56 | |
mwhahaha | rdocloud is messing up again | 15:56 |
mwhahaha | always great and everyone is off | 15:57 |
* mwhahaha give sup | 15:57 | |
openstackgerrit | RedHat RDO CI proposed openstack/tripleo-heat-templates master: GATE CHECK for TripleO https://review.openstack.org/604298 | 16:00 |
chkumar|off | mwhahaha: https://review.openstack.org/#/c/609943/ and https://review.openstack.org/609937 are good to go | 16:02 |
chkumar|off | mwhahaha: https://review.openstack.org/#/c/608939/ for tempest standalone network | 16:03 |
mwhahaha | k | 16:03 |
*** iurygregory has quit IRC | 16:03 | |
*** Vorrtex has quit IRC | 16:05 | |
*** vinaykns has quit IRC | 16:05 | |
openstackgerrit | Bogdan Dobrelya proposed openstack/paunch master: Intoduce caching of podman ps calls in BaseRunner https://review.openstack.org/611911 | 16:06 |
*** iranzo has quit IRC | 16:07 | |
*** beekneemech has quit IRC | 16:08 | |
*** bnemec has joined #tripleo | 16:08 | |
*** ooolpbot has joined #tripleo | 16:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 16:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 16:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 16:10 |
*** ooolpbot has quit IRC | 16:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 16:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 16:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 16:10 |
*** mjturek has joined #tripleo | 16:11 | |
*** holser_ has quit IRC | 16:11 | |
*** bogdando has quit IRC | 16:14 | |
*** gfidente is now known as gfidente|afk | 16:19 | |
*** openstackgerrit has quit IRC | 16:24 | |
*** shardy has quit IRC | 16:30 | |
*** sambetts is now known as sambetts|afk | 16:32 | |
sambetts|afk | slagle, mwhahaha: thanks for the help today, cya | 16:32 |
slagle | sambetts|afk: np. will aim to get some fixes out next week | 16:33 |
*** kopecmartin is now known as kopecmartin|off | 16:37 | |
*** social has quit IRC | 16:39 | |
*** bnemec is now known as beekneemech | 16:43 | |
*** dtantsur is now known as dtantsur|afk | 16:44 | |
*** openstackgerrit has joined #tripleo | 16:47 | |
openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-tripleo master: Make sure that the _member_ role is assigned to admin. https://review.openstack.org/611919 | 16:47 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-tripleo master: Make sure that the _member_ role is assigned to admin. https://review.openstack.org/611919 | 16:48 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates master: WIP: enable _member_ role for undercloud install. https://review.openstack.org/611677 | 16:49 |
*** rdopiera has quit IRC | 16:53 | |
*** cylopez has quit IRC | 16:55 | |
*** derekh has quit IRC | 17:01 | |
*** homegrown_ has quit IRC | 17:02 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Resolve get_build_command output before container_build_id https://review.openstack.org/602734 | 17:09 |
*** homegrown has joined #tripleo | 17:10 | |
*** ooolpbot has joined #tripleo | 17:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 17:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 17:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 17:10 |
*** ooolpbot has quit IRC | 17:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 17:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 17:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 17:10 |
*** trown is now known as trown|lunch | 17:14 | |
*** tosky has quit IRC | 17:18 | |
*** morazi has quit IRC | 17:21 | |
*** social has joined #tripleo | 17:22 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Install python-pip if not available https://review.openstack.org/611924 | 17:22 |
itlinux | something very strange I see on a new test now.. it worked with no problem but I just pulled down the latest pike and now I get this TASK [Ensure system is NTP time synced] and fails.. I went to the compute nodes since the ctl can sync and I get 9 Oct 17:18:04 ntpdate[1973]: no server suitable for synchronization found | 17:23 |
itlinux | any suggestions? | 17:24 |
mwhahaha | itlinux: do you block ntp? if so set NtpServer to a local ntp source | 17:24 |
mwhahaha | default is pool.ntp.org | 17:25 |
itlinux | yes I have NtpServer set.. | 17:25 |
mwhahaha | then it doesn't have access to your ntp server (maybe bad net config?) | 17:25 |
itlinux | http://paste.openstack.org/show/732517/ | 17:26 |
*** florianf has quit IRC | 17:26 | |
itlinux | ok let me try something else.. | 17:26 |
mwhahaha | itlinux: yea try running ntpdate by hand on the system. you can see the cmd there | 17:26 |
itlinux | yea I get the same error back | 17:27 |
mwhahaha | we added this so that you find out early in the deploy rather than later when your pacemaker cluster falls apart because of time skeq | 17:27 |
mwhahaha | skew | 17:27 |
itlinux | yeap.. | 17:28 |
*** abishop has quit IRC | 17:29 | |
*** cylopez has joined #tripleo | 17:34 | |
*** morazi has joined #tripleo | 17:37 | |
*** ayoung has joined #tripleo | 17:41 | |
ayoung | EvilienM, question about customizing policy IAW: https://review.openstack.org/#/c/445700/10/puppet/services/nova-api.yaml what is the part of the example: nova-context_is_admin:? How does that map to the end state policy file? | 17:42 |
*** morazi has quit IRC | 17:42 | |
*** morazi has joined #tripleo | 17:43 | |
ayoung | Like, if I were to generate the yaml from the policy, for the rule context_is_admin I'd get: "context_is_admin": "role:admin" | 17:43 |
ayoung | so what is the part of the environment nova-context_is_admin used for? Is it just an internal variable? | 17:45 |
mwhahaha | ayoung: it's an identifier for the underlying config change | 17:47 |
mwhahaha | ayoung: specifically it's the puppet resource name for the augueas | 17:47 |
ayoung | mwhahaha, what is that resource? Is it the whole policy file, or just that individual line? Do I need to deduce the name of the lines for any policy I want to update? | 17:47 |
mwhahaha | https://github.com/openstack/puppet-openstacklib/blob/master/manifests/policy/base.pp#L31 | 17:48 |
ayoung | mwhahaha, like, say I have a whole new policy.json file, and I want to convert it to env vars like this, what are the rules? | 17:48 |
mwhahaha | that's the internals | 17:48 |
mwhahaha | it's key/value | 17:48 |
mwhahaha | { unique-identifier: { key: <keyvalue>, value: <datavalue> }, ...} | 17:49 |
mwhahaha | so it's a hash of that | 17:49 |
mwhahaha | because that gets shoved in through https://github.com/openstack/puppet-openstacklib/blob/master/manifests/policy.pp#L17 | 17:49 |
ayoung | mwhahaha, by hash, I assume you mean hash table, and not sha256 type hash | 17:50 |
mwhahaha | so nova-context_is_admin ends up being a openstacklib::policy::base { 'nova-context_is_admin': key => 'context_is_admin', value => 'role:admin' } in puppet | 17:50 |
ayoung | mwhahaha, but does it matter what I havce there ? would this be just as valid? | 17:50 |
mwhahaha | a dict/hash/insert-the-name-of-your-favorite-key-valuye-datastructure | 17:50 |
ayoung | openstacklib::policy::base { 'it-is-all-my-fault': key => 'context_is_admin', value => 'role:admin' } | 17:51 |
*** cylopez has left #tripleo | 17:51 | |
*** apetrich has quit IRC | 17:51 | |
mwhahaha | well there's a filepath too | 17:52 |
mwhahaha | but anwyay that comment in the THT is the general structure you need | 17:52 |
ayoung | mwhahaha, let me cobble up a sample env file and tell me if it makes sense: | 17:53 |
mwhahaha | https://github.com/openstack/puppet-nova/blob/master/manifests/policy.pp#L42 | 17:53 |
mwhahaha | https://github.com/openstack/puppet-nova/blob/master/manifests/policy.pp#L7 has better example for multiple changes | 17:54 |
mwhahaha | that's the puppet hash format, you'd just need to have an equivalent json | 17:54 |
* mwhahaha wanders off for lunch | 17:56 | |
*** dciabrin has quit IRC | 17:58 | |
Hobbestigrou | maybe i don't understand correctly the ticket but that seems already fixed https://bugs.launchpad.net/tripleo/+bug/1623933 | 18:04 |
openstack | Launchpad bug 1623933 in tripleo "Quickstart doesn't allow to use different pip mirrors or cache" [High,Triaged] | 18:04 |
*** apetrich has joined #tripleo | 18:04 | |
Hobbestigrou | ? | 18:04 |
ayoung | mwhahaha, something like http://paste.openstack.org/show/732519/ | 18:07 |
ayoung | ? | 18:07 |
*** medberry has joined #tripleo | 18:07 | |
*** ooolpbot has joined #tripleo | 18:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 18:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 18:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 18:10 |
*** ooolpbot has quit IRC | 18:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 18:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 18:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 18:10 |
*** ayoung has quit IRC | 18:12 | |
*** salmankhan has quit IRC | 18:13 | |
*** medberry has quit IRC | 18:14 | |
*** morazi has quit IRC | 18:15 | |
openstackgerrit | Merged openstack/tripleo-quickstart master: Use dnf and python3 on platforms where these are default https://review.openstack.org/610475 | 18:24 |
*** trown|lunch is now known as trown | 18:46 | |
trown | 826178 | 18:46 |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Install python-virtualenv if not available https://review.openstack.org/611924 | 18:47 |
*** ayoung has joined #tripleo | 18:50 | |
*** fultonj has quit IRC | 18:52 | |
*** fultonj has joined #tripleo | 18:54 | |
openstackgerrit | Merged openstack/tripleo-common stable/rocky: Fix nova-api healthcheck in case of nova metadata wsgi https://review.openstack.org/610890 | 18:55 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Correct a minor typo in the doc that could lead to some issues https://review.openstack.org/611302 | 18:55 |
openstackgerrit | Merged openstack/tripleo-common master: Increase size for security hardened images https://review.openstack.org/608017 | 18:55 |
openstackgerrit | Merged openstack/tripleo-upgrade stable/rocky: Fix variable name for workload_launch task. https://review.openstack.org/611242 | 18:55 |
*** gfidente|afk has quit IRC | 18:55 | |
openstackgerrit | Merged openstack-infra/tripleo-ci master: Revert "Make containerized undercloud upgrade non voting until we get Stein tag" https://review.openstack.org/611526 | 18:55 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Add nova file_backed_memory and memory_backing_dir support for qemu.conf https://review.openstack.org/604360 | 18:55 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Use different base virtual_router_id on openshift https://review.openstack.org/608719 | 18:55 |
*** ooolpbot has joined #tripleo | 19:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 19:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 19:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 19:10 |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 19:10 |
*** ooolpbot has quit IRC | 19:10 | |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 19:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 19:10 |
openstackgerrit | Evilien Macchi proposed openstack/python-tripleoclient master: undercloud_preflight: compare actual IPs without mask https://review.openstack.org/611937 | 19:20 |
*** akrivoka has quit IRC | 19:28 | |
openstackgerrit | Evilien Macchi proposed openstack/paunch master: podman: stop the docker container during upgrade https://review.openstack.org/608319 | 19:32 |
openstackgerrit | Evilien Macchi proposed openstack/paunch master: podman: stop the docker container during upgrade https://review.openstack.org/608319 | 19:32 |
openstackgerrit | Evilien Macchi proposed openstack/paunch master: podman: stop the docker container during upgrade https://review.openstack.org/608319 | 19:32 |
openstackgerrit | Evilien Macchi proposed openstack/tripleo-quickstart master: fs050: upgrade the undercloud to Podman containers https://review.openstack.org/608463 | 19:32 |
*** mcornea has quit IRC | 19:33 | |
*** mcornea has joined #tripleo | 19:34 | |
*** sshnaidm|off has quit IRC | 19:34 | |
*** sshnaidm|off has joined #tripleo | 19:50 | |
*** holser_ has joined #tripleo | 20:02 | |
*** sshnaidm|off has quit IRC | 20:04 | |
*** holser_ has quit IRC | 20:05 | |
*** ooolpbot has joined #tripleo | 20:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 20:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 20:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 20:10 |
*** ooolpbot has quit IRC | 20:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 20:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 20:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 20:10 |
*** sshnaidm|off has joined #tripleo | 20:22 | |
*** owalsh has quit IRC | 20:36 | |
*** beekneemech has quit IRC | 20:53 | |
*** trown is now known as trown|outtypewww | 21:00 | |
*** owalsh has joined #tripleo | 21:10 | |
*** ooolpbot has joined #tripleo | 21:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 21:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 21:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 21:10 |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 21:10 |
*** ooolpbot has quit IRC | 21:10 | |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 21:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 21:10 |
*** raildo has quit IRC | 21:12 | |
*** mjturek has quit IRC | 21:19 | |
*** salmankhan has joined #tripleo | 21:20 | |
*** ssbarnea has quit IRC | 21:21 | |
*** ssbarnea|bkp2 has joined #tripleo | 21:21 | |
*** rlandy has quit IRC | 21:40 | |
*** rh-jelabarre has quit IRC | 21:41 | |
openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Switch to Chrony by default https://review.openstack.org/611969 | 21:42 |
*** hjensas has joined #tripleo | 21:43 | |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - data + env (1/3) https://review.openstack.org/582180 | 21:44 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - network.j2 (2/3) https://review.openstack.org/582181 | 21:44 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Replace tripleo_common/utils/roles.py validate_role_yaml() https://review.openstack.org/608471 | 21:44 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - subnet fixed_ips (3/3) https://review.openstack.org/582301 | 21:44 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: Add release file for fedora 28 https://review.openstack.org/610468 | 21:58 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart-extras master: Add fedora28 support for quickstart https://review.openstack.org/591652 | 21:59 |
openstackgerrit | Sorin Sbarnea proposed openstack/tripleo-quickstart master: standalone support for quickstart on libvirt https://review.openstack.org/591540 | 22:08 |
*** ooolpbot has joined #tripleo | 22:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 22:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 22:10 |
*** ooolpbot has quit IRC | 22:10 | |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 22:10 |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 22:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 22:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 22:10 |
mwhahaha | ssbarnea: what are the patches you need for f28 (do we have a list?) | 22:13 |
*** ssbarnea has joined #tripleo | 22:21 | |
*** mcornea has quit IRC | 22:25 | |
openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: Fail correctly if can't create output files https://review.openstack.org/587405 | 22:25 |
openstackgerrit | Donny Davis proposed openstack/tripleo-heat-templates master: Adding Support for RadosGW using external Ceph Clusters https://review.openstack.org/611977 | 22:34 |
openstackgerrit | Alex Schultz proposed openstack/python-tripleoclient master: spelling fixes doc string and help strings https://review.openstack.org/602212 | 22:37 |
openstackgerrit | Nagasai Vinaykumar Kapalavai proposed openstack/tripleo-heat-templates master: Update to the ceilometer publisher list https://review.openstack.org/600843 | 22:38 |
openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-tripleo master: Make sure that the _member_ role is assigned to admin. https://review.openstack.org/611919 | 22:42 |
openstackgerrit | Nagasai Vinaykumar Kapalavai proposed openstack/puppet-tripleo master: Add a connector to Qpid router https://review.openstack.org/611979 | 22:45 |
*** lblanchard has quit IRC | 22:59 | |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - data + env (1/3) https://review.openstack.org/582180 | 23:04 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - network.j2 (2/3) https://review.openstack.org/582181 | 23:04 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: Replace tripleo_common/utils/roles.py validate_role_yaml() https://review.openstack.org/608471 | 23:04 |
openstackgerrit | Harald Jensås proposed openstack/tripleo-heat-templates master: L3 routed networks - subnet fixed_ips (3/3) https://review.openstack.org/582301 | 23:04 |
*** ooolpbot has joined #tripleo | 23:10 | |
ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797600 | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797918 | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798195 | 23:10 |
ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1798664 | 23:10 |
openstack | Launchpad bug 1797600 in tripleo "Fixed interval looping call 'nova.virt.ironic.driver.IronicDriver._wait_for_active' failed: InstanceDeployFailure: Failed to set node power state to power on." [Critical,Incomplete] | 23:10 |
*** ooolpbot has quit IRC | 23:10 | |
openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Triaged] - Assigned to Marios Andreou (marios-b) | 23:10 |
openstack | Launchpad bug 1798195 in tripleo "rdo-cloud yum repos unavailable during container updates and failing the undercloud install " [Critical,Triaged] | 23:10 |
openstack | Launchpad bug 1798664 in tripleo "ara pip install failing across various branches" [Critical,Triaged] | 23:10 |
itlinux | for lab testing does anyone think that 128GB for each controller is good enough? | 23:13 |
itlinux | thanks | 23:13 |
*** rpioso is now known as rpioso|afk | 23:15 | |
*** rfolco|rucker has quit IRC | 23:16 | |
*** bnemec has joined #tripleo | 23:25 | |
*** medberry has joined #tripleo | 23:26 | |
*** ssbarnea has quit IRC | 23:35 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!