Tuesday, 2018-09-18

*** mcornea has quit IRC00:22
*** rh-jelabarre has quit IRC00:59
*** Son_Goku has quit IRC01:08
*** cyberworm54 has quit IRC01:22
*** Son_Goku has joined #rdo01:54
*** Son_Goku has quit IRC02:16
*** ramishra has joined #rdo02:18
*** rlandy|bbl is now known as rlandy02:23
*** masonjoyers has quit IRC02:47
*** apetrich has quit IRC02:52
*** ykarel|away has joined #rdo03:01
*** ykarel|away has quit IRC03:07
rdogerritMerged rdoinfo master: Promote CBS tags update for rocky-testing  https://review.rdoproject.org/r/1621803:08
*** rlandy has quit IRC03:42
*** rlandy has joined #rdo03:50
*** rlandy has quit IRC03:53
*** udesale has joined #rdo03:53
*** ykarel|away has joined #rdo04:08
*** slaweq has joined #rdo04:11
*** slaweq has quit IRC04:16
rdogerritYatin Karel proposed rdoinfo master: Promote CBS tags update for rocky-release  https://review.rdoproject.org/r/1603404:30
*** ykarel|away has quit IRC04:34
*** ykarel|away has joined #rdo04:53
*** jaosorior has joined #rdo04:54
*** ykarel|away is now known as ykarel04:55
ykarelchkumar|ruck, sileht seeing the same tempest failure even with merged ceilometer patches:- https://centos.logs.rdoproject.org/weirdo-generic-puppet-openstack-scenario001/6306/weirdo-project/logs/testr_results.html.gz04:56
ykarellooks like it needs some other fix04:57
*** Son_Goku has joined #rdo05:02
rdogerritrdo-trunk created openstack/neutron-tempest-plugin-distgit rpm-master: python-neutron-tests-tempest: failed to build 55dfb31  https://review.rdoproject.org/r/1628805:03
*** Son_Goku has quit IRC05:12
rdogerritYatin Karel proposed rdoinfo master: Promote CBS tags update for rocky-release  https://review.rdoproject.org/r/1603405:18
chkumar|ruckykarel: http://logs.openstack.org/45/560445/143/check/tripleo-ci-centos-7-containers-multinode/6a1f478/job-output.txt.gz#_2018-09-18_00_23_39_35937105:18
chkumar|ruckykarel: seen this issue?05:18
chkumar|ruck"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true}05:18
ykarelhttp://logs.openstack.org/45/560445/143/check/tripleo-ci-centos-7-containers-multinode/6a1f478/logs/subnode-2/home/zuul/repo_setup.log.txt.gz05:19
ykarelchkumar|ruck, ^^ actual issue, seems mirror issue05:20
chkumar|ruckykarel: ah mirror issue again05:20
chkumar|ruckykarel: mirror issue will be fixed by this may be https://review.openstack.org/#/c/603054/05:27
*** quique|rover|off is now known as quiquell|rover05:31
*** jtomasek has joined #rdo05:35
*** sbonazzo has joined #rdo05:43
*** holser_ has joined #rdo05:45
ykarelchkumar|ruck, but that is abandoned05:45
chkumar|ruckykarel: https://bugs.launchpad.net/tripleo/+bug/179300605:46
openstackLaunchpad bug 1793006 in tripleo "yum repo failures in upstream mirrors" [Critical,In progress] - Assigned to wes hayutin (weshayutin)05:46
*** sbonazzo has quit IRC05:50
rdobot[sensu] NEW: master.monitoring.rdoproject.org - check-delorean-master-current @ http://tinyurl.com/y8hxewm2 |#| Build failure on centos7-master/current: neutron-tempest-plugin: http://trunk.rdoproject.org/centos7-master/report.html05:53
*** ksambor has joined #rdo06:01
chkumar|ruckykarel: looking at telemetry issue06:05
ykarelchkumar|ruck, ack06:05
*** jfrancoa has joined #rdo06:06
*** janki has joined #rdo06:08
*** jtomasek has quit IRC06:09
*** jtomasek has joined #rdo06:13
*** slaweq has joined #rdo06:19
*** rgogunskiy has joined #rdo06:20
*** rdopiera has joined #rdo06:21
*** cylopez has joined #rdo06:24
*** jtomasek has quit IRC06:35
*** quiquell|rover is now known as quique|rover|brb06:36
*** ccamposr has joined #rdo06:43
*** akrivoka has joined #rdo06:45
*** jtomasek has joined #rdo06:46
*** jlibosva has joined #rdo06:56
*** dpawlik has quit IRC06:56
*** dpawlik has joined #rdo06:57
*** assassin has joined #rdo06:59
*** jtomasek has quit IRC07:01
*** quique|rover|brb is now known as quiquell|rover07:02
*** rcernin has quit IRC07:03
*** karimb has joined #rdo07:10
*** cylopez has left #rdo07:15
*** ykarel is now known as ykarel|lunch07:31
*** aufi has joined #rdo07:36
rdogerritBernard Cafarelli proposed openstack/neutron-tempest-plugin-distgit rpm-master: Update for setup.cfg upstream changes  https://review.rdoproject.org/r/1628807:38
*** alphacc has quit IRC07:38
*** gkadam has joined #rdo07:39
*** jpich has joined #rdo07:40
rdogerritMerged rdoinfo master: Promote CBS tags update for rocky-release  https://review.rdoproject.org/r/1603407:42
*** paramite|clone has joined #rdo07:47
*** jpena|off is now known as jpena07:50
*** agopi has quit IRC07:54
chkumar|rucksileht: Hello07:55
chkumar|rucksileht: Telemetry tempest test failure is not yet fixed https://centos.logs.rdoproject.org/weirdo-generic-puppet-openstack-scenario001/6306/weirdo-project/logs/testr_results.html.gz07:56
chkumar|rucksileht: the ceilometer merged patch is used here, please have a look07:56
*** amoralej|off is now known as amoralej07:57
*** kopecmartin has joined #rdo08:00
rdogerritMerged openstack/neutron-tempest-plugin-distgit rpm-master: Update for setup.cfg upstream changes  https://review.rdoproject.org/r/1628808:10
silehtchkumar|ruck, sure08:10
*** hseipp has joined #rdo08:12
*** hseipp has joined #rdo08:12
*** tosky has joined #rdo08:16
rdobot[sensu] RESOLVED: master.monitoring.rdoproject.org - check-delorean-master-current @ http://tinyurl.com/y8hxewm2 |#| No build failures detected: http://trunk.rdoproject.org/centos7-master/report.html08:18
*** ykarel|lunch is now known as ykarel08:25
silehtchkumar|ruck, have this job ever worked ? some telemetry configuration are missing08:36
silehtchkumar|ruck, this configuration is missing in the job: https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/scenario001-multinode-containers.yaml#L112-L11908:37
silehtchkumar|ruck, so this job have never worked, where is located the environment file for this job ?08:38
*** chem has joined #rdo08:41
amoralejykarel, oooq job in ci.centos.org failed for queens with introspection issue08:45
amoralejis that known issue?08:46
amoralejthat's preventing promotion, right?08:46
ykarelamoralej, yes08:48
ykarelamoralej, not sure about there is a bug for it08:48
ykarelchkumar|ruck, ^^08:48
ykarelamoralej, i checked logs, seems some memory related while starting vms, but didn't looked much there yet08:49
rdogerritrdo-trunk created openstack/neutron-tempest-plugin-distgit rpm-master: python-neutron-tests-tempest: failed to build 55dfb31  https://review.rdoproject.org/r/1628908:49
*** derekh has joined #rdo08:49
amoralejykarel, memory issue in the physical box?08:49
ykarellet me check again, pc.ram Cannot allocate memory08:50
ykarelerror was something like ^^08:50
ykarelamoralej, Sep 18 06:07:40 undercloud.localdomain vbmc[1973]: libvirt: QEMU Driver error : internal error: process exited while connecting to monitor: Cannot set up guest memory 'pc.ram': Cannot allocate memory08:51
ykarelhttps://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-queens-rdo_trunk-minimal-130/undercloud/var/log/journal.txt.gz08:51
amoralejyeah, that's the node has not enough memory08:52
amoralejthere has been any change in sizing of undercloud or overcloud in oooq?08:53
ykarelamoralej, no08:54
ykarelit looks like cico node is of 15 gb now08:54
amoralejmmm08:54
amoralejnode is only 15gb08:54
amoralejyeah08:54
amoralejit used to be 32GB iirc08:54
ykarelearlier around 32 gb08:54
ykarelyes08:54
chkumar|rucksileht: earlier tests were passing, after the changes in telemetry tempest plugin is got broke08:55
silehtchkumar|ruck, I found the issue, this is related to another ceilometer change08:56
chkumar|rucksileht: ack thanks :-)08:56
silehtchkumar|ruck, a metric have been removed from ceilometer and that the one still used by tempest08:56
silehtchkumar|ruck, also the puppet integration test take 30-45 minutes instead 5 minutes. I update that too.08:57
amoralejykarel, i've just asked in #centos-devel08:57
ykarelamoralej, ack08:58
amoralejykarel, we may remove it from promotion criteria if there is no quick way to get 32GB servers again08:59
ykarelamoralej, agree, quiquell|rover ^^08:59
quiquell|roverthis is fs020 ?09:01
quiquell|rovermaybe it's better to disable the tempest test ?09:01
chkumar|ruckquiquell|rover: nope09:02
chkumar|ruckquiquell|rover: this jobs https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-queens-rdo_trunk-minimal-130/undercloud/var/log/journal.txt.gz09:02
quiquell|roverAhh phase109:04
quiquell|roverDoes it make sense to do phase1 promotions without that ?09:04
ykarelwe can do that as it's blocked by centos side, most of the scenarios are covered in tripleo-ci phase, this is minimal and libvirt based, and i think phase2 can test the libvirt aspect09:08
quiquell|rover ykarel fair enough09:08
quiquell|roverykarel:  do we have a lp or the like ?09:08
ykarelquiquell|rover, may be some old bug exists, no new afaik09:09
ykarelfew days back also have issue from centos side, that time also phase 1 was promoted without that tripleo job09:09
ykareli think weshay removed that from criteria, may be a bug was there09:09
ykarelbut not sure, u can find in the git history of ci-config09:10
quiquell|roverykarel: Nah will just state that in the comment09:10
ykarelack09:11
amoralejykarel,09:12
amoralej<amoralej> i guess we can't enforce minimal memory in cico client, right?09:12
amoralej<arrfab> amoralej: nope09:12
amoralejlet's temporarily remove ooq job from promotion criteria09:12
amoralejquiquell|rover, we have very good coverage for oooq deployments from tripleo promotion09:12
amoralejso i'd say it's safe to remove it temporarily09:13
amoralejwhat will be missing is oooq deploy in baremetal instead of ovb09:13
* quiquell|rover is removing it09:13
ykarelamoralej, that(baremetal deploy) should be covered by rdo phase2 i think09:14
amoralejmmmm, probably09:15
rdogerritFélix Enrique Llorente Pastora created rdo-infra/ci-config master: Disable temporally phase1 quickstart minimal  https://review.rdoproject.org/r/1629009:18
quiquell|roverchkumar|ruck, ykarel, amoralej: ^09:18
quiquell|roverThis is it ?09:19
chkumar|ruckyup09:19
ykarelyes let's promote queens,09:19
quiquell|roverok +w09:20
rdogerritMerged rdo-infra/ci-config master: Disable temporally phase1 quickstart minimal  https://review.rdoproject.org/r/1629009:25
*** kopecmartin has quit IRC09:26
*** aludwar has quit IRC09:28
*** aludwar has joined #rdo09:28
*** ksambor has quit IRC09:28
*** ksambor has joined #rdo09:33
*** shardy has joined #rdo09:34
*** dtantsur|afk is now known as dtantsur09:36
quiquell|roverchkumar|ruck: Reagarding debuging ironic issue, what kind of info you where expecting at te-broker ?09:37
quiquell|roverI mean ykarel09:39
*** puzzled has joined #rdo09:40
*** zoli is now known as zoli|lunch09:42
*** zoli|lunch is now known as zoli09:42
ykarelquiquell|rover, on bmc node logs u can check if baremetal nodes are registered there09:44
ykarelif not ipmitool commands fails09:44
ykarelsometime rdocloud issues are also gathered on those logs09:45
ykarellike network related, etc09:45
*** shardy has quit IRC09:46
*** iranzo has joined #rdo09:49
*** ykarel is now known as ykarel|away09:50
*** ykarel|away is now known as ykarel|afk09:51
iranzojaosorior++09:54
jaosorior<_<09:59
jaosorior>_>09:59
*** kopecmartin has joined #rdo10:02
*** gkadam has quit IRC10:02
*** gkadam has joined #rdo10:04
*** quiquell|rover has quit IRC10:08
*** quiquell has joined #rdo10:09
quiquellI am back10:09
quiquellykarel|afk, chkumar|ruck: I see issues at te-broker10:09
quiquellI am back Error, some other host already uses address 192.168.100.189.10:10
*** Son_Goku has joined #rdo10:11
*** gkadam has quit IRC10:21
quiquelljaosorior: We are looking at an issue with te-broker10:26
quiquelljaosorior: looks like the openstack tenant is giving us dup IPs10:26
quiquelljaosorior: for the BMC instances of OVB jobs10:27
*** kopecmartin has quit IRC10:31
rdogerritFabien Boucher created rdo-infra/rdo-infra-playbooks master: Add sfproject.io nodes into inventory  https://review.rdoproject.org/r/1629110:34
quiquelljpena: Do you know how to check what it's taking the IP 192.168.100.189 at nodepool ?10:42
quiquelljpena: openstack server list shows non with this ip10:42
jpenaquiquell: which tenant? openstack-nodepool?10:42
quiquelljpena: yep10:42
jpenalet me check10:42
quiquelljpena: I can ping it inside of te-broker10:43
*** panda has joined #rdo10:44
*** udesale has quit IRC10:47
jpenaquiquell: I have found a port with that IP. Interestingly, its state is DOWN10:49
*** dprince has joined #rdo10:50
quiquelljpena: https://codesearch.rdoproject.org/?q=192.168.100.189&i=nope&files=&repos=10:51
quiquellpacemaker ?10:51
jpenaquiquell: that looks like unit test stuff10:52
jpenaquiquell: so here's the info I found: https://review.rdoproject.org/paste/show/141/10:54
jpenathe port with that IP belongs to a VM named "bmc-1693"10:54
quiquelljpena: so the server is not up but the port  is ?10:55
jpenaactually, it looks the other way round. The server is active, but the port is DOWN10:55
jpenaI'm not sure why that machine has 4 ports in the subnet, maybe they are required for some OVB stuff10:56
pandaone port for each server10:57
pandafor each openstack node10:57
pandaovercloud10:57
*** gkadam has joined #rdo10:57
quiquellpanda: we have found issues with te-broker, not able to use ip address at BMC instances11:00
ykarel|afkquiquell, ack11:00
*** ykarel|afk is now known as ykarel11:00
quiquellpanda: looks like happening after te-broker get re-constructed11:00
quiquellhttps://bugs.launchpad.net/tripleo/+bug/1792870/+attachment/5190093/+files/bmc-1357-console.log.gz11:01
openstackLaunchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)11:01
ykarelquiquell, i have seen these errors when stack cleanups are not done11:02
quiquellykarel: There are two stacks not cleaned up11:03
ykarelmay be that ip is consumed by one of those11:03
rdogerritFabien Boucher proposed rdo-infra/rdo-infra-playbooks master: Add sfproject.io nodes into inventory  https://review.rdoproject.org/r/1629111:04
quiquellykarel: penstack port list|grep 189 don't show the port of them11:04
quiquellbut maybe somethig is lingering11:05
ykareljpena, quiquell and about the down thing, those ports are always down state, there ip's becomes active in the bmc node11:05
quiquellykarel: and bmc fails11:05
quiquellykarel: at cloud-init11:05
ykarelyup similar issues appeared in past, good to find the bug, more info can be found there11:06
ykarellet me see if i can find11:06
quiquellkforde was more of a kforCe to do a real cleanup when scrit cannot do it11:07
ykarelquiquell, from irc history:11:08
ykarelsome other host already11:08
ykarelAug 06 20:28:16 <weshay>        [   67.608590] os-net-config[2461]: [2018/08/06 12:18:31 PM] RROR] stdout: ERROR    : [/etc/sysconfig/network-scripts/ifup-eth] Error, some other host already uses address 192.168.102.248.11:08
ykarelAug 06 20:29:01 <kforde>        weshay: let's see11:08
ykarelAug 06 20:29:14 <weshay>        kforde, maybe we have old stacks messin us up11:08
ykarelAug 06 20:29:33 <kforde>        weshay: you do have some old stacks pending cleanup iirc11:08
*** amoralej is now known as amoralej|lunch11:08
quiquellkforde is not around11:08
ykarelsee #rhos-ops11:08
ykarelsee/try11:09
quiquellykarel: will do11:10
ykarelack11:10
*** kopecmartin has joined #rdo11:14
*** artom has joined #rdo11:15
ykarelquiquell, the two stacks name?11:15
ykarelis that 1693 one?11:15
quiquellykarel:11:15
quiquell455 and 43111:15
rdogerritJavier Peña proposed rdo-infra/rdo-infra-playbooks master: Add playbooks to setup the RDO Trunk replicated DB  https://review.rdoproject.org/r/1628511:15
ykarelquiquell, so those are different, 1693 is the failing one?11:16
quiquellykarel: it will, it's still running, logs will appear soon11:16
ykarelokk11:16
quiquellor this is what I think...11:16
ykarelquiquell, so if u can ssh to the bmc node(for those two stack) then it can be confirmed11:17
*** gfidente has joined #rdo11:18
quiquellykarel: confirmed11:18
quiquellbaremetal-431-0 was using 192.168.100.189 as ip for their BMC11:19
quiquellsomething is lingering11:19
ykarelquiquell, and what is openstack server list|grep bmc-43111:21
quiquellykarel: this will not work, instances have being removed, but something is lingering in the stack11:21
quiquellykarel: some port or th elike11:22
ykarelquiquell, mmm strange11:22
ykarelquiquell, so how u confirmed baremetal-431-0 was using11:23
ykarelbmc-logs11:23
quiquellhttp://38.145.33.166/testenv-worker.log11:24
quiquelllook for baremetal-431-0 you get the address it will use for PM11:24
quiquellthat means that their BMC is using it11:24
quiquellchkumar|ruck: https://bugs.launchpad.net/tripleo/+bug/1792872 have to be a dup of the other11:26
openstackLaunchpad bug 1792872 in tripleo "[queens] overcloud prepare image failed by giving IronicAction.node.set_provision_state failed: 'NoneType' object has no attribute '__getitem_" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)11:26
ykarelquiquell, is utility_bmc-431 also deleted?11:28
quiquellykarel: that's a port ?11:28
ykarelserver11:28
quiquellbmc-431 is still there11:29
ykarelhmm that's issue11:30
chkumar|ruckquiquell: quiquell for this one https://bugs.launchpad.net/tripleo/+bug/1792870 ?11:30
openstackLaunchpad bug 1792870 in tripleo "[Rocky] FS01 periodic job failed at overcloud prepare image giving Error: Unable to establish IPMI v2 / RMCP+ session\n'.: ProcessExecutionError: Unexpected error while running command" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)11:30
ykarelquiquell, if u ssh to that u can find multiple ips active there11:31
quiquellykarel: Cannot ssh it11:32
ykarelreason? ssh key or something else?11:32
quiquellyep11:33
quiquellkey11:33
ykareli think key is in te-broker at some place11:34
ykareland which user u trying11:35
quiquellykarel: all I know of :-)11:35
ykareltry centos as well11:35
*** leanderthal has joined #rdo11:35
ykarelquiquell, may be panda knows where priv key for tripleo-cd-admins11:38
ykarelor someone else11:38
*** jpena is now known as jpena|lunch11:38
ykarelquiquell, once confirmed, until cleanup is done, u can poweroff that bmc-43111:38
*** gkadam has quit IRC11:39
*** gkadam has joined #rdo11:40
*** cyberworm54 has joined #rdo11:40
quiquellpanda: Do you know how to access BMC instances at nodepool ? we don't find the ssh key11:41
ykarelquiquell, okk so these admins can ssh those11:41
ykarelhttps://github.com/openstack-infra/tripleo-ci/blob/master/scripts/tripleo-cd-admins11:41
quiquellderekh: Can you access bmc instances ?11:42
chkumar|ruckquiquell: may jaosorior can have access11:43
quiquelljaosorior: Can you access bmc instances ?11:43
chkumar|ruckor panda ^^11:43
pandaquiquell: give me an IP11:44
quiquellpanda:  192.168.100.10311:46
pandammmh11:47
ykarelquiquell, chkumar|ruck 019 passed with ur test patch11:48
chkumar|ruckyup https://logs.rdoproject.org/43/13943/32/check/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-master/27d65fd/11:48
chkumar|ruckykarel: testing it for rocky11:48
quiquellykarel: yep, confirme dthat it was using the change :-)11:49
ykarelchkumar|ruck, i doubt it works for rocky, tripleo-common patch is for master, but good to try11:51
ykarelchkumar|ruck, okk tripleo-common change is just default, so it should work with just tqe change11:52
chkumar|ruckykarel: yes11:52
*** leanderthal has quit IRC11:53
derekhquiquell: my info on this may be way outdated but have you a public IP for the undercloud node so I can try to get to that first to hope to the bmc?11:53
quiquellderekh: btw do you have super powers to cleanup some stacks that are lingering there ?11:54
*** thrash|g0ne is now known as thrash11:54
derekhquiquell: any super powers I used to have are now gone, others now run the CI stuff, sorry11:55
quiquellderekh: we don't have undercloud, is a broken stack with some images not suppose to be there :-(11:55
derekhahhh, afraid I can't help so, indeed you'll need somebody with the super powers11:56
rdogerritMarc Dequènes (Duck) proposed rdo-infra/rdo-infra-playbooks master: Moved web-related rules from OSAS repo  https://review.rdoproject.org/r/1622711:57
*** dprince has quit IRC11:57
*** agopi has joined #rdo11:57
*** gkadam has quit IRC12:06
pandaquiquell: I can't seem to have access12:08
*** cyberworm54 has quit IRC12:08
pandaquiquell: tried all the keys i could12:08
quiquellpanda: kforde is going to clean those up12:09
*** cyberworm54 has joined #rdo12:10
*** jtomasek has joined #rdo12:16
*** mcornea has joined #rdo12:16
ykarelegonzalez, both openstack-tempest-all and collect-gnocchi are now in centos rocky:- http://mirror.centos.org/centos/7/cloud/x86_64/openstack-rocky/12:22
*** kopecmartin has quit IRC12:22
*** hseipp has quit IRC12:23
*** hseipp has joined #rdo12:26
*** trown|outtypewww is now known as trown12:26
rdogerritYatin Karel created rdo-jobs master: Revert "Revert "Revert "Update timeout to 3 hours for validate-buildsys-tags"""  https://review.rdoproject.org/r/1629212:31
rdogerritYatin Karel created config master: Revert "Revert "Revert "Increase timeout for update-buildsys-tag job"""  https://review.rdoproject.org/r/1629312:31
*** chkumar|ruck is now known as chkumar|off12:32
rdogerritLuigi Toscano created rdoinfo master: Bump openstack-sahara-tests to 0.7.0  https://review.rdoproject.org/r/1629412:36
*** jpena|lunch is now known as jpena12:38
rdogerritFabien Boucher proposed rdo-infra/rdo-infra-playbooks master: Add sfproject.io nodes into inventory  https://review.rdoproject.org/r/1629112:40
*** dtantsur is now known as dtantsur|brb12:40
*** imcleod has joined #rdo12:40
*** imcleod has quit IRC12:42
*** rlandy has joined #rdo12:42
rdogerritMerged openstack/ironic-distgit rocky-rdo: Use copytruncate when rotating logs  https://review.rdoproject.org/r/1628612:42
*** imcleod has joined #rdo12:44
ykarelquiquell, that ironic inspector issue should be seen in phase 2 queens as well if it runs non-containerized undercloud12:46
ykareljust a heads up12:46
ykarelif u see there12:46
quiquellykarel: ack12:47
ykareland in downstream jobs too, jschlueter ^^12:47
ykarelafter the import12:47
jschlueterykarel: for queens/OSP 13 ack we run non-containerized undercloud12:49
jschlueterykarel: which issue would be seen?12:49
ykareljschlueter, systemctl start for openstack-ironic-inspector-dnsmasq fail12:50
jschlueterykarel: k LP for it?12:50
jschlueterquiquell: ^^12:50
ykareljschlueter, https://bugs.launchpad.net/tripleo/+bug/179307312:50
openstackLaunchpad bug 1793073 in tripleo "[queens] fs01 noop job failed with Stderr: u'/usr/bin/ironic-inspector-rootwrap: Unauthorized command: systemctl start openstack-ironic-inspector-dnsmasq.service (no filter matched)" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)12:50
quiquellykarel: still not at promotion12:51
ykarelquiquell, any active issues for queens tripleo-ci?12:51
number80amoralej|lunch, jpena: +W for https://review.rdoproject.org/r/#/c/16272/ ?12:52
number80(can wait after lunch :) )12:52
jpenayep, let's go12:52
quiquellykarel: I think this is it for now...12:53
ykarelquiquell, promotion will solve that issue12:53
ykarelquiquell, what is blocking promotion for consistent -> current-tripleo12:54
*** kopecmartin has joined #rdo12:54
* quiquell checking12:54
quiquellykarel: the last promotion failed at featureset01912:55
quiquellykarel: Can be the ceph thing, but the issue is different12:56
*** kgiusti has joined #rdo12:56
rdogerritMerged rdo-infra/puppet-dlrn master: Change the minute for the update-build-deps cron job  https://review.rdoproject.org/r/1627212:57
rdogerritMerged rdo-infra/rdo-infra-playbooks master: Improve instructions to fetch requirements  https://review.rdoproject.org/r/1625613:01
*** cyberworm54 has quit IRC13:02
tobias-urdinykarel: when will this be merged? :) https://review.rdoproject.org/r/#/c/16262/113:03
rdogerritYatin Karel proposed rdoinfo master: Promote CBS tags update for queens-release  https://review.rdoproject.org/r/1626213:04
ykareltobias-urdin, it should be clear now, will try to get it today13:05
ykareldid a rebase13:05
tobias-urdinykarel: ty!13:07
*** jtomasek has quit IRC13:08
*** jtomasek has joined #rdo13:11
*** cyberworm54 has joined #rdo13:13
*** quiquell is now known as quique|rover|lch13:14
*** fultonj is now known as fultonj|afk13:14
*** mjturek has joined #rdo13:15
rdogerritJavier Peña proposed rdo-infra/rdo-infra-playbooks master: Moved web-related rules from OSAS repo  https://review.rdoproject.org/r/1622713:16
*** baha has joined #rdo13:19
rdogerritYatin Karel created rdoinfo master: Add missing packages from stein-testing  https://review.rdoproject.org/r/1629513:20
ykareli skipped paunch, lz4 last time due to dependency issue, let's fix those now13:22
ykarellibvarlink, python-django-debreach should be stein only, currently those are added for rocky, good to check if anything apart from those are in rocky13:23
ykarelamoralej|lunch, jpena ^^13:23
* ykarel checking any other stein package added to rocky13:24
*** agopi has quit IRC13:24
* ykarel ok so can find only those two13:25
*** dustins has joined #rdo13:26
*** rh-jelabarre has joined #rdo13:28
*** amoralej|lunch is now known as amoralej13:30
amoralejykarel, those packages are in rdo trunk13:30
amoralejwhy do we need them in stein-testing tag?13:30
*** cyberworm54 has quit IRC13:31
amoralejykarel, packages in rdo.yml should not be in stein-testing buildsys tag13:32
amoralejonly dependencies13:32
ykarelamoralej, am talking about libvarlink and python-django-debreach,13:33
ykarelmay be two reviews mixed13:33
amoraleji was revieweing the   https://review.rdoproject.org/r/1629513:33
ykarelokk got ur point now13:34
amoralejykarel, i'll send also a review to remove all stein-testing tags in rdo.yml13:36
ykarelamoralej, ack, just to understand, what issue that causes13:36
amoralejcurrently none :)13:36
ykarelopenstack packages in -testing tag13:36
ykarelamoralej, then why revert?13:37
amoralejbecause the deps synchronization script is clever enough to not include packages in the deps repo13:37
amoralejonly packages in deps.yml is taken into account13:37
amoralejand synchronization to buildlogs is still not enabled13:37
amoralejbut when sync to buildlogs is enabled we will end up with rocky packages in stein repo13:38
amoralejwhich is not correct13:38
amoralejit's like cross-tagging rocky packages to stein13:38
amoralejin fact, we've done it13:38
amoralejmmm13:38
amoralejwe'll have to remove those cross-tags13:38
amoraleji don't want a rocky nova version cross-tagged into stein13:39
amoralejdid i explain clear enough?13:39
ykarelhmm that patch tagged those13:39
*** quique|rover|lch is now known as quiquell|rover13:40
ykarelamoralej, yes all clear now13:40
ykarelamoralej, i didn't took this into account when i proposed that patch13:40
amoralejno problem13:40
ykareland reviewers also missed that13:40
ykarel:)13:40
amoralejit's a bit tricky13:42
ykarelhmm agree13:42
rdogerritYatin Karel proposed rdoinfo master: Add missing packages from stein-testing  https://review.rdoproject.org/r/1629513:42
ykareland what about those packages which are stein but added in rocky13:43
ykareli mean libvarlink and python-django-debreach13:43
amoralejykarel, but those are deps?13:44
amoralejor openstack packages?13:44
ykarelamoralej, yes those are deps13:44
amoralejfor  libvarlink i see it has been added to both stein and rocky13:45
ykareldebreach too13:46
*** agopi has joined #rdo13:46
amoralejso the problem is that they are not required in rocky?13:46
ykarelyes13:47
ykarelexactly13:48
amoralejwe can remove it from rdoinfo and cbs tags13:48
ykareldjango-debreach required for horizon, and libvarlink i think for podman switch13:48
amoraleji mean rocky tags13:48
amoralejbut that will not remove it from the deps actual repo13:48
*** apetrich has joined #rdo13:48
amoralejfor it we need to do it manually13:49
amoralejin trunk-primary and trunk13:49
ykarelatleast, tag should be removed, so bot do not propose it to rocky-release13:49
ykareli meant rocky-testing tag13:50
rdogerritMerged rdo-infra/rdo-infra-playbooks master: Moved web-related rules from OSAS repo  https://review.rdoproject.org/r/1622713:51
*** Son_Goku has quit IRC13:53
sfbenderJakub Ružička proposed rpmreq master: Add last_version to query existing packages  https://softwarefactory-project.io/r/1364113:53
rdogerritAlfredo Moralejo created rdoinfo master: Remove OpenStack packages from buildsys stein-testing tag  https://review.rdoproject.org/r/1629613:55
amoralejykarel, yeah,13:55
amoralejpropose the review to rdoinfo13:55
amoralejand i'll untag13:55
*** ktibi has joined #rdo13:56
*** mjturek has quit IRC13:57
ykarelamoralej, ack13:57
*** kgiusti has quit IRC13:58
*** radeks_ has joined #rdo13:58
weshayany RDO folks attending the tripleo community mtg today?14:00
*** florianf is now known as florianf|biab14:01
*** fultonj|afk is now known as fultonj14:01
quiquell|roverykarel: queens issue at fs019 is different than masetr and rocky https://logs.rdoproject.org/openstack-periodic-24hr/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-queens/ba29e20/logs/undercloud/var/log/mistral/executor.log.txt.gz?#_2018-09-18_06_03_49_43414:04
*** dciabrin has joined #rdo14:05
ykarelthat issue is generic i think14:05
ykarelit just checks for overcloud container, and in the beginning it's expected to not exist14:06
*** mjturek has joined #rdo14:06
quiquell|roverykarel: maybe this ? https://logs.rdoproject.org/openstack-periodic-24hr/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-queens/ba29e20/logs/undercloud/var/log/mistral/executor.log.txt.gz#_2018-09-18_06_34_39_37314:08
*** dtantsur|brb is now known as dtantsur14:09
quiquell|roverykarel: Ahh na is the same as master and rocky https://logs.rdoproject.org/openstack-periodic-24hr/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-queens/ba29e20/logs/subnode-2/var/log/extra/docker/containers/ceph-rgw-upstream-centos-7-rdo-cloud-tripleo-0000179888/docker_info.log.txt.gz14:09
ykarelquiquell|rover, ack14:10
sfbenderMerged rpmreq master: Add last_version to query existing packages  https://softwarefactory-project.io/r/1364114:10
rdogerritNicolas HICHER created rdo-jobs master: test-requirements: blacklist sphinx 1.8.0  https://review.rdoproject.org/r/1629714:12
*** Son_Goku has joined #rdo14:13
*** radeks_ has quit IRC14:14
rdogerritrdo-trunk created openstack/octavia-distgit pike-rdo: openstack-octavia-1.0.3-1  https://review.rdoproject.org/r/1629814:15
*** ykarel is now known as ykarel|away14:16
*** jfrancoa has quit IRC14:17
*** quiquell|rover is now known as quique|rover|off14:17
number80https://review.rdoproject.org/r/#/c/14921/14:20
rdogerritJavier Peña proposed rdo-infra/rdo-infra-playbooks master: Add playbooks to setup the RDO Trunk replicated DB  https://review.rdoproject.org/r/1628514:20
number80^ one review that needs some attention :)14:20
*** jfrancoa has joined #rdo14:20
rdogerritrdo-trunk created openstack/neutron-distgit queens-rdo: openstack-neutron-12.0.4-1  https://review.rdoproject.org/r/1629914:26
*** zul has joined #rdo14:26
rdogerritFabien Boucher proposed rdo-infra/rdo-infra-playbooks master: Add sfproject.io nodes into inventory  https://review.rdoproject.org/r/1629114:27
*** cyberworm54 has joined #rdo14:27
*** jfrancoa has quit IRC14:27
sfbenderJakub Ružička created rpmreq master: Add support for basic RPM macro substitution  https://softwarefactory-project.io/r/1366514:27
rdogerritUser bfournie created openstack/ironic-distgit queens-rdo: Use copytruncate when rotating logs  https://review.rdoproject.org/r/1630014:28
rdogerritUser bfournie created openstack/ironic-inspector-distgit queens-rdo: Use copytruncate when rotating logs  https://review.rdoproject.org/r/1630114:28
*** kgiusti has joined #rdo14:31
*** cyberworm54 has quit IRC14:34
*** ykarel|away has quit IRC14:36
*** rgogunskiy has quit IRC14:40
*** dpawlik has quit IRC14:40
*** mjturek has quit IRC14:43
*** ktibi has quit IRC14:46
*** mjturek has joined #rdo14:47
*** paramite|clone has quit IRC14:55
*** hamzy has quit IRC14:56
*** hamzy has joined #rdo14:58
rdogerritMerged openstack/ironic-distgit queens-rdo: Use copytruncate when rotating logs  https://review.rdoproject.org/r/1630015:01
rdogerritMerged openstack/ironic-inspector-distgit queens-rdo: Use copytruncate when rotating logs  https://review.rdoproject.org/r/1630115:01
*** ksambor has quit IRC15:04
rdogerritNicolas HICHER proposed rdo-jobs master: tripleo-ci legacy: use hostvar to set /etc/nodepool/provider  https://review.rdoproject.org/r/1591915:06
*** ramishra has quit IRC15:07
*** zul has quit IRC15:08
*** dpawlik has joined #rdo15:10
rdogerritJavier Peña created rdo-jobs master: Remove logserver job for rdo-infra-playbooks  https://review.rdoproject.org/r/1630215:11
*** iranzo has quit IRC15:13
*** aufi has quit IRC15:14
*** dpawlik has quit IRC15:15
*** florianf|biab is now known as florianf15:15
rdogerritJavier Peña created config master: Remove logserver job from rdo-infra-playbooks  https://review.rdoproject.org/r/1630315:16
rdogerritJavier Peña proposed rdo-jobs master: Remove logserver job for rdo-infra-playbooks  https://review.rdoproject.org/r/1630215:16
rdogerritJavier Peña created rdo-infra/rdo-infra-playbooks master: Remove leftovers for logserver  https://review.rdoproject.org/r/1630415:17
*** zul has joined #rdo15:18
*** amuller has joined #rdo15:24
*** MrWatson is now known as NostawRm15:26
rdogerritMerged openstack/neutron-distgit queens-rdo: openstack-neutron-12.0.4-1  https://review.rdoproject.org/r/1629915:29
rdogerritMerged openstack/heat-distgit pike-rdo: openstack-heat-9.0.5-1  https://review.rdoproject.org/r/1613615:30
rdogerritNicolas HICHER proposed rdo-jobs master: tripleo-ci legacy: use hostvar to set /etc/nodepool/provider  https://review.rdoproject.org/r/1591915:30
*** iranzo has joined #rdo15:31
*** dprince has joined #rdo15:39
*** dprince has quit IRC15:40
*** dprince has joined #rdo15:40
*** cyberworm54 has joined #rdo15:43
*** kgiusti has quit IRC15:44
*** kgiusti has joined #rdo15:45
*** iranzo has quit IRC15:45
*** cyberworm54 has quit IRC15:47
*** kgiusti has quit IRC15:50
*** cyberworm54 has joined #rdo15:51
sfbenderJakub Ružička proposed rpmreq master: Add support for basic RPM macro substitution  https://softwarefactory-project.io/r/1366515:53
*** cyberworm54 has quit IRC15:55
*** cyberworm54 has joined #rdo15:56
*** rdopiera has quit IRC16:00
*** hamzy has quit IRC16:01
*** cyberworm54 has quit IRC16:01
*** cyberworm54 has joined #rdo16:02
*** gkadam has joined #rdo16:02
*** kgiusti has joined #rdo16:04
sfbenderJakub Ružička proposed rpmreq master: Add support for basic RPM macro substitution  https://softwarefactory-project.io/r/1366516:07
rdogerritJill R proposed rdoinfo master: Import ansible-role-tripleo-keystone  https://review.rdoproject.org/r/1503916:08
*** thrash is now known as thrash|biab16:09
*** mjturek has quit IRC16:10
*** ykarel|away has joined #rdo16:10
*** Son_Goku has quit IRC16:10
rdogerritwes hayutin created rdo-jobs master: add 3rd party rocky jobs  https://review.rdoproject.org/r/1630516:11
*** mjturek has joined #rdo16:12
sfbenderJakub Ružička created rpmreq master: Include rpmvercmp.py for RPM version comparison  https://softwarefactory-project.io/r/1366716:13
*** rlandy is now known as rlandy|brb16:14
*** zoli is now known as zoli|gone16:18
*** zoli|gone is now known as zoli16:18
jillrcan I please get reviews on https://review.rdoproject.org/r/#/c/15039/ ?16:18
*** Son_Goku has joined #rdo16:20
*** mjturek has quit IRC16:22
sfbenderJakub Ružička proposed rpmreq master: Include rpmvercmp.py for RPM version comparison  https://softwarefactory-project.io/r/1366716:23
*** holser_ has quit IRC16:23
*** hseipp has quit IRC16:26
*** Son_Goku has quit IRC16:28
*** bnemec has quit IRC16:28
*** dtantsur is now known as dtantsur|afk16:28
*** bnemec has joined #rdo16:28
*** jpich has quit IRC16:33
*** thrash|biab is now known as thrash16:35
rdogerritwes hayutin created rdo-jobs master: move 3rd party upgrade jobs to experimental  https://review.rdoproject.org/r/1630616:38
*** rlandy|brb is now known as rlandy16:38
*** mjturek has joined #rdo16:40
rdogerritAlfredo Moralejo proposed openstack/mistral-distgit rpm-master: Create python2/python3 package depending on distro  https://review.rdoproject.org/r/1524716:41
rdogerritMerged rdoinfo master: Promote CBS tags update for queens-release  https://review.rdoproject.org/r/1626216:42
rdogerritAlfredo Moralejo proposed rdoinfo master: Import ansible-role-tripleo-keystone  https://review.rdoproject.org/r/1503916:44
*** mjturek has quit IRC16:45
*** ccamposr has quit IRC16:49
*** amoralej is now known as amoralej|off16:50
honzanumber80: could you push this across the finish line?  https://review.rdoproject.org/r/#/c/16261/116:51
*** dciabrin has quit IRC16:51
number80honza: ack16:51
rdogerritLee Yarwood created openstack/nova-distgit pike-rdo: Require python2-tooz >= 1.58.0  https://review.rdoproject.org/r/1630716:53
rdogerritLee Yarwood proposed openstack/nova-distgit pike-rdo: Require python-tooz >= 1.58.0  https://review.rdoproject.org/r/1630716:55
rdogerritMerged openstack/octavia-distgit pike-rdo: openstack-octavia-1.0.3-1  https://review.rdoproject.org/r/1629816:57
number80honza: not sure what was the issue with CI16:59
*** dsneddon has joined #rdo17:00
*** kopecmartin has quit IRC17:01
*** jpena is now known as jpena|off17:02
*** derekh has quit IRC17:02
*** gfidente is now known as gfidente|afk17:04
*** gkadam has quit IRC17:07
*** dsneddon has quit IRC17:10
rdogerritMerged openstack/tripleo-ui-distgit rpm-master: Upgrade dependency version to Stein  https://review.rdoproject.org/r/1626117:12
*** jchhatbar has joined #rdo17:14
*** akhila has joined #rdo17:15
*** janki has quit IRC17:17
*** dpawlik has joined #rdo17:23
*** dpawlik has quit IRC17:24
*** amuller has quit IRC17:24
*** dpawlik has joined #rdo17:24
honzanumber80: thanks17:27
*** dsneddon has joined #rdo17:32
*** masonjoyers has joined #rdo17:35
*** mmercer has joined #rdo17:40
*** jchhatbar has quit IRC17:40
rdogerritEmilien Macchi proposed openstack/paunch-distgit rpm-master: Add support for podman  https://review.rdoproject.org/r/1628017:41
*** dpawlik has quit IRC17:48
*** jlibosva has quit IRC17:48
rdogerritRonelle Landy created config master: Revert "Revert "Add first native zuul v3 job""  https://review.rdoproject.org/r/1630917:53
rdogerritwes hayutin proposed rdo-jobs master: add 3rd party rocky jobs  https://review.rdoproject.org/r/1630517:56
*** gfidente|afk has quit IRC17:59
*** trown is now known as trown|lunch18:00
*** cyberworm54 has quit IRC18:01
*** panda is now known as panda|dinner18:01
*** cyberworm54 has joined #rdo18:02
*** cyberworm54 has quit IRC18:04
*** ykarel|away has quit IRC18:10
*** mjturek has joined #rdo18:16
*** cyberworm54 has joined #rdo18:25
*** cyberworm54 has quit IRC18:28
*** cyberworm54 has joined #rdo18:36
*** cyberworm54 has quit IRC18:38
*** dustins has quit IRC18:52
*** trown|lunch is now known as trown18:55
*** assassin has quit IRC18:59
*** hamzy has joined #rdo19:04
*** panda|dinner is now known as panda19:30
*** mjturek has quit IRC19:34
*** dneary has joined #rdo19:34
*** dpawlik has joined #rdo19:48
*** dustins has joined #rdo19:48
*** mjturek has joined #rdo19:49
*** dpawlik has quit IRC19:52
*** rdogerrit has quit IRC20:00
*** stevebaker has quit IRC20:01
*** sfbender has quit IRC20:01
*** dmellado has quit IRC20:01
*** dneary has quit IRC20:02
*** rdobot has quit IRC20:02
*** dneary has joined #rdo20:02
*** cgoncalves is now known as cgoncalves|pto20:13
*** akrivoka has quit IRC20:17
*** NostawRm has quit IRC20:17
*** NostawRm has joined #rdo20:20
*** akhila has quit IRC20:35
*** karimb has quit IRC20:41
*** panda has quit IRC20:41
*** baha has quit IRC20:42
*** hamzy has quit IRC20:47
*** mjturek has quit IRC20:47
*** mmercer has quit IRC20:51
*** rh-jelabarre has quit IRC20:53
*** weshay is now known as weshay_pto20:53
*** mmercer has joined #rdo20:53
*** kgiusti has left #rdo20:58
*** trown is now known as trown|outtypewww21:06
*** chem has quit IRC21:11
*** mmercer has quit IRC21:17
*** dprince has quit IRC21:19
*** mmercer has joined #rdo21:20
*** dmellado has joined #rdo21:20
*** rlandy has quit IRC21:31
*** agopi has quit IRC21:32
*** stevebaker has joined #rdo21:36
*** mcornea has quit IRC21:42
*** dustins has quit IRC21:59
*** sshnaidm|ptg has joined #rdo22:00
*** sshnaidm|ptg is now known as sshnaidm|pto22:00
*** florianf is now known as florianf|afk22:03
*** agopi has joined #rdo22:05
*** cyberworm54 has joined #rdo22:18
*** rdogerrit has joined #rdo22:19
rdogerritMerged rdo-infra/ci-config master: Add ovb tracking script  https://review.rdoproject.org/r/1627722:19
*** slaweq has quit IRC22:26
rdogerritMerged rdo-infra/ci-config master: Add influxdb stats to te-broker crontab  https://review.rdoproject.org/r/1628422:27
*** jaosorior_ has joined #rdo22:43
*** jaosorior has quit IRC22:45
*** rcernin has joined #rdo22:47
*** janki has joined #rdo22:47
*** dpawlik has joined #rdo22:49
*** dpawlik has quit IRC22:53
*** sshnaidm|pto has quit IRC22:59
*** dhill_ has quit IRC22:59
*** dneary has quit IRC23:02
*** cyberworm54 has quit IRC23:05
*** tosky has quit IRC23:18
*** dmacpher has quit IRC23:26
*** gfidente has joined #rdo23:33
*** gfidente has quit IRC23:37

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!