Monday, 2019-08-12

*** yolanda has quit IRC00:12
*** yolanda has joined #oooq00:13
*** dsneddon has joined #oooq01:32
*** dsneddon has quit IRC01:37
*** apetrich has quit IRC02:08
*** yolanda has quit IRC02:32
*** yolanda has joined #oooq02:37
*** yolanda has quit IRC02:43
*** yolanda has joined #oooq02:44
*** rfolco has quit IRC02:49
*** aakarsh has quit IRC02:55
*** yolanda has quit IRC03:17
*** yolanda has joined #oooq03:22
*** dsneddon has joined #oooq03:32
*** ykarel|away has joined #oooq03:35
*** dsneddon has quit IRC03:37
*** surpatil has joined #oooq03:45
*** udesale has joined #oooq04:04
*** ykarel|away has quit IRC04:11
sshnaidmraukadah, http://logs.rdoproject.org/01/21801/1/check/periodic-tripleo-ci-rhel-8-standalone-master/151d847/job-output.txt.gz04:20
raukadahlooking04:21
raukadahhttps://github.com/openstack/openstack-ansible-os_tempest/blob/master/vars/redhat-8.yml#L3904:22
raukadahfixing it04:22
raukadahsshnaidm: https://review.opendev.org/#/c/675809/04:24
* raukadah gets ready for work04:24
*** ykarel|away has joined #oooq04:27
*** ykarel|away is now known as ykarel04:34
*** raukadah is now known as chkumar|ruck05:10
*** ksambor has quit IRC05:11
*** ksambor has joined #oooq05:14
sshnaidmchkumar|ruck, rerunning with your patch: https://review.rdoproject.org/r/2180105:29
*** sshnaidm is now known as sshnaidm|afk05:29
*** dsneddon has joined #oooq05:33
*** ratailor has joined #oooq05:35
*** dsneddon has quit IRC05:39
*** marios has joined #oooq05:43
*** surpatil has quit IRC05:44
*** surpatil has joined #oooq05:48
chkumar|rucksshnaidm|afk: ok05:50
chkumar|rucksshnaidm|afk: please have a look at https://etherpad.openstack.org/p/ruckroversprint14 l50 to l5305:55
*** jfrancoa has joined #oooq06:05
*** jfrancoa has quit IRC06:10
*** jfrancoa has joined #oooq06:20
*** surpatil has quit IRC06:20
*** surpatil has joined #oooq06:21
*** dtantsur|afk is now known as dtantsur06:42
*** Goneri has joined #oooq06:53
*** surpatil has quit IRC07:04
*** surpatil has joined #oooq07:05
chkumar|ruckmarios: sshnaidm|afk ykarel https://review.opendev.org/#/c/675563/ container build check job fix07:05
ykarelack07:08
*** saneax has joined #oooq07:09
marioschkumar|ruck: o/ urgh that git ls-remote thing though :/07:10
marioslovely breakfast07:10
* marios swigs coffee07:10
chkumar|ruckmarios: If I store in a var then do echo var then it floods the ci console logs07:11
*** bogdando has joined #oooq07:14
*** tesseract has joined #oooq07:14
*** tosky has joined #oooq07:17
marioschkumar|ruck: k, but please check ... esp the wc -l -eq 1 bit is unnecessary07:17
marioschkumar|ruck: and please revisit the commit message a bit? (do we need bug?)07:17
chkumar|ruckmarios: ok, I will create , will update the commit meesgae07:18
marioschkumar|ruck: thanks but also see https://review.opendev.org/#/c/675563/6/roles/build-containers/tasks/main.yaml about the 10:17 < marios> chkumar|ruck: k, but please check ... esp the wc -l -eq 1 bit is unnecessary07:18
*** kopecmartin|off is now known as kopecmartin07:18
*** amoralej|off is now known as amoralej07:22
*** jpena|off is now known as jpena07:25
*** dsneddon has joined #oooq07:30
*** panda has quit IRC07:30
*** ykarel is now known as ykarel|lunch07:33
*** panda has joined #oooq07:33
*** zbr is now known as zbr|flu07:47
*** brault has quit IRC08:03
*** dsneddon has quit IRC08:34
*** derekh has joined #oooq08:37
*** tesseract has quit IRC08:42
*** saneax has quit IRC08:42
*** jschluet has quit IRC08:42
*** saneax has joined #oooq08:43
*** tesseract has joined #oooq08:43
*** ykarel|lunch is now known as ykarel08:46
*** jschluet has joined #oooq08:47
*** irclogbot_2 has quit IRC08:49
*** irclogbot_0 has joined #oooq08:51
*** jaosorior has joined #oooq09:07
*** sshnaidm|afk is now known as sshnaidm09:52
arxcruzsshnaidm: did you handle the ansible 2.8 upgrade already right ?09:59
*** jfrancoa has quit IRC10:02
sshnaidmarxcruz, we use 2.8 with oooq if you ask about that10:07
marios" Bump tripleo quickstart ansible to 2.8" https://review.opendev.org/#/c/667219/18 Idebd929b40097442feee3efbdee3084cb38c983810:08
chkumar|rucksshnaidm: collectd package is now available in RHUI10:08
chkumar|rucksshnaidm: https://bugs.launchpad.net/tripleo/+bug/1839423/comments/410:08
openstackLaunchpad bug 1839423 in tripleo "[RHEL-8][container-build]No match for argument: collectd-sensubility" [Critical,In progress] - Assigned to chandan kumar (chkumar246)10:08
sshnaidmchkumar|ruck, nice10:08
arxcruzsshnaidm: i was talking about this https://tree.taiga.io/project/tripleo-ci-board/us/1217?milestone=23693310:09
sshnaidmchkumar|ruck, containers were built for 2569.. hash10:09
sshnaidmarxcruz, need to check now if zuul in rdo can use ansible 2.810:10
chkumar|rucksshnaidm: yes correct10:10
sshnaidmchkumar|ruck, at least I can use it now..10:10
chkumar|rucksshnaidm:  =:-)10:12
chkumar|rucksshnaidm: marios https://review.opendev.org/#/c/675860/ and https://review.opendev.org/#/c/675859/ reverts10:12
chkumar|rucksshnaidm: https://review.rdoproject.org/r/#/c/21804/10:13
chkumar|ruckneeds +w on this10:13
marioschkumar|ruck: make me!10:13
marios(done)10:13
sshnaidmchkumar|ruck, did it start to pass?10:14
chkumar|rucksshnaidm: nope, we are adding to make sure os_tempest changes works10:15
sshnaidmchkumar|ruck, always failing job won't add too much value..10:16
*** jfrancoa has joined #oooq10:17
chkumar|ruck-w on above patch, will wait10:18
arxcruzzbr|flu: you should also change your name to zbr on gerrit as well :P10:28
chkumar|rucksshnaidm: we have no ara report generation on RHEL standalone job https://logs.rdoproject.org/01/21801/3/check/periodic-tripleo-ci-rhel-8-standalone-master/9ce67a3/logs/10:28
*** dsneddon has joined #oooq10:30
sshnaidmchkumar|ruck, ack, will look10:32
chkumar|rucksshnaidm: https://github.com/openstack/tripleo-quickstart/blob/master/ansible.cfg#L13 might be causing the issue10:33
chkumar|ruckas there is python3 there10:33
sshnaidmchkumar|ruck, yeah, right10:33
sshnaidmchkumar|ruck, ok, will add there py3 too10:34
chkumar|rucksshnaidm: few other places also we need to update http://codesearch.openstack.org/?q=%2Fusr%2Flib%2Fpython&i=nope&files=.cfg&repos=10:34
*** dsneddon has quit IRC10:35
sshnaidmchkumar|ruck, well, overcloud ara is updated10:35
sshnaidmchkumar|ruck, so only this one10:35
*** ykarel is now known as ykarel|afk10:36
chkumar|rucksshnaidm: yes10:37
chkumar|ruckmarios: Do we still care about pike jobs running in tripleo check queue?10:42
chkumar|ruckor we can remove it?10:42
chkumar|rucksorry better we can check it during tripleo meeting10:44
marioschkumar|ruck: well...10:45
marioschkumar|ruck: yeah check for sure but looking at https://releases.openstack.org/10:45
marioschkumar|ruck: its labelled as 'extended maintenance'10:45
marioschkumar|ruck: so upstream its the long life10:45
marioschkumar|ruck: we may want to keep it around but lets discuss in tripleo meeting10:45
marioschkumar|ruck: s/may/have10:45
chkumar|ruckmarios: sure, thanks!10:46
*** jaosorior has quit IRC10:54
*** ykarel|afk is now known as ykarel11:02
ykarelchkumar|ruck, marios re. pike extended maintenance also check https://review.rdoproject.org/r/#/c/21165/11:03
ykarelhttps://trunk.rdoproject.org/centos7-pike/report.html11:04
arxcruzykarel: well, 2.8 isn't in rdo zuul https://opendev.org/zuul/zuul/src/tag/3.8.1/releasenotes/notes11:13
arxcruzit uses the 3.8.1 upstream uses 3.9.111:13
ykarelarxcruz, yup right11:13
*** udesale has quit IRC11:18
ykarelso you can contact #sf-ops, regarding the plan for movement to 3.9.111:20
*** ratailor has quit IRC11:24
pandareviews! (in suggested merge order) https://review.opendev.org/673481 https://review.rdoproject.org/r/21808 https://review.rdoproject.org/r/2154711:26
mariosthanks ykarel11:32
chkumar|ruckmarios: https://review.opendev.org/#/c/675301/4 needs +w for scenario 10 fix11:32
mariosack chkumar|ruck commented11:39
chkumar|ruckmarios: thanks!11:39
mariosack panda but not immediately noted for next reviews11:40
*** jpena is now known as jpena|lunch11:40
arxcruzmarios: MALAKA man11:45
arxcruzmarios: anchors works11:45
arxcruzmarios: https://review.rdoproject.org/r/#/c/21787/1/zuul.d/standalone-jobs.yaml11:45
arxcruzCHECK WHAT YOU DID ON LINE 64!11:45
marios  arxcruz it does in some cases like for files:11:46
mariosarxcruz: ah i forgot one you mean?11:46
arxcruzmarios: vars: vars: &scen3_standalone_vars11:46
arxcruzyou did vars: vars11:46
mariosyah11:46
arxcruzthat's why the job fails11:46
mariosupdating (and forgot the anchor)11:46
mariosarxcruz: hmm... maybe i'd need to try but lemme check where it failed was it there11:46
arxcruzmarios: should be vars: &scen3_standalone_vars11:46
mariosarxcruz: hmm it could be11:47
arxcruzmarios: check your own comment :P11:47
mariosarxcruz: but anyway, i think i like the inheritance way11:47
mariosarxcruz: imo11:47
arxcruzmarios: I was wondering, because this works https://opendev.org/opendev/system-config/src/branch/master/.zuul.yaml#L6611:47
marioswe have both so we can compare it and decide which way to go before i update the review11:47
mariosarxcruz: so i know it works in some cases, like i added it in the files: for standalone in tripleo-ci repo layout11:47
mariosarxcruz: but i thought it is disallowed here because zuul prefers the inheritance11:48
marios(or something_)11:48
arxcruzmarios: it's not related to zuul11:48
arxcruzanchor is a yaml feature zuul doesn't care11:48
arxcruzmarios: http://eavesdrop.openstack.org/irclogs/%23zuul/%23zuul.2019-07-30.log.html#t2019-07-30T13:38:4211:48
arxcruzmarios: but anyway, I believe using the patch set 2 is better, at the end, when we migrate zuul to 2.8, we can just remove the ansible_python_interpreter from these jobs11:51
mariosarxcruz: right. i like the inheritance too11:52
mariosarxcruz: added brief comment there anyway https://review.rdoproject.org/r/#/c/21787/1/zuul.d/standalone-jobs.yaml@6411:52
*** rlandy has joined #oooq12:00
arxcruzmarios: i comment there, I was thinking, even though we would have more lines to do the same, have a base-featureset00[1-4] job definition12:00
arxcruzmarios: and then, both rhel-8 and centos-7 inherit from that for each featureset12:00
chkumar|ruckbrb12:00
*** rlandy is now known as rlandy|rover12:00
mariosarxcruz: yeah that might be good too as long as we have one place but at least agree to use inheritance anyway12:00
rlandy|roverchkumar|ruck: hi12:00
arxcruzmarios: yup, inheritance is better12:01
*** jaosorior has joined #oooq12:03
*** rfolco has joined #oooq12:03
rlandy|roverchkumar|ruck: retrying two queens failures in ci.centos12:03
rlandy|roverchkumar|ruck: you ok to attend ci escalation meeting?12:08
rlandy|roverotherwise I will12:08
*** ykarel is now known as ykarel|afk12:16
chkumar|ruckrlandy|rover: I can attend12:16
chkumar|ruckrlandy|rover: queens promoted by the way12:16
rlandy|roverchkumar|ruck - k - good news :) - I restarted the failed queens jobs12:17
rlandy|roverin ci.centos12:17
ykarel|afkphase1 is not promoted yet12:17
rlandy|roverto clear phase 112:17
rlandy|roverykarel|afk: ack - there are two phase weirdo jobs12:17
rlandy|roverI restarted - may be real issues12:17
ykarel|afkrlandy|rover, yup i saw12:17
rlandy|roverwill ping if they do not pass this time12:17
ykarel|afkdidn't find anything, so worth retrying12:17
ykarel|afkrlandy|rover, ack12:17
rlandy|roverchkumar|ruck: I closed the card from yesterday re: phase 112:18
rlandy|roverlooks like that promoted fine overnight12:18
chkumar|ruckrlandy|rover: cool, I was about to ping about the same12:18
*** amoralej is now known as amoralej|lunch12:18
rlandy|roverchkumar|ruck: yeah - self merged that change - was simple enough - noticed it because it broke baremetal as well12:19
rlandy|roverchkumar|ruck: re: queens tempest failures - did we get a real fix there?12:20
chkumar|ruckrlandy|rover: collectd-sensuablity is now available in RHUI12:20
rlandy|roverk - saw that revert - great news12:20
chkumar|ruckrlandy|rover: queens tempest failyre https://bugs.launchpad.net/tripleo/+bug/1836046 I will be checking during escaltion call what we need to do on tripleo side12:21
openstackLaunchpad bug 1836046 in tripleo "tempest.scenario.test_network_basic_ops.TestNetworkBasicOps Failing on queens" [Critical,Triaged]12:21
rlandy|roverre: rocky containers push - have seen that from time to time12:21
ykarel|afkrlandy|rover, yup i reran the stein ci.centos job after includerole changed_when patch merged12:21
rlandy|roverk - will lurk on that call to get info12:21
rlandy|roverykarel|afk: thanks12:21
chkumar|ruckrlandy|rover: jpena|lunch is looking in that12:22
chkumar|ruckrlandy|rover: check notes on etherpad12:22
rlandy|roverk12:22
* ykarel|afk out12:23
chkumar|ruckrlandy|rover: https://review.opendev.org/#/c/675301/ scenario10 standalone proper fix once it merges, please revert the nonvoting part12:24
chkumar|ruckor we can do it right now with depends-on?12:24
*** jtomasek_ has joined #oooq12:28
*** ykarel|afk has quit IRC12:28
rlandy|roverlooking12:28
rlandy|roverchkumar|ruck: k - will put in the revert withe depends on12:29
*** jtomasek has quit IRC12:30
*** jpena|lunch is now known as jpena12:30
*** dsneddon has joined #oooq12:31
rlandy|roverchkumar|ruck: https://review.opendev.org/#/c/675888/ Revert "Make standalone-10 temp non-voting while fix merges"12:33
chkumar|ruckrlandy|rover: thanks!12:33
*** dsneddon has quit IRC12:35
rlandy|roverchkumar|ruck: hmmm .... think we have legit weird failures in phase 1  - will ping rdo12:38
rlandy|roverchkumar|ruck: going to try work on getting downstream tests into rrcockpit - ping me if you want me to look at anything else12:46
chkumar|ruckrlandy|rover: want to sync?12:46
rlandy|roverk12:46
rlandy|roveranything we need to cover that is not in etherpad notes?12:47
*** ykarel|afk has joined #oooq12:48
chkumar|ruckrlandy|rover: all the stuffs added12:49
rlandy|roverchkumar|ruck: k - great - will pick up when you check out for the day12:50
chkumar|ruckrlandy|rover: https://redhat.bluejeans.com/chkumar/12:50
rlandy|roverjoining12:51
*** ykarel|afk is now known as ykarel12:52
*** amoralej|lunch is now known as amoralej13:01
rfolcoping scrum marios panda zbr|flu arxcruz13:01
*** Vorrtex has joined #oooq13:07
*** surpatil has quit IRC13:25
*** udesale has joined #oooq13:30
chkumar|rucksee ya tomorrow13:30
rlandy|rovergood night13:30
*** chkumar|ruck is now known as raukadah13:30
rlandy|roverraukadah: zbr|flu: pls review https://review.opendev.org/#/c/675898/13:42
*** vinaykns has joined #oooq13:53
*** udesale has quit IRC14:06
*** udesale has joined #oooq14:08
*** udesale has quit IRC14:08
*** udesale has joined #oooq14:08
*** ykarel is now known as ykarel|afk14:10
zbr|flurlandy|rover: i added a question there.14:21
rlandy|roverzbr|flu: sshnaidm: pls review https://review.opendev.org/#/c/675909/14:23
rlandy|roverlooking14:23
rlandy|roverzbr|flu: https://review.opendev.org/675898 updated14:27
*** aakarsh has joined #oooq14:29
zbr|flurlandy|rover: https://review.opendev.org/#/c/675909/2/ansible.cfg makes no sense to me, that is not a template. AFAIK, you cannot put jinja2 in ansible.cfg14:31
*** dsneddon has joined #oooq14:32
zbr|flusolution is to remove paths from there and use dynamic ara configuration14:32
*** dsneddon has quit IRC14:37
zbr|flumainly best approach is to avoid having to define these and just assuring you install ara in the right locations, so ansible can find it.14:38
*** ykarel|afk has quit IRC14:43
rlandy|roverzbr|flu: abandoning that - let's rethink this14:43
*** ykarel|afk has joined #oooq14:43
raukadahrlandy|rover: http://codesearch.openstack.org/?q=%2Fusr%2Flib%2Fpython&i=nope&files=.cfg&repos=14:43
raukadahrlandy|rover: may be we need to add a custom task to do soemthing like this https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/overcloud-deploy/templates/ansible.cfg.j214:44
rlandy|roverraukadah: yeah 0 we need a more global solution here14:44
rlandy|roverabandoned that review14:44
raukadahrlandy|rover: ok14:46
raukadahrfolco: can we include this https://tree.taiga.io/project/tripleo-ci-board/epic/1054 as a part of sprint 14 ? since Validation team has started working on that14:47
*** ankit08 has joined #oooq14:50
rlandy|roveridk14:51
rlandy|roverprobably lands on us14:51
*** ykarel|afk is now known as ykarel|away14:57
sshnaidmrlandy|rover, zbr|flu https://review.opendev.org/#/c/675868/ I was first :)15:01
zbr|flusshnaidm: i do not particulary find this approach safe: it will fail badly when you have both versions installed.15:02
zbr|flubecause you will combine modules from other version of python15:02
sshnaidmzbr|flu, you won't have both versions installed15:02
zbr|fluwhy? even on centos/rhel-7 you can now install both py36/py37,  officially15:03
rlandy|roversshnaidm: you were - fight it out with zbr|flu and we can go from there15:03
sshnaidmzbr|flu, you install oooq only once15:03
zbr|fluhaha :D15:04
zbr|fluYOLO15:04
*** ykarel|away has quit IRC15:04
*** ykarel|away has joined #oooq15:04
zbr|flusshnaidm: looked again, added +1. it should work.15:07
rlandy|roversshnaidm: k - let's go with this15:08
rlandy|roverchecking queens failure15:08
raukadahsshnaidm: rlandy|rover https://github.com/openstack/tripleo-quickstart/blob/master/tox.ini#L19 in tox.ini. we are setting VIRTUAL_ENV15:09
raukadahwe can set another var there which will set python_version and reuse it15:09
raukadahthe job is done15:09
raukadahin ansible.cfg15:10
raukadahzbr|flu: ^^ what do you think?15:12
zbr|fluraukadah: nope, this should work even without a virtualenv.15:13
sshnaidmraukadah, we don't use it in oooq install I think15:13
zbr|flumainly this should being taken care of ara itself, but I am not sure when dmsimard will fix it.15:14
zbr|fluif it would be installed as a collection, ansible should find it with no extra config.15:14
rlandy|roverk - let's check the sova tracking job now15:17
raukadahzbr|flu: collection is a new thing, I need to check15:18
zbr|flunot sure you can fix it yourself. btw, what is the minimum ansible version we need to support with qs?15:19
zbr|flucollections were introduced in 2.8, as experimental.15:19
raukadahpanda: once this review https://review.rdoproject.org/r/#/c/21547/ merges, please let prodchain team know so that they can remove annonymus access cc https://tree.taiga.io/project/morucci-software-factory/us/270315:20
raukadahzbr|flu: ansible 2.8 landed, https://github.com/openstack/tripleo-quickstart/blob/master/requirements.txt#L3 so I will good to use it, if it solves our problem15:21
*** ankit08 has quit IRC15:24
*** jfrancoa has quit IRC15:30
*** dsneddon has joined #oooq15:33
rlandy|roverraukadah: seen all the post failures on rdo cloud?15:35
raukadahrlandy|rover: nope, saw few one, but ignored15:36
rlandy|roverk - will look into it15:36
raukadahrlandy|rover: do we have seperate dashboard for rrlimit and postfailure if not then I will implement this week?15:37
rlandy|roverit's on the main dashboard15:37
rlandy|roverraukadah: maybe was temp hitch - jobs are looking better now15:38
raukadahrlandy|rover: ack15:39
raukadahjpena: do we have a doc to setup temprory rdo registry locally for testing purpose?15:39
* rlandy|rover panics too much15:39
jpenaraukadah: there's no doc as such, but you could play around with the playbooks we use for CI: https://github.com/rdo-infra/rdo-infra-playbooks/tree/master/tests/playbooks (see registry-pre.yaml and registry-run.yaml)15:40
raukadahjpena: thanks, add to my try list. :-)15:41
raukadah*adding15:41
pandajpena: quickie for you: can you +2 this also ? https://review.rdoproject.org/r/2181115:45
pandajpena: I will not merge the switch without your explicit +215:45
raukadahjpena: https://bugs.launchpad.net/tripleo/+bug/1839845 feel free to take a look at this issue, it is poping up from last week from limestone, I am not we can do anythign to mitigate it15:46
openstackLaunchpad bug 1839845 in tripleo "TripleO gate jobs run on limestone nodes are failing "to retrieve repo file from https://trunk.rdoproject.org/centos7-<release>/current-tripleo/delorean.repo" after 10 retries " [High,Triaged]15:46
jpenaraukadah: ack, I'll look at it15:47
raukadahjpena: I have added the #openstack-infra irc discussion also15:47
raukadahthanks :-)15:47
*** marios has quit IRC15:48
jpenapanda: gotta run now, I did a small fix on the review15:49
jpenait's +2'ed now15:49
pandajpena: the file is actually .yml15:49
pandajpena: but thanks15:50
jpenapanda: not in https://review.rdoproject.org/r/#/c/21808/, is it a different one?15:50
jpenaah wait15:50
jpenaargs, my fault15:51
pandajpena: https://review.opendev.org/#/c/673481/8/tasks/registry-login.yml15:51
jpenaI was looking in the wrong place15:51
pandajpena: sorry to block your run, I'll pester someone else to 2 this15:52
jpenait's ok, fixed15:52
*** jpena is now known as jpena|off15:53
pandajpena|off: thanks!15:53
*** amoralej is now known as amoralej|off15:55
*** udesale has quit IRC15:56
*** ykarel|away has quit IRC16:08
*** bogdando has quit IRC16:08
*** Goneri has quit IRC16:10
*** dtantsur is now known as dtantsur|afk16:37
rlandy|rover2019-08-12 12:25:40.140651 | primary | requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://trunk.rdoproject.org/rhel8-stein/current/delorean.repo16:52
rlandy|roverha16:52
rlandy|roverpanda: hi16:53
*** derekh has quit IRC17:01
rlandy|roversshnaidm: panda: https://review.rdoproject.org/r/21812 Only run RHEL-8 build image jobs on master17:04
rlandy|rover^^ maybe that should be not on stable branches?17:04
raukadahrlandy|rover: elastic recheck about to merge now, \o/17:05
rlandy|roverraukadah: oh wow17:05
rlandy|roverraukadah: fyi .. https://review.rdoproject.org/r/21812 Only run RHEL-8 build image jobs on master17:05
rlandy|rover^^ failing on stein etc.17:06
rlandy|roverraukadah: pls see my comment on alternative17:06
raukadahrlandy|rover: checking17:06
rlandy|roverthose are the retry_limit errors on rdo cloud atm17:07
rfolcopanda, hello-world containers can be pushed to what namespace in docker.io? just wondering if its safer to keep them separate from tripleomaster.... like tripleoci namespace.... wdyt ?17:15
rlandy|roverrfolco: pls review https://review.rdoproject.org/r/21812 Only run RHEL-8 build image jobs on master17:16
rfolcolooking17:17
rfolcorlandy|rover, lgtm w/ nit comment17:21
rlandy|roverthanks - let's merge this and get rid of the errors17:21
rlandy|roverrfolco: wrt comment - that how all our master jobs are :)17:22
rfolcorlandy|rover, weird17:22
rfolco:)17:22
rlandy|roverw+ - hopefully that will get rid of some errors17:23
raukadahrlandy|rover: we have lots of failurs on current openstack-periodic-master run https://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-master-upload/3f28f84/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2019-08-12_15_16_1417:46
*** saneax has quit IRC17:46
raukadahmight be related to failed to deleted stacks17:46
* raukadah will poke these stuffs tomorrow17:47
rlandy|roverraukadah: failed deleted stacks are not up17:47
pandarfolco: apparently that's what we want to do. Keep using all the production namespaces for the staging job.17:59
rfolcopanda, prod namespace at docker.io ? or setup a local registry inside the staging job ?18:00
pandarfolco: prod namespace a docker.io, prod namespace at trunk.registry, prod endpoint on dlrn.18:02
rlandy|rover2019-08-12 17:16:07 | 2019-08-12 17:15:42Z [overcloud.Controller.2.Controller]: CREATE_FAILED  ResourceInError: resources.Controller: Went to status ERROR due to "Message: No valid host was found. , Code: 500"18:05
rlandy|rover2019-08-12 17:16:07 | 2019-08-12 17:15:42Z [overcloud.Controller.2]: CREATE_FAILED  Resource CREATE failed: ResourceInError: resources.Controller: Went to status ERROR due to "Message: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance c24cafd4-1a6d-48e6-a052-9dcf4d38ead5., Code: 5018:05
rlandy|roverwe have a problem with overload18:05
*** dsneddon has quit IRC18:33
*** kopecmartin is now known as kopecmartin|off18:55
sshnaidmrlandy|rover, https://review.opendev.org/#/c/675896/19:06
sshnaidmrlandy|rover, this should help btw: https://review.rdoproject.org/r/#/c/21665/19:09
*** dsneddon has joined #oooq19:09
rlandy|roverlooking19:22
*** tesseract has quit IRC19:32
rlandy|roversshnaidm: idk why rdocloud ovb is in such bad shape19:46
rlandy|roverthere are not a ton of failed stacks19:46
rlandy|roversome19:46
rlandy|roverrerunning clean up script19:47
*** ccamacho has quit IRC20:05
rlandy|roverk  rdo check is looking better now20:14
rlandy|roversshnaidm: still around?20:23
rlandy|roverlooking into this failure: https://logs.rdoproject.org/openstack-periodic-24hr/review.rdoproject.org/rdo-infra/ci-config/master/sova-tracking-jobs/4040fd4/job-output.txt.gz#_2019-08-12_04_02_21_68837620:23
sshnaidmrlandy|rover, yeah, need to work on nicer output there20:24
sshnaidmrlandy|rover, seems like need to add tripleo-ci-centos-7-containers-undercloud-minion and tripleo-build-containers-rhel-8-master20:24
rlandy|roversshnaidm: the way to fix is to edit sova itself, right?20:26
rlandy|rovernot the test anywhere?20:26
* rlandy|rover looks for where those strings are20:26
sshnaidmrlandy|rover, yeah, patch to sova solves it20:26
rlandy|roversshnaidm: k - let me try that20:26
*** jtomasek_ has quit IRC20:26
sshnaidmrlandy|rover, sure20:26
rlandy|roverfor your review - obvously20:26
*** aakarsh has quit IRC20:39
*** aakarsh has joined #oooq20:41
*** aakarsh has quit IRC20:48
*** tosky has quit IRC21:55
*** aakarsh has joined #oooq22:18
*** vinaykns has quit IRC23:02
*** rlandy|rover is now known as rlandy|rover|bbl23:12
*** Vorrtex has quit IRC23:29

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!