Tuesday, 2019-11-05

*** apevec_ has quit IRC00:00
rdogerritrdo-trunk created rdoinfo master: Promote CBS tags update for queens-testing  https://review.rdoproject.org/r/2358500:05
rdogerritrdo-trunk created rdoinfo master: Promote CBS tags update for rocky-testing  https://review.rdoproject.org/r/2358600:07
*** rlandy|ruck has quit IRC00:07
*** artom has joined #rdo00:11
*** ramishra has quit IRC00:14
*** Ramereth has quit IRC00:19
*** number80 has quit IRC00:23
*** Ramereth has joined #rdo00:24
*** number80 has joined #rdo00:26
*** Ramereth has quit IRC00:48
*** ccamposr__ has joined #rdo00:51
*** Goneri has quit IRC00:51
*** ccamposr has quit IRC00:53
*** Ramereth has joined #rdo00:54
*** bnemec has quit IRC01:12
*** hybridpollo has joined #rdo01:28
*** slaweq_ has joined #rdo01:35
*** slaweq__ has joined #rdo01:39
*** slaweq_ has quit IRC01:41
*** Ramereth has quit IRC01:48
*** tkajinam has joined #rdo01:52
*** Ramereth has joined #rdo01:54
rdogerritrdo-trunk created rdoinfo master: CBS tags sync with uc for train-candidate  https://review.rdoproject.org/r/2358701:56
*** bnemec has joined #rdo01:58
*** dsneddon has quit IRC02:07
rdogerritSagi Shnaidman created config master: Revert "Add rhel8 build containers job to kolla"  https://review.rdoproject.org/r/2358802:12
*** hybridpollo has quit IRC02:13
*** hybridpollo has joined #rdo02:14
*** hybridpollo has quit IRC02:14
*** hybridpollo has joined #rdo02:14
rdogerritMerged config master: Revert "Add rhel8 build containers job to kolla"  https://review.rdoproject.org/r/2358802:17
*** hybridpollo has quit IRC02:21
*** hybridpollo has joined #rdo02:22
*** slaweq__ has quit IRC02:23
*** hybridpollo has left #rdo02:26
*** dsneddon has joined #rdo02:32
*** bnemec has quit IRC02:37
*** tkajinam has quit IRC02:40
*** slaweq has joined #rdo02:45
*** Ramereth has quit IRC02:48
*** bnemec has joined #rdo02:52
*** Ramereth has joined #rdo02:53
*** apetrich has quit IRC03:08
*** dsneddon has quit IRC03:39
*** slaweq has quit IRC03:40
*** bnemec has quit IRC03:56
*** bnemec has joined #rdo03:57
*** mpeterson has quit IRC04:04
*** cyberworm54 has joined #rdo04:08
*** cyberworm54 has quit IRC04:09
*** cyberworm54 has joined #rdo04:10
*** mpeterson has joined #rdo04:12
*** skramaja has joined #rdo04:19
*** dsneddon has joined #rdo04:23
*** bnemec has quit IRC04:26
*** dsneddon has quit IRC04:29
*** dsneddon has joined #rdo04:31
*** dsneddon has quit IRC04:41
*** dsneddon has joined #rdo04:48
*** ykarel has joined #rdo04:52
*** dsneddon has quit IRC04:53
*** ykarel has quit IRC04:54
*** ykarel has joined #rdo04:54
*** dsneddon has joined #rdo04:55
*** igarcia_ has joined #rdo05:00
*** dsneddon has quit IRC05:00
*** cyberworm54 has quit IRC05:00
*** dsneddon has joined #rdo05:03
*** dsneddon has quit IRC05:08
rdogerritMerged openstack/swift-distgit stein-rdo: Change %attr of /run/swift to swift.root  https://review.rdoproject.org/r/2358005:09
rdogerritMerged openstack/cinder-distgit rpm-master: Fix deprecated logdir option to log_dir  https://review.rdoproject.org/r/2339505:11
*** dsneddon has joined #rdo05:13
*** brault has quit IRC05:17
*** ykarel_ has joined #rdo05:18
*** ykarel has quit IRC05:20
*** igarcia_ has quit IRC05:27
*** slaweq_ has joined #rdo05:28
*** dsneddon has quit IRC05:28
*** dsneddon has joined #rdo05:31
*** dsneddon has quit IRC05:36
*** dsneddon has joined #rdo05:38
*** ykarel_ is now known as ykarel05:40
*** pcaruana has joined #rdo05:41
*** dsneddon has quit IRC05:43
*** slaweq_ has quit IRC05:45
*** dsneddon has joined #rdo05:46
*** Ramereth has quit IRC05:48
*** Ramereth has joined #rdo05:49
*** rdogerrit has quit IRC05:52
*** dsneddon has quit IRC06:00
*** dsneddon has joined #rdo06:01
*** marios has joined #rdo06:11
*** dsneddon has quit IRC06:13
*** surpatil has joined #rdo06:19
*** bandini has joined #rdo06:38
*** dsneddon has joined #rdo06:46
*** aufi has joined #rdo07:06
*** slaweq_ has joined #rdo07:16
*** slaweq__ has joined #rdo07:20
*** slaweq_ has quit IRC07:22
*** dpawlik has joined #rdo07:31
*** jfrancoa has joined #rdo07:33
*** chasmo77 has joined #rdo07:35
*** surpatil is now known as surpatil|lunch07:36
*** rakhmerov has joined #rdo07:38
*** jcapitao has joined #rdo07:44
*** tmazur has joined #rdo07:56
*** jlibosva has joined #rdo08:11
*** surpatil has joined #rdo08:17
*** slaweq__ has quit IRC08:19
*** slaweq has joined #rdo08:19
*** rdogerrit has joined #rdo08:19
rdogerritMerged rdoinfo master: Promote CBS tags update for queens-testing  https://review.rdoproject.org/r/2358508:19
*** surpatil|lunch has quit IRC08:20
*** paragn has quit IRC08:22
*** paragn has joined #rdo08:23
*** tesseract has joined #rdo08:24
*** bnemec has joined #rdo08:25
*** tosky has joined #rdo08:30
*** ccamposr has joined #rdo08:34
*** ccamposr__ has quit IRC08:37
*** zbr|ooo is now known as zbr08:38
*** apetrich has joined #rdo08:41
*** jpena|off is now known as jpena08:42
*** amoralej|off is now known as amoralej08:43
*** ykarel is now known as ykarel|lunch08:46
*** marios has quit IRC08:46
*** marios has joined #rdo08:47
*** bnemec has quit IRC08:50
rdogerritMerged rdo-infra/ci-config master: ppc64le: Move success/fail string echo to publisher  https://review.rdoproject.org/r/2357808:52
*** ralonsoh has joined #rdo08:52
*** migarcia has joined #rdo08:52
rdogerritrdo-trunk created openstack/barbicanclient-distgit rpm-master: python-barbicanclient: failed to build e5fdd10  https://review.rdoproject.org/r/2358908:58
*** slaweq has quit IRC09:04
*** jpich has joined #rdo09:06
*** jistr is now known as jistr|mtgs09:10
*** tosky has quit IRC09:13
*** apevec has joined #rdo09:13
*** chem|eod is now known as chem09:17
*** mvkr has quit IRC09:17
rdogerritAlfredo Moralejo proposed rdo-infra/ci-config master: Remove jobs for ocata and pike and add weirdo for newer clousisg  https://review.rdoproject.org/r/2358109:23
*** arxcruz is now known as arxcruz|off09:24
*** alexmcleod has joined #rdo09:32
*** tosky has joined #rdo09:35
rdogerritAlfredo Moralejo created config master: Disable legacy-rdo-deps-uc-send-review job in master branch  https://review.rdoproject.org/r/2359009:37
rdogerritSorin Sbarnea (zbr) created rdo-infra/ci-config master: lint: maintenance chores  https://review.rdoproject.org/r/2359109:42
*** derekh has joined #rdo09:43
*** ykarel|lunch is now known as ykarel09:46
*** surpatil has quit IRC09:46
*** surpatil has joined #rdo09:46
rdogerritSorin Sbarnea (zbr) proposed rdo-infra/ci-config master: lint: maintenance chores  https://review.rdoproject.org/r/2359109:53
*** paramite has joined #rdo09:54
*** paramite has quit IRC09:59
*** derekh has quit IRC10:01
*** derekh has joined #rdo10:01
*** ccamposr has quit IRC10:01
*** aedc has quit IRC10:03
zbris anyone getting errors pulling tags from github? I seen at least two https://review.rdoproject.org/analytics/app/kibana#/discover?_a=(columns:!(_source),index:AWsldLLQ-cMPWrFD-N_t,interval:auto,query:(query_string:(analyze_wildcard:!t,query:'message:%22An%20unexpected%20error%20has%20occurred:%20CalledProcessError:%20Command%22')),sort:!('@timestamp',desc))&_g=(refreshInterval:(display:Off,pause:!f,value:0),time:(from:now-24h,mode:quick,to:now))10:05
rdogerritYatin Karel created rdo-infra/releng master: Add abandon old review script  https://review.rdoproject.org/r/2359210:05
rdogerritSorin Sbarnea (zbr) proposed rdo-infra/ci-config master: lint: maintenance chores  https://review.rdoproject.org/r/2359110:09
*** ccamposr has joined #rdo10:11
rdogerritAlfredo Moralejo created openstack/oslo-utils-distgit train-rdo: python-oslo-utils-3.41.2-1  https://review.rdoproject.org/r/2359310:13
*** sshnaidm|rover|b is now known as sshnaidm|rover10:13
ykarelzbr, that job is green https://review.rdoproject.org/zuul/builds?job_name=tox-linters, and considering that failure in same patch twice, issue seems patch specific10:13
ykareli noticed remote without caps for flake8, may be that's the issue10:14
ykarelatleast locally i don't see the issue for git fetch10:15
zbrykarel: gitlab strikes again, i switched to github mirrors. better to depend on a single hosted service.10:18
ykarelzbr, ack10:19
zbris not the first time i face it, but i forgot what was causing last time. sometimes adding ".git" suffix to the url can make it work.10:19
zbrbut once i realised it was gitlab again, i decided to consolidate deps.10:20
zbri personally don't like the pre-commit cloning frenzy but i do not have the energy to address it now.10:20
*** radeks has joined #rdo10:21
zbrbut i do fancy writing a pre-build linting-container10:21
*** dtantsur|afk is now known as dtantsur10:26
rdogerritSorin Sbarnea (zbr) proposed rdo-infra/ci-config master: lint: maintenance chores  https://review.rdoproject.org/r/2359110:31
rdogerritMerged openstack/oslo-utils-distgit train-rdo: python-oslo-utils-3.41.2-1  https://review.rdoproject.org/r/2359310:35
rdogerritJoel Capitao created rdoinfo master: Add python-timeout-decorator to Ussuri  https://review.rdoproject.org/r/2359410:47
*** dpawlik has quit IRC10:48
*** leanderthal has joined #rdo10:51
*** chem is now known as chem|brb11:00
*** dpawlik has joined #rdo11:06
zbrykarel:  i got a very weird error but only on CI/rdo: fatal: reference is not a tree: ad721b6cde91a65e28d1f4fa4052bb721b17ae1111:09
zbrhttp://logs.rdoproject.org/91/23591/4/check/tox-linters/5b7064b/job-output.txt11:10
zbrand I can tell you that this sha is in github, https://github.com/ansible/ansible-lint/commit/ad721b6cde91a65e28d1f4fa4052bb721b17ae1111:10
zbrdo we have some kind of weird proxy?11:10
ykarelzbr, hmm commit is in repo, me not aware of any github proxy11:12
ykareljpena, ^^11:12
zbryep, recloned locally, cleared caches, it does not look like a github issues to me.11:12
*** dpawlik has quit IRC11:14
*** dpawlik has joined #rdo11:16
jpenaI'm checking11:22
rdogerritJoel Capitao proposed openstack/barbicanclient-distgit rpm-master: Add BR on sphinxcontrib-rsvgconverter  https://review.rdoproject.org/r/2358911:23
jpenazbr: there's something odd with that repo. When I clone it and checkout the commit on a centos 7 machine, I get this: https://softwarefactory-project.io/paste/show/1647/11:29
jpenawith fedora, I do not get that message11:29
*** leanderthal has quit IRC11:33
zbrhmm, smells like binaries uploaded as text to me, or something related to BOMs. I discovered few minutes ago that the repository has few files with BOMs.11:37
zbrstill this does not fully explain git behavior11:37
*** chem|brb is now known as chem11:38
rdogerritUser marios created config master: WIP Add periodic-tripleo-centos-7-master-nova-containers-build  https://review.rdoproject.org/r/2359511:39
jpenazbr: ok, I got the reason for the error, and it's in pre_commit11:39
*** dsneddon has quit IRC11:39
jpenaThe sequence of commands it runs is: https://softwarefactory-project.io/paste/show/1648/11:40
jpenasince you're specifying a commit and not a tag or branch, it fails because it didn't do a full clone11:40
jpenaI have reproduced it locally11:40
jpenait starts in https://github.com/pre-commit/pre-commit/blob/master/pre_commit/store.py#L157-L172, which then calls https://github.com/pre-commit/pre-commit/blob/master/pre_commit/git.py#L152-L158, and finally tries the checkout at https://github.com/pre-commit/pre-commit/blob/master/pre_commit/store.py#L139-L14411:41
*** rfolco has joined #rdo11:45
zbrjpena: interesting because I used commit in the past and i did not encounter the bug11:49
zbralso this does not explain why it works locally for me, i rememeber that I cleaned the cache directory11:50
zbrbehavior seems to to vary, maybe depends on git version?11:50
zbrjpena: what git version do you have where you reproduced it?11:51
*** paramite has joined #rdo11:57
jpenazbr: 1.8.3.111:58
jpenalet me try it in fedora11:58
zbrat least we could raise a valid bug once we narrow it down11:59
jpenazbr: in fedora (git version 2.21.0) it does not fail11:59
zbrbut git version could explain the other error I got, the maintainer already told me that old git gives some errors11:59
zbrin special cases11:59
zbri am afraid that if I raise a bug with git 1.8, he may show me the finger12:00
*** raildo has joined #rdo12:00
*** mvkr has joined #rdo12:00
zbr1.8 is not old, is more of ancient12:00
jpenaI really wonder why it doesn't simply run git clone, instead of going through the process of git init, git remote add, git ...12:02
*** chem is now known as chem|lunch12:05
*** dsneddon has joined #rdo12:09
*** dpawlik has quit IRC12:10
*** dsneddon has quit IRC12:14
rdogerritJavier Peña created rdo-infra/puppet-dlrn master: Add extra web directories for RHEL-based workers  https://review.rdoproject.org/r/2359612:20
*** amoralej is now known as amoralej|lunch12:23
*** jpena is now known as jpena|lunch12:32
sshnaidm|roverykarel, seems like increasing timeout for train build job didn't solve all..12:33
ykarelsshnaidm|rover, which timeout increase?12:34
ykarelwhen and why it was increased?12:34
sshnaidm|roverykarel, https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul.d/tripleoci.yaml#L157:L15712:37
sshnaidm|roverykarel, nobody knows why it takes so long time on train yet12:37
sshnaidm|roverykarel, https://bugs.launchpad.net/tripleo/+bug/185018812:38
openstackLaunchpad bug 1850188 in tripleo "periodic container build (train) timing out" [Critical,Triaged]12:38
*** chem|lunch is now known as chem12:39
sshnaidm|roverPushIntoQueueTask takes 2 hours12:40
ykarelsshnaidm|rover, ohhk that's bad12:40
ykarelso there was some real issue which increased timeout,12:41
ykarellooks like investigation is not done since timeout is bumped12:41
*** tosky_ has joined #rdo12:42
sshnaidm|roveryeah12:43
sshnaidm|roverand in master PushIntoQueueTask takes 1 hour12:43
sshnaidm|roverI think it explains..12:43
*** dpawlik has joined #rdo12:44
*** tosky has quit IRC12:45
ykarelhmm12:46
rdogerritMerged rdo-infra/rdo-infra-playbooks master: Change Sensu server playbooks to use RDO Queens  https://review.rdoproject.org/r/2348712:52
*** Garyx has quit IRC12:53
*** rlandy has joined #rdo12:54
*** rlandy is now known as rlandy|ruck12:54
*** rh-jelabarre has joined #rdo12:55
*** ykarel is now known as ykarel|afk12:59
*** tosky_ is now known as tosky12:59
rdogerritRonelle Landy proposed rdo-jobs master: Increase standalone tempest job timeout  https://review.rdoproject.org/r/2358313:01
*** rh-jelabarre has quit IRC13:02
*** surpatil has quit IRC13:02
*** rh-jelabarre has joined #rdo13:02
*** derekh has quit IRC13:09
*** dsneddon has joined #rdo13:11
*** jistr|mtgs is now known as jistr13:14
*** lmiccini has quit IRC13:23
*** lmiccini has joined #rdo13:23
*** ykarel|afk is now known as ykarel|away13:23
*** alphacc has quit IRC13:31
rdogerritMerged openstack/barbicanclient-distgit rpm-master: Add BR on sphinxcontrib-rsvgconverter  https://review.rdoproject.org/r/2358913:36
rdogerritRonelle Landy proposed rdo-jobs master: Increase standalone tempest job timeout  https://review.rdoproject.org/r/2358313:39
*** alphacc_ has joined #rdo13:42
*** alphacc_ is now known as alpha[[13:47
*** eharney has quit IRC13:53
*** amoralej|lunch is now known as amoralej13:55
rdogerritMerged rdoinfo master: Add python-timeout-decorator to Ussuri  https://review.rdoproject.org/r/2359414:00
*** Goneri has joined #rdo14:01
*** alpha[[ is now known as alphacc14:01
*** alphacc has quit IRC14:06
*** ramishra has joined #rdo14:07
*** xek has joined #rdo14:11
*** alphacc has joined #rdo14:12
*** mvkr has quit IRC14:19
*** lbragstad_ has joined #rdo14:22
*** lbragstad has quit IRC14:23
*** imcleod has joined #rdo14:24
*** slaweq has joined #rdo14:27
*** jaosorior has joined #rdo14:29
*** slaweq has quit IRC14:32
*** slaweq_ has joined #rdo14:32
*** mvkr has joined #rdo14:32
*** mcornea has joined #rdo14:33
*** cyberworm54 has joined #rdo14:35
*** xek has quit IRC14:40
*** cyberworm54 has quit IRC14:48
*** eharney has joined #rdo14:49
*** ramishra has quit IRC14:50
*** TrevorV has joined #rdo14:56
*** mvkr has quit IRC14:56
*** marst has joined #rdo14:57
*** xek has joined #rdo14:58
*** slaweq_ is now known as slaweq14:59
*** derekh has joined #rdo15:02
marstHello! I'm trying to install proof of concept RDO15 (1 controller, 3 computes, 3 ceph nodes) with Ceph4, does anyone have blog posts\articles with sample config files?15:03
*** Caterpillar2 has joined #rdo15:04
*** chem is now known as chem|tea15:04
*** dsneddon has quit IRC15:04
*** dpawlik has quit IRC15:05
rdogerritMerged rdo-jobs master: Increase standalone tempest job timeout  https://review.rdoproject.org/r/2358315:07
*** slaweq has quit IRC15:08
*** mvkr has joined #rdo15:09
*** slaweq__ has joined #rdo15:11
*** jmlowe has quit IRC15:11
*** dsneddon has joined #rdo15:15
*** chem|tea is now known as chem15:15
*** jmlowe has joined #rdo15:15
*** slaweq__ has quit IRC15:19
*** dsneddon has quit IRC15:20
*** mcornea has quit IRC15:21
*** dsneddon has joined #rdo15:21
*** mcornea has joined #rdo15:21
*** rfolco is now known as rfolco|afk15:22
*** dsneddon has quit IRC15:30
*** jcapitao is now known as jcapitao|afk15:32
*** cyberworm54 has joined #rdo15:36
amoralejmarst, i'd recommend you to ask in #tripleo15:36
marstamoralej: will do, thank you!15:37
*** jaosorior has quit IRC15:41
*** cyberworm54 has quit IRC15:41
amoralejykarel|away, jpena|lunch i'm updating fedora packages, just in case you receive a storm of notifications15:41
ykarel|awayamoralej, ack fedora rawhide to train-releases?15:42
amoralejyes15:43
ykarel|awayok already receiving mails: amoralej pushed to python-octaviaclient (master). "Sync from RDO train release" :)15:43
amoralejyep15:43
amoralejthat's the first one15:44
*** jcapitao|afk is now known as jcapitao15:51
rdogerritUser marios created rdo-jobs master: Add periodic-tripleo-ci-centos-7-scenario007-standalone-master  https://review.rdoproject.org/r/2359815:51
rdogerritUser marios created config master: Add periodic-scenario007-standalone-master to master pipeline  https://review.rdoproject.org/r/2359915:59
*** dsneddon has joined #rdo15:59
*** rlandy|ruck is now known as rlandy|ruck|mtg16:01
rdogerritUser marios proposed rdo-jobs master: Add periodic-tripleo-ci-centos-7-scenario007-standalone-master  https://review.rdoproject.org/r/2359816:03
*** dsneddon has quit IRC16:05
rdogerritAlfredo Moralejo proposed rdo-infra/releng master: Add scripts to list OpenStack packages in Fedora  https://review.rdoproject.org/r/2060916:07
*** Trevor_V has joined #rdo16:08
*** jpena|lunch is now known as jpena16:11
*** TrevorV has quit IRC16:11
*** aufi has quit IRC16:17
*** igordc has joined #rdo16:27
*** igordc has quit IRC16:27
rdogerritLance Albertson proposed openstack/nova-distgit train-rdo: Remove additional deprecated nova-network options  https://review.rdoproject.org/r/2339616:30
*** lmiccini has quit IRC16:31
*** dsneddon has joined #rdo16:34
*** marios is now known as marios|call16:35
*** skramaja has quit IRC16:41
apevecamoralej, I've BZ to add epel8 for croniter https://bugzilla.redhat.com/show_bug.cgi?id=176200916:42
openstackbugzilla.redhat.com bug 1762009 in python-croniter "python-croniter: Please provide EPEL8 package" [High,New] - Assigned to apevec16:42
apevecshould we be careful, is this dep still used ?16:42
amoralejlemme check16:43
apevecI'm thinking to add Reporter as co-maintainer, RPM is currently in openstack-sig16:43
amoralejapevec, croniter is dep for some packages16:44
amoralejaodh, heat16:44
amoralejmistral16:44
amoralejso yes, we still need it16:45
*** jpena is now known as jpena|brb16:45
apevecok, in any case epel8 will not hurt us16:46
apevecfor rdo we'll rebuild in cloudsig16:46
*** mvkr has quit IRC16:48
rdogerritLance Albertson created openstack/cinder-distgit train-rdo: Fix deprecated logdir option to log_dir  https://review.rdoproject.org/r/2360016:50
*** tesseract has quit IRC16:50
rdogerritLance Albertson created openstack/cinder-distgit stein-rdo: Fix deprecated logdir option to log_dir  https://review.rdoproject.org/r/2360116:50
rdogerritLance Albertson created openstack/cinder-distgit rocky-rdo: Fix deprecated logdir option to log_dir  https://review.rdoproject.org/r/2360216:50
*** alexmcleod has quit IRC16:51
*** d0ugal has quit IRC16:53
*** Caterpillar2 has quit IRC16:53
*** chem is now known as chem|eod16:56
*** jlibosva has quit IRC17:01
*** rlandy|ruck|mtg is now known as rlandy|ruck17:03
*** marios|call is now known as marios|out17:03
*** marios|out has quit IRC17:04
*** migarcia has quit IRC17:06
*** d0ugal has joined #rdo17:09
rdogerritAlfredo Moralejo proposed rdo-infra/releng master: Add scripts to list OpenStack packages in Fedora  https://review.rdoproject.org/r/2060917:10
rdogerritAlfredo Moralejo proposed rdo-infra/releng master: Add scripts to list and rebuild OpenStack packages in Fedora  https://review.rdoproject.org/r/2060917:11
*** jfrancoa has quit IRC17:12
*** radeks has quit IRC17:12
sshnaidm|roverykarel|away, jpena|brb do you know something about dnf error "Error: No available modular metadata for modular package" ?  http://logs.rdoproject.org/63/22163/8/check/periodic-tripleo-rhel-8-master-containers-build-push/b6dd564/logs/buildah-builds/kolla-hea_e58r/docker/nova/nova-libvirt/nova-libvirt-build.log.txt.gz17:15
sshnaidm|roveramoralej, ^17:16
sshnaidm|roverrlandy|ruck, new failure for rhel8 containers ^17:16
amoralejlemme check17:16
amoralejmmm17:17
amoralejwe upload those packages to rhui out of modules iirc17:17
amoralejyes17:18
amoralejbut we should have been having this issue in the past17:18
amoralejunless it's related to 8.117:18
sshnaidm|roveramoralej, well, it's from 2 days before I think17:19
amoralejlet me check if i can reproduce it17:20
sshnaidm|roveramoralej, actually week before, last passed job: http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-rhel-8-master-containers-build-push/dc58f48/logs/buildah-builds/kolla-bwqmog7j/docker/nova/nova-libvirt/nova-libvirt-build.log.txt.gz17:21
*** ykarel|away has quit IRC17:22
*** jtomasek_ has quit IRC17:22
*** chem|eod has quit IRC17:26
*** jpena|brb is now known as jpena17:27
*** tmazur has quit IRC17:29
jpenaamoralej, sshnaidm|rover: looking at the log output, I see it does "dnf -y module disable virt:rhel", but it never enables the advanced virtualization module17:32
jpenathen, it is downloading all the virt-related packages from the rhui-custom-deps repo (?!)17:32
amoralejjpena, there is no advanced virtualization in rhui17:32
*** aedc has joined #rdo17:32
amoralejthere was some problem with synchronization of that particular module17:32
amoralejthat repo17:32
jpenaaha17:32
amoralejso we uploaded as bare rpms to the custom-deps in rhui17:33
amoralejand it was working until some days ago17:33
*** ccamposr__ has joined #rdo17:36
rdogerritMerged config master: Disable legacy-rdo-deps-uc-send-review job in master branch  https://review.rdoproject.org/r/2359017:36
*** chem|eod has joined #rdo17:37
*** jcapitao has quit IRC17:38
*** ccamposr has quit IRC17:38
rdogerritJavier Peña proposed rdo-infra/rdo-infra-playbooks master: Remove blogs.rdoproject.org from inventory  https://review.rdoproject.org/r/2350417:38
amoralejjpena, sshnaidm|rover definitively dnf update to dnf-4.2.7-6.el8.noarch broke us17:43
amoralejapevec, ^17:43
amoralejthat's breaking installation of virtualization packages from rhui17:44
amoralejjpena, sshnaidm|rover look at last line in https://access.redhat.com/downloads/content/rhel---8/x86_64/7416/dnf/4.2.7-6.el8/noarch/fd431d51/package-changelog17:45
amoralej"Remove patch to not fail when installing modular RPMs without modular metadata"17:45
jpenabut, but... why?17:46
*** mvkr has joined #rdo17:47
*** jpich has quit IRC17:49
*** cyberworm54 has joined #rdo17:55
rlandy|rucksshnaidm|rover: wrt https://bugs.launchpad.net/tripleo/+bug/1850188 - those time differences are to push to rdproject registry only?18:00
openstackLaunchpad bug 1850188 in tripleo "periodic container build (train) timing out" [Critical,Triaged]18:00
*** derekh has quit IRC18:00
rlandy|ruckie: not docker.io?18:00
sshnaidm|roverrlandy|ruck, I don't know yet if it's pushing to registry18:01
sfbenderJavier Peña created DLRN master: Add new known error to the regular expression  https://softwarefactory-project.io/r/1692918:02
sshnaidm|roveramoralej, that doesn't sound good..18:03
rlandy|ruckwe can check that18:03
amoralejnop, we need to think of a fix for that18:03
sshnaidm|roverrlandy|ruck, trying to find this stuff in code to understand what is going on there18:03
amoralejideally, doing proper synchronization of adv virt module in rhui18:03
amoralejbut I'm not sure if that's possible18:04
sshnaidm|roveramoralej, ok, will submit a bug meanwhile..18:04
amoralejok18:05
amoralejsshnaidm|rover, is this only impacting build-containers job?18:08
sshnaidm|roverrlandy|ruck, amoralej https://bugs.launchpad.net/tripleo/+bug/185141718:08
openstackLaunchpad bug 1851417 in tripleo "Nova libvirt container fails to build on RHEL-8 because last dnf changes" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)18:08
sshnaidm|roveramoralej, yeah, 3 containers18:08
rlandy|rucktanks - added to etherpad18:08
sshnaidm|roverrlandy|ruck, it's kinda blocking all rhel8 stuff on master for now18:11
*** cyberworm54 has quit IRC18:11
sshnaidm|roverrlandy|ruck, so we can focus on centos :)18:11
rlandy|rucksshnaidm|rover: right - because that is looking for a hash that is not pushed18:12
rlandy|rucksshnaidm|rover: yes and no - we have other problems there18:12
rlandy|rucktrain containers push and master overcloud image build18:12
rlandy|rucksshnaidm|rover: plus this ...18:12
sfbenderJavier Peña proposed DLRN master: Add new known error to the regular expression  https://softwarefactory-project.io/r/1692918:12
rlandy|ruckhttps://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/RedHat-8/master.yml#L3118:13
rlandy|ruckwe have a mix of tripleo-current and tripleo-ci-testing18:13
sshnaidm|roverrlandy|ruck, overcloud image build I'd delegate in CIX call to DF team or other, not sure we can do something there..18:13
sshnaidm|roverrlandy|ruck, and train containers I'm checking..18:13
rlandy|ruckI'm following a change there but the failure is sporadic18:14
rlandy|rucksshnaidm|rover: when we run the rhel check jobs ...18:15
rlandy|ruckwe should in theory be picking up dlrn_hash_tag: current-tripleo18:15
sshnaidm|roverrlandy|ruck, yeah18:15
rlandy|ruckNot found image: docker://trunk.registry.rdoproject.org/tripleomaster/rhel-binary-aodh-api:a158b862eaf99f0f3018496adf076b538ae5a64d_0014621218:15
rlandy|ruckthat hash should be there from the last promotion18:16
rlandy|ruckie: failing containers build -push jobs in promotions should not impact check jobs18:17
rlandy|ruckbut they do18:17
*** amoralej is now known as amoralej|off18:17
rlandy|ruckthat's not how the rest of our check jobs work18:17
sshnaidm|roverrlandy|ruck, not sure I follow18:18
rlandy|ruckalso we should be picking up the current-tripleo image18:18
rlandy|rucksshnaidm|rover, see https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/RedHat-8/master.yml#L3118:19
rlandy|ruckvs18:19
rlandy|ruckhttps://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/CentOS-7/master.yml#L2618:19
sshnaidm|roverrlandy|ruck, yeah, that I noticed18:20
rlandy|rucksshnaidm|rover: so we have more unstable rhel chcek jobs than centos check jobs18:20
sshnaidm|roverrlandy|ruck, not great not terrible, though18:20
rlandy|ruckwill put in a review for that18:20
rlandy|ruckit's a problem when the image build fails18:20
sshnaidm|roverrlandy|ruck, we update the images during the job to last tripleo packages18:21
rlandy|ruckyes18:21
sshnaidm|roverrlandy|ruck, well, but non-tripleo packages should be promoted, yeah18:21
rlandy|ruckso we should look for the more stable image18:21
sshnaidm|roverrlandy|ruck, let's fix it then18:21
rlandy|ruckanyways18:21
rlandy|ruckack - doing that18:21
rlandy|ruckconsidering containers ...18:22
sshnaidm|roverrlandy|ruck, seems like it's leftovers from times we didn't have any promotion in rhel18:22
rlandy|ruckhere we should be picking up current-tripleo18:22
rdogerritMerged rdo-infra/ci-config master: Remove jobs for ocata and pike and add weirdo for newer clousisg  https://review.rdoproject.org/r/2358118:22
rlandy|ruck(ie: what concerns me if when check jobs are unstable sue to failing promotion jobs)18:23
rlandy|ruckbut we're failing on getting the hash we are looking for18:23
rlandy|ruckthat should not be18:23
*** chem|eod has quit IRC18:24
rlandy|ruckwhen we deal with centos - we pull the container from docker.io18:24
rlandy|ruckdocker_registry_host: docker.io18:25
rlandy|ruckwhen we real with rhel, we pull the container from rdo registry18:25
rdogerritMerged rdo-infra/rdo-infra-playbooks master: Remove blogs.rdoproject.org from inventory  https://review.rdoproject.org/r/2350418:25
rlandy|ruckdocker_registry_host: trunk.registry.rdoproject.org18:25
rlandy|ruckwhen we run check the container hash should exist18:27
sshnaidm|roverrlandy|ruck, yeah, I see we use dlrn_hash_tag: current-tripleo18:28
sshnaidm|roverrlandy|ruck, but this specific container doesn't exist18:28
rlandy|ruckbut yet we fail out on that all the time18:28
sshnaidm|roverrlandy|ruck, is it promoted hash?18:29
rlandy|ruckcheck should be using a more stable hash18:29
sshnaidm|roverrlandy|ruck, or maybe it's because current-tripleo of centos is not as for rhel18:29
rlandy|rucksshnaidm|rover: yeah18:29
rlandy|ruckwhich is why our rhel check jobs are so unstable18:29
rlandy|ruck^^ not good18:29
sshnaidm|roverrlandy|ruck, yeah, because centos hash is moving forward18:30
rlandy|ruckcheck should not be that dependent on failing promotions18:30
rlandy|ruckthat is the whole point of check18:30
rlandy|rucksshnaidm|rover: let me fix images link18:30
sshnaidm|roverrlandy|ruck, well, we can manage separately rhel and centos current-tripleo hashes18:30
rlandy|ruckthen will write up a bug on containers and we can discuss best path there18:30
sshnaidm|roverrlandy|ruck, but it wasn't the initial idea I think18:31
sshnaidm|roverrlandy|ruck, which bug on containers?18:31
*** chem|eod has joined #rdo18:31
rlandy|ruckI want to write up a new bug18:31
rlandy|ruckso we have a clear decision here18:31
rlandy|ruckand check can be more stable18:31
sshnaidm|roverrlandy|ruck, ack18:32
rlandy|rucksomething like last-known-good18:32
*** rfolco|afk is now known as rfolco18:34
apevecisn't current-tripleo supposed to be last-known-good ?18:40
rlandy|ruckyes - but rhel and centos are pulling that current-tripleo from a different repo18:41
rlandy|ruckbu design18:41
rlandy|ruckby18:41
apevecamoralej, jpena, re. 8.1 dnf - I don't have a solution, really why was that patch removed?? and will that also break workaround in koji?18:41
apevecerr mock18:41
jpenaapevec: dunno why the patch was removed, I'll check bugzilla tomorrow and see if I can find something18:42
apevecack18:43
*** marst has quit IRC18:44
*** jpena is now known as jpena|off18:45
*** Caterpillar2 has joined #rdo18:46
*** jtomasek has joined #rdo18:53
*** ralonsoh has quit IRC18:54
*** Caterpillar2 has quit IRC19:01
*** jaosorior has joined #rdo19:03
*** aedc has quit IRC19:07
*** jtomasek has quit IRC19:12
*** xek_ has joined #rdo19:13
*** xek has quit IRC19:14
*** jaosorior has quit IRC19:15
* apevec kinda starts to not like modules...19:15
*** sshnaidm|rover is now known as sshnaidm|off19:16
*** ccamposr has joined #rdo19:28
*** dpawlik has joined #rdo19:28
*** radeks has joined #rdo19:29
*** ccamposr__ has quit IRC19:30
*** aedc has joined #rdo19:33
*** rh-jelabarre has quit IRC19:40
*** rh-jelabarre has joined #rdo19:42
*** Goneri has quit IRC19:51
*** ccamposr__ has joined #rdo19:52
*** eharney has quit IRC19:52
*** ccamposr has quit IRC19:54
*** rh-jelabarre has quit IRC19:55
*** rh-jelabarre has joined #rdo19:57
*** dpawlik has quit IRC20:13
*** tosky has quit IRC20:16
*** zbr is now known as zbr|ooo20:29
*** radeks has quit IRC20:34
*** xek_ has quit IRC20:49
*** xek has joined #rdo20:50
*** eharney has joined #rdo20:57
*** Goneri has joined #rdo20:57
*** xek has quit IRC20:59
*** bandini has quit IRC21:03
*** aedc has quit IRC21:03
*** Trevor_V has quit IRC21:23
*** raildo has quit IRC21:25
*** weshay is now known as weshay_ptg21:50
rdogerritAdam Kimball created rdo-infra/ci-config master: ppc64le: Switch venv to Install through yum  https://review.rdoproject.org/r/2360421:53
*** rh-jelabarre has quit IRC21:55
*** mcornea has quit IRC22:01
*** pcaruana has quit IRC22:03
*** rcernin has joined #rdo22:29
*** ekultails has quit IRC22:49
*** zbr|ooo has quit IRC23:00
*** ramishra has joined #rdo23:04
*** apevec has quit IRC23:08
*** rlandy|ruck is now known as rlandy|ruck|bbl23:40
*** hybridpollo has joined #rdo23:41
*** ccamposr__ has quit IRC23:46
*** bnemec has joined #rdo23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!