| clarkb | dmsimard: ianw: the tripleo heat templates change tseting the zuul-jobs update for ovs installs finally got test nodes. The logs for the standalone job lgtm | 00:05 |
|---|---|---|
| clarkb | I won't merge the zuul-jobs change since its getting late in my day and we probably want to watch that one, but I'll +2 it now. I can approve it in the morning or maybe ianw wants to watch it? | 00:05 |
| dmsimard | If jobs break as a consequence of that change, it probably means it is related to the ceph and virt repositories (were jobs relying on them without explicitely setting them up?) | 00:07 |
| clarkb | dmsimard: yup | 00:07 |
| dmsimard | net fix is that we properly set up the repo, install ovs and clean it up now :p | 00:07 |
| clarkb | dmsimard: I know tripleo disables all the things they don't want so don't expect issues from tripleo | 00:07 |
| dmsimard | actually, I think they do uninstall them somewhere | 00:07 |
| clarkb | more concerned about anyone else using multinode centos | 00:08 |
| clarkb | ya tripleo should be fine | 00:08 |
| dmsimard | ah, kolla, osa, etc | 00:08 |
| clarkb | I do think we should help them add the right repos if that does happen rather than revert. The chagne is definitely an improvement and more closely matches what we want to do there | 00:31 |
| *** ssbarnea|rover has quit IRC | 00:34 | |
| *** rfolco has quit IRC | 02:30 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add change status page https://review.openstack.org/599472 | 02:49 |
| *** bhavikdbavishi has joined #zuul | 02:51 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add change status page https://review.openstack.org/599472 | 03:18 |
| *** smyers has quit IRC | 03:51 | |
| *** smyers has joined #zuul | 03:52 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add projects page https://review.openstack.org/604266 | 03:55 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: refactor change page to use a reducer https://review.openstack.org/625145 | 03:55 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: refactor projects page to use a reducer https://review.openstack.org/625146 | 03:55 |
| ianw | clarkb / dmsimard : sorry totally sniped by the openstacksdk issues, which i started looking at because it was blocking my nodepool fixup job, which was blocking the dib gate. one of those days :) | 03:59 |
| *** bhavikdbavishi has quit IRC | 04:50 | |
| *** bhavikdbavishi has joined #zuul | 04:51 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/nodepool master: Implement an OpenShift resource provider https://review.openstack.org/570667 | 04:55 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: update status page layout based on screen size https://review.openstack.org/622010 | 05:37 |
| *** bhavikdbavishi has quit IRC | 06:06 | |
| *** swest has joined #zuul | 06:14 | |
| *** bhavikdbavishi has joined #zuul | 06:24 | |
| *** quiquell|off is now known as quiquell | 07:11 | |
| *** pcaruana has joined #zuul | 07:12 | |
| *** bhavikdbavishi has quit IRC | 07:35 | |
| *** ssbarnea|rover has joined #zuul | 07:40 | |
| *** hashar has joined #zuul | 08:27 | |
| *** dkehn has quit IRC | 08:28 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add change status page https://review.openstack.org/599472 | 08:35 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: refactor change page to use a reducer https://review.openstack.org/625145 | 08:35 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add projects page https://review.openstack.org/604266 | 08:35 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: refactor projects page to use a reducer https://review.openstack.org/625146 | 08:35 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add labels page https://review.openstack.org/604682 | 08:35 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add nodes page https://review.openstack.org/604683 | 08:35 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: refactor build page to use a reducer https://review.openstack.org/624894 | 08:35 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: refactor build page using a container https://review.openstack.org/624895 | 08:35 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add errors from the job-output to the build page https://review.openstack.org/624896 | 08:35 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add jobs graph rendering https://review.openstack.org/537869 | 08:35 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: add project page https://review.openstack.org/625177 | 08:35 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: refactor job page to use a reducer https://review.openstack.org/625178 | 08:35 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: refactor labels page to use a reducer https://review.openstack.org/625179 | 08:35 |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul master: web: refactor nodes page to use a reducer https://review.openstack.org/625180 | 08:35 |
| *** bhavikdbavishi has joined #zuul | 08:42 | |
| *** jpena|off is now known as jpena | 08:48 | |
| tristanC | sorry for the spam, i put the patches in order to avoid rebase issues | 09:07 |
| *** bhavikdbavishi has quit IRC | 09:17 | |
| *** bhavikdbavishi has joined #zuul | 10:07 | |
| *** neilsun has joined #zuul | 10:34 | |
| *** neilsun has quit IRC | 10:36 | |
| *** bhavikdbavishi has quit IRC | 10:40 | |
| *** bhavikdbavishi has joined #zuul | 10:46 | |
| *** electrofelix has joined #zuul | 10:49 | |
| *** bhavikdbavishi has quit IRC | 11:10 | |
| *** rfolco has joined #zuul | 11:16 | |
| *** bhavikdbavishi has joined #zuul | 11:28 | |
| *** bhavikdbavishi has quit IRC | 11:36 | |
| *** bhavikdbavishi has joined #zuul | 12:17 | |
| *** pcaruana has quit IRC | 12:21 | |
| *** pcaruana has joined #zuul | 12:22 | |
| *** pcaruana is now known as pcaruana|intw| | 12:25 | |
| *** jpena is now known as jpena|lunch | 12:31 | |
| *** bhavikdbavishi has quit IRC | 12:54 | |
| *** bhavikdbavishi has joined #zuul | 13:04 | |
| *** quiquell is now known as quiquell|lunch | 13:13 | |
| *** EmilienM is now known as EvilienM | 13:20 | |
| *** jpena|lunch is now known as jpena | 13:35 | |
| *** bhavikdbavishi has quit IRC | 13:36 | |
| *** rlandy has joined #zuul | 13:37 | |
| *** dkehn has joined #zuul | 13:58 | |
| *** pcaruana|intw| has quit IRC | 14:05 | |
| *** hashar has quit IRC | 14:23 | |
| strigazi | hello, I'm trying to use secrets in a job, but I miss smth. I can't figure it out since some time. can someone have a look? https://review.openstack.org/#/c/585420/25 | 14:28 |
| pabelanger | strigazi: zuul left a comment at: https://review.openstack.org/#/c/585420/25/.zuul.yaml publish isn't valid, should be post-run | 14:30 |
| *** pcaruana has joined #zuul | 14:31 | |
| strigazi | pabelanger: thanks | 14:38 |
| *** bbayszczak has joined #zuul | 14:38 | |
| *** panda|off is now known as panda | 14:50 | |
| *** quiquell|lunch is now known as quiquell | 15:12 | |
| *** hashar has joined #zuul | 15:58 | |
| *** bhavikdbavishi has joined #zuul | 15:59 | |
| *** hashar has quit IRC | 15:59 | |
| clarkb | I've approved https://review.openstack.org/#/c/624817/ and will keep an eye out for any unanticipated side effects | 16:15 |
| *** pcaruana has quit IRC | 16:20 | |
| *** quiquell is now known as quiquell|off | 16:23 | |
| *** pwhalen has quit IRC | 16:24 | |
| *** electrofelix has quit IRC | 16:29 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Vendor the RDO repository configuration for installing OVS https://review.openstack.org/624817 | 16:44 |
| *** bbayszczak has quit IRC | 16:47 | |
| *** sshnaidm|off has quit IRC | 17:10 | |
| dmsimard | clarkb: ack, let me know if there's anything | 17:14 |
| *** sshnaidm|off has joined #zuul | 17:25 | |
| *** tobiash has quit IRC | 17:29 | |
| Shrews | tristanC: did you mean to remove the post.yaml playbook from https://review.openstack.org/570667 ? | 17:33 |
| *** tobiash has joined #zuul | 17:40 | |
| *** tobiash has quit IRC | 17:45 | |
| *** tobiash has joined #zuul | 17:55 | |
| *** tobiash has quit IRC | 18:05 | |
| *** jpena is now known as jpena|off | 18:06 | |
| *** tobiash has joined #zuul | 18:07 | |
| *** chandan_kumar has quit IRC | 18:46 | |
| pabelanger | tristanC: can't remember if we talked about this or not, but it would be helpful if we could also filter job under builds for the dashboard, that are PRE_FAILURES (not even sure we log that). The use case I am thinking about, is to help a zuul operator keep track of those failures as they are likely related to infrastructure. eg: bad dns, networking, etc | 19:01 |
| pabelanger | today, from dashboard we have zero inside into that | 19:01 |
| clarkb | pabelanger: ya I was poking at that from the perspective of logstash and elasticsearch and we don't really differentiate today | 19:02 |
| clarkb | we need to update the executor server's recording of things first I think | 19:02 |
| clarkb | maybe even add an attribute called failed-in and set that to pre-run, run or post-run appropriately | 19:03 |
| pabelanger | clarkb: Yah, I think so. I might look into it later today or monday. I've been chasing down fedora mirror issues in ansible-network, and really didn't know it was an issue until I see a few RETRY_LIMIT results | 19:03 |
| pabelanger | but that is only if we fail 3 times | 19:04 |
| clarkb | pabelanger: openstack has the opposite issue of we track it with elasticsearch but over prioritize fixing things that will be retried. We should still fix them but their impact is lower than what elastic-recheck implies it is | 19:05 |
| pabelanger | +1 | 19:05 |
| pabelanger | in my case, I disabled elastic-search when we moved to swift for logs. I need to look how to re-enable it | 19:06 |
| clarkb | pabelanger: another idea I had was to record if a failure would be retried | 19:06 |
| clarkb | btu I think recording info about run stage might be more flexible | 19:06 |
| pabelanger | I also, want to see how I can run elastic-recheck for ansible-network. It is a great tool in openstack, but never looked to use it outside of openstack | 19:07 |
| clarkb | really the hard part is getting your logs into shape so that they are consistent enough that they can be indexed and queried | 19:07 |
| pabelanger | yah | 19:07 |
| clarkb | ocne that is done it should be pretty straightforward (I think e-r even doesn't assume openstack' ES anymore) | 19:07 |
| *** bhavikdbavishi has quit IRC | 19:15 | |
| *** bhavikdbavishi has joined #zuul | 19:15 | |
| *** bhavikdbavishi has quit IRC | 19:20 | |
| strigazi | hello, with help from pabelanger I managed to create the job with secrets I wanted. I made this job as post and in post it failed (504 from registry.fedoraproject.org). is it possible to trigeer it again? | 20:55 |
| strigazi | here is the job: | 20:55 |
| strigazi | https://review.openstack.org/#/c/585420/30/.zuul.yaml@359 | 20:56 |
| strigazi | here is the failure: | 20:56 |
| strigazi | http://logs.openstack.org/20/20d965c86428b26adc17f89e32917cbea77bbf7e/post/container-publish/35bd2ff/ | 20:56 |
| strigazi | shall I ask in -infra ? | 20:56 |
| dmsimard | strigazi: it looks like there's errors in there that are unrelated to your secret | 20:59 |
| dmsimard | for example http://logs.openstack.org/20/20d965c86428b26adc17f89e32917cbea77bbf7e/post/container-publish/35bd2ff/ara-report/result/899121b3-9208-4f4e-96f0-d6a7d1cfcdcb/ and http://logs.openstack.org/20/20d965c86428b26adc17f89e32917cbea77bbf7e/post/container-publish/35bd2ff/ara-report/result/e526ebb5-444e-4029-a2d4-00d9d25686d9/ | 20:59 |
| dmsimard | (from http://logs.openstack.org/20/20d965c86428b26adc17f89e32917cbea77bbf7e/post/container-publish/35bd2ff/ara-report/ ) | 21:00 |
| *** rlandy has quit IRC | 21:12 | |
| *** chandan_kumar has joined #zuul | 21:13 | |
| pabelanger | strigazi: dmsimard: you also want to change your password for docker login, you have leaked it in the post job: http://logs.openstack.org/20/20d965c86428b26adc17f89e32917cbea77bbf7e/post/container-publish/35bd2ff/ara-report/result/290d3f6c-b4e5-4e4a-afcd-b683888aa763/ | 21:28 |
| pabelanger | will need to use no_log: True | 21:28 |
| strigazi | pabelanger: :( I thought secrets would be logged | 21:37 |
| pabelanger | strigazi: you need to use no_log: True for ansible | 21:37 |
| pabelanger | otherwise, they are just in stdout | 21:37 |
| pabelanger | from ansibles POV, it doesn't know anything about secrets | 21:38 |
| pabelanger | just an ansible variable | 21:38 |
| dmsimard | same thing for ARA for what it's worth | 21:39 |
| dmsimard | ara picks up whatever ansible sends to it | 21:39 |
| *** EvilienM is now known as EmilienM | 21:44 | |
| strigazi | dmsimard: pabelanger lgtu? https://review.openstack.org/625351 | 21:44 |
| *** rfolco has quit IRC | 22:22 | |
| *** hashar has joined #zuul | 22:59 | |
| *** hashar has quit IRC | 23:30 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!