| *** openstack has joined #openstack-dib | 00:16 | |
| *** jamielennox has quit IRC | 00:16 | |
| *** jamielennox has joined #openstack-dib | 00:16 | |
| *** zigo has quit IRC | 00:17 | |
| *** peterstac has quit IRC | 00:17 | |
| *** strigazi has joined #openstack-dib | 00:24 | |
| *** zigo has joined #openstack-dib | 00:24 | |
| *** peterstac has joined #openstack-dib | 00:24 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] use ci mirrors https://review.openstack.org/475607 | 00:42 |
|---|---|---|
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] use ci mirrors https://review.openstack.org/475607 | 00:47 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] use ci mirrors https://review.openstack.org/475607 | 00:52 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] use ci mirrors https://review.openstack.org/475607 | 00:56 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] use ci mirrors https://review.openstack.org/475607 | 01:04 |
| *** rfolco has joined #openstack-dib | 01:39 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] use ci mirrors https://review.openstack.org/475607 | 01:47 |
| *** zhugaoxiao has joined #openstack-dib | 02:51 | |
| *** prometheanfire has joined #openstack-dib | 02:59 | |
| *** chhavi has joined #openstack-dib | 03:02 | |
| *** rfolco has quit IRC | 03:13 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] use ci mirrors https://review.openstack.org/475607 | 03:20 |
| *** chhavi has quit IRC | 04:13 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] use ci mirrors https://review.openstack.org/475607 | 04:19 |
| *** aparnav has joined #openstack-dib | 04:38 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] use ci mirrors https://review.openstack.org/475607 | 04:45 |
| *** andreas-f has joined #openstack-dib | 04:48 | |
| *** pleia2_ is now known as pleia2 | 05:09 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] use ci mirrors https://review.openstack.org/475607 | 05:16 |
| *** chhavi has joined #openstack-dib | 05:38 | |
| *** yolanda has joined #openstack-dib | 06:06 | |
| ianw | between known CI dns issues, and mirror issues, the gate is ... not happy | 06:19 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Start at using CI mirrors for fedora/centos https://review.openstack.org/475607 | 06:32 |
| ianw | ^ is a start ... the image downloads we do need to start being cached ... | 06:39 |
| yolanda | hi ianw , i saw the changes merged yesterday night. How is the status of the image building? | 07:06 |
| *** andreas-f has quit IRC | 07:17 | |
| *** cmurphy_ is now known as cmurphy | 07:18 | |
| ianw | yolanda: i've re-run octavia several times and not seen the problem, so that's promising | 07:34 |
| ianw | but the gate is fairly painful ATM | 07:34 |
| yolanda | going to build an image today with partitions | 07:34 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Start at using CI mirrors for fedora/centos https://review.openstack.org/475607 | 07:37 |
| *** andreas-f has joined #openstack-dib | 07:54 | |
| *** Administrator_ has joined #openstack-dib | 08:17 | |
| *** zhugaoxiao has quit IRC | 08:20 | |
| openstackgerrit | Noam Angel proposed openstack/diskimage-builder master: disk-image-create flag that receive packages to be removed before install phase https://review.openstack.org/475701 | 08:35 |
| *** openstackgerrit has quit IRC | 08:48 | |
| *** openstackgerrit has joined #openstack-dib | 08:49 | |
| openstackgerrit | Noam Angel proposed openstack/diskimage-builder master: add flag -r that receive packages to be removed before install phase https://review.openstack.org/475701 | 08:49 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Start at using CI mirrors for fedora/centos https://review.openstack.org/475607 | 09:18 |
| *** openstackgerrit has quit IRC | 09:33 | |
| *** amarao has joined #openstack-dib | 09:58 | |
| *** openstackgerrit has joined #openstack-dib | 10:36 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Start at using CI mirrors for fedora/centos https://review.openstack.org/475607 | 10:36 |
| openstackgerrit | Noam Angel proposed openstack/diskimage-builder master: add flag -r that receive packages to be removed before install phase https://review.openstack.org/475701 | 10:40 |
| *** aparnav has quit IRC | 10:42 | |
| *** aparnav has joined #openstack-dib | 10:42 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Start at using CI mirrors for fedora/centos https://review.openstack.org/475607 | 11:27 |
| ianw | this mirror stuff just has tentacles everywhere ... hopefully that closer ... | 11:28 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move ironic-agent test to fedora-minimal https://review.openstack.org/475749 | 11:37 |
| ianw | if that works, it's one less download ... | 11:37 |
| ianw | dirk / hwoarang : it looks like suse is having constant build failures | 11:43 |
| *** rfolco has joined #openstack-dib | 12:14 | |
| openstackgerrit | Noam Angel proposed openstack/diskimage-builder master: add flag -r that receive packages to be removed before install phase https://review.openstack.org/475701 | 12:19 |
| *** farosas has joined #openstack-dib | 12:40 | |
| *** aparnav has quit IRC | 12:42 | |
| *** yolanda has quit IRC | 13:19 | |
| *** yolanda has joined #openstack-dib | 13:24 | |
| hwoarang | ianw: could you point me to one of the logs? | 13:25 |
| *** Administrator_ has quit IRC | 14:01 | |
| *** Administrator_ has joined #openstack-dib | 14:02 | |
| *** bkero has quit IRC | 14:16 | |
| *** isaacb has joined #openstack-dib | 14:28 | |
| *** andreas-f has quit IRC | 14:58 | |
| *** isaacb has quit IRC | 15:01 | |
| *** isaacb has joined #openstack-dib | 15:12 | |
| *** amarao has quit IRC | 15:56 | |
| *** isaacb has quit IRC | 16:10 | |
| *** sudipto has joined #openstack-dib | 16:17 | |
| *** sudipto_ has joined #openstack-dib | 16:17 | |
| *** andreas-f has joined #openstack-dib | 17:16 | |
| *** yolanda_ has joined #openstack-dib | 17:16 | |
| *** yolanda_ has quit IRC | 17:21 | |
| *** sudipto has quit IRC | 17:40 | |
| *** sudipto_ has quit IRC | 17:40 | |
| *** chhavi has quit IRC | 18:18 | |
| *** andreas-f has quit IRC | 18:27 | |
| *** andreas-f has joined #openstack-dib | 18:37 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Start at using CI mirrors for fedora/centos https://review.openstack.org/475607 | 19:08 |
| ianw | johnsom / rm_work : i'm assuming no news is good news re partition-related failure rates? | 19:28 |
| johnsom | Yeah, haven't seen an issue yet | 19:29 |
| ianw | ++ given the prior frequency, that seems good | 19:30 |
| *** andreas-f has quit IRC | 19:38 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Switch apt-sources test to ubuntu-minimal https://review.openstack.org/475907 | 19:40 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Switch apt-sources test to ubuntu-minimal https://review.openstack.org/475907 | 19:44 |
| *** andreas-f has joined #openstack-dib | 20:02 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Switch apt-sources test to ubuntu-minimal https://review.openstack.org/475907 | 20:19 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Switch apt-sources test to ubuntu-minimal https://review.openstack.org/475907 | 20:26 |
| rm_work | johnsom: AUGH WHAT | 20:29 |
| rm_work | sorry wrong channel | 20:29 |
| rm_work | nm this is the right channel | 20:30 |
| rm_work | everything is blowing up right now in the gate | 20:30 |
| rm_work | http://logs.openstack.org/92/475892/1/gate/gate-octavia-v1-dsvm-scenario-ubuntu-xenial/8a5f2c0/logs/devstacklog.txt.gz#_2017-06-20_19_57_12_741 | 20:30 |
| johnsom | Ha, yeah, looks like a bad cloud image | 20:31 |
| rm_work | ianw: T_T | 20:32 |
| rm_work | i'm starting to think there's a curse of some sort at work here | 20:33 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Switch apt-sources test to ubuntu-minimal https://review.openstack.org/475907 | 20:36 |
| ianw | rm_work: ^ why i'm trying to get the gate using mirrors! | 20:36 |
| rm_work | k | 20:37 |
| ianw | but yes, i agree there is a curse atm | 20:37 |
| ianw | we need to get that image cached like we do for devstack ... it's in the queue to work on | 20:37 |
| johnsom | It is the third milestone curse. | 20:37 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Switch apt-sources test to ubuntu-minimal https://review.openstack.org/475907 | 20:39 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Switch apt-sources test to ubuntu-minimal https://review.openstack.org/475907 | 20:47 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Switch apt-sources test to ubuntu-minimal https://review.openstack.org/475907 | 20:51 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Switch apt-sources test to ubuntu-minimal https://review.openstack.org/475907 | 20:58 |
| *** andreas-f has quit IRC | 21:01 | |
| ianw | rm_work: any reason to not use ubuntu-minimal? | 21:04 |
| rm_work | umm | 21:04 |
| rm_work | i think we maybe tried and it didn't work? | 21:04 |
| rm_work | we can try again | 21:04 |
| rm_work | i forget why | 21:04 |
| rm_work | i can spin a devstack really quick | 21:05 |
| ianw | hmm, well it's going to be easier to mirror-ise ... see that patch 475907 | 21:05 |
| rm_work | yeah | 21:05 |
| ianw | if we get that ground work in, you could in theory switch, include the openstack-ci-mirrors element during testing and be isolated from the image download | 21:06 |
| rm_work | ianw: so i'd just change: | 21:07 |
| rm_work | AMP_element_sequence=${AMP_element_sequence:-"base vm ubuntu"} | 21:08 |
| rm_work | to be ubuntu-minimal | 21:08 |
| rm_work | right? | 21:08 |
| *** owalsh_ has joined #openstack-dib | 21:10 | |
| rm_work | dib-run-parts Tue Jun 20 14:08:40 PDT 2017 Running /tmp/dib_build.NcouTJq8/hooks/root.d/08-debootstrap | 21:11 |
| rm_work | sh: 1: debootstrap: not found | 21:11 |
| rm_work | wut | 21:12 |
| rm_work | is this a fail on my side? | 21:12 |
| rm_work | not actually sure how old this dib is | 21:12 |
| rm_work | i should update everything | 21:12 |
| *** owalsh has quit IRC | 21:12 | |
| dirk | ianw: any links to the opensuse failures or a log message that I could search for in logstash? | 21:19 |
| ianw | rm_work: you'll probably need different bits installed | 21:27 |
| ianw | see tests/install_test_deps.sh | 21:27 |
| ianw | dirk: http://logs.openstack.org/51/475051/1/check/gate-dib-dsvm-functests-python2-ubuntu-trusty-extras-nv/d529b7b/console.html | 21:28 |
| rm_work | k, urg, really didn't/don't have time to be dealing with this presently T_T | 21:29 |
| rm_work | *cursed* | 21:29 |
| ianw | rm_work: no worries ... just an idea | 21:29 |
| rm_work | yeah i was gonna try it if it was simple, but i can't affort to yak shave ATM | 21:29 |
| dirk | ianw: ah, ok, so the download servers are not responding / in time | 21:30 |
| *** bkero has joined #openstack-dib | 21:30 | |
| *** bkero has joined #openstack-dib | 21:30 | |
| dirk | ianw: hmm, I wonder if that's an ipv6 thing | 21:32 |
| dirk | ianw: did you see a fail on ipv4 ever? | 21:32 |
| ianw | dirk: i'm not sure, there's been so many failures lately it could be anything | 21:34 |
| *** andreas-f has joined #openstack-dib | 21:35 | |
| ianw | maybe just look through recent failures | 21:35 |
| ianw | i just learnt it's winter solstice here today. that must explain all these gremlins | 21:35 |
| dirk | ianw: from a brief look it seems ipv6 related | 21:42 |
| *** rfolco has quit IRC | 21:42 | |
| dirk | Just browsing through the logstash hits, 48 hits in the last 6 hours | 21:42 |
| dirk | I do see accesses to the same mirror via ipv4 succeeding | 21:43 |
| ianw | dirk: hmm, suse's end or our end? | 21:52 |
| *** clarkb has joined #openstack-dib | 21:54 | |
| dirk | Well, likely that particular mirror has a problem with the ipv6 connectivity | 21:55 |
| dirk | Ipv6 outbound from the cloud probably works because the master download redirector is serving via ipv6 as well | 21:56 |
| dirk | So it's bad luck us getting redirected to a mirror that seems to be partitioned ipv6 wise | 21:56 |
| *** openstack has joined #openstack-dib | 22:15 | |
| *** rm_work has joined #openstack-dib | 22:15 | |
| ianw | dirk: ^ that element in there, openstack-ci-mirrors -- i'd like to extend that so it "just works" for everything | 22:15 |
| dirk | ianw: well, there's more low hanging fruits. First of all we could set a timeout on mirror download to avoid failing the job on a single bad mirror. There is a way to fetch a list of mirrors that serve that file in the current version so we could try all of them | 22:17 |
| *** owalsh_ is now known as owalsh | 22:18 | |
| dirk | I would look at that approach first before setting up more complicated mirroring infra | 22:19 |
| ianw | dirk: yeah ... the real solution for these is to pre-cache the downloads in the infra images like we do for devstack images | 22:19 |
| ianw | and not hit the network at all | 22:19 |
| ianw | the problem has been getting the list of images, and making dib use them | 22:20 |
| dirk | Ianw: yes for ci, not for actual end users. Something worth keeping in mind that we don't do things primarily to keep the ci happy ;-) | 22:20 |
| ianw | well doing extra loops extra is really just for ci, i think users are exponentially less likely to hit this running once a day | 22:23 |
| ianw | rather than having timeouts etc i'd rather us have the infrastructure to do it right ... something we've put off for too long | 22:24 |
| *** farosas has quit IRC | 22:34 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Start at using CI mirrors for fedora/centos https://review.openstack.org/475607 | 22:38 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Use local mirror for ubuntu-minimal jobs https://review.openstack.org/475907 | 23:29 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Start at using CI mirrors for fedora/centos https://review.openstack.org/475607 | 23:29 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!