Saturday, 2016-04-02

*** catherineD has joined #openstack-infra00:00
*** yamamoto has quit IRC00:02
*** gyee has quit IRC00:02
pvaneckjeblair: so an npm install was triggered in the puppet run where the www directory was synced?00:03
jeblairpvaneck: no, there was a failed one before, but it did a lot before failing with an inscrutable error message, so i don't really know what happened00:04
jeblairpvaneck: no, but there was a failed one in the previous run, but it did a lot before failing with an inscrutable error message, so i don't really know what happened00:04
jeblair( ^ clarified)00:04
*** fawadkhaliq has quit IRC00:04
armaxAJaeger: ping00:04
*** salv-orl_ has quit IRC00:04
*** eil397 has quit IRC00:06
pvaneckjeblair: ah, okay. Should be good for now with that assets/lib folder actually generated. I will keep an eye out next time npm install is needed for future releases00:08
pvaneckthanks for the help00:08
openstackgerritMerged openstack-infra/project-config: Fix broken ironic gate jobs  https://review.openstack.org/30069400:09
*** eharney has quit IRC00:11
*** eharney has joined #openstack-infra00:11
*** harlowja has joined #openstack-infra00:12
*** harlowja has quit IRC00:15
*** harlowja has joined #openstack-infra00:15
*** tphummel has quit IRC00:21
*** tphummel has joined #openstack-infra00:21
*** keedya has quit IRC00:27
*** kzaitsev_mb has joined #openstack-infra00:27
*** sdake has quit IRC00:27
*** fbo has quit IRC00:28
*** sputnik13 has quit IRC00:29
openstackgerritEmilien Macchi proposed openstack-infra/project-config: copy_puppet_logs: gzip only files  https://review.openstack.org/30070000:40
pabelangerclarkb: still online?00:42
pabelangeram I reading this right: https://github.com/openstack-infra/system-config/blob/master/modules/openstack_project/files/reprepro/reprepro-mirror-update.sh#L2300:43
*** apoorvad has quit IRC00:43
pabelangerreprepo will only run for 2m 30s before timeout will try to kill it?00:44
*** Sukhdev has joined #openstack-infra00:44
pabelangerokay, it will run for 30m00:45
pabelangerthen send kill00:45
pabelangerclarkb: so that appears to be our issue.  reprepro is talking way longer then 30mins to import xenial00:46
pabelangerand it keeps getting killed00:46
pabelangerwhich I see00:46
pabelangerInterruption in progress, interrupt again to force-stop it (and risking database corruption!)00:46
pabelangerand eventually00:46
pabelangerThere have been errors!00:46
pabelangerso, we should definitely increase that timeout00:47
pabelangeror do the initial import manually00:47
*** mriedem has joined #openstack-infra00:47
*** tiswanso has joined #openstack-infra00:48
*** ZZelle_ has quit IRC00:48
*** Sukhdev has quit IRC00:49
clarkbprobably do initial one manually00:50
*** tiswanso has quit IRC00:51
openstackgerritPaul Belanger proposed openstack-infra/system-config: Bump reprepro to timeout after 90mins  https://review.openstack.org/30070100:51
pabelangerclarkb: Ya, added a comment and bumped our default timeout ^00:51
*** tiswanso has joined #openstack-infra00:51
pabelangerit will get stopped in 8mins00:51
*** roxanaghe has quit IRC00:51
pabelangerI'll open a screen session and do the import manually00:52
*** pvaneck has quit IRC00:55
*** achanda has quit IRC00:55
*** rfolco has joined #openstack-infra00:56
*** woodster_ has quit IRC00:57
*** yamamoto has joined #openstack-infra00:57
*** yamamoto has quit IRC01:03
*** rvasilets__ has quit IRC01:06
*** tphummel has quit IRC01:09
*** tphummel has joined #openstack-infra01:11
*** [1]Thelo has joined #openstack-infra01:19
*** Thelo has quit IRC01:21
*** [1]Thelo is now known as Thelo01:21
*** knikolla has quit IRC01:24
*** achanda has joined #openstack-infra01:26
*** bpokorny has joined #openstack-infra01:27
*** achanda has quit IRC01:30
*** markvoelker has joined #openstack-infra01:31
*** Qiming has joined #openstack-infra01:32
*** tphummel has quit IRC01:32
*** markvoelker_ has joined #openstack-infra01:33
*** markvoelker has quit IRC01:36
*** markvoel_ has joined #openstack-infra01:36
*** markvoelker_ has quit IRC01:39
*** bpokorny_ has joined #openstack-infra01:41
*** bpokorny has quit IRC01:45
*** bpokorny_ has quit IRC01:45
*** kzaitsev_mb has quit IRC01:48
*** roxanaghe has joined #openstack-infra01:52
*** akshai has joined #openstack-infra01:54
*** achanda has joined #openstack-infra01:55
*** akshai has quit IRC01:56
*** roxanaghe has quit IRC01:56
*** akshai has joined #openstack-infra01:57
*** baoli has joined #openstack-infra01:58
*** yamamoto has joined #openstack-infra01:59
*** yamamoto has quit IRC02:05
*** esker has joined #openstack-infra02:05
*** esker has quit IRC02:09
*** roxanaghe has joined #openstack-infra02:09
*** roxanaghe has quit IRC02:10
*** armax_ has joined #openstack-infra02:11
*** armax has quit IRC02:15
*** armax_ is now known as armax02:15
*** markvoelker has joined #openstack-infra02:19
*** markvoel_ has quit IRC02:20
*** esker has joined #openstack-infra02:21
*** EricGonczer_ has quit IRC02:24
*** roxanaghe has joined #openstack-infra02:26
*** elo has joined #openstack-infra02:26
*** roxanaghe has quit IRC02:27
*** tphummel has joined #openstack-infra02:31
*** logan- has quit IRC02:37
*** armax has quit IRC02:37
*** logan- has joined #openstack-infra02:38
*** armax has joined #openstack-infra02:42
*** ayoung has quit IRC02:43
*** kzaitsev_mb has joined #openstack-infra02:44
*** armax has quit IRC02:48
*** tonytan4ever has quit IRC02:48
*** kzaitsev_mb has quit IRC02:49
*** bpokorny has joined #openstack-infra02:49
*** rfolco has quit IRC02:52
*** bpokorny has quit IRC02:58
*** armax has joined #openstack-infra02:58
*** tqtran has quit IRC02:59
*** yamamoto has joined #openstack-infra03:01
*** thorst has joined #openstack-infra03:05
*** kong has quit IRC03:06
*** thorst has quit IRC03:06
*** yamamoto has quit IRC03:07
*** thorst has joined #openstack-infra03:07
*** markvoelker has quit IRC03:07
*** kzaitsev_mb has joined #openstack-infra03:14
*** thorst has quit IRC03:16
*** achanda has quit IRC03:17
*** baoli has quit IRC03:19
*** kzaitsev_mb has quit IRC03:19
*** markvoelker has joined #openstack-infra03:20
*** Guest54251 has quit IRC03:21
*** yamamoto has joined #openstack-infra03:25
*** yamamoto has quit IRC03:35
*** roxanaghe has joined #openstack-infra03:43
*** markvoelker has quit IRC03:44
*** salv-orlando has joined #openstack-infra03:47
*** roxanaghe has quit IRC03:47
*** mylu has joined #openstack-infra03:48
*** mylu has quit IRC03:52
*** tonytan4ever has joined #openstack-infra03:53
*** salv-orlando has quit IRC03:54
*** yamamoto has joined #openstack-infra03:55
*** tqtran has joined #openstack-infra03:56
*** mylu has joined #openstack-infra04:00
*** tqtran has quit IRC04:01
*** thorst has joined #openstack-infra04:13
*** kzaitsev_mb has joined #openstack-infra04:15
*** mylu has quit IRC04:17
*** thorst has quit IRC04:21
*** kzaitsev_mb has quit IRC04:22
*** mylu has joined #openstack-infra04:24
*** LaT0rtue has quit IRC04:32
*** roxanaghe has joined #openstack-infra04:44
*** esker has quit IRC04:47
*** roxanaghe has quit IRC04:48
*** LaT0rtue has joined #openstack-infra04:48
*** mylu has quit IRC04:52
*** mylu has joined #openstack-infra05:00
*** xarses has joined #openstack-infra05:06
*** tmartins has quit IRC05:06
*** thorst has joined #openstack-infra05:18
*** yamahata has joined #openstack-infra05:22
*** nadya has joined #openstack-infra05:24
*** esker has joined #openstack-infra05:24
*** thorst has quit IRC05:25
*** kushal has quit IRC05:26
*** esker has quit IRC05:29
*** mylu has quit IRC05:32
*** mylu has joined #openstack-infra05:33
*** tonytan4ever has quit IRC05:34
*** kushal has joined #openstack-infra05:39
*** esker has joined #openstack-infra05:45
*** eharney has quit IRC05:49
*** esker has quit IRC05:50
*** eharney has joined #openstack-infra05:51
*** mylu has quit IRC05:51
*** LaT0rtue has quit IRC05:56
*** mylu has joined #openstack-infra06:00
*** LaT0rtue has joined #openstack-infra06:02
*** ramishra has quit IRC06:06
*** ramishra has joined #openstack-infra06:08
*** mylu has quit IRC06:11
*** nadya has quit IRC06:23
*** thorst has joined #openstack-infra06:23
*** salv-orlando has joined #openstack-infra06:27
*** kelepirci_ has quit IRC06:28
*** thorst has quit IRC06:31
*** LaT0rtue has quit IRC06:35
*** salv-orlando has quit IRC06:37
*** yamamoto has quit IRC06:40
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/28884906:41
*** Jeffrey4l has joined #openstack-infra06:42
*** ramishra has quit IRC06:47
*** LaT0rtue has joined #openstack-infra06:47
*** ramishra has joined #openstack-infra06:48
*** esker has joined #openstack-infra06:51
*** esker has quit IRC06:55
*** salv-orlando has joined #openstack-infra07:02
*** nadya has joined #openstack-infra07:04
*** nadya has quit IRC07:09
*** esker has joined #openstack-infra07:12
*** mixos has quit IRC07:14
openstackgerritMerged openstack-infra/project-config: networking-bgpvpn dvsm job: add gate_hook  https://review.openstack.org/29961007:14
*** esker has quit IRC07:16
*** sputnik13 has joined #openstack-infra07:20
*** LaT0rtue has quit IRC07:20
*** dalgaaf has joined #openstack-infra07:21
*** sputnik13 has quit IRC07:24
*** mylu has joined #openstack-infra07:26
*** thorst has joined #openstack-infra07:29
*** wznoinsk_ has joined #openstack-infra07:30
*** mylu has quit IRC07:30
*** wznoinsk has quit IRC07:32
*** roxanaghe has joined #openstack-infra07:32
*** thorst has quit IRC07:35
*** roxanaghe has quit IRC07:37
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove unused magnum-ui mitaka translation job  https://review.openstack.org/29428607:37
*** salv-orlando has quit IRC07:37
*** yamamoto has joined #openstack-infra07:40
*** ihrachys has joined #openstack-infra07:42
*** yamamoto has quit IRC07:46
*** ifarkas has joined #openstack-infra07:47
*** esker has joined #openstack-infra07:53
*** ihrachys has quit IRC07:57
*** esker has quit IRC07:59
*** ihrachys has joined #openstack-infra08:07
*** fbo has joined #openstack-infra08:10
*** zz_dimtruck is now known as dimtruck08:11
*** yaume has joined #openstack-infra08:12
*** ifarkas has quit IRC08:22
*** yaume has quit IRC08:26
*** achanda has joined #openstack-infra08:32
*** ihrachys has quit IRC08:34
*** thorst has joined #openstack-infra08:34
*** shashank_hegde has quit IRC08:37
*** achanda has quit IRC08:41
*** thorst has quit IRC08:41
*** yamamoto has joined #openstack-infra08:43
*** yamamoto has quit IRC08:48
*** LaT0rtue has joined #openstack-infra08:51
*** GheRivero is now known as GheRivero_vaca09:01
*** bswartz has quit IRC09:08
*** wznoinsk_ has quit IRC09:11
*** roxanaghe has joined #openstack-infra09:21
*** roxanaghe has quit IRC09:25
*** mylu has joined #openstack-infra09:26
*** ihrachys has joined #openstack-infra09:28
*** mylu has quit IRC09:31
*** thorst has joined #openstack-infra09:39
*** esker has joined #openstack-infra09:41
*** yamamoto has joined #openstack-infra09:44
*** thorst has quit IRC09:45
*** esker has quit IRC09:45
*** yaume has joined #openstack-infra09:46
*** yaume has quit IRC09:46
*** yaume has joined #openstack-infra09:47
*** yamamoto has quit IRC09:50
*** dimtruck is now known as zz_dimtruck09:53
*** esker has joined #openstack-infra10:03
*** claudiub has joined #openstack-infra10:05
*** ihrachys has quit IRC10:07
*** kong has joined #openstack-infra10:07
*** esker has quit IRC10:08
*** yaume has quit IRC10:20
*** esker has joined #openstack-infra10:24
*** esker has quit IRC10:29
*** yamamoto has joined #openstack-infra10:30
*** cody-somerville has quit IRC10:37
*** thorst has joined #openstack-infra10:44
*** yolanda has joined #openstack-infra10:44
*** yamamoto has quit IRC10:47
*** cody-somerville has joined #openstack-infra10:50
*** thorst has quit IRC10:50
*** flepied1 has quit IRC10:54
*** flepied has joined #openstack-infra10:54
*** e0ne has joined #openstack-infra11:06
*** yamamoto has joined #openstack-infra11:09
*** roxanaghe has joined #openstack-infra11:09
openstackgerritMerged openstack-infra/project-config: copy_puppet_logs: gzip only files  https://review.openstack.org/30070011:10
*** e0ne has quit IRC11:12
*** roxanaghe has quit IRC11:13
openstackgerritMerged openstack-infra/project-config: add missing release jobs  https://review.openstack.org/30047411:15
*** e0ne has joined #openstack-infra11:15
openstackgerritMerged openstack-infra/system-config: Run 'reprepro ubuntu' cron once ever 2 hours  https://review.openstack.org/30062011:16
*** Jeffrey4l has quit IRC11:17
*** Jeffrey4l has joined #openstack-infra11:17
openstackgerritMerged openstack-infra/project-config: Enable DB access for Designate unittests  https://review.openstack.org/30053711:18
*** [1]Thelo has joined #openstack-infra11:19
*** HeOS has quit IRC11:21
*** Thelo has quit IRC11:22
*** [1]Thelo is now known as Thelo11:22
*** yamamoto has quit IRC11:22
*** e0ne has quit IRC11:25
*** mylu has joined #openstack-infra11:27
*** esikachev has joined #openstack-infra11:28
*** e0ne has joined #openstack-infra11:29
*** dims__ has joined #openstack-infra11:30
*** mylu has quit IRC11:32
*** salv-orlando has joined #openstack-infra11:32
*** dims_ has quit IRC11:32
openstackgerritDavanum Srinivas (dims) proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/28884911:33
*** markvoelker has joined #openstack-infra11:35
*** markvoelker_ has joined #openstack-infra11:36
*** salv-orlando has quit IRC11:37
*** markvoelker has quit IRC11:40
*** e0ne has quit IRC11:40
pabelangermorning11:40
pabelangerhttp://logs.openstack.org/26/300526/1/experimental/gate-project-config-bindep-fallback-ubuntu-xenial/973c8d9/console.html11:44
pabelangerwas a success, meaning xenial mirror was functional11:44
pabelangerhowever some warnings from APT11:44
pabelangertaking a peak now11:44
*** e0ne has joined #openstack-infra11:44
*** dims__ has quit IRC11:45
*** thorst has joined #openstack-infra11:48
*** ihrachys has joined #openstack-infra11:52
*** nadya has joined #openstack-infra11:52
*** nadya has quit IRC11:53
*** thorst has quit IRC11:55
*** nadya has joined #openstack-infra11:56
*** esikachev has quit IRC11:57
*** markvoelker has joined #openstack-infra12:00
kevinbentonIs there a gertty equivalent tool for launchpad?12:01
*** markvoelker_ has quit IRC12:04
*** esker has joined #openstack-infra12:06
*** e0ne has quit IRC12:08
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: Request for new project - python-k8sclient  https://review.openstack.org/30072912:08
*** esker has quit IRC12:11
*** e0ne has joined #openstack-infra12:11
*** e0ne has quit IRC12:14
kevinbentondims: it's the weekend12:16
kevinbentondims: stop working12:16
kevinbenton:)12:16
*** amotoki has joined #openstack-infra12:17
*** esikachev has joined #openstack-infra12:17
*** e0ne has joined #openstack-infra12:18
*** zeih has joined #openstack-infra12:20
*** akshai_ has joined #openstack-infra12:21
*** akshai has quit IRC12:21
*** EricGonczer_ has joined #openstack-infra12:22
dimskevinbenton : LOL, right back at ya :)12:23
*** pblaho has quit IRC12:23
*** yamamoto has joined #openstack-infra12:23
kevinbentondims: I'm sitting in an airport killing time. I have an excuse :)12:24
dimsah. safe travels kevinbenton12:24
*** ihrachys has quit IRC12:24
dimsam on my way to a whole bunch of weekend errands :)12:25
*** akshai_ has quit IRC12:26
*** kong has quit IRC12:26
*** akshai has joined #openstack-infra12:26
kevinbentondims: have fun!12:26
*** esker has joined #openstack-infra12:27
*** cody-somerville has quit IRC12:28
*** yamamoto has quit IRC12:29
*** esikachev has quit IRC12:29
*** nadya has quit IRC12:30
*** tiswanso has quit IRC12:31
*** e0ne has quit IRC12:31
*** esker has quit IRC12:32
*** e0ne has joined #openstack-infra12:35
*** markvoelker has quit IRC12:37
pabelangerjeblair: When you have spare cycles, could use some help reviewing the AFS mirrors.  I believe the mirror.ubuntu is working as expected, but just want to confirm.12:40
pabelangerI see:12:40
pabelanger       server afs01.dfw.openstack.org partition /vicepa RW Site  -- New release12:40
pabelanger       server afs01.dfw.openstack.org partition /vicepa RO Site  -- New release12:40
pabelanger       server afs01.ord.openstack.org partition /vicepa RO Site  -- Old release12:40
pabelangerwhich I assume is normal, since it was a large reprepro sync that just happened12:40
*** yamamoto has joined #openstack-infra12:40
*** zhurong has joined #openstack-infra12:41
*** e0ne has quit IRC12:43
*** zeih has quit IRC12:44
*** ihrachys has joined #openstack-infra12:46
*** zhurong has quit IRC12:46
*** e0ne has joined #openstack-infra12:47
*** e0ne has quit IRC12:50
*** thorst has joined #openstack-infra12:53
*** e0ne has joined #openstack-infra12:54
*** e0ne has quit IRC12:57
*** roxanaghe has joined #openstack-infra12:57
*** salv-orlando has joined #openstack-infra12:58
*** nadya has joined #openstack-infra13:01
*** thorst has quit IRC13:01
*** e0ne has joined #openstack-infra13:01
*** roxanaghe has quit IRC13:01
*** Goneri has quit IRC13:04
*** salv-orlando has quit IRC13:05
*** sdake has joined #openstack-infra13:05
*** e0ne has quit IRC13:06
*** e0ne has joined #openstack-infra13:08
*** e0ne has quit IRC13:10
*** thorst has joined #openstack-infra13:10
*** baoli has joined #openstack-infra13:13
*** baoli has quit IRC13:13
*** e0ne has joined #openstack-infra13:14
*** e0ne has quit IRC13:16
*** e0ne has joined #openstack-infra13:20
*** Hal has joined #openstack-infra13:21
*** Hal is now known as Guest5573213:21
mriedemanyone ever seen this? http://logs.openstack.org/periodic-stable/periodic-horizon-python27-kilo/3a2afa8/console.html#_2016-04-02_06_46_14_56113:23
*** e0ne has quit IRC13:31
*** LaT0rtue has quit IRC13:34
*** e0ne has joined #openstack-infra13:35
*** LaT0rtue has joined #openstack-infra13:36
*** nadya has quit IRC13:38
openstackgerritMerged openstack-infra/shade: Follow name_or_id pattern on domain operations  https://review.openstack.org/28871513:44
*** e0ne has quit IRC13:46
*** nadya has joined #openstack-infra13:48
openstackgerritMerged openstack/requirements: Updated from generate-constraints  https://review.openstack.org/28884913:49
*** e0ne has joined #openstack-infra13:49
*** zeih has joined #openstack-infra13:51
*** pradk has joined #openstack-infra13:51
*** esker has joined #openstack-infra13:52
*** zeih has quit IRC13:56
*** esker has quit IRC13:57
*** ihrachys has quit IRC13:58
*** e0ne has quit IRC13:58
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: Request for new project - python-k8sclient  https://review.openstack.org/30072914:03
*** cdent has joined #openstack-infra14:05
*** nadya has quit IRC14:08
*** LaT0rtue has quit IRC14:10
*** nadya has joined #openstack-infra14:13
*** esker has joined #openstack-infra14:15
*** LaT0rtue has joined #openstack-infra14:16
*** nadya has quit IRC14:17
*** esker has quit IRC14:19
*** thorst has quit IRC14:22
*** thorst has joined #openstack-infra14:22
*** ams_ has joined #openstack-infra14:26
jeblairpabelanger: hi there14:29
*** thorst has quit IRC14:31
jeblairpabelanger: is vos release still running or was it interrupted?14:32
*** tiswanso has joined #openstack-infra14:34
*** salv-orlando has joined #openstack-infra14:36
openstackgerritRoland Hochmuth proposed openstack-infra/project-config: Add openstack/monasca-transform project  https://review.openstack.org/30074214:38
*** zul has quit IRC14:41
*** salv-orlando has quit IRC14:44
*** cdent has quit IRC14:48
*** rfolco has joined #openstack-infra14:50
*** LaT0rtue has quit IRC14:50
*** kzaitsev_mb has joined #openstack-infra14:56
jeblairpabelanger: as best as i can tell, a vos release was run but was interrupted.  the underlying volume server transaction is still active and still running, but even when it finishes copying the data, i don't think the volume will update because the 'vos release' command isn't running anymore, and that's what's responsible for doing that.14:56
*** kgiusti has left #openstack-infra14:56
*** esker has joined #openstack-infra14:56
openstackgerritRoland Hochmuth proposed openstack-infra/project-config: Add openstack/monasca-transform project  https://review.openstack.org/30074214:56
*** cdent has joined #openstack-infra14:57
jeblairpabelanger: currently, the cron job is erroring out on vos release each time because it sees the ongoing transaction14:57
jeblairpabelanger: it's possible that once that transaction is complete, the next cron job will be able to vos release again, which may or may not start correctly.  if it does start, it would just do the same thing again and be interrupted.14:58
openstackgerritRoland Hochmuth proposed openstack-infra/project-config: Add openstack/monasca-transform project  https://review.openstack.org/30074214:58
fungiif memory serves, our other initial volume adds of any significant size needed vos release run manually without a timeout so that it would have ample time to complete?14:59
jeblairpabelanger: vos release is very slow between dfw-ord, and it's important that it not be interrupted, or that its tokens not expire while it's running15:00
jeblairfungi: right15:00
*** esker has quit IRC15:01
jeblairpabelanger: so when we're adding a lot of data like this, we need to do it manually, inside screen on a file or volume server using the '-localauth' flag instead of tokens15:01
jeblairpabelanger: my recommendation is to disable the reprepro cron job, wait for the current transaction to finish, then run vos release as i described above15:02
jeblairpabelanger: vos status afs01.dfw.openstack.org15:03
jeblairpabelanger: that shows the current volume transaction status15:03
*** cdent has quit IRC15:03
jeblairpabelanger: /var/log/openafs/VolserLog is also interesting15:03
*** nihilifer has quit IRC15:03
*** zhurong has joined #openstack-infra15:04
*** nihilifer has joined #openstack-infra15:04
*** yaume has joined #openstack-infra15:04
*** nihilifer has quit IRC15:05
*** yaume is now known as yaume[away]15:05
jeblairpabelanger: and as an extra check, i have run 'iftop -f "not port domain" -P' on afs01.dfw and see afs3-volser traffic to ord, so i'm certain it is continuing.15:05
*** yaume[away] is now known as yaume15:05
*** zul has joined #openstack-infra15:05
*** yaume is now known as yaume[away]15:06
*** yaume[away] is now known as yaume15:06
jeblairpabelanger: my favorite way to disable the cron job is to run screen on mirror-update and then run "flock -n /var/run/reprepro/ubuntu.lock bash" to squat on the lockfile15:06
*** yaume is now known as yaume[away]15:06
*** zhurong has quit IRC15:10
*** esker has joined #openstack-infra15:17
*** yaume[away] is now known as yaume15:19
*** yaume is now known as yaume[away]15:19
*** yaume[away] is now known as yaume15:19
*** yaume is now known as yaume[away]15:20
*** LaT0rtue has joined #openstack-infra15:20
*** hieulq has joined #openstack-infra15:23
*** nihilifer has joined #openstack-infra15:23
*** nihilifer has quit IRC15:23
*** esker has quit IRC15:23
*** tiswanso has quit IRC15:24
*** rfolco has quit IRC15:24
*** nihilifer has joined #openstack-infra15:25
*** Jeffrey4l_ has joined #openstack-infra15:26
*** Jeffrey4l has quit IRC15:27
*** thorst has joined #openstack-infra15:28
openstackgerritRoland Hochmuth proposed openstack-infra/project-config: Add openstack/monasca-transform project  https://review.openstack.org/30074215:35
*** thorst has quit IRC15:36
*** zz_dimtruck is now known as dimtruck15:36
*** hieulq has quit IRC15:36
*** flepied has quit IRC15:37
openstackgerritMerged openstack/diskimage-builder: Add image size report  https://review.openstack.org/28962915:45
*** yamamoto has quit IRC15:47
*** armax_ has joined #openstack-infra15:51
*** yaume[away] is now known as yaume15:51
*** rfolco has joined #openstack-infra15:52
*** ihrachys has joined #openstack-infra15:52
*** armax has quit IRC15:53
*** armax_ is now known as armax15:53
*** flepied has joined #openstack-infra15:55
jeblairpabelanger: i've gone ahead and taken the reprepro lock on mirror-update.  but i'm about to head out for the day, so i won't do anything else.15:56
*** EricGonczer_ has quit IRC15:58
*** EricGonczer_ has joined #openstack-infra15:59
*** daemontool has joined #openstack-infra15:59
openstackgerritMerged openstack/requirements: Precisions on the licensing requirements  https://review.openstack.org/29722316:00
openstackgerritMerged openstack/requirements: Bump oslo.context >= 2.2.0 to store roles  https://review.openstack.org/30036116:00
*** salv-orlando has joined #openstack-infra16:02
*** yaume has quit IRC16:10
*** yaume has joined #openstack-infra16:11
*** yaume is now known as yaume[away]16:11
*** kzaitsev_mb has quit IRC16:13
*** salv-orlando has quit IRC16:14
*** yaume[away] is now known as yaume16:16
*** yaume is now known as yaume[away]16:16
*** baoli has joined #openstack-infra16:16
*** yaume[away] is now known as yaume16:17
*** yaume is now known as yaume[away]16:17
*** baoli has quit IRC16:18
*** salv-orlando has joined #openstack-infra16:19
*** kzaitsev_mb has joined #openstack-infra16:21
*** esker has joined #openstack-infra16:21
*** Jeffrey4l_ is now known as Jeffrey4l16:26
*** esker has quit IRC16:28
openstackgerritMerged openstack/diskimage-builder: Set tgtd not auto-start on OS boot time.  https://review.openstack.org/29754816:28
openstackgerritKhai Do proposed openstack-infra/system-config: Replace the Gerrit icon for Workflow -1 vote.  https://review.openstack.org/16522816:29
*** Jeffrey4l_ has joined #openstack-infra16:32
*** kzaitsev_mb has quit IRC16:33
*** thorst has joined #openstack-infra16:33
*** Jeffrey4l has quit IRC16:36
*** e0ne has joined #openstack-infra16:37
*** ihrachys has quit IRC16:39
openstackgerritJeffrey Zhang proposed openstack-infra/project-config: add Ubuntu binary build and deploy gate for kolla  https://review.openstack.org/29294216:40
*** thorst has quit IRC16:41
*** HeOS has joined #openstack-infra16:41
*** e0ne has quit IRC16:43
*** yamamoto has joined #openstack-infra16:48
*** e0ne has joined #openstack-infra16:48
*** armax has quit IRC16:51
*** salv-orlando has quit IRC16:53
*** yamamoto has quit IRC16:53
*** armax has joined #openstack-infra16:54
*** esker has joined #openstack-infra16:54
pabelangerjeblair: okay, thanks for the info. Yes vos release was interrupted, and it was locked, so I removed said lock.16:56
pabelangerjeblair: I will use the commands you listed and watch it, but yes, a lot of initial data from the xenial mirror16:56
*** e0ne has quit IRC16:57
openstackgerritMatt Riedemann proposed openstack/requirements: Bump upper-constraint for python-novaclient to 3.4.0  https://review.openstack.org/29897916:59
*** kzaitsev_mb has joined #openstack-infra17:00
*** ihrachys has joined #openstack-infra17:07
*** maishsk has joined #openstack-infra17:08
*** armax has quit IRC17:09
*** Thelo has quit IRC17:10
*** ihrachys has quit IRC17:10
*** armax has joined #openstack-infra17:11
*** Thelo has joined #openstack-infra17:11
*** yaume[away] is now known as yaume17:13
*** maishsk has quit IRC17:18
*** kzaitsev_mb has quit IRC17:25
*** shashank_hegde has joined #openstack-infra17:28
*** yaume_ has joined #openstack-infra17:31
*** Qiming has quit IRC17:32
*** EricGonczer_ has quit IRC17:32
*** maishsk has joined #openstack-infra17:33
*** ams_ has quit IRC17:33
*** HeOS has quit IRC17:33
*** yaume has quit IRC17:34
openstackgerritRoland Hochmuth proposed openstack-infra/project-config: Add openstack/monasca-transform project  https://review.openstack.org/30074217:35
sdakeAJaeger was my repsonse more clear after the followup?17:36
sdakeif not, I need to do a better job of explaining itin the review and i'll do that :)17:36
*** HeOS has joined #openstack-infra17:37
*** thorst has joined #openstack-infra17:39
AJaegersdake: I need some more time to review this. I think I have now all the hints. thanks17:39
sdakeok jus tdorp a line in the review if you need more context17:39
sdakethe only thing agian, we put in stable that ins't in master is a change to the version pins for rdo and from source17:39
sdakeand possibly the rdo repo locations and ubuntu binary locations17:40
sdakesince they change between releaes17:40
AJaegerunderstood.17:41
AJaegerStill, the change is broken as is - it duplicates a job that already exists in projects.yaml. We'll need a few more iterations on this.17:41
AJaegersdake: note that I won't -1 in general a change that only restricts to a specific branch. But I'd like to understand why ;)17:42
*** lawn_bauwer has quit IRC17:42
sdakeAJaeger good to hear17:42
*** achanda has joined #openstack-infra17:44
*** thorst has quit IRC17:46
*** bauzas has joined #openstack-infra17:46
AJaegersdake: noticed something: You have both source nad binary jobs. The source jobs can run on master, the binary jobs need a release. Correct?17:47
*** maishsk_ has joined #openstack-infra17:47
sdakeAJaeger right the binary job needs a release which wepull from rdoproject.org17:48
*** maishsk has quit IRC17:48
sdakethat needs to be mirrored in the infrastructure17:48
*** maishsk_ is now known as maishsk17:48
sdakewhich is a separate discussion I need to hvae with fungi17:48
AJaegersdake: Ok, that explains the setup. So, let's document it properly.17:49
sdakenote ubuntu has no such delorean repository17:49
sdakeit only hsa a mitaka release17:49
AJaegeryep17:49
sdakewhich is why we exclude it from msater gating17:49
*** yamamoto has joined #openstack-infra17:50
*** mylu has joined #openstack-infra17:50
fungisdake: i believe rdo mirroring is already part of ianw and pabelanger's plans for rpm/epel mirroring17:51
AJaegersdake: understood now. Make it run on ubuntu-trusty instead of devstack-trusty node (we removed all devstack-trusty ones) and document it - and I'll +2 next time I'll go through it.17:51
fungithough they will hopefully correct me if i am wrong17:51
*** tphummel has quit IRC17:53
AJaegerfungi, looking at lifeless comments on the nova other-requirements change, I fear that he has a more involved concept in mind - one that might be more complex.17:53
AJaegerfungi, so that would imply going back to the drawing board...17:53
*** Jeffrey4l_ has quit IRC17:54
AJaegerfungi, we might need a writeup on etherpad, a spec, or a patch to update http://docs.openstack.org/infra/manual/drivers.html#package-requirements ...17:54
*** yamamoto has quit IRC17:55
AJaegerfungi, I'll sign of in 10 mins - so I just wanted to comment this, we can discuss further next week...17:55
fungiAJaeger: i think there's a middle ground there for now, which is that we make the job install any packages which belong to the default profile for the platform, and also any packages for that platform which belong to the "test" profile17:55
AJaegerfungi, yes, that should work.17:56
fungiAJaeger: then projects can make a best effort of tagging test-only dependencies with the "test" platform tag17:56
*** HeOS has quit IRC17:56
AJaegerSo, that could be covered with a change of the Infra Manual to explain what infra expects.17:56
fungisimilar to how we currently install requirements.txt and test-requirements.txt in the test venv, but if a project accidentally put a test requirement in requirements.txt or vice versa our ci is not going to catch that17:56
fungis/but//17:57
AJaegeryep17:57
fungithis is more of a bookkeeping improvement for projects which are concerned that people might think something in the other-requirements.txt file is a runtime dependency17:57
fungithe missing bit is that i (or someone) need to test the behavior of bindep in that situation17:58
*** shashank_hegde has quit IRC17:58
AJaegeragreed17:59
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Increase heat rpc_response_timeout in the overcloud  https://review.openstack.org/29894117:59
*** fedexo has joined #openstack-infra18:05
*** esikachev has joined #openstack-infra18:08
*** esikachev has quit IRC18:12
*** amrith is now known as _amrith_18:16
*** shashank_hegde has joined #openstack-infra18:19
*** salv-orlando has joined #openstack-infra18:20
*** salv-orlando has quit IRC18:24
*** nibalize1 is now known as nibalizer18:24
*** achanda has quit IRC18:25
*** shashank_hegde has quit IRC18:27
*** sdake_ has joined #openstack-infra18:28
*** shashank_hegde has joined #openstack-infra18:28
*** akshai has quit IRC18:30
*** achanda has joined #openstack-infra18:30
*** sdake has quit IRC18:31
pabelangerfungi: Indeed, next on my list to do18:33
*** achanda has quit IRC18:34
*** kushal has quit IRC18:35
*** maishsk has quit IRC18:36
*** tphummel has joined #openstack-infra18:36
*** ihrachys has joined #openstack-infra18:37
*** xarses has quit IRC18:38
*** maishsk has joined #openstack-infra18:39
*** yamamoto has joined #openstack-infra18:40
*** shashank_hegde has quit IRC18:40
*** ihrachys has quit IRC18:43
*** yamamoto has quit IRC18:44
*** yamamoto has joined #openstack-infra18:44
*** thorst has joined #openstack-infra18:46
*** kushal has joined #openstack-infra18:48
*** yamahata has quit IRC18:50
*** StaffUnicorn is now known as nhandler18:50
*** thorst has quit IRC18:51
*** yamamoto has quit IRC18:52
*** ayoung has joined #openstack-infra18:53
*** e0ne has joined #openstack-infra18:55
*** mylu has quit IRC18:57
*** e0ne has quit IRC18:57
*** daemontool has quit IRC18:57
*** shashank_hegde has joined #openstack-infra18:58
openstackgerritDoug Hellmann proposed openstack-infra/release-tools: script to create branches for a bunch of repos at once  https://review.openstack.org/30082018:58
*** mylu has joined #openstack-infra18:59
*** ihrachys has joined #openstack-infra19:13
*** xarses has joined #openstack-infra19:18
*** xarses has quit IRC19:19
*** xarses has joined #openstack-infra19:19
*** _amrith_ is now known as amrith19:19
*** MarkAtwood has joined #openstack-infra19:20
*** rfolco has quit IRC19:23
*** tphummel has quit IRC19:25
*** salv-orlando has joined #openstack-infra19:26
*** tphummel has joined #openstack-infra19:29
*** sdake has joined #openstack-infra19:34
*** e0ne has joined #openstack-infra19:34
*** sdake_ has quit IRC19:37
*** e0ne has quit IRC19:39
*** salv-orlando has quit IRC19:42
*** e0ne has joined #openstack-infra19:43
*** hashar has joined #openstack-infra19:44
*** e0ne has quit IRC19:46
*** e0ne has joined #openstack-infra19:47
*** shashank_hegde has quit IRC19:47
*** thorst has joined #openstack-infra19:49
*** shashank_hegde has joined #openstack-infra19:49
*** baoli has joined #openstack-infra19:51
*** e0ne has quit IRC19:51
*** yamamoto has joined #openstack-infra19:52
*** daemontool has joined #openstack-infra19:53
*** e0ne has joined #openstack-infra19:55
*** thorst has quit IRC19:56
*** ihrachys has quit IRC19:57
*** yamamoto has quit IRC19:58
*** rcernin has joined #openstack-infra19:58
*** angdraug has joined #openstack-infra19:59
*** e0ne has quit IRC20:01
*** e0ne has joined #openstack-infra20:05
*** e0ne has quit IRC20:08
*** shashank_hegde has quit IRC20:10
*** e0ne has joined #openstack-infra20:12
*** e0ne has quit IRC20:16
*** achanda has joined #openstack-infra20:18
*** dimtruck is now known as zz_dimtruck20:21
*** sdake_ has joined #openstack-infra20:26
*** sdake has quit IRC20:29
*** yaume_ has quit IRC20:33
*** yaume has joined #openstack-infra20:33
*** yaume has quit IRC20:33
*** baoli has quit IRC20:35
*** baoli has joined #openstack-infra20:35
*** EricGonczer_ has joined #openstack-infra20:37
*** baoli has quit IRC20:39
*** hashar has quit IRC20:40
*** esikachev has joined #openstack-infra20:42
*** armax has quit IRC20:43
*** amrith is now known as _amrith_20:43
*** armax has joined #openstack-infra20:44
*** sdake has joined #openstack-infra20:45
*** zz_dimtruck is now known as dimtruck20:46
*** HeOS has joined #openstack-infra20:46
*** salv-orlando has joined #openstack-infra20:47
*** baoli has joined #openstack-infra20:47
*** sdake_ has quit IRC20:47
*** EricGonczer_ has quit IRC20:48
*** EricGonczer_ has joined #openstack-infra20:49
*** EricGonczer_ has quit IRC20:49
*** thorst has joined #openstack-infra20:54
*** salv-orlando has quit IRC20:54
*** yamamoto has joined #openstack-infra20:55
*** asselin has joined #openstack-infra21:00
*** angdraug has quit IRC21:00
*** yamamoto has quit IRC21:00
*** maishsk has quit IRC21:00
*** thorst has quit IRC21:00
*** asselin__ has quit IRC21:01
*** Guest20841 has joined #openstack-infra21:03
*** nelsnelson has quit IRC21:04
*** sdake has quit IRC21:04
*** Guest20841 has quit IRC21:05
*** armax_ has joined #openstack-infra21:07
*** armax has quit IRC21:08
*** armax_ is now known as armax21:08
*** sdake has joined #openstack-infra21:09
*** dimtruck is now known as zz_dimtruck21:11
*** sdake has quit IRC21:13
*** rfolco has joined #openstack-infra21:13
*** maishsk has joined #openstack-infra21:14
*** sdake has joined #openstack-infra21:14
*** [1]Thelo has joined #openstack-infra21:20
*** Thelo has quit IRC21:22
*** [1]Thelo is now known as Thelo21:22
*** rfolco has quit IRC21:25
*** sgordon has quit IRC21:26
*** daemontool has quit IRC21:32
*** shashank_hegde has joined #openstack-infra21:34
*** esikachev has quit IRC21:36
*** cody-somerville has joined #openstack-infra21:37
*** mylu has quit IRC21:41
*** EricGonczer_ has joined #openstack-infra21:43
*** daemontool has joined #openstack-infra21:47
*** baoli has quit IRC21:50
*** daemontool has quit IRC21:52
*** shashank_hegde has quit IRC21:52
*** shashank_hegde has joined #openstack-infra21:53
*** EricGonczer_ has quit IRC21:54
*** yamamoto has joined #openstack-infra21:56
*** thorst has joined #openstack-infra21:58
*** maishsk has quit IRC21:58
*** achanda has quit IRC22:01
*** yamamoto has quit IRC22:01
pabelangerjeblair: is there a reason for the slowness between ord and dfw, surprised it wouldn't be faster22:02
*** shashank_hegde has quit IRC22:02
*** shashank_hegde has joined #openstack-infra22:03
*** thorst has quit IRC22:05
*** mylu has joined #openstack-infra22:08
*** toabctl has quit IRC22:09
*** toabctl has joined #openstack-infra22:10
*** salv-orlando has joined #openstack-infra22:12
*** EricGonczer_ has joined #openstack-infra22:14
*** salv-orlando has quit IRC22:15
*** mylu has quit IRC22:22
*** eharney has quit IRC22:23
*** MarkAtwood has quit IRC22:24
*** MarkAtwood has joined #openstack-infra22:30
*** eharney has joined #openstack-infra22:30
*** shashank_hegde has quit IRC22:33
*** MarkAtwood has quit IRC22:36
*** MarkAtwood has joined #openstack-infra22:45
*** rfolco has joined #openstack-infra22:46
*** achanda has joined #openstack-infra22:49
*** shashank_hegde has joined #openstack-infra22:56
*** |-paul-| has joined #openstack-infra22:56
*** yamamoto has joined #openstack-infra22:58
*** shashank_hegde has quit IRC22:59
*** thorst has joined #openstack-infra23:03
*** yamamoto has quit IRC23:03
*** thorst has quit IRC23:10
*** doug-fish has quit IRC23:15
*** rfolco has quit IRC23:24
*** salv-orlando has joined #openstack-infra23:43
*** fedexo has quit IRC23:44
*** salv-orlando has quit IRC23:46
*** MarkAtwood has quit IRC23:51
pabelangerjeblair: okay, after reading more, I've re issued vos release using --localauth like you recommended this morning.  I would be curious to know if you can see the xfer info from openafs tooling about the cloning process23:52
*** MarkAtwood has joined #openstack-infra23:57
*** thorst has joined #openstack-infra23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!