| *** Apoorva_ has joined #openstack-infra | 00:01 | |
| *** rkukura has quit IRC | 00:01 | |
| *** rfolco_ has joined #openstack-infra | 00:02 | |
| *** Apoorva has quit IRC | 00:03 | |
| *** rfolco has quit IRC | 00:04 | |
| *** Apoorva_ has quit IRC | 00:04 | |
| *** aeng has quit IRC | 00:04 | |
| *** Apoorva has joined #openstack-infra | 00:04 | |
| *** tphummel has quit IRC | 00:04 | |
| *** esikachev has quit IRC | 00:04 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-accessbot master: Add bindep.txt file https://review.openstack.org/461536 | 00:05 |
|---|---|---|
| *** mat128 has joined #openstack-infra | 00:05 | |
| *** dingyichen has joined #openstack-infra | 00:05 | |
| *** Apoorva_ has joined #openstack-infra | 00:06 | |
| *** Apoorva has quit IRC | 00:06 | |
| *** mat128 has quit IRC | 00:06 | |
| mtreinish | fungi: it looks like it's sitting just short of ~4k msg/sec right now | 00:07 |
| mtreinish | although I have no idea if that's good or not :) | 00:07 |
| *** rlandy is now known as rlandy|bbl | 00:12 | |
| fungi | mtreinish: well, i'm back inside for the night and can ramp up the publisher with a second loop now | 00:15 |
| *** Apoorva_ has quit IRC | 00:15 | |
| fungi | no idea what effect that'll have | 00:15 |
| fungi | second publisher loop underway now | 00:15 |
| fungi | getting a number of "Error: The connection was lost." | 00:16 |
| *** ijw has quit IRC | 00:16 | |
| fungi | i'm guessing that's the broker refusing messages | 00:16 |
| *** erikmwilson has quit IRC | 00:16 | |
| *** erikmwilson has joined #openstack-infra | 00:17 | |
| *** esikachev has joined #openstack-infra | 00:17 | |
| mtreinish | fungi: yeah that's probably likely | 00:18 |
| mtreinish | we should check the server's logs to see if there is a corresponding error on that end | 00:18 |
| *** ijw has joined #openstack-infra | 00:18 | |
| fungi | cacti graphs are definitely seeing the load increase http://cacti.openstack.org/cacti/graph_view.php?action=tree&tree_id=1&leaf_id=301 | 00:18 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-ansible master: Add bindep.txt file https://review.openstack.org/461539 | 00:19 |
| fungi | intersestingly, load average is still low | 00:19 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-apparmor master: Add bindep.txt file https://review.openstack.org/461540 | 00:19 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-apps_site master: Add bindep.txt file https://review.openstack.org/461541 | 00:19 |
| *** rfolco_ has quit IRC | 00:19 | |
| fungi | looks like we could benefit from more ram though given the buffers/cache are starting to top out on the current 2gb | 00:19 |
| *** deafult has joined #openstack-infra | 00:19 | |
| pabelanger | apologies for the incoming spam | 00:20 |
| fungi | (if we need to scale the server up in the future) | 00:20 |
| pabelanger | trying to update our puppet modules with bindep.txt files | 00:20 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-askbot master: Add bindep.txt file https://review.openstack.org/461542 | 00:20 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-asterisk master: Add bindep.txt file https://review.openstack.org/461543 | 00:20 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-bandersnatch master: Add bindep.txt file https://review.openstack.org/461544 | 00:20 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-bugdaystats master: Add bindep.txt file https://review.openstack.org/461545 | 00:21 |
| *** aeng has joined #openstack-infra | 00:21 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-bup master: Add bindep.txt file https://review.openstack.org/461546 | 00:21 |
| fungi | mtreinish: mosquitto.log on the server is pretty huge | 00:21 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-cgit master: Add bindep.txt file https://review.openstack.org/461547 | 00:21 |
| fungi | every one of these publishes shows up as a line in the log | 00:21 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-ciwatch master: Add bindep.txt file https://review.openstack.org/461548 | 00:21 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-infra-cookiecutter master: Add bindep.txt file https://review.openstack.org/461549 | 00:21 |
| *** esikachev has quit IRC | 00:22 | |
| *** sflanigan has joined #openstack-infra | 00:22 | |
| *** sflanigan has joined #openstack-infra | 00:22 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-diskimage_builder master: Add bindep.txt file https://review.openstack.org/461552 | 00:23 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-drupal master: Add bindep.txt file https://review.openstack.org/461554 | 00:23 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-elastic_recheck master: Add bindep.txt file https://review.openstack.org/461555 | 00:23 |
| mtreinish | fungi: hmm yeah I think we had to turn the connection logging on at one point in the past to debug an issue | 00:24 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-elasticsearch master: Add bindep.txt file https://review.openstack.org/461556 | 00:24 |
| fungi | mtreinish: here's an example error from the log: http://paste.openstack.org/show/608554/ | 00:24 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-ethercalc master: Add bindep.txt file https://review.openstack.org/461557 | 00:24 |
| fungi | oh, wait, that's a connection from our puppetmaster? | 00:24 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-etherpad_lite master: Add bindep.txt file https://review.openstack.org/461558 | 00:24 |
| fungi | that's weird | 00:24 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-exim master: Add bindep.txt file https://review.openstack.org/461559 | 00:24 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-featuretracker master: Add bindep.txt file https://review.openstack.org/461560 | 00:24 |
| mtreinish | fungi: yeah: https://git.openstack.org/cgit/openstack-infra/puppet-mosquitto/commit/templates/mosquitto.conf.erb?id=695d94cc3c85b277a95d0d4d36c02ce004689fb9 | 00:25 |
| mtreinish | fungi: heh, so we're dropping the ansible messages now :) | 00:25 |
| fungi | i suppose so | 00:25 |
| mtreinish | fungi: the way I've been writing all of the publishers is to not keep an open connection between publishes | 00:25 |
| fungi | well, this is at denial of service levels of events already | 00:26 |
| fungi | maybe if we cranked down the logging it would behave better | 00:26 |
| mtreinish | it disconnects after the transfer finishes | 00:26 |
| mtreinish | fungi: yeah we can do that, I'll write up a patch for that now | 00:26 |
| *** ijw has quit IRC | 00:26 | |
| fungi | cool, on hand to review | 00:27 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-germqtt master: Add bindep.txt file https://review.openstack.org/461561 | 00:27 |
| fungi | can definitely see the traffic levels double when i started up the second publisher loop | 00:27 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-gerrit master: Add bindep.txt file https://review.openstack.org/461562 | 00:27 |
| *** mdrabe has quit IRC | 00:27 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-gerritbot master: Add bindep.txt file https://review.openstack.org/461563 | 00:28 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-github master: Add bindep.txt file https://review.openstack.org/461564 | 00:28 |
| fungi | it's receiving 36kepm and sending 402kepm now | 00:28 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-grafyaml master: Add bindep.txt file https://review.openstack.org/461565 | 00:28 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/puppet-mosquitto master: Decrease logging verbosity https://review.openstack.org/461566 | 00:28 |
| mtreinish | fungi: ^^^ | 00:28 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-graphite master: Add bindep.txt file https://review.openstack.org/461567 | 00:28 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-haveged master: Add bindep.txt file https://review.openstack.org/461568 | 00:29 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-hound master: Add bindep.txt file https://review.openstack.org/461569 | 00:29 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-httpd master: Add bindep.txt file https://review.openstack.org/461570 | 00:29 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-infracloud master: Add bindep.txt file https://review.openstack.org/461571 | 00:29 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-ipsilon master: Add bindep.txt file https://review.openstack.org/461572 | 00:29 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-iptables master: Add bindep.txt file https://review.openstack.org/461573 | 00:30 |
| *** armax has quit IRC | 00:30 | |
| pabelanger | going to pause here for now | 00:30 |
| mtreinish | fungi: that's a fair number of messages :) | 00:30 |
| *** wolverineav has joined #openstack-infra | 00:32 | |
| mtreinish | fungi: it's too bad the dropped messages thing I added to mqtt_statsd doesn't look like it's working, because I'd be curious how many messages we're dropping at this load | 00:32 |
| *** tphummel has joined #openstack-infra | 00:33 | |
| mtreinish | it looks like those topics don't work on our mosquitto (I'm subscribed to them but they don't get any messages) | 00:34 |
| mtreinish | oh it might just mean we've never hit that limit before. According to the man page the dropped messages reported there are because of inflight/queuing limits set in the config | 00:35 |
| *** aeng has quit IRC | 00:36 | |
| *** xingchao has joined #openstack-infra | 00:37 | |
| fungi | makes (some) sense | 00:38 |
| fungi | once the logging change is active i'll crank up the client and server count a little more | 00:39 |
| *** tiswanso has joined #openstack-infra | 00:39 | |
| *** xingchao has quit IRC | 00:40 | |
| *** mdrabe has joined #openstack-infra | 00:40 | |
| *** xingchao has joined #openstack-infra | 00:41 | |
| *** tiswanso has quit IRC | 00:41 | |
| *** tiswanso has joined #openstack-infra | 00:41 | |
| *** salv-orlando has joined #openstack-infra | 00:42 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-accessbot master: Add bindep.txt file https://review.openstack.org/461536 | 00:42 |
| *** xinliang has joined #openstack-infra | 00:42 | |
| *** xinliang has joined #openstack-infra | 00:42 | |
| *** Apoorva has joined #openstack-infra | 00:44 | |
| openstackgerrit | Merged openstack-infra/puppet-mosquitto master: Decrease logging verbosity https://review.openstack.org/461566 | 00:45 |
| *** xingchao has quit IRC | 00:45 | |
| *** wolverineav has quit IRC | 00:46 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-accessbot master: Add bindep.txt file https://review.openstack.org/461536 | 00:46 |
| *** salv-orlando has quit IRC | 00:46 | |
| *** ym200 has joined #openstack-infra | 00:46 | |
| *** ym200 has quit IRC | 00:46 | |
| *** tjones has joined #openstack-infra | 00:46 | |
| *** aeng has joined #openstack-infra | 00:47 | |
| *** mdrabe has quit IRC | 00:48 | |
| *** ym200 has joined #openstack-infra | 00:48 | |
| *** wolverineav has joined #openstack-infra | 00:49 | |
| *** zz_dimtruck is now known as dimtruck | 00:51 | |
| *** hongbin has quit IRC | 00:52 | |
| * mtreinish disapears for a while to find food | 00:52 | |
| fungi | yeah, making a quick snack myself | 00:53 |
| *** wolverineav has quit IRC | 00:53 | |
| *** zhurong has joined #openstack-infra | 00:56 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-accessbot master: Add bindep.txt file https://review.openstack.org/461577 | 00:57 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Remove system-config instructions https://review.openstack.org/461578 | 00:58 |
| *** funzo has joined #openstack-infra | 01:00 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-accessbot master: Add bindep.txt file https://review.openstack.org/461579 | 01:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-ansible master: Add bindep.txt file https://review.openstack.org/461580 | 01:01 |
| *** esikachev has joined #openstack-infra | 01:02 | |
| *** aspiers has quit IRC | 01:02 | |
| *** Julien-zte has joined #openstack-infra | 01:03 | |
| *** liusheng has quit IRC | 01:04 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-apparmor master: Add bindep.txt file https://review.openstack.org/461540 | 01:04 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-apps_site master: Add bindep.txt file https://review.openstack.org/461541 | 01:04 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-askbot master: Add bindep.txt file https://review.openstack.org/461542 | 01:05 |
| *** funzo has quit IRC | 01:05 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-asterisk master: Add bindep.txt file https://review.openstack.org/461543 | 01:05 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-bandersnatch master: Add bindep.txt file https://review.openstack.org/461544 | 01:05 |
| inc0 | good evening everyone | 01:05 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-bugdaystats master: Add bindep.txt file https://review.openstack.org/461545 | 01:06 |
| inc0 | do you have any resources about 3rd party CI setup? | 01:06 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-bup master: Add bindep.txt file https://review.openstack.org/461546 | 01:06 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-cgit master: Add bindep.txt file https://review.openstack.org/461547 | 01:06 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-ciwatch master: Add bindep.txt file https://review.openstack.org/461548 | 01:06 |
| *** esikachev has quit IRC | 01:06 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-infra-cookiecutter master: Add bindep.txt file https://review.openstack.org/461549 | 01:06 |
| *** ym200 has quit IRC | 01:06 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-diskimage_builder master: Add bindep.txt file https://review.openstack.org/461552 | 01:06 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-drupal master: Add bindep.txt file https://review.openstack.org/461554 | 01:07 |
| inc0 | fungi: pabelanger ^ | 01:07 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-elastic_recheck master: Add bindep.txt file https://review.openstack.org/461555 | 01:07 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-elasticsearch master: Add bindep.txt file https://review.openstack.org/461556 | 01:07 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-ethercalc master: Add bindep.txt file https://review.openstack.org/461557 | 01:07 |
| pabelanger | inc0: https://docs.openstack.org/infra/system-config/third_party.html | 01:07 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-etherpad_lite master: Add bindep.txt file https://review.openstack.org/461558 | 01:07 |
| inc0 | thank you good sir! | 01:08 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-exim master: Add bindep.txt file https://review.openstack.org/461559 | 01:08 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-featuretracker master: Add bindep.txt file https://review.openstack.org/461560 | 01:08 |
| xinliang | pabelanger: thank you:) | 01:08 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-germqtt master: Add bindep.txt file https://review.openstack.org/461561 | 01:08 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-gerrit master: Add bindep.txt file https://review.openstack.org/461562 | 01:08 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-gerritbot master: Add bindep.txt file https://review.openstack.org/461563 | 01:08 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-github master: Add bindep.txt file https://review.openstack.org/461564 | 01:08 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck master: Add query for live migration bug 1687511 https://review.openstack.org/461581 | 01:09 |
| openstack | bug 1687511 in OpenStack Compute (nova) "live migration job blowing up with "InvalidSharedStorage: ubuntu-xenial-2-node-osic-cloud1-s3500-8668392-565309 is not on shared storage: Live migration can not be used without shared storage except a booted from volume VM which does not have a local disk."" [Undecided,Confirmed] https://launchpad.net/bugs/1687511 | 01:09 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-grafyaml master: Add bindep.txt file https://review.openstack.org/461565 | 01:09 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-graphite master: Add bindep.txt file https://review.openstack.org/461567 | 01:09 |
| xinliang | inc0, pabelanger: I will look into the docs. Thanks you guys. | 01:09 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-haveged master: Add bindep.txt file https://review.openstack.org/461568 | 01:09 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-hound master: Add bindep.txt file https://review.openstack.org/461569 | 01:09 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-httpd master: Add bindep.txt file https://review.openstack.org/461570 | 01:09 |
| fungi | pabelanger: inc0: xinliang: https://docs.openstack.org/infra/openstackci/third_party_ci.html is possibly more relevant, depending on the use case | 01:09 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-infracloud master: Add bindep.txt file https://review.openstack.org/461571 | 01:09 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-ipsilon master: Add bindep.txt file https://review.openstack.org/461572 | 01:10 |
| xinliang | fungi: thanks:) | 01:10 |
| pabelanger | ah, I always confuse them | 01:10 |
| inc0 | thanks fungi, use case is that xinliang and his collegues are gracious enough to donate few nodes for aarch64 testing for Kolla | 01:10 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-iptables master: Add bindep.txt file https://review.openstack.org/461573 | 01:10 |
| fungi | oh, awesome | 01:10 |
| inc0 | I'd really appreciate if you could help him | 01:10 |
| *** knangia has quit IRC | 01:11 | |
| pabelanger | okay, that is enough spam for tonight | 01:12 |
| pabelanger | I'll finish up the other 1/2 another night of the week | 01:12 |
| *** mriedem has quit IRC | 01:12 | |
| mtreinish | pabelanger: it's never enough spam. Heh, and you're helping with our firehose load testing :) | 01:13 |
| *** zhurong has quit IRC | 01:13 | |
| fungi | mtreinish: speaking of which, your config changes are there on the server now. does the daemon need a restart to pick them up? | 01:13 |
| *** Sukhdev_ has quit IRC | 01:14 | |
| fungi | seems like it probably does | 01:14 |
| mtreinish | fungi: it probably does | 01:14 |
| fungi | shall i go ahead and do that now? i assume the subscribers will all get disconnected and need restarting? | 01:14 |
| *** liusheng has joined #openstack-infra | 01:15 | |
| mtreinish | fungi: sure go ahead, Actually I think it'll be fine | 01:15 |
| fungi | i'll take the opportunity to truncate the old log too. it's pretty huge | 01:15 |
| fungi | 3.3gb | 01:15 |
| mtreinish | the clients tend to handle broker failures pretty well | 01:15 |
| mtreinish | hah, nice | 01:15 |
| *** esikachev has joined #openstack-infra | 01:16 | |
| fungi | it's still logging 1493687791: New connection from 104.130.140.99 on port 8883. | 01:16 |
| fungi | i guess the connection logging isn't afected | 01:17 |
| mtreinish | hmm, I thought connection_messages was the setting for that | 01:17 |
| * mtreinish digs it up in the mosquitto code | 01:17 | |
| mtreinish | the mosquitto logging has always been weird/terrible | 01:18 |
| fungi | logged about 20k lines of that so far since restarting | 01:18 |
| openstackgerrit | Merged openstack-infra/elastic-recheck master: Add query for live migration bug 1687511 https://review.openstack.org/461581 | 01:18 |
| openstack | bug 1687511 in OpenStack Compute (nova) "live migration job blowing up with "InvalidSharedStorage: ubuntu-xenial-2-node-osic-cloud1-s3500-8668392-565309 is not on shared storage: Live migration can not be used without shared storage except a booted from volume VM which does not have a local disk."" [Undecided,Confirmed] https://launchpad.net/bugs/1687511 | 01:18 |
| *** EricGonczer_ has joined #openstack-infra | 01:18 | |
| mtreinish | fungi: it's the notice log level... (I don't understand how that makes sense) | 01:20 |
| mtreinish | fungi: https://github.com/eclipse/mosquitto/blob/5487395fb67ad2e2b6dac1ff67bd0ac289383f09/src/net.c#L193 | 01:20 |
| fungi | it's certainly "noticing" a lot | 01:20 |
| mtreinish | fungi: I'll push up a patch dropping notice from the log, one sec | 01:21 |
| fungi | k | 01:21 |
| *** esikachev has quit IRC | 01:21 | |
| fungi | since it needs a restart to take effect anyway, if i change it locally and restart now it won't get reverted | 01:21 |
| pabelanger | ianw: maybe you can finish up reviews on https://review.openstack.org/#/q/status:open+topic:unpuppet-zuul-workers | 01:22 |
| fungi | should we comment out info level too? | 01:22 |
| fungi | mtreinish: ^ | 01:22 |
| pabelanger | ianw: should be safe now | 01:22 |
| ianw | pabelanger: sure, will take a look | 01:23 |
| pabelanger | ianw: great, thanks | 01:23 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/puppet-mosquitto master: Disable notice log level messages https://review.openstack.org/461583 | 01:23 |
| *** mat128 has joined #openstack-infra | 01:23 | |
| pabelanger | I'm off for the night now | 01:23 |
| mtreinish | fungi: ^^^ | 01:23 |
| *** yolkfull_ has joined #openstack-infra | 01:23 | |
| mtreinish | oh, sure one sec I'll drop info too | 01:23 |
| mtreinish | fungi: fwiw: https://github.com/eclipse/mosquitto/search?utf8=%E2%9C%93&q=MOSQ_LOG_INFO&type= | 01:23 |
| fungi | restarted with both commented out now | 01:23 |
| *** srobert has joined #openstack-infra | 01:24 | |
| mtreinish | I think leaving info is probably fine | 01:24 |
| mtreinish | it's just like config loading | 01:24 |
| *** srobert has quit IRC | 01:24 | |
| fungi | i'm cool with it either way then | 01:24 |
| *** srobert has joined #openstack-infra | 01:25 | |
| fungi | though this one is unfortunate... | 01:25 |
| fungi | _mosquitto_log_printf(NULL, MOSQ_LOG_INFO, "Error saving in-memory database, out of memory."); | 01:25 |
| *** yolkfull has joined #openstack-infra | 01:25 | |
| mtreinish | fungi: well it is info you'd want to know :) | 01:26 |
| fungi | that seems like it should be error, or at _least_ warning | 01:26 |
| mtreinish | yeah it does | 01:26 |
| *** yolkfull_ has quit IRC | 01:27 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/project-config master: Add neutron-dynamic-routing job with ryu master https://review.openstack.org/461584 | 01:27 |
| *** zhurong has joined #openstack-infra | 01:28 | |
| *** liujiong has joined #openstack-infra | 01:28 | |
| mtreinish | fungi: if I find the time I might work on fixing all of that logging mess in mosquitto | 01:28 |
| mtreinish | it doesn't seem like it'll be too hard | 01:29 |
| mtreinish | (definitely a post boston thing) | 01:29 |
| fungi | mtreinish: looking at grafana, it _seems_ throughput has improved following the log config tweaks too | 01:29 |
| mtreinish | fungi: oh, that might have been me I opened up 20 more subs a little while ago | 01:30 |
| *** thorst has quit IRC | 01:30 | |
| fungi | around when i restarted the daemon? | 01:30 |
| mtreinish | yeah, pretty soon before | 01:31 |
| mtreinish | you can see it in the graph, there is a spike right before the dip for the first restart | 01:31 |
| fungi | that's probably it then, yeah | 01:31 |
| *** esikachev has joined #openstack-infra | 01:32 | |
| mtreinish | fungi: but if anything it decreases the disk io a lot, we'll have to check the cacti | 01:32 |
| fungi | http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=4931&rra_id=all | 01:33 |
| fungi | dropped, yep | 01:33 |
| mtreinish | heh, if we use those in the slides I'll have to render them from the csv :) | 01:34 |
| *** ijw has joined #openstack-infra | 01:36 | |
| *** esikachev has quit IRC | 01:36 | |
| *** yanyanhu has joined #openstack-infra | 01:37 | |
| fungi | with this pattern, i think we're going to run out of memory before we top out any other resources on that server | 01:37 |
| mtreinish | hmm, that could be | 01:37 |
| mtreinish | fungi: the number I'm also curious about is the max number of clients/subscriptions we can maintain | 01:38 |
| *** gildub has joined #openstack-infra | 01:38 | |
| fungi | i can drop one of the publisher loops and ramp up a bunch more subs | 01:38 |
| *** erikmwilson has quit IRC | 01:39 | |
| mtreinish | sure | 01:39 |
| mtreinish | or I can just keep bumping up the clients on my end see how far we get with 2 loops | 01:39 |
| fungi | i killed one of the two loops already | 01:39 |
| mtreinish | heh ok | 01:39 |
| *** erikmwilson has joined #openstack-infra | 01:39 | |
| fungi | will add another 20 subs here real quick | 01:39 |
| mtreinish | ok, I just added 40 | 01:39 |
| fungi | load average on my test instance is a hovering around 1.0-1.1 now | 01:40 |
| fungi | given there are 4 vcpus on it, not worrying | 01:41 |
| *** ijw has quit IRC | 01:41 | |
| fungi | actually, it's dropped a bit now that i stopped one of the pub loops | 01:41 |
| mtreinish | really? my desktop is at ~1.2, but I'm also running a vm for windows that has 8 vcpus :) | 01:41 |
| fungi | currently running one pub loop and 30 subs on here | 01:42 |
| mtreinish | I lost count but I think I'm at 60 or 80 clients on my desktop | 01:42 |
| mtreinish | the grafana count says 125 total clients | 01:42 |
| mtreinish | and we normally sit at 15 iirc | 01:42 |
| fungi | since i'm using & i just look at the numbers on the `jobs` command output | 01:43 |
| fungi | 31 background jobs, and i know one of those is the pub loop | 01:43 |
| mtreinish | I am too, but I forgot to redirect output on a couple of the windows so jobs isn't so useful | 01:43 |
| fungi | we're probably around the number of listeners we see for third-party ci systems on gerrit's ssh interface now | 01:44 |
| mtreinish | do you want to start some more? | 01:44 |
| fungi | sure, i can add... a hundred? i'll go in increments of 10 in case i hit any errors | 01:44 |
| mtreinish | ok | 01:45 |
| fungi | okay, so i'm up to 130 subs now | 01:46 |
| *** baoli has joined #openstack-infra | 01:46 | |
| mtreinish | grafan is showing 225 clients | 01:46 |
| *** jamesdenton has joined #openstack-infra | 01:47 | |
| *** zhenguo has joined #openstack-infra | 01:48 | |
| mtreinish | I just launched 40 more on my end too | 01:48 |
| mtreinish | we're at 265 clients | 01:48 |
| fungi | given that the test instance i'm using has twice the cpu and ram of firehose01, amusing that the load average on the 'hose is still well under 1.0, close to 0.5 even | 01:49 |
| mtreinish | I also like that we're encroaching 1.5M msg/min | 01:50 |
| *** chlong has quit IRC | 01:50 | |
| mtreinish | fungi: man the restarts cleared up the ram usage a lot: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=4927&rra_id=all | 01:51 |
| fungi | yep | 01:51 |
| mtreinish | we're at < 0.5GB | 01:51 |
| fungi | well, it'll have that effect on buffers/cache especially | 01:51 |
| *** Apoorva has quit IRC | 01:52 | |
| mtreinish | I was just looking at used memory, it was at almost 1.5GB before the restarts | 01:52 |
| fungi | established tcp connections is up to nearly 300 now | 01:52 |
| fungi | oh, yeah i'm not sure why used memory jumped by so much when we got partway into testing | 01:53 |
| fungi | might have been related to logging somehow | 01:53 |
| mtreinish | yeah, that's what I was thinking | 01:54 |
| fungi | doesn't seem like it should have suddenly tripled like that if just restarting the daemon takes it back well under the pre-testing values while still under our test load | 01:54 |
| mtreinish | fungi: so one thing is germqtt doesn't seem to be running anymore | 01:55 |
| fungi | checking | 01:55 |
| mtreinish | I just subscribed to gerrit/# and I'm not seeing anything | 01:55 |
| mtreinish | (I even did a test recheck comment) | 01:55 |
| mtreinish | and if that's having issues I suspect lpmqtt will too | 01:55 |
| *** srobert has quit IRC | 01:57 | |
| *** Goneri has quit IRC | 01:57 | |
| fungi | lpmqtt is still running at least | 01:57 |
| fungi | germqtt does seem to have died though | 01:58 |
| fungi | maybe that's what the memory drop was from? | 01:58 |
| mtreinish | yeah, that would make more sense | 01:59 |
| *** esikachev has joined #openstack-infra | 01:59 | |
| mtreinish | it does use gerritlib so it maintains an in memory queue of gerrit events | 01:59 |
| fungi | looks like it may have exited on a socket error | 01:59 |
| *** jamielennox is now known as jamielennox|away | 01:59 | |
| fungi | about half an hour ago | 01:59 |
| mtreinish | oh, that's interesting | 01:59 |
| mtreinish | maybe before the restart when things were starting to bog down | 02:00 |
| fungi | does it log anywhere besides stdout? | 02:00 |
| fungi | gotta see if i can dig the full traceback out of systemd's journal | 02:00 |
| mtreinish | fungi: err I actually don't know if logging works on it at all... | 02:01 |
| mtreinish | it calls getLogger, but never does anything with it | 02:01 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: support github pull request labels https://review.openstack.org/444511 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Allow github trigger to match on branches/refs https://review.openstack.org/445625 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Set filter according to PR/Change in URL https://review.openstack.org/446782 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Add support for requiring github pr head status https://review.openstack.org/449390 | 02:02 |
| fungi | `service germqtt status` shows me the tail end of a backtrace | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Support for dependent pipelines with github https://review.openstack.org/445292 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Adds github triggering from status updates https://review.openstack.org/453844 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Implement pipeline requirement on github reviews https://review.openstack.org/453845 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Add basic Github Zuul Reporter. https://review.openstack.org/443323 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Configurable SSH access to GitHub https://review.openstack.org/444034 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Represent github change ID in status page by PR number https://review.openstack.org/460716 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Add 'push' and 'tag' github webhook events. https://review.openstack.org/443947 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Add 'pr-comment' github webhook event https://review.openstack.org/443959 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Support for github commit status https://review.openstack.org/444060 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Better merge message for GitHub pull reqeusts https://review.openstack.org/445644 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Test gerrit and github drivers in same tenant https://review.openstack.org/448257 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Encapsulate determining the event purpose https://review.openstack.org/445242 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Merge pull requests from github reporter https://review.openstack.org/444463 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Include exc_info in reporter failure https://review.openstack.org/460765 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Add support for github enterprise https://review.openstack.org/449258 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Support GitHub PR webhooks https://review.openstack.org/439834 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: GitHub file matching support https://review.openstack.org/446113 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Ensure PRs arent rejected for stale negative reviews https://review.openstack.org/460700 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Add trigger capability on github pr review https://review.openstack.org/449365 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Log GitHub API rate limit https://review.openstack.org/446150 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Comment on PRs if a remote call to merge a change failed https://review.openstack.org/460762 | 02:02 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Add cachecontrol to requests to github https://review.openstack.org/461587 | 02:02 |
| *** ramishra has joined #openstack-infra | 02:02 | |
| mtreinish | fungi: you can do systemctl status germqtt -n 50 or something | 02:03 |
| *** aeng has quit IRC | 02:03 | |
| *** esikachev has quit IRC | 02:06 | |
| fungi | mtreinish: thanks! that did it... http://paste.openstack.org/show/608563/ | 02:07 |
| fungi | guess we can trap for socket.error in the future | 02:08 |
| mtreinish | fungi: yep I can push a patch for that tomorrow | 02:08 |
| *** ym200 has joined #openstack-infra | 02:08 | |
| fungi | oh, or not. looks like maybe if it hits one during reconnect this is what happens | 02:08 |
| fungi | so might be a pretty pathological condition | 02:09 |
| fungi | anyway, i'll fire it back up now | 02:09 |
| mtreinish | ok | 02:10 |
| mtreinish | fungi: well I don't have any error handling in the main loop, if something fails it'll raise all the way | 02:10 |
| *** Julien-zte has quit IRC | 02:10 | |
| fungi | right, i guess it's a question of whether this is an error worth handling, or if things have gone this far then is aborting the daemon the right call anyway? | 02:11 |
| *** zhurong has quit IRC | 02:11 | |
| *** Julien-zte has joined #openstack-infra | 02:12 | |
| mtreinish | yeah, I'm not sure. I know in other daemons we do except Exception as e: log.exception() | 02:12 |
| mtreinish | to make the failures not fatal and just log them | 02:12 |
| mtreinish | but you're right in this case we might end up in a loop of socket errors :) | 02:13 |
| fungi | and we're up to 1.675kmpm now per grafana | 02:13 |
| *** jamielennox|away is now known as jamielennox | 02:13 | |
| mtreinish | also, gerrit messages are back | 02:13 |
| *** ym200 has quit IRC | 02:13 | |
| fungi | should we try to crank up subs further, or switch to larger message payloads? | 02:14 |
| mtreinish | your call | 02:15 |
| *** aeng has joined #openstack-infra | 02:15 | |
| fungi | i'll give a larger payload a shot | 02:15 |
| mtreinish | ok | 02:16 |
| mtreinish | fungi: pushing the cert now? | 02:18 |
| fungi | okay testing with very large paylod (the cafile) | 02:18 |
| fungi | let's see what this destroys | 02:18 |
| fungi | curious whether we blow out memory or hit our bandwidth cap | 02:19 |
| mtreinish | heh, yeah I wonder | 02:20 |
| mtreinish | what is the bandwidth cap? | 02:20 |
| fungi | on a 2gb flavor in rax, not sure but probably ~100mbps | 02:20 |
| mtreinish | heh, well we're up to about 3.3 Mbps right now | 02:21 |
| mtreinish | at least according to the grafana graph | 02:21 |
| mtreinish | I guess this is more accurate: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=4952&rra_id=all | 02:22 |
| *** rfolco_ has joined #openstack-infra | 02:22 | |
| *** rfolco_ has quit IRC | 02:22 | |
| fungi | it's also possible that my load generator loop simply won't be able to produce anywhere close to the message count with these much larger messages | 02:22 |
| *** zhurong has joined #openstack-infra | 02:22 | |
| mtreinish | heh start multiple publishers :) | 02:23 |
| fungi | wcpgw? | 02:23 |
| * mtreinish is thinking we really should script this | 02:24 | |
| *** esikachev has joined #openstack-infra | 02:24 | |
| fungi | i have 3 publisher loops running now | 02:24 |
| mtreinish | or just use something like: https://github.com/takanorig/mqtt-bench | 02:24 |
| mtreinish | yeah, we're not getting anywhere near the same message rate | 02:25 |
| fungi | indeed, that looks spiffy (if it works as designed) | 02:25 |
| *** watanabe_isao has joined #openstack-infra | 02:26 | |
| *** lamt has joined #openstack-infra | 02:26 | |
| *** EricGonczer_ has quit IRC | 02:26 | |
| *** felipemonteiro has joined #openstack-infra | 02:26 | |
| *** felipemonteiro_ has joined #openstack-infra | 02:27 | |
| mtreinish | fungi: do you want to give mqtt-bench a try later in the week? | 02:28 |
| mtreinish | I'm gonna kill my clients on my desktop. I've got some things around the house today, so I'm gonna call it a night | 02:28 |
| *** Julien-zte has quit IRC | 02:28 | |
| *** esikachev has quit IRC | 02:28 | |
| *** watanabe_isao has quit IRC | 02:29 | |
| *** winggundamth has joined #openstack-infra | 02:29 | |
| *** gcb has joined #openstack-infra | 02:30 | |
| *** Julien-zte has joined #openstack-infra | 02:30 | |
| *** thorst has joined #openstack-infra | 02:30 | |
| mtreinish | fungi: it does look like we hit 100mbps outbound: http://cacti.openstack.org/cacti/graph.php?action=zoom&local_graph_id=4952&rra_id=5&view_type=&graph_start=1493689617&graph_end=1493691954&graph_height=120&graph_width=500&title_font_size=10 | 02:31 |
| *** markvoelker has quit IRC | 02:31 | |
| *** felipemonteiro has quit IRC | 02:31 | |
| *** aeng has quit IRC | 02:31 | |
| *** esikachev has joined #openstack-infra | 02:31 | |
| *** Julien-zte has quit IRC | 02:32 | |
| fungi | mtreinish: yeah, i'll wind down the current testing | 02:33 |
| fungi | it's about time for me to knock off as well | 02:33 |
| fungi | as for "later in the week" i fly up to boston on thursday but maybe before that | 02:33 |
| *** watanabe_isao has joined #openstack-infra | 02:33 | |
| mtreinish | fungi: yeah | 02:34 |
| *** Julien-zte has joined #openstack-infra | 02:34 | |
| mtreinish | fungi: fwiw, I'll be driving to boston on sun. morning | 02:34 |
| fungi | not a terrible drive i guess | 02:35 |
| mtreinish | about 3-3.5 hrs normally | 02:35 |
| fungi | oh, that's faster than i can get to raleigh or dc | 02:36 |
| *** lamt has quit IRC | 02:40 | |
| *** hongbin has joined #openstack-infra | 02:40 | |
| *** lamt has joined #openstack-infra | 02:41 | |
| *** Julien-zte has quit IRC | 02:42 | |
| *** zhurong has quit IRC | 02:43 | |
| *** Julien-zte has joined #openstack-infra | 02:43 | |
| *** nicolasbock has quit IRC | 02:44 | |
| *** aeng has joined #openstack-infra | 02:45 | |
| *** watanabe_isao has quit IRC | 02:45 | |
| *** mat128 has quit IRC | 02:46 | |
| *** Julien-zte has quit IRC | 02:49 | |
| *** thorst has quit IRC | 02:50 | |
| *** Julien-zte has joined #openstack-infra | 02:50 | |
| *** jamesdenton has quit IRC | 02:51 | |
| *** watanabe_isao has joined #openstack-infra | 02:51 | |
| *** jamesmca_ has joined #openstack-infra | 02:52 | |
| *** lamt has quit IRC | 02:53 | |
| watanabe_isao | Does anyone know if we can backport a tiny bug fix to stable/mitaka now ? I went to stable room. But no one is there. :) | 02:54 |
| *** lamt has joined #openstack-infra | 02:55 | |
| *** lamt has quit IRC | 02:56 | |
| *** dimtruck is now known as zz_dimtruck | 02:57 | |
| *** rderose has joined #openstack-infra | 02:57 | |
| *** lamt has joined #openstack-infra | 02:57 | |
| *** jamesmca_ has quit IRC | 02:57 | |
| *** Kevin_Zheng has joined #openstack-infra | 02:58 | |
| *** esikachev has quit IRC | 02:58 | |
| *** lamt has quit IRC | 02:59 | |
| *** lamt has joined #openstack-infra | 03:00 | |
| *** funzo has joined #openstack-infra | 03:02 | |
| *** Julien-zte has quit IRC | 03:03 | |
| *** lamt has quit IRC | 03:05 | |
| *** Julien-zte has joined #openstack-infra | 03:05 | |
| *** Sukhdev has joined #openstack-infra | 03:06 | |
| *** lamt has joined #openstack-infra | 03:06 | |
| *** funzo has quit IRC | 03:06 | |
| *** watanabe_isao has quit IRC | 03:08 | |
| *** Julien-zte has quit IRC | 03:08 | |
| *** Julien-zte has joined #openstack-infra | 03:09 | |
| *** lamt has quit IRC | 03:10 | |
| *** dhajare has joined #openstack-infra | 03:10 | |
| *** lamt has joined #openstack-infra | 03:11 | |
| *** lamt has quit IRC | 03:13 | |
| *** lamt has joined #openstack-infra | 03:14 | |
| *** gildub has quit IRC | 03:15 | |
| *** Julien-zte has quit IRC | 03:15 | |
| *** Julien-zte has joined #openstack-infra | 03:16 | |
| *** ijw has joined #openstack-infra | 03:17 | |
| openstackgerrit | Merged openstack-infra/system-config master: Move puppet repos to openstack_project::server https://review.openstack.org/460702 | 03:18 |
| *** dhajare has quit IRC | 03:19 | |
| openstackgerrit | Merged openstack-infra/system-config master: Remove empty template class https://review.openstack.org/460703 | 03:19 |
| *** Julien-zte has quit IRC | 03:20 | |
| *** Julien-zte has joined #openstack-infra | 03:21 | |
| *** ijw has quit IRC | 03:22 | |
| *** lamt has quit IRC | 03:22 | |
| *** rderose has quit IRC | 03:23 | |
| *** lamt has joined #openstack-infra | 03:23 | |
| *** Julien-zte has quit IRC | 03:24 | |
| *** lamt has quit IRC | 03:24 | |
| *** dave-mccowan has quit IRC | 03:25 | |
| *** Julien-zte has joined #openstack-infra | 03:26 | |
| *** lamt has joined #openstack-infra | 03:26 | |
| *** lamt has quit IRC | 03:27 | |
| *** ijw has joined #openstack-infra | 03:28 | |
| *** lamt has joined #openstack-infra | 03:29 | |
| *** Julien-zte has quit IRC | 03:32 | |
| *** Julien-zte has joined #openstack-infra | 03:32 | |
| *** gildub has joined #openstack-infra | 03:33 | |
| *** Julien-zte has quit IRC | 03:35 | |
| *** Julien-zte has joined #openstack-infra | 03:36 | |
| *** zhurong has joined #openstack-infra | 03:37 | |
| *** Julien-zte has quit IRC | 03:37 | |
| *** vikrant has joined #openstack-infra | 03:37 | |
| *** Julien-zte has joined #openstack-infra | 03:39 | |
| *** lamt has quit IRC | 03:40 | |
| *** baoli has quit IRC | 03:40 | |
| *** lamt has joined #openstack-infra | 03:41 | |
| *** lamt has quit IRC | 03:42 | |
| *** baoli has joined #openstack-infra | 03:43 | |
| *** lamt has joined #openstack-infra | 03:43 | |
| *** yamahata has joined #openstack-infra | 03:45 | |
| *** lamt has quit IRC | 03:45 | |
| *** baoli has quit IRC | 03:46 | |
| openstackgerrit | Anne Gentle proposed openstack-infra/reviewstats master: Adds doc and api-ref stat measures https://review.openstack.org/461280 | 03:46 |
| *** felipemonteiro_ has quit IRC | 03:46 | |
| *** thorst has joined #openstack-infra | 03:47 | |
| *** lamt has joined #openstack-infra | 03:47 | |
| *** Dinesh_Bhor has joined #openstack-infra | 03:47 | |
| *** lamt has quit IRC | 03:48 | |
| *** lamt has joined #openstack-infra | 03:49 | |
| *** lamt has quit IRC | 03:51 | |
| *** thorst has quit IRC | 03:51 | |
| *** lamt has joined #openstack-infra | 03:52 | |
| *** ykarel has joined #openstack-infra | 03:52 | |
| *** lamt has quit IRC | 03:54 | |
| *** esikachev has joined #openstack-infra | 03:55 | |
| *** lamt has joined #openstack-infra | 03:55 | |
| *** zhurong has quit IRC | 03:56 | |
| *** lamt has quit IRC | 03:57 | |
| *** markvoelker has joined #openstack-infra | 03:59 | |
| *** lamt has joined #openstack-infra | 03:59 | |
| *** lamt has quit IRC | 04:00 | |
| *** esikachev has quit IRC | 04:00 | |
| *** esikachev has joined #openstack-infra | 04:01 | |
| *** lamt has joined #openstack-infra | 04:01 | |
| openstackgerrit | Anne Gentle proposed openstack-infra/reviewstats master: Adds doc and api-ref stat measures https://review.openstack.org/461280 | 04:02 |
| *** hongbin has quit IRC | 04:03 | |
| *** links has joined #openstack-infra | 04:05 | |
| *** esikachev has quit IRC | 04:06 | |
| *** ykarel has quit IRC | 04:07 | |
| *** ym200 has joined #openstack-infra | 04:10 | |
| *** csomerville has joined #openstack-infra | 04:11 | |
| *** kornica has joined #openstack-infra | 04:11 | |
| *** esikachev has joined #openstack-infra | 04:11 | |
| *** ym200 has quit IRC | 04:14 | |
| *** cody-somerville has quit IRC | 04:14 | |
| *** esikachev has quit IRC | 04:17 | |
| *** Julien-zte has quit IRC | 04:17 | |
| *** yolkfull_ has joined #openstack-infra | 04:18 | |
| *** sree has joined #openstack-infra | 04:18 | |
| *** Julien-zte has joined #openstack-infra | 04:20 | |
| *** yolkfull has quit IRC | 04:21 | |
| *** xinliang has quit IRC | 04:25 | |
| *** salv-orlando has joined #openstack-infra | 04:30 | |
| *** Julien-zte has quit IRC | 04:30 | |
| *** Julien-zte has joined #openstack-infra | 04:31 | |
| *** lamt has quit IRC | 04:33 | |
| *** sree_ has joined #openstack-infra | 04:33 | |
| *** sree_ is now known as Guest92926 | 04:34 | |
| *** sree has quit IRC | 04:36 | |
| *** esikachev has joined #openstack-infra | 04:37 | |
| *** ykarel has joined #openstack-infra | 04:37 | |
| *** xinliang has joined #openstack-infra | 04:37 | |
| *** xinliang has quit IRC | 04:37 | |
| *** xinliang has joined #openstack-infra | 04:37 | |
| *** yamahata has quit IRC | 04:39 | |
| *** esikachev has quit IRC | 04:41 | |
| *** jascott1 has quit IRC | 04:44 | |
| *** jascott1 has joined #openstack-infra | 04:44 | |
| *** jascott1 has quit IRC | 04:49 | |
| *** Julien-zte has quit IRC | 05:01 | |
| *** Guest92926 has quit IRC | 05:01 | |
| *** Julien-zte has joined #openstack-infra | 05:02 | |
| *** sree has joined #openstack-infra | 05:03 | |
| *** esikachev has joined #openstack-infra | 05:06 | |
| *** baoli has joined #openstack-infra | 05:06 | |
| *** Julien-zte has quit IRC | 05:08 | |
| *** Julien-zte has joined #openstack-infra | 05:09 | |
| *** aviau has joined #openstack-infra | 05:09 | |
| *** baoli has quit IRC | 05:10 | |
| *** lamt has joined #openstack-infra | 05:11 | |
| *** esikachev has quit IRC | 05:11 | |
| *** pgadiya has joined #openstack-infra | 05:11 | |
| *** sree has quit IRC | 05:13 | |
| *** Julien-zte has quit IRC | 05:15 | |
| *** pgadiya has quit IRC | 05:16 | |
| *** Julien-zte has joined #openstack-infra | 05:16 | |
| *** Sukhdev has quit IRC | 05:17 | |
| *** jascott1 has joined #openstack-infra | 05:19 | |
| *** tphummel has quit IRC | 05:19 | |
| *** Julien-zte has quit IRC | 05:20 | |
| *** Julien-zte has joined #openstack-infra | 05:21 | |
| *** jascott1 has quit IRC | 05:21 | |
| *** ym200 has joined #openstack-infra | 05:23 | |
| *** jascott1 has joined #openstack-infra | 05:25 | |
| *** lamt has quit IRC | 05:27 | |
| *** ym200 has quit IRC | 05:27 | |
| *** pgadiya has joined #openstack-infra | 05:28 | |
| *** gyee has quit IRC | 05:28 | |
| *** sree has joined #openstack-infra | 05:30 | |
| *** ym200 has joined #openstack-infra | 05:32 | |
| *** ym200 has quit IRC | 05:36 | |
| *** Julien-zte has quit IRC | 05:38 | |
| *** Julien-zte has joined #openstack-infra | 05:38 | |
| openstackgerrit | Dirk Mueller proposed openstack-infra/project-config master: Upgrade python 3.5 cross-unit test jobs to voting https://review.openstack.org/461629 | 05:39 |
| *** ricardoas has quit IRC | 05:39 | |
| *** coolsvap has joined #openstack-infra | 05:44 | |
| *** esikachev has joined #openstack-infra | 05:44 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: block_device: reorder imports https://review.openstack.org/461632 | 05:46 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move blockdevicesetupexception.py into blockdevice.py https://review.openstack.org/461633 | 05:46 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Remove unused val_else_none https://review.openstack.org/461634 | 05:46 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move dib-block-device implementation into cmd.py https://review.openstack.org/461635 | 05:46 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move YAML parsing into cmd.py; default to env https://review.openstack.org/461636 | 05:46 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Take --params from environment https://review.openstack.org/461637 | 05:46 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Create BlockDeviceCmd object https://review.openstack.org/461638 | 05:46 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move to subparsers https://review.openstack.org/461639 | 05:46 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Remove args from BlockDevice() init https://review.openstack.org/461640 | 05:46 |
| *** thorst has joined #openstack-infra | 05:48 | |
| *** ricardoas has joined #openstack-infra | 05:49 | |
| *** esikachev has quit IRC | 05:50 | |
| *** prateek has joined #openstack-infra | 05:50 | |
| *** ym200 has joined #openstack-infra | 05:51 | |
| *** esikachev has joined #openstack-infra | 05:51 | |
| *** ym200_ has joined #openstack-infra | 05:52 | |
| *** thorst has quit IRC | 05:53 | |
| *** esikachev has quit IRC | 05:56 | |
| *** ym200 has quit IRC | 05:56 | |
| *** watanabe_isao has joined #openstack-infra | 05:56 | |
| *** ym200_ has quit IRC | 05:56 | |
| *** lamt has joined #openstack-infra | 05:57 | |
| *** lamt has quit IRC | 05:57 | |
| *** nmathew has joined #openstack-infra | 05:58 | |
| *** Hal has quit IRC | 05:58 | |
| *** watanabe_isao has quit IRC | 05:59 | |
| *** esikachev has joined #openstack-infra | 06:00 | |
| AJaeger | ianw, could you review https://review.openstack.org/461250 and https://review.openstack.org/461282 again , please? | 06:00 |
| ianw | AJaeger: sure | 06:01 |
| *** Julien-zte has quit IRC | 06:03 | |
| *** Julien-zte has joined #openstack-infra | 06:03 | |
| AJaeger | thanks | 06:04 |
| *** esikachev has quit IRC | 06:05 | |
| ianw | AJaeger: 461282 .. missing a " ? or wonky eyes, could be either :) | 06:05 |
| *** zhurong has joined #openstack-infra | 06:06 | |
| AJaeger | ianw: My fat fingers ;( thanks for catching | 06:06 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Use DEVSTACK_PROJECT_FROM_GIT (1/2) https://review.openstack.org/461282 | 06:08 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Use DEVSTACK_PROJECT_FROM_GIT (2/2) https://review.openstack.org/461284 | 06:08 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: ironic: Cleanup PROJECTS and DEVSTACK_PROJECT_FROM_GIT https://review.openstack.org/461460 | 06:08 |
| AJaeger | ianw: fixed and rebased ^ | 06:08 |
| openstackgerrit | Merged openstack-infra/project-config master: Cleanup PROJECTS and DEVSTACK_PROJECT_FROM_GIT https://review.openstack.org/461250 | 06:09 |
| *** tjones has quit IRC | 06:09 | |
| *** Julien-zte has quit IRC | 06:10 | |
| AJaeger | ianw: https://review.openstack.org/461460 would be nice as well, please | 06:13 |
| *** salv-orlando has quit IRC | 06:15 | |
| *** nmathew- has joined #openstack-infra | 06:16 | |
| *** nmathew has quit IRC | 06:19 | |
| *** nmathew has joined #openstack-infra | 06:19 | |
| *** esikachev has joined #openstack-infra | 06:20 | |
| *** rlandy|bbl is now known as rlandy | 06:20 | |
| *** rlandy has quit IRC | 06:20 | |
| *** nmathew- has quit IRC | 06:22 | |
| *** chem` has joined #openstack-infra | 06:22 | |
| *** chem has quit IRC | 06:24 | |
| *** gibi has quit IRC | 06:24 | |
| *** gibi has joined #openstack-infra | 06:24 | |
| *** yolkfull__ has joined #openstack-infra | 06:25 | |
| *** yolkfull__ has quit IRC | 06:26 | |
| *** yolkfull__ has joined #openstack-infra | 06:26 | |
| *** yolkfull_ has quit IRC | 06:27 | |
| *** ijw has quit IRC | 06:27 | |
| *** sree has quit IRC | 06:32 | |
| *** adriant has quit IRC | 06:35 | |
| *** e0ne has joined #openstack-infra | 06:35 | |
| *** lamt has joined #openstack-infra | 06:38 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Use full path to socat in devstack plugin https://review.openstack.org/461651 | 06:38 |
| ianw | yolanda: ^ should fix the dib jobs? hopefully | 06:38 |
| *** andreas_s has joined #openstack-infra | 06:39 | |
| *** sree has joined #openstack-infra | 06:42 | |
| * yolanda checks | 06:43 | |
| yolanda | ianw, maye is more secure to run a "which socat" ? | 06:43 |
| ianw | yolanda: yeah, systemd just wants a full path to a binary there, i don't think it will run "which" :) | 06:44 |
| ianw | i think the other services the jobs starts should be ok, from a quick look | 06:44 |
| *** chenying_ has quit IRC | 06:45 | |
| *** ym200 has joined #openstack-infra | 06:45 | |
| *** ym200_ has joined #openstack-infra | 06:47 | |
| yolanda | ianw, i mean, we run which in that script, to get the full path, then pass it to statsd | 06:47 |
| *** nmathew- has joined #openstack-infra | 06:47 | |
| ianw | oh :) yeah ... i guess, does it actually live in different places? | 06:47 |
| yolanda | don't know for all distros | 06:48 |
| *** eranrom_ is now known as eranrom | 06:49 | |
| yolanda | i need to leave for the morning, i'll be working this afternoon | 06:49 |
| AJaeger | It's /usr/bin/socat for SUSE distros at least. We can take the change as is and add which if a distro needs something else in a followup... | 06:49 |
| *** GheRivero has left #openstack-infra | 06:49 | |
| *** nmathew has quit IRC | 06:50 | |
| *** ym200 has quit IRC | 06:50 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Take --params from environment https://review.openstack.org/461637 | 06:50 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move YAML parsing into cmd.py; default to env https://review.openstack.org/461636 | 06:50 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move to subparsers https://review.openstack.org/461639 | 06:50 |
| *** nmathew has joined #openstack-infra | 06:50 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Create BlockDeviceCmd object https://review.openstack.org/461638 | 06:50 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move blockdevicesetupexception.py into blockdevice.py https://review.openstack.org/461633 | 06:51 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move dib-block-device implementation into cmd.py https://review.openstack.org/461635 | 06:51 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Remove unused val_else_none https://review.openstack.org/461634 | 06:51 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Remove args from BlockDevice() init https://review.openstack.org/461640 | 06:51 |
| *** ym200 has joined #openstack-infra | 06:51 | |
| *** ym200_ has quit IRC | 06:51 | |
| *** ym200_ has joined #openstack-infra | 06:52 | |
| *** nmathew- has quit IRC | 06:53 | |
| *** jamesmca_ has joined #openstack-infra | 06:53 | |
| *** nmathew has quit IRC | 06:54 | |
| *** nmathew has joined #openstack-infra | 06:54 | |
| *** ym200__ has joined #openstack-infra | 06:55 | |
| *** shardy has joined #openstack-infra | 06:55 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Clean up puppetmaster cruft https://review.openstack.org/452558 | 06:56 |
| *** ym200 has quit IRC | 06:56 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove useless '' for nodes https://review.openstack.org/461352 | 06:56 |
| *** ym200 has joined #openstack-infra | 06:56 | |
| *** ym200_ has quit IRC | 06:57 | |
| *** jamesmca_ has quit IRC | 06:58 | |
| *** makowals has joined #openstack-infra | 06:58 | |
| *** ym200__ has quit IRC | 06:59 | |
| *** ym200 has quit IRC | 07:01 | |
| *** ym200 has joined #openstack-infra | 07:02 | |
| *** funzo has joined #openstack-infra | 07:04 | |
| *** pcaruana has joined #openstack-infra | 07:06 | |
| *** ym200 has quit IRC | 07:07 | |
| *** ym200_ has joined #openstack-infra | 07:07 | |
| *** funzo has quit IRC | 07:08 | |
| *** zhurong has quit IRC | 07:08 | |
| *** ym200_ has quit IRC | 07:11 | |
| *** hashar has joined #openstack-infra | 07:11 | |
| *** andreas-f has joined #openstack-infra | 07:12 | |
| *** gcb has quit IRC | 07:14 | |
| *** sree_ has joined #openstack-infra | 07:16 | |
| *** sree has quit IRC | 07:16 | |
| *** sree_ is now known as Guest98476 | 07:17 | |
| *** salv-orlando has joined #openstack-infra | 07:20 | |
| *** jascott1 has quit IRC | 07:21 | |
| *** ym200 has joined #openstack-infra | 07:21 | |
| *** ym200_ has joined #openstack-infra | 07:23 | |
| *** Hal has joined #openstack-infra | 07:23 | |
| *** ym200 has quit IRC | 07:26 | |
| *** gcb has joined #openstack-infra | 07:26 | |
| *** ym200_ has quit IRC | 07:27 | |
| *** ijw has joined #openstack-infra | 07:28 | |
| *** markus_z has joined #openstack-infra | 07:28 | |
| *** tesseract-RH has joined #openstack-infra | 07:30 | |
| *** knangia has joined #openstack-infra | 07:32 | |
| *** ijw has quit IRC | 07:34 | |
| *** huanxie has joined #openstack-infra | 07:36 | |
| *** jascott1 has joined #openstack-infra | 07:38 | |
| *** jascott1 has quit IRC | 07:43 | |
| *** ccamacho has joined #openstack-infra | 07:43 | |
| *** kjackal_ has joined #openstack-infra | 07:44 | |
| *** thorst has joined #openstack-infra | 07:49 | |
| *** lewo has quit IRC | 07:53 | |
| *** lewo has joined #openstack-infra | 07:53 | |
| *** rossella_s has joined #openstack-infra | 07:54 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:00 | |
| *** coolsvap has quit IRC | 08:00 | |
| *** therve_ has joined #openstack-infra | 08:00 | |
| *** therve has quit IRC | 08:01 | |
| *** mandre has quit IRC | 08:01 | |
| *** mandre_ has joined #openstack-infra | 08:01 | |
| *** mandre_ is now known as mandre | 08:01 | |
| *** jamielennox is now known as jamielennox|away | 08:02 | |
| *** tobiash has quit IRC | 08:06 | |
| *** tobiash has joined #openstack-infra | 08:07 | |
| *** thorst has quit IRC | 08:09 | |
| *** kornica has quit IRC | 08:12 | |
| *** kornica has joined #openstack-infra | 08:12 | |
| *** neiljerram has joined #openstack-infra | 08:13 | |
| *** kornica has quit IRC | 08:18 | |
| *** lucas-afk is now known as lucasagomes | 08:18 | |
| *** kornica has joined #openstack-infra | 08:19 | |
| *** john-davidge has joined #openstack-infra | 08:20 | |
| *** john-davidge has quit IRC | 08:20 | |
| *** dingyichen has quit IRC | 08:21 | |
| *** alexchadin has joined #openstack-infra | 08:22 | |
| *** kornicameister has joined #openstack-infra | 08:22 | |
| *** jamielennox|away is now known as jamielennox | 08:22 | |
| *** kornicameister has quit IRC | 08:23 | |
| *** kornicameister has joined #openstack-infra | 08:23 | |
| *** john-davidge has joined #openstack-infra | 08:24 | |
| *** kornica has quit IRC | 08:25 | |
| *** kornicameister has quit IRC | 08:28 | |
| *** kornicameister has joined #openstack-infra | 08:28 | |
| *** ijw has joined #openstack-infra | 08:30 | |
| *** kornicameister has quit IRC | 08:32 | |
| *** kornicameister has joined #openstack-infra | 08:33 | |
| *** e0ne has quit IRC | 08:34 | |
| *** tie has joined #openstack-infra | 08:36 | |
| *** ijw has quit IRC | 08:36 | |
| *** kjackal__ has joined #openstack-infra | 08:38 | |
| yolkfull__ | Hi everyone, could anybody pls tell me how to fix the failure of gerrit upgrading : Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Unknown column 'auto_hide_diff_table_header' in 'field list' | 08:38 |
| *** jascott1 has joined #openstack-infra | 08:39 | |
| *** kjackal___ has joined #openstack-infra | 08:40 | |
| *** kjackal_ has quit IRC | 08:40 | |
| *** kjackal__ has quit IRC | 08:43 | |
| *** jascott1 has quit IRC | 08:44 | |
| *** kjackal_ has joined #openstack-infra | 08:44 | |
| *** derekh has joined #openstack-infra | 08:45 | |
| *** kjackal__ has joined #openstack-infra | 08:48 | |
| *** e0ne has joined #openstack-infra | 08:48 | |
| *** kjackal___ has quit IRC | 08:49 | |
| *** kjackal_ has quit IRC | 08:51 | |
| *** john-davidge has quit IRC | 08:58 | |
| *** pgadiya has quit IRC | 09:00 | |
| *** john-davidge has joined #openstack-infra | 09:01 | |
| *** john-davidge has quit IRC | 09:02 | |
| *** thorst has joined #openstack-infra | 09:06 | |
| *** links has quit IRC | 09:07 | |
| *** thorst has quit IRC | 09:10 | |
| *** pbourke has joined #openstack-infra | 09:11 | |
| *** Julien-zte has joined #openstack-infra | 09:12 | |
| *** Julien-zte has quit IRC | 09:13 | |
| *** Julien-zte has joined #openstack-infra | 09:15 | |
| *** gildub has quit IRC | 09:15 | |
| *** dtantsur|afk is now known as dtantsur | 09:15 | |
| *** pgadiya has joined #openstack-infra | 09:16 | |
| *** dizquierdo has joined #openstack-infra | 09:22 | |
| *** pgadiya has quit IRC | 09:22 | |
| *** psachin has joined #openstack-infra | 09:24 | |
| *** links has joined #openstack-infra | 09:25 | |
| *** john-davidge has joined #openstack-infra | 09:26 | |
| *** tosky has joined #openstack-infra | 09:27 | |
| *** Julien-zte has quit IRC | 09:27 | |
| *** Julien-zte has joined #openstack-infra | 09:28 | |
| *** esikachev has quit IRC | 09:29 | |
| *** ijw has joined #openstack-infra | 09:32 | |
| *** gildub has joined #openstack-infra | 09:37 | |
| *** pgadiya has joined #openstack-infra | 09:37 | |
| *** Julien-zte has quit IRC | 09:37 | |
| *** sdague has joined #openstack-infra | 09:38 | |
| *** ijw has quit IRC | 09:38 | |
| *** Julien-zte has joined #openstack-infra | 09:39 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config master: Remove factor use in jenkins-sudo-grep.sh https://review.openstack.org/461697 | 09:41 |
| *** Julien-zte has quit IRC | 09:41 | |
| *** Julien-zte has joined #openstack-infra | 09:42 | |
| *** jamesmcarthur has quit IRC | 09:43 | |
| *** amit213 has quit IRC | 09:43 | |
| *** evgenyl has quit IRC | 09:43 | |
| *** dham1 has quit IRC | 09:43 | |
| *** yonglihe has quit IRC | 09:43 | |
| *** auggy has quit IRC | 09:43 | |
| *** rajinir has quit IRC | 09:43 | |
| *** jaranovich_ has quit IRC | 09:43 | |
| *** kmARC has quit IRC | 09:43 | |
| *** jpmaxman has quit IRC | 09:43 | |
| *** rguillebert has quit IRC | 09:43 | |
| *** igorbelikov has quit IRC | 09:43 | |
| *** sindhu has quit IRC | 09:43 | |
| *** madhuvishy has quit IRC | 09:43 | |
| *** dasanind has quit IRC | 09:43 | |
| *** nikhil has quit IRC | 09:43 | |
| *** jamespage has quit IRC | 09:43 | |
| *** kozhukalov has quit IRC | 09:43 | |
| *** fmccrthy has quit IRC | 09:43 | |
| *** zxiiro-away has quit IRC | 09:43 | |
| *** gildub has quit IRC | 09:45 | |
| *** electrofelix has joined #openstack-infra | 09:46 | |
| *** madhuvishy has joined #openstack-infra | 09:48 | |
| *** kozhukalov has joined #openstack-infra | 09:49 | |
| *** jaranovich_ has joined #openstack-infra | 09:49 | |
| *** evgenyl has joined #openstack-infra | 09:50 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Take --params from environment https://review.openstack.org/461637 | 09:50 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move YAML parsing into cmd.py; default to env https://review.openstack.org/461636 | 09:50 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move to subparsers https://review.openstack.org/461639 | 09:50 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Create BlockDeviceCmd object https://review.openstack.org/461638 | 09:50 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Move dib-block-device implementation into cmd.py https://review.openstack.org/461635 | 09:50 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Remove args from BlockDevice() init https://review.openstack.org/461640 | 09:50 |
| *** zxiiro-away has joined #openstack-infra | 09:50 | |
| *** priteau has joined #openstack-infra | 09:51 | |
| *** salv-orl_ has joined #openstack-infra | 09:52 | |
| *** yamamoto has quit IRC | 09:52 | |
| *** jaosorior has joined #openstack-infra | 09:52 | |
| *** jpmaxman has joined #openstack-infra | 09:53 | |
| *** auggy has joined #openstack-infra | 09:53 | |
| *** jamesmcarthur has joined #openstack-infra | 09:53 | |
| *** dham1 has joined #openstack-infra | 09:54 | |
| *** fmccrthy has joined #openstack-infra | 09:54 | |
| *** igorbelikov has joined #openstack-infra | 09:54 | |
| *** salv-orlando has quit IRC | 09:55 | |
| *** nikhil has joined #openstack-infra | 09:56 | |
| *** jamesmcarthur_ has joined #openstack-infra | 09:57 | |
| *** jamesmcarthur has quit IRC | 09:57 | |
| *** jamesmcarthur_ is now known as jamesmcarthur | 09:57 | |
| *** links has quit IRC | 10:01 | |
| openstackgerrit | dongwenjuan proposed openstack-infra/puppet-jenkins master: use 'openjdk-8-jre-headless' for ubuntu-16.04 https://review.openstack.org/461708 | 10:04 |
| *** Julien-zte has quit IRC | 10:05 | |
| *** heyongli has quit IRC | 10:05 | |
| *** zhurong has joined #openstack-infra | 10:05 | |
| *** Julien-zte has joined #openstack-infra | 10:07 | |
| *** thorst has joined #openstack-infra | 10:07 | |
| *** EricGonczer_ has joined #openstack-infra | 10:08 | |
| *** nicolasbock has joined #openstack-infra | 10:08 | |
| *** liujiong has quit IRC | 10:10 | |
| *** baoli has joined #openstack-infra | 10:12 | |
| *** thorst has quit IRC | 10:12 | |
| *** kmARC has joined #openstack-infra | 10:12 | |
| *** heyongli has joined #openstack-infra | 10:13 | |
| *** jamespage has joined #openstack-infra | 10:13 | |
| *** rajinir has joined #openstack-infra | 10:14 | |
| *** rguillebert has joined #openstack-infra | 10:14 | |
| *** yonglihe has joined #openstack-infra | 10:15 | |
| *** baoli has quit IRC | 10:16 | |
| *** amit213 has joined #openstack-infra | 10:16 | |
| *** dasanind has joined #openstack-infra | 10:17 | |
| *** sindhu has joined #openstack-infra | 10:17 | |
| *** nmathew has quit IRC | 10:18 | |
| *** links has joined #openstack-infra | 10:19 | |
| *** yanyanhu has quit IRC | 10:27 | |
| *** jkilpatr has quit IRC | 10:32 | |
| *** pgadiya has quit IRC | 10:32 | |
| *** Odd_Bloke has quit IRC | 10:33 | |
| *** ijw has joined #openstack-infra | 10:34 | |
| *** salv-orl_ has quit IRC | 10:39 | |
| *** ijw has quit IRC | 10:39 | |
| openstackgerrit | Merged openstack/python-jenkins master: create_node: avoid double-encoding https://review.openstack.org/460363 | 10:40 |
| *** jascott1 has joined #openstack-infra | 10:40 | |
| *** sree has joined #openstack-infra | 10:41 | |
| *** Julien-zte has quit IRC | 10:43 | |
| *** Julien-zte has joined #openstack-infra | 10:44 | |
| *** Guest98476 has quit IRC | 10:45 | |
| *** e0ne has quit IRC | 10:45 | |
| *** jascott1 has quit IRC | 10:45 | |
| *** yolkfull__ has quit IRC | 10:46 | |
| *** psachin has quit IRC | 10:47 | |
| *** Julien-zte has quit IRC | 10:50 | |
| *** pgadiya has joined #openstack-infra | 10:50 | |
| *** Julien-zte has joined #openstack-infra | 10:52 | |
| *** zhurong has quit IRC | 10:53 | |
| *** alexchadin has quit IRC | 10:55 | |
| *** mat128 has joined #openstack-infra | 10:59 | |
| *** ggnel_t has quit IRC | 10:59 | |
| *** jkilpatr has joined #openstack-infra | 11:03 | |
| *** psachin has joined #openstack-infra | 11:04 | |
| *** EricGonczer_ has quit IRC | 11:05 | |
| *** kjackal__ has quit IRC | 11:06 | |
| *** EricGonczer_ has joined #openstack-infra | 11:06 | |
| *** EricGonczer_ has quit IRC | 11:11 | |
| *** ggnel_t has joined #openstack-infra | 11:15 | |
| *** yamahata has joined #openstack-infra | 11:15 | |
| *** mat128 has quit IRC | 11:15 | |
| *** john-davidge has quit IRC | 11:15 | |
| *** b3nt_pin is now known as beagles | 11:24 | |
| *** mat128 has joined #openstack-infra | 11:24 | |
| *** beagles is now known as Guest93618 | 11:24 | |
| *** Guest93618 is now known as b3nt_pin | 11:25 | |
| *** kjackal_ has joined #openstack-infra | 11:28 | |
| *** yamamoto has joined #openstack-infra | 11:32 | |
| *** lucasagomes is now known as lucas-hungry | 11:33 | |
| *** yamamoto_ has joined #openstack-infra | 11:33 | |
| *** gcb has quit IRC | 11:34 | |
| *** ijw has joined #openstack-infra | 11:35 | |
| *** thorst has joined #openstack-infra | 11:36 | |
| *** john-davidge has joined #openstack-infra | 11:36 | |
| *** yamamoto has quit IRC | 11:36 | |
| *** mat128 has quit IRC | 11:37 | |
| *** e0ne has joined #openstack-infra | 11:37 | |
| *** sree has quit IRC | 11:38 | |
| *** john-davidge has quit IRC | 11:40 | |
| *** ijw has quit IRC | 11:40 | |
| *** yamahata has quit IRC | 11:44 | |
| *** e0ne has quit IRC | 11:44 | |
| *** mat128 has joined #openstack-infra | 11:45 | |
| *** gildub has joined #openstack-infra | 11:48 | |
| *** ldnunes has joined #openstack-infra | 11:48 | |
| *** ggnel_t has quit IRC | 11:48 | |
| *** felipemonteiro_ has joined #openstack-infra | 11:50 | |
| *** gcb has joined #openstack-infra | 11:52 | |
| *** alexchadin has joined #openstack-infra | 11:52 | |
| *** chem` is now known as chem | 11:54 | |
| *** felipemonteiro has joined #openstack-infra | 11:54 | |
| *** felipemonteiro_ has quit IRC | 11:57 | |
| *** yamamoto_ has quit IRC | 11:58 | |
| *** rlandy has joined #openstack-infra | 11:58 | |
| *** yamamoto has joined #openstack-infra | 11:59 | |
| *** therve_ is now known as therve | 12:00 | |
| *** yamamoto has quit IRC | 12:01 | |
| *** srobert has joined #openstack-infra | 12:05 | |
| *** dave-mccowan has joined #openstack-infra | 12:06 | |
| *** afred312 has quit IRC | 12:06 | |
| *** lunarlamp has joined #openstack-infra | 12:06 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/project-config master: Execute undercloud-container job only on master and ocata https://review.openstack.org/461758 | 12:07 |
| *** psachin has quit IRC | 12:11 | |
| *** trown|outtypewww is now known as trown | 12:14 | |
| openstackgerrit | Dirk Mueller proposed openstack-infra/project-config master: Upgrade python 3.5 cross-unit test jobs to voting https://review.openstack.org/461629 | 12:15 |
| *** dprince has joined #openstack-infra | 12:17 | |
| *** srobert has quit IRC | 12:20 | |
| *** srobert has joined #openstack-infra | 12:21 | |
| *** pgadiya has quit IRC | 12:21 | |
| *** alexchadin has quit IRC | 12:21 | |
| *** alexchadin has joined #openstack-infra | 12:22 | |
| *** rhallisey has joined #openstack-infra | 12:24 | |
| *** psachin has joined #openstack-infra | 12:24 | |
| *** annegentle has quit IRC | 12:25 | |
| *** lamt has quit IRC | 12:26 | |
| *** mikal has quit IRC | 12:27 | |
| *** zz_dimtruck is now known as dimtruck | 12:29 | |
| *** psachin has quit IRC | 12:29 | |
| *** xingchao has joined #openstack-infra | 12:30 | |
| *** knangia has quit IRC | 12:31 | |
| *** mat128 has quit IRC | 12:32 | |
| *** mikal has joined #openstack-infra | 12:33 | |
| openstackgerrit | Merged openstack-infra/project-config master: don't run tripleo-container-undercloud before Pike https://review.openstack.org/461528 | 12:33 |
| *** mat128 has joined #openstack-infra | 12:34 | |
| *** xingchao has quit IRC | 12:34 | |
| *** ijw has joined #openstack-infra | 12:36 | |
| *** lucas-hungry is now known as lucasagomes | 12:38 | |
| *** tiswanso has quit IRC | 12:38 | |
| *** mikal has quit IRC | 12:38 | |
| *** mikal has joined #openstack-infra | 12:40 | |
| *** xingchao has joined #openstack-infra | 12:41 | |
| *** ijw has quit IRC | 12:42 | |
| *** kgiusti has joined #openstack-infra | 12:42 | |
| *** jascott1 has joined #openstack-infra | 12:42 | |
| *** vikrant has quit IRC | 12:43 | |
| *** rfolco has joined #openstack-infra | 12:43 | |
| *** dimtruck is now known as zz_dimtruck | 12:44 | |
| *** sree has joined #openstack-infra | 12:45 | |
| *** tonytan4ever has joined #openstack-infra | 12:45 | |
| *** b3nt_pin is now known as beagles | 12:46 | |
| *** jascott1 has quit IRC | 12:47 | |
| *** funzo has joined #openstack-infra | 12:47 | |
| *** alexchadin has quit IRC | 12:49 | |
| *** gildub has quit IRC | 12:50 | |
| *** dtantsur is now known as dtantsur|brb | 12:51 | |
| *** wolverineav has joined #openstack-infra | 12:51 | |
| *** funzo has quit IRC | 12:52 | |
| *** gordc has joined #openstack-infra | 12:52 | |
| *** kornicameister has quit IRC | 12:53 | |
| *** winggundamth has quit IRC | 12:58 | |
| *** ociuhandu has joined #openstack-infra | 13:00 | |
| *** yamamoto has joined #openstack-infra | 13:02 | |
| *** trown is now known as trown|brb | 13:04 | |
| *** alexchadin has joined #openstack-infra | 13:04 | |
| *** xingchao has quit IRC | 13:06 | |
| *** gouthamr has joined #openstack-infra | 13:08 | |
| *** xingchao has joined #openstack-infra | 13:09 | |
| openstackgerrit | Merged openstack-infra/project-config master: Use DEVSTACK_PROJECT_FROM_GIT (1/2) https://review.openstack.org/461282 | 13:10 |
| openstackgerrit | Merged openstack-infra/project-config master: Use DEVSTACK_PROJECT_FROM_GIT (2/2) https://review.openstack.org/461284 | 13:11 |
| *** tiswanso has joined #openstack-infra | 13:11 | |
| openstackgerrit | Merged openstack-infra/project-config master: ironic: Cleanup PROJECTS and DEVSTACK_PROJECT_FROM_GIT https://review.openstack.org/461460 | 13:11 |
| *** Julien-zte has quit IRC | 13:11 | |
| *** mdrabe has joined #openstack-infra | 13:12 | |
| *** gouthamr has quit IRC | 13:12 | |
| *** zz_dimtruck is now known as dimtruck | 13:13 | |
| *** chlong has joined #openstack-infra | 13:13 | |
| *** kjackal__ has joined #openstack-infra | 13:14 | |
| *** kjackal_ has quit IRC | 13:14 | |
| *** xingchao has quit IRC | 13:15 | |
| *** dizquierdo has quit IRC | 13:16 | |
| *** eharney has joined #openstack-infra | 13:17 | |
| *** sree has quit IRC | 13:18 | |
| *** links has quit IRC | 13:20 | |
| openstackgerrit | Rosario Di Somma proposed openstack-infra/shade master: Use REST API for volume attach and volume backup calls https://review.openstack.org/461781 | 13:21 |
| *** trown|brb is now known as trown | 13:24 | |
| *** mdrabe_ has joined #openstack-infra | 13:24 | |
| *** mdrabe has quit IRC | 13:24 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove factor use in jenkins-sudo-grep.sh https://review.openstack.org/461697 | 13:24 |
| *** yamamoto has quit IRC | 13:25 | |
| *** yamamoto has joined #openstack-infra | 13:25 | |
| openstackgerrit | Merged openstack-infra/project-config master: Cinder: move rally-dsvm-py35 to experimental https://review.openstack.org/461482 | 13:25 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove stackviz from centos-7 https://review.openstack.org/461478 | 13:26 |
| *** hashar is now known as hasharAway | 13:26 | |
| openstackgerrit | Merged openstack-infra/project-config master: swift: Skip long-running dsvm jobs for unrelated changes https://review.openstack.org/455439 | 13:27 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove system-config instructions https://review.openstack.org/461578 | 13:27 |
| *** askb has quit IRC | 13:27 | |
| openstackgerrit | Merged openstack-infra/project-config master: Retire python-gnocchiclient https://review.openstack.org/459748 | 13:29 |
| *** pblaho has quit IRC | 13:36 | |
| *** ijw has joined #openstack-infra | 13:38 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-infracloud master: Fix puppet-lint job https://review.openstack.org/461785 | 13:38 |
| *** kjackal__ has quit IRC | 13:39 | |
| *** kjackal_ has joined #openstack-infra | 13:40 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-germqtt master: Fix puppet-lint job https://review.openstack.org/461787 | 13:41 |
| *** EricGonczer_ has joined #openstack-infra | 13:42 | |
| *** bh526r has joined #openstack-infra | 13:42 | |
| *** mriedem has joined #openstack-infra | 13:43 | |
| *** ijw has quit IRC | 13:44 | |
| *** flaper87 has joined #openstack-infra | 13:45 | |
| *** priteau has quit IRC | 13:47 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-apps_site master: Fix puppet-lint job https://review.openstack.org/461788 | 13:47 |
| *** openstackgerrit has quit IRC | 13:48 | |
| *** Julien-zte has joined #openstack-infra | 13:49 | |
| *** openstackgerrit has joined #openstack-infra | 13:50 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-germqtt master: Add bindep.txt file https://review.openstack.org/461561 | 13:50 |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-infracloud master: Add bindep.txt file https://review.openstack.org/461571 | 13:51 |
| *** daniel has joined #openstack-infra | 13:54 | |
| *** daniel has quit IRC | 13:55 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-apps_site master: Fix puppet-lint job https://review.openstack.org/461788 | 13:55 |
| *** xingchao has joined #openstack-infra | 13:57 | |
| *** ldnunes has quit IRC | 13:58 | |
| *** gouthamr has joined #openstack-infra | 13:59 | |
| *** thorst is now known as thorst_afk | 13:59 | |
| *** esberglu_ is now known as esberglu | 14:00 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/puppet-apps_site master: Add bindep.txt file https://review.openstack.org/461541 | 14:00 |
| *** xyang1 has joined #openstack-infra | 14:01 | |
| *** xingchao has quit IRC | 14:01 | |
| *** daniel has joined #openstack-infra | 14:02 | |
| *** daniel is now known as Guest47234 | 14:02 | |
| *** Guest47234 is now known as Odd_Bloke | 14:03 | |
| *** Odd_Bloke has quit IRC | 14:03 | |
| *** Odd_Bloke has joined #openstack-infra | 14:03 | |
| *** markvoelker has quit IRC | 14:04 | |
| pabelanger | cmurphy: When you have time: https://review.openstack.org/#/q/topic:puppet-bindep+status:open a few tests are failing still after we converted to puppet gems, but most just worked. Just 1/2 of our modules right now | 14:07 |
| pabelanger | yolanda: ^if you also feel like reviewing | 14:07 |
| *** lamt has joined #openstack-infra | 14:07 | |
| yolanda | pabelanger, ouch! | 14:08 |
| pabelanger | yolanda: should be straightforward reviews, just a mass review | 14:09 |
| *** annegentle has joined #openstack-infra | 14:09 | |
| yolanda | it's the same bindep in all? | 14:09 |
| pabelanger | yes | 14:09 |
| yolanda | ok bot mode :) | 14:09 |
| pabelanger | ya, I would have +3 myself, just wanted some eyes on it | 14:09 |
| fungi | out of curiosity why is it the same one in every repo? | 14:09 |
| cmurphy | all for beaker | 14:10 |
| pabelanger | we have the same ruby dependencies requirements for most of our modules | 14:10 |
| fungi | aha | 14:10 |
| fungi | so for the puppet test jobs | 14:10 |
| pabelanger | and it gave me a quick way to confirm our jobs on modules still worked when we switched to puppet from gem | 14:11 |
| pabelanger | only a few failures, which I've used the puppet-lint topic so far | 14:11 |
| openstackgerrit | Rosario Di Somma proposed openstack-infra/shade master: Use REST API for volume attach and volume backup calls https://review.openstack.org/461781 | 14:11 |
| pabelanger | fungi: also, I have removed my item from the infra meeting today. Since it was merged | 14:11 |
| fungi | thanks! | 14:12 |
| cmurphy | pabelanger: while we're at it can you +w https://review.openstack.org/#/c/461230/ and review https://review.openstack.org/#/c/452558/ ? | 14:13 |
| pabelanger | +3 on 461230 | 14:14 |
| *** dimtruck is now known as zz_dimtruck | 14:14 | |
| cmurphy | pabelanger: https://review.openstack.org/#/c/461549/ doesn't have any jobs, why does it need a bindep.txt? | 14:15 |
| *** eranrom has quit IRC | 14:16 | |
| AJaeger | cmurphy: to execute noops faster? ;) | 14:16 |
| cmurphy | superspeed noops | 14:17 |
| *** tiswanso has quit IRC | 14:17 | |
| *** armax has joined #openstack-infra | 14:18 | |
| openstackgerrit | Merged openstack-infra/puppet-apparmor master: Add bindep.txt file https://review.openstack.org/461540 | 14:19 |
| openstackgerrit | Merged openstack-infra/puppet-asterisk master: Add bindep.txt file https://review.openstack.org/461543 | 14:19 |
| AJaeger | cmurphy: If he might argue for consistency | 14:20 |
| * AJaeger edits again.. | 14:20 | |
| AJaeger | cmurphy: He might argue for consistency... | 14:20 |
| *** pblaho has joined #openstack-infra | 14:20 | |
| *** tiswanso has joined #openstack-infra | 14:20 | |
| *** rossella_s has quit IRC | 14:20 | |
| openstackgerrit | Merged openstack-infra/system-config master: Remove empty single_use_slave class https://review.openstack.org/461230 | 14:20 |
| *** hongbin has joined #openstack-infra | 14:20 | |
| *** tphummel has joined #openstack-infra | 14:21 | |
| *** rbrndt has joined #openstack-infra | 14:21 | |
| *** rossella_s has joined #openstack-infra | 14:21 | |
| *** zz_dimtruck is now known as dimtruck | 14:21 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-bandersnatch master: Add xenial beaker nodeset https://review.openstack.org/461805 | 14:22 |
| openstackgerrit | Merged openstack-infra/puppet-etherpad_lite master: Add bindep.txt file https://review.openstack.org/461558 | 14:22 |
| openstackgerrit | Merged openstack-infra/puppet-bup master: Add bindep.txt file https://review.openstack.org/461546 | 14:22 |
| openstackgerrit | Merged openstack-infra/puppet-askbot master: Add bindep.txt file https://review.openstack.org/461542 | 14:22 |
| openstackgerrit | Merged openstack-infra/puppet-gerritbot master: Add bindep.txt file https://review.openstack.org/461563 | 14:24 |
| openstackgerrit | Merged openstack-infra/puppet-bugdaystats master: Add bindep.txt file https://review.openstack.org/461545 | 14:24 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-gerrit master: Add xenial beaker nodeset https://review.openstack.org/461806 | 14:24 |
| openstackgerrit | Merged openstack-infra/puppet-ethercalc master: Add bindep.txt file https://review.openstack.org/461557 | 14:24 |
| openstackgerrit | Merged openstack-infra/puppet-ipsilon master: Add bindep.txt file https://review.openstack.org/461572 | 14:25 |
| *** arxcruz has quit IRC | 14:26 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-graphite master: Add xenial beaker nodeset https://review.openstack.org/461807 | 14:26 |
| *** dtantsur|brb is now known as dtantsur | 14:27 | |
| dmsimard | mtreinish: what's the link for your mqtt callback PR ? might have found something else | 14:27 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-elasticsearch master: Add xenial beaker nodeset https://review.openstack.org/461808 | 14:28 |
| openstackgerrit | Merged openstack-infra/puppet-iptables master: Add bindep.txt file https://review.openstack.org/461573 | 14:28 |
| EmilienM | pabelanger: not sure we want https://review.openstack.org/461799 tbh, we prefer to manage our deps ourselves | 14:28 |
| dmsimard | nevermind, found it | 14:28 |
| EmilienM | pabelanger: it's a lot of patches that will be required with bindep, we have nearly 40 repos and 3 branches | 14:29 |
| dmsimard | mtreinish: so, I don't know if it's important in your context -- but the current PR doesn't have anything for task items (i.e, when using with_items) | 14:30 |
| *** markvoelker has joined #openstack-infra | 14:30 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-diskimage_builder master: Add xenial beaker nodeset https://review.openstack.org/461809 | 14:30 |
| dmsimard | I don't know if you want to A) emit a message for each task item or 2) take into account the item results when publishing the task result | 14:30 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-accessbot master: Add xenial beaker nodeset https://review.openstack.org/461810 | 14:31 |
| *** arxcruz has joined #openstack-infra | 14:32 | |
| dmsimard | The result._result of a task is almost empty when dealing with a task with loops | 14:32 |
| dmsimard | The real result is nested inside the items' results | 14:32 |
| openstackgerrit | Merged openstack-infra/puppet-featuretracker master: Add bindep.txt file https://review.openstack.org/461560 | 14:32 |
| pabelanger | EmilienM: yes, we are doing that in infra now. We just switched to same test jobs for puppet as puppet / tripleo team. So, trying to see if we can clean up JJB more. However, was also forward thinking to zuulv3, where we should have a bindep task in ansible now, that will read the bindep.txt files and resolve dependencies directly | 14:32 |
| openstackgerrit | Merged openstack-infra/puppet-github master: Add bindep.txt file https://review.openstack.org/461564 | 14:32 |
| openstackgerrit | Merged openstack-infra/puppet-grafyaml master: Add bindep.txt file https://review.openstack.org/461565 | 14:32 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-ansible master: Add xenial beaker nodeset https://review.openstack.org/461811 | 14:33 |
| hongbin | hi, would appreciate review on this patch if any core has a chance: https://review.openstack.org/#/c/461224/ | 14:33 |
| *** salv-orlando has joined #openstack-infra | 14:33 | |
| openstackgerrit | Merged openstack-infra/puppet-hound master: Add bindep.txt file https://review.openstack.org/461569 | 14:34 |
| *** eharney has quit IRC | 14:34 | |
| AJaeger | hongbin: LGTM, +3 | 14:34 |
| hongbin | AJaeger: thx | 14:35 |
| fungi | dmsimard: also mind peeking at https://review.openstack.org/461214 to see if that makes sense in the wake of our discussion over the weekend? | 14:35 |
| openstackgerrit | Merged openstack-infra/puppet-exim master: Add bindep.txt file https://review.openstack.org/461559 | 14:35 |
| pabelanger | EmilienM: basically, we'd like to rework this builder in JJB: http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/macros.yaml#n503 | 14:36 |
| openstackgerrit | Merged openstack-infra/puppet-elastic_recheck master: Add bindep.txt file https://review.openstack.org/461555 | 14:36 |
| cmurphy | pabelanger: interesting failure in puppet-cgit, "Execution of '/usr/bin/yum -d 0 -e 0 -y list cgit' returned 1: Error: No matching Packages to list" | 14:36 |
| cmurphy | was cgit in epel? | 14:36 |
| pabelanger | cmurphy: oh, maybe | 14:37 |
| pabelanger | hmm | 14:37 |
| fungi | i think we can also revisit migrating our git servers to xenial now that we're using it for other production workloads | 14:37 |
| mtreinish | dmsimard: https://github.com/ansible/ansible/pull/23769 is my PR | 14:38 |
| dmsimard | mtreinish: just added a comment on it | 14:38 |
| dmsimard | fungi: looking | 14:38 |
| pabelanger | fungi: Oh, nice. I thought there was something with git that was pinning us to centos | 14:38 |
| bkero | cmurphy: pretty sure it's in epel | 14:38 |
| bkero | pabelanger: ^ | 14:38 |
| mtreinish | dmsimard: hmm, it probably doesn't hurt to add events for task items too | 14:39 |
| openstackgerrit | Merged openstack-infra/puppet-ciwatch master: Add bindep.txt file https://review.openstack.org/461548 | 14:39 |
| openstackgerrit | Merged openstack-infra/puppet-drupal master: Add bindep.txt file https://review.openstack.org/461554 | 14:39 |
| dmsimard | mtreinish: note the strange bug I found and linked | 14:39 |
| pabelanger | bkero: thanks | 14:39 |
| dmsimard | mtreinish: sort of arguing with upstream that it's a real issue, they're on the side that it's a feature (or trade-off) of async processing | 14:40 |
| *** ijw has joined #openstack-infra | 14:40 | |
| pabelanger | guess we need to update beaker job to enable epel there | 14:40 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-cgit master: Add xenial beaker nodeset https://review.openstack.org/461815 | 14:40 |
| openstackgerrit | Merged openstack-infra/puppet-mosquitto master: Disable notice log level messages https://review.openstack.org/461583 | 14:40 |
| *** marst has quit IRC | 14:40 | |
| cmurphy | puppet-httpd is super sad | 14:41 |
| pabelanger | Ya, I quickly looked at it, but haven't dived deeper | 14:41 |
| openstackgerrit | Merged openstack-infra/project-config master: [Kuryr] Add devstack-plugin-contianer to PROJECTS https://review.openstack.org/461224 | 14:42 |
| pabelanger | https://review.openstack.org/#/c/205596/ migrates us away from puppet-http to puppetlabs-apache, but would need to see if jobs still passed | 14:42 |
| *** onovy has quit IRC | 14:42 | |
| *** betherly has quit IRC | 14:42 | |
| *** lcastell has quit IRC | 14:43 | |
| *** gtmanfred has quit IRC | 14:43 | |
| *** jlwhite has quit IRC | 14:43 | |
| *** tnarg has quit IRC | 14:43 | |
| *** Jeffrey4l has quit IRC | 14:43 | |
| *** jpmaxman has quit IRC | 14:43 | |
| *** ameade has quit IRC | 14:43 | |
| *** rackertom has quit IRC | 14:43 | |
| *** NobodyCam has quit IRC | 14:43 | |
| *** auggy has quit IRC | 14:43 | |
| *** robcresswell has quit IRC | 14:43 | |
| *** hughsaunders has quit IRC | 14:43 | |
| mtreinish | dmsimard: hmm, yeah I don't really have a horse in that race. But, I'll take a look at adding the task items when I'm respinning the plugin | 14:43 |
| *** topol has quit IRC | 14:43 | |
| *** stevemar has quit IRC | 14:43 | |
| *** dougshelley66 has quit IRC | 14:43 | |
| *** bh526r has quit IRC | 14:43 | |
| *** jamespage has quit IRC | 14:43 | |
| *** jaranovich_ has quit IRC | 14:43 | |
| *** kozhukalov has quit IRC | 14:43 | |
| *** kiltzman has quit IRC | 14:43 | |
| *** eeiden has quit IRC | 14:43 | |
| *** csatari has quit IRC | 14:44 | |
| *** SamYaple_ has quit IRC | 14:44 | |
| *** madhuvishy has quit IRC | 14:44 | |
| *** dougwig has quit IRC | 14:44 | |
| *** kmARC has quit IRC | 14:44 | |
| *** peterstac has quit IRC | 14:44 | |
| *** abramley has quit IRC | 14:44 | |
| *** pcrews_ has quit IRC | 14:44 | |
| *** SergeyLukjanov has quit IRC | 14:44 | |
| *** hogepodge has quit IRC | 14:44 | |
| *** luzC has quit IRC | 14:44 | |
| *** redrobot has quit IRC | 14:44 | |
| *** SamYaple has joined #openstack-infra | 14:44 | |
| *** dmsimard has quit IRC | 14:44 | |
| *** mat128 has quit IRC | 14:44 | |
| mtreinish | dmsimard: but based on everything I've seen with the ansible internals that attitude from upstream isn't surprising | 14:44 |
| *** zhenguo has quit IRC | 14:45 | |
| *** freerunner has quit IRC | 14:45 | |
| *** slagle_ has quit IRC | 14:45 | |
| *** igorbelikov has quit IRC | 14:45 | |
| *** Shrews has quit IRC | 14:45 | |
| *** honza has quit IRC | 14:45 | |
| *** d34dh0r53 has quit IRC | 14:45 | |
| *** aglarendil has quit IRC | 14:45 | |
| *** raddaoui has quit IRC | 14:45 | |
| *** cargonza has quit IRC | 14:45 | |
| *** flaper87 has quit IRC | 14:45 | |
| *** madhuvishy has joined #openstack-infra | 14:45 | |
| *** jaosorior has quit IRC | 14:45 | |
| *** jlwhite has joined #openstack-infra | 14:45 | |
| *** ijw has quit IRC | 14:45 | |
| *** fmccrthy has quit IRC | 14:45 | |
| *** dham1 has quit IRC | 14:45 | |
| *** Kevin_Zheng has quit IRC | 14:45 | |
| *** rguillebert has quit IRC | 14:45 | |
| *** jmccrory has quit IRC | 14:45 | |
| *** briancurtin has quit IRC | 14:45 | |
| *** andrewbogott has quit IRC | 14:45 | |
| *** pcaruana has quit IRC | 14:45 | |
| *** ggnel_t has joined #openstack-infra | 14:46 | |
| *** kozhukalov has joined #openstack-infra | 14:46 | |
| *** Jeffrey4l has joined #openstack-infra | 14:46 | |
| *** mat128 has joined #openstack-infra | 14:46 | |
| *** eventingmonkey has quit IRC | 14:46 | |
| *** laurelm has quit IRC | 14:46 | |
| *** esberglu has quit IRC | 14:46 | |
| *** dmsimard has joined #openstack-infra | 14:46 | |
| *** ruhe has quit IRC | 14:46 | |
| *** lifeless has quit IRC | 14:47 | |
| *** cloudnull has quit IRC | 14:47 | |
| *** fbouliane has quit IRC | 14:47 | |
| *** SergeyLukjanov has joined #openstack-infra | 14:47 | |
| *** GregHouse has quit IRC | 14:47 | |
| *** petrovich has quit IRC | 14:47 | |
| *** greghaynes has quit IRC | 14:47 | |
| *** ruhe has joined #openstack-infra | 14:47 | |
| *** luzC has joined #openstack-infra | 14:48 | |
| *** aimeeu has quit IRC | 14:48 | |
| *** antonym has quit IRC | 14:48 | |
| *** vgadiraj has quit IRC | 14:48 | |
| *** jaranovich_ has joined #openstack-infra | 14:48 | |
| *** jamesmcarthur has quit IRC | 14:48 | |
| *** funzo has joined #openstack-infra | 14:48 | |
| *** dangers_away has quit IRC | 14:48 | |
| bkero | pabelanger++ for that | 14:48 |
| *** lifeless has joined #openstack-infra | 14:48 | |
| *** fmccrthy has joined #openstack-infra | 14:48 | |
| *** rguillebert has joined #openstack-infra | 14:48 | |
| *** clenimar has quit IRC | 14:48 | |
| *** purp has quit IRC | 14:48 | |
| *** kmARC has joined #openstack-infra | 14:49 | |
| *** lcastell has joined #openstack-infra | 14:49 | |
| *** eharney has joined #openstack-infra | 14:49 | |
| *** kiltzman has joined #openstack-infra | 14:49 | |
| *** cloudnull has joined #openstack-infra | 14:49 | |
| *** onovy has joined #openstack-infra | 14:49 | |
| *** ianychoi has quit IRC | 14:49 | |
| *** gtmanfred has joined #openstack-infra | 14:50 | |
| *** jamesmcarthur has joined #openstack-infra | 14:50 | |
| *** GregHouse has joined #openstack-infra | 14:50 | |
| *** hughsaunders has joined #openstack-infra | 14:50 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config master: Clean up puppetmaster cruft https://review.openstack.org/452558 | 14:50 |
| *** auggy has joined #openstack-infra | 14:50 | |
| *** eranrom has joined #openstack-infra | 14:50 | |
| *** vgadiraj has joined #openstack-infra | 14:50 | |
| *** raddaoui has joined #openstack-infra | 14:50 | |
| *** dangers_away has joined #openstack-infra | 14:50 | |
| *** ianychoi has joined #openstack-infra | 14:50 | |
| *** jmccrory has joined #openstack-infra | 14:51 | |
| *** pcaruana has joined #openstack-infra | 14:51 | |
| *** d34dh0r53 has joined #openstack-infra | 14:51 | |
| *** vryzhenkin has joined #openstack-infra | 14:51 | |
| *** eventingmonkey has joined #openstack-infra | 14:51 | |
| *** csatari has joined #openstack-infra | 14:51 | |
| *** dprince has quit IRC | 14:51 | |
| *** eeiden has joined #openstack-infra | 14:52 | |
| *** dham1 has joined #openstack-infra | 14:52 | |
| *** honza has joined #openstack-infra | 14:52 | |
| *** slagle_ has joined #openstack-infra | 14:52 | |
| *** redrobot has joined #openstack-infra | 14:52 | |
| *** redrobot is now known as Guest92102 | 14:52 | |
| *** honza is now known as Guest93955 | 14:52 | |
| *** esberglu has joined #openstack-infra | 14:52 | |
| *** funzo has quit IRC | 14:53 | |
| *** purp has joined #openstack-infra | 14:53 | |
| *** andrewbogott has joined #openstack-infra | 14:54 | |
| *** dougwig has joined #openstack-infra | 14:54 | |
| *** jpmaxman has joined #openstack-infra | 14:54 | |
| *** Shrews has joined #openstack-infra | 14:54 | |
| *** andrewbogott has quit IRC | 14:54 | |
| *** andrewbogott has joined #openstack-infra | 14:54 | |
| *** fbouliane has joined #openstack-infra | 14:55 | |
| *** pcrews_ has joined #openstack-infra | 14:56 | |
| *** greghaynes has joined #openstack-infra | 14:57 | |
| *** igorbelikov has joined #openstack-infra | 14:57 | |
| *** jamespage has joined #openstack-infra | 14:57 | |
| *** cargonza has joined #openstack-infra | 14:57 | |
| *** xarses_ has joined #openstack-infra | 14:57 | |
| *** clenimar has joined #openstack-infra | 14:57 | |
| *** petrovich has joined #openstack-infra | 14:58 | |
| *** jaosorior has joined #openstack-infra | 14:58 | |
| *** dprince has joined #openstack-infra | 14:58 | |
| *** eroux has joined #openstack-infra | 14:59 | |
| *** Guest93955 is now known as honza____ | 14:59 | |
| *** alexchadin has quit IRC | 14:59 | |
| *** tongli has joined #openstack-infra | 14:59 | |
| *** andreww has joined #openstack-infra | 14:59 | |
| *** ameade has joined #openstack-infra | 15:01 | |
| *** NobodyCam has joined #openstack-infra | 15:01 | |
| *** xarses_ has quit IRC | 15:02 | |
| *** aglarendil has joined #openstack-infra | 15:02 | |
| *** bh526r has joined #openstack-infra | 15:03 | |
| *** abramley has joined #openstack-infra | 15:04 | |
| *** srobert has quit IRC | 15:04 | |
| *** andreas_s has quit IRC | 15:05 | |
| *** hogepodge has joined #openstack-infra | 15:05 | |
| *** krtaylor has joined #openstack-infra | 15:06 | |
| *** aimeeu has joined #openstack-infra | 15:07 | |
| openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci master: Use mixed release for container upgrade https://review.openstack.org/460061 | 15:07 |
| *** betherly has joined #openstack-infra | 15:07 | |
| *** prateek has quit IRC | 15:08 | |
| dtantsur | hi folks! we've broken something around our u-c handling, and we end with http://logs.openstack.org/25/440125/5/check/gate-virtualbmc-docs-ubuntu-xenial/72593a4/console.html.gz#_2017-04-28_09_10_09_787256 | 15:09 |
| dtantsur | do you have any quick ideas on where to look for a fix? | 15:09 |
| *** xingchao has joined #openstack-infra | 15:11 | |
| *** Rockyg has joined #openstack-infra | 15:11 | |
| *** flaper87 has joined #openstack-infra | 15:12 | |
| fungi | dtantsur: generally if your job is going to install a constrained library from source then it needs a call to edit-constraints to remove that entry. i think other projects may be doing something with an install wrapper called from tox.ini? i'd look into oslo libs for a common example | 15:13 |
| fungi | it's possible the source in those situations is installed after (test-)requirements without the -c option to pip | 15:13 |
| *** chlong has quit IRC | 15:13 | |
| hongbin | hi all | 15:14 |
| hongbin | it looks the gate convert to systemd | 15:14 |
| fungi | dtantsur: wondering if it broke on you once virtualbmc ended up in the constraints list | 15:14 |
| hongbin | i wonder where to find the logs in the gate after switching to systemd | 15:14 |
| *** tonytan_brb has joined #openstack-infra | 15:14 | |
| *** jamesmca_ has joined #openstack-infra | 15:15 | |
| *** antonym has joined #openstack-infra | 15:15 | |
| fungi | hongbin: devstack did, and i think some additional troubleshooting/workflow documentation was added to devstack's readme as well. there was a thread on the ml but asking in #openstack-qa might also be on more on topic since this is devstack-specific | 15:15 |
| *** xingchao has quit IRC | 15:15 | |
| clarkb | and a bit of work was done to make it "backward compatible" for logstash | 15:15 |
| dtantsur | fungi, that tox_install.sh thing, yeah. trying to cargo-cult it to virtualbmc now | 15:15 |
| clarkb | so the logs should be where they always have been | 15:16 |
| fungi | hongbin: http://lists.openstack.org/pipermail/openstack-dev/2017-May/116188.html | 15:16 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Clone zuul from git.openstack.org for zuul-env https://review.openstack.org/461525 | 15:16 |
| clarkb | additionally we are collecting journal files which you can download locally and interact with using journalctl | 15:16 |
| *** tonytan4ever has quit IRC | 15:17 | |
| hongbin | fungi: the problem in our side is all the screen-* logs are gone in the gate, as a result, i am not able to debug it further | 15:18 |
| hongbin | however, i can ask the #openstack-qa for that | 15:18 |
| fungi | yeah, i mean we know a fair amount about devstack, but it's a qa project not infra | 15:18 |
| fungi | (also a lot of the qa devs hang out in here and vice versa) | 15:19 |
| *** sree has joined #openstack-infra | 15:20 | |
| *** inc0 has quit IRC | 15:22 | |
| *** inc0 has joined #openstack-infra | 15:22 | |
| *** annegentle has quit IRC | 15:22 | |
| *** mdrabe_ has quit IRC | 15:22 | |
| clarkb | hongbin: are you using a plugin? and is it possible that plugin does not use the helper functions in devstack to run the service(s)? | 15:23 |
| clarkb | as long as you use the run service helper fucntion it should be all automagic. | 15:23 |
| *** Julien-zte has quit IRC | 15:24 | |
| hongbin | clarkb: what "helper functions" in particular , like run_process ? | 15:24 |
| clarkb | hongbin: ya | 15:24 |
| hongbin | yes, i am using plugin | 15:24 |
| *** Julien-zte has joined #openstack-infra | 15:24 | |
| hongbin | ok, i can look into it | 15:25 |
| mtreinish | fungi: so I tried playing with mqtt-bench late last night and it doesn't work. It depends on a very early version of the paho go library | 15:25 |
| *** sree has quit IRC | 15:25 | |
| mtreinish | I'll try to find the time to teach myself go and fix it | 15:26 |
| clarkb | hongbin: http://logs.openstack.org/51/461651/1/check/gate-dsvm-nodepool/5477c7e/logs/screen-nodepool.txt.gz uses run_process in a devstack plugin and it got journald logging automagically at the old filename | 15:26 |
| clarkb | for example | 15:26 |
| clarkb | dtantsur: fungi ya the problem is that constraints says use virtualbmc==1.1.0 but the pip install is using file:///path/to/virtualbmc and it can't resolve those two things. So the workaround is to edit the constraints | 15:27 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: support github pull request labels https://review.openstack.org/444511 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Allow github trigger to match on branches/refs https://review.openstack.org/445625 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Add cachecontrol to requests to github https://review.openstack.org/461587 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Set filter according to PR/Change in URL https://review.openstack.org/446782 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Add support for requiring github pr head status https://review.openstack.org/449390 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Support for dependent pipelines with github https://review.openstack.org/445292 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Adds github triggering from status updates https://review.openstack.org/453844 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Implement pipeline requirement on github reviews https://review.openstack.org/453845 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Add basic Github Zuul Reporter. https://review.openstack.org/443323 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Configurable SSH access to GitHub https://review.openstack.org/444034 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Represent github change ID in status page by PR number https://review.openstack.org/460716 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Add 'push' and 'tag' github webhook events. https://review.openstack.org/443947 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Add 'pr-comment' github webhook event https://review.openstack.org/443959 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Support for github commit status https://review.openstack.org/444060 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Better merge message for GitHub pull reqeusts https://review.openstack.org/445644 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Test gerrit and github drivers in same tenant https://review.openstack.org/448257 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Encapsulate determining the event purpose https://review.openstack.org/445242 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Merge pull requests from github reporter https://review.openstack.org/444463 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Include exc_info in reporter failure https://review.openstack.org/460765 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Add support for github enterprise https://review.openstack.org/449258 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Support GitHub PR webhooks https://review.openstack.org/439834 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: GitHub file matching support https://review.openstack.org/446113 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Ensure PRs arent rejected for stale negative reviews https://review.openstack.org/460700 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Add trigger capability on github pr review https://review.openstack.org/449365 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Log GitHub API rate limit https://review.openstack.org/446150 | 15:28 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Comment on PRs if a remote call to merge a change failed https://review.openstack.org/460762 | 15:28 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-ansible master: Fix beaker on xenial https://review.openstack.org/461811 | 15:29 |
| *** GnomeKing has joined #openstack-infra | 15:29 | |
| *** chlong has joined #openstack-infra | 15:30 | |
| *** xingchao has joined #openstack-infra | 15:31 | |
| *** pblaho has quit IRC | 15:32 | |
| rm_work | hey, I need to edit our project-config jobs to omit a thing on certain stable branches | 15:33 |
| rm_work | what var should I be checking? is $BRANCH_OVERRIDE going to contain the branch for the test, or is that for zuul? | 15:33 |
| rm_work | Like, I need to catch "stable/newton" and do something | 15:33 |
| clarkb | rm_work: meaning not run a service or disable a feature? | 15:33 |
| rm_work | not add the "DEVSTACK_PROJECT_FROM_GIT" for the client | 15:34 |
| rm_work | for our old stable branches (specifically newton and ocata) | 15:34 |
| AJaeger | rm_work: depending on the job, you might also just say: Let this job run only on pike and newer. | 15:35 |
| AJaeger | rm_work: you set branch_override, so should not check it. | 15:35 |
| rm_work | ah, i think that'd be a little bothersome | 15:35 |
| rm_work | right now it's on all jobs | 15:35 |
| rm_work | we don't have separate definitions for stable vs master | 15:35 |
| AJaeger | rm_work: check ZUUL_BRANCH | 15:35 |
| *** baoli has joined #openstack-infra | 15:35 | |
| rm_work | ah, $ZUUL_BRANCH will look like... | 15:36 |
| clarkb | right so there are two things in play here. The first is ZUUL_BRANCH which is the branch in gerrit that the change was proposed against | 15:36 |
| rm_work | "stable/ocata" or "master"? | 15:36 |
| rm_work | ok | 15:36 |
| rm_work | yeah i think that's what we want | 15:36 |
| rm_work | if the change was proposed against stable/ocata we need to know that | 15:36 |
| *** mdrabe_ has joined #openstack-infra | 15:36 | |
| clarkb | the second is the BRANCH_OVERRIDE which is a way of telling devstack-gate "I don't care what ZUUL_BRANCH is, give me a cloud from this branch instead" | 15:36 |
| AJaeger | do a negative check: Handle old branches - you don#t want to add a check for queens, rocky etc | 15:36 |
| rm_work | right | 15:36 |
| rm_work | err | 15:37 |
| rm_work | rather | 15:37 |
| rm_work | i'm going to *omit* this thing, only if it's stable/newton or stable/ocata | 15:37 |
| rm_work | that way we'll get it for pike+ | 15:37 |
| rm_work | and eventually can remove the check | 15:37 |
| *** tphummel has quit IRC | 15:38 | |
| fungi | BRANCH_OVERRIDE is what tends to get used for backward-compat jobs (test my latest novaclient patch targeting master against a stable/newton devstack deployment please) or in periodic bitrot jobs (where there is no change being tested, so zuul has no branch context to provide) | 15:38 |
| *** amotoki has joined #openstack-infra | 15:40 | |
| *** xingchao has quit IRC | 15:41 | |
| *** ijw has joined #openstack-infra | 15:41 | |
| *** srobert has joined #openstack-infra | 15:41 | |
| openstackgerrit | Merged openstack/gertty master: Allow negative comparison on null topics https://review.openstack.org/447148 | 15:42 |
| jeblair | when we port this stuff to ansible, we should see if we can't use better names than "fallback_branch_extra_double_override_project" :) | 15:43 |
| *** ijw has quit IRC | 15:47 | |
| *** markvoelker has quit IRC | 15:47 | |
| *** portdirect has quit IRC | 15:47 | |
| *** portdirect has joined #openstack-infra | 15:48 | |
| openstackgerrit | Adam Harwell proposed openstack-infra/project-config master: Don't install octaviaclient on newton or ocata branches https://review.openstack.org/461830 | 15:48 |
| rm_work | well... | 15:48 |
| *** tnarg has joined #openstack-infra | 15:48 | |
| rm_work | fungi / clarkb / AJaeger ^^ that is what I went with | 15:48 |
| rm_work | I think it should be fine? | 15:48 |
| rm_work | eventually it'll stop being relevant and the check can be removed | 15:49 |
| *** peterstac has joined #openstack-infra | 15:49 | |
| clarkb | yes, that will install the client from pypi on those branches if pulled in at all | 15:49 |
| *** stevemar has joined #openstack-infra | 15:50 | |
| fungi | animal_house_double_secret_probation_branch | 15:50 |
| rm_work | it shouldn't install the client *at all* on those branches | 15:50 |
| *** dougshelley66 has joined #openstack-infra | 15:50 | |
| rm_work | as the PROJECT line is removed as well | 15:50 |
| *** honza____ is now known as honza | 15:51 | |
| rm_work | err, rather because it's not added | 15:51 |
| *** rderose has joined #openstack-infra | 15:51 | |
| *** salv-orl_ has joined #openstack-infra | 15:52 | |
| *** vryzhenkin is now known as freerunner | 15:52 | |
| *** markvoelker has joined #openstack-infra | 15:53 | |
| *** markus_z has quit IRC | 15:54 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Added compresion to cache middleware https://review.openstack.org/461833 | 15:54 |
| *** salv-orlando has quit IRC | 15:54 | |
| clarkb | rm_work: it may install the client from pypi | 15:54 |
| clarkb | if something depends on it for example | 15:55 |
| rm_work | oh, well sure | 15:55 |
| *** laurelm has joined #openstack-infra | 15:55 | |
| clarkb | what it will not do is install it from source | 15:55 |
| rm_work | yeah that's fine | 15:55 |
| rm_work | we don't actually use the client... | 15:55 |
| *** hamzy has quit IRC | 15:55 | |
| rm_work | yet, at least | 15:57 |
| *** dizquierdo has joined #openstack-infra | 15:58 | |
| *** annegentle has joined #openstack-infra | 15:58 | |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Added compresion to cache middleware https://review.openstack.org/461833 | 15:59 |
| *** tesseract-RH has quit IRC | 16:01 | |
| openstackgerrit | Lucas Alvares Gomes proposed openstack-infra/project-config master: Make rally job non-voting for networking-ovn https://review.openstack.org/461835 | 16:01 |
| *** pcaruana has quit IRC | 16:02 | |
| *** jascott1 has joined #openstack-infra | 16:03 | |
| mmedvede | pabelanger: I saw you mentioned during yesterday's third-party-ci meeting that it would be nice to check if third-party operators can stil build their images after the puppet/ruby removal | 16:03 |
| *** pblaho has joined #openstack-infra | 16:03 | |
| mmedvede | pabelanger: I can confirm that I can build mine. We were not directly depending on infra project-config, so the changes there did not break our build. I guess other operator's setups might differ | 16:04 |
| *** chlong has quit IRC | 16:04 | |
| pabelanger | mmedvede: thank for the info | 16:05 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Added summit listing to cache https://review.openstack.org/461838 | 16:06 |
| *** Apoorva has joined #openstack-infra | 16:06 | |
| *** rderose_ has joined #openstack-infra | 16:09 | |
| *** csomerville has quit IRC | 16:11 | |
| *** cody-somerville has joined #openstack-infra | 16:11 | |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Added summit listing to cache https://review.openstack.org/461838 | 16:12 |
| *** rderose has quit IRC | 16:12 | |
| *** Hal has quit IRC | 16:13 | |
| *** trown is now known as trown|lunch | 16:14 | |
| *** amotoki has quit IRC | 16:21 | |
| *** csomerville has joined #openstack-infra | 16:23 | |
| openstackgerrit | Merged openstack-infra/project-config master: Don't install octaviaclient on newton or ocata branches https://review.openstack.org/461830 | 16:23 |
| *** ykarel has quit IRC | 16:23 | |
| *** cody-somerville has quit IRC | 16:26 | |
| pabelanger | infra-root: Is anybody able to see the Create PPA button under VHD util section: https://launchpad.net/~openstack-ci-core I am guess only mordred can | 16:28 |
| openstackgerrit | Merged openstack-infra/nodepool master: Use full path to socat in devstack plugin https://review.openstack.org/461651 | 16:28 |
| clarkb | pabelanger: I think any member of the owner group can | 16:29 |
| clarkb | (I see the button) | 16:29 |
| pabelanger | Odd, I cannot see it | 16:29 |
| clarkb | pabelanger: you aren't in openstack administrators. I wonder why that group isn't self owned | 16:29 |
| fungi | pabelanger: the "create a new ppa" link at https://launchpad.net/~openstack-ci-core ? | 16:29 |
| pabelanger | fungi: right, I cannot see that. Maybe I am lacking permissions | 16:30 |
| clarkb | can we make openstack-ci-core own openstack-ci-core? | 16:30 |
| pabelanger | clarkb: k, let me join | 16:30 |
| fungi | oh, maybe it's members of https://launchpad.net/~openstack-admins | 16:30 |
| fungi | yeah | 16:30 |
| pabelanger | I think I need to be invited | 16:30 |
| pabelanger | I don't see a join team button for that too | 16:31 |
| fungi | the openstack-admins group isn't specifically an infra team thing | 16:32 |
| pabelanger | ah | 16:32 |
| clarkb | fungi: right thats why I'm wondering if we can chagne ownership over ci group | 16:32 |
| fungi | and normally it's set as the owner of official openstack teams on lp | 16:32 |
| clarkb | also | 16:32 |
| clarkb | I can't change membership in admins group | 16:32 |
| clarkb | I think only jeblair can | 16:32 |
| *** aspiers has joined #openstack-infra | 16:32 | |
| fungi | regardless, i find it odd that ppa creation is limited to group owners | 16:32 |
| fungi | and not a separate permission that i can find | 16:33 |
| fungi | for now, maybe it's easier if i just fill in the 3 fields needed to create the new ppa | 16:34 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool feature/zuulv3: Use full path to socat in devstack plugin https://review.openstack.org/461846 | 16:34 |
| fungi | pabelanger: what did we want to name it and what's a good short description? | 16:34 |
| pabelanger | clarkb: fungi: could either one of you create the bublewrap PPA, setup to also use backports for builds | 16:34 |
| pabelanger | bubblewrap should be okay for name | 16:34 |
| pabelanger | description: Unprivileged sandboxing tool ? | 16:35 |
| *** spotz_ is now known as spotz | 16:35 | |
| fungi | pabelanger: https://launchpad.net/~openstack-ci-core/+archive/ubuntu/bubblewrap | 16:37 |
| *** tie has quit IRC | 16:38 | |
| pabelanger | fungi: danke! | 16:38 |
| *** eharney has quit IRC | 16:38 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Updated email log level https://review.openstack.org/461847 | 16:40 |
| *** dtantsur is now known as dtantsur|afk | 16:41 | |
| *** rderose_ has quit IRC | 16:41 | |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Updated email log level https://review.openstack.org/461847 | 16:41 |
| *** rackertom has joined #openstack-infra | 16:42 | |
| *** robcresswell has joined #openstack-infra | 16:43 | |
| *** rderose_ has joined #openstack-infra | 16:43 | |
| *** Kevin_Zheng has joined #openstack-infra | 16:44 | |
| *** zhenguo has joined #openstack-infra | 16:44 | |
| *** salv-orl_ has quit IRC | 16:45 | |
| *** funzo has joined #openstack-infra | 16:46 | |
| *** briancurtin has joined #openstack-infra | 16:46 | |
| *** rderose_ has quit IRC | 16:49 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: [WIP] Add bubblewrap to bindep / test-setup.sh https://review.openstack.org/461849 | 16:49 |
| *** funzo has quit IRC | 16:50 | |
| *** dimtruck is now known as zz_dimtruck | 16:50 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config master: Disable EPEL after running Bindep for OSA jobs https://review.openstack.org/461851 | 16:50 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Added missing compression to summit json generator task. https://review.openstack.org/461852 | 16:53 |
| *** yamahata has joined #openstack-infra | 16:56 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: [WIP] Add bubblewrap to bindep / test-setup.sh https://review.openstack.org/461849 | 16:57 |
| *** tongli has quit IRC | 16:58 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config master: Disable EPEL after running Bindep for OSA jobs https://review.openstack.org/461851 | 16:58 |
| dmsimard | pabelanger: good point thanks | 16:58 |
| *** tphummel has joined #openstack-infra | 16:59 | |
| *** derekh has quit IRC | 17:01 | |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Added missing compression to summit json generator task. https://review.openstack.org/461852 | 17:01 |
| *** harlowja has quit IRC | 17:04 | |
| *** eharney has joined #openstack-infra | 17:04 | |
| *** tojuvone has quit IRC | 17:07 | |
| *** gyee has joined #openstack-infra | 17:09 | |
| *** topol_ has joined #openstack-infra | 17:09 | |
| *** e0ne has joined #openstack-infra | 17:09 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add bubblewrap to bindep / test-setup.sh https://review.openstack.org/461849 | 17:10 |
| openstackgerrit | Mike Perez proposed openstack-infra/shade master: Removing unsed fake methods and classes https://review.openstack.org/461854 | 17:11 |
| *** erlon has joined #openstack-infra | 17:11 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Added more log info on cache middleware https://review.openstack.org/461855 | 17:13 |
| *** felipemonteiro_ has joined #openstack-infra | 17:13 | |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Added more log info on cache middleware https://review.openstack.org/461855 | 17:13 |
| *** eroux has quit IRC | 17:14 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add support for bwrap https://review.openstack.org/453851 | 17:14 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add bubblewrap to bindep / test-setup.sh https://review.openstack.org/461849 | 17:14 |
| *** Rockyg has quit IRC | 17:15 | |
| *** e0ne has quit IRC | 17:15 | |
| *** felipemonteiro has quit IRC | 17:16 | |
| *** ldnunes has joined #openstack-infra | 17:16 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-cgit master: Fix beaker on xenial https://review.openstack.org/461815 | 17:19 |
| *** ijw has joined #openstack-infra | 17:19 | |
| *** tojuvone has joined #openstack-infra | 17:19 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-accessbot master: Fix beaker on xenial https://review.openstack.org/461810 | 17:22 |
| *** trown|lunch is now known as trown | 17:22 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-cgit master: Fix beaker on xenial https://review.openstack.org/461815 | 17:22 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-ansible master: Fix beaker on xenial https://review.openstack.org/461811 | 17:23 |
| *** ijw has quit IRC | 17:24 | |
| *** eranrom has quit IRC | 17:25 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-bandersnatch master: Fix beaker on xenial https://review.openstack.org/461805 | 17:25 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-diskimage_builder master: Fix beaker on xenial https://review.openstack.org/461809 | 17:27 |
| *** jascott1 has quit IRC | 17:28 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-elasticsearch master: Fix beaker on xenial https://review.openstack.org/461808 | 17:28 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-graphite master: Fix beaker on xenial https://review.openstack.org/461807 | 17:29 |
| *** knangia has joined #openstack-infra | 17:31 | |
| *** ramishra has quit IRC | 17:32 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-gerrit master: Fix beaker on xenial https://review.openstack.org/461806 | 17:32 |
| *** xingchao has joined #openstack-infra | 17:38 | |
| *** tosky has quit IRC | 17:38 | |
| *** dhinesh has joined #openstack-infra | 17:42 | |
| *** hamzy has joined #openstack-infra | 17:42 | |
| *** xingchao has quit IRC | 17:43 | |
| *** wolverineav has quit IRC | 17:43 | |
| *** wolverineav has joined #openstack-infra | 17:43 | |
| *** zz_dimtruck is now known as dimtruck | 17:47 | |
| *** salv-orlando has joined #openstack-infra | 17:51 | |
| *** jamesmca_ has quit IRC | 17:54 | |
| *** Goneri has joined #openstack-infra | 17:54 | |
| *** ijw has joined #openstack-infra | 17:56 | |
| *** rbrndt has quit IRC | 17:56 | |
| openstackgerrit | Kendall Nelson proposed openstack-infra/storyboard master: Handle Branches from Launchpad in Migration https://review.openstack.org/437469 | 17:57 |
| openstackgerrit | Merged openstack-infra/puppet-bandersnatch master: Add bindep.txt file https://review.openstack.org/461544 | 17:58 |
| openstackgerrit | Merged openstack-infra/puppet-ansible master: Add bindep.txt file https://review.openstack.org/461580 | 17:59 |
| *** bh526r has quit IRC | 17:59 | |
| *** rossella_s has quit IRC | 17:59 | |
| *** baoli has quit IRC | 18:00 | |
| *** ijw has quit IRC | 18:00 | |
| *** harlowja has joined #openstack-infra | 18:00 | |
| *** eranrom has joined #openstack-infra | 18:01 | |
| *** baoli has joined #openstack-infra | 18:01 | |
| *** jamesmca_ has joined #openstack-infra | 18:01 | |
| *** lucasagomes is now known as lucas-afk | 18:02 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: Deploy FreeIPA-backed LDAP domain for keystone in fakeha-caserver job https://review.openstack.org/461864 | 18:03 |
| *** chlong has joined #openstack-infra | 18:03 | |
| *** rbrndt has joined #openstack-infra | 18:05 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE: Testing LDAP integration https://review.openstack.org/461865 | 18:06 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE: Testing LDAP integration https://review.openstack.org/461865 | 18:08 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: Deploy FreeIPA-backed LDAP domain for keystone in fakeha-caserver job https://review.openstack.org/461864 | 18:08 |
| *** pvaneck has joined #openstack-infra | 18:09 | |
| *** Sukhdev has joined #openstack-infra | 18:12 | |
| *** csomerville has quit IRC | 18:13 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/project-config master: Remove the tempest layer4 job https://review.openstack.org/461867 | 18:13 |
| *** dprince has quit IRC | 18:16 | |
| *** jascott1 has joined #openstack-infra | 18:20 | |
| *** jamielennox is now known as jamielennox|away | 18:22 | |
| *** Sukhdev has quit IRC | 18:25 | |
| *** kjackal_ has quit IRC | 18:25 | |
| *** electrofelix has quit IRC | 18:27 | |
| *** jascott1 has quit IRC | 18:28 | |
| *** jascott1 has joined #openstack-infra | 18:28 | |
| *** felipemonteiro_ has quit IRC | 18:29 | |
| *** Sukhdev has joined #openstack-infra | 18:30 | |
| *** baoli has quit IRC | 18:31 | |
| *** baoli has joined #openstack-infra | 18:31 | |
| *** krtaylor has quit IRC | 18:32 | |
| *** rderose has joined #openstack-infra | 18:38 | |
| *** xingchao has joined #openstack-infra | 18:39 | |
| *** csomerville has joined #openstack-infra | 18:43 | |
| *** xingchao has quit IRC | 18:43 | |
| *** csomerville has quit IRC | 18:43 | |
| *** csomerville has joined #openstack-infra | 18:44 | |
| *** andreas-f has quit IRC | 18:46 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/infra-specs master: Goodbye Git Namespaces https://review.openstack.org/461878 | 18:46 |
| *** dprince has joined #openstack-infra | 18:47 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add untrusted-projects ansible test https://review.openstack.org/461881 | 18:52 |
| *** tonytan4ever has joined #openstack-infra | 18:54 | |
| *** csomerville has quit IRC | 18:54 | |
| *** tonytan_brb has quit IRC | 18:56 | |
| *** gyee has quit IRC | 18:56 | |
| *** hasharAway has quit IRC | 18:58 | |
| *** cody-somerville has joined #openstack-infra | 18:58 | |
| *** hashar has joined #openstack-infra | 18:58 | |
| *** dimtruck is now known as zz_dimtruck | 18:59 | |
| *** jaosorior is now known as jaosorior_away | 19:00 | |
| fungi | it's that (weekly infra team meeting) time again! find us in #openstack-meeting for the next hour | 19:00 |
| *** rderose_ has joined #openstack-infra | 19:01 | |
| *** zz_dimtruck is now known as dimtruck | 19:01 | |
| *** sree has joined #openstack-infra | 19:02 | |
| *** rderose has quit IRC | 19:04 | |
| *** e0ne has joined #openstack-infra | 19:05 | |
| *** salv-orlando has quit IRC | 19:05 | |
| *** yamahata has quit IRC | 19:07 | |
| *** sree has quit IRC | 19:07 | |
| *** ldnunes_ has joined #openstack-infra | 19:07 | |
| *** ldnunes has quit IRC | 19:08 | |
| *** ianychoi_ has joined #openstack-infra | 19:10 | |
| *** Goneri has quit IRC | 19:11 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate master: Collect lvmdump info in logs https://review.openstack.org/461883 | 19:11 |
| openstackgerrit | Merged openstack-infra/nodepool feature/zuulv3: Use full path to socat in devstack plugin https://review.openstack.org/461846 | 19:12 |
| *** ianychoi has quit IRC | 19:13 | |
| *** neiljerram has quit IRC | 19:15 | |
| openstackgerrit | Marton Kiss proposed openstack-infra/system-config master: Add Russian language to ask-staging.o.o https://review.openstack.org/461885 | 19:16 |
| *** neiljerram has joined #openstack-infra | 19:17 | |
| *** Apoorva has quit IRC | 19:17 | |
| *** tiswanso has quit IRC | 19:18 | |
| *** ijw has joined #openstack-infra | 19:18 | |
| *** tiswanso has joined #openstack-infra | 19:18 | |
| openstackgerrit | Sean McGinnis proposed openstack-infra/project-config master: Bump grenade job filter to >= ocata https://review.openstack.org/461886 | 19:19 |
| *** ianychoi_ is now known as ianychoi | 19:19 | |
| *** annegentle has quit IRC | 19:20 | |
| *** jamesdenton has joined #openstack-infra | 19:20 | |
| *** tiswanso has quit IRC | 19:22 | |
| *** xarses_ has joined #openstack-infra | 19:23 | |
| *** xarses_ has quit IRC | 19:23 | |
| *** xarses_ has joined #openstack-infra | 19:23 | |
| *** andreww has quit IRC | 19:25 | |
| *** eharney has quit IRC | 19:27 | |
| *** andreas-f has joined #openstack-infra | 19:29 | |
| *** armax has quit IRC | 19:30 | |
| *** rlandy is now known as rlandy|brb | 19:32 | |
| *** rockyg has joined #openstack-infra | 19:36 | |
| *** marst has joined #openstack-infra | 19:39 | |
| *** tiswanso has joined #openstack-infra | 19:40 | |
| *** xingchao has joined #openstack-infra | 19:40 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: DNM - deploy tripleo with all debug https://review.openstack.org/457037 | 19:40 |
| *** eharney has joined #openstack-infra | 19:41 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient master: Upgrade node in tox.ini to newest LTS (6.10.2) https://review.openstack.org/455788 | 19:41 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck master: Add query for novnc bug 1669468 https://review.openstack.org/461891 | 19:43 |
| openstack | bug 1669468 in OpenStack Compute (nova) "tempest.api.compute.servers.test_novnc.NoVNCConsoleTestJSON.test_novnc fails intermittently in neutron multinode nv job" [Medium,Confirmed] https://launchpad.net/bugs/1669468 | 19:43 |
| *** xingchao has quit IRC | 19:44 | |
| *** kencjohnston has joined #openstack-infra | 19:45 | |
| *** mhickey has joined #openstack-infra | 19:45 | |
| *** markvoelker has quit IRC | 19:50 | |
| *** trown is now known as trown|brb | 19:51 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck master: Add query for novnc bug 1669468 https://review.openstack.org/461891 | 19:52 |
| openstack | bug 1669468 in OpenStack Compute (nova) "tempest.api.compute.servers.test_novnc.NoVNCConsoleTestJSON.test_novnc fails intermittently in neutron multinode nv job" [Medium,Confirmed] https://launchpad.net/bugs/1669468 | 19:52 |
| *** cody-somerville has quit IRC | 19:52 | |
| openstackgerrit | Merged openstack-infra/shade master: Removing unsed fake methods and classes https://review.openstack.org/461854 | 19:54 |
| *** salv-orlando has joined #openstack-infra | 19:57 | |
| *** yamahata has joined #openstack-infra | 19:58 | |
| *** xarses_ has quit IRC | 19:58 | |
| *** rlandy|brb is now known as rlandy | 19:59 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Collect test-results for tox jobs https://review.openstack.org/452991 | 20:01 |
| *** xarses_ has joined #openstack-infra | 20:02 | |
| *** ociuhandu has quit IRC | 20:02 | |
| *** srobert_ has joined #openstack-infra | 20:03 | |
| *** andreww has joined #openstack-infra | 20:03 | |
| *** gyee has joined #openstack-infra | 20:04 | |
| *** rockyg has quit IRC | 20:04 | |
| *** srobert has quit IRC | 20:06 | |
| *** xarses_ has quit IRC | 20:06 | |
| *** srobert_ has quit IRC | 20:08 | |
| *** trown|brb is now known as trown | 20:10 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Collect test-results for tox jobs https://review.openstack.org/452991 | 20:11 |
| *** EricGonczer_ has quit IRC | 20:12 | |
| *** krtaylor has joined #openstack-infra | 20:13 | |
| *** gouthamr has quit IRC | 20:13 | |
| *** cody-somerville has joined #openstack-infra | 20:16 | |
| *** Apoorva has joined #openstack-infra | 20:18 | |
| *** ociuhandu has joined #openstack-infra | 20:19 | |
| *** annegentle has joined #openstack-infra | 20:19 | |
| *** eranrom has quit IRC | 20:20 | |
| *** ociuhandu has quit IRC | 20:21 | |
| *** jkilpatr has quit IRC | 20:22 | |
| *** Apoorva has quit IRC | 20:22 | |
| *** ociuhandu has joined #openstack-infra | 20:23 | |
| *** kjackal_ has joined #openstack-infra | 20:24 | |
| *** puiterwijk has quit IRC | 20:25 | |
| *** puiterwijk has joined #openstack-infra | 20:25 | |
| *** puiterwijk has joined #openstack-infra | 20:25 | |
| *** srobert has joined #openstack-infra | 20:26 | |
| *** afazekas is now known as fazekas|pto | 20:27 | |
| *** fazekas|pto is now known as afazekas|pto | 20:27 | |
| *** cody-somerville has quit IRC | 20:28 | |
| *** afred312 has joined #openstack-infra | 20:28 | |
| *** ijw has quit IRC | 20:28 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Create openstack-zuul-jobs project https://review.openstack.org/461897 | 20:28 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Create openstack-zuul-jobs / openstack-zuul-roles projects https://review.openstack.org/461897 | 20:31 |
| *** kgiusti has left #openstack-infra | 20:32 | |
| *** markvoelker has joined #openstack-infra | 20:32 | |
| *** Apoorva has joined #openstack-infra | 20:32 | |
| *** markvoelker has quit IRC | 20:33 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Create openstack-zuul-jobs / openstack-zuul-roles projects https://review.openstack.org/461897 | 20:33 |
| *** markvoelker has joined #openstack-infra | 20:34 | |
| *** Apoorva_ has joined #openstack-infra | 20:34 | |
| pabelanger | neat, zuul -1'd that^ | 20:35 |
| *** jamesmca_ has quit IRC | 20:36 | |
| *** ijw has joined #openstack-infra | 20:36 | |
| *** ijw has quit IRC | 20:36 | |
| *** ijw has joined #openstack-infra | 20:37 | |
| *** cody-somerville has joined #openstack-infra | 20:37 | |
| *** Apoorva has quit IRC | 20:38 | |
| *** jamesmca_ has joined #openstack-infra | 20:39 | |
| *** srobert has quit IRC | 20:40 | |
| *** srobert has joined #openstack-infra | 20:40 | |
| *** xingchao has joined #openstack-infra | 20:40 | |
| *** ijw has quit IRC | 20:41 | |
| openstackgerrit | Slawek Kaplonski proposed openstack-infra/shade master: Don't get ports info from unavailable neutron service https://review.openstack.org/461903 | 20:42 |
| *** srobert has quit IRC | 20:43 | |
| *** dprince has quit IRC | 20:44 | |
| *** srobert has joined #openstack-infra | 20:44 | |
| *** xingchao has quit IRC | 20:45 | |
| *** xarses_ has joined #openstack-infra | 20:45 | |
| *** mat128 has quit IRC | 20:45 | |
| *** ijw has joined #openstack-infra | 20:46 | |
| *** e0ne has quit IRC | 20:46 | |
| *** ijw has quit IRC | 20:46 | |
| *** ijw has joined #openstack-infra | 20:46 | |
| *** annegentle has quit IRC | 20:47 | |
| openstackgerrit | Slawek Kaplonski proposed openstack-infra/shade master: Replace neutronclient with REST API calls in ports commands https://review.openstack.org/461357 | 20:47 |
| *** funzo has joined #openstack-infra | 20:47 | |
| *** armax has joined #openstack-infra | 20:49 | |
| *** andreww has quit IRC | 20:49 | |
| *** xarses_ has quit IRC | 20:50 | |
| *** xarses_ has joined #openstack-infra | 20:50 | |
| *** funzo has quit IRC | 20:52 | |
| *** Sukhdev has quit IRC | 20:52 | |
| *** trown is now known as trown|outtypewww | 20:55 | |
| *** cody-somerville has quit IRC | 20:55 | |
| *** marst has quit IRC | 20:55 | |
| *** pfallenop has quit IRC | 20:55 | |
| pabelanger | jeblair: clarkb: fungi: openstack-zuul-jobs / openstack-zuul-roles for your review: https://review.openstack.org/#/c/461897/ | 20:55 |
| *** ijw has quit IRC | 20:56 | |
| *** pfallenop has joined #openstack-infra | 20:56 | |
| *** ijw has joined #openstack-infra | 20:57 | |
| *** cody-somerville has joined #openstack-infra | 20:57 | |
| *** cody-somerville has joined #openstack-infra | 20:57 | |
| *** cody-somerville has quit IRC | 20:58 | |
| *** cody-somerville has joined #openstack-infra | 20:58 | |
| *** thorst_afk has quit IRC | 20:59 | |
| *** jamielennox|away is now known as jamielennox | 21:01 | |
| *** gordc has quit IRC | 21:01 | |
| *** chlong has quit IRC | 21:01 | |
| *** annegentle has joined #openstack-infra | 21:03 | |
| *** eharney has quit IRC | 21:04 | |
| jeblair | pabelanger: WHEE! Zuul v3 dynamic config errors! :) | 21:04 |
| jeblair | that's so cool | 21:04 |
| mtreinish | fungi: I'm close to get mqtt-bench working, it's building now and it will publish the messages, but there are still some issues on subscriptions and closing clients | 21:04 |
| mtreinish | fungi: https://github.com/mtreinish/mqtt-bench/tree/fix-pointers is my working branch | 21:05 |
| jeblair | though it does look like we have a bug in the error locality statement | 21:05 |
| fungi | mtreinish: awesome. i need to find some food. famished | 21:05 |
| pabelanger | jeblair: ya, was surprised about that | 21:05 |
| jeblair | pabelanger: main.yaml isn't dynamic; needs a full reload. so you have to create the project and add it to the main.yaml file before you can add it to pipelines. | 21:06 |
| jeblair | pabelanger: it's worth noting that if we merge that change as-is, we will breake the running zuulv3 until the project exists. | 21:06 |
| pabelanger | jeblair: Ah, that was the piece I was missing | 21:07 |
| pabelanger | let me update | 21:07 |
| *** topol_ is now known as topol | 21:07 | |
| fungi | splitting it into phases? | 21:07 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Create openstack-zuul-jobs / openstack-zuul-roles projects https://review.openstack.org/461897 | 21:08 |
| jeblair | yeah, dynamically adding a new repo is especially dangerous, so that seems pretty infeasible. | 21:09 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Add openstack-zuul-jobs / openstack-zuul-roles to zuul.yaml https://review.openstack.org/461905 | 21:09 |
| *** rkukura has joined #openstack-infra | 21:10 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/shade master: Updated from global requirements https://review.openstack.org/461375 | 21:10 |
| *** EricGonczer_ has joined #openstack-infra | 21:11 | |
| *** jkilpatr has joined #openstack-infra | 21:12 | |
| ianw | hmm, timestamping has become more "interesting" in this journal enabled world | 21:12 |
| *** andreww has joined #openstack-infra | 21:14 | |
| *** xarses_ has quit IRC | 21:15 | |
| *** EricGonczer_ has quit IRC | 21:15 | |
| *** xarses_ has joined #openstack-infra | 21:15 | |
| *** dimtruck is now known as zz_dimtruck | 21:15 | |
| *** ldnunes_ has quit IRC | 21:15 | |
| *** mnencia has quit IRC | 21:15 | |
| *** xarses_ has quit IRC | 21:15 | |
| *** mnencia has joined #openstack-infra | 21:16 | |
| *** xarses_ has joined #openstack-infra | 21:16 | |
| *** EricGonczer_ has joined #openstack-infra | 21:16 | |
| *** chlong has joined #openstack-infra | 21:16 | |
| *** felipemonteiro has joined #openstack-infra | 21:17 | |
| *** kjackal_ has quit IRC | 21:18 | |
| *** andreww has quit IRC | 21:19 | |
| *** askb has joined #openstack-infra | 21:21 | |
| fungi | mtreinish: so did newer go compilers get picky about being able to call pointers to an object instead of instantiating? what's the deal there? | 21:22 |
| mtreinish | fungi: I think it's because the paho library changed | 21:22 |
| mtreinish | but it might also be the go compiler | 21:22 |
| mtreinish | I wasn't sure | 21:22 |
| *** ijw has quit IRC | 21:22 | |
| mtreinish | fungi: I'm putting the finishing touches on the patch to fix the disconnect | 21:23 |
| mtreinish | and then it's working for me locally | 21:23 |
| *** ijw has joined #openstack-infra | 21:24 | |
| *** ijw has joined #openstack-infra | 21:24 | |
| *** zz_dimtruck is now known as dimtruck | 21:25 | |
| *** thorst_afk has joined #openstack-infra | 21:25 | |
| *** dougwig has quit IRC | 21:25 | |
| *** cody-somerville has quit IRC | 21:25 | |
| *** rhallisey has quit IRC | 21:25 | |
| *** ijw has quit IRC | 21:27 | |
| *** ijw has joined #openstack-infra | 21:29 | |
| *** thorst_afk has quit IRC | 21:29 | |
| *** ijw has joined #openstack-infra | 21:29 | |
| *** adriant has joined #openstack-infra | 21:30 | |
| *** jamesmca_ has quit IRC | 21:30 | |
| mtreinish | fungi: https://github.com/takanorig/mqtt-bench/pull/13 | 21:30 |
| mtreinish | which is just from the current head of that branch | 21:30 |
| mtreinish | everything works for me locally with that | 21:30 |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate master: Collect lvmdump info in logs https://review.openstack.org/461883 | 21:31 |
| mtreinish | fungi: hah, I just noticed there is another PR doing the same basic thing on the repo | 21:31 |
| mtreinish | from a couple of months ago | 21:32 |
| *** EricGonczer_ has quit IRC | 21:32 | |
| fungi | heh, abandonware! | 21:32 |
| mtreinish | well we can use my branch for testing things at least | 21:33 |
| openstackgerrit | Sean McGinnis proposed openstack-infra/project-config master: Bump grenade job filter to >= ocata https://review.openstack.org/461886 | 21:34 |
| *** wolverineav has quit IRC | 21:35 | |
| clarkb | project-config reviewers can we get second review on ^ | 21:36 |
| clarkb | grenade is all sorts of hurt on newton and it doesn't make sense to fix it as we are in the middle of EOLing mitaka | 21:36 |
| *** wolverineav has joined #openstack-infra | 21:36 | |
| *** Apoorva_ has quit IRC | 21:39 | |
| *** wolverineav has quit IRC | 21:40 | |
| *** Apoorva has joined #openstack-infra | 21:40 | |
| *** wolverineav has joined #openstack-infra | 21:41 | |
| *** xingchao has joined #openstack-infra | 21:41 | |
| *** ijw has quit IRC | 21:42 | |
| *** jamesdenton has quit IRC | 21:43 | |
| *** rfolco has quit IRC | 21:43 | |
| mtreinish | ftr, I'm not a fan of go. That being my first real attempt to use it for more than just playing around | 21:43 |
| *** annegentle has quit IRC | 21:44 | |
| *** annegentle has joined #openstack-infra | 21:44 | |
| fungi | so less of a fan than you were? | 21:45 |
| mtreinish | heh, I guess | 21:45 |
| fungi | it's still so foreign to me i'm at the stage of trying to figure out what the package name is for the compiler | 21:45 |
| *** wolverineav has quit IRC | 21:46 | |
| openstackgerrit | Hongbin Lu proposed openstack-infra/project-config master: [Kuryr] Make fullstack jobs voting https://review.openstack.org/461911 | 21:46 |
| *** xingchao has quit IRC | 21:46 | |
| mtreinish | asymptotically approaching 0 :) | 21:46 |
| *** ijw has joined #openstack-infra | 21:46 | |
| mtreinish | on ubuntu it's golang | 21:46 |
| *** ijw has quit IRC | 21:46 | |
| mtreinish | on arch it's go... | 21:46 |
| *** ijw has joined #openstack-infra | 21:46 | |
| *** mat128 has joined #openstack-infra | 21:46 | |
| fungi | golang-go i think | 21:46 |
| mtreinish | oh, yeah that's probably it | 21:47 |
| fungi | golang-go - Go programming language compiler, linker, compiled stdlib | 21:47 |
| openstackgerrit | Merged openstack-infra/project-config master: Bump grenade job filter to >= ocata https://review.openstack.org/461886 | 21:47 |
| mtreinish | hmm, according to my bash history on my test vm I just did 'apt-get install golang' and that seemed to work | 21:48 |
| fungi | and now i'm directed to `go help gopath` | 21:49 |
| fungi | which doesn't even invoke a pager. fun times! | 21:49 |
| *** mdrabe_ has quit IRC | 21:49 | |
| mtreinish | heh, yeah I had the same experience | 21:49 |
| mtreinish | fungi: just do mkdir ~/.go && export GOPATH=~/.go && export PATH="PATH:$GOPATH/bin" | 21:50 |
| fungi | 145 lines of help output distilled to a one-liner... thanks! ;) | 21:51 |
| *** salv-orl_ has joined #openstack-infra | 21:52 | |
| fungi | next stupid gonewb question... how to i tell it i want to clone the repo over an anonymous protocol instead of being prompted for ssh authentication to gh? | 21:53 |
| *** salv-orlando has quit IRC | 21:54 | |
| *** xingchao has joined #openstack-infra | 21:54 | |
| mtreinish | fungi: heh, that's actually http prompts iirc. It tries to auth against github for some repos | 21:55 |
| mtreinish | fungi: is that against my fork or the original? | 21:55 |
| fungi | i was trying to `go get github.com/mtreinish/mqtt-bench` and first it asked me to accept a new ssh host key for github.com | 21:55 |
| mtreinish | oh, that's probably why it worked for me on my fork but not the original repo | 21:56 |
| mtreinish | because I have access to my own repo :p | 21:56 |
| mtreinish | heh, I guess I never figured that out then | 21:56 |
| *** yamahata has quit IRC | 21:56 | |
| *** hashar has quit IRC | 21:57 | |
| mtreinish | fungi: tbh I would just manually clone it | 21:57 |
| mtreinish | it makes the dir in .go/src/github.com/mtreinish/mqtt-bench | 21:57 |
| fungi | and my documentation searching fu is weak, i only turn up instructions on how to get it to use ssh (indicating that it tries https first) | 21:57 |
| *** ijw has quit IRC | 21:58 | |
| mtreinish | if you just clone it yourself there it'll find it for go install | 21:58 |
| *** ijw has joined #openstack-infra | 21:58 | |
| *** marst has joined #openstack-infra | 21:58 | |
| fungi | i'm thoroughly determined to figure this out now. it can't be how they expect the thing to work | 21:59 |
| *** xingchao has quit IRC | 21:59 | |
| mtreinish | but if you do that I you'll probably have to install the deps by hand too: go get github.com/eclipse/paho.mqtt.golang && go get golang.org/x/net/websocket (which definitely worked for me) | 21:59 |
| fungi | dims: mordred: ^ how do you convince `go get` to use http(s) instead of defaulting to ssh? this is maddening and i'm not finding obvious explanations in the documentation | 22:00 |
| fungi | dims: mordred: nevermind! -v to the rescue | 22:00 |
| fungi | i should have tried that first | 22:00 |
| openstackgerrit | Hongbin Lu proposed openstack-infra/project-config master: [Kuryr] Make fullstack jobs voting https://review.openstack.org/461911 | 22:01 |
| fungi | it's apparently when it tries to resolve the dependencies and decides it should get https://git.eclipse.org/gitroot/paho/org.eclipse.paho.mqtt.golang/ | 22:01 |
| mtreinish | fungi: oh, because it doesn't have my branch | 22:01 |
| fungi | mtreinish: shouldn't your patch have fixed that? | 22:01 |
| dims | fungi : ok :) | 22:01 |
| mtreinish | fungi: it's using master which doesn't have the fix | 22:01 |
| *** ijw has quit IRC | 22:02 | |
| fungi | mtreinish: oh, i thought i saw that commit on your master branch | 22:02 |
| *** ijw has joined #openstack-infra | 22:02 | |
| fungi | nope, you're right, it's the fix-pointers branch | 22:02 |
| mtreinish | fungi: I can push it on master, one sec | 22:02 |
| mtreinish | ok, it should be on master too now | 22:03 |
| fungi | well, there ought to be a way to specify a branch name to go get | 22:03 |
| fungi | apparently not in the help documentation anyway. it does some magic things if there's a "go1" branch or similar | 22:03 |
| fungi | mtreinish: that worked (after i blew away and recreated ~/.go at least) | 22:04 |
| fungi | looks like it built successfully | 22:05 |
| mtreinish | heh, ok cool | 22:05 |
| fungi | so i have it available on the test instance from last night now | 22:05 |
| mtreinish | fungi: from my google searches everyone seems to recommend going to the repo in your GOPATH and checking out the branch from there | 22:05 |
| fungi | heh | 22:06 |
| *** ijw has quit IRC | 22:06 | |
| fungi | which is a catch-22 if the master branch has different deps declared | 22:06 |
| mtreinish | heh, yep | 22:06 |
| *** ijw has joined #openstack-infra | 22:06 | |
| mtreinish | fungi: so the way I was running it locally was starting mqtt-bench -action sub -broker tcp://127.0.0.1:1883 -x -intervaltime 10 and the running mqtt-bench -action pub -broker tcp://127.0.0.1:1883 -broker-username infra -broker-password pass -x to send the messages | 22:07 |
| mtreinish | oh, and drop the -x to turn off verbose output (we don't need that) | 22:07 |
| mtreinish | it prints every message and topic with -x | 22:07 |
| mtreinish | from there we can tune the number of clients, number of loops, qos, payload size, etc | 22:08 |
| *** Apoorva_ has joined #openstack-infra | 22:08 | |
| *** jascott1 has quit IRC | 22:09 | |
| *** pradk has quit IRC | 22:10 | |
| *** ijw has quit IRC | 22:10 | |
| *** jascott1 has joined #openstack-infra | 22:10 | |
| *** Apoorva has quit IRC | 22:11 | |
| *** mhickey has quit IRC | 22:11 | |
| *** jascott1 has quit IRC | 22:12 | |
| *** gouthamr has joined #openstack-infra | 22:12 | |
| *** jascott1 has joined #openstack-infra | 22:12 | |
| fungi | Result : broker=tcp://firehose.openstack.org:1883, clients=10, totalCount=1000, duration=63125ms, throughput=15.84messages/sec | 22:12 |
| *** shardy has quit IRC | 22:12 | |
| fungi | okay, that works | 22:12 |
| fungi | Result : broker=tcp://firehose.openstack.org:1883, clients=10, totalCount=998, duration=22ms, throughput=45363.64messages/sec | 22:13 |
| fungi | first was from the subscriber, second was from the publisher | 22:13 |
| mtreinish | that first one seems really slow | 22:13 |
| fungi | well, it was running for a minute or so before i started the publisher | 22:13 |
| mtreinish | ah ok | 22:13 |
| fungi | so it was presumably counting all that time? | 22:13 |
| *** ijw has joined #openstack-infra | 22:14 | |
| mtreinish | I'd have to double check the code, but that's likely | 22:14 |
| fungi | so no way to synchronize start times i guess | 22:14 |
| fungi | just expects you to start them at almost teh same time and use a much higher count? | 22:14 |
| *** jascott__ has joined #openstack-infra | 22:16 | |
| mtreinish | fungi: yeah looking at the code it starts counting on the sub: https://github.com/mtreinish/mqtt-bench/blob/master/mqtt-bench.go#L136-L138 not when it starts getting events | 22:16 |
| *** neiljerram has quit IRC | 22:16 | |
| *** jascott1 has quit IRC | 22:16 | |
| *** neiljerram has joined #openstack-infra | 22:18 | |
| fungi | upped -count to 1000... sub: duration=2030ms, throughput=4926.11messages/sec; pub: duration=439ms, throughput=22758.54messages/sec | 22:18 |
| mtreinish | that's a better number | 22:19 |
| fungi | gonna need to crank it waaaaay higher for the time it takes me to switch screen sessions and it enter to not factor in by multiple orders of magnitude | 22:19 |
| *** mat128 has quit IRC | 22:20 | |
| fungi | going to 100k count | 22:20 |
| *** jascott__ has quit IRC | 22:20 | |
| *** cody-somerville has joined #openstack-infra | 22:20 | |
| *** felipemonteiro has quit IRC | 22:20 | |
| pabelanger | clarkb: if we wanted to do one-time use SSH keys for jenkins user in nodepool, do you think our clouds could handle the create / delete of SSH keys? | 22:21 |
| pabelanger | assuming we updated glean too | 22:21 |
| *** erlon has quit IRC | 22:21 | |
| clarkb | pabelanger: yes, more likely the scaling issue would be on your nodepool server making the key and needing entropy for that | 22:21 |
| *** tonytan4ever has quit IRC | 22:21 | |
| pabelanger | clarkb: right, that would need to be considered too | 22:22 |
| fungi | mtreinish: something's off-kilter between the publisher and subscriber modes. at 100k count the pub finished in 39919ms but the pub is still running | 22:22 |
| clarkb | pabelanger: is there a problem you are trying to solve with that? I'm not sure where it would be super beneficial except to reduce size of a key compromise | 22:22 |
| fungi | er, sub is still running | 22:22 |
| *** chlong has quit IRC | 22:22 | |
| *** puiterwijk has quit IRC | 22:23 | |
| *** puiterwijk has joined #openstack-infra | 22:23 | |
| *** puiterwijk has joined #openstack-infra | 22:23 | |
| mtreinish | fungi: hmm, that's weird | 22:23 |
| mtreinish | fungi: maybe delay on the broker? | 22:24 |
| fungi | mtreinish: i guess the idea is to leave the pub running in a longer loop, and then just measure in short bursts with the sub | 22:24 |
| fungi | that's what their subscribe example shows at any rate | 22:24 |
| pabelanger | clarkb: was just thinking about bubblewrap stuff for zuulv3. We need to add our private key into bubblewrap container to run ansible-playbook. Was thinking if we wanted to reduce security attack around the ssh key, we might consider a onetime SSH key for jenkins / zuul on zuul worker | 22:24 |
| *** annegentle has quit IRC | 22:25 | |
| mtreinish | fungi: yeah I guess that makes sense | 22:25 |
| pabelanger | other wise, if leaked, we'd need to rebuild all images today | 22:25 |
| clarkb | gotcha, would an ssh agent help? | 22:25 |
| pabelanger | not sure, didn't think of it | 22:25 |
| mtreinish | fungi: if we had more time I'd just rewrite in python and make it so that it would handle both the pub and sub in one command | 22:26 |
| pabelanger | clarkb: reading docs now | 22:26 |
| clarkb | pabelanger: I know that without haveged making that many keys is likely to be very painful | 22:26 |
| clarkb | but with haveged it may not be too bad, would need to test | 22:26 |
| fungi | mtreinish: so anyway, short burst sub result is totalCount=1605, duration=140ms, throughput=11464.29messages/sec | 22:26 |
| pabelanger | clarkb: the other question, we'd generate on nodepool side, then share private key to zuul, via zookeeper. Is that safe or not | 22:27 |
| clarkb | pabelanger: its probably safe enough if using tls'd zk connections and auth | 22:27 |
| mtreinish | fungi: that seems pretty good | 22:27 |
| mtreinish | although I don't have any frame of reference to compare it against | 22:28 |
| *** dizquierdo has quit IRC | 22:28 | |
| fungi | roughly the same with the sub using tls as well | 22:29 |
| mtreinish | fungi: the other thing we should try is upping the client count, by default it only uses 10 | 22:29 |
| *** krtaylor has quit IRC | 22:30 | |
| *** baoli has quit IRC | 22:30 | |
| *** jaypipes has quit IRC | 22:30 | |
| mtreinish | fungi: I guess we also should record this data in a csv or something so we can generate a graph for the slides | 22:30 |
| fungi | oh, i think it may not have been using tls after all :/ | 22:31 |
| *** dave-mccowan has quit IRC | 22:31 | |
| fungi | i had tcp://firehose.openstack.org:1883 instead of tcp://firehose.openstack.org:8883 | 22:31 |
| fungi | does mosquitto do opportunistic tls on 1883? | 22:31 |
| mtreinish | it's not configured to | 22:32 |
| clarkb | pabelanger: ssh-agent will protect the key contents but not use of the key. We are ok with use of the key. However not sure how you'd give the bubblewrap env access to external ssh-agent | 22:32 |
| mtreinish | fungi: https://git.openstack.org/cgit/openstack-infra/puppet-mosquitto/tree/templates/mosquitto.conf.erb#n279 | 22:32 |
| mtreinish | fungi: but tbh I don't know what happens, let me try it locally | 22:33 |
| pabelanger | clarkb: right, we want bubblewrap to use the key, just not know what the key is. | 22:33 |
| pabelanger | I'm going to ready up about containers and SSH_AUTH_SOCK tonight | 22:33 |
| fungi | mtreinish: when i try with -broker tcp://firehose.openstack.org:8883 and -tls=server:mosquitto_cafile.pem i get "Connected error: Network Error : %!s(<nil>)" | 22:33 |
| mtreinish | fungi: I get a tls error on 1883 | 22:33 |
| jeblair | pabelanger: fyi, i've already declined one patch to use ssh-agent | 22:33 |
| pabelanger | jeblair: which one was that? | 22:34 |
| *** ijw has quit IRC | 22:34 | |
| jeblair | i dunno, there was a patch to add it | 22:34 |
| pabelanger | k, will look at review.o.o | 22:35 |
| mtreinish | fungi: hmm I would expect -tls=client:mosquitto_cafile.pem | 22:35 |
| mtreinish | since that's the CA file not the server cert | 22:35 |
| pabelanger | jeblair: was discussing how else we could keep out private keys outside of bubblewrap container | 22:35 |
| mtreinish | but I don't know | 22:35 |
| mtreinish | let me check the tls code in mqtt-bench | 22:35 |
| *** ijw has joined #openstack-infra | 22:36 | |
| *** jascott1 has joined #openstack-infra | 22:36 | |
| mtreinish | fungi: according to my brief skim of the code that should do the right thing | 22:36 |
| *** dimtruck is now known as zz_dimtruck | 22:36 | |
| clarkb | jeblair: pabelanger I don't think you'd need zuul to directly support the agent, if you had one running and the env var set it should just work (tm) | 22:36 |
| pabelanger | ya, that is how I was going to test it. Add it outside of zuul, make sure we tried to mount it | 22:37 |
| pabelanger | see what happened | 22:37 |
| jeblair | pabelanger: it was a lot of complexity for no gain. | 22:37 |
| pabelanger | found it: https://review.openstack.org/#/c/331148 was to remove ssh wrappers | 22:38 |
| mtreinish | fungi: it makes the certpool https://github.com/mtreinish/mqtt-bench/blob/master/mqtt-bench.go#L61-L71 from the server cert https://github.com/mtreinish/mqtt-bench/blob/master/mqtt-bench.go#L318 | 22:38 |
| jeblair | pabelanger: i can see the argument for it here. | 22:38 |
| mtreinish | and passes that TlsConfig object to the paho library | 22:38 |
| *** sree has joined #openstack-infra | 22:39 | |
| jeblair | clarkb, pabelanger: if we decide to use it, i would *want* zuul to manage it. setting that up externally is a lot to ask of an operator. | 22:39 |
| jeblair | that patch at least does that | 22:40 |
| mtreinish | fungi: I guess lets not worry about tls for now :) | 22:40 |
| jeblair | but, oy, the headaches that's going to cause | 22:41 |
| mtreinish | fungi: heh, although you're probably sending the password in plaintext on the pub side if you're not setting that up | 22:41 |
| fungi | mtreinish: that's why i stopped once i spotted it | 22:43 |
| *** salv-orl_ has quit IRC | 22:43 | |
| *** sree has quit IRC | 22:44 | |
| mtreinish | fungi: heh, isn't security on late 90s protocols fun :) | 22:44 |
| mtreinish | fungi: well at least we have a couple data point we can put in the slides. The graph will be pretty boring though | 22:47 |
| fungi | mtreinish: well, i was still trying to figure out an actual test methodology | 22:47 |
| fungi | i guess we have two streams. long running publisher and short-running subscriber | 22:48 |
| *** funzo has joined #openstack-infra | 22:48 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate master: Collect lvmdump info in logs https://review.openstack.org/461883 | 22:48 |
| fungi | while the publisher is running at a specific client quantity (count used to tune the duration) we sample the subscriber at increasing client quantities | 22:49 |
| *** dave-mccowan has joined #openstack-infra | 22:49 | |
| fungi | then we up the publisher quantity and repeat the battery of subscriber datapoints? | 22:49 |
| * clarkb wonders why lvmdump won't just let you pass a tarball path in | 22:49 | |
| mtreinish | fungi: that sounds like a good approach | 22:50 |
| fungi | mtreinish: result is a 3-d bar or surface graph where x is subscribers, y is publishers and z is the message rate observed by the subscribers? | 22:51 |
| *** funzo has quit IRC | 22:52 | |
| *** rbrndt has quit IRC | 22:52 | |
| pabelanger | jeblair: clarkb: should be as easy as adding: --bind $SSH_AUTH_SOCK $SSH_AUTH_SOCK to our bwrap command | 22:52 |
| pabelanger | then export SSH_AUTH_SOCKET | 22:52 |
| pabelanger | just tested locally and worked | 22:52 |
| pabelanger | minus all the steps needed to set up ssh-agent | 22:53 |
| jeblair | pabelanger: which that patch seems to have covered | 22:53 |
| jeblair | pabelanger: lets run this by mordred and SpamapS too | 22:53 |
| *** tiswanso has quit IRC | 22:53 | |
| mtreinish | fungi: probably depends on the size of the dataset. If we have enough data in x, y, and z then a surface probably makes sense | 22:53 |
| mtreinish | but if one dimension is less than the others we could get away with multiple lines or something | 22:54 |
| mtreinish | but we can figure out the visualization after we collect the data | 22:54 |
| clarkb | pabelanger: cool, good to know that that is sufficient | 22:55 |
| fungi | mtreinish: as for stepping, geometric or exponential progression? | 22:56 |
| pabelanger | jeblair: clarkb: Agree, getting more eyes would be good | 22:57 |
| mtreinish | fungi: hmm, exponential I guess | 22:58 |
| mtreinish | it's been a while since I used a log scale in a graph :) | 22:58 |
| fungi | agreed, i'm leaning toward the latter. maybe powers of 2 | 22:58 |
| fungi | for (computer) science | 22:58 |
| mtreinish | yeah, sounds good | 22:58 |
| *** hongbin has quit IRC | 22:59 | |
| *** Apoorva_ has quit IRC | 23:02 | |
| *** Apoorva has joined #openstack-infra | 23:02 | |
| *** annegentle has joined #openstack-infra | 23:04 | |
| fungi | could also vary message size, but then we're getting into volumetric representations or something equally hard to translate to a slide deck | 23:06 |
| mtreinish | fungi: we could just do side by side surface graphs with different payload sizes | 23:06 |
| openstackgerrit | Ian Y. Choi proposed openstack-infra/project-config master: Add and enable translation jobs for i18n-guide https://review.openstack.org/461924 | 23:06 |
| fungi | mtreinish: well, there's also the ms interval between messages per publisher | 23:07 |
| mtreinish | but yeah, we can jsut stick with a single smmall message size | 23:07 |
| fungi | i'm good with holding interval and size constant and varying clients on both sides | 23:07 |
| *** xarses_ has quit IRC | 23:09 | |
| *** annegentle has quit IRC | 23:10 | |
| *** xyang1 has quit IRC | 23:10 | |
| openstackgerrit | Ian Y. Choi proposed openstack-infra/project-config master: Add and enable translation jobs for i18n-guide https://review.openstack.org/461924 | 23:11 |
| *** baoli has joined #openstack-infra | 23:14 | |
| *** rderose_ has quit IRC | 23:15 | |
| *** sdague has quit IRC | 23:17 | |
| clarkb | jeblair: how do you take presentty patches? | 23:18 |
| fungi | jeblair: i've used git gotmat-patch and attached it to e-mail to him ;) | 23:18 |
| fungi | er, clarkb ^ | 23:18 |
| fungi | git format-patch | 23:18 |
| fungi | where has my typing ability gone this evening? | 23:19 |
| clarkb | gotmat-patch? /me will just git diff | 23:19 |
| *** baoli has quit IRC | 23:19 | |
| clarkb | er show | 23:19 |
| fungi | yeah, got show, git diff | 23:19 |
| fungi | go get me new fingers | 23:20 |
| *** thorst_afk has joined #openstack-infra | 23:21 | |
| *** tiswanso has joined #openstack-infra | 23:22 | |
| *** pahuang has joined #openstack-infra | 23:23 | |
| fungi | mtreinish: at the default count on the sub i'm getting wildly different rates between tries, so either need a longer sample or to average multiple samples... any preference? | 23:25 |
| fungi | -count=1000 seems to keep the variance to around +/-10% so maybe that's good enough | 23:26 |
| mtreinish | fungi: honestly I'd probably do both | 23:26 |
| mtreinish | fungi: considering this is a running system, the load on the broker isn't fixed at any point | 23:27 |
| fungi | i should probably repeat the full battery multiple times so that we're not getting a bias of adjacent samples from external influence | 23:27 |
| fungi | then we can average the cells of the resulting fields together | 23:27 |
| mtreinish | sounds good | 23:28 |
| *** marst has quit IRC | 23:30 | |
| *** lamt has quit IRC | 23:30 | |
| clarkb | jeblair: I have emailed you a patch for presentty | 23:32 |
| clarkb | jeblair: would be interested in feedback as I have little experience with urwid or sphinx | 23:32 |
| mtreinish | clarkb: I still get confused by urwid | 23:33 |
| jeblair | clarkb: neat, i didn't know about '|' :) | 23:34 |
| fungi | mtreinish: awesome engrish error message... "panic: Subscribe error : Not finished in the max count. It may not be received the message." | 23:34 |
| clarkb | devstack-gate reviewers, can I get eyeballs on https://review.openstack.org/#/c/461883/ I think that will help debug the lvm issues cinder has been having, but am super open to other suggestions as well | 23:35 |
| *** tiswanso has quit IRC | 23:35 | |
| clarkb | the tldr on that is lvm isn't changing state of volumes when cinder asks it to. The attribute change command returns 0 happily but then querying if the transition has completed shows it hasn't | 23:36 |
| jeblair | clarkb: (also, ftr, the readme has a contributing section) | 23:36 |
| *** gildub has joined #openstack-infra | 23:36 | |
| mtreinish | fungi: let me see if there is a japanese comment in the code for me to test my kanji knowledge against | 23:36 |
| *** marst has joined #openstack-infra | 23:37 | |
| clarkb | jeblair: ah of course | 23:37 |
| clarkb | people actualyl read the files that say "read me" ? :P | 23:37 |
| jeblair | no :( | 23:37 |
| clarkb | I'm actually not sure if that would work locally. would require being able to send out on port 25 right? or configure git to talk to something to tunnel it? | 23:38 |
| mtreinish | fungi: oh, there is something in the readme about that error: https://github.com/mtreinish/mqtt-bench#subscribe | 23:39 |
| jeblair | clarkb: i assume it rus /usr/lib/sendmail unless you tell it otherwise | 23:40 |
| fungi | mtreinish: neat. well, the count isn't actually over limit in this case, it happens if i specify -count and there's no publisher apparently | 23:41 |
| jeblair | clarkb: what did you end up doing? | 23:41 |
| clarkb | jeblair: I just did git show > patch then attached that file to email in my normal mail client | 23:42 |
| mtreinish | fungi: well from copying the comment into google translate it says that error is raised if the main loop iteration equals 100x the specified count | 23:43 |
| jeblair | clarkb: do you have a suggestion as to how to apply that? | 23:43 |
| mtreinish | probably because it's waiting for messages and not getting anything | 23:43 |
| mtreinish | I still haven't figured out the threading model for the subscribers to understand how that code makes sense in practice | 23:44 |
| clarkb | jeblair: git am < patch? | 23:44 |
| fungi | mtreinish: that's my guess as well. same -count value on the client works fine if i have the publisher going | 23:44 |
| jeblair | clarkb: not so much with the git show format, afaict | 23:44 |
| clarkb | arg ok | 23:45 |
| fungi | clarkb: see https://security.openstack.org/#how-to-propose-and-review-a-security-patch | 23:45 |
| fungi | has git format-patch syntax | 23:45 |
| clarkb | thanks will do that in a few | 23:46 |
| *** thorst_afk has quit IRC | 23:46 | |
| fungi | that's how we generally recommend attaching them to our embargoed vulnerability reports so that we can git am them correctly later at disclosure | 23:46 |
| *** rkukura has quit IRC | 23:47 | |
| fungi | i agree format-patch is pretty opaque since its default is to just generate tons of incrementally-indexed patch files in your git tree | 23:47 |
| *** Julien-z_ has joined #openstack-infra | 23:48 | |
| jeblair | fungi, clarkb: that page has a good way to send a patch as well as how to apply a 'git show' patch | 23:48 |
| fungi | yep | 23:48 |
| fungi | you'll lose some authorship info though, so format-patch and am are preferred over show and apply | 23:49 |
| jeblair | oh, yeah, that's what i was aiming for | 23:49 |
| jeblair | i would like to preserve history | 23:49 |
| clarkb | ya I'll get you the format patxh version in a few. had to stepmaway from computer | 23:49 |
| jeblair | so i guess i really do need the format-patch | 23:49 |
| *** Julien-zte has quit IRC | 23:51 | |
| jeblair | clarkb, fungi: readme updated http://git.inaugust.com/cgit/presentty/commit/?id=1fbc379fc0973d21c1ba4aad85015b277c2b3122 :) | 23:52 |
| *** Julien-z_ has quit IRC | 23:52 | |
| fungi | awesome! | 23:52 |
| *** hongbin has joined #openstack-infra | 23:52 | |
| clarkb | jeblair: ok you should have format patch patch | 23:56 |
| *** yamamoto has quit IRC | 23:56 | |
| mtreinish | jeblair: fwiw, my normal workflow there is just git format-patch -1 it'll write out a 0001-commit-summary.patch and the just git-send-email --to=corvus@gnu.org 0001*patch | 23:56 |
| clarkb | looking at the different between show and format-patch one wonders why show isn't the same as format patch | 23:58 |
| clarkb | its basically the same | 23:58 |
| clarkb | the version at the bottom maybe? | 23:58 |
| fungi | clarkb: format-patch creates an mbox entry | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!