*** jangutter_ has joined #softwarefactory | 00:01 | |
*** jangutter has quit IRC | 00:01 | |
*** jangutter_ has quit IRC | 00:04 | |
*** jangutter has joined #softwarefactory | 00:12 | |
*** jangutter has quit IRC | 00:22 | |
*** jangutter has joined #softwarefactory | 00:22 | |
*** jangutter has quit IRC | 00:27 | |
*** sfbender has quit IRC | 02:18 | |
*** jangutter has joined #softwarefactory | 03:09 | |
*** jangutter has quit IRC | 07:38 | |
*** jangutter has joined #softwarefactory | 07:38 | |
*** jpena|off is now known as jpena | 07:39 | |
*** jangutter has quit IRC | 07:42 | |
tristanC | matburt: here is a wip demo of a job deploying openshift and an awx-install job to verify it install on openshift https://github.com/ansible/zuul-jobs/pull/6/files | 08:46 |
---|---|---|
tristanC | dmsimard: ^ | 08:46 |
*** sfbender has joined #softwarefactory | 10:00 | |
sfbender | Merged logreduce master: react: fix typo and add build time https://softwarefactory-project.io/r/13580 | 10:00 |
sfbender | Merged software-factory/sfinfo master: Remove old packages https://softwarefactory-project.io/r/11885 | 10:13 |
tristanC | matburt: dmsimard: here you go, the job last task was to list available roles: https://ansible.softwarefactory-project.io/logs/6/6/c783dc05e3f9e17602c78fe90ed871588947a55a/check/openshift-awx-install/1c3f63b/ara-report/ | 10:16 |
sfbender | Merged software-factory/sf-docs master: slightly improve the secret section https://softwarefactory-project.io/r/13332 | 10:17 |
sfbender | Merged software-factory/sfinfo master: Remove uwsgi from sf-master sfinfo https://softwarefactory-project.io/r/11342 | 10:57 |
*** jpena is now known as jpena|lunch | 11:25 | |
dmsimard | tristanC: very helpful, thanks! | 11:47 |
*** jangutter has joined #softwarefactory | 11:50 | |
*** jpena|lunch is now known as jpena | 12:28 | |
sfbender | Merged software-factory/managesf master: bind: add logging statement to the controller https://softwarefactory-project.io/r/12743 | 13:03 |
*** jangutter has quit IRC | 13:27 | |
*** jangutter has joined #softwarefactory | 13:34 | |
*** jangutter has quit IRC | 13:35 | |
*** jangutter has joined #softwarefactory | 13:35 | |
*** jangutter has quit IRC | 13:40 | |
*** jangutter has joined #softwarefactory | 13:44 | |
*** jangutter has quit IRC | 13:48 | |
pabelanger | mhu: nhicher: fbo: is there an outage in RDO cloud? | 13:51 |
pabelanger | https://softwarefactory-project.io/grafana/d/000000005/nodepool-status?orgId=1&from=now-1h&to=now&refresh=5s | 13:51 |
pabelanger | is showing launch errors for nodepool | 13:51 |
mhu | pabelanger, the outage mails come and go, they all look the same now ... brb let me check when was the last one | 13:52 |
mhu | pabelanger, yeah we got a notification about 6 hours ago, no resolution yet | 13:53 |
mhu | although the internal semaphore is all greem | 13:54 |
mhu | green | 13:54 |
pabelanger | okay, let me try a node in vexxhost | 13:55 |
pabelanger | mhu: is it possible to echo the outages here too? cc gundalow | 13:56 |
fbo | pabelanger: some minutes ago issues were reported to rhos-ops | 14:19 |
pabelanger | thanks | 14:21 |
jruzicka | tristanC, heya! gertty is completely awesome, thanks again for that. Comments on the blog would be nice, I think there is a US and ongoing research on that but I got one more crazy idea | 14:24 |
jruzicka | tristanC, sf could generate gertty config for it's config so you could copy it like API key... | 14:25 |
jruzicka | probably at least GERTTY_HOME would need an input field, but you could generate .gertty.yaml with all fields filled. It would should relevant servers: section and offer to download full .gertty.yaml file. | 14:30 |
jruzicka | we're supposed to support best practices, right? :) | 14:30 |
*** jangutter has joined #softwarefactory | 14:41 | |
*** jangutter has joined #softwarefactory | 14:41 | |
matburt | tristanC: sorry I haven't been able to catch up so far this week... we have a big release going this week and there's a hurricane bearing down on North Carolina. I'll drop you an email later today. | 14:56 |
sfbender | Merged rdopkg master: meta: update setup.cfg summary https://softwarefactory-project.io/r/13417 | 15:06 |
tristanC | jruzicka: glad you like it, it really improves review workflow... and having a 'download .gertty configuration' button is a good idea :) | 15:08 |
tristanC | matburt: alright, no hurries, the job works, but it's just a demo. let me know when you want to delve into the detail and what type of funtional job you would like to set first | 15:09 |
matburt | I'm super excited to do that, as soon as I can | 15:09 |
mhu | FYI, we're stopping nodepool for a little while to allow some cleanup in the nodepool tenant | 15:24 |
pabelanger | mhu: can we create a 2nd nodepool-launcher? so we don't bring down vexxhost when rdocloud outages? | 15:27 |
pabelanger | we are looking to start using vexxhost most today in ansible-network | 15:27 |
mhu | pabelanger, good idea | 15:29 |
pabelanger | mhu: or, can we set max-server: 0 for rdo-cloud then bring nodepool-launcher back online | 15:30 |
pabelanger | to not affect ansible-network | 15:30 |
pabelanger | mhu: any ETA on nodepool-launcher coming back online? Did you see my comment about setting max-servers: 0 | 16:05 |
mhu | pabelanger, we're still in the middle of cleaning | 16:05 |
pabelanger | mhu: ack, can we look to set max-server then for clouds that are broken | 16:06 |
fbo | we have restarted nodepool | 16:20 |
pabelanger | thanks, it would be helpful if we stand up a 2nd launcher, as not to block jobs running in vexxhost, or look to have set max-server: 0 for affects providers next time. We're going to start experimenting more with vexxhost in ansible-network moving forward | 16:23 |
*** sshnaidm has joined #softwarefactory | 16:38 | |
pabelanger | fbo: mhu: nhicher: is anybody able to help debug why zuul isn't starting to run a job on vexxhost: https://ansible-network.softwarefactory-project.io/zuul/status.html | 17:01 |
pabelanger | I cannot remember if we properly opened all the ports in the vexxhost tenant | 17:03 |
pabelanger | I can check that first | 17:03 |
nhicher | pabelanger: yes, I don't remember working on security groups for this project | 17:07 |
*** jangutter_ has joined #softwarefactory | 17:07 | |
*** jangutter has quit IRC | 17:08 | |
*** jpena is now known as jpena|off | 17:09 | |
pabelanger | yah, I'm going to manually check, then setup a zuul job for cloud launcher to manage it | 17:09 |
*** sshnaidm has quit IRC | 17:14 | |
*** jangutter_ has quit IRC | 17:14 | |
pabelanger | nhicher: okay, I've run cloud launcher against the tenant, it should have right settings now | 17:30 |
pabelanger | will try PR again | 17:31 |
pabelanger | 2018-09-11 17:37:45,196 WARNING zuul.Repo: Retry 1: Clone /var/opt/rh/rh-python35/lib/zuul/executor/softwarefactory-project.io/sf-jobs | 17:39 |
pabelanger | guess RDO cloud is down again | 17:40 |
nhicher | pabelanger: yes, rhos-ops is cleaning the tenants | 17:48 |
pabelanger | nhicher: this looks to be networking, since zuul executor cannot clone a git repo from gerrit | 17:49 |
pabelanger | nhicher: do we mirror sf-jobs to github today? | 17:49 |
nhicher | pabelanger: not sure for sf-jobs, let me check | 17:51 |
nhicher | pabelanger: no | 17:52 |
pabelanger | nhicher: k, we should consider mirroring them outside of rdocloud. I don't usually suggest github, but will be the better in this case | 18:38 |
pabelanger | nhicher: tristanC: mhu: can we update the redirect for https://ansible-network.softwarefactory-project.io to be https://ansible-network.softwarefactory-project.io/zuul/status.html not projects.html? | 19:48 |
*** jangutter has joined #softwarefactory | 20:01 | |
pabelanger | ssh_exchange_identification: read: Connection reset by peer | 20:30 |
pabelanger | I get that when I try to propose a review to sf.io | 20:30 |
pabelanger | guessing networking still out | 20:30 |
pabelanger | mhu: nhicher: ^ | 20:31 |
nhicher | could you try again pabelanger, I propose a review few minutes ago without issue | 20:58 |
*** jangutter has quit IRC | 21:00 | |
pabelanger | nhicher: no, fails here | 21:01 |
pabelanger | nhicher: what is the output of: | 21:01 |
pabelanger | ssh -v softwarefactory-project.io -p29418 | 21:01 |
pabelanger | for you | 21:01 |
nhicher | debug1: Connecting to softwarefactory-project.io [38.145.34.47] port 29418. | 21:02 |
nhicher | debug1: Connection established. | 21:02 |
pabelanger | ssh_exchange_identification: read: Connection reset by peer | 21:02 |
pabelanger | so, could be my route to rdocloud | 21:02 |
pabelanger | but, given I can ssh into port 22 | 21:03 |
pabelanger | makes me think something on cloud side is the issue | 21:03 |
pabelanger | let me get to another box and try | 21:04 |
pabelanger | nhicher: fails from rackspace, so routing for sure | 21:04 |
nhicher | pabelanger: ok, do you think you use different routes for differents ports ? | 21:05 |
pabelanger | nhicher: are you routing over the VPN? | 21:06 |
pabelanger | or using public | 21:06 |
*** jangutter has joined #softwarefactory | 21:06 | |
nhicher | public | 21:06 |
pabelanger | okay, I'll have to drop to eat with family. Do you mind confirming with rhos-ops things are okay? | 21:07 |
pabelanger | or maybe try from another system | 21:07 |
pabelanger | I'll check back in an hour or so | 21:08 |
nhicher | for rdocloud, nodepool provider are okay | 21:08 |
nhicher | providers | 21:08 |
*** sshnaidm has joined #softwarefactory | 21:34 | |
*** sshnaidm has quit IRC | 23:31 | |
*** sshnaidm has joined #softwarefactory | 23:40 | |
*** sshnaidm is now known as sshnaidm|afk | 23:40 | |
*** jangutter has quit IRC | 23:49 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!