Wednesday, 2019-05-01

*** bnemec has quit IRC00:02
*** bobh has joined #openstack-infra00:27
*** Weifan has quit IRC00:29
*** bobh has quit IRC00:34
*** bnemec has joined #openstack-infra00:35
*** whoami-rajat has quit IRC00:41
*** bobh has joined #openstack-infra00:46
*** gyee has quit IRC00:47
*** bobh has quit IRC00:50
*** bobh has joined #openstack-infra01:07
*** bobh has quit IRC01:23
*** bobh has joined #openstack-infra01:24
*** bobh has quit IRC01:28
*** whoami-rajat has joined #openstack-infra01:30
*** bobh has joined #openstack-infra01:33
*** bobh has quit IRC01:48
*** liuyulong has quit IRC01:50
*** bhavikdbavishi has joined #openstack-infra01:53
*** sshnaidm|ptg has joined #openstack-infra02:11
*** bobh has joined #openstack-infra02:15
*** gmann has quit IRC02:17
*** bhavikdbavishi1 has joined #openstack-infra02:18
*** bhavikdbavishi has quit IRC02:20
*** bhavikdbavishi1 is now known as bhavikdbavishi02:20
*** bobh has quit IRC02:23
*** yamamoto has quit IRC02:29
*** tdasilva has quit IRC02:30
*** eharney has quit IRC02:41
pabelangerianw: Have you started looking into fedora-30 for DIB?02:54
openstackgerritPaul Belanger proposed zuul/nodepool master: DNM: Switch to fedora-30 for nodepool tests  https://review.opendev.org/65660803:01
*** yamamoto has joined #openstack-infra03:12
*** rfolco|ruck is now known as rfolco|pto03:15
*** yamamoto has quit IRC03:18
openstackgerritPaul Belanger proposed openstack/diskimage-builder master: DNM - test fedora-30  https://review.opendev.org/65661003:29
openstackgerritPaul Belanger proposed openstack/diskimage-builder master: DNM - test fedora-30  https://review.opendev.org/65661003:30
*** yamamoto has joined #openstack-infra03:48
*** betherly has joined #openstack-infra03:50
*** betherly has quit IRC03:55
*** bhavikdbavishi has quit IRC04:16
*** bhavikdbavishi has joined #openstack-infra04:17
*** psachin has joined #openstack-infra04:22
*** sshnaidm|ptg has quit IRC04:38
*** yamamoto has quit IRC04:47
*** bhavikdbavishi has quit IRC04:54
*** bhavikdbavishi has joined #openstack-infra04:54
*** yamamoto has joined #openstack-infra05:02
*** kjackal has joined #openstack-infra05:08
*** gmann has joined #openstack-infra05:10
*** jbadiapa has quit IRC05:21
*** yamamoto has quit IRC05:29
*** yamamoto has joined #openstack-infra05:41
*** e0ne has joined #openstack-infra05:44
*** e0ne has quit IRC05:45
*** yamamoto has quit IRC05:46
*** yamamoto has joined #openstack-infra05:47
*** yamamoto has quit IRC06:06
*** yboaron has joined #openstack-infra06:08
*** kjackal has quit IRC06:17
*** bhavikdbavishi has quit IRC06:25
*** kjackal has joined #openstack-infra06:30
*** yamamoto has joined #openstack-infra06:31
*** yamamoto has quit IRC06:36
*** kjackal has quit IRC06:40
openstackgerritAlec Hothan proposed openstack/project-config master: Remove docs-on-readthedocs-failing from kloudbuster project  https://review.opendev.org/65660406:51
*** bhavikdbavishi has joined #openstack-infra07:08
*** yamamoto has joined #openstack-infra07:10
*** Lucas_Gray has joined #openstack-infra07:10
*** pcaruana has joined #openstack-infra07:14
*** shardy has joined #openstack-infra07:19
*** yboaron has quit IRC07:21
*** Lucas_Gray has quit IRC07:23
*** jtomasek has joined #openstack-infra07:26
*** Lucas_Gray has joined #openstack-infra07:27
*** larainema has quit IRC07:32
*** jpich has joined #openstack-infra07:40
*** quiquell|off is now known as quiquell|ptg07:56
*** yamamoto has quit IRC08:08
*** gmann has quit IRC08:19
*** psachin has quit IRC08:20
*** yboaron has joined #openstack-infra08:25
*** yamamoto has joined #openstack-infra08:25
*** Wryhder has joined #openstack-infra08:26
*** Lucas_Gray has quit IRC08:27
*** Wryhder is now known as Lucas_Gray08:27
*** yboaron_ has joined #openstack-infra08:28
*** yamamoto has quit IRC08:28
*** yboaron has quit IRC08:31
ianwpabelanger: yeah not quite yet -- i thought i'd upgrade locally and that did *not* go well.  something happens and it runs out of memory during the upgrade, and so i had double packages installed everywhere.   tried to fix it for a bit but luckily i snapshotted before ...08:40
AJaegerianw: ianw is fedora-28 really our latest fedora or was devstack forgotten to update? See https://opendev.org/openstack/devstack/src/branch/master/.zuul.yaml#L5508:44
openstackgerritMerged openstack/project-config master: Remove docs-on-readthedocs-failing from kloudbuster project  https://review.opendev.org/65660408:52
*** kjackal has joined #openstack-infra09:06
*** yamamoto has joined #openstack-infra09:12
*** yamamoto has quit IRC09:18
*** bhavikdbavishi has quit IRC09:23
*** Lucas_Gray has quit IRC09:23
*** yamamoto has joined #openstack-infra09:24
*** Lucas_Gray has joined #openstack-infra09:25
*** yamamoto has quit IRC09:31
openstackgerritSorin Sbarnea proposed openstack/diskimage-builder master: Avoid breaking virtualenv on python3  https://review.opendev.org/65646709:34
*** bhavikdbavishi has joined #openstack-infra09:35
*** rascasoft has quit IRC09:38
*** rascasoft has joined #openstack-infra09:42
lifelesscorvus: de nada :)09:58
*** kjackal has quit IRC10:06
*** kjackal has joined #openstack-infra10:09
*** yamamoto has joined #openstack-infra10:12
*** yamamoto has quit IRC10:17
*** betherly has joined #openstack-infra10:24
*** hwoarang has quit IRC10:36
*** hwoarang has joined #openstack-infra10:37
*** slaweq has joined #openstack-infra11:18
*** noama has joined #openstack-infra11:19
*** bhavikdbavishi has quit IRC11:27
ianwAJaeger: it is our latest, i have patches out for updating to fedora 29 but they never made it in.  sometimes it happens when there's just not enough people caring :/11:28
*** xarses_ has quit IRC11:37
*** bhavikdbavishi has joined #openstack-infra11:38
*** Lucas_Gray has quit IRC11:39
*** rfarr has joined #openstack-infra11:43
*** bhavikdbavishi has quit IRC12:06
*** slaweq has quit IRC12:08
*** slaweq has joined #openstack-infra12:09
*** kgiusti has joined #openstack-infra12:10
*** kgiusti has left #openstack-infra12:13
pabelangerianw: :( I did the fedora-30 last night with out issue.12:23
pabelangerianw: but so far, it seem get-pip.py is broken on fedora-30: http://logs.openstack.org/10/656610/2/check/nodepool-functional-py35-redhat-src/caa26ff/controller/logs/builds/fedora-30-0000000001_log.txt.gz#_2019-05-01_03_56_37_00612:24
pabelangerwill have to dig more into it later12:24
*** bhavikdbavishi has joined #openstack-infra12:28
*** rfarr_ has joined #openstack-infra12:34
*** rfarr has quit IRC12:34
*** ianychoi_ has quit IRC12:35
*** rlandy has joined #openstack-infra12:35
*** ianychoi_ has joined #openstack-infra12:35
AJaegerianw: I see.12:38
pabelangerAJaeger: fedora-28 should be EOL in less then 30 days, so could be the montivation need to migrate12:40
pabelangerneeded*12:40
*** kopecmartin|off has quit IRC12:40
*** aaronsheffield has joined #openstack-infra12:47
*** rfarr_ has quit IRC12:47
*** rfarr has joined #openstack-infra12:48
*** pcaruana has quit IRC12:49
*** mriedem has joined #openstack-infra12:50
*** yamamoto has joined #openstack-infra12:52
*** pcaruana has joined #openstack-infra12:54
*** ianychoi_ has quit IRC13:00
*** bhavikdbavishi has quit IRC13:14
*** auristor has quit IRC13:17
mriedemis anyone aware of any zuul v3 job examples where the job is sending a file down to one of the nodes, like a policy file to the controller?13:19
mriedemor is that just standard ansible and i'd need to use zuul variables to build the proper path on the proper host13:20
pabelangerwhen you say sending a file down, you mean between nodes?13:21
mriedemi want to define a nova policy.yaml file in my job and then transfer it to the controller host13:22
mriedemi could do this with hacking devstack, but that seems like the wrong way13:22
mriedemso i'm assuming i can use the copy module https://docs.ansible.com/ansible/latest/modules/copy_module.html#copy-module to send a file to the controller and build the dest param from zuul variables13:24
pabelangerso, I am not aware of an existing job to do that, however that concept is pretty standard in ansible.  It sounds like we just need to figure out where it is defined and use the synchronize task to copy it to controller.13:24
pabelangeryah, copy also works too13:24
mriedemcan i write the file contents in the job def using a variable? or do i need a real policy.yaml file somewhere in the nova repo to copy?13:25
*** mtreinish has joined #openstack-infra13:25
mriedemforgive my ansible ignorance13:25
mriedemwas thinking like:13:25
mriedemvars:13:25
mriedem   policy_yaml: |13:26
mriedem       some.nova.policy.rule=rule:admin_or_owner13:26
pabelangeryou could do it that way, but you'd then need to use template module to write it on the controller13:26
mriedemheh i suppose i should just cat it13:26
mriedem*er not cat13:26
mriedemjust write it out with a remote exec13:26
mriedemalthough i'm not sure in what order things run in these jobs, i.e. i really need this in post-config once the /etc/nova dir is setup13:29
*** yamamoto has quit IRC13:31
mriedemi think i can maybe fart around after looking through the existing tasks here http://logs.openstack.org/22/655222/9/check/nova-multi-cell/3596d01/ara-report/13:32
mriedemthanks13:33
*** mriedem has quit IRC13:33
*** e0ne has joined #openstack-infra13:34
*** Goneri has joined #openstack-infra13:38
*** e0ne has quit IRC13:41
*** markvoelker has joined #openstack-infra13:41
*** ianychoi has joined #openstack-infra13:42
*** auristor has joined #openstack-infra13:49
*** kjackal has quit IRC14:05
*** rascasoft has quit IRC14:06
*** rascasoft has joined #openstack-infra14:08
*** yamamoto has joined #openstack-infra14:09
*** kjackal has joined #openstack-infra14:11
*** markvoelker has quit IRC14:15
*** bobh has joined #openstack-infra14:16
*** yamamoto has quit IRC14:17
*** yamamoto has joined #openstack-infra14:18
*** bobh has quit IRC14:21
*** kjackal has quit IRC14:25
*** zbr|rover has quit IRC14:27
*** zbr has joined #openstack-infra14:30
*** slaweq has quit IRC14:32
openstackgerritSorin Sbarnea proposed openstack/diskimage-builder master: Bypass pip-and-virtualenv for later redhat distros  https://review.opendev.org/65663614:34
*** zbr is now known as zbr|rover14:35
*** armax has joined #openstack-infra14:36
*** efried has joined #openstack-infra14:37
*** efried1 has joined #openstack-infra14:39
*** jtomasek has quit IRC14:40
*** slaweq has joined #openstack-infra14:41
*** efried has quit IRC14:42
fungii'm planning to be in the security sig bof (room 507) first today14:42
clarkbIm going to be un 4b for the openlab session14:43
*** efried1 has quit IRC14:44
*** mriedem has joined #openstack-infra14:45
zbr|roverpabelanger: hi14:49
*** dklyle has joined #openstack-infra14:49
pabelangero/14:52
corvusmriedem: yeah copy module can work like that -- use "content" instead of "src" to use the string yaml in the value as the content of the file instead of an existing file on disk14:55
corvuswe do that in opendev to write out some simple config files14:55
corvuser, make that "the string value in the yaml"14:56
*** e0ne has joined #openstack-infra14:56
mriedemcorvus: thanks14:56
*** mattw4 has joined #openstack-infra15:01
zbr|roverpabelanger: re DIB and the fact that f28 virtualenv is messed by current version of pip-and-virtualenv element....15:01
zbr|rovermy take on that is we cannot really perform a virtualenv install from source without messing the system version, and probably we are better off not doing in on newer platforms.15:02
pabelangerzbr|rover: sure, understand. ianw is running point there, however as another way, without updating did, if you set that variable in your downstream nodepool.yaml, you don't even mess with source installs of pip and virtualenv, it should just ensure that the distro versions are installed15:03
pabelangerso, that could be another way of getting virtualenv working, without having to do a DIB release and carry more code in the source-pip-and-virtual files15:04
pabelangerzbr|rover:however, it should work on fedora-29, I use it without issues for downstream stuff too15:04
zbr|roverpabelanger: sure, going to look now into that as it would be faster to do it this way. and we can look to sort the upstream logic later, with less pressure.15:04
zbr|rovermainly I do not have anything against installing source versions using --user --- so they do not override the system ones.15:05
zbr|roverthe problem comes when you start to override system files (symlinks, modules,....)15:05
pabelangerzbr|rover: yah, I know with fedora we do some special things for openstack, but at the cost of modifying OS level pip / virtualenv. But we may have to rethink that process with releae of rhel8 / centos8 and multiple system level pythons15:06
*** dims has quit IRC15:09
*** yamamoto has quit IRC15:09
*** e0ne has quit IRC15:10
*** e0ne has joined #openstack-infra15:11
*** dims has joined #openstack-infra15:17
*** e0ne has quit IRC15:19
*** efried has joined #openstack-infra15:19
*** dklyle has quit IRC15:22
zbr|roverpabelanger: is this what you suggested? https://softwarefactory-project.io/r/#/c/15462/15:22
pabelangerzbr|rover: exactly15:24
pabelangerby default DIB will do source installs15:24
*** slaweq has quit IRC15:30
openstackgerritDavid Ames proposed openstack/project-config master: Add new Keystone SAML Mellon charm repositories  https://review.opendev.org/65665715:36
zbr|roverpabelanger: thanks.15:38
mriedemcorvus: like this? https://review.opendev.org/#/c/656656/1/roles/setup-multi-cell-policy/tasks/main.yaml15:39
pabelangernp15:39
* mriedem is an ansible newb15:39
*** mriedem has quit IRC15:40
*** e0ne has joined #openstack-infra15:40
openstackgerritNicolas Hicher proposed openstack/diskimage-builder master: openssh-server: harden sshd config  https://review.opendev.org/65389015:42
openstackgerritDavid Ames proposed openstack/project-config master: Add new Keystone SAML Mellon charm repositories  https://review.opendev.org/65665715:42
clarkbnow 505/506 to see fatih talk zuul and banking15:44
*** Lucas_Gray has joined #openstack-infra15:44
*** bnemec has quit IRC15:44
*** mriedem has joined #openstack-infra15:46
*** slaweq has joined #openstack-infra15:49
fungias am i15:50
*** rascasoft has quit IRC15:51
*** yamamoto has joined #openstack-infra15:52
*** rascasoft has joined #openstack-infra15:52
*** gyee has joined #openstack-infra15:54
*** bnemec has joined #openstack-infra15:55
*** yamamoto has quit IRC15:56
*** Lucas_Gray has quit IRC16:00
*** noama has quit IRC16:02
*** igordc has joined #openstack-infra16:02
*** gmann has joined #openstack-infra16:12
clarkbour vexxhost sjc1 nodes are failing nodepool ssh connection checks so aren't being used16:14
clarkbthe ssh connectivity is going over ipv6 so could be related to the addition of ipv6 there16:14
clarkbI can ping6 opendev.org so ipv6 is working there at some level16:16
*** yboaron_ has quit IRC16:16
*** Lucas_Gray has joined #openstack-infra16:18
*** shardy has quit IRC16:19
*** tjgresha has joined #openstack-infra16:21
*** jpich has quit IRC16:25
*** e0ne has quit IRC16:25
*** sshnaidm has joined #openstack-infra16:28
*** rfolco has joined #openstack-infra16:29
*** rfolco|pto has quit IRC16:29
*** bobh has joined #openstack-infra16:29
*** imacdonn has quit IRC16:30
*** imacdonn has joined #openstack-infra16:31
fungiaspiers: when you get a break, last sentence of https://docs.openstack.org/infra/system-config/irc.html#logging is what you're looking for16:35
*** slaweq has quit IRC16:36
fungiafter the break i'll be in 507 for diversity wg discussions the next two schedule slots16:37
*** mriedem has quit IRC16:38
openstackgerritAndreas Jaeger proposed openstack/project-config master: Remove barbican api-ref  https://review.opendev.org/65667116:38
*** michael-beaver has joined #openstack-infra16:39
*** whoami-rajat has quit IRC16:40
*** sshnaidm has quit IRC16:40
*** bnemec has quit IRC16:43
*** slaweq has joined #openstack-infra16:44
*** mriedem has joined #openstack-infra16:45
*** efried has quit IRC16:45
*** e0ne has joined #openstack-infra16:54
corvusmrhillsman: lgtm16:57
corvusmriedem: ^  ( sorry mrhillsman )16:57
*** Wryhder has joined #openstack-infra16:57
mriedemthanks16:58
*** bnemec has joined #openstack-infra16:58
*** Lucas_Gray has quit IRC16:59
*** Wryhder is now known as Lucas_Gray16:59
corvusevrardjp: https://docs.opendev.org/opendev/base-jobs/latest/docker-image.html  for your reading pleasure17:00
openstackgerritIvan Kolodyazhny proposed openstack/reviewstats master: Add cinder-tempest-plugin repository for Cinder  https://review.opendev.org/65667517:01
*** mriedem has quit IRC17:04
*** whoami-rajat has joined #openstack-infra17:06
openstackgerritMerged zuul/nodepool master: Fix leaked loggers  https://review.opendev.org/65657517:09
*** Weifan has joined #openstack-infra17:11
*** mattw4 has quit IRC17:11
*** jtomasek has joined #openstack-infra17:11
evrardjpcorvus thanks17:12
openstackgerritIvan Kolodyazhny proposed openstack/project-config master: Retire xstatic-vis and xstatic-angular-ui-router projects  https://review.opendev.org/65668017:13
*** Lucas_Gray has quit IRC17:16
*** Weifan has quit IRC17:19
*** igordc has quit IRC17:19
*** e0ne has quit IRC17:21
*** Weifan has joined #openstack-infra17:23
*** Weifan has quit IRC17:24
*** Weifan has joined #openstack-infra17:25
*** bnemec has quit IRC17:25
*** bobh has quit IRC17:27
*** Weifan has quit IRC17:28
kota_hello anyone knows how we could setup a library from master branch in github in *devstack* gate job?17:31
kota_for fixing py3 compatibility issue, we want to use eventlet master at github.com/eventlet/eventlet but no idea how to setup for devstack gate template.17:32
Shrewsinfra-root: restarting nodepool launchers to pick up a memory leak fix17:33
clarkbShrews: +117:33
clarkbkota_: you'll likely need to modify devstack to do that. I think it currently only knows how to install openstack libs from source17:33
clarkbkota_: the opnstack-qa channel may be a better place to ask though17:34
Shrews#status log Nodepool launchers restarted on commit f58a2a2b68c58f9626170795dba10b75e96cd551 to pick up memory leak fix17:34
openstackstatusShrews: finished logging17:34
kota_clarkb: i see, will try to the openstack-qa channel17:35
mordredSotK: I believe timburke is the one who was telling us about the swift-all-in-one-with-keystone17:35
kota_clarkb: quick question to understand how the gate works. the devstack in the gate working under tox virtualenv? or system-wide?17:36
kota_ah, it might be also for #openstack-qa channel.17:36
openstackgerritSean McGinnis proposed openstack/reviewstats master: Raise hacking version and fix pep8 errors  https://review.opendev.org/65591117:37
openstackgerritSean McGinnis proposed openstack/reviewstats master: Raise hacking version and fix pep8 errors  https://review.opendev.org/65591117:38
*** efried has joined #openstack-infra17:38
*** bnemec has joined #openstack-infra17:39
*** slaweq has quit IRC17:40
openstackgerritSean McGinnis proposed openstack/reviewstats master: Add cinderlib repository for Cinder  https://review.opendev.org/65668217:41
*** slaweq has joined #openstack-infra17:43
*** mattw4 has joined #openstack-infra17:49
*** sshnaidm has joined #openstack-infra17:53
*** slaweq has quit IRC17:54
*** Weifan has joined #openstack-infra17:54
*** dciabrin has joined #openstack-infra17:55
*** bnemec has quit IRC18:03
*** e0ne has joined #openstack-infra18:04
openstackgerritIvan Kolodyazhny proposed openstack/project-config master: Retire xstatic-vis and xstatic-angular-ui-router projects  https://review.opendev.org/65668018:06
*** e0ne has quit IRC18:10
*** e0ne has joined #openstack-infra18:10
*** jamesmcarthur has joined #openstack-infra18:10
mnaserclarkb: running ping6 since yesteday18:16
mnaserhttps://www.irccloud.com/pastebin/iwcCCtnt/18:16
mnaserwhat's the nodepool ip so I can try and do some troubleshooting.. maybe the problem is on the nodepool side and not our cloud?18:17
clarkbmnaser: 2604:e100:3:0:f816:3eff:fede:2089 was an example dest ip and trying to ssh from 2001:4800:7818:104:be76:4eff:fe04:924018:21
clarkbmnaser: I can ping6 opendev.org from 2001:4800:7818:104:be76:4eff:fe04:924018:21
*** mriedem has joined #openstack-infra18:21
clarkbmnaser: is it possible the hosts aren't getting RAs in a reasonable amount of time? (nodepool will retry ssh connections for some time before timing out)18:21
*** e0ne has quit IRC18:22
*** kjackal has joined #openstack-infra18:22
mnaserclarkb: could be? I can double check how often we send RA's18:22
mnaserthat's a valid possibility18:22
mnaserclarkb: do you think you can try ssh-ing into a freshly provisioned machine over ipv4?18:22
clarkbmnaser: ya I can boot one outside of nodepool and then try to get on via ipv318:23
*** Goneri has quit IRC18:23
*** e0ne has joined #openstack-infra18:25
*** e0ne has quit IRC18:25
clarkbhrm not sure how to boot from volume with openstackclient18:27
clarkbdo I really have to create a volume first ?18:27
mnaserwith openstackclient... yes ;(18:32
*** dciabrin has quit IRC18:33
clarkbmnaser: I've booted clarkb-test in sjc1 uuid 1ac45415-c165-401e-bb1f-0fb7b93375dc18:35
clarkbI can't hit it on ipv4 or ipv6 yet18:35
clarkbit is possible this is an imag eproblem though the same image is working on other clouds I think18:35
clarkbit is about 4 minute sold18:35
clarkb(also possible that I did something wrong in the create a volume from an image then boot from it process)18:35
*** dklyle has joined #openstack-infra18:39
mnaserclarkb: did you want to check console logs and see what’s up with?18:42
*** jamesmcarthur has quit IRC18:44
*** dklyle has quit IRC18:45
clarkbmnaser: there werent any18:51
*** jamesmcarthur has joined #openstack-infra18:52
*** kjackal has quit IRC18:55
*** jamesmcarthur has quit IRC19:02
*** jamesmcarthur has joined #openstack-infra19:04
*** sshnaidm has quit IRC19:05
*** jamesmcarthur has quit IRC19:09
*** jamesmcarthur has joined #openstack-infra19:14
*** jamesmcarthur has quit IRC19:17
*** Goneri has joined #openstack-infra19:18
*** jamesmcarthur has joined #openstack-infra19:19
*** ijw has joined #openstack-infra19:21
*** ijw has quit IRC19:25
*** ijw has joined #openstack-infra19:26
*** mriedem has quit IRC19:29
*** ijw has quit IRC19:30
*** dciabrin has joined #openstack-infra19:32
*** e0ne has joined #openstack-infra19:36
clarkbmnaser: ya no console log and no networking. So either I didn't do boot from volume properly, our image is broken, or the hypervisor is sad?19:36
mnaserclarkb: I am heading back to venue (in an Uber now :)) and I’ll check this out. Surprised console log shows nothing19:37
*** efried has quit IRC19:38
clarkbmnaser: ya it exits 0 with no output on stderr or stdout19:38
*** ramishra has joined #openstack-infra19:39
openstackgerritIvan Kolodyazhny proposed openstack/project-config master: Retire xstatic-vis and xstatic-angular-ui-router projects  https://review.opendev.org/65668019:42
*** dklyle has joined #openstack-infra19:42
*** ramishra has quit IRC19:45
*** bnemec has joined #openstack-infra19:47
*** markvoelker has joined #openstack-infra20:00
*** efried has joined #openstack-infra20:02
mnaserclarkb: hmm https://usercontent.irccloud-cdn.com/file/7LCNdYxE/image.png20:03
clarkbmnaser: ok so good chance I did boot from volume wrong20:04
clarkbI created a volume with the --image flag then did server create --volume that-volume20:04
mnaserthat seems right20:05
mnaserim gonna try to see a node pool booted vm20:06
clarkbdo I need to set a flag to make it a bootable volume?20:06
mnaserI just found an arbitrarily booted vm by nodepool20:06
mnaser38.108.68.20820:06
mnaserpingable over ipv420:06
mnaserwanna check if it has ipv6?20:07
clarkbthat one has come up20:08
fungiyeah, 2604:e100:3:0:f816:3eff:fe86:22ec is reachable for me20:08
clarkb2604:e100:3:0:f816:3eff:fe86:22ec/64 is its address and I can telnet to port 2220:08
fungii can ssh in20:08
mnaserI was just trying to arbitrarily pick one that seems to be failing somehow and we can login and see what happens there20:08
clarkbok here is a thing looking at logs it seems to be xenial not bionic?20:09
clarkbso maybe there is something wrong with our image?20:09
mnaserso maybe the bionic image was borked?20:09
clarkbs/bionic/xenial/ but ya20:10
mnaserah yes20:10
clarkblet me look at hashes20:10
*** markvoelker has quit IRC20:12
clarkbhrm ya the checksums we have in nb02.openstack.org:/opt/nodepool_dib don't match what glance reports20:13
clarkbI thoguth we provided the checksum on upload and glance is supposed to error if they don't match?20:13
clarkbfungi: can you cross check ^ that for me just to make sure I'm not crazy?20:13
clarkbbut if that is the case maybe we delete the image and see if a new upload is happier?20:14
clarkboh ya its size is totally off too20:16
*** bnemec has quit IRC20:16
clarkbwe've also filled the disk on nb0120:17
clarkbI'm going to delete the image in sjc1 and that should force a reupload iirc20:18
fungilooking now... been handling a private request to redact something from mailing list archives20:26
*** slaweq has joined #openstack-infra20:27
fungiclarkb: recent nova is supposed to check glance checksums before booting, but i think cinder does not yet20:28
clarkbfungi: the issue was the image in glance was smaller tha  ehat we had on disk and a different checksum20:28
fungi#status log redacted a phone number from posts to the women-of-openstack mailing list in response to a forwarded private request20:29
clarkbI would expect glance to check the checksum we provide against what it received but doesnt appear to20:29
openstackstatusfungi: finished logging20:29
fungiclarkb: that may be an optimization to consider for the sdk?20:29
clarkbin any case nodepool should be deleting that bad jmage and switching to the older one20:29
fungias in, make sure glance reports the expected checksum for what i think i uploaded20:29
corvusi had a vague idea that the checksums were just used by the sdk to determine whether an image was changed?20:30
*** Goneri has quit IRC20:36
*** pcaruana has quit IRC20:42
*** dklyle has quit IRC20:44
*** Lucas_Gray has joined #openstack-infra20:45
*** e0ne has quit IRC20:47
*** Goneri has joined #openstack-infra20:49
*** rcernin has quit IRC20:53
*** dklyle has joined #openstack-infra20:53
*** jtomasek has quit IRC20:54
*** jamesmcarthur has quit IRC20:57
*** dklyle has quit IRC20:59
*** efried has quit IRC21:01
*** dciabrin has quit IRC21:06
*** dciabrin has joined #openstack-infra21:06
*** dciabrin has quit IRC21:13
*** jamesmcarthur has joined #openstack-infra21:14
*** slaweq has quit IRC21:15
*** sthussey has joined #openstack-infra21:22
*** ijw has joined #openstack-infra21:24
*** mriedem has joined #openstack-infra21:26
*** e0ne has joined #openstack-infra21:32
*** bnemec has joined #openstack-infra21:32
*** dklyle has joined #openstack-infra21:34
*** e0ne has quit IRC21:34
*** ijw has quit IRC21:34
*** ijw has joined #openstack-infra21:35
*** e0ne has joined #openstack-infra21:39
*** ijw has quit IRC21:39
*** e0ne has quit IRC21:47
*** dklyle has quit IRC21:50
*** jamesmcarthur has quit IRC21:51
*** jamesmcarthur has joined #openstack-infra21:52
*** dklyle has joined #openstack-infra21:56
*** rfarr has quit IRC21:57
*** jamesmcarthur has quit IRC21:57
*** jamesmcarthur has joined #openstack-infra21:59
*** e0ne has joined #openstack-infra22:03
*** mriedem has quit IRC22:04
*** dklyle has quit IRC22:06
*** rh-jelabarre has quit IRC22:06
*** bnemec has quit IRC22:07
*** slaweq has joined #openstack-infra22:09
*** efried has joined #openstack-infra22:13
*** rlandy is now known as rlandy|bbl22:18
*** whoami-rajat has quit IRC22:20
*** tjgresha_nope has joined #openstack-infra22:22
*** tjgresha has quit IRC22:25
*** jamesmcarthur has quit IRC22:30
*** kei-ichi has joined #openstack-infra22:33
*** e0ne has quit IRC22:34
*** dklyle has joined #openstack-infra22:36
*** Goneri has quit IRC22:41
*** dklyle has quit IRC22:42
*** slaweq has quit IRC22:44
fungiinfra(/opendev?) project update starting now22:45
*** dciabrin has joined #openstack-infra22:51
*** samueldmq has joined #openstack-infra22:53
*** slaweq has joined #openstack-infra22:54
*** mriedem has joined #openstack-infra22:58
*** bnemec has joined #openstack-infra22:59
*** Weifan has quit IRC23:01
*** lmiccini has quit IRC23:01
mriedemcorvus: btw that copy task worked, thanks again23:01
fungithat's excellent news23:02
*** Weifan has joined #openstack-infra23:02
*** bdodd has quit IRC23:04
*** efried has quit IRC23:05
*** slaweq has quit IRC23:07
*** lmiccini has joined #openstack-infra23:08
*** aaronsheffield has quit IRC23:09
*** Lucas_Gray has quit IRC23:09
*** rcernin has joined #openstack-infra23:10
*** bnemec has quit IRC23:11
*** e0ne has joined #openstack-infra23:11
clarkbremote:   https://review.opendev.org/656719 Fixes for the Denver 2019 project update23:12
*** dklyle has joined #openstack-infra23:13
*** yamamoto has joined #openstack-infra23:18
fungiwe ought to switch to a wildcard branch match for the opendev/publications repo in gerritbot23:24
clarkbfungi: I have that change up thought it needs work after renames23:25
clarkbs/thought/though/23:25
fungiaha, then i shall endeavor to just find yours and not duplicate that effort23:29
fungibut maybe not until after dinner23:29
*** bnemec has joined #openstack-infra23:33
*** e0ne has quit IRC23:38
*** dklyle has quit IRC23:39
*** Weifan has quit IRC23:39
*** betherly has quit IRC23:46
*** mriedem has quit IRC23:48
*** gyee has quit IRC23:49
paladoxbtw https://bugs.chromium.org/p/gerrit/issues/detail?id=10381 is the issue i opened fungi clarkb corvus23:54
*** bnemec has quit IRC23:54
*** betherly has joined #openstack-infra23:56
fungineat! maybe we won 't have to abandon using the /p/ urls then23:56
paladoxthat issue's been open for a while :)23:56
paladoxthough i did ask one of the maintainers about it in a pm.23:57
paladoxso he may look at it next week (he said)23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!