Thursday, 2016-09-08

*** xarses has quit IRC00:01
*** ducttape_ has quit IRC00:12
*** ducttape_ has joined #puppet-openstack00:20
*** iurygregory_ has quit IRC00:26
*** ducttape_ has quit IRC00:30
openstackgerritDavid Moreau Simard proposed openstack/puppet-magnum: Add SSL support for magnum::api  https://review.openstack.org/36699200:37
openstackgerritDavid Moreau Simard proposed openstack/puppet-openstack-integration: Add magnum support to scenario002  https://review.openstack.org/36701200:39
openstackgerritDavid Moreau Simard proposed openstack/puppet-tempest: Add support for testing magnum  https://review.openstack.org/36700900:41
openstackgerritDavid Moreau Simard proposed openstack/puppet-openstack-integration: Add magnum support to scenario002  https://review.openstack.org/36701200:42
*** ducttape_ has joined #puppet-openstack00:43
*** cdelatte has quit IRC00:51
*** saneax is now known as saneax-_-|AFK00:52
openstackgerritDavid Moreau Simard proposed openstack/puppet-magnum: Add SSL support for magnum::api  https://review.openstack.org/36699200:55
*** ducttape_ has quit IRC01:03
*** xiaohua has joined #puppet-openstack01:11
*** ducttape_ has joined #puppet-openstack01:14
*** xiaohua has quit IRC01:19
*** xiaohua has joined #puppet-openstack01:20
*** xiaohua has quit IRC01:22
*** xiaohua has joined #puppet-openstack01:22
openstackgerritMarcus Furlong proposed openstack/puppet-ceilometer: fix broken join that stops polling service from starting  https://review.openstack.org/36609801:28
*** ducttape_ has quit IRC01:28
*** xiaohua has quit IRC01:32
*** xiaohua has joined #puppet-openstack01:33
*** xiaohua has quit IRC01:35
*** xiaohua has joined #puppet-openstack01:35
*** ducttape_ has joined #puppet-openstack01:36
*** openstack has joined #puppet-openstack01:44
*** ilbot3 has quit IRC01:46
*** ilbot3 has joined #puppet-openstack01:48
openstackgerritDavid Moreau Simard proposed openstack/puppet-magnum: Add SSL support for magnum::api  https://review.openstack.org/36699201:56
openstackgerritDavid Moreau Simard proposed openstack/puppet-tempest: Add support for testing magnum  https://review.openstack.org/36700901:58
openstackgerritMarcus Furlong proposed openstack/puppet-ceilometer: fix broken join that stops polling service from starting  https://review.openstack.org/36609802:03
*** michapma_alt has joined #puppet-openstack02:24
*** xarses has joined #puppet-openstack02:29
*** ducttape_ has quit IRC02:31
*** ducttape_ has joined #puppet-openstack02:32
*** ducttape_ has quit IRC02:34
openstackgerritDavid Moreau Simard proposed openstack/puppet-magnum: Add SSL support for magnum::api  https://review.openstack.org/36699202:36
*** jperry has joined #puppet-openstack02:37
*** foxhunt_away has quit IRC02:38
openstackgerritMerged openstack/puppet-keystone: Ensure endpoints created before admin_token_auth  https://review.openstack.org/36695002:39
openstackgerritDavid Moreau Simard proposed openstack/puppet-tempest: Add support for testing magnum  https://review.openstack.org/36700902:41
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: haproxy/glance-api: set 90m client/server  https://review.openstack.org/36705502:43
openstackgerritMerged openstack/puppet-cinder: Establish cinder_type after keystone_endpoint  https://review.openstack.org/36695102:47
openstackgerritMerged openstack/puppet-swift: Keystone endpoints should go before the service  https://review.openstack.org/36694902:47
*** ducttape_ has joined #puppet-openstack02:56
*** ducttape_ has quit IRC03:35
*** xiaohua has quit IRC04:11
*** xiaohua has joined #puppet-openstack04:11
*** xiaohua_ has joined #puppet-openstack04:16
*** xiaohua has quit IRC04:16
*** markvoelker has quit IRC04:30
*** markvoelker has joined #puppet-openstack04:31
*** ducttape_ has joined #puppet-openstack04:36
*** xiaohua_ has quit IRC04:36
*** xiaohua has joined #puppet-openstack04:38
*** ducttape_ has quit IRC04:40
*** xiaohua has quit IRC04:46
*** xiaohua has joined #puppet-openstack05:05
*** jaosorior has joined #puppet-openstack05:10
*** xiaohua has quit IRC05:10
*** xiaohua has joined #puppet-openstack05:22
*** ducttape_ has joined #puppet-openstack05:37
*** xiaohua has quit IRC05:38
*** xiaohua has joined #puppet-openstack05:39
*** richm has quit IRC05:40
*** ducttape_ has quit IRC05:41
*** xiaohua has quit IRC05:46
*** furlongm_ has joined #puppet-openstack05:59
*** furlongm has quit IRC06:00
rski"ERROR tempest.scenario.manager OSError: [Errno 12] Cannot allocate memory"06:00
*** xiaohua has joined #puppet-openstack06:00
rskiis this a transient error as well?06:00
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Fetch internal certificates for HAProxy based on network  https://review.openstack.org/36654806:04
*** snarwade has joined #puppet-openstack06:05
*** furlongm_ has quit IRC06:15
*** xiaohua has quit IRC06:23
*** furlongm has joined #puppet-openstack06:23
*** saneax-_-|AFK is now known as saneax06:36
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Fetch internal certificates for HAProxy based on network  https://review.openstack.org/36654806:36
*** ducttape_ has joined #puppet-openstack06:38
*** ducttape_ has quit IRC06:43
*** xiaohua has joined #puppet-openstack06:46
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Fetch internal certificates for HAProxy based on network  https://review.openstack.org/36654806:49
*** jpena|away is now known as jpena|off06:52
*** fxpester has joined #puppet-openstack06:57
*** rski has quit IRC06:58
*** rski has joined #puppet-openstack06:58
*** StarBeast has quit IRC07:02
*** tesseract- has joined #puppet-openstack07:04
*** hjensas has joined #puppet-openstack07:05
*** xiaohua has quit IRC07:16
*** maestropandy has joined #puppet-openstack07:25
*** maestropandy has left #puppet-openstack07:25
*** ifarkas_afk is now known as ifarkas07:33
*** openstackgerrit has quit IRC07:33
*** openstackgerrit has joined #puppet-openstack07:34
*** dtantsur|afk is now known as dtantsur07:42
*** dgurtner has joined #puppet-openstack07:45
openstackgerritOpenStack Proposal Bot proposed openstack/puppet-openstack-integration: Promote RDO repository to latest consistent URL  https://review.openstack.org/36715407:47
*** mkarpin has joined #puppet-openstack07:51
*** jpena|off is now known as jpena07:54
*** karthiks has joined #puppet-openstack07:57
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Fetch internal certificates for HAProxy based on network  https://review.openstack.org/36654807:58
*** maestropandy has joined #puppet-openstack08:00
*** maestropandy has left #puppet-openstack08:15
*** xarses has quit IRC08:21
*** shardy has joined #puppet-openstack08:26
*** mkarpin has quit IRC08:31
*** mkarpin1 has joined #puppet-openstack08:31
*** xarses has joined #puppet-openstack08:33
*** paramite has quit IRC08:34
*** jperry has quit IRC08:37
*** jaosorior is now known as jaosorior_lunch08:40
*** xiaohua has joined #puppet-openstack08:50
*** derekh has joined #puppet-openstack08:55
*** samuelBartel has joined #puppet-openstack08:55
*** maestropandy has joined #puppet-openstack09:03
openstackgerritMerged openstack/puppet-tripleo: Add class to write overcloud VIPs into /etc/hosts  https://review.openstack.org/35776209:29
*** ducttape_ has joined #puppet-openstack09:41
*** foxhunt72 has joined #puppet-openstack09:41
*** ducttape_ has quit IRC09:46
*** social_ has quit IRC09:50
*** richm has joined #puppet-openstack10:08
*** ducttape_ has joined #puppet-openstack10:42
*** ducttape_ has quit IRC10:47
*** ansmith has quit IRC10:56
*** jpena is now known as jpena|lunch10:59
openstackgerritMerged openstack/puppet-openstack-integration: Puppetfile: bump apache module to latest release  https://review.openstack.org/36695411:15
openstackgerritMerged openstack/puppet-openstack-integration: Add explicit dependencies to pass puppet4  https://review.openstack.org/36695611:16
*** rski has quit IRC11:18
*** maestropandy has quit IRC11:19
*** _degorenko|afk is now known as degorenko11:19
*** paramite has joined #puppet-openstack11:21
*** ducttape_ has joined #puppet-openstack11:43
*** jperry has joined #puppet-openstack11:46
*** ducttape_ has quit IRC11:48
EmilienMhello11:48
*** xiaohua has quit IRC11:50
*** xiaohua has joined #puppet-openstack11:51
*** xiaohua has quit IRC11:54
*** xiaohua has joined #puppet-openstack11:55
*** jaosorior_lunch is now known as jaosorior11:56
*** johnmilton has quit IRC11:59
colonwqEmilienM, Can I make today an official hate puppet on ubuntu day?11:59
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo: haproxy/glance-api: set 90m client/server  https://review.openstack.org/36705512:00
EmilienMcolonwq: why that?12:03
colonwqEmilienM, On trusty, ::service_provider is upstart. On centos7, ::service_provider is systemd. On xenial, ::service_provider is debian12:05
*** ansmith has joined #puppet-openstack12:06
EmilienMcolonwq: yes, we have been dealing with this problem since long time12:06
EmilienMiirc we decided to switch puppet-ceph support on Xenial starting from Jewel12:07
EmilienMso current master is Xenial12:07
EmilienMand stable/hammer is Trusty12:07
colonwqIt is causing problems here. I need to make a patch. https://github.com/openstack/puppet-ceph/blob/master/manifests/rgw.pp#L15812:08
colonwqIt is why the patch to add scenario 004 fails on xenial.12:08
*** dprince has joined #puppet-openstack12:09
*** trown|outtypewww is now known as trown12:09
colonwqthe xenial test fails to start rgw with a message of not being able to bind to 8080, the rgw port. This is because "service radosgw start" already started it once and systemctl attempts to restart.12:11
*** johnmilton has joined #puppet-openstack12:11
*** ducttape_ has joined #puppet-openstack12:11
EmilienMmake it work on xenial and that's it12:11
*** johnmilton has quit IRC12:11
colonwqEmilienM, Ok. I'll work it up and submit a patch today.12:12
*** johnmilton has joined #puppet-openstack12:12
EmilienMdmsimard: for magnum, how does it work with nova and neutron?12:13
EmilienMdmsimard: nothing to configure?12:13
*** alee_run has quit IRC12:13
*** jpena|lunch is now known as jpena12:21
*** dgurtner has quit IRC12:22
*** pradk has joined #puppet-openstack12:22
*** jperry has quit IRC12:29
iurygregorymorning12:31
*** xiaohua has quit IRC12:31
*** ducttape_ has quit IRC12:36
dmsimardEmilienM: I think I need to create a ssh keypair in p-o-i as part of setting up magnum because tempest won't create it12:41
EmilienMdmsimard: how magnum works?12:41
dmsimardthere's requirements on images and networks as well12:41
*** cdelatte has joined #puppet-openstack12:42
dmsimardI watched https://www.youtube.com/watch?v=_ZbebTIaS7M yesterday :P12:42
degorenkochem, are you here?12:43
EmilienMdmsimard: what about nova config?12:45
*** maestropandy has joined #puppet-openstack12:46
*** fultonj has joined #puppet-openstack12:46
*** fultonj has joined #puppet-openstack12:49
dmsimardEmilienM: don't believe there's anything in particular required for nova12:50
dmsimardiiuc magnum orchestrates containers on top of VMs (or bare metal)12:50
EmilienMah12:50
EmilienMcool12:50
*** fultonj has quit IRC12:50
dmsimardI can be proven wrong but that's my understanding of it12:51
*** jaosorior has quit IRC12:51
*** jaosorior has joined #puppet-openstack12:52
*** fultonj has joined #puppet-openstack12:53
*** maestropandy has quit IRC12:54
*** dgurtner has joined #puppet-openstack12:55
*** shardy is now known as shardy_mtg12:57
*** maestropandy has joined #puppet-openstack13:00
*** StraubTW has joined #puppet-openstack13:10
mjblackEmilienM: hey, got a sec?13:11
mjblackThis guy is saying that the python-rados package is a replacement for python-cradox since Xenial ships with jewel13:14
mjblackhttps://bugs.launchpad.net/cloud-archive/+bug/160484713:14
openstackLaunchpad bug 1604847 in Ubuntu Cloud Archive "cradox package dependency for gnocchi" [Undecided,Won't fix]13:14
*** shardy_mtg is now known as shardy13:14
*** xiaohua has joined #puppet-openstack13:20
*** xiaohua has quit IRC13:20
*** xiaohua has joined #puppet-openstack13:20
*** snarwade has quit IRC13:20
EmilienMmjblack: how can I help with ubuntu packaging things?13:24
mjblackEmilienM: I'm testing out the package right now to see if it works13:24
mjblackif it does, I'll submit a patch to master13:24
mjblacknot sure if we'd want to backport it to mitaka since it would be a xenial only change13:25
mjblacksorry xenial or newer13:25
*** ducttape_ has joined #puppet-openstack13:28
mjblackEmilienM: looks like he is right, I just tested it and so far no issues13:33
dtantsuriberezovskiy, hi! any news re https://review.openstack.org/#/c/365236/ ?13:36
*** jayg|g0n3 is now known as jayg13:39
*** xiaohua has quit IRC13:40
*** jperry has joined #puppet-openstack13:40
*** ducttape_ has quit IRC13:40
*** ducttape_ has joined #puppet-openstack13:41
*** ducttape_ has quit IRC13:41
*** ducttape_ has joined #puppet-openstack13:41
*** _ducttape_ has joined #puppet-openstack13:44
*** _ducttape_ has quit IRC13:45
*** _ducttape_ has joined #puppet-openstack13:45
iberezovskiydtantsur, hey, sorry for delay, I've prepared adapt patch. waiting for CI13:46
dtantsurthanks!13:46
*** ducttape_ has quit IRC13:48
*** jperry has quit IRC13:54
*** jperry has joined #puppet-openstack13:54
*** fultonj has quit IRC13:55
iurygregoryEmilienM, sorry I forgot to send the email that we didn't had the meeting =X13:56
EmilienMiurygregory: no worries13:56
iurygregoryEmilienM, Should I do now?13:57
EmilienMyeah if you want13:57
iurygregorydone o/13:57
*** fultonj has joined #puppet-openstack13:58
*** xarses has quit IRC14:01
mwhahahahmm openstackgerrit bot seems not to be working this morning14:02
mwhahahaat least not in here14:02
iurygregoryyeah14:02
*** _ducttape_ has quit IRC14:24
*** bnemec has quit IRC14:24
*** bnemec has joined #puppet-openstack14:27
*** xarses has joined #puppet-openstack14:40
*** dprince has quit IRC14:57
*** dprince has joined #puppet-openstack14:57
*** rski has joined #puppet-openstack15:01
openstackgerritMatthew J Black proposed openstack/puppet-gnocchi: Add python-rados package in ceph backend class.  https://review.openstack.org/36743815:08
mjblackEmilienM: ^ thats what we were discussing earlier, it'll fix the gnocchi storage ceph backend for ubuntu xenial15:08
EmilienMmjblack: sounds like we're solving packaging issue again :-D15:09
mjblackwell sorta15:09
mjblackcradox isnt offical package it seems and python-rados is...15:09
mwhahahai think gnocchi is broken15:09
mwhahahahttp://logs.openstack.org/94/366394/4/check/gate-puppet-openstack-integration-3-scenario001-tempest-centos-7/cd0bd1e/logs/gnocchi/app.txt.gz#_2016-09-08_13_43_16_57015:09
mwhahahaor the client is15:10
mwhahahaso scenario001 on centos is hosed15:10
EmilienMdamn15:11
EmilienMI saw that in tripleo CI too (now we test gnocchi for real)15:11
EmilienMpradk: we need you :)15:11
pradkreading up15:12
mwhahahaand scenaio003 runs out of memory, http://logs.openstack.org/22/367022/2/check/gate-puppet-openstack-integration-3-scenario003-tempest-centos-7/cb6e6f9/console.html#_2016-09-08_14_30_25_86630715:12
mwhahahahappy ci day15:13
mwhahaha(ノ´・ω・)ノ ミ ┸━┸15:13
pradkhmm thats new .. what version of packages are you using?15:14
*** fxpester has quit IRC15:14
mwhahahahttp://logs.openstack.org/94/366394/4/check/gate-puppet-openstack-integration-3-scenario001-tempest-centos-7/cd0bd1e/logs/rpm-qa.txt.gz15:14
mwhahahaopenstack-gnocchi-api-2.2.1-0.20160907002316.b2d64d2.el7.centos.noarch15:14
*** ducttape_ has joined #puppet-openstack15:15
pradkhmm seems like an upstream issue.. lemme check15:15
*** dfisher has joined #puppet-openstack15:15
pradkmwhahaha, who is making the request here? ceilo client or gnocchi client?15:15
mwhahahawhatever tempest does15:16
EmilienMpradk: we are on the edge lo15:16
EmilienMllol15:16
pradkmwhahaha, hmm tempest? so we're running tempest tests here and they fail?15:16
mwhahahahttp://logs.openstack.org/94/366394/4/check/gate-puppet-openstack-integration-3-scenario001-tempest-centos-7/cd0bd1e/console.html#_2016-09-08_13_44_31_04784215:17
mwhahahamight just be a bad test15:18
mwhahahasince some of the tests are ok15:18
openstackgerritKeith Schincke proposed openstack/puppet-ceph: Update radosgw service definition for Xenial  https://review.openstack.org/36745615:18
mwhahahagabbi.suitemaker.tempest.scenario.gnocchi.test_live_myresource_resource_complex_accept.test_request and gabbi.suitemaker.tempest.scenario.gnocchi.test_live_search_for_myresource_resource_via_user_id.test_request fail15:18
dmsimardEmilienM: the puppet module tarballs on tarballs.o.o, why are they prefixed by openstack- rather than puppet- ?15:22
dmsimardi.e, puppet-nova tarball extracts to openstack-nova-9.2.0/15:22
dmsimardI don't particularly mind but it doesn't seem accurate15:22
mwhahahathe actual name is openstack-nova i think15:23
mwhahahahttps://github.com/openstack/puppet-nova/blob/master/metadata.json#L215:23
EmilienMyes15:23
EmilienMit's the name in puppetlabs forge15:23
EmilienMthe namespace even15:23
dmsimardah.. eh15:23
EmilienMnamespace-modulename15:23
EmilienMopenstack-nova15:23
dmsimardokay, I guess15:23
pradkmwhahaha, so sounds like this might be a one time error.. sileht said he saw it this morning but went away with a rerun15:23
pradkmwhahaha, can you try recheck?15:24
mwhahahapradk: no it's happening repeatedly15:24
mwhahahaalready have15:24
mwhahahaon multiple changes15:24
pradkmwhahaha, hmm can you open a bug upstream against gnocchi.. we could just disbale that test and see15:24
pradkmwhahaha, the issue is wrong content type is sent15:25
pradkmwhahaha, but i dont know who is sending that15:25
mwhahahak15:26
*** StraubTW has quit IRC15:27
*** StraubTW has joined #puppet-openstack15:29
*** dtantsur is now known as dtantsur|afk15:29
*** dprince has quit IRC15:30
*** dprince has joined #puppet-openstack15:31
*** foxhunt72 is now known as foxhunt_away15:33
mwhahahapradk: https://bugs.launchpad.net/gnocchi/+bug/162153115:35
openstackLaunchpad bug 1621531 in Gnocchi "tempest failures due to invalid Content-Type" [Undecided,New]15:35
*** dprince has quit IRC15:37
EmilienMpradk, mwhahaha: I think we should revert RDO repo to be less recent15:40
EmilienMrecent gnocchi is breaking us15:40
pradkmwhahaha, thanks15:40
pradkyea perhaps, you just started seeing this today?15:41
*** _ducttape_ has joined #puppet-openstack15:44
*** ducttape_ has quit IRC15:44
mwhahahai just noticed it today15:45
mjblackmwhahaha: I have a CI going for gnocchi right now15:48
mjblackits finishing the centos and tripleo checks, so we can see if it was a one time issue15:48
mwhahahai've seen it on multiple, my assumption would be a tempest broken thing since i don't think we pin that15:49
mjblackyeah the ubuntu xenial change went through because it completely bypasses gnocchi15:50
*** leanderthal is now known as leanderthal|afk15:51
mjblackCI needs to be updated to support xenial gnocchi for that scenario test to work15:52
*** maestropandy has quit IRC15:55
*** saneax is now known as saneax-_-|AFK16:00
colonwqis github having issues? I have having problems pulling down modules for a local test of patches16:03
iurygregorycolonwq to download the repo?16:06
colonwqiurygregory, I am using r10k to pull down the files listed in the Puppetfile of a module I am testing. Today it is failing on one module out of >50 listed.16:08
iurygregoryi don't have this problem .-.16:09
colonwqWell crud. I'l reset the reset the test VM and see if it is resolved.16:10
iurygregorygood luck o/16:11
openstackgerritEmilien Macchi proposed openstack/puppet-openstack-integration: run_tests: disable gnocchi  https://review.openstack.org/36749016:13
EmilienMmwhahaha: ^16:13
mwhahahak16:13
colonwqiurygregory, The problem persists but I will manually work around by doing a 'git clone' until this Heisenberg issue clears.16:20
iurygregorycolonwq, Breaking Bad reference? O.o16:21
*** tesseract- has quit IRC16:21
*** trown is now known as trown|outtypewww16:23
colonwqiurygregory, that and physics. Something works correctly 100 times in a row, fails for no apparent reason and then works.16:23
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Terminate Zaqar websocket endpoint in HAProxy  https://review.openstack.org/36032916:24
iurygregorycolonwq, yeah XD16:25
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo: Terminate Zaqar websocket endpoint in HAProxy  https://review.openstack.org/36032916:26
*** dprince has joined #puppet-openstack16:31
*** fxpester has joined #puppet-openstack16:31
*** samuelBartel has quit IRC16:32
*** moravec has quit IRC16:45
*** derekh has quit IRC16:49
*** jperry has quit IRC16:51
*** jperry has joined #puppet-openstack16:52
*** jaosorior has quit IRC17:01
*** ducttape_ has joined #puppet-openstack17:01
*** _ducttape_ has quit IRC17:04
*** moravec has joined #puppet-openstack17:05
*** ducttape_ has quit IRC17:12
*** ducttape_ has joined #puppet-openstack17:13
*** jpena is now known as jpena|off17:21
*** michapma_alt has quit IRC17:23
EmilienMmhh, I see some failures in CI where scenario001 fails to create instances17:24
openstackgerritDimitri Savineau proposed openstack/puppet-tripleo: Cinder: Add iSCSI protocol parameter  https://review.openstack.org/36754217:24
EmilienMhttp://logs.openstack.org/90/367490/1/check/gate-puppet-openstack-integration-3-scenario001-tempest-centos-7/672d783/console.html#_2016-09-08_16_44_58_23712217:24
iurygregoryOSError: [Errno 12] Cannot allocate memory17:25
EmilienMhttp://logs.openstack.org/90/367490/1/check/gate-puppet-openstack-integration-3-scenario001-tempest-centos-7/672d783/logs/nova/nova-compute.txt.gz#_2016-09-08_16_46_04_67217:25
iurygregorysad =(17:25
EmilienMiurygregory: where do you see that?17:25
iurygregoryEmilienM, http://logs.openstack.org/90/367490/1/check/gate-puppet-openstack-integration-3-scenario001-tempest-centos-7/672d783/console.html#_2016-09-08_16_46_41_98820917:25
EmilienMoh indeed17:25
EmilienMhttp://logs.openstack.org/90/367490/1/check/gate-puppet-openstack-integration-3-scenario001-tempest-centos-7/672d783/logs/free.txt.gz17:26
EmilienMindeed free memory is low17:26
EmilienMshould we create a swapfile?17:26
EmilienMI think I tried one time17:26
EmilienMhttps://review.openstack.org/#/c/287279/17:26
iurygregoryif the host allow overcommit for memory it should be fine but a sawpfile can work17:27
openstackgerritSven Anderson proposed openstack/puppet-tempest: Add provider for ec2 credentials  https://review.openstack.org/36458017:29
xarsesmwhahaha: if you have a chance, please look at https://review.openstack.org/#/c/347956/17:32
mwhahahak17:33
mwhahahaxarses: any thoughts as to why some osds won't start when they were all rebooted? it's erroring in systemd because the start timeout is exceeding17:33
xarsesweird raid card?17:33
xarsesthere may still be issues with the udev discovery17:34
xarsesthe magic mounting relies on the udev rule being able to 1) read the partition GUUID, 2) that the device is ready to start by the time we try to mound it.17:35
xarsesI wonder if we should trigger the udev probe in the systemd unit, or some how make it delay later17:36
mwhahahait's not even getting to that point i don't think17:36
mwhahahaits int he pre startup phase it just hangs and exceeds the systemd start time17:36
mwhahahaeh fun with ceph day17:37
xarsesIs it happening regularly on VM's?17:40
xarsescolonwq: cheers!17:42
openstackgerritEmilien Macchi proposed openstack/puppet-openstack-integration: Add 2GB swap by default  https://review.openstack.org/36755117:44
*** ducttape_ has quit IRC17:45
*** jayg is now known as jayg|g0n317:47
*** jayg|g0n3 is now known as jayg17:48
openstackgerritEmilien Macchi proposed openstack/puppet-openstack-integration: Add 2GB swap by default  https://review.openstack.org/36755117:51
*** moravec has quit IRC17:52
*** moravec has joined #puppet-openstack17:56
EmilienMI hope adding swap will help17:56
iurygregoryEmilienM, me too you have my +1 haha18:01
*** ifarkas is now known as ifarkas_afk18:04
EmilienMI think i'll have to promote RDO CI in the same patch or our CI will never pass again18:05
*** ducttape_ has joined #puppet-openstack18:07
iurygregorygo ahead \o/18:19
*** chem is now known as chem|off18:19
*** dhollinger has quit IRC18:19
iurygregoryit's time to align starts18:20
*** degorenko is now known as _degorenko|afk18:20
*** dhollinger has joined #puppet-openstack18:20
*** skramaja has quit IRC18:24
*** karthiks has quit IRC18:24
*** EmilienM sets mode: +o mwhahaha18:28
*** iberezovskiy is now known as iberezovskiy|afk18:30
*** aimon has joined #puppet-openstack18:30
openstackgerritEmilien Macchi proposed openstack/puppet-openstack-integration: Align the stars to bring our CI back  https://review.openstack.org/36755118:38
EmilienMfolks, we're aligning stars again18:38
iurygregory\o/18:44
*** dmsimard is now known as dmsimard|afk18:45
openstackgerritBradley Klein proposed openstack/puppet-monasca: Add configuration of monasca agent vertica plugin  https://review.openstack.org/36629218:49
openstackgerritBradley Klein proposed openstack/puppet-monasca: Add configuration of monasca agent vertica plugin  https://review.openstack.org/36629218:50
openstackgerritSven Anderson proposed openstack/puppet-tempest: Add provider for ec2 credentials  https://review.openstack.org/36458018:50
colonwqEmilienM, Your 367551 patch can (hopefully) resolve many issues for me. Can I give it a +3?18:54
EmilienMcolonwq: let's wait if it works.18:55
colonwqEmilienM, No problem. I'll keep watch on the stars.18:56
EmilienMdamn it's failing on ubuntu, transient problem with apt repo18:58
iurygregorydamm it ubuntu why you do this D:18:58
iurygregoryEmilienM, you can read the logs while zuul is running? '-'19:00
EmilienMyes19:00
EmilienMgo on http://status.openstack.org/zuul/19:00
EmilienMand use https://etherpad.openstack.org/p/firefox-telnet19:00
openstackgerritBradley Klein proposed openstack/puppet-monasca: Add configuration of monasca agent vertica plugin  https://review.openstack.org/36629219:00
iurygregorywitchcraft <O>19:01
iurygregoryEmilienM, thanks \o/19:01
colonwqiurygregory, EmilienM https://cdn.meme.am/instances/500x/71589643.jpg19:02
iurygregorycolonwq, lol19:02
*** dgurtner has quit IRC19:03
*** johnmilton has quit IRC19:14
*** dprince has quit IRC19:16
*** aimon has quit IRC19:17
EmilienMok now our CI is broken because of Ubuntu19:19
EmilienMhttp://logs.openstack.org/51/367551/4/check/gate-puppet-openstack-integration-3-scenario002-tempest-ubuntu-xenial/1f154da/console.html#_2016-09-08_19_06_18_31302919:19
EmilienMI reported it on #ubuntu-server19:19
EmilienMerr http://logs.openstack.org/51/367551/4/check/gate-puppet-openstack-integration-3-scenario002-tempest-ubuntu-xenial/1f154da/console.html#_2016-09-08_19_06_18_31805719:20
EmilienMsounds like they upgraded something19:20
EmilienMand didn't test it, sigh19:20
EmilienMi'm disabling Ironic on our ubuntu jobs. anyone against?19:20
iurygregory+119:20
* colonwq is not against it. 19:22
openstackgerritEmilien Macchi proposed openstack/puppet-openstack-integration: Align the stars to bring our CI back  https://review.openstack.org/36755119:23
EmilienMdone19:23
*** samuelBartel has joined #puppet-openstack19:24
*** johnmilton has joined #puppet-openstack19:27
*** AnarchyAo has joined #puppet-openstack19:35
mwhahahapesky debian based packaging19:35
mwhahahastop trying to do stuff :D19:36
*** furlongm_ has joined #puppet-openstack19:38
*** furlongm has quit IRC19:38
*** aimon has joined #puppet-openstack19:39
*** aimon has quit IRC19:42
*** aimon has joined #puppet-openstack19:49
colonwqiurygregory, The command that were failing for me before are working now. Heisenberg.19:49
*** fxpester has quit IRC19:49
*** aimon has quit IRC19:49
iurygregorycolonwq, nice \o/ (did you turn off the computer? haha)19:50
openstackgerritBradley Klein proposed openstack/puppet-monasca: Add configuration of monasca agent vertica plugin  https://review.openstack.org/36629219:52
colonwqiurygregory, I did a virt undefine and a virt-clone. I did not even touch the hypervisor.19:53
*** dmsimard|afk is now known as dmsimard19:54
iurygregorycolonwq,good approach =D since most of ours problems will be solved by reboot the computer19:55
*** samuelBartel has quit IRC19:55
colonwqiurygregory, except the clones failed multiple times in a row. Damn clones.19:55
*** ducttape_ has quit IRC19:55
iurygregorycolonwq, for no good reason it failed =( its sad19:56
dmsimardmwhahaha: thanks for the magnum moral support, I don't do a whole lot of puppet anymore :P20:06
mwhahahano problem20:06
openstackgerritDavid Moreau Simard proposed openstack/puppet-magnum: Add SSL support for magnum::api  https://review.openstack.org/36699220:07
*** jperry has quit IRC20:07
*** jperry has joined #puppet-openstack20:08
*** cdelatte has quit IRC20:08
EmilienMdmsimard: I can't forget the icecream when I see magnum20:17
bkeroEmilienM: your ice cream definitely needs SSL support20:18
dmsimardI think of... something else20:18
dmsimardbut okay :)20:18
* _ody will not probably think if icecream20:18
*** ducttape_ has joined #puppet-openstack20:18
_odys/not/now20:18
EmilienMdmsimard: hum. is it sfw?20:18
iurygregoryhaha ^20:20
*** paramite has quit IRC20:22
*** aimon has joined #puppet-openstack20:24
*** jayg is now known as jayg|g0n320:24
EmilienM_ody: can we have your vote on https://review.openstack.org/#/c/367551/ please? missing one core review20:25
EmilienM(Ci is almost finished to run)20:25
mwhahahadmsimard: looks like magnum is broken or something, i'll take a look at it in a bit20:27
iurygregoryEmilienM, -1 from jenkis http://logs.openstack.org/51/367551/5/check/gate-puppet-openstack-integration-3-scenario001-tempest-ubuntu-xenial/9416303/20:27
iurygregoryi've put recheck20:28
dmsimardmwhahaha: you mean the beaker that just failed ? I'll look20:28
dmsimardmwhahaha: this is one of the reasons I want to add magnum to p-o-i, repository promotions can potentially break beaker tests if the project isn't tested20:28
dmsimardmwhahaha: like what we had for manila for milestone 2 I think20:29
EmilienMdamn20:29
mwhahahadmsimard: yea it's broken20:29
EmilienMthat's why we need more coverage in poi20:30
dmsimardhey it's not like I'm not trying to add magnum and designate or anything :p20:30
dmsimardonly have so much time to spend on that20:30
EmilienMstop taking PTO20:31
EmilienMyou're always on PTO20:31
dmsimardT_T20:31
dmsimardI don't take 3 or 4 weeks back to back like some people do :)20:31
iurygregoryI only have PTO in january =(20:32
dmsimardiurygregory: you have PTO for BCN *cough* beach *cough*20:33
mwhahahaPTO is for the weak, and the european20:33
EmilienMlol20:33
iurygregorydmsimard, BCN? .-.20:33
EmilienMmwhahaha: do I count? i live in NA now20:33
mwhahahacanada is the europe of north america20:34
mwhahahawith your no guns and free health care20:34
iurygregoryLOL20:34
dmsimardiurygregory: BCN is the airport for Barcelona :)20:34
dmsimardmwhahaha: yeah no kidding and if Trump gets elected, we'll build a wall to keep him out :D20:35
iurygregorydmsimard, haha i'm going to barcelona by my own i'll not have money to enjoy D:20:35
mwhahahapretty sure if he gets elected, we'll be building our own walls to keep him out20:36
yankcrimei think there's a problem with puppet-oslo in the way it handles boolean true or false, in cases where false should mean that the option isn't set20:39
yankcrimei'm looking at puppet-glance and trying to configure glance-{api,registry} to log to stderr20:39
openstackgerritDavid Moreau Simard proposed openstack/puppet-tempest: Add support for testing magnum  https://review.openstack.org/36700920:39
yankcrimewhich they should do if log_file isn't set (and use_stderr is set to true)20:39
yankcrimebasically if log_file is set to false in either glance::api or glance::logging::api then it's stringified and ends up in glance-api.conf as 'False'20:40
yankcrimeso glance-api logs to /var/log/glance/False20:40
yankcrimei'm happy to raise bugs / propose solutions, just looking for a bit of guidance20:41
yankcrimeright now i've got a conditional around log_file in glance::api::logging (as an example) which sets $log_file_real to $::os_service_default if $log_file is set to false20:42
yankcrimeotherwise it just uses the pick function as per before20:42
yankcrimeso yeah, looking for guidance really20:42
dmsimardmwhahaha: re: magnum20:42
dmsimardmwhahaha: it's a packaging issue, I'll fix it: http://logs.openstack.org/92/366992/7/check/gate-puppet-magnum-puppet-beaker-rspec-centos-7/b678559/logs/syslog.txt.gz#_Sep_08_20_22_4920:43
* iurygregory reading20:43
mwhahahadmsimard: k20:43
dmsimardSee the problems we find when extending testing coverage? :D20:43
mwhahahayankcrime: so we use the same method for true/false everywhere20:44
*** ansmith has quit IRC20:44
mwhahahathat sounds like an issue with the config parsing20:44
iurygregoryyankcrime, log_file shoud be the file path20:44
*** aimon has quit IRC20:44
iurygregoryif you set false it will create a file with that name i think20:45
mwhahahayea but the point is he's trying to turn it off20:45
mwhahahalet me look at the code20:45
*** ducttape_ has quit IRC20:46
yankcrimeiurygregory: sorry, i thought that's what i just explained20:47
mwhahahayankcrime: if you want it off you should set glance::api::logging::log_file = $::os_service_default20:47
mwhahahanot to false20:47
mwhahahasame for registry20:47
iurygregoryif you set any value it will be used20:47
yankcrimemwhahaha: ok, that's basically what i've ended up with20:48
yankcrimeit's just the comment that needs correcting then20:48
mwhahahawhich comment tells you to set it to false?20:48
yankcrime 34 #   If set to boolean false, it will not log to any file.20:48
yankcrime(from api.pp)20:48
yankcrimeprobably the same in registry.pp20:48
mwhahahais it being written as 'False' to the config with quotes?20:49
yankcrimemwhahaha: without quotes20:49
*** shardy has quit IRC20:49
mwhahahaso that's a bug in oslo.logging then20:49
mwhahahabecause we turned it into a python boolean that's being interpreted as a string20:50
yankcrimeactually let me double-check that20:50
mwhahahasetting to $::os_service_default will just remove the item from the config file and fall back to whatever the service default is20:50
mwhahahawhich may or maynot be stderr20:50
iurygregoryyou can set use_stderr too20:51
yankcrimemwhahaha: which is the behaviour i'm after20:51
yankcrimeiurygregory: you have to set that to true and unset log_file20:52
mwhahahaso yea there's probably a few issues, the first being that the comment is wrong20:52
mwhahahai'm sure it's wrong in a bunch of other places as well20:52
iurygregoryyankcrime, can be =) log_file = $::os_service_default and use_stderr=true20:53
yankcrimemwhahaha: ok, i'll raise a bug in puppet-glance which at least describes the behaviour and then we can take it from there20:53
yankcrimeiurygregory: yeah that's pretty much what i've ended up with20:53
*** ducttape_ has joined #puppet-openstack20:55
*** ducttape_ has quit IRC20:55
*** aimon has joined #puppet-openstack20:57
openstackgerritPradeep Kilambi proposed openstack/puppet-panko: Implement Panko Api service  https://review.openstack.org/36230521:07
yankcrimemwhahaha: setting it to false in puppet results in the line 'log_file = False' in glance-api.conf and glance-registry.conf21:46
yankcrimewhich in turn means logging to a file called False under /var/log/glance :)21:47
yankcrimeso yeah, without quotes as i said - just needed to double-check before i start digging around oslo.logging21:48
mwhahahaok21:48
_odyEmilienM: Looking.21:48
yankcrimein the meantime i'll at least raise a bug against puppet-glance and get that comment fixed21:48
yankcrimethanks for the help!21:50
mwhahahayankcrime: sure, thanks for reporting it21:53
mwhahahai'll take a look at some of the other modules as well to make sure we don't have other places with bad docs21:53
dmsimardmwhahaha: trying to fix magnum asap but fell into a rabbit hole21:58
EmilienMhe always falls, last time was Designate21:59
dmsimardI'm about to /nick rabbit if I keep falling into these21:59
EmilienMbtw what's up with dnsaas?21:59
mwhahaha:D dependency hell21:59
dmsimardEmilienM: the tempest part will be unblocked once https://review.rdoproject.org/r/#/c/2136/ lands in which your opinion was actually requested22:00
EmilienMdmsimard: do you mean I should work?22:00
dmsimard¯\_(ツ)_/¯22:01
pradkEmilienM, can you look at my last comment https://review.openstack.org/#/c/362305/422:01
EmilienMdmsimard: reviewed22:01
EmilienMpradk: when packaging was added?22:02
pradkEmilienM, we might need a promotion to get panko packages.. they are in current22:02
EmilienMpradk: we promoted yesterday22:02
EmilienMhttps://dashboards.rdoproject.org/rdo-dev22:02
EmilienMwe promoted 24h ago22:02
EmilienMand we're about to promote right now, patch is in gate22:02
pradkEmilienM, cool lets see if this one picks it up22:02
*** jperry has quit IRC22:02
EmilienMpradk: I can tell you22:03
EmilienMsee https://review.openstack.org/#/c/367551/5/manifests/repos.pp22:03
EmilienMI do see it :)22:03
EmilienMso yes22:03
pradklooking22:03
EmilienMhttps://trunk.rdoproject.org/centos7-master/13/22/13223e459babddd74792699b20b52843a0ff9576_466d3f91/22:04
pradkEmilienM, yep see it22:04
pradkthx, i'll wait22:04
EmilienMpradk: excellent, ,thanks22:04
*** xarses has quit IRC22:04
*** johnmilton has quit IRC22:11
EmilienMscenario003 is now failing on ubuntu all the times22:11
EmilienM2016-09-08 22:01:04.516268 |     AssertionError: False is not true : Timed out waiting for 172.24.5.19 to become reachable22:11
EmilienMmaybe neutron22:11
EmilienMscenario003 deploys linux bridge instead of OVS iirc22:12
dmsimardmaybe you should revert to the previous uca hash22:12
dmsimardoh wait22:12
* dmsimard hides22:12
*** dtantsur|afk has quit IRC22:12
EmilienMdmsimard: ...22:12
EmilienMhttp://logs.openstack.org/51/367551/5/check/gate-puppet-openstack-integration-3-scenario003-tempest-ubuntu-xenial/d634f0b/logs/nova/nova-compute.txt.gz#_2016-09-08_21_47_07_63722:13
*** dtantsur has joined #puppet-openstack22:14
EmilienMhttp://logs.openstack.org/51/367551/5/check/gate-puppet-openstack-integration-3-scenario003-tempest-ubuntu-xenial/d634f0b/logs/neutron/neutron-linuxbridge-agent.txt.gz#_2016-09-08_21_46_45_38322:14
EmilienMsounds like a bug !22:14
mwhahahalooptastic22:14
dmsimardand with that I will go drown my tears in food22:15
dmsimardand alcohol22:15
dmsimardhave a nice one22:15
dfisher+122:15
EmilienMcan I go sleep?22:15
EmilienMmaybe we need to load br_netfilter ?22:16
EmilienMmy1.fr/files/emilien-right-now.jpg22:17
bkerodmsimard: gg, have a nice evening22:19
bkeroneutron!! D:22:20
mwhahahaEmilienM: possibly, not sure how that changed22:22
EmilienMmwhahaha: https://bugs.launchpad.net/cloud-archive/+bug/162165122:23
openstackLaunchpad bug 1621651 in Ubuntu Cloud Archive "neutron linuxbridge fails to create interfaces" [Undecided,New]22:23
EmilienMI'm investigating in neutron code now22:23
mwhahahato bad we don't capture an lsmod22:24
openstackgerritEmilien Macchi proposed openstack/puppet-openstack-integration: Align the stars to bring our CI back  https://review.openstack.org/36755122:25
EmilienMthis is awesome ^22:25
EmilienMmwhahaha: see my patch22:25
mwhahahaha22:25
bkeronice commit message22:25
mwhahahabrb22:26
*** johnmilton has joined #puppet-openstack22:27
EmilienMdmsimard: https://github.com/openstack/neutron/commit/359b7c971a88f6dff64e8e4d558210a880f3ee0f22:28
EmilienMI think that's this one22:28
EmilienM"May 2015", hum22:29
*** ntpttr has quit IRC22:31
*** ntpttr has joined #puppet-openstack22:31
*** xarses has joined #puppet-openstack22:37
*** fultonj has quit IRC22:50
EmilienMlol scenario003 now works22:52
bkeroEmilienM: nice blog posts recently btw22:53
* bkero follows planet and saw them cross by.22:53
EmilienMbkero: thx, trying to make code break22:53
*** aimon has quit IRC22:58
*** StraubTW has quit IRC22:59
mwhahahahttps://review.openstack.org/#/c/367551/ it passed \o/23:08
*** pradk has quit IRC23:08
EmilienMstars are aligned23:09
EmilienM_ody: if you around, can you approve it?23:09
EmilienMthe br_netfilter was funny to debug though23:10
EmilienMit made my day23:10
openstackgerritAlex Schultz proposed openstack/puppet-openstack-integration: Move ceph object len options to profile  https://review.openstack.org/36702223:10
EmilienMI'm actually wondering if it's transient23:10
mwhahahait's not loaded on centos23:11
EmilienMdang23:11
EmilienMwe have "bridge" module though23:12
mwhahahaso did ubuntu23:12
EmilienMright23:12
EmilienMinteresting23:12
mwhahahai bet it's a kernel version thing23:13
mwhahaha3.10 vs 4.x or something23:13
mwhahaha3.10 vs 3.323:13
mwhahahaer 4.423:14
bkeroYou think it was something like a wonky non-existant NAT table?23:14
EmilienMso recent ubuntu has 4.4.0-3623:14
EmilienMlet's see what we had before23:14
*** saneax-_-|AFK is now known as saneax23:14
EmilienMmhh, same23:15
EmilienM¯\_(ツ)_/¯23:15
mwhahahaindeed23:15
*** dfisher has quit IRC23:16
EmilienM🤷23:16
EmilienMdamn my unicode doesn't work23:16
mwhahahaxt_physdev uses br_netfilter on ubuntu where as that's not the case on centos, who knows.  it's working :D23:16
mwhahahawe'll see it break for centos8 ;)23:17
*** moravec1 has joined #puppet-openstack23:22
*** moravec has quit IRC23:22
*** ntpttr has quit IRC23:23
*** markvoelker has quit IRC23:25
*** AnarchyAo has quit IRC23:28
*** ntpttr has joined #puppet-openstack23:28
EmilienMmwhahaha: it's transient23:40
EmilienMI see the error :(23:40
mwhahahanooooes23:40
EmilienMlet's compare packaging23:42
mwhahahahttps://www.diffchecker.com/uw3iZOyD23:42
mwhahahai did already23:42
EmilienMhttps://www.diffchecker.com/WnGvcwjo23:43
EmilienMnice !23:43
EmilienMmww, could be python-os-vif23:44
EmilienMoh I got it :=23:46
EmilienMhttps://review.openstack.org/#/c/365104/23:46
EmilienMhttps://bugs.launchpad.net/neutron/+bug/161744723:46
openstackLaunchpad bug 1617447 in os-vif "InterfaceAttachFailed: Failed to attach network adapter device" [High,Fix released] - Assigned to Kevin Benton (kevinbenton)23:46
mwhahahayankcrime: just fyi glance and trove are the only two modules with the incorrect comment around log_file23:46
mwhahahaoh, bad dependency. glorious23:46
EmilienMyep23:46
EmilienMos-vif 1.2.0 in current repo23:46
EmilienMinstead of os-vif 1.2.123:46
mwhahahasooo no neutron smoke test? :D23:47
EmilienMyou know how I found it?23:47
EmilienMlast day i was curous why os-vif 1.2.1 was released so much close from 1.2.0 and I looked the bug report23:47
mwhahahadid you remember it from rdo like 2 months ago? :D23:47
EmilienMI remembered it 5 min ago :)23:47
mwhahahaha23:47
EmilienManyway23:48
EmilienMyes, let's disable linuxbridge in scenario003 for ubuntu23:48
EmilienMI'll keep the modprobe thing, because it's still useful to avoid ERROR in logs like we have. We'll see how ubuntu reacts on my bug report23:49
openstackgerritAlex Schultz proposed openstack/puppet-trove: Update log_file documentation  https://review.openstack.org/36769423:49
mwhahahak23:49
openstackgerritEmilien Macchi proposed openstack/puppet-openstack-integration: Align the stars to bring our CI back  https://review.openstack.org/36755123:52
openstackgerritAlex Schultz proposed openstack/puppet-glance: Update log_file documentation  https://review.openstack.org/36769623:53
* mwhahaha wanders off23:54
mwhahahahmm23:54
mwhahahaheh who knew that ctrl+l clears scrollback in xchat too23:55
*** johnmilton has quit IRC23:55
EmilienMhttp://logs.openstack.org/51/367551/7/check/gate-puppet-openstack-integration-3-scenario001-tempest-centos-7/66be083/console.html#_2016-09-08_23_54_01_45797823:56
EmilienMis it a joke?23:56
EmilienMis there someone behind a computer hacking us?23:56
EmilienM_ody: something just broke in puppetlabs.com repo23:57
EmilienM_ody: it's blocking all our CI, all centos are now failing23:58
* bkero facepalm.23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!