*** rongze has quit IRC | 00:02 | |
*** openstackgerrit has quit IRC | 00:06 | |
*** noslzzp has quit IRC | 00:06 | |
*** openstackgerrit has joined #tripleo | 00:06 | |
*** morazi has quit IRC | 00:07 | |
SpamapS | ow | 00:08 |
---|---|---|
SpamapS | Illegal OpCode | 00:09 |
SpamapS | on the console of one of the servers. | 00:09 |
SpamapS | that _can't_ be good | 00:09 |
*** cd-undercloud has joined #tripleo | 00:11 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 00:11 |
*** cd-undercloud has quit IRC | 00:11 | |
*** CaptTofu has joined #tripleo | 00:20 | |
SpamapS | hrm, now DHCP doesn't seem to be reaching undercloud | 00:21 |
* SpamapS -> kids | 00:21 | |
*** matsuhashi has joined #tripleo | 00:21 | |
*** epim has quit IRC | 00:26 | |
*** martyntaylor has quit IRC | 00:32 | |
*** cd-undercloud has joined #tripleo | 00:36 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 00:36 |
*** cd-undercloud has quit IRC | 00:36 | |
*** krotscheck has quit IRC | 01:21 | |
*** sballe has quit IRC | 01:24 | |
*** rongze has joined #tripleo | 01:28 | |
*** matsuhashi has quit IRC | 01:31 | |
*** rongze has quit IRC | 01:33 | |
*** matsuhas_ has joined #tripleo | 01:33 | |
*** cd-undercloud has joined #tripleo | 01:34 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 01:34 |
*** cd-undercloud has quit IRC | 01:34 | |
*** nosnos has joined #tripleo | 01:36 | |
*** flwang has quit IRC | 01:49 | |
*** cd-undercloud has joined #tripleo | 01:59 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 01:59 |
*** cd-undercloud has quit IRC | 01:59 | |
*** boris-42 has quit IRC | 02:02 | |
*** openstack has joined #tripleo | 02:18 | |
*** openstackgerrit has quit IRC | 02:24 | |
*** openstackgerrit has joined #tripleo | 02:24 | |
*** jayg is now known as jayg|g0n3 | 02:30 | |
*** jcooley_ has joined #tripleo | 02:35 | |
*** matsuhas_ has quit IRC | 02:35 | |
*** flwang has joined #tripleo | 02:50 | |
*** rongze has joined #tripleo | 02:53 | |
*** vkozhukalov has joined #tripleo | 02:55 | |
*** rongze_ has joined #tripleo | 02:55 | |
*** cd-undercloud has joined #tripleo | 02:58 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 02:58 |
*** cd-undercloud has quit IRC | 02:58 | |
*** rongze has quit IRC | 02:58 | |
*** jcooley_ has quit IRC | 03:17 | |
*** sdake_ has quit IRC | 03:21 | |
*** cd-undercloud has joined #tripleo | 03:23 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 03:23 |
*** cd-undercloud has quit IRC | 03:23 | |
*** CaptTofu has quit IRC | 03:24 | |
openstackgerrit | Jun Jie Nan proposed a change to openstack/diskimage-builder: Fix no busybox symlinks issue on rhel https://review.openstack.org/59940 | 03:28 |
lifeless | python | 03:31 |
*** CaptTofu has joined #tripleo | 03:36 | |
*** cwolfe__ has joined #tripleo | 03:45 | |
*** cwolferh_ has quit IRC | 03:47 | |
*** tzumainn has quit IRC | 03:59 | |
*** tzumainn has joined #tripleo | 04:05 | |
*** matsuhashi has joined #tripleo | 04:14 | |
*** cd-undercloud has joined #tripleo | 04:23 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 04:23 |
*** cd-undercloud has quit IRC | 04:23 | |
*** michchap_ has joined #tripleo | 04:24 | |
*** michchap has quit IRC | 04:26 | |
*** sdake_ has joined #tripleo | 04:29 | |
*** rongze_ has quit IRC | 04:35 | |
*** michchap has joined #tripleo | 04:35 | |
*** CaptTofu has quit IRC | 04:36 | |
*** CaptTofu has joined #tripleo | 04:36 | |
*** michchap_ has quit IRC | 04:38 | |
*** cd-undercloud has joined #tripleo | 04:47 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 04:47 |
*** cd-undercloud has quit IRC | 04:47 | |
*** bauzas has quit IRC | 04:55 | |
*** marun has joined #tripleo | 05:03 | |
SpamapS | lifeless: traffic is not making it from br-ctlplane into the DHCP netns. Halp? | 05:18 |
lifeless | SpamapS: hi | 05:25 |
lifeless | SpamapS: on host? | 05:25 |
*** rushiagr has joined #tripleo | 05:27 | |
lifeless | SpamapS: assuming cd-undercloud-notcompute | 05:38 |
lifeless | SpamapS: ovs show + ovs ofctl dump-flows is useful here | 05:38 |
lifeless | SpamapS: we expect br-ctlplane -> br-int and from there a tap device into the agents | 05:39 |
lifeless | SpamapS: so from the netns we can see the tap device is tap56efc4c6-55 | 05:40 |
lifeless | which is indeed plugged into br-int | 05:40 |
lifeless | with tag 1 | 05:40 |
lifeless | SpamapS: we can see that br-int has 3 flows, dropping traffic from ports 2 and 3 and flooding everything else | 05:41 |
lifeless | SpamapS: ovs-ofctl show br-int gets you port ids | 05:42 |
lifeless | 2 and 3 are taps but not the dhcp one | 05:42 |
lifeless | SpamapS: so it looks fine to me | 05:42 |
lifeless | SpamapS: nothing obvious in iptables-save that would cause issues | 05:43 |
*** cd-undercloud has joined #tripleo | 05:46 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 05:46 |
*** cd-undercloud has quit IRC | 05:46 | |
*** sdake_ has quit IRC | 05:49 | |
*** noslzzp has joined #tripleo | 06:09 | |
*** cd-undercloud has joined #tripleo | 06:11 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 06:11 |
*** cd-undercloud has quit IRC | 06:11 | |
*** matsuhashi has quit IRC | 06:14 | |
*** rushiagr2 has joined #tripleo | 06:14 | |
*** matsuhashi has joined #tripleo | 06:14 | |
*** rushiagr has quit IRC | 06:15 | |
*** rpodolyaka1 has joined #tripleo | 06:17 | |
*** rushiagr2 is now known as rushiagr | 06:24 | |
openstackgerrit | Mark McLoughlin proposed a change to openstack/diskimage-builder: Log the repository fetches in source-repositories https://review.openstack.org/60035 | 06:30 |
*** agordeev has joined #tripleo | 06:43 | |
*** vkozhukalov has quit IRC | 06:48 | |
lifeless | SpamapS: | 06:50 |
lifeless | # tcpdump -enli br-int port bootpc | 06:50 |
lifeless | tcpdump: br-int: That device is not up | 06:50 |
*** pblaho has joined #tripleo | 06:50 | |
lifeless | ok, so ifconfig that up; now I see it on br-int | 06:50 |
StevenK | lifeless: ITYM 'ip l s dev <blah> up' ? :-) | 06:51 |
lifeless | StevenK: 'meh' | 06:51 |
StevenK | Haha | 06:52 |
lifeless | so | 06:52 |
lifeless | my suspicion would be the process for tap56efc4c6-55 is awol | 06:52 |
*** noslzzp has quit IRC | 06:52 | |
*** rongze has joined #tripleo | 06:54 | |
*** flwang has left #tripleo | 06:55 | |
*** akuznetsov has quit IRC | 06:55 | |
*** cd-undercloud has joined #tripleo | 07:10 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 07:10 |
*** cd-undercloud has quit IRC | 07:10 | |
*** rpodolyaka1 has quit IRC | 07:11 | |
*** kmsWork_ has joined #tripleo | 07:17 | |
*** matsuhashi has quit IRC | 07:17 | |
*** kmsWork has quit IRC | 07:19 | |
*** akuznetsov has joined #tripleo | 07:23 | |
*** akuznetsov has quit IRC | 07:26 | |
openstackgerrit | Jun Jie Nan proposed a change to openstack/diskimage-builder: Fix no busybox symlinks issue on rhel https://review.openstack.org/59940 | 07:26 |
*** tzumainn has quit IRC | 07:29 | |
*** jcoufal has joined #tripleo | 07:30 | |
*** cd-undercloud has joined #tripleo | 07:34 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 07:34 |
*** cd-undercloud has quit IRC | 07:34 | |
*** boris-42 has joined #tripleo | 07:35 | |
*** ifarkas has joined #tripleo | 07:50 | |
*** lsmola has joined #tripleo | 07:57 | |
rpodolyaka | morning tripleo | 07:59 |
*** akuznetsov has joined #tripleo | 08:07 | |
*** jprovazn has joined #tripleo | 08:16 | |
*** ifarkas has quit IRC | 08:21 | |
*** GheRivero has joined #tripleo | 08:23 | |
*** panda has joined #tripleo | 08:26 | |
*** vipul is now known as vipul-away | 08:27 | |
*** ifarkas has joined #tripleo | 08:27 | |
*** bauzas has joined #tripleo | 08:30 | |
*** vkozhukalov has joined #tripleo | 08:32 | |
*** cd-undercloud has joined #tripleo | 08:34 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 08:34 |
*** cd-undercloud has quit IRC | 08:34 | |
*** vipul-away is now known as vipul | 08:37 | |
*** rdopieralski has joined #tripleo | 08:38 | |
*** SlickNik has quit IRC | 08:39 | |
*** SlickNik has joined #tripleo | 08:40 | |
*** akrivoka has joined #tripleo | 08:41 | |
*** boris-42 has quit IRC | 08:57 | |
*** cd-undercloud has joined #tripleo | 08:58 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 08:58 |
*** cd-undercloud has quit IRC | 08:58 | |
*** jistr has joined #tripleo | 08:58 | |
Ng | morning | 09:02 |
lifeless | morning ng | 09:09 |
lifeless | SpamapS: (hiatus with me is C, obviously :P) | 09:09 |
*** athomas has joined #tripleo | 09:10 | |
*** boris-42 has joined #tripleo | 09:16 | |
lifeless | SpamapS: and yeah, my suspicion was right - service neutron-openvswitch-agent restart, et voila | 09:20 |
*** lucasagomes has joined #tripleo | 09:25 | |
*** jtomasek has joined #tripleo | 09:27 | |
*** jcoufal has quit IRC | 09:30 | |
lifeless | rpodolyaka: around? | 09:32 |
rpodolyaka | lifeless: yep | 09:32 |
rpodolyaka | review time :) | 09:33 |
lifeless | rpodolyaka: so hey, wanted to sync on rebuild | 09:36 |
rpodolyaka | sure | 09:36 |
lifeless | rpodolyaka: we chatted earlier in the week about the disconnect we had | 09:36 |
rpodolyaka | so, I tried to push it down the stack | 09:36 |
rpodolyaka | curiously, tests work | 09:36 |
*** jtomasek has quit IRC | 09:36 | |
lifeless | rpodolyaka: I'm wondering how the revamp is going, and wanted to suggest that I spend tomorrow afternoon hacking on it | 09:36 |
rpodolyaka | both unit and devstack gates | 09:36 |
lifeless | rpodolyaka: cool | 09:37 |
lifeless | ship it ! ;) | 09:37 |
rpodolyaka | https://review.openstack.org/#/c/59468/ | 09:37 |
rpodolyaka | have you already seen this one? | 09:37 |
rpodolyaka | + I made small fix to your patch adding a table column | 09:38 |
lifeless | awesome | 09:39 |
rpodolyaka | ok, so I'm going to write a commit message for the rebuild patch and remove the WIP status | 09:40 |
lifeless | rpodolyaka: what happened to all the API bits - are they sitting locally for now? | 09:40 |
rpodolyaka | lifeless: yes | 09:40 |
lifeless | ok | 09:40 |
rpodolyaka | lifeless: going to hack on this today | 09:40 |
lifeless | sweet | 09:40 |
lifeless | if you push everything - WIP and non-WIP when you're done tonight, I'll try to hack on it my tomorrow | 09:41 |
rpodolyaka | got side tracked yesterday pinging neutron team | 09:41 |
lifeless | I'm itching to get some code written :) | 09:41 |
rpodolyaka | cool! | 09:41 |
rpodolyaka | me too! | 09:41 |
rpodolyaka | :) | 09:41 |
* rpodolyaka got a small team here at mirantis | 09:41 | |
lifeless | ah, the perils of being a team lead? | 09:41 |
rpodolyaka | yeah... mentoring is hard :) | 09:42 |
*** max_lobur_afk is now known as max_lobur | 09:45 | |
*** jtomasek has joined #tripleo | 09:50 | |
lifeless | ok, night all | 09:55 |
*** cd-undercloud has joined #tripleo | 09:57 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 09:57 |
*** cd-undercloud has quit IRC | 09:57 | |
*** jcoufal has joined #tripleo | 09:58 | |
*** athomas has quit IRC | 10:00 | |
*** akrivoka has quit IRC | 10:01 | |
*** akrivoka has joined #tripleo | 10:02 | |
*** jtomasek has quit IRC | 10:04 | |
*** lsmola has quit IRC | 10:05 | |
*** martyntaylor has joined #tripleo | 10:09 | |
openstackgerrit | Jun Jie Nan proposed a change to openstack/diskimage-builder: Add examples for ramdisk-image-create https://review.openstack.org/60193 | 10:12 |
*** derekh has joined #tripleo | 10:13 | |
*** hewbrocca has joined #tripleo | 10:16 | |
*** lsmola has joined #tripleo | 10:17 | |
*** jtomasek has joined #tripleo | 10:20 | |
*** michchap has quit IRC | 10:30 | |
*** michchap has joined #tripleo | 10:31 | |
*** jprovazn has quit IRC | 10:41 | |
*** akrivoka has quit IRC | 10:46 | |
*** akrivoka has joined #tripleo | 10:47 | |
*** boris-42 has quit IRC | 10:47 | |
*** lsmola has quit IRC | 10:49 | |
*** athomas has joined #tripleo | 10:55 | |
*** markmc has joined #tripleo | 10:55 | |
*** cd-undercloud has joined #tripleo | 10:59 | |
cd-undercloud | ************** overcloud complete status=0 ************ | 10:59 |
*** cd-undercloud has quit IRC | 10:59 | |
Ng | :) | 11:01 |
*** boris-42 has joined #tripleo | 11:02 | |
*** lsmola has joined #tripleo | 11:02 | |
*** rongze has quit IRC | 11:12 | |
*** jprovazn has joined #tripleo | 11:15 | |
*** akrivoka has quit IRC | 11:18 | |
*** akrivoka has joined #tripleo | 11:33 | |
*** jcoufal has quit IRC | 11:36 | |
vkozhukalov | tried to build image with diskimage-builder, included some tripleo elements from tripleo-image-elements, scripts failes with the error "DIB_INIT_SYSTEM: unbound variable". the question is how to use this variable? | 11:47 |
*** morazi has joined #tripleo | 11:48 | |
*** rha has joined #tripleo | 11:48 | |
vkozhukalov | and why is it not installed into some default? | 11:50 |
GheRivero | vkozhukalov: i'll take a look to it | 11:52 |
GheRivero | can you paste the command you were using? | 11:52 |
*** morazi has quit IRC | 11:53 | |
*** cd-undercloud has joined #tripleo | 11:53 | |
cd-undercloud | ************** overcloud complete status=0 ************ | 11:53 |
*** cd-undercloud has quit IRC | 11:53 | |
vkozhukalov | GheRivero, disk-image-create -x -u -a amd64 -o /var/tmp/ieS8rohk vm ironic 2>&1 | tee /var/tmp/ieS8rohk.log | 11:54 |
vkozhukalov | GheRivero, error line in log is "/tmp/in_target.d/install.d/10-os-collect-config: line 14: DIB_INIT_SYSTEM: unbound variable" | 11:55 |
GheRivero | can you see something like: Please include at least one distribution root element. in the logs? | 11:56 |
vkozhukalov | GheRivero, no, i can't | 11:57 |
*** rongze has joined #tripleo | 11:57 | |
vkozhukalov | GheRivero, I can send you the log file if you need. | 11:59 |
GheRivero | yeah, you can paste it. Is the ironic element in a review? | 11:59 |
GheRivero | forget it | 12:00 |
vkozhukalov | GheRivero, it is already in master. | 12:01 |
GheRivero | yeah. i forgot to update my local copy :) | 12:02 |
*** morazi has joined #tripleo | 12:06 | |
GheRivero | vkozhukalov: did you paste the output? | 12:09 |
vkozhukalov | GheRivero, log file http://rghost.net/50704129 | 12:11 |
GheRivero | server not found :( | 12:12 |
GheRivero | when downloading it | 12:12 |
vkozhukalov | GheRivero, one min | 12:12 |
vkozhukalov | GheRivero, https://drive.google.com/file/d/0BybDDjx4oqkYTEphT2hDX1FzTkU/edit?usp=sharing | 12:14 |
GheRivero | you can also use paste.openstack.org | 12:14 |
GheRivero | :) | 12:14 |
vkozhukalov | GheRivero, ok, will know | 12:14 |
*** rongze has quit IRC | 12:17 | |
GheRivero | i just build it without problems... | 12:19 |
GheRivero | will check env variables | 12:19 |
openstackgerrit | A change was merged to openstack/diskimage-builder: Fix no busybox symlinks issue on rhel https://review.openstack.org/59940 | 12:24 |
GheRivero | vkozhukalov: do you have dib updated? | 12:26 |
*** rongze has joined #tripleo | 12:35 | |
vkozhukalov | GheRivero, wow. You are right. Im sorry I have not updated my dib. | 12:37 |
vkozhukalov | GheRivero, thanks a lot lot lot | 12:37 |
GheRivero | :) | 12:37 |
GheRivero | i hate this computer (athlon k7). My HD dies yesterday and still waiting for a replacement | 12:39 |
*** rongze_ has joined #tripleo | 12:41 | |
*** rongze has quit IRC | 12:42 | |
*** nosnos has quit IRC | 12:45 | |
*** cd-undercloud has joined #tripleo | 12:49 | |
cd-undercloud | ************** overcloud complete status=0 ************ | 12:49 |
*** cd-undercloud has quit IRC | 12:49 | |
*** CaptTofu has quit IRC | 12:51 | |
*** CaptTofu has joined #tripleo | 12:51 | |
shadower | have you ever run out of memory on the overcloud-in-a-vm? | 12:55 |
shadower | I'm getting 'ERROR: An unexpected error prevented the server from fulfilling your request. [Errno 12] Cannot allocate memory (HTTP 500)' after a few redeploys of the overcloud | 12:55 |
shadower | this on a standard devtest, 64bit vms, 2048 RAM | 12:56 |
*** athomas has quit IRC | 12:57 | |
ifarkas | shadower, yeah, I sometimes had this issue and had to rebuild the undercloud | 13:00 |
jprovazn | shadower, I think I've seen this about a month ago, yesterday I've hit this on undercloud vm - for undercloud the issue is with keystone and bunch of generated tokens in DB (which keystone seems to keep also in memory) | 13:00 |
ifarkas | shadower, I redeployed the it, doubled the available ram and it has be up for a couple weeks | 13:01 |
jprovazn | shadower, could you check memory on your vm and ideally also check size of "token" table in keystone db? | 13:01 |
shadower | jprovazn: it is keystone that's hitting the issue | 13:02 |
jprovazn | ah :) | 13:02 |
*** rbrady has joined #tripleo | 13:02 | |
jprovazn | shadower, and which processes take msot of mem? | 13:03 |
shadower | jprovazn: I've about 170mb of free memory, keystone-all takes the most mem according to top | 13:03 |
openstackgerrit | A change was merged to openstack/diskimage-builder: Add examples for ramdisk-image-create https://review.openstack.org/60193 | 13:04 |
shadower | and when I check the logs, the issue is in keystone-all in issue_v2_token | 13:05 |
shadower | more specifically, there is a os.fork() command that fails | 13:05 |
openstackgerrit | A change was merged to openstack/diskimage-builder: Log the repository fetches in source-repositories https://review.openstack.org/60035 | 13:06 |
jprovazn | shadower, and how much mem does keystone take atm? more than 170M? | 13:09 |
shadower | jprovazn: that's the RES column, right? | 13:10 |
jprovazn | shadower, yes | 13:10 |
jprovazn | shadower, when fork is done, memory is copied to the new process, so if parent keystone process is big enough, it might be the reason | 13:11 |
shadower | about 450mb if I read it rigt | 13:11 |
shadower | yeah | 13:11 |
jprovazn | shadower, as a hotfix, you can try: | 13:12 |
jprovazn | mysql -u keystone -p keystone | 13:12 |
jprovazn | (password 'unset') | 13:12 |
jprovazn | then "delete from token;" (this works for me for undercloud, not sure if you have some tokens in overcloud) | 13:13 |
jprovazn | if yes, something like "delete from token where expire>some_Date" might be better | 13:13 |
shadower | jprovazn: my issue is in the undercloud too | 13:13 |
jprovazn | shadower, ah, I read overcloud above | 13:13 |
jprovazn | shadower, ok, in that case it should work | 13:13 |
jprovazn | then restart keystone | 13:13 |
shadower | I wrote it wrong, sorry | 13:13 |
shadower | jprovazn: sweet, thanks! | 13:16 |
jprovazn | shadower, yaw | 13:17 |
jprovazn | going to look what exactly causes this "token spree" | 13:17 |
shadower | yeah if keystone's leaking memory like that, surely that's a bug. Especially if it needs to fork on every os cli request | 13:17 |
shadower | the forking seems to be needed because of openssl signing | 13:18 |
*** lsmola has quit IRC | 13:22 | |
*** CaptTofu has quit IRC | 13:25 | |
*** CaptTofu has joined #tripleo | 13:25 | |
*** CaptTofu has quit IRC | 13:35 | |
*** jdob has joined #tripleo | 13:35 | |
*** CaptTofu has joined #tripleo | 13:35 | |
openstackgerrit | Radomir Dopieralski proposed a change to openstack/tuskar-ui: New structure of panels https://review.openstack.org/60231 | 13:38 |
rdopieralski | wheee | 13:39 |
*** noslzzp has joined #tripleo | 13:40 | |
rdopieralski | boilerplate :) | 13:41 |
*** cd-undercloud has joined #tripleo | 13:42 | |
cd-undercloud | ************** overcloud complete status=42 ************ | 13:42 |
*** cd-undercloud has quit IRC | 13:42 | |
openstackgerrit | Radomir Dopieralski proposed a change to openstack/tuskar-ui: New structure of panels https://review.openstack.org/60231 | 13:47 |
*** athomas has joined #tripleo | 13:48 | |
*** ccrouch has joined #tripleo | 13:50 | |
*** jistr has quit IRC | 13:57 | |
*** jistr has joined #tripleo | 13:58 | |
*** dprince has joined #tripleo | 13:59 | |
*** morazi has quit IRC | 14:01 | |
*** tzumainn has joined #tripleo | 14:02 | |
*** jcoufal has joined #tripleo | 14:03 | |
*** julim has joined #tripleo | 14:12 | |
*** morazi has joined #tripleo | 14:12 | |
openstackgerrit | Ralf Haferkamp proposed a change to openstack/diskimage-builder: Add support for building openSUSE images https://review.openstack.org/56157 | 14:20 |
*** matty_dubs|gone is now known as matty_dubs | 14:21 | |
*** jayg|g0n3 is now known as jayg | 14:28 | |
*** cd-undercloud has joined #tripleo | 14:33 | |
cd-undercloud | ************** overcloud complete status=0 ************ | 14:33 |
*** cd-undercloud has quit IRC | 14:33 | |
*** john-n-seattle1 has quit IRC | 14:33 | |
NobodyCam | good morning TripleO | 14:37 |
*** jdob has quit IRC | 14:38 | |
openstackgerrit | Radomir Dopieralski proposed a change to openstack/tuskar-ui: New structure of panels https://review.openstack.org/60231 | 14:40 |
*** sballe has joined #tripleo | 14:49 | |
*** jdob has joined #tripleo | 14:51 | |
*** john-n-seattle1 has joined #tripleo | 14:53 | |
*** jcoufal has quit IRC | 14:56 | |
openstackgerrit | Radomir Dopieralski proposed a change to openstack/tuskar-ui: New structure of panels https://review.openstack.org/60231 | 14:58 |
*** sdake has quit IRC | 15:02 | |
*** sdake has joined #tripleo | 15:03 | |
*** GheRivero has quit IRC | 15:04 | |
*** pblaho has quit IRC | 15:08 | |
*** marun has quit IRC | 15:23 | |
*** cd-undercloud has joined #tripleo | 15:25 | |
cd-undercloud | ************** overcloud complete status=0 ************ | 15:25 |
*** cd-undercloud has quit IRC | 15:25 | |
*** jergerber has joined #tripleo | 15:27 | |
SpamapS | awright.. we're deployin clouds again :) | 15:50 |
derekh | hip hip | 15:57 |
*** jcooley_ has joined #tripleo | 15:58 | |
*** jprovazn has quit IRC | 15:58 | |
*** jcooley_ has quit IRC | 15:59 | |
*** vkozhukalov has quit IRC | 16:00 | |
SpamapS | derekh: now you're just asking for it. ;) | 16:03 |
SpamapS | so now I feel like we have to attack the mellanox issues.. | 16:04 |
*** jcooley_ has joined #tripleo | 16:06 | |
*** boris-42 has quit IRC | 16:11 | |
*** jprovazn has joined #tripleo | 16:12 | |
*** jcooley_ has quit IRC | 16:12 | |
*** jcooley_ has joined #tripleo | 16:13 | |
*** ifarkas has quit IRC | 16:14 | |
*** max_lobur is now known as max_lobur_afk | 16:15 | |
*** cd-undercloud has joined #tripleo | 16:17 | |
cd-undercloud | ************** overcloud complete status=0 ************ | 16:17 |
*** cd-undercloud has quit IRC | 16:17 | |
*** jcooley_ has quit IRC | 16:18 | |
*** akrivoka has quit IRC | 16:23 | |
SpamapS | dprince: you working on enable/disable today? | 16:24 |
dprince | SpamapS: I've had some interruptions, but I probably can | 16:26 |
dprince | SpamapS: were you anxious to jump in there? | 16:26 |
SpamapS | dprince: I need to do some reviews and then if you're not started I'll grab the baton back. | 16:27 |
SpamapS | dprince: probably ~2 hours | 16:28 |
openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/tripleo-image-elements: Add an ntp element https://review.openstack.org/60079 | 16:29 |
*** rongze_ has quit IRC | 16:37 | |
*** akuznetsov has quit IRC | 16:44 | |
*** bauzas has quit IRC | 16:45 | |
dprince | SpamapS: so with the suggested new approaches we would need to enable use-ephemeral then? | 16:46 |
* dprince has not used it before... | 16:46 | |
SpamapS | dprince: right, you need to store state in places that use-ephemeral knows about | 16:47 |
*** cwolfe__ has quit IRC | 16:50 | |
dprince | SpamapS: So we aren't doing that for our config files today (yet) so I feel sort of like this could come after we fix service enable/disable | 16:51 |
*** cwolferh has joined #tripleo | 16:51 | |
*** jcooley_ has joined #tripleo | 16:51 | |
dprince | SpamapS: perhaps you already agree and I'm just assuming we'd do this first. Let me just throw some code up there. | 16:52 |
*** jcooley_ has quit IRC | 16:54 | |
*** jcooley_ has joined #tripleo | 16:55 | |
*** jcooley_ has quit IRC | 16:57 | |
*** athomas has quit IRC | 16:57 | |
*** jcooley_ has joined #tripleo | 16:57 | |
SpamapS | dprince: I do agree, and it is also on my todo list to do it for the config files :) | 16:58 |
SpamapS | dprince: either can come first. | 16:58 |
SpamapS | I should say it is on my very short-term list | 16:58 |
dprince | SpamapS: agree we do | 16:58 |
*** rdopieralski has quit IRC | 17:01 | |
*** jcooley_ has quit IRC | 17:02 | |
*** athomas has joined #tripleo | 17:04 | |
*** jcooley_ has joined #tripleo | 17:06 | |
*** markmc has quit IRC | 17:06 | |
openstackgerrit | A change was merged to openstack/tuskar-ui: New structure of panels https://review.openstack.org/60231 | 17:09 |
*** CaptTofu has quit IRC | 17:10 | |
*** CaptTofu has joined #tripleo | 17:10 | |
*** CaptTofu has quit IRC | 17:12 | |
*** CaptTofu has joined #tripleo | 17:12 | |
*** cd-undercloud has joined #tripleo | 17:12 | |
cd-undercloud | ************** overcloud complete status=0 ************ | 17:12 |
*** cd-undercloud has quit IRC | 17:12 | |
*** matty_dubs is now known as matty_dubs|lunch | 17:13 | |
*** julim has quit IRC | 17:16 | |
*** julim has joined #tripleo | 17:17 | |
*** martyntaylor has quit IRC | 17:18 | |
openstackgerrit | A change was merged to openstack/diskimage-builder: Add support for building openSUSE images https://review.openstack.org/56157 | 17:24 |
derekh | openSUSE welcome to disk-image-builder :-) | 17:26 |
Ng | \o/ | 17:27 |
derekh | pleia2: so I booted up a sample/manual test env host and geard server and started running commands (for the easy stuff) https://etherpad.openstack.org/p/tripleo-test-cluster | 17:29 |
pleia2 | derekh: great | 17:30 |
*** jtomasek has quit IRC | 17:31 | |
derekh | pleia2: have manually started setting up 2 test envs on the host (see commands in etherpad), we now have http://paste.openstack.org/show/54525/ | 17:31 |
derekh | pleia2: don't be fooled into thinking those VM's do anything, their blank disks | 17:32 |
derekh | ;-) | 17:32 |
pleia2 | derekh: so with boot-seed-vm I think we need two conditions added, 1. don't run configure-vm 2... browsing now because I forgot (coffee is brewing as we speak, yay!) | 17:34 |
derekh | pleia2: dprince so I think its mostly neutron hokus pokus from here, I'll pick up on that in the morning, or if ye want to try out anything fire ahead and add what you did yo the etherpad | 17:35 |
pleia2 | derekh: great, I'll give it a spin now | 17:35 |
derekh | pleia2: ya we want one boot-seed-vm todo everything except run DIB and the other to only run DIB | 17:36 |
derekh | pleia2: actually the second condition is done by passing in the node to not boot VM | 17:36 |
pleia2 | derekh: so I was thinking I'd actually run boot-seed-vm on the nodepool node | 17:36 |
derekh | pleia2: kinda | 17:36 |
pleia2 | where the image is created, we're just not creating the configure-vm stuff because that's already done | 17:37 |
derekh | pleia2: yup, you right, we need to run it on the nodepool node to create the image | 17:37 |
derekh | pleia2: and on the testenv host to do everything except create the image | 17:37 |
pleia2 | derekh: right | 17:37 |
derekh | pleia2: the dirty hack in the etherpad create a noop disk-image-builder so that boot-seed-vm does its stuff on the test env but doesn't create the image | 17:38 |
pleia2 | derekh: gotcha, so we need a couple patches in boot-seed-vm so we can support both ends of creation | 17:39 |
pleia2 | I'll work on that today too | 17:39 |
derekh | pleia2: yup, If its going to be a mess to decouple we don't really need a patch for the nodepool end, we could just use boot-seed-vm with -n so it doesn't start the VM, it doesn't really matter if it does things like configure-vm as we'll be throwing this VM away after the test | 17:41 |
*** jistr has quit IRC | 17:41 | |
derekh | pleia2: but I'm sure people with say that ugly, so we should try and do both ends | 17:42 |
pleia2 | I'll see how painful it is :) | 17:42 |
*** jcooley_ has quit IRC | 17:47 | |
*** jcooley_ has joined #tripleo | 17:48 | |
*** panda has quit IRC | 17:49 | |
*** jcooley_ has quit IRC | 17:52 | |
*** jcooley_ has joined #tripleo | 17:56 | |
*** matty_dubs|lunch is now known as matty_dubs | 17:56 | |
* Ng bows out for some feeding | 17:58 | |
openstackgerrit | Dan Prince proposed a change to openstack/tripleo-image-elements: Enable some services after installing daemon's... https://review.openstack.org/59299 | 17:59 |
openstackgerrit | Dan Prince proposed a change to openstack/tripleo-image-elements: Call os-svc-enable in post-configure.d https://review.openstack.org/59298 | 17:59 |
openstackgerrit | Dan Prince proposed a change to openstack/tripleo-image-elements: Enable services with os-svc-enable https://review.openstack.org/59297 | 17:59 |
openstackgerrit | Dan Prince proposed a change to openstack/tripleo-image-elements: Don't enable services in os-svc-install https://review.openstack.org/59300 | 17:59 |
dprince | SpamapS: okay. I messed with upstart a bit... and I think I'm confused a bit. Clearly you are more the expert here so what I did in my patch series is make os-svc-enable a noop for upstart for now. | 18:00 |
dprince | SpamapS: So the existing patch series affect systemd only, which I think eliminates the concerns you guys have. Perhaps you can append your implementation at the end and we'll be done with this first step? | 18:00 |
openstackgerrit | Dan Prince proposed a change to openstack/tripleo-image-elements: Enable some services after installing daemon's... https://review.openstack.org/59299 | 18:03 |
openstackgerrit | Dan Prince proposed a change to openstack/tripleo-image-elements: Call os-svc-enable in post-configure.d https://review.openstack.org/59298 | 18:03 |
openstackgerrit | Dan Prince proposed a change to openstack/tripleo-image-elements: Enable services with os-svc-enable https://review.openstack.org/59297 | 18:03 |
openstackgerrit | Dan Prince proposed a change to openstack/tripleo-image-elements: Don't enable services in os-svc-install https://review.openstack.org/59300 | 18:03 |
*** akuznetsov has joined #tripleo | 18:04 | |
*** cd-undercloud has joined #tripleo | 18:06 | |
cd-undercloud | ************** overcloud complete status=0 ************ | 18:06 |
*** cd-undercloud has quit IRC | 18:06 | |
*** vkozhukalov has joined #tripleo | 18:08 | |
*** derekh has quit IRC | 18:10 | |
*** csd_ has joined #tripleo | 18:18 | |
SpamapS | dprince: will review shortly | 18:18 |
*** csd_ is now known as csd | 18:18 | |
*** shardy is now known as shardy_afk | 18:19 | |
*** csd has quit IRC | 18:26 | |
lifeless | morning | 18:32 |
lifeless | oh look, success | 18:32 |
*** rbrady has left #tripleo | 18:35 | |
*** rbrady has joined #tripleo | 18:36 | |
*** athomas has quit IRC | 18:38 | |
*** csd has joined #tripleo | 18:38 | |
*** krotscheck has joined #tripleo | 18:39 | |
*** sdake has quit IRC | 18:44 | |
*** sdake has joined #tripleo | 18:45 | |
*** john-n-seattle has quit IRC | 18:45 | |
*** john-n-seattle has joined #tripleo | 18:49 | |
*** lucasagomes has quit IRC | 18:51 | |
*** cd-undercloud has joined #tripleo | 18:58 | |
cd-undercloud | ************** overcloud complete status=0 ************ | 18:58 |
*** cd-undercloud has quit IRC | 18:58 | |
lifeless | twice in a row | 18:59 |
lifeless | O | 18:59 |
lifeless | M | 18:59 |
lifeless | G | 18:59 |
* SpamapS self ^5's | 19:01 | |
SpamapS | which I think is just called a clap | 19:01 |
lifeless | thats a very very special clap | 19:03 |
SpamapS | lifeless: where do you think that element tester thing should live? | 19:06 |
lifeless | SpamapS: well so far it's testing oac templates. | 19:06 |
SpamapS | lifeless: I feel like embedded metadata in README.md plus os-apply-config is specific to tripleo-image-elements | 19:06 |
*** jrist has joined #tripleo | 19:07 | |
SpamapS | lifeless: my second order of that btw is to allow element authors to save the output as .expected and then we test the result. | 19:07 |
lifeless | SpamapS: so, tie is a leaf node in our code graph | 19:07 |
lifeless | SpamapS: I think it should stay that way | 19:07 |
SpamapS | agreed | 19:07 |
*** sdake_ has joined #tripleo | 19:07 | |
lifeless | SpamapS: I'd be happy with it in oac for now. | 19:07 |
SpamapS | so maybe a tripleo-dev-tools ? | 19:07 |
SpamapS | oh | 19:07 |
SpamapS | hmmm | 19:07 |
lifeless | SpamapS: it's not a perfect fit | 19:07 |
SpamapS | It's an o-k fit | 19:08 |
*** derekh has joined #tripleo | 19:08 | |
lifeless | SpamapS: but I think it's less bad than in tie | 19:08 |
*** noslzzp has quit IRC | 19:08 | |
SpamapS | lifeless: truth be told there is nothing element specific about the code other than README.md and the directory named os-apply-config .. so yeah we can just separate those two bits | 19:08 |
SpamapS | and yeah, I totally hated writing that without tests | 19:09 |
SpamapS | putting it in oac means it can have real tests :) | 19:09 |
*** noslzzp has joined #tripleo | 19:09 | |
*** rushiagr has quit IRC | 19:13 | |
*** noslzzp has quit IRC | 19:14 | |
*** jtomasek has joined #tripleo | 19:18 | |
openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/os-apply-config: Log parsing errors from pystache as errors https://review.openstack.org/60047 | 19:23 |
*** derekh has quit IRC | 19:25 | |
openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/tripleo-image-elements: Add an ntp element https://review.openstack.org/60079 | 19:26 |
*** rpodolyaka1 has joined #tripleo | 19:31 | |
*** jrist has quit IRC | 19:32 | |
*** bauzas has joined #tripleo | 19:36 | |
*** jtomasek has quit IRC | 19:43 | |
SpamapS | dprince: I'm trying to find where systemd writes the symlinks from the enable/disable command. Help? | 19:44 |
*** jcooley_ has quit IRC | 19:44 | |
SpamapS | looks like the pkg-config variable 'systemdsystemconfdir' has it | 19:46 |
*** jcoufal has joined #tripleo | 19:46 | |
dprince | SpamapS: /etc/systemd/system/multi-user.target.wants | 19:46 |
dprince | SpamapS: so presumably that will eventually be on /mnt/state as well... once we start actually using the use-ephemeral element? | 19:48 |
dprince | SpamapS: But for now... (in my existing service enable series) I think we can leave it alone | 19:48 |
openstackgerrit | A change was merged to openstack/tripleo-image-elements: Add an ntp element https://review.openstack.org/60079 | 19:49 |
SpamapS | Right. THat will likely have to be one of those symlinked to /mnt things. | 19:49 |
SpamapS | dprince: I think I'll do my upstart implementation as a standalone utility in os-svc-install and then you can just rebase off that commit. I'd rather not merge the upstart noop if we don't have to. Starting on it now. | 19:51 |
*** cd-undercloud has joined #tripleo | 19:51 | |
cd-undercloud | ************** overcloud complete status=0 ************ | 19:51 |
*** cd-undercloud has quit IRC | 19:51 | |
dprince | SpamapS: Fine. In fairness to myself I did implement a mostly working version for upstart in its current form. And this could have come later. But I'm happy to rebase. So long as we move forwards and don't overly intertwine service enable and read only features that have been talked about here. They are related... yes but not having Mega commits makes reviews easier IMO. | 19:57 |
SpamapS | dprince: we're very close to the readonly and ephemeral disk separation, it is not just pie in the sky. | 19:58 |
SpamapS | dprince: and mega commits are definitely _bad_ | 19:59 |
dprince | SpamapS: Sure. I understand that now. I just think things in this service enable series have been held up for no reason. It isn't like it would have broken anything.... | 19:59 |
SpamapS | dprince: right, I think it is more like "let's not make state/software separation harder than it already is going to be. | 20:00 |
*** jcooley_ has joined #tripleo | 20:01 | |
SpamapS | dprince: really.. just about 20 minutes from testing the upstart solution myself. :) | 20:01 |
dprince | SpamapS: my take is... its all in /etc so lets just do it at the same time ;) | 20:01 |
SpamapS | dprince: and the opposing take is "let's not create more churn for what we're planning to do basically tomorrow" | 20:07 |
*** julim has quit IRC | 20:16 | |
lifeless | and another success, cool. | 20:17 |
openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/tripleo-image-elements: Add a service enable/disable mechanism for upstart https://review.openstack.org/60341 | 20:21 |
SpamapS | dprince: ^^ | 20:21 |
SpamapS | untested yet | 20:21 |
SpamapS | building an image to test it with now | 20:21 |
openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/tripleo-image-elements: Add a service enable/disable mechanism for upstart https://review.openstack.org/60341 | 20:26 |
* SpamapS cleaned up upstart job env statement | 20:26 | |
rpodolyaka1 | lifeless: hey! | 20:29 |
rpodolyaka1 | lifeless: so this is what I've got so far https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:bp/baremetal-preserve-epehemeral,n,z | 20:30 |
dprince | SpamapS: I left some comments, mainly weren't there supposed to be some changes to the actual upstart script in os-svc-daemon too? | 20:30 |
SpamapS | dprince: there is one change. | 20:32 |
dprince | SpamapS: right, where does that TRIPLEO export get used then? | 20:32 |
rpodolyaka1 | lifeless: this should be considered as drafts... have to be heavily refactored (the patch pushing rebuild down the stack is really ugly, we probably will want to add some helpers instead of callbacks). And the last one (bringing in-rebuild for baremetal) is broken due to incorrect db query | 20:32 |
SpamapS | dprince: 'start on starting TRIPLEO=1' is a matcher. It matches any 'starting' event with "TRIPLEO=1" in its environment. | 20:33 |
SpamapS | dprince: the instance $JOB makes upstart start one of those for every unique $JOB | 20:33 |
SpamapS | dprince: and the 'task' makes upstart block the 'starting' event until the script section exits. | 20:34 |
dprince | SpamapS: ah, cool. well I suppose that works then. couple other minor things but if this works then great | 20:34 |
*** jcooley_ has quit IRC | 20:35 | |
SpamapS | just spotted a bug in the upstart conf | 20:35 |
openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/tripleo-image-elements: Add a service enable/disable mechanism for upstart https://review.openstack.org/60341 | 20:36 |
*** jcooley_ has joined #tripleo | 20:41 | |
*** dprince has quit IRC | 20:41 | |
*** cd-undercloud has joined #tripleo | 20:45 | |
cd-undercloud | ************** overcloud complete status=0 ************ | 20:45 |
*** cd-undercloud has quit IRC | 20:45 | |
openstackgerrit | A change was merged to openstack/os-apply-config: Log parsing errors from pystache as errors https://review.openstack.org/60047 | 20:45 |
*** cwolferh has quit IRC | 20:47 | |
*** jprovazn has quit IRC | 20:50 | |
rbrady | slagle: I had to add "export LIBVIRT_DEFAULT_URI=${LIBVIRT_DEFAULT_URI:-"qemu:///system"}" to step 6 of https://gist.github.com/slagle/981b279299e91ca91bd9 to get undercloud running. So far overcloud fails. | 20:50 |
*** julim has joined #tripleo | 20:56 | |
rpodolyaka1 | night all | 20:58 |
*** rpodolyaka1 has left #tripleo | 20:58 | |
*** noslzzp has joined #tripleo | 20:59 | |
*** jcooley_ has quit IRC | 20:59 | |
lifeless | and is that another success I see? | 21:03 |
*** cd-undercloud has joined #tripleo | 21:37 | |
cd-undercloud | ************** overcloud complete status=0 ************ | 21:37 |
*** cd-undercloud has quit IRC | 21:37 | |
SpamapS | lifeless: and another | 21:37 |
SpamapS | also it isn't slower anymore | 21:37 |
SpamapS | 'bout the same. I wonder if we just needed to get everything cached | 21:38 |
*** sdake has quit IRC | 21:40 | |
*** sdake has joined #tripleo | 21:40 | |
*** sdake has quit IRC | 21:40 | |
*** sdake has joined #tripleo | 21:40 | |
lifeless | SpamapS: or unfuck the network | 21:41 |
lifeless | excuse the french | 21:41 |
SpamapS | could very well be | 21:48 |
SpamapS | lifeless: any movement on that JIRA ticket? I haven't yet made the loop back around to try it out yet. | 21:48 |
lifeless | SpamapS: I haven't checked, I'm not subscribed to it | 21:50 |
SpamapS | hm... building an image with diskimage-builder and the vm element didn't result in an image that just boots in kvm. | 21:52 |
SpamapS | n/m | 21:54 |
SpamapS | doh no stackuser | 21:54 |
*** epim has joined #tripleo | 21:54 | |
*** jcooley_ has joined #tripleo | 22:12 | |
*** jdob has quit IRC | 22:14 | |
*** jcoufal has quit IRC | 22:17 | |
*** ccrouch has quit IRC | 22:17 | |
*** matty_dubs is now known as matty_dubs|gone | 22:29 | |
*** cd-undercloud has joined #tripleo | 22:30 | |
cd-undercloud | ************** overcloud complete status=42 ************ | 22:30 |
*** cd-undercloud has quit IRC | 22:30 | |
*** noslzzp has quit IRC | 22:41 | |
*** openstackgerrit has quit IRC | 22:48 | |
*** openstackgerrit has joined #tripleo | 22:48 | |
*** epim has quit IRC | 22:51 | |
*** epim has joined #tripleo | 22:58 | |
openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/tripleo-image-elements: Need libssl-dev to install glance standalone https://review.openstack.org/60374 | 22:58 |
SpamapS | nooooo not 42 | 22:59 |
* SpamapS shakes fist at Neutron | 22:59 | |
SpamapS | \o/ tripleo-image-elements and tripleo-heat-templates should not comment on tripleo bugs. :) https://review.openstack.org/60278 | 23:09 |
lifeless | not? | 23:13 |
*** jcooley_ has quit IRC | 23:14 | |
*** jcoufal-mob has joined #tripleo | 23:16 | |
*** bauzas has quit IRC | 23:17 | |
*** jcooley_ has joined #tripleo | 23:23 | |
*** jcoufal-mob has quit IRC | 23:24 | |
*** cd-undercloud has joined #tripleo | 23:25 | |
cd-undercloud | ************** overcloud complete status=0 ************ | 23:25 |
*** cd-undercloud has quit IRC | 23:25 | |
*** vkozhukalov has quit IRC | 23:26 | |
SpamapS | lifeless: s/not/now/ | 23:26 |
*** jcooley_ has quit IRC | 23:42 | |
*** jcooley_ has joined #tripleo | 23:43 | |
*** openstackgerrit has quit IRC | 23:47 | |
*** openstackgerrit has joined #tripleo | 23:47 | |
lifeless | ok, next deploy that succeeds I'm going to halt the service to validate some of the toci assumptions | 23:50 |
lifeless | specifically about vms and provider networks | 23:50 |
lifeless | if anyone wants to collaborate on that (e.g. dan, who is offline :P, or pleia2 ) - just shout | 23:51 |
pleia2 | lifeless: I'm around | 23:53 |
lifeless | pleia2: cool | 23:54 |
lifeless | so it will be ~30m before it hits | 23:54 |
lifeless | once it does I plan to stop tripleo-cd | 23:54 |
*** jcooley_ has quit IRC | 23:55 | |
lifeless | then review the deployed neutron setup, add a dedicated test tenant, and a provider network it has access too | 23:55 |
lifeless | and then see if we can do the funky chicken with an instance spawned on that network | 23:55 |
pleia2 | great | 23:55 |
openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/tripleo-image-elements: Add a service enable/disable mechanism for upstart https://review.openstack.org/60341 | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!