Tuesday, 2016-05-03

*** garthb has quit IRC00:06
*** Sukhdev has quit IRC00:11
*** ijw has joined #openstack-ironic00:11
*** baoli has joined #openstack-ironic00:14
*** ijw_ has joined #openstack-ironic00:15
*** ijw has quit IRC00:15
*** baoli has quit IRC00:16
*** piet has quit IRC00:18
*** piet has joined #openstack-ironic00:18
*** wajdi has quit IRC00:19
*** Sukhdev has joined #openstack-ironic00:30
*** jaybeale has quit IRC00:43
*** fragatina has quit IRC00:50
*** piet has quit IRC00:50
*** rloo has quit IRC00:56
*** Haomeng has joined #openstack-ironic01:04
*** baoli has joined #openstack-ironic01:07
*** david-lyle has joined #openstack-ironic01:09
*** fragatina has joined #openstack-ironic01:12
*** fragatin_ has joined #openstack-ironic01:13
*** fragatina has quit IRC01:16
*** fragatin_ has quit IRC01:24
*** fragatina has joined #openstack-ironic01:31
*** adu has joined #openstack-ironic01:32
*** rloo has joined #openstack-ironic01:36
*** baoli has quit IRC01:37
*** baoli has joined #openstack-ironic01:45
*** ijw_ has quit IRC01:54
*** adu has quit IRC01:57
*** jrist has quit IRC01:59
*** irf has joined #openstack-ironic02:05
*** jrist has joined #openstack-ironic02:12
*** piet has joined #openstack-ironic02:14
*** Sukhdev has quit IRC02:18
*** aarefiev has quit IRC02:26
*** piet has quit IRC02:27
*** aarefiev has joined #openstack-ironic02:28
*** irf has quit IRC02:28
*** piet has joined #openstack-ironic02:28
*** praneshp has joined #openstack-ironic02:35
*** piet has quit IRC02:42
*** rloo_ has joined #openstack-ironic02:54
*** rloo has quit IRC02:54
*** rloo_ has quit IRC02:55
*** rloo has joined #openstack-ironic02:56
*** baoli has quit IRC03:01
openstackgerritZhenguo Niu proposed openstack/ironic-specs: Dynamically allocate console ports  https://review.openstack.org/24987603:10
*** fragatina has quit IRC03:17
*** ChrisAusten has quit IRC03:22
*** ChrisAusten has joined #openstack-ironic03:22
*** cameron_nb has joined #openstack-ironic03:25
*** cameron_nb has quit IRC03:25
*** cameron_nb has joined #openstack-ironic03:25
*** cameron_nb has joined #openstack-ironic03:26
*** piet has joined #openstack-ironic03:32
*** Nisha_away has joined #openstack-ironic03:35
*** irf has joined #openstack-ironic03:36
*** Nisha_away has quit IRC03:43
*** harlowja_at_home has joined #openstack-ironic03:49
*** Nisha_away has joined #openstack-ironic03:55
*** blakec1 has joined #openstack-ironic03:56
Nisha_awayMorning Ironic!!!03:56
*** caldw__ has joined #openstack-ironic03:57
*** blakec1 has quit IRC04:00
*** piet has quit IRC04:01
*** fragatina has joined #openstack-ironic04:08
*** hemna has joined #openstack-ironic04:13
*** pleia2 has quit IRC04:16
*** sacharya has quit IRC04:16
*** sacharya has joined #openstack-ironic04:16
*** pleia2 has joined #openstack-ironic04:16
*** links has joined #openstack-ironic04:17
*** sacharya has quit IRC04:17
*** caldw__ has quit IRC04:29
*** caldw__ has joined #openstack-ironic04:32
*** ChrisAusten has quit IRC04:37
*** harlowja_at_home has quit IRC04:41
*** adu has joined #openstack-ironic04:45
*** adu has quit IRC04:49
*** moshele has joined #openstack-ironic04:58
*** hemna has quit IRC05:10
*** sacharya has joined #openstack-ironic05:17
*** sacharya has quit IRC05:22
*** vmud213 has joined #openstack-ironic05:23
*** ChubYann has quit IRC05:29
*** yolanda has joined #openstack-ironic05:44
*** yolanda has quit IRC05:48
*** yolanda has joined #openstack-ironic05:48
*** vmud213 has quit IRC06:05
*** vmud213 has joined #openstack-ironic06:08
*** caldw__ has quit IRC06:11
*** vmud213 has quit IRC06:14
*** vmud213 has joined #openstack-ironic06:15
*** rcernin has joined #openstack-ironic06:15
*** yolanda has quit IRC06:27
*** yolanda has joined #openstack-ironic06:27
*** yolanda has quit IRC06:34
*** yolanda has joined #openstack-ironic06:40
*** tesseract has joined #openstack-ironic06:44
*** tesseract is now known as Guest4047906:44
-openstackstatus- NOTICE: Filesystem on logs.openstack.org is broken, we are on the process of repairing it. Please stop checking your jobs until further notice06:44
*** ChanServ changes topic to "Filesystem on logs.openstack.org is broken, we are on the process of repairing it. Please stop checking your jobs until further notice"06:44
*** daemontool_ has quit IRC06:45
*** Guest40479 has quit IRC06:47
*** tesseract- has joined #openstack-ironic06:49
*** sacharya has joined #openstack-ironic06:53
*** Nisha_away has quit IRC06:56
*** sacharya has quit IRC06:58
openstackgerritTan Lin proposed openstack/ironic: Make use of oslo-config-generator  https://review.openstack.org/24733107:00
*** irf has quit IRC07:04
*** irf has joined #openstack-ironic07:04
*** rcernin_ has joined #openstack-ironic07:04
*** rcernin_ has quit IRC07:33
*** rcernin has quit IRC07:36
*** praneshp has quit IRC07:47
*** chlong has quit IRC07:47
*** itamarl has joined #openstack-ironic07:54
*** ppiela_ has joined #openstack-ironic07:55
*** yuanying has joined #openstack-ironic07:55
*** fragatin_ has joined #openstack-ironic07:56
*** xek__ has joined #openstack-ironic07:57
*** pas-ha_ has joined #openstack-ironic07:57
*** pas-ha has quit IRC07:58
*** yonglihe has quit IRC07:58
*** sergek has quit IRC07:58
*** francoblanco has quit IRC07:58
*** boris-42 has quit IRC07:58
*** agordeev has quit IRC07:58
*** cppforlife_ has quit IRC07:58
*** fyxim__ has quit IRC07:58
*** NobodyCam has quit IRC07:58
*** vdrok has quit IRC07:58
*** izaakk has quit IRC07:58
*** zzzeek has quit IRC07:58
*** vdrok_ has joined #openstack-ironic07:58
*** NobodyCam_ has joined #openstack-ironic07:58
*** pas-ha_ is now known as pas-ha07:58
lucasagomesmorning all07:58
irfgood morning07:58
*** vdrok_ has quit IRC07:58
*** vdrok_ has joined #openstack-ironic07:58
*** yolanda has quit IRC07:58
*** xek_ has quit IRC07:58
*** mmedvede has quit IRC07:58
*** ppiela has quit IRC07:58
*** lekha has quit IRC07:58
*** ayoung has quit IRC07:58
*** d0ugal has quit IRC07:58
*** ChrisMead has quit IRC07:58
*** zer0c00l has quit IRC07:58
*** yuanying_ has quit IRC07:58
*** zer0c00l has joined #openstack-ironic07:58
*** d0ugal has joined #openstack-ironic07:59
*** jistr has joined #openstack-ironic07:59
*** fragatina has quit IRC07:59
*** agordeev has joined #openstack-ironic07:59
*** athomas has joined #openstack-ironic07:59
*** ayoung has joined #openstack-ironic07:59
*** fyxim__ has joined #openstack-ironic08:00
*** lekha has joined #openstack-ironic08:00
*** yonglihe has joined #openstack-ironic08:00
*** zzzeek has joined #openstack-ironic08:00
irfi am able to configure ironic service and WoL driver successfully ...08:01
*** chlong has joined #openstack-ironic08:01
irfable to boot machine08:02
*** itamarl_ has joined #openstack-ironic08:02
irfnow i need further steps and action items ...08:03
*** yolanda has joined #openstack-ironic08:03
irfis it like configuring DHCP and assign the IP to bare metal node and then configure OS?08:03
*** ChrisMead has joined #openstack-ironic08:03
*** itamarl_ has quit IRC08:05
*** itamarl has quit IRC08:06
*** sergek has joined #openstack-ironic08:06
*** francoblanco has joined #openstack-ironic08:07
irfi think integration with nova compute is the next stuff so that we can start provisioning server ?08:08
*** cppforlife_ has joined #openstack-ironic08:08
irfplz suggest08:08
*** izaakk has joined #openstack-ironic08:09
*** boris-42 has joined #openstack-ironic08:09
lucasagomesirf, yup nova + neutron08:10
irfok08:11
*** mbound has joined #openstack-ironic08:11
*** mmedvede has joined #openstack-ironic08:12
*** vmud213 has quit IRC08:12
*** itamarl has joined #openstack-ironic08:15
*** ifarkas has joined #openstack-ironic08:17
*** ohamada has joined #openstack-ironic08:20
*** ChanServ changes topic to "Bare Metal Provisioning | Status: http://bit.ly/ironic-whiteboard | Docs: http://docs.openstack.org/developer/ironic/ | Bugs: https://bugs.launchpad.net/ironic"08:24
-openstackstatus- NOTICE: Logs filesystem has been successfully restored, please recheck your jobs08:24
*** fragatin_ has quit IRC08:24
*** keedya has quit IRC08:28
*** irf has quit IRC08:31
-openstackstatus- NOTICE: Filesystem on docs-draft.openstack.org is broken, we are on the process of repairing it. Please stop checking jobs using this filesystem until further notice08:35
*** dmk0202 has joined #openstack-ironic08:35
alinebmorning all!08:37
*** fragatina has joined #openstack-ironic08:37
*** derekh has joined #openstack-ironic08:39
lucasagomesalineb, morning08:48
*** irf has joined #openstack-ironic08:50
*** e0ne has joined #openstack-ironic08:52
*** vmud213 has joined #openstack-ironic08:53
*** sacharya has joined #openstack-ironic08:54
*** sacharya has quit IRC08:59
*** irf has quit IRC08:59
*** irf has joined #openstack-ironic08:59
*** electrofelix has joined #openstack-ironic09:02
*** fragatina has quit IRC09:03
*** mgould has joined #openstack-ironic09:07
openstackgerritZhenguo Niu proposed openstack/ironic-specs: Check duplicate nodes enrollment/update  https://review.openstack.org/29635709:08
mgouldmorning Ironic09:08
*** itamarl_ has joined #openstack-ironic09:12
openstackgerritMerged openstack/ironic: Use Ironic node name for VM  https://review.openstack.org/31040309:14
*** itamarl has quit IRC09:15
*** itamarl_ is now known as itamarl09:15
*** fragatina has joined #openstack-ironic09:16
lucasagomesmgould, morning09:19
*** mkovacik has joined #openstack-ironic09:19
*** e0ne has quit IRC09:21
mgouldmorning lucasagomes!09:21
-openstackstatus- NOTICE: Docs-draft filesystem has been restored. Please check your affected jobs again09:21
lucasagomesmgould, btw, do you know how to run the grenade tests ? I'm trying to follow https://github.com/JohnVillalovos/devstack-gate-test but but when I run ./ironic-grenade.sh it complains about the repos in /opt/stack/{new,old} not being populated09:23
lucasagomesjlvillal, ^ FYI09:23
lucasagomesso i tried to clone the repos manually but there's some merge conflicts that happens when cherry-pick'ing some stuff :-/09:23
mgouldlucasagomes, I haven't looked at that for a while, but I can try to help09:24
mgoulddid you run the setup_git_cache script?09:24
mgouldrun that on the machine hosting the VM09:24
mgouldalso, can you paste the output somewhere?09:25
*** sambetts|afk is now known as sambetts09:32
sambettsMorning all09:33
openstackgerritMerged openstack/ironic: Set root hints for disks less than 4Gb and IPA  https://review.openstack.org/31040409:35
*** mkovacik has quit IRC09:36
*** mkovacik has joined #openstack-ironic09:36
lucasagomesmgould, I haven't run that script AFAICT, 1 sec lemme try09:39
lucasagomesmgould, I'm running the ansible bits again09:39
*** fragatina has quit IRC09:41
sambettslucasagomes: How much ram are you using for your granade testing?09:42
lucasagomes8G09:43
sambettsdas a lot of ram :-P09:47
*** links has quit IRC09:48
lucasagomesheh yeah, that's what was suggested09:50
* sambetts is having to redownload 14.04 :/09:52
openstackgerritDebayan Ray proposed openstack/ironic: File download fails with swift pseudo folder  https://review.openstack.org/30692909:54
*** cameron_nb has quit IRC10:00
mgouldlucasagomes, I'm not sure if running that script is required for correctness, but it makes your run/debug/curse/try-again loop a lot faster10:00
sambettshahaha10:01
lucasagomesmgould, yeah, I apparently can't access my VM again after the ansible run10:01
lucasagomesthe ubuntu user's gone now I have a jenkins one and a "backdoor" one10:01
lucasagomesbut I can't log in anyway :-/10:02
mgouldd'oh10:02
*** irf has quit IRC10:02
* lucasagomes is not using vagrant 10:02
mgouldI think the "backdoor" user has been added since I last looked at the script10:02
mgouldoh, OK; it only worked using vagrant when I last looked at it10:02
mgouldwhat are you using instead? virsh?10:02
*** e0ne has joined #openstack-ironic10:02
lucasagomesmgould, yeah10:02
* sambetts was talking to john about the users10:03
*** irf has joined #openstack-ironic10:03
irfgood morning mgould10:03
mgouldmorning irf10:03
mkovacikmorning all!10:03
sambettsthe backdoor user was added so you can log in when the scripts nuke the existing users10:03
mgoulddid you have any luck with your wake-on-lan problem?10:03
mgouldsambetts, makes sense10:03
irfall the issues resolved and node is getting booted10:03
mgould\o/10:04
mgouldwhat changes did you need to make?10:04
*** links has joined #openstack-ironic10:04
irfthanks a ton for all your continus support and co-operation10:04
mgouldnp, glad to hear it worked out in the end10:04
irfactually.. issues was on the NIC card ....10:04
mgouldgo on?10:04
irfNIC card was not receiveing the packet either ...10:04
irfi shifted to another NIC and changed the MAC addrd10:05
irfadds10:05
mgouldweird10:05
irfand it started functioning ...10:05
mgouldO_o10:05
mgouldso it was getting through the switch but being dropped by the NIC?10:05
irfso now WoL is also working and from ironic also i am able to boot the node ...10:06
irfyes10:06
irfi checked with IT and there was no issue on switch or firewall10:06
* mgould 's faith in computers takes another knock10:06
*** divya has joined #openstack-ironic10:06
irfbut frankly spoeaking it was so weired10:06
irfthe NIC was faulty10:07
irfand due to that ... i guess10:07
*** links has quit IRC10:07
divyaHi folks...10:08
mgouldhi divya10:08
mgouldirf, are the two NICs the same model?10:09
irfnop .. different one10:09
divyamgould : Hi,,, Still the issue is not resolved.10:10
*** Nisha_away has joined #openstack-ironic10:12
mgouldirf, possibly the first one you tried doesn't support WoL - apparently not all NICs do10:12
irfyes might be ...10:12
irfnow i am proceeding with nova and neutron configuration so that i can start computing physical server10:13
mgouldirf, good luck!10:13
mgoulddivya, remind me what the problem was?10:13
divyamgould : http://paste.openstack.org/show/495518/10:14
*** links has joined #openstack-ironic10:14
mgoulddivya, thanks10:15
divyamgould : u asked me to give the output of sudo tcpdump -vv port 67 or port 6810:15
divyaBut it is not showing anything.10:16
divya$ sudo tcpdump -vv port 67 or port 68 tcpdump: listening on docker0, link-type EN10MB (Ethernet), capture size 65535 bytes10:16
irfthanks mgould10:16
mgoulddivya, are you running things in Docker containers?10:17
divyamgould : no, i am not running.10:20
mgoulddivya, OK, in that case then tcpdump is listening on the wrong interface10:21
mgouldone minute, then I can give you my full attention...10:21
Nisha_awaylucasagomes, regarding https://review.openstack.org/#/c/306870/10:24
divyamgould : is there any way to check it?10:29
mgouldsorry, my "unread emails" count was full of lies10:29
mgouldOK, back10:30
mgoulddivya, you have two physical machines, one controller and one baremetal10:30
mgouldthe controller is running neutron and ironic, and the two nodes are physically connected over a LAN, yes?10:30
divyayes, both are connected by l2 switch10:31
mgouldcool10:31
* mgould reads the paste10:31
lucasagomesNisha_away, hi there, yes?10:32
mgouldOK, I see you have a neutron network called provision-net10:32
mgouldand another called tenant-net10:33
divyayes, couple of networks10:33
mgouldthe idea is to provision new baremetal nodes over provision-net and then communicate with them over tenant-net after deployment?10:33
mgouldbecause I'm pretty sure we don't support that upstream yet10:33
mgouldlucasagomes, ^^^ ?10:34
* lucasagomes reads10:34
divyamgould : yes, that is the idea.10:34
lucasagomesdivya, hi, yeah mgould is correct. We do have patches in the review queue for ironic and nova, but they are not merged yet10:35
* lucasagomes tries to find the links10:35
*** Haomeng has quit IRC10:36
divyamgould, lucasagomes : i pulled those unmerged codes. pls send the links to cross check10:37
lucasagomesdivya, https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:bp/ironic-networks-support,n,z10:38
lucasagomesfor nova10:38
mgoulddivya, so you're running patched versions of Ironic and Neutron?10:38
divyamgould : yes10:38
lucasagomesdivya, oh, in that case I think you should talk to jroll or Sukdev or someone that has tried it10:39
*** MattMan has joined #openstack-ironic10:39
divyalucasagomes : i spoke with jroll, he mentioned that there could be an issue between bm and controller10:41
mgoulddivya, did he say what *kind* of issue?10:41
sambettspretty sure this is the error you need to pay attention to Stderr: u'Set Chassis Power Control to Down/Off failed: Command not supported in present state\n'^[[00m10:42
mgoulddivya, what happens if you run `sudo brctl show` on the controller?10:42
mgouldactually, listen to sambetts, I'm just guessing10:42
divyalucasagomes, mgould : yes, i sent the same paste to understand the issue.10:42
sambettsthe conductor tried to use ipmitool to shutdown the node your trying to boot, and it failed10:43
lucasagomesdivya, right, I'm not sure how to help since I haven't tried those patches yet10:43
* lucasagomes do not have the gear10:43
divyaoutput of brctl show http://paste.openstack.org/show/495944/10:43
lucasagomesdivya, there's a email thread about it called [openstack-dev] [Ironic][Neutron] Integration status10:44
lucasagomesyou may want to check it10:44
mgoulddivya, thanks: unfortunately that was less helpful than I'd hoped10:44
mgoulddivya, what does `sudo ip addr ls` say on the controller?10:45
* sambetts knows that devananda has had it working, and /me has had it working, however its changed dramatically since I was using it, because its still a big WIP chain 10:45
sambettsI would try to run the ipmitool command manually, and attempt to shutdown the machine using that, because as far as I can tell thats where it broke down, and the mgnt interface shouldn't be affected by the network switching logic10:47
divyamgould : http://paste.openstack.org/show/495945/10:47
mgouldsambetts, good point10:48
mgouldthough I'm confused by the fact that the node is turning on10:49
mgoulddivya, is the controller node physically connected to the IPMI network?10:50
divyamgould : no, bare metal node is physically connected to IPMI network.10:52
*** sacharya has joined #openstack-ironic10:55
mgoulddivya, this may be the problem10:55
openstackgerritDebayan Ray proposed openstack/proliantutils: Add proper error message for extraction failure  https://review.openstack.org/30533110:55
mgouldthe controller node needs to be able to talk to the baremetal node's BMC10:55
* mgould wonders how it's being turned on currently...10:56
*** lucasagomes is now known as lucas-hungry10:59
*** sacharya has quit IRC10:59
divyamgould : Bare metal's IPMI console is accessible from controller. when i power the ironic node from controller, physical node is powered on.10:59
mgouldOK10:59
mgouldwhat happens if you run `ping $IPMI`?10:59
mgouldand what happens if you run the ipmitool command manually?11:00
divyamgould : it is pinigng11:00
mgouldOK, cool11:00
mgouldtry ipmitool -I lanplus -H 172.26.24.104 -L ADMINISTRATOR -U USERID -R 12 -N 5 -f /tmp/tmpm9D21e power off11:01
divyamgould : this one "ipmitool -I lanplus -H 172.26.24.104 -L ADMINISTRATOR -U USERID -R 12 -N 5 -f /tmp/tmpm9D21e power off"for node 9999b024-f309-40ec-b40b-7b92a2db1376. Error: Unexpected error while running command. Command: ipmitool -I lanplus -H 172.26.24.104 -L ADMINISTRATOR -U USERID -R 12 -N 5 -f /tmp/tmpm9D21e power off"11:01
mgouldyep, that's the one11:01
mgouldbrb11:01
divyamgould : same error message as shown in ir-conductor log11:04
mgouldback11:04
divyahttp://paste.openstack.org/show/495946/11:04
*** Nisha_away has quit IRC11:05
sambettsthen there is a problem with your machines BMC preventing a remote poweroff11:05
mgoulddivya, on line 5, did you type in the password?11:05
divyamgould : yes, i entered manually11:06
mgouldcool11:06
mgoulddivya, it may be worth adding -vv to the ipmitool command-line and trying again11:06
* mgould has no idea how to debug a problem in the BMC, sorry11:06
divyamgould : i don't understand the output since it is new http://paste.openstack.org/show/495947/11:09
* mgould takes a look11:09
mgould"-vv" was "set verbosity to level 2", but you knew that11:10
mgouldthere's also -vvv, which includes hexdumps of all packets11:10
mgoulddivya, what's the output of `ipmitool -I lanplus -H 172.26.24.104 -L ADMINISTRATOR -U USERID -R 12 -N 5 power status`?11:12
divyamgould : thanks for the info. 1 sec.11:12
divyamgould :  http://paste.openstack.org/show/495949/11:14
mgouldiiinteresting11:15
mgouldtry again with -vv?11:15
divyamgould : got same error for -vvv11:15
mgouldand no more useful info?11:15
* mgould isn't expecting -vv to do anything different, but he is hoping it will give more insight into what's going wrong11:16
divyamgould : http://paste.openstack.org/show/495950/11:18
sambettsthe chassis is already off, so thats why its failing to power off the node, because its already in the off state11:20
mgouldso it is11:21
*** adu has joined #openstack-ironic11:21
*** yolanda has quit IRC11:22
jrollmorning friends11:23
mgouldmorning jroll11:23
sambettsHey jroll, how are you recovering from the summit?11:24
*** links has quit IRC11:24
jrollsambetts: fantastically, short flight + full weekend did wonders11:25
jrollhow are you all doing on that side of the pond?11:25
divyasambetts, mgould : powered on and tried off. http://paste.openstack.org/show/495952/11:26
sambettsjet lag + converence flu nearly killed me yesterday, but feel11:26
sambettsbetter today11:26
jroll:( :D11:26
jrollbunch of other people ended up getting sick too11:27
jrollsomehow I was spared11:27
*** yolanda has joined #openstack-ironic11:27
sambettsyeah, it didn't hit me until yesterday, I was fine all of Sat and Sun11:28
jrollweird11:31
mgoulddivya, so the chassis is now on?11:31
sambettsjroll: btw what was the context of the triple-o testenv-worker element, I saw the ping in my highlight window but had no context11:31
mgouldif so, try running `nova boot` again11:31
divyamgould : yes, physicall it is on.11:32
divyamgould : sure.11:32
jrollsambetts: reserving hardware to run tests against11:36
jrollthat's how they do it I guess11:36
sambettsah right, I thought it might be something like that, although when I was looking at it, it seemed to just carve a host into multiple VMs to testing tripleo11:37
*** thrash has quit IRC11:37
jrollmehhhh, ok, ignore it then :)11:37
sambettsbut that was just a quick skim11:37
jrollmanaged to crash my vc client, now it segfaults at startup \o/11:37
sambetts:(11:37
jrollwhy so :(, that means no meetings ;)11:38
sambettshahaha11:38
*** thrash has joined #openstack-ironic11:39
*** thrash has quit IRC11:39
*** thrash has joined #openstack-ironic11:39
*** thrash has quit IRC11:39
*** thrash has joined #openstack-ironic11:42
*** thrash has quit IRC11:42
*** thrash has joined #openstack-ironic11:42
*** adu has quit IRC11:44
divyamgould : when i give nova boot, physical bare metal got rebooted and pxe failied with thie error "Boot failed. PXE Network."11:45
sambettsis there a trace back in the logs11:46
sambetts?11:46
jrollit just isn't pxe booting, same issue as yesterday :|11:47
jrollit either can't dhcp properly or can't tftp properly11:47
jrollsambetts: (fwiw, that's the error on the console for the node)11:48
sambettsoh right11:48
mgouldjroll, can you add `log_dhcp` to the relevant dnsmasq.conf?11:49
jrollmgould: I can't, perhaps divya can :P11:49
mgouldah, sorry11:49
jrollI was helping yesterday so just adding context11:49
mgouldjroll, thanks11:49
divyaJroll, mgould  : Thanks. i will add it.11:51
mgouldthen look at the logs from dnsmasq, that should give you some idea of what stage it's failing at11:51
mgouldif that doesn't work, then figure out which interface it's talking on and use tcpdump on that interface11:52
divyamgould : ok. couldn't be an issue right? http://paste.openstack.org/show/495869/11:53
*** dprince has joined #openstack-ironic11:53
mgoulddivya, neutron-dhcp-agent is expecting a config file in .ini format, not dnsmasq.conf format11:54
*** lucas-hungry is now known as lucasagomes11:54
lucasagomesjroll, morning11:54
jrollhey lucasagomes \o11:54
mgoulddivya, have a look at the neutron-dhcp-agent docs to see if there's an option you can pass in to make dnsmasq log more11:55
*** maurosr has quit IRC11:55
lucasagomesmgould, apparently my grenade tests is going now... I've restarted from scratch (I had to do it anyways to try to document how to run the tests)11:55
mgouldlucasagomes, \o/11:55
lucasagomeslet's see let's see11:55
* mgould puts the champagne back on ice11:56
lucasagomeslol11:56
jrollI started kicking around tempest-smoke yesterday (first step of grenade) and made a bit of progress11:56
jrollor rather, found two tests that will always fail and skipped them11:56
jrolllucasagomes: https://review.openstack.org/#/c/311864/11:57
lucasagomesoh right11:57
jrollthat should get a couple more passing11:57
lucasagomesI'm trying to document it here https://etherpad.openstack.org/p/ironic-grenade-tests11:57
jroller, couple less failing11:57
lucasagomesofc there's almost nothing yet, just a raw step-to-step11:57
* lucasagomes checks11:57
*** baoli has joined #openstack-ironic11:57
jrollthere's also this https://etherpad.openstack.org/p/ironic-newton-summit-grenade-worksession11:57
divyamgould : do i need to add .ini format file? i am following thie link http://docs.openstack.org/developer/ironic/deploy/install-guide.html11:58
jrolllucasagomes: side note, you might be interested in yesterday's irc logs, had a good chat with jay pipes about how his resource pool thing might fit for us11:58
lucasagomesjroll, yeah I will probably update it there once I get it running11:58
lucasagomesjroll, oh, I thought we didn't have a meeting (it was national holiday here too)11:58
lucasagomeswill check, thanks11:58
jrolllucasagomes: we didn't, just chatting in here11:59
* lucasagomes checks eavesdrop11:59
jrollno rush, it's quite the read :P11:59
jaypipesjroll: ssshhhh, don't tell lucasagomes!12:01
lucasagomesha12:01
jaypipes:P12:01
lucasagomestoo late12:01
*** jjohnson2 has joined #openstack-ironic12:01
jaypipeslucasagomes: back home safe and sound I presume? :)12:01
jrolllol12:01
jrolland this is how another two hour conversation begins :P12:02
lucasagomesyup!12:02
jaypipesjroll: :)12:02
mgoulddivya, we're trying to change the options passed to dnsmasq by neutron-dhcp-agent, to do something not covered by those instructions12:02
mgouldneutron-dhcp-agent expects its config file to be a .ini12:03
*** links has joined #openstack-ironic12:03
mgould*if* neutron-dhcp-agent allows us to configure its dnsmasq process in the way we want, then yes, we'll have to edit an ini file that neutron-dhcp-agent reads12:04
*** maurosr has joined #openstack-ironic12:04
mgouldit might not pass that option through, in which case our options are (a) try editing the generated dnsmasq.conf directly and restarting dnsmasq, (b) give up and try something else12:05
mgoulddivya, have a look in etc/neutron/dhcp_agent.ini12:06
*** trown|outtypewww is now known as trown12:06
mgouldis dnsmasq_base_log_dir set?12:06
*** rbudden has joined #openstack-ironic12:08
TheJuliagood morning everyone12:09
sambettsMorning TheJulia12:09
openstackgerritvinay kumar muddu proposed openstack/ironic-python-agent: Fix local boot issue with fedora in uefi mode  https://review.openstack.org/30214312:09
mgouldmorning TheJulia12:10
divyamgould : it is set. agin running nova boot to check the log. dnsmasq_base_log_dir = /tmp12:12
*** maurosr has quit IRC12:13
mgoulddivya, cool. Have a look in /tmp for dnsmasq logfiles12:14
jroll\o TheJulia12:16
*** krtaylor has quit IRC12:18
divyamgould : i don't find any log file12:19
*** krtaylor has joined #openstack-ironic12:21
*** fragatina has joined #openstack-ironic12:22
xavierrgood morning TheJulia12:23
xavierrgood morning lucasagomes12:23
*** maurosr has joined #openstack-ironic12:23
xavierrmorning all :)12:23
*** sinval has joined #openstack-ironic12:23
sinvalmorning Ironic12:23
mgouldmorning xavierr sinval12:24
xavierrmorning mgould :)12:24
mgoulddivya, anything else logging-related in dhcp_agent.ini?12:25
divyamgould : looking at it.12:25
*** amotoki has joined #openstack-ironic12:27
*** amotoki has quit IRC12:27
lucasagomesxavierr, hi there12:27
*** thrash is now known as thrash|biab12:30
vmud213morning everyone12:32
*** mgould has quit IRC12:33
*** natorious has quit IRC12:33
vmud213TheJulia: Would you mind reviewing https://review.openstack.org/#/c/30214312:34
vmud213It's pending for a while12:35
TheJuliasure, in a few minutes12:35
*** mgould has joined #openstack-ironic12:35
* lucasagomes is in a meeting, but was able to run granade (which failed on the smoking tests)12:35
*** natorious has joined #openstack-ironic12:38
*** vmud213 has quit IRC12:41
*** mgould has quit IRC12:48
*** mgould has joined #openstack-ironic12:48
*** mjturek1 has joined #openstack-ironic12:49
openstackgerritXavier proposed openstack/ironic: Updating dev-quickstart.rst file links  https://review.openstack.org/30882112:50
*** irf has quit IRC12:52
divyamgould : couple of directories created under /tmp/dhcp_dns_log12:53
*** piet has joined #openstack-ironic12:53
*** mgould has quit IRC12:53
divya01aca76e-1de6-4459-849d-b61d216f34a7      - tenant-net12:53
divyamould : c35cbfde-db1a-4224-8098-a0e67b772a20      -        provision-net12:53
*** Goneri has joined #openstack-ironic12:54
*** mjturek1 has quit IRC12:54
*** sacharya has joined #openstack-ironic12:55
*** thrash|biab is now known as thrash12:56
divyamgould : dnsmasq log file http://paste.openstack.org/show/495956/12:57
*** raildo-afk is now known as raildo12:58
*** rloo has joined #openstack-ironic12:59
*** sacharya has quit IRC13:00
*** Nisha_away has joined #openstack-ironic13:01
*** itamarl has quit IRC13:05
*** itamarl has joined #openstack-ironic13:05
*** mjturek1 has joined #openstack-ironic13:07
sambetts:( my CI has blown up and it seems like something is weird in tempest13:09
sambetts:/13:09
lucasagomesjroll, http://paste.openstack.org/show/495958/ this is the error you've seem on the smoking tests?13:10
jrolllucasagomes: no, I haven't seen that :/13:11
lucasagomes:-/ new one then13:11
*** itamarl has quit IRC13:11
jlvillallucasagomes, Did you resolve issue with devstack-gate-test?13:16
*** rloo_ has joined #openstack-ironic13:17
jlvillalI fixed an issue yesterday where I have to now install two libraries so that Ansible 2.0 compiles. This was working before, but for some reason it stopped13:17
*** rloo has quit IRC13:17
lucasagomesjlvillal, yup, missing dependencies13:17
lucasagomesI listed that in the etherpad13:18
*** mgould has joined #openstack-ironic13:18
lucasagomesjlvillal, https://etherpad.openstack.org/p/ironic-grenade-tests13:18
lucasagomesthat works so far for me13:18
jlvillalGreat, thanks :)13:18
lucasagomesjlvillal, the only thing is, after the smoking tests fails it cleans up the environment automatically13:19
lucasagomesit kinda sucks, cause I would like to have a way to re-run the tests quickly13:19
jlvillallucasagomes, https://github.com/JohnVillalovos/devstack-gate-test/commit/997aca68735c2df8fc456e74bea6af51ee19d5cf13:19
lucasagomesinstead of waiting 30 minutes every time I need to re-run it13:19
jlvillallucasagomes, Maybe we should make a patch to have it not clean up on failure.13:19
jlvillalCan then add that patch to the 'update-projects.sh' file13:19
jlvillalAdd it, as in add it to be cherry-picked13:20
jlvillalAnd I did propose this: https://review.openstack.org/311876  So that if Ansible fails to install, stop right there13:21
lucasagomescool, will take a look13:21
sambettsany idea which is the best channel to talk to people about tempest is?13:22
lucasagomesopenstack-qa I guess13:23
lucasagomes#openstack-qa13:23
jlvillalFYI: for anyone. For $15 you can get a big group of e-books from Humble Bundle  https://www.humblebundle.com/books/no-starch-hacking-books13:23
jlvillalA few Python books in there.13:23
sambettsah cool thanks lucasagomes13:23
jlvillalbig group = 13 e-books13:24
jlvillalsambetts, +1 on #openstack-qa13:24
*** NobodyCam_ is now known as NobodyCam13:25
sambettsCool :) seeing a weird issue in my CI, http://192.133.158.2:8080/view/openstack%20ironic/job/tempest-dsvm-ironic-pxe_ucs/618/console13:25
*** mgould has quit IRC13:25
NobodyCamGood morning Ironic folks.13:26
sambettsHey NobodyCam13:26
NobodyCam:)13:26
jlvillalNobodyCam, Good morning :)  And good morning to everyone else.13:26
NobodyCammorning sambetts jlvillal :)13:26
lucasagomesjlvillal, you need python-dev installed to ansible to compile as well13:27
lucasagomesapart from libffi and libssl13:27
*** piet has quit IRC13:28
jlvillallucasagomes, Okay thanks!  I'll add that.13:28
*** piet has joined #openstack-ironic13:28
jlvillallucasagomes, I think it is working in my case because I am building/installing python after all the puppet stuff runs. Just a theory.13:29
jlvillals/python/ansible/13:29
jlvillalBut I will add it to the list of packages to install13:30
*** mgould has joined #openstack-ironic13:34
*** ptrlv has joined #openstack-ironic13:38
NobodyCammorning lucasagomes13:39
lucasagomesNobodyCam, good morning13:39
*** piet has quit IRC13:39
*** rloo_ has quit IRC13:40
*** rloo has joined #openstack-ironic13:41
NobodyCammorning rloo :)13:41
rloomorning NobodyCam, lucasagomes, sambetts, jlvillal13:41
lucasagomesrloo, g'morning13:42
jrollohai rloo, NobodyCam, jlvillal13:42
NobodyCammorning jroll :)13:42
rloohi jroll13:42
NobodyCamHow was the trip back for everyone. Good I hope13:42
jlvillalGood morning rloo jroll13:43
sambettsNobodyCam: trip was good, but converence flu hit my yesterday13:43
sambettss/my/me13:43
jrolljlvillal: lucasagomes: SO CLOSE https://gist.github.com/jimrollenhagen/f703875bfddf8ca26925f8a2c37882b513:44
NobodyCamYep... I have stuffed up nose13:44
*** baoli has quit IRC13:44
jrollI think the failure is some sort of config issue13:44
jlvillalSweet. tempest-full and only one test fails?13:44
*** baoli has joined #openstack-ironic13:45
jlvillalOh wait, tempest-smoke13:45
jlvillalStill great :)13:45
jrollyeah, starting with smoke13:45
jrollnotes at the bottom of https://etherpad.openstack.org/p/ironic-newton-summit-grenade-worksession13:45
jrollotherwise is stock devstack13:45
jlvillalWe need that for Grenade, so good stuff :)13:45
sambettshahahaha becuase you can13:46
jrollright, that's the idea13:47
jrollnow it's just making it fast (and fit in an 8gb vm)13:48
*** elfosardo has joined #openstack-ironic13:49
lucasagomesjroll, nice!13:50
* jlvillal goes gets ready to go to work13:51
*** ametts has joined #openstack-ironic13:52
Gonerihi, can I have a review on this puppet-ironic patch https://review.openstack.org/#/c/310283/ ?14:01
lucasagomesdone14:05
sambettsoh man... cinder has blown up my CIs tempest environment ...14:09
*** links has quit IRC14:10
* lucasagomes brbs needs to go to the post office14:11
*** lucasagomes is now known as lucas-post-offic14:11
*** moshele has left #openstack-ironic14:12
openstackgerritMerged openstack/ironic: Updated from global requirements  https://review.openstack.org/31153414:13
*** caldw__ has joined #openstack-ironic14:13
*** blakec1 has joined #openstack-ironic14:15
*** itamarl has joined #openstack-ironic14:18
*** caldw__ has quit IRC14:18
*** itamarl has quit IRC14:18
*** divya has quit IRC14:20
*** [1]cdearborn has joined #openstack-ironic14:22
gabriel-bezerraGood morning, folks14:31
gabriel-bezerraIf you are interested in the Dijkstra manuscript I mentioned in the end of Ironic Social, on Thursday, find it here: http://www.cs.utexas.edu/users/EWD/transcriptions/EWD10xx/EWD1036.html14:32
NobodyCamhey hey gabriel-bezerra hope you have a good trip back14:32
*** cdearborn has joined #openstack-ironic14:32
gabriel-bezerraWhich I highlighted the part of stopping calling errors bugs14:32
gabriel-bezerraThank you very much, NobodyCam. I hope the same for you.14:33
NobodyCam:)14:34
*** wajdi has joined #openstack-ironic14:37
*** piet has joined #openstack-ironic14:38
*** baoli has quit IRC14:45
*** [1]cdearborn has quit IRC14:46
*** e0ne has quit IRC14:47
*** mtanino has joined #openstack-ironic14:47
*** Keedya has joined #openstack-ironic14:48
*** cdearborn has quit IRC14:48
*** baoli has joined #openstack-ironic14:49
*** sacharya has joined #openstack-ironic14:49
jlvillallucas-post-offic: FYI: https://github.com/JohnVillalovos/devstack-gate-test/commit/e30c58041640fd94599ae20b4c7f8d3b9c795a4e14:51
*** vishwanathj has joined #openstack-ironic14:51
*** baoli has quit IRC14:53
*** Keedya has quit IRC14:53
*** mtanino has quit IRC14:57
*** baoli has joined #openstack-ironic14:59
*** fragatina has quit IRC15:00
*** absubram has joined #openstack-ironic15:03
*** rloo has quit IRC15:05
*** rloo has joined #openstack-ironic15:05
*** mgould has quit IRC15:06
devanandamorning, all15:07
TheJuliagood morning devananda15:09
NobodyCammorning devananda15:09
*** tesseract- has quit IRC15:12
*** garthb has joined #openstack-ironic15:14
*** xhku_ has joined #openstack-ironic15:15
*** mgould has joined #openstack-ironic15:15
*** absubram has quit IRC15:15
*** xhku has quit IRC15:18
*** links has joined #openstack-ironic15:19
sambettsmorning devananda15:20
*** ChrisAusten has joined #openstack-ironic15:20
jrollhey deva15:23
cineramagabriel-bezerra, thanks for the #longread15:26
cineramahi folks15:26
jlvillaljroll: devananda: You probably have already seen this, but just in case: http://paste.openstack.org/show/495971/15:26
jrolljlvillal: yeah, that prompted a nice long discussion yesterday15:26
jlvillal:)15:27
devanandajlvillal: yep, thanks :)15:29
wajdigood morning all! :)15:29
gabriel-bezerracinerama: you're welcome!15:29
mgouldmorning devananda wajdi15:30
NobodyCammorning mgould wajdi cinerama15:31
*** Nisha_away has quit IRC15:34
mgouldmorning NobodyCam15:34
mgouldjlvillal, what currently exists out of the things described in that paste?15:36
jlvillalmgould: That is a proposal15:36
*** mtanino has joined #openstack-ironic15:36
mgouldjlvillal, OK15:36
mgoulddoes nova currently have a notion of resource classes, or is that entirely new?15:36
jlvillalmgould: jroll and devananda know much much much much more about it than I do.15:36
jlvillalmgould: But it goes towards being able to have multiple nova compute hosts controlling Ironic, is my understanding.15:37
jlvillalmgould: I think that is new15:37
* jroll finds a link15:37
jrollmgould: they're basically rearchitecting the scheduler15:37
mgouldjroll, cool15:38
*** piet has quit IRC15:38
jrollmgould: http://lists.openstack.org/pipermail/openstack-dev/2016-February/086371.html15:38
mgouldnova-scheduler scales horribly, right?15:38
*** lucas-post-offic is now known as lucasagomes15:41
lucasagomesjlvillal, awesome thanks15:41
lucasagomesdevananda, good morning15:42
jlvillallucasagomes: So I am failing at the resource create phase. Are you seeing same issue?15:42
lucasagomesthe issue I saw was http://paste.openstack.org/show/495958/15:42
lucasagomesseems to be after resource create tho15:42
jlvillallucasagomes: thanks15:43
devanandamgould: resource classes and resource pools are entirely new15:43
* sambetts is trying to play catch up on the grenade stuff15:44
lucasagomessambetts, it's not easy heh15:45
jrollso, what's the nova-api error?15:45
lucasagomesproblem is that right now it seems very time consuming, I mean, it takes a lot of time to get the results15:45
* lucasagomes is looking at how to optmize that15:45
*** piet has joined #openstack-ironic15:45
jlvillallucasagomes: Yeah, the time is a killer...15:45
jrollso I'm just hacking on smoke tests in a devstack environment, so I don't need to rekick it every time and such15:46
jrollit isn't as 'gate-like' but should get us most of the way there15:46
sambettssounds like the same issue I was having when setting up my CI, e.g. takes 1hr just to tell you its failed15:47
*** cdearborn has joined #openstack-ironic15:47
lucasagomesjroll, +1 yup yeah for the smoking tests that sounds like a better way indeed15:47
lucasagomesin any case, my goal was to learn how to actually run the grenade tests as we do in gate using jlvillal ansible playbooks15:48
lucasagomeswhich I know now, maybe I should look at the devstack+smoking as well to tackle that quickly15:48
jrolllucasagomes: well, if we don't get the create-resources bit going, we won't get to the smoke tests15:49
lucasagomesjroll, yeah... btw jlvillal do you have a paste of the error you are seem?15:50
lucasagomesseeing*15:50
jrollso does everything get torn down, so you don't get a nova traceback?15:50
jlvillallucasagomes: I need to look. I am rebuilding my box right now...15:50
jrollor nova logs?15:50
*** fragatina has joined #openstack-ironic16:01
*** dmk0202 has quit IRC16:03
*** keedya has joined #openstack-ironic16:06
sambettswhats the minimum vm count for tempest smoke?16:07
*** Nisha_away has joined #openstack-ironic16:11
*** e0ne has joined #openstack-ironic16:11
*** ifarkas has quit IRC16:13
*** fragatin_ has joined #openstack-ironic16:13
JayFSo I have my testbed installed for testing faster pxe roms, but despite grepping and reading through configs for the last while, I can't find where the hell it's configured :/16:16
*** absubram has joined #openstack-ironic16:16
*** fragatina has quit IRC16:17
sambettsJayF: for KVM?16:18
JayFaye16:18
JayFvia libvirt in this case16:18
jrollJayF: find ironic/devstack/ -name *node*16:18
jrollsomething in there16:18
*** xhku_ has quit IRC16:19
JayFThat specifies a /nic driver/16:19
sambetts /usr/share/qemu there are a bunch of roms in there16:19
JayFnot a pxe rom16:19
*** xhku has joined #openstack-ironic16:19
jrollmmm16:20
JayFyeah I see the roms16:20
JayFbut I can't figure out how they are used16:20
JayFI actually suspect those are ... assembled16:20
JayFI'll keep digging then. Just wanted to make sure I wasn't missing anything obvious16:20
sambettsfrom a related askubuntu "Somehow these are automatically found and used by seabios when booting with one of these NICs." hehe16:21
jrollJayF: http://libvirt.org/formatdomain.html#elementsNICSROM ?16:21
JayFyeah that's the nic rom16:21
jrollmmm16:21
JayFI suspect I'll have to make a custom nic rom to do some testing here16:21
JayFif it works, we could probably still do it all in devstack, we'll see16:22
jrolldoes that not have the pxe rom backed in?16:22
JayFI think it does16:22
JayFI think the way it works is16:22
jrollalso, apt-get install kvm-pxe ?16:22
JayFnetwork rom = nic rom + pxe rom16:22
JayFso I have to assemble it16:22
jrollnod16:22
jrollJayF: -option-rom? http://alien.slackbook.org/dokuwiki/doku.php?id=slackware:qemu#pxe_booting_your_qemu_virtual_machine16:23
JayFyou're about one result ahead of me in google I think16:23
jroll"As of the 0.9.0 release, QEMU can do a PXE boot using one of the PXE-capable boot roms available in /usr/share/qemu"16:23
JayFlol16:23
jrollheh16:23
JayFyeah see looking at that option, according to the manpage16:23
JayFit just basically automatically sends that through16:23
JayFI'll figure it out though, I just hope this is a speedup16:23
openstackgerritNisha Agarwal proposed openstack/ironic-specs: Enhance ilo drivers to do inband inspection  https://review.openstack.org/20190416:24
jrollhm16:24
JayFthat option isn't passed through to qemu at all right now, fwiw16:25
JayFthe option-rom isn't the same as what I was looking at, btw16:25
JayFbut I think that option rom is nic specific16:25
sambettsit would be cool to get pxe not taking 3mins, but I worry that it just a nested virt IOPS issue16:25
JayFI mean, I don't buy that16:26
JayFsimply because of how small the pxe roms are16:26
JayFbeing slow in that point makes no sense if slow virt io is the problem16:26
lucasagomesJayF, :-/ is it iPXE ? Maybe you can create a script that checks the version of the ROM you are using and if it's not the one you want it chainloads it from the tftp server?16:27
jrollJayF: well, I think slow virt network io is a thing16:27
jroll(when dragging in agent image)16:27
JayFlucasagomes: Well, my effort now is to swap it to ipxe16:27
JayFand see if it speeds stuff up16:27
lucasagomesgotcha16:28
JayFI think I have a path to go science with for a while now though16:28
sambettsI'm just thinking that, because I used to have tinyipa install IPA from python wheels at boot up, and it literally took 20mins+ to install the python packages16:28
jrollJayF: when we chainload ipxe it doesn't speed it up16:28
JayFmy current hypothesis is that pxelinux pxe rom is slow in VM for $bad_code_reasons16:28
lucasagomesby default, some nics in qemu uses ipxe by default16:28
lucasagomesAFAIK16:28
JayFso if I can get ipxe rom to *be the default option rom* (not chainloaded), that it could improve performance16:28
jlvillallucasagomes: Thanks for that etherpad. I'll try to add that info to the documentation16:29
lucasagomesjlvillal, cool, did it work for you?16:29
jlvillalhttps://etherpad.openstack.org/p/ironic-grenade-tests16:29
jlvillalI'm still using Vagrant :)16:29
lucasagomesheh16:29
lucasagomesright on16:29
jlvillalBut I might spin up a VM over on digitalocean or something to give it a quick test.16:30
jlvillalOr just try it in a Vagrant VM locally, and run through the steps16:30
*** mbound has quit IRC16:30
sambettshmm I wonder if we might do better to optimise the VMs in the gate by not using pxe at all, and doing a virtual media boot with an iso16:30
jlvillallucasagomes: I did update one thing on the etherpad. Just the cd devstack-gate-test/ansible16:30
lucasagomesjroll, quick q, for the smoking tests I'm running it in a devstack env and it seems to run against things like storage etc... can we filter it to run with baremetal related only>16:31
lucasagomes?*16:31
TheJuliaI was going to ask about the execution in vagrant, but if we're just looking to run inside any host, awesome16:31
JayFsambetts: that's a damn good idea16:31
* jlvillal has to go to a meeting...16:31
JayFsambetts: like damn damn good idea16:31
jlvillalTheJulia: https://etherpad.openstack.org/p/ironic-grenade-tests   For running inside any VM16:31
sambettsJayF: I think that might be better than fighting to replace roms etc16:31
TheJuliaYeah, was kind of preferring vagrant since I've basically got a big box and it was an easy way to create a vm :)16:32
JayFsambetts: That's a really, really good idea. I just wonder if all the pieces are in place for us to make that work...16:32
JayFsambetts: because I think it'd mean adding more option to the ssh driver in ironic, and if libvirt supports sorta a "boot from iso" action16:32
jrolllucasagomes: the devstack config I'm using disables cinder16:34
jrollwhich I think we do in the gate16:34
jrollsambetts: ++16:34
sambettsJayF: my only concern would be it would move the gate further away from real ipmitool deploy16:34
jrollI feel like... yeah16:34
jrollwe'd need a new driver too16:34
lucasagomesjroll, right, will take a look here16:34
cineramahey jlvillal16:36
cineramaoh he's in a meeting :)16:36
JayFSo what's the verdict? Value || not in booting an agent iso directly?16:37
JayFI'm thinking there is value there, just unsure if it's creating more tech debt than it would be fixing16:38
*** blakec1 has quit IRC16:38
sambettsI wonder if it worth it for at least the full tempest runs if it gives us significant speed ups16:39
sambettsI had planned to deprecate the pxe_ssh drivers this cycle in favor of pxe_ipmitool :/16:40
*** Nisha_away has quit IRC16:40
JayFI mean, no reason virtualbmc couldn't support vmedia attach, is there?16:40
sambettsno, but then its supporting more than whats possible with IPMItool right? and we'd end up with a VirtualBMCVirtualMediaBoot interface which might confuse people :/ and also it would mean PXEBoot isn't tested in gate :/16:44
jrollyep16:45
sambetts:( super bummed now I've thought about it16:46
*** rama_y has joined #openstack-ironic16:46
JayFso basically if I can't make pxe booting faster we have no make-the-gate-faster path ahead /o\16:47
JayFno pressure, lol16:48
sambettsJayF: have you tried installing apt-get install kvm-ipxe??16:49
JayFI'm right now in a meeting16:49
JayFbut I will be going down those paths16:49
JayFbut I also have to figure out, via virsh, how to get that config'd there16:49
* mgould wonders why pxe-booting is so slow in libvirt16:50
jrollJayF: I assume <option-rom> or something16:50
* lucasagomes wonders about the same thing16:50
jrollmost cli args map to an xml tag16:50
lucasagomesis it a network being slow? Or actually booting it (decompressing the ramdisk etc...) ?16:51
lucasagomesif the latter I don't think virtual media will actually help much16:51
mgouldhttps://bugzilla.redhat.com/show_bug.cgi?id=980882 looks relevant16:51
openstackbugzilla.redhat.com bug 980882 in ipxe "PXE boot unusably slow after update/upgrade" [Urgent,Closed: cantfix] - Assigned to virt-maint16:51
sambettsseems like installing kvm-ipxe might just overwrite the existing roms, and then it picks them up like that16:51
sambettshttp://askubuntu.com/questions/190929/how-do-i-disable-unwanted-ipxe-boot-attempt-in-libvirt-qemu-kvm16:52
JayFsambetts: depends on which nic you're using16:53
sambettsit seems to replace them all16:53
mgouldif it's the same bug, loading KVM with emulate_invalid_guest_state=N apparently helps16:53
sambettsand it looks like it does a find pxe-<insrt-nic-here>.rom16:53
sambettsbut I'm just guessing16:54
JayFK, I'll dig in16:54
JayFwelcome to pair with me if you want? After thismeeting16:54
JayFotherwise I can science alone16:54
JayFwe just should do less theorycrafting and more figuring out what's going on16:54
mgouldhttp://prefetch.net/blog/index.php/2009/06/09/fixing-slow-fedora-pxe-installations-under-kvm/ possibly also relevant16:55
JayFyep, we already do that fwiw16:56
mgouldah, OK16:56
mgouldJayF, do you mean you already set the KVM parameter?16:57
JayF/usr/bin/qemu-system-x86_64 -name baremetalbrbm_1 -S -machine pc-1.0,accel=tcg,usb=off -m 1024 -realtime mlock=off -smp 1,sockets=1,cores=1,threads=1 -uuid 7f23f233-58b3-40f3-bcbb-67676c84d624 -no-user-config -nodefaults -device sga -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/baremetalbrbm_1.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=utc16:57
JayF-no-shutdown -boot menu=off,strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -drive file=/var/lib/libvirt/images/baremetalbrbm_1.qcow2,if=none,id=drive-virtio-disk0,format=qcow2,cache=writeback -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -netdev tap,fd=24,id=hostnet0 -device16:57
JayFvirtio-net-pci,netdev=hostnet0,id=net0,mac=52:54:00:21:d6:56,bus=pci.0,addr=0x4 -chardev file,id=charserial0,path=/opt/stack/ironic-bm-logs/baremetalbrbm_1_console.log -device isa-serial,chardev=charserial0,id=serial0 -chardev pty,id=charserial1 -device isa-serial,chardev=charserial1,id=serial1 -vnc 127.0.0.1:0 -device cirrus-vga,id=video0,bus=pci.0,addr=0x2 -device16:57
JayFvirtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x716:57
JayFholy crap, apologies16:57
JayFI'll paste that, no idea it was that long16:58
jroll/kick JayF spam!16:58
mgouldheh, that's a lot of flags :-)16:58
JayFhttps://gist.github.com/anonymous/34057bfdd8ded2025bfdb3cb174d2e5816:58
JayFis exactly what libvirt calls to start our vms16:58
sambettshttp://packages.ubuntu.com/trusty/ipxe-qemu16:58
sambettsmgould, JayF: https://etherpad.openstack.org/p/ironic-gate-pxe-replacement16:59
JayFsambetts: seriously, have any interest in working w/me on this? I have a 8gb rackspace vm up already, with devstack working (what gate jobs run in)16:59
JayFand am to the point of ready to change things to see if it makes them better16:59
mgouldJayF: I note that has accel=tcg17:00
mgouldI'd expect to see accel=kvm, but perhaps I'm wrong on that17:00
JayFWhat does that mean?17:00
* sambetts would love to, but I've got dinner plans :(17:00
mgouldit means it's using the Tiny Code Generator backend rather than KVM, I think17:00
jrollwell, tcg is fully emulated and slower, while kvm is not so emulated and faster17:01
mgould<- not a QEMU expert17:01
JayFwouldn't accel=kvm require nested vt?17:01
jrollbut I think kvm doesn't work on nested things17:01
jrollright17:01
mgouldoh, is this running inside a VM? Sorry, I missed that17:01
jroller rather, work in VMs that aren't run with nested virt17:01
mgouldjroll, in theory it's possible, but I never got it to work17:01
JayFyep that's what's special about ironic's gate tests17:01
JayFwe launch vms inside vms17:01
jrollmgould: ya17:01
mgouldyeah, you need to enable nested virt on the outer VM17:01
mgouldand a bunch of things on the host machine17:02
JayFwhich apparently wreacks havoc on other things17:02
jrolland we don't have control of17:02
JayFbut infra is looking into as well17:02
mgouldquite possibly, I never got to that stage :-)17:02
*** praneshp has joined #openstack-ironic17:02
mgouldanyway, running qemu with software emulation is not a route to Real Ultimate Performance17:03
JayFI think we'd be happy if we could get it to pxe boot faster than 5m17:03
JayFlol17:03
mgouldouch17:03
mgouldJayF, I need to head home in ~30mins, but I'd be happy to pair with you until then17:04
*** jistr has quit IRC17:04
JayFsure; we can do google hangouts or we can do vidyo (a rackspace thing that I can give you a link, but it requires a client .... but it works super well)17:05
mgouldwhatever works for you17:05
mgouldbrb17:05
JayFmgould: actually just got called for a meeting, so nogo for me17:06
JayFmissed off my calendar17:06
mgouldJayF, np, see you tomorrow17:07
sambettsmgould, JayF: perhaps we can pair tomorrow for a bit, if you work anything out today can you put it in the etherpad so I can pick it up in the morning?17:08
JayFI absolutely will17:08
mgouldawesome17:08
sambetts:D sweet!17:08
mgouldsambetts, I should be ready to go by ~10am BST17:08
sambetts:D awesome17:09
sambettsSee everyone in the morning17:09
mgouldo/17:09
*** sambetts is now known as sambetts|afk17:09
JayFI start around 8am PST, no idea how that fits in BST17:09
*** trown is now known as trown|lunch17:10
mgouldJayF, 8am PST = 4pm BST17:10
sambetts|afkJayF: we're +8 from the west coast17:11
JayFah, that sucks :(17:11
mgouldor rather, 8am PDT = 4pm BST17:12
mgouldbecause we use "S" to stand for opposite things :-)17:13
*** rloo has quit IRC17:14
*** rloo has joined #openstack-ironic17:15
*** ohamada has quit IRC17:20
*** cdearborn has quit IRC17:21
*** praneshp has quit IRC17:22
*** wajdi_ has joined #openstack-ironic17:22
*** ChubYann has joined #openstack-ironic17:22
*** wajdi has left #openstack-ironic17:25
*** wajdi_ is now known as wajdi17:25
lucasagomesfolks, I'm calling it a day17:26
lucasagomeshave a great evening all!17:26
lucasagomessee you tomorrow17:26
mgouldlucasagomes, good night!17:26
lucasagomesnight night17:27
*** lucasagomes is now known as lucas-dinner17:27
*** e0ne has quit IRC17:31
*** ijw has joined #openstack-ironic17:31
*** deray has joined #openstack-ironic17:32
*** ijw has quit IRC17:32
*** ijw has joined #openstack-ironic17:32
*** vishwanathj has quit IRC17:33
*** serverascode has quit IRC17:34
*** vishwanathj has joined #openstack-ironic17:35
openstackgerritJim Rollenhagen proposed openstack/ironic: Migrate api-ref into our tree  https://review.openstack.org/31218117:35
*** izaakk has quit IRC17:35
*** cppforlife_ has quit IRC17:35
*** francoblanco has quit IRC17:35
*** serverascode has joined #openstack-ironic17:35
*** francoblanco has joined #openstack-ironic17:36
*** patrickeast has quit IRC17:37
*** izaakk has joined #openstack-ironic17:38
*** patrickeast has joined #openstack-ironic17:38
*** cppforlife_ has joined #openstack-ironic17:38
* mgould -> home; good night!17:41
*** mgould has quit IRC17:42
deraykrotscheck, hi ..17:46
krotscheckderay: Hi!17:46
*** mbound has joined #openstack-ironic17:48
wajdimordred - I was just speaking to jroll about possibly obtaining a baremetal for CI testing. He mentioned to message you to possibly get more information? Also, I will probably head over to openstack-infra to get some more details so I can make a clearer request on my end.17:49
openstackgerritMerged openstack/bifrost: [Trivial] Remove executable privilege of doc/source/conf.py  https://review.openstack.org/31102417:49
jrollwajdi: I think you mean donating baremetal for CI testing ya? :)17:50
wajdiyes. donating :)17:51
wajdifor the good cause of making everyone's life easier :)17:51
deraykrotscheck, when we invoke the GET /v1/nodes then what value do we pass to ``X-Auth-Token`` header?17:51
krotscheckderay: That depends on the configuration of your ironic. At this time, the webclient does not do anything authentication related.17:52
krotscheckderay: it sounds like you've got keystone enabled, yes? If so, the keystone documentation should give you details on what goes into that header.17:53
deraykrotscheck, ys I have keystone configured and my ironic is not a standalone one17:54
deraykrotscheck, to get the nodes on the webclient do we need to have the ironic running in a standalone mode?17:55
deraywhat if I have the ironic running as part of devstack with all the other services17:56
krotscheckderay: Then I recommend you use horizon and the ironic-ui plugin.17:56
*** praneshp has joined #openstack-ironic17:56
krotscheckderay: The JS ecosystem is not yet mature enough to handle that use case. We're working on it, and welcome patches.17:56
deraykrotscheck, I am very new to Angular. Could you point me where you invoke the REST API /v1/nodes in ironic-webclient?17:57
deraykrotscheck, is this the area where we configure the REST call? https://github.com/openstack/ironic-webclient/blob/master/app/js/modules/api/ironic_node.js#L5417:59
krotscheckderay: Sure, http://git.openstack.org/cgit/openstack/ironic-webclient/tree/app/js/modules/api/ironic_node.js#n6917:59
krotscheckSo, that's the resource configuration. It creates an API abstraction library.17:59
krotscheckThe actual invocation is.... (just a minute...)17:59
krotscheckderay: http://git.openstack.org/cgit/openstack/ironic-webclient/tree/app/js/modules/ironic/controller/node_list_controller.js#n4518:00
krotscheckIronicNode.query({})18:00
*** baoli has quit IRC18:00
*** baoli has joined #openstack-ironic18:01
deraykrotscheck, tyvm :) .. just a few more queries18:02
deraykrotscheck, where from do we get the IronicNode dependency injected in https://github.com/openstack/ironic-webclient/blob/master/app/js/modules/ironic/controller/node_list_controller.js#L20-L2118:03
krotscheckderay: Well, Angular's an injection framework, so anytime you see something like angular.module('modulenames').somemethod(name, implementation); you're getting a new thing that's been injected.18:03
krotscheckderay: The actual resource implementations are here: http://git.openstack.org/cgit/openstack/ironic-webclient/tree/app/js/modules/api18:04
*** piet has quit IRC18:04
*** frontrunner has quit IRC18:05
deraykrotscheck, oh .. thx. so as I have defined the name of ``IronicNode`` in the ironic_node.js factory this gets automatically registered and injected with name-matching18:06
krotscheckderay: yep.18:06
krotscheckderay: So, if you want super easy auth header injection, you can define your own injection point and it'll add all the things yourself.18:07
krotscheckall the things itself18:07
* krotscheck has an example, just a sec....18:07
deraykrotscheck, secondly if I raise a patch on ironic-webclient what things I need to run to make sure it's has passed the UT s and other gate jobs18:08
deraykrotscheck, okay18:08
krotscheckderay: The commands that need to pass are `npm run lint` and `npm test`18:09
*** cdearborn has joined #openstack-ironic18:09
deraykarma is the testing framework.. behind the scenes does it run the jasmine suites/specs18:09
krotscheckderay: Hrm, the thign that I had that added request interceptors isn't there anymore.18:10
* krotscheck remembers deprecating that.18:10
krotscheckThere's an example in the angular docs in the "Interceptors" section - https://docs.angularjs.org/api/ng/service/$http18:10
krotscheckYou can add an interceptor in angular.module('ironic').config(function() { add your interceptors here });18:10
deraykrotscheck, okay. will have a look.. tyvvm :-)18:11
krotscheckderay: Karma is the testing harness that captures the JS to test, launches the browsers, and captures the output. Jasmine is the testing framework :).18:11
krotscheckderay: ANytime :)18:11
deraykrotscheck, so karma encompasses the headless browser to run the jasmine specs, is it?18:12
krotscheckderay: Well, it's headless in infra. On your desktop it's not headless unless you setup your environment to run xvfb18:12
deraykrotscheck, ohkay . .so when i do ``npm test`` it will open up the browser and run the tests ?18:13
krotscheckYep.18:13
krotscheckderay: Assuming you have the browsers installed ;)18:14
deraykrotscheck, yeah .. I have now .. didn't have it at first . bare minimum OS image:)18:14
*** trown|lunch is now known as trown18:15
deraykrotscheck, this https://github.com/openstack/ironic-ui is based on Django plugin I suppose18:18
krotscheckderay: yes, that's betherly and ppiela_'s work that plugs into Horizon. different use case :)18:19
krotscheck(But we still all work together)18:19
deraykrotscheck, lemme see if I can make ironic-webclient work for my case (with keystone enabled).. need some more in depth understanding of Angular and some more brushing up of JS. Interceptor might be the quick soln ..18:21
krotscheckderay: You may want to look at the JS roadmap, particulary the js-openstacklib project https://krotscheck.net/2016/04/21/javascript-roadmap-for-openstack-newton.html18:22
krotscheckderay: Long story short- we _should_ be able to support your use case, but right now there's only one person working on moving this needle. The more that help, the better :)18:22
*** Goneri has quit IRC18:23
*** Goneri has joined #openstack-ironic18:24
deraykrotscheck, thanks so much .. would definitely like to volunteer :) am already late here in my part of the world .. good day ahead for you. tty soon18:25
krotscheckderay: Awesome! Sleep tight, see you tomorrow.18:25
deraykrotscheck, ciao :)18:25
*** deray has quit IRC18:25
*** electrofelix has quit IRC18:26
*** kwilke has quit IRC18:32
*** KennethWilke has joined #openstack-ironic18:37
*** fragatin_ has quit IRC18:37
*** fragatina has joined #openstack-ironic18:38
JayFDoes anyone have a high quality, color picture of pixie boots?18:44
*** baoli has quit IRC18:52
*** dprince has quit IRC18:53
*** baoli has joined #openstack-ironic18:56
cineramaJayF: iirc there's an SVG linked from the wiki page18:56
*** yolanda has quit IRC18:56
*** links has quit IRC18:58
*** baoli has quit IRC18:58
*** ijw has quit IRC18:59
JayFyep, bingo, perfect ty18:59
*** ijw has joined #openstack-ironic19:02
*** mbound has quit IRC19:02
*** baoli has joined #openstack-ironic19:05
*** cdearborn has quit IRC19:22
*** Sukhdev has joined #openstack-ironic19:23
openstackgerritChris Krelle proposed openstack/ironic: Add support for the audit middleware  https://review.openstack.org/27265819:30
*** blakec has joined #openstack-ironic19:35
jlvillalMy co-worker said he was at the Scientific Workgroup meeting and one user said they were using Ironic to control 850 bare-metal systems :)19:40
JayFYeah; someone from Pittsburgh I believe19:40
JayFI think I talked to them in Vancouver19:40
JayFI don't recall the name but they came up and excitedly thanked me for talking to them19:41
JayFand I took them at their word that we had talked /forgetful19:41
*** fragatina has quit IRC19:42
*** vishwanathj has quit IRC19:42
*** xhku has quit IRC19:42
*** thrash has quit IRC19:42
*** jrist has quit IRC19:42
*** david-lyle has quit IRC19:42
*** kuthurium_ has quit IRC19:42
*** cfarquhar has quit IRC19:42
*** n|cotine has quit IRC19:42
*** trown has quit IRC19:42
*** gabriel-bezerra has quit IRC19:42
*** keedya has quit IRC19:42
*** mtanino has quit IRC19:42
*** d0ugal has quit IRC19:42
*** xek__ has quit IRC19:42
*** ppiela_ has quit IRC19:42
*** aarefiev has quit IRC19:42
*** yhvh- has quit IRC19:42
*** marlinc has quit IRC19:42
*** mag009_ has quit IRC19:42
*** xavierr has quit IRC19:42
*** lennyb has quit IRC19:42
*** Guest89093 has quit IRC19:42
*** lazy_prince has quit IRC19:42
*** persia has quit IRC19:42
*** crinkle has quit IRC19:42
*** keekz has quit IRC19:42
*** oberezovskyi has quit IRC19:42
*** adreznec has quit IRC19:42
jlvillalJayF: That is a pretty good size deployment :)19:43
JayFAbsolutely19:43
NobodyCamthat's awesome.. how many conductors?19:46
jlvillalNobodyCam: I don't know...19:47
*** yolanda has joined #openstack-ironic19:47
*** blakec has quit IRC19:48
*** baoli has quit IRC19:49
*** jjohnson2 has quit IRC19:49
*** phschwartz_ is now known as phschwartz19:49
*** jjohnson2 has joined #openstack-ironic19:50
*** baoli has joined #openstack-ironic19:50
*** dmk0202 has joined #openstack-ironic19:51
*** cdearborn has joined #openstack-ironic19:51
*** david-lyle has joined #openstack-ironic19:51
*** keedya has joined #openstack-ironic19:51
*** mtanino has joined #openstack-ironic19:51
*** d0ugal has joined #openstack-ironic19:51
*** xek__ has joined #openstack-ironic19:51
*** ppiela_ has joined #openstack-ironic19:51
*** aarefiev has joined #openstack-ironic19:51
*** yhvh- has joined #openstack-ironic19:51
*** marlinc has joined #openstack-ironic19:51
*** mag009_ has joined #openstack-ironic19:51
*** xavierr has joined #openstack-ironic19:51
*** lennyb has joined #openstack-ironic19:51
*** Guest89093 has joined #openstack-ironic19:51
*** lazy_prince has joined #openstack-ironic19:51
*** persia has joined #openstack-ironic19:51
*** crinkle has joined #openstack-ironic19:51
*** keekz has joined #openstack-ironic19:51
*** oberezovskyi has joined #openstack-ironic19:51
*** adreznec has joined #openstack-ironic19:51
*** fragatina has joined #openstack-ironic19:51
*** vishwanathj has joined #openstack-ironic19:51
*** xhku has joined #openstack-ironic19:51
*** thrash has joined #openstack-ironic19:51
*** jrist has joined #openstack-ironic19:51
*** kuthurium_ has joined #openstack-ironic19:51
*** cfarquhar has joined #openstack-ironic19:51
*** n|cotine has joined #openstack-ironic19:51
*** trown has joined #openstack-ironic19:51
*** gabriel-bezerra has joined #openstack-ironic19:51
*** Goneri has quit IRC19:52
*** kuthurium_ has quit IRC19:53
*** jjohnson2 has quit IRC19:56
*** yolanda has quit IRC19:56
*** jjohnson2 has joined #openstack-ironic20:04
*** baoli has quit IRC20:04
*** baoli has joined #openstack-ironic20:04
*** rbrud has joined #openstack-ironic20:07
*** Sukhdev has quit IRC20:07
*** [1]cdearborn has joined #openstack-ironic20:14
*** cdearborn has quit IRC20:14
devanandajlvillal, JayF, NobodyCam: I had a long chat with the guy doing the pittsburgh U. deployment -- single node running all the openstack services.20:16
*** rbrud has quit IRC20:17
NobodyCamfor 850 nodes... that's really cool20:17
jlvillalCool :)20:18
jrollcray20:19
jrollrunning everything on one box is never cool :P20:19
NobodyCamcool was for 850 node sacle20:20
NobodyCamscale20:20
jrollya I know20:21
cineramajlvillal, how do you want to handle changes, reviews, etc on the devstack-gate-test repo?20:26
-openstackstatus- NOTICE: restarting apache on review.openstack.org to pick up security patches. Gerrit web ui may disappear for a short time.20:27
jlvillalcinerama: Pull requests are very welcome20:28
jlvillalcinerama: Hopefully that isn't too burdensome20:28
*** vishwanathj has quit IRC20:32
cineramajlvillal: nope. just wanted to check what the deal was20:32
*** vishwanathj has joined #openstack-ironic20:33
*** rloo has quit IRC20:34
*** e0ne has joined #openstack-ironic20:34
mrdaMorning Ironic20:38
NobodyCammorning mrda20:38
*** cdearborn has joined #openstack-ironic20:42
*** Sukhdev has joined #openstack-ironic20:42
openstackgerritMilan Kováčik proposed openstack/ironic-inspector-specs: High Availability for Ironic Inspector  https://review.openstack.org/25367520:43
*** [1]cdearborn has quit IRC20:43
*** bigjools has quit IRC20:43
*** bigjools has joined #openstack-ironic20:45
*** rloo has joined #openstack-ironic20:45
JayFjlvillal: mrda: https://review.openstack.org/#/c/306670 is fixing an ironic bug in the nova driver, and has no negative feedback. What should we do to get it merged? cc: jcook20:47
*** Sukhdev has quit IRC20:51
*** rbrud has joined #openstack-ironic20:52
mrdaThnks JayF, shall look20:53
mrdaNobodyCam: o/20:53
*** baoli has quit IRC20:54
*** lucas-dinner has quit IRC20:54
*** lucasagomes has joined #openstack-ironic20:58
*** Sukhdev has joined #openstack-ironic21:02
*** jjohnson2 has quit IRC21:04
jrolldevananda: rloo: NobodyCam: JayF: lucasagomes: dtantsur: I need your reviews on this sometime this week please: https://review.openstack.org/#/c/311530/21:04
* jroll updates quickly21:05
rloojroll: oh. sure, will look in a few minutes.21:06
jrollthanks21:06
openstackgerritJim Rollenhagen proposed openstack/ironic-specs: Add newton priorities doc  https://review.openstack.org/31153021:06
*** trown is now known as trown|outtypewww21:06
*** Sukhdev has quit IRC21:07
*** maurosr has quit IRC21:07
*** cdearborn has quit IRC21:08
*** maurosr has joined #openstack-ironic21:09
*** ijw has quit IRC21:10
*** Sukhdev has joined #openstack-ironic21:10
*** harshs has joined #openstack-ironic21:10
NobodyCamjroll: you split the search and clams out from Multi compute host stuff21:11
jrollyes21:12
jrollthey are two distinct pieces of work21:12
*** kuthurium has joined #openstack-ironic21:12
*** e0ne has quit IRC21:13
NobodyCamdid we want to list any of the stuff under small stuff?21:13
TheJuliaI think it is best to keep the main priorities list short21:14
*** jaybeale has joined #openstack-ironic21:14
jroll+121:15
jrollthis is too long as it is21:15
TheJuliaagreed21:15
jrollI'll put the small stuff on my dashboard21:15
NobodyCam:)21:15
*** raildo is now known as raildo-afk21:15
rloojroll: I thought we had prioritized them?21:16
devanandajroll: reading21:16
jrollrloo: well, we roughly said "if we get to the small things, these things are what we should push"21:17
jrollI don't want to publish them as our primary priorities for the cycle21:17
rloojroll: sorry, I meant the first table. Above it, it sez 'in no particular order'. are they prioritized or not?21:17
jrolloh that21:18
jrollrloo: I suppose they are, though I'd question the order of boot from volume vs driver comp21:18
devanandajroll: LGTM, and they do appear ordered21:19
jrollright, I can change those words21:19
jrollplease do comment21:19
*** lucasagomes has quit IRC21:20
rloojroll: am commenting :) Question about search/claims API. I'd like them to be split, and a primary contact for each.21:20
openstackgerritJim Rollenhagen proposed openstack/ironic: Migrate api-ref into our tree  https://review.openstack.org/31218121:20
rloojroll: what are the primary contacts? folks to make sure they get done, or folks doing the work?21:20
jrollrloo: some of both?21:21
jrollprimarily the former, I suppose21:21
rloojroll: do you have time to do that work?21:21
rloojroll: I mean, there are two names there.21:22
jrollrloo: certainly not all of it, hence the ask for volunteers21:22
*** lucasagomes has joined #openstack-ironic21:22
rloojroll: OK. so i can volunteer for one of them.21:22
jrollrloo: or more! :)21:22
rloojroll: do you know which lintan is interested in? Although I'd like him to get the rolling upgrades done.21:22
jrollrloo: I guess I'm not sure21:23
jrollrloo: he expressed interest in that group of work21:23
rloojroll: has lucas seen this? I think he'd volunteer for something.21:23
jrollrloo: I'm not sure, he hasn't reviewed21:23
jrollrloo: I put this up because I was done writing it and just needed volunteers21:24
rloojroll: ok, i'd like lucas to have a chance to review before it is approved. Well, actually, didn't I ask that all cores review the mitaka priorities before it was approved? guess i'd ask the same.21:24
jrollrloo: right, which is why I pinged him21:25
jrollall cores is fine with me21:25
jrollrloo: to be clear, do you want all cores or all specs cores?21:25
rloojroll: all cores -- the ones that I HOPE will be reviewing this stuff.21:26
jrollrloo: okay, cool21:26
jrollthanks21:27
devanandajroll: commented21:29
jrollthanks21:30
jrolldevananda: fwiw, I don't think we've agreed the resource provider thing is viable for this yet21:33
*** gugl has joined #openstack-ironic21:33
jrolldevananda: needs more thought imo21:33
devanandajroll: you want to proceed with the plan for the nova driver that we had in mitaka?21:34
*** e0ne has joined #openstack-ironic21:34
jrolldevananda: if the resource provider thing turns out to be a poor fit, maybe21:35
jrollI would prefer not to21:35
jrollbut for example, if an operator needs to issue a nova command every time a node becomes unschedulable, it's a non-starter21:36
jroll(obviously that one is solvable, but you get the idea)21:36
*** rloo has quit IRC21:36
jrollor if we propose a new spec to use that work and the nova folks disagree that it's the right direction21:36
*** rloo has joined #openstack-ironic21:36
jrolletc21:37
*** rama_y has quit IRC21:37
jrollbasically, nobody has agreed that's the right thing to do (yet)21:37
devananda*nod*21:37
devanandait also seems like no one, at least on the nova side, is looking at the proposal we had21:38
devanandaI need to go back and reread it to see if it makes any sense with the way nova resource tracker is heading21:38
*** e0ne has quit IRC21:38
jrollyeah, I think it'll still fit21:38
jrollthe idea is we expose cpu/ram/disk21:38
jrollso it's still bad in that we pretend to be a hyp21:38
jrollbut nothing should block it from working21:39
*** baoli has joined #openstack-ironic21:39
*** baoli has quit IRC21:39
openstackgerritJim Rollenhagen proposed openstack/ironic: Migrate api-ref into our tree  https://review.openstack.org/31218121:39
jrolldevananda: ^ also relevant to your interests21:39
*** baoli has joined #openstack-ironic21:40
devanandaawesome - yea, I saw the doc email21:40
*** derekh has quit IRC21:40
jrollso there's a bunch of work to do there, I may rename some files21:40
jrollbut basically those docs are old and crusty and totally missing things21:41
jrolland we should fix that21:41
jroll(which is much easier to do now that they're in our tree(21:41
*** lucasagomes has quit IRC21:41
devanandatotally21:41
*** baoli_ has joined #openstack-ironic21:42
* devananda builds the docs locally21:42
jrollI never realized how bad they were :(21:42
jrolltox -e api-ref should do it21:42
devanandayep21:42
devanandaalrady building21:42
devanandajroll: I'd be in favor of landing the raw import, then cleaning it up in subsequent patches21:42
devanandaso there's a good trail21:42
jrollthere's also this as a follow on https://review.openstack.org/#/c/312184/21:42
jrolldevananda: yep, totally agree21:42
*** lucasagomes has joined #openstack-ironic21:44
devanandabuilt fine, no errors \o/21:44
jrolltempest-full in serial, running on bare metal: Ran: 1291 tests in 17337.0000 sec.21:44
jrollouch.21:44
devanandadayum21:44
*** baoli has quit IRC21:45
devanandawhen you say "on bare metal" - what exactly do you mean?21:45
jrollone or two timeouts in there21:45
jrolla bare metal machine + devstack w/ 64 VMs for "nodes"21:45
devanandajust under 5 hours isn't bad, then21:46
devanandaalso, there's no way we're booting 64 VMs in the current -infra gate21:46
jrollehhh. it isn't viable at all though.21:46
jrolloh totally21:46
devanandait'd take _days_21:46
jrollI just wanted to see what happens when we aren't restricted by ram21:46
devanandatotally21:46
jrollwhen/if21:46
* jroll wonders how nasty things get in parallel21:47
devanandarunning in serial, did it utilize all 64 VMs ?21:47
devanandaheh yea, that's my next question21:47
devanandaor how much faster  it is21:47
devananda*if it is21:47
*** Sukhdev has quit IRC21:47
jrollit looks like I have console logs for a majority of the VMs21:48
* jroll runs parallel for funsies21:49
*** xhku has quit IRC21:59
jlvillalJayF: mrda and I are meeting in about 30 minutes to go over Nova stuff. We will check it out. Thanks.22:01
JayFjlvillal: I figured you'd wanna know, so that's why I pointed them out :)22:02
jlvillalJayF: We do :)22:02
jlvillalThanks!22:02
wajdijroll: mat128 and I want to volunteer for the Multiple compute hosts. Should I edit our names inline?22:02
jrollwajdi: comment on the patch pls22:02
jrollI will update all the things at once22:02
jrollI don't want to lose other comments22:02
jrolllose/misplace22:03
wajdijroll: great. done.22:03
jrollthanks22:03
*** sambetts|afk has quit IRC22:04
*** sambetts has joined #openstack-ironic22:07
*** ijw has joined #openstack-ironic22:14
*** baoli_ has quit IRC22:14
* JayF WTB generic ironic API call for "boot a ramdisk on this"22:14
*** ijw has quit IRC22:14
*** wajdi has quit IRC22:17
*** mbound has joined #openstack-ironic22:26
*** ijw has joined #openstack-ironic22:30
*** ijw has quit IRC22:32
*** ijw has joined #openstack-ironic22:32
*** ChrisAusten has quit IRC22:37
*** baoli has joined #openstack-ironic22:39
*** krotscheck is now known as krotscheck_dcm22:44
*** ametts has quit IRC22:45
*** mbound has quit IRC22:46
*** baoli has quit IRC22:48
*** baoli has joined #openstack-ironic22:49
JayFIs there some magic I'm missing to enrolling additional fake hardware in Ironic?22:52
JayFI tried to modify some, ended up deleting the ones taht existed, and I keep missing something22:53
*** baoli has quit IRC22:54
*** dmk0202 has quit IRC22:54
*** rloo has quit IRC22:56
*** baoli has joined #openstack-ironic22:58
*** baoli has quit IRC23:06
*** baoli has joined #openstack-ironic23:06
*** baoli has quit IRC23:13
*** harshs has quit IRC23:14
devanandaJayF: what are you running into?23:27
JayFI think the problem is my knowledge of what to do, not devstack itself, heh23:29
JayFtried to cleanup the nodes given to me preconfigured by devstack23:29
JayFand create new ones manually on my own23:29
JayFwithout knowing that it's an ... ordeal23:29
*** absubram has quit IRC23:29
JayFI'm building a 'clean' devstack now and will take a different tactic that doesn't involve starting from scratch23:30
devanandaJayF: using devstack with VMs to mock bare metal?23:33
JayFyes23:33
JayFand trying to change the config of the underlying vms23:33
devanandaI see23:33
JayFto benchmark other nic drivers, pxe roms, etc23:33
JayFI think I'm going to go for an in-place virsh edit ratehr than trying to make new nodes23:34
devanandaso yes, there are a bunch of pre-enroll steps that devstack takes to create those VMs, create the network bridges that act like a local switch, etc23:34
devanandaone way would be to change the ironic/devstack/lib/ironic script to create those VMs differently23:34
devanandathough you'd need to re-stack for that to take effect, probably23:34
JayFyeah, I tried to reproduce those commands manually23:34
JayFand it just met with frustration23:34
devanandaheh, indeed23:34
JayFso going to take this other tactic instead23:35
*** ppiela_ has quit IRC23:35
JayFI might try to make a ./create_nodes_do_everything.sh tool, which creates a node with a set of sane defaults, creates ports, enrolls in ironic23:35
*** keedya has quit IRC23:36
JayFIf I were to get a bunch of die cut pixie boots stickers, 3"x3" or 2"x2"?23:37
*** keedya has joined #openstack-ironic23:37
devanandahmm23:38
* devananda looks at his laptop cover23:38
JayF2"x2" is cheaper, but I think with the die cut it'd end up looking ridiculously small23:38
devananda*nod*23:38
devanandaI have room for either one :)23:38
* NobodyCam votes for 3x323:39
JayFyeah, I think I'm going 3x323:39
JayFAh, this is enlightening: even on a fresh stack, the nodes we create don't validate23:44
JayFCannot validate image information for node 2bbb5120-48ef-42cc-8a35-24ac165ee8b7 because one or more parameters are missing from its instance_info.. Missing are: ['ramdisk', 'kernel', 'image_source']23:45
devanandaoh - yes, that's normal23:45
devanandadeploy doesn't validate because nova hasn't passed the instance info yet23:46
devanandaalso, that's an annoying API23:46
JayFyeah; looks like hte only thing I got wrong on my other devstack was pointing ironic at the pubkey instead of the privkey for ssh23:46
JayFand assuming validate should've worked23:46

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!