Friday, 2015-10-09

*** Sukhdev has quit IRC00:03
*** achanda_ has joined #openstack-ironic00:03
*** david-ly_ has joined #openstack-ironic00:04
openstackgerritMerged openstack/ironic-python-agent: Update gitignore  https://review.openstack.org/23234500:04
*** david-lyle has quit IRC00:05
*** mbound has quit IRC00:06
*** achanda has quit IRC00:06
*** Sukhdev has joined #openstack-ironic00:07
*** achanda_ has quit IRC00:07
*** Sukhdev has quit IRC00:10
*** VikasC has joined #openstack-ironic00:12
*** morgan is now known as mordgan00:16
*** mordgan is now known as morgan00:16
*** mordred is now known as morgred00:16
*** morgan is now known as mordan00:16
*** mordan is now known as mordgan00:16
*** shadower has joined #openstack-ironic00:23
*** morgred is now known as morgblue00:34
*** sdake has joined #openstack-ironic00:35
*** morgblue is now known as morgred00:36
*** olaph is now known as doseedo01:03
*** VikasC has quit IRC01:08
openstackgerritMerged openstack/ironic: Use power manager to reboot in agent deployments  https://review.openstack.org/23215701:12
* devananda realises it's after 6pm and he still hasn't gotten around to fixing up some patches01:13
jrolldevananda: I *just* left a comment that was "we can do this as long as there isn't hardware that behaves like <that patch>"01:13
jroll(on another thing)01:13
*** baoli has joined #openstack-ironic01:14
devanandajroll: huh?01:14
jrolldevananda: the thing that just merged.01:14
devanandaahh01:14
jrollnot quite the same behavior, but that also breaks my assumption :P01:14
*** david-ly_ has quit IRC01:14
jrolldevananda: also, if you don't get a chance to deal with that FakeBoot thing tonight, let me know and I'll handle it in the AM01:15
devanandawill do01:16
devanandaI have about 20 minutes right now - it's either try to book a hotel using IBM's travel thing, or do that01:16
jrollis it carlson wagonlit?01:16
devanandanope01:16
jrollwell, maybe that's doable01:16
devanandahehe01:16
jroll:P01:16
jrollanyway, out for the night, have a good one :)01:17
devanandaciao!01:18
*** dims has quit IRC01:18
*** lazy_prince has joined #openstack-ironic01:18
*** dims has joined #openstack-ironic01:18
*** david-lyle has joined #openstack-ironic01:22
*** dims has quit IRC01:23
jlvillallifeless, Have you heard of any other bugs detected because of new Fixture release?01:24
*** baoli has quit IRC01:25
*** doseedo is now known as olaph01:26
*** david-lyle has quit IRC01:29
lifelessjlvillal: nothing else has reached my easrs01:29
*** lazy_prince has quit IRC01:40
*** naohirot has joined #openstack-ironic01:40
*** lazy_prince has joined #openstack-ironic01:40
*** baoli has joined #openstack-ironic01:43
*** sdake has quit IRC01:44
openstackgerritshravya Gaddam proposed openstack/ironic: ucs_hostname changed to ucs_address  https://review.openstack.org/23283401:45
*** jamielennox is now known as jamielennox|away01:46
*** bnemec has quit IRC01:48
openstackgerritOm Kumar proposed openstack/ironic: Add portgroups to support LAG interfaces - RPC  https://review.openstack.org/20624301:50
openstackgerritOm Kumar proposed openstack/ironic: Add portgroups to support LAG interfaces - API  https://review.openstack.org/20624401:50
openstackgerritOm Kumar proposed openstack/ironic: Add portgroups to support LAG interfaces - net  https://review.openstack.org/20624501:50
openstackgerritOm Kumar proposed openstack/ironic: Add portgroups to support LAG interfaces - DB  https://review.openstack.org/20623201:50
openstackgerritOm Kumar proposed openstack/ironic: Add portgroups to support LAG interfaces - objs  https://review.openstack.org/20623801:50
openstackgerritOm Kumar proposed openstack/ironic: Add network provider interface and implementations  https://review.openstack.org/13968701:50
jlvillallifeless, Thanks01:55
*** bnemec has joined #openstack-ironic01:59
*** baoli has quit IRC01:59
*** baoli has joined #openstack-ironic02:02
*** ijw has quit IRC02:05
*** lazy_prince has quit IRC02:05
*** dims has joined #openstack-ironic02:19
*** penick has quit IRC02:21
*** frontrunner has quit IRC02:21
*** dims has quit IRC02:24
*** harshs has joined #openstack-ironic02:24
*** achanda has joined #openstack-ironic02:31
openstackgerritJohn L. Villalovos proposed openstack/ironic: Add secret=True to password option  https://review.openstack.org/23284302:35
*** davideagnello has quit IRC02:47
*** davideagnello has joined #openstack-ironic02:54
*** harshs has quit IRC03:29
*** Nisha has joined #openstack-ironic03:34
*** david-lyle has joined #openstack-ironic03:47
*** sdake has joined #openstack-ironic03:51
*** Nisha has quit IRC03:52
*** links has joined #openstack-ironic03:53
*** achanda has quit IRC03:57
*** baoli has quit IRC03:58
*** VikasC has joined #openstack-ironic04:00
*** chlong has joined #openstack-ironic04:00
*** chlong has quit IRC04:05
*** dims has joined #openstack-ironic04:08
*** Nisha has joined #openstack-ironic04:08
openstackgerritShivanand Tendulker proposed openstack/ironic: Fixes logging of failure in deletion of swift temporary object  https://review.openstack.org/23244004:17
*** chlong has joined #openstack-ironic04:18
*** sdake_ has joined #openstack-ironic04:41
*** achanda has joined #openstack-ironic04:41
*** sdake has quit IRC04:44
*** rameshg87 has joined #openstack-ironic04:49
*** dims has quit IRC04:51
openstackgerritRamakrishnan G proposed stackforge/proliantutils: Add support for emulation with VirtualBox  https://review.openstack.org/15564704:52
*** harshs has joined #openstack-ironic04:59
openstackgerritOpenStack Proposal Bot proposed openstack/ironic: Updated from global requirements  https://review.openstack.org/23287005:00
openstackgerritOpenStack Proposal Bot proposed openstack/ironic-lib: Updated from global requirements  https://review.openstack.org/23287105:00
openstackgerritOpenStack Proposal Bot proposed openstack/ironic-python-agent: Updated from global requirements  https://review.openstack.org/23287205:00
openstackgerritRamakrishnan G proposed stackforge/proliantutils: Reduce logical disk size returned by 1  https://review.openstack.org/23288005:01
*** sdake_ has quit IRC05:01
openstackgerritOpenStack Proposal Bot proposed openstack/python-ironic-inspector-client: Updated from global requirements  https://review.openstack.org/23289205:04
*** sdake has joined #openstack-ironic05:07
*** Marga__ has joined #openstack-ironic05:29
*** jefabo has quit IRC05:30
*** chlong has quit IRC05:31
rameshg87congrats jlvillal vdrok (if you guys are around) :)05:32
jlvillalrameshg87, Thank you very much :) Was a very nice surprise for me this week. Great to be nominated!05:32
*** Marga_ has quit IRC05:33
rameshg87jlvillal: enjoy your surprise with beer ;-)05:33
jlvillalrameshg87, I'll have a drink tomorrow night. Friday! :)05:34
*** Marga__ has quit IRC05:34
rameshg87jlvillal: oh yeah, so it's still Thursday for you. it's already Friday for me :)05:34
rameshg87jlvillal: but thanks a lot for all your work in Ironic once again05:35
jlvillalrameshg87, Well enjoy your weekend, if I don't chat with you before you leave.05:35
jlvillalrameshg87, My pleasure. The Ironic group of people is a great group of people to work with!05:35
rameshg87jlvillal: sure same to you too..good night and have a great weekend05:35
jlvillalrameshg87, Thanks. Bye05:36
rameshg87jlvillal: bye..see you05:36
*** harshs has quit IRC05:39
*** dims has joined #openstack-ironic05:52
*** pas-ha has joined #openstack-ironic06:10
*** Sukhdev has joined #openstack-ironic06:19
*** Marga_ has joined #openstack-ironic06:22
*** Marga__ has joined #openstack-ironic06:23
*** Marga_ has quit IRC06:23
*** dims has quit IRC06:25
openstackgerritOpenStack Proposal Bot proposed openstack/ironic: Imported Translations from Zanata  https://review.openstack.org/23293006:31
*** Sukhdev has quit IRC06:33
*** sdake has quit IRC06:33
*** chlong has joined #openstack-ironic06:39
*** max_lobur1 has joined #openstack-ironic06:40
*** max_lobur1 has left #openstack-ironic06:40
*** mrmoje has joined #openstack-ironic06:47
*** dims has joined #openstack-ironic06:49
*** dims has quit IRC06:54
*** yog_ has joined #openstack-ironic06:59
*** romainh has joined #openstack-ironic07:01
*** Marga__ has quit IRC07:03
*** romainh has quit IRC07:16
*** romainh has joined #openstack-ironic07:16
*** romainh has left #openstack-ironic07:18
*** mrmoje has quit IRC07:19
*** mrmoje has joined #openstack-ironic07:21
*** mkovacik has quit IRC07:24
openstackgerritShivanand Tendulker proposed openstack/ironic: Fixes logging of failure in deletion of swift temporary object  https://review.openstack.org/23244007:28
*** ifarkas has joined #openstack-ironic07:41
*** marzif has joined #openstack-ironic07:45
*** dims has joined #openstack-ironic07:50
*** dtantsur|afk is now known as dtantsur07:52
dtantsurMorning Ironic07:54
*** mbound has joined #openstack-ironic07:56
*** dims has quit IRC07:56
*** MattMan has quit IRC07:57
*** MattMan has joined #openstack-ironic07:58
*** athomas has joined #openstack-ironic07:59
openstackgerritAnton Arefiev proposed openstack/python-ironicclient: Use requests lib in HTTPClient  https://review.openstack.org/22928607:59
*** openstackstatus has quit IRC08:02
*** openstackstatus has joined #openstack-ironic08:03
*** ChanServ sets mode: +v openstackstatus08:03
sambettsCongrats jlvillal and vdrok !!!!08:04
dtantsur:)08:09
dtantsurmorning sambetts08:09
sambettso/08:09
*** chlong has quit IRC08:09
sambettsdtantsur: I need to do more reviews :-P08:09
dtantsuralways good thing to do ;)08:10
openstackgerritNaohiro Tamura proposed openstack/ironic: Prevent iRMC unit test from potential failure at the gate  https://review.openstack.org/23294608:13
*** achanda has quit IRC08:18
*** lucasagomes has joined #openstack-ironic08:19
*** e0ne has joined #openstack-ironic08:20
openstackgerritNaohiro Tamura proposed openstack/ironic: Refactor IRMCVirtualMediaIscsiDeploy by applying new BootInterface  https://review.openstack.org/22137108:20
rameshg87Nisha: hello08:21
openstackgerritNaohiro Tamura proposed openstack/ironic: Refactor IRMCVirtualMediaAgentDeploy by applying new BootInterface  https://review.openstack.org/22157708:21
rameshg87Nisha: why can't we just call ilo_common.cleanup_vmedia_boot() in https://review.openstack.org/#/c/232323/2/ironic/drivers/modules/ilo/deploy.py08:22
rameshg87Nisha: we do that today when ipa ramdisk is booted in iscsi_ilo driver. so why not in agent_ilo driver ?08:22
vdrokmorning ironic08:22
vdrokand morning dtantsur, sambetts, rameshg87 :)08:23
rameshg87morning vdrok o/08:23
rameshg87vdrok and congrats too :)08:23
dtantsurvdrok, o/ congrats on being nominated08:23
vdroksambetts, rameshg87, JoshNang, thiagop - thanks :)08:23
vdrokdtantsur, thank you too :)08:24
vdrokand congrats to jlvillal08:24
sambettso/ vdrok08:24
openstackgerritMerged openstack/ironic-python-agent: Move oslotest to test-requirements  https://review.openstack.org/23188008:26
romchegHi fellas!08:27
*** mdbooth has quit IRC08:27
vdrokmorning romcheg08:27
romcheglucasagomes, dtantsur: have you seen we've found the cause of that issue in testr with lifeless :)08:28
lifelessromcheg: oh ?08:28
romcheglifeless: the unicode :)08:28
lifelessromcheg: oh, so I still don't know the root cause08:29
lifelessromcheg: we know the proximate cause and a decent workaround08:29
romchegno no, it's not the root cause08:29
dtantsurso what was it? :)08:29
romcheglifeless: correct, I've used wrong words08:29
romchegdtantsur: the workaround was to supress all output to stdout08:29
dtantsurdoes not sound like a good fix to be honest08:30
romchegthis is basically why we don't call it a fix but a workaround :)08:30
dtantsurour default testing system is already pretty quiet when it comes to outputting stuff...08:30
romchegso if you have similar issues, try that08:31
dtantsur(before we switched to os-testr, this one is pretty chatty)08:31
dtantsurromcheg, thanks for information anyway, will keep in mind08:31
lucasagomescool08:32
*** mdbooth has joined #openstack-ironic08:32
openstackgerritNaohiro Tamura proposed openstack/ironic: Add hardware inspection module for iRMC driver  https://review.openstack.org/19648008:36
openstackgerritYuriy Zveryanskyy proposed openstack/ironic: Add documentation for Ceph Object Gateway support  https://review.openstack.org/23206808:39
*** jistr has joined #openstack-ironic08:41
*** Nisha has quit IRC08:43
*** subscope has joined #openstack-ironic08:44
*** derekh has joined #openstack-ironic08:51
lifelessdtantsur: its the same capture mechanism all the other openstack projects use;08:51
lifelessdtantsur: you get the output associated with the test in failures etc08:51
dtantsurack08:52
*** dims has joined #openstack-ironic08:53
*** mkovacik has joined #openstack-ironic08:54
*** aswadr has joined #openstack-ironic08:55
*** dims has quit IRC08:58
*** dtantsur is now known as dtantsur|brb09:08
*** pelix has joined #openstack-ironic09:08
*** marzif has quit IRC09:10
*** jcoufal has joined #openstack-ironic09:19
*** subscope has quit IRC09:32
*** subscope has joined #openstack-ironic09:33
*** athomas has quit IRC09:42
*** athomas has joined #openstack-ironic09:49
*** subscope has quit IRC09:52
*** naohirot has quit IRC09:56
*** marzif has joined #openstack-ironic10:00
*** ndipanov has joined #openstack-ironic10:01
*** zhenguo has quit IRC10:03
*** amotoki has joined #openstack-ironic10:05
*** fandi has quit IRC10:05
*** ionutbalutoiu has joined #openstack-ironic10:07
openstackgerritNisha Agarwal proposed openstack/ironic: Add support for partition images in agent driver  https://review.openstack.org/16200810:11
*** chlong has joined #openstack-ironic10:25
openstackgerritMerged openstack/ironic-lib: Updated from global requirements  https://review.openstack.org/23287110:26
openstackgerritLucas Alvares Gomes proposed openstack/ironic: iPXE: Fix assumption that ${mac} is the MAC of the NIC it's booting  https://review.openstack.org/23299810:30
lucasagomesrare problem with iPXE, but we just saw it happening ^. Someone can take a look please?10:31
openstackgerritLucas Alvares Gomes proposed openstack/ironic: iPXE: Fix assumption that ${mac} is the MAC of the NIC it's booting  https://review.openstack.org/23299810:33
* lucasagomes fix error message typo10:33
*** dtantsur|brb is now known as dtantsur10:37
openstackgerritTan Lin proposed openstack/ironic-specs: Add `memdisk_boot` and support boot Windows PreInstallation Environment(WinPE)  https://review.openstack.org/22088910:47
*** ionutbalutoiu has quit IRC10:52
*** krtaylor has quit IRC10:53
*** krtaylor has joined #openstack-ironic10:53
rameshg87dtantsur: for gate job in https://review.openstack.org/#/c/184443/ to use ironic-lib>=0.3.0, the patch to bump up g-r version should merge. right ?10:59
*** subscope has joined #openstack-ironic10:59
rameshg87but did we have big enough changes between 0.2.0 and 0.3.0 ?10:59
rameshg87wondering why it's failing :)10:59
dtantsurrameshg87, we did, a couple of functions changed their signature11:00
rameshg87dtantsur: okay, then wait is the only option11:00
dtantsurrameshg87, ironic-lib bump patch is waiting for reviews: https://review.openstack.org/#/c/231368/211:00
dtantsuryou can ping someone ;)11:00
*** faizan has joined #openstack-ironic11:00
rameshg87yeah I saw .. :)11:00
rameshg87faizan is here.11:00
*** ionutbalutoiu has joined #openstack-ironic11:01
rameshg87faizan: the g-r patch needs to merge as you told11:01
faizanyes, that is correct,11:01
faizanrameshg87: even with the earlier version it should have worked, but it seems that is_iscsi_device(dev) is not working as expected11:03
rameshg87faizan: yeah it's checking lun1311:04
rameshg87something like that ?11:04
faizanrameshg87: this code has been removed from ironic-lib in the latest version, which is required when we use ironic-lib in agent-context11:05
rameshg87okay11:06
*** e0ne has quit IRC11:08
dtantsurfaizan, IIRC is_iscsi_device was removed because it wasn't present in ironic11:13
*** chlong has quit IRC11:15
* rameshg87 goes home11:15
rameshg87happy weekend everyone11:15
*** rameshg87 has quit IRC11:15
sambettso/ rameshg8711:16
*** subscope has quit IRC11:20
*** subscope has joined #openstack-ironic11:22
openstackgerritMerged openstack/ironic: Add secret=True to password option  https://review.openstack.org/23284311:22
*** e0ne has joined #openstack-ironic11:24
*** subscope has quit IRC11:29
*** lucasagomes is now known as lucas-hungry11:31
*** subscope has joined #openstack-ironic11:34
*** thrash|g0ne is now known as thrash11:37
*** subscope has quit IRC11:44
*** subscope has joined #openstack-ironic11:45
*** lazy_prince has joined #openstack-ironic11:50
*** yog_ has quit IRC11:54
TheJuliagood morning11:54
sinvalTheJulia, good morning o/11:56
openstackgerritMerged openstack/python-ironic-inspector-client: Updated from global requirements  https://review.openstack.org/23289212:00
*** baoli has joined #openstack-ironic12:02
*** ukalifon has joined #openstack-ironic12:02
*** trown|outttypeww is now known as trown12:05
*** dprince has joined #openstack-ironic12:07
*** baoli_ has joined #openstack-ironic12:08
* sambetts is trying to workout how its possible for IPA to attempt to iscsi to /dev/sdb when sdb doesn't exist when you run an lsblk on the ramdisk 12:10
*** derekh has quit IRC12:10
dtantsurOo12:10
sambettsits failing because its saying the blocks are out of range, and I'm like of course they are the device doesn't exist!12:10
*** baoli has quit IRC12:11
openstackgerritJulia Kreger proposed openstack/bifrost: WIP: Additional inspection role and adding role to NV job script  https://review.openstack.org/23274612:12
sambettsdtantsur: Any ideas?12:14
dtantsursambetts, no root device hints are used?12:15
openstackgerritMerged openstack/ironic: PXE: Support Extra DHCP Options for IPv6  https://review.openstack.org/23157312:16
sambettsdtantsur: nope12:16
*** dims has joined #openstack-ironic12:16
openstackgerritMerged openstack/ironic: iPXE: Fix assumption that ${mac} is the MAC of the NIC it's booting  https://review.openstack.org/23299812:17
openstackgerritOpenStack Proposal Bot proposed openstack/ironic: Updated from global requirements  https://review.openstack.org/23287012:19
openstackgerritOpenStack Proposal Bot proposed openstack/ironic-python-agent: Updated from global requirements  https://review.openstack.org/23287212:19
*** VikasC has quit IRC12:24
TheJuliaugh, ironic now overwrites the boot.ipxe file.12:25
TheJulianot good12:25
*** chlong has joined #openstack-ironic12:26
dtantsurhmmm, I think we were overwriting it for some time already?12:27
TheJuliawell, definitly overwrites now12:27
TheJuliaI guess the solution for people with weird pxe environments would be overwrite the install's boot.ipxe file, or define it directly12:28
TheJuliaor, chmod -w12:28
dtantsurI think someone had a patch to change it, but it was mostly rejected12:28
*** subscope has quit IRC12:29
dtantsurlucas-hungry might remember12:29
TheJuliaYeah, I could have sworn there was a patch12:29
*** subscope has joined #openstack-ironic12:29
openstackgerritVladyslav Drok proposed openstack/ironic: Fix tests giving erroneous output during os-testr run  https://review.openstack.org/23302812:30
TheJuliayup, got changed on 9/2 to just copy the file that is defined in the config12:30
TheJulia:(12:30
TheJuliaat least, thats the last day the line was touched12:31
*** subscope has quit IRC12:31
*** lucas-hungry is now known as lucasagomes12:32
* lucasagomes reads12:32
TheJuliayeah12:33
*** subscope has joined #openstack-ironic12:33
TheJuliaI must have had it chmod -w for a long time in bifrost12:33
TheJuliasince the initial behavior change and revert were end of august/early september12:34
TheJuliawere at12:34
lucasagomesTheJulia, hi there, the patch to not overwrite the boot.ipxe was reverted12:34
*** lazy_prince has quit IRC12:35
TheJuliayeah, I was looking at it backward12:35
TheJulias12:35
TheJuliathis is weird12:35
lucasagomesI think the reasoning was that, if we don't overwrite and we update boot.ipxe in ironic ot fix something12:35
lucasagomesthat fix won't be applied on someone's env when they update ironic12:35
TheJuliano, I got it correctly12:35
*** Marga_ has joined #openstack-ironic12:35
lucasagomesTheJulia, did the last change to boot.ipxe break bifrost?12:35
TheJuliakind of broke bifrost, initial deploys work, but we also updated our boot.ipxe little12:36
TheJulialucasagomes: we basically had a case where we were running into old ipxe firmwares that did not fully support the feature set, so we actually try to detect that and load ipxe from the server12:37
lucasagomesTheJulia, ok, so it wasn't using the upstream version? What you can do is have a different boot script in bifrost (tho it would be good to unify) and change it in the config file12:38
lucasagomesTheJulia, oh right, chainload a new version of it?12:38
TheJuliayup12:38
lucasagomesTheJulia, oh I see here https://github.com/openstack/bifrost/blob/6840c963a28472675a96eebe6394947874ad79f6/playbooks/roles/bifrost-ironic-install/files/boot.ipxe#L3-L412:39
TheJuliawe had to do the same with dhcp config for cards that claimed ipxe support but were really just gpxe12:39
TheJuliaI think it actually kind of helps the ironic community to have an alternative example, its not an easy thing to wrap one's head around since it is fairly complex.  Just saw your other fix and pondering it for bifrost12:40
lucasagomesTheJulia, right, yeah it can get really complex12:41
lucasagomesspecially when we have old and new versions of iPXE12:41
lucasagomesfor gPXE vs iPXE you can indentify it by looking at a tag in the DHCP request (will look up the name)12:42
TheJulialucasagomes: exactly what we did for bifrost12:42
*** dims is now known as dimsum__12:42
lucasagomesTheJulia, but anyway I'm +1 to have other examples, ipxe script can get really complex and yeah it's hard to have a common ground sometimes12:43
lucasagomes"user-class" is the DHCP tag to identify gPXE vs iPXE12:45
*** morgred is now known as mordred12:46
TheJulialucasagomes: http://git.openstack.org/cgit/openstack/bifrost/tree/playbooks/roles/bifrost-ironic-install/templates/dnsmasq.conf.j2#n438 :)12:48
lucasagomesyup12:48
*** ukalifon has quit IRC12:50
*** ukalifon has joined #openstack-ironic12:50
*** marzif has quit IRC12:52
openstackgerritSyed Ismail Faizan Barmawer proposed openstack/ironic: Refactor disk partitioner code from ironic and use ironic-lib.  https://review.openstack.org/18444312:53
*** marzif has joined #openstack-ironic12:53
jrollgood morning y'all :)12:53
dtantsurmorning jroll12:55
openstackgerritJulia Kreger proposed openstack/bifrost: Fix boot.ipxe config behavior to ensure proper use  https://review.openstack.org/23303912:57
TheJuliaGood morning jroll12:57
*** albertoffb has joined #openstack-ironic12:59
*** frontrunner has joined #openstack-ironic13:00
sambettso/ jroll13:00
jrollmorning sambetts, TheJulia, dtantsur, lucasagomes \o13:00
lucasagomesjroll, yo! good morning13:01
lucasagomesTheJulia, ++ yeah I think that's the right fix for those using a custom script13:02
lucasagomesTheJulia, in any case, depending on how old is the iPXE ROMs you have you may want to copy that loop from upstream as well13:02
lucasagomesTheJulia, see here too http://git.ipxe.org/ipxe.git/commitdiff/66ea45813:02
TheJulialucasagomes: Thanks, I was already thinking that.13:03
sambettsjroll: Is anyone working on lldp discovery stuff for neutron intergration? I don't see a spec for it in the ironic-neutron ether pad13:03
dtantsursambetts, nobody right now, I guess13:04
*** Marga_ has quit IRC13:05
sambettsI didn't know if anyone had create a spec for it yet?13:05
jrollsambetts: yeah not that I know of13:05
dtantsuralso nope13:05
jrollwe already have lldp stuff in IPA, I believe?13:05
*** Marga_ has joined #openstack-ironic13:05
jrollyeah https://github.com/openstack/ironic-python-agent/blob/master/ironic_python_agent/netutils.py#L10913:06
jrollso just need an inspection hook13:06
jrolldtantsur: do you do specs for inspector?13:06
dtantsurjroll, not really, usually we write a blueprint and discuss it right here :)13:06
jrollyeah13:07
jrollthis shouldn't be much code anyway13:07
sambettsYeah, we have BPs, but there wasn't one of those either :-P13:07
jrollsambetts: you agree it should all be in inspector?13:07
*** faizan has quit IRC13:07
sambettsI guess it depends how dynamic we're expecting it to be13:08
jrollI tend to think people shouldn't be re-cabling things constantly :)13:10
TheJulialucasagomes: feel free to +2 in bifrost if you want :)13:11
sambetts:-P true and if they do they should re-inspect I guess13:11
lucasagomesTheJulia, hah ok I would totally +2 that patch13:11
* lucasagomes changes votes13:11
* TheJulia goes hunting for more coffee while test things do their things13:14
*** ukalifon has quit IRC13:14
Bob_BallHow do I get a RSA private key that can be used in pxe_ssh?  So far I've just been using the password, but I'd like to use a key now... apparently needs to be on one line, but every way I've tried to set it gets an error from paramiko saying it's not a valid RSA key13:17
jrollBob_Ball: ssh_keygen?13:17
jrollBob_Ball: the driver_info thing is the filename13:18
Bob_BallI've got a keypair which works for normal ssh - I just can't figure out how to get it into ironic's config13:18
*** boris-42 has quit IRC13:18
Bob_BallTrying to set "ssh_key_contents" in driver_info which is meant to be a single-line RSA private key13:18
*** smoriya has quit IRC13:18
*** links has quit IRC13:19
jrollinteresting, not sure about that, I've always used ssh_key_filename like devstack does https://github.com/openstack-dev/devstack/blob/master/lib/ironic#L58813:20
Bob_Ballironic just confirms that "BEGIN RSA PRIVATE" is part of the string before passing to paramiko (which it is) - paramiko then seems to check that BEGIN RSA PRIVATE KEY is in the first line, then somehow has run out of lines (which I don't understand"13:20
jrollmaybe there's a bug there13:20
jrollthe "single line" thing seems weird to me13:21
Bob_BallI'm guessing it usually works - RHEL OSP requires you to use ssh_key_contents, so I'd like to think that RHEL have tested it ;)13:21
lucasagomesBob_Ball, yeah... pointing to the key file as jroll mentioned didn't work for you?13:21
jrollheh13:21
jrollmust be someting with the format then13:21
lucasagomesBob_Ball, oh, that's a bug then... it should allow the filename as well13:21
jrollthanks RHEL for requiring keys in the database :(13:22
*** puranamr has joined #openstack-ironic13:22
Bob_BallRHEL have got a batch import for nodes from a json file - the only thing they translate from that file is the ssh_key_contents13:22
lucasagomesBob_Ball, we need to extend this https://github.com/openstack/os-cloud-config/blob/master/os_cloud_config/nodes.py#L4813:22
lucasagomesto support filename13:22
Bob_BallThat's exactly the bit I was talking about :)13:22
lucasagomesyeah this is os-cloud-config13:23
Bob_Ballbut key contents should work :( and I don't understand why it doesn't :(13:23
* lucasagomes no idea either13:23
Bob_BallNo worries... I was assuming it was something stupidly simple I don't understand about private keys.  May still be.  But I'll add some debug commands to try and work it out13:24
lucasagomesBob_Ball, cool, yeah feel free to open a bug against os-cloud-config for that as well13:25
Bob_Ballhttps://bugs.launchpad.net/os-cloud-config/+bug/150455013:28
openstackLaunchpad bug 1504550 in os-cloud-config "import should support private key file" [Undecided,New]13:28
TheJuliacinerama: NobodyCam: please take a look at https://review.openstack.org/#/c/233039/ once coffee has hit your systems :)13:28
lucasagomesBob_Ball, thanks much!13:31
Bob_BallRaising a bug is the easy bit :D13:31
* lucasagomes sees a trick error here https://review.openstack.org/#/c/232440/3/ironic/drivers/modules/ilo/common.py13:31
openstackgerritJim Rollenhagen proposed openstack/ironic: Add agent_amt driver  https://review.openstack.org/23166513:33
TheJuliadtantsur: Out of curiosity, does http://paste.openstack.org/show/dmjLOb8I7t1oRrRjnCtH/ ring any bells for you?13:34
*** Nisha has joined #openstack-ironic13:37
lucasagomesjroll, that unit test tho... is that really needed?13:38
* lucasagomes finds it a bit inconsistent with other drivers13:38
*** lazy_prince has joined #openstack-ironic13:39
*** davideagnello has quit IRC13:40
openstackgerritOm Kumar proposed openstack/ironic: Add portgroups to support LAG interfaces - RPC  https://review.openstack.org/20624313:40
openstackgerritOm Kumar proposed openstack/ironic: Add portgroups to support LAG interfaces - API  https://review.openstack.org/20624413:40
openstackgerritOm Kumar proposed openstack/ironic: Add portgroups to support LAG interfaces - net  https://review.openstack.org/20624513:40
openstackgerritOm Kumar proposed openstack/ironic: Update the deploy drivers with network flipping logic  https://review.openstack.org/21326213:40
openstackgerritOm Kumar proposed openstack/ironic: Add portgroups to support LAG interfaces - DB  https://review.openstack.org/20623213:40
openstackgerritOm Kumar proposed openstack/ironic: Add portgroups to support LAG interfaces - objs  https://review.openstack.org/20623813:40
openstackgerritOm Kumar proposed openstack/ironic: Add network provider interface and implementations  https://review.openstack.org/13968713:40
*** puranamr has quit IRC13:41
jrolllucasagomes: ramesh asked for it, also adding them for the other agent drivers because I don't think it hurts13:43
*** mbound has quit IRC13:43
jrollthat's failing tests right now though13:43
lucasagomeshmm ok.. I mean, mostly it tries to catch are syntax errors or import errors imo13:43
openstackgerritJim Rollenhagen proposed openstack/ironic: Add agent_amt driver  https://review.openstack.org/23166513:44
jrolllucasagomes: he seemed to think it would have helped with the boot interface thing13:44
lucasagomesok13:44
jrollidk, I'm not sure it's needed13:45
jrollwe do have it for irmc stuff13:45
jrollbut that one is more complex13:45
Bob_Balllucasagomes/jroll: FYI looks like I just needed to replace the newlines with embedded \n's13:46
lucasagomesright, yeah I'm not convinced as well, but if it helps with the boot interface thing, why not13:46
lucasagomesa-ha... Bob_Ball that's tricky :P13:47
*** mbound has joined #openstack-ironic13:47
jrollBob_Ball: ha, cool13:47
Bob_BallPretty obvious when you think about it that way round... but apparently there is no such thing as a one-line private key, so you just have to trick convince json that you want multiple lines13:48
*** davideagnello has joined #openstack-ironic13:48
*** mehip has joined #openstack-ironic13:48
NobodyCamgood moorning Ironicers and .....13:49
NobodyCamTGIF13:49
NobodyCam:)13:49
lucasagomesNobodyCam, morning13:51
NobodyCammornign lucasagomes :)13:52
openstackgerritYuriy Zveryanskyy proposed openstack/ironic-specs: Proxy configuration for agent images downloading  https://review.openstack.org/22518113:52
openstackgerritYuriy Zveryanskyy proposed openstack/ironic-specs: Proxy configuration for agent images downloading  https://review.openstack.org/22518113:55
vdrokmorning jroll NobodyCam Bob_Ball and lucasagomes13:57
lucasagomesvdrok, morning!13:57
vdrokand TheJulia13:57
NobodyCammorning vdrok13:57
NobodyCammorning jroll dtantsur sambetts romcheg13:58
*** dansmith is now known as superdan13:59
TheJuliaNobodyCam: good morning14:07
jlvillalsambetts, Thank you14:13
jlvillalvdrok, Thank you and congrats to you. Well deserved :)14:13
jlvillalGood morning Ironic14:13
sambetts\o/ jlvillal14:13
vdrokmorning jlvillal, thanks for congrats, congrats!14:14
jlvillal:)14:14
jrollmorning vdrok, NobodyCam :)14:15
jrolltgif \o/14:15
*** bnemec has quit IRC14:16
* jlvillal waits for jroll to post a youtube link ;)14:16
jrollnow I feel like I can't post it because you said that :(14:17
romchegMorning NobodyCam and the other guys :)14:19
dtantsurTheJulia, eeek, WUT?? I'm pretty sure we're using mysql in the gate now....14:19
dtantsurmorning NobodyCam, romcheg, jlvillal and everyone14:19
*** harshs has joined #openstack-ironic14:20
dtantsurtrown, sambetts, does http://paste.openstack.org/show/dmjLOb8I7t1oRrRjnCtH/ look familiar to you?14:20
TheJuliadtantsur: might be the version i'm getting in CI from pip, I'll switch it out for something not from pip a little later14:20
*** bnemec has joined #openstack-ironic14:20
jlvillaljroll, I like when you post it! :D14:21
dtantsurversion of inspector? I don't think we landed anything new since 2.2.114:21
trowndtantsur: I have not seen that one14:21
jlvillaldtantsur, Morning :)14:21
TheJuliadtantsur: yeah, 2.2.1 is what it is getting from pip.  Odd14:21
jrolljlvillal: too late, you ruined it14:21
TheJuliadtantsur: I'll dig into it some more locally, it worked earlier in the week just fine :)14:22
jlvillal:(14:22
TheJuliadtantsur: likely something I did switching my stuff over to mysql14:22
dtantsuryeah, I remember you confirming it...14:22
jlvillaljroll, Okay, old school then: https://www.youtube.com/watch?v=jl1mQASHc4814:23
jrolljlvillal: heh :D14:23
TheJuliaYeah, that was me just doing a quick local pip install, running the dbsync command and the world being a happy place.  This, is a from scratch deploy with changed playbooks.  Maybe I've got something wrong someplace.  Need to dig14:23
trownah mysql, I have not tried that yet14:24
trownnow that we have a "real" db, that is on my list14:25
dtantsurTheJulia, if you take the query in the bottom, and just execute it in mysql console, will it work?14:25
TheJuliadtantsur: can't, its on a CI job, but looks like it should be fine.... which is what has me going "what?!?"14:26
*** mehip has quit IRC14:26
TheJuliaatleast can't in the ci context14:26
*** r-daneel has joined #openstack-ironic14:27
NobodyCammorning jroll jlvillal TheJulia trown ]14:29
NobodyCam:)14:29
jlvillalNobodyCam, morning14:29
NobodyCam:)14:29
trownmorning NobodyCam14:29
NobodyCamTGIF!!!! (again)14:29
*** harshs has quit IRC14:29
TheJuliadtantsur: doing it by hand after creating a local nodes table, in my mysql install, works like a champ.14:30
dtantsurweird....14:31
* TheJulia thinks beer may fix it14:32
*** mtanino has joined #openstack-ironic14:35
dtantsur++14:35
*** davideag_ has joined #openstack-ironic14:36
*** davideagnello has quit IRC14:38
lucasagomesjlvillal, morning14:39
jlvillallucasagomes, You too. Almost the weekend for you :)14:40
lucasagomes:-) yup14:40
*** mehip has joined #openstack-ironic14:49
*** harshs has joined #openstack-ironic14:51
*** mehip has quit IRC14:52
*** thrash is now known as thrash|biab14:53
openstackgerritVladyslav Drok proposed openstack/ironic: Fix tests giving erroneous output during os-testr run  https://review.openstack.org/23302814:55
jlvillalyuriyz, I hope my comment about no_proxy makes sense.14:57
jlvillalyuriyz, regarding https://review.openstack.org/#/c/225181/14:58
*** ntpttr has joined #openstack-ironic15:01
*** Marga_ has quit IRC15:01
*** Marga_ has joined #openstack-ironic15:01
*** Marga_ has quit IRC15:04
*** Marga_ has joined #openstack-ironic15:05
krotscheckI've... got a problem with cors middleware that I'm trying to address.15:08
krotscheckThe issue is that keystone is often layered on top of existing services.15:08
krotscheckkeystonemiddleware I mean15:08
krotscheckSo the order of operations ends up being: keystone, then cors, then api15:09
krotscheckThis presents 2 problems.15:09
krotscheckkeystone intercepts all requests, so even an OPTIONS request will be rejected.15:09
krotscheckSecond- if your auth token is invalid, the browser will never be told, because keystone rejects the request before it can be annotated.15:10
TheJuliaugh15:11
openstackgerritMerged openstack/ironic: Fix a bug error by passwords only includes numbers  https://review.openstack.org/22038515:12
jlvillalvdrok, Responded to your comment. Hopefully it makes sense.15:12
*** sdake has joined #openstack-ironic15:13
jlvillalvdrok, I've been living in proxy madness for the last 15+ years at my work ;)15:13
krotscheckTheJulia: Yeah. Which is why paste.ini is apparently the way most people do their thing15:14
*** mordgan is now known as morgan15:14
openstackgerritMerged openstack/ironic: Updated from global requirements  https://review.openstack.org/23287015:14
krotscheckIs there some way to tell the wsgi pipeline to "no no no, execute this first"?15:14
TheJuliai dunno, i would think so, but the browser never being told a token is invalid seems like a fundimental flaw15:19
krotscheckTheJulia: Right, but the CORS middleware would handle that, if it was first in the wsgi chain15:20
krotscheckBut it can't be first in the chain, because it's baked into ironic, and keystone is applied on top of ironic.15:20
krotscheckOr is it.15:20
krotscheckWAIT15:20
krotscheckNo it's not.15:20
* krotscheck doublechecks15:20
*** thrash|biab is now known as thrash15:22
*** mbound has quit IRC15:22
sambettsdtantsur: How do I turn on IPA debug logging?/15:23
*** masterbound has joined #openstack-ironic15:23
dtantsursambetts, looks like we don't have such an option right now, which surprises me a lot15:23
dtantsurprobably someone should just implement it, don't know..15:23
sambettsdtantsur: if you --help it says you can --debug :/15:26
dtantsursambetts, so you probably can inject a custom config (if you're using coreos, that is)15:26
dtantsurI'd really love to have a kernel option though15:27
sambettsdtantsur: I'm actually logged in to the IPA box and am running commands on there so, I'll work it out15:28
*** subscope has quit IRC15:28
devanandakrotscheck: keystone is a middleware (ie, a hook inside our API code) not an external thing layered on top15:28
devanandaalso - good morning, all15:28
sambettso/ devananda15:28
krotscheckdevananda: Yeah, I just realized that.15:28
krotscheckdevananda: I'm just doublechecking the order of invocation before I get back to jtomasek15:29
devanandaah15:29
*** jcoufal has quit IRC15:30
lucasagomesdevananda, morning15:31
*** marzif has quit IRC15:35
*** marzif has joined #openstack-ironic15:36
*** e0ne has quit IRC15:37
*** lazy_prince has left #openstack-ironic15:37
krotscheckdevananda, TheJulia: Yep, looks like someone was trying to deploy iroinc with keystonemiddleware15:37
*** lazy_prince has joined #openstack-ironic15:37
lazy_princejroll: When you have time, can you look at https://review.openstack.org/#/c/139687/29/ironic/networks/neutron_plugin.py15:38
*** e0ne has joined #openstack-ironic15:39
dtantsurmorning devananda15:39
*** harshs has quit IRC15:39
vdrokjlvillal, agree, makes sense :)15:39
vdrokmorning devananda15:39
*** mjturek1 has quit IRC15:41
dtantsurfolks, have you seen the thread "jobs that make break when we remove Devstack extras.d in 10 weeks"?15:41
dtantsurour jobs are listed there, and I was unable to understand why15:42
openstackgerritLilia Sampaio proposed openstack/ironic: OneView Driver for Ironic  https://review.openstack.org/19182215:42
*** e0ne has quit IRC15:43
*** persia has quit IRC15:46
*** persia has joined #openstack-ironic15:47
*** mjturek1 has joined #openstack-ironic15:48
jlvillalvdrok, Thanks15:51
johnthetubaguyjroll: would be good to quickly catch up with some summit sessions planning quickly, if you have a sec, let me know when works15:51
*** mjturek1 has quit IRC15:52
*** dims_ has joined #openstack-ironic15:56
*** dims_ has quit IRC15:56
*** dimsum__ has quit IRC15:59
jlvillaldtantsur, Maybe you know who to ask to get the ironic-lib version patch approved.15:59
dtantsurjlvillal, one of https://review.openstack.org/#/admin/groups/131,members15:59
*** ntpttr has quit IRC15:59
dtantsur(well, actually two of)16:00
jlvillal:)16:00
jlvillalI did do some begging on infra, but no luck so far16:00
dtantsurcalling it a day now, beer times approaches quickly :)16:03
dtantsurhave a nice weekend16:03
sambettsdtantsur: Have a great weekend!! o/16:03
*** Marga_ has quit IRC16:03
*** dtantsur is now known as dtantsur|afk16:04
lucasagomesdtantsur|afk, g'night16:04
openstackgerritYuriy Zveryanskyy proposed openstack/ironic-specs: Proxy configuration for agent images downloading  https://review.openstack.org/22518116:04
*** mjturek1 has joined #openstack-ironic16:05
*** sdake has quit IRC16:06
*** sdake_ has joined #openstack-ironic16:06
*** mjturek1 has quit IRC16:07
*** mjturek1 has joined #openstack-ironic16:08
*** jistr has quit IRC16:08
*** dimsum__ has joined #openstack-ironic16:09
*** dimsum__ has quit IRC16:09
*** dimsum__ has joined #openstack-ironic16:10
*** tsekiyama has joined #openstack-ironic16:10
*** trown is now known as trown|lunch16:18
*** lsmola_ has quit IRC16:18
*** mkovacik has quit IRC16:23
*** Sukhdev has joined #openstack-ironic16:25
Sukhdevlazy_prince: ping16:26
*** sdake_ is now known as sdake16:28
*** Marga_ has joined #openstack-ironic16:29
lazy_princeSukhdev: hi..16:29
Sukhdevlazy_prince: got few minutes to chat now?16:31
openstackgerritNisha Agarwal proposed openstack/ironic: Fix agent_ilo to remove temporary images  https://review.openstack.org/23232316:31
lazy_princeSukhdev: sure... Did you take a look at the patches that I pushed today..?16:32
lazy_princeSukhdev: Please review them when you get time.16:32
openstackgerritNisha Agarwal proposed openstack/ironic: Fix agent_ilo to remove temporary images  https://review.openstack.org/23232316:32
Sukhdevlazy_prince: no. Not yet. But will look at them later16:34
*** Sukhdev_ has joined #openstack-ironic16:36
lazy_princeSukhdev: okay.. so apart from issues pointed by you, I found another issue where dhcp options were being added to the tenant port instead of provisioning port.16:36
lazy_princeSukhdev: so wanted to check with you, if you saw the same in your environment too..16:36
*** achanda has joined #openstack-ironic16:38
openstackgerritNisha Agarwal proposed openstack/ironic: Fix agent_ilo to remove temporary images  https://review.openstack.org/23232316:39
*** achanda has quit IRC16:39
*** achanda has joined #openstack-ironic16:40
*** masterbound has quit IRC16:40
jrolljohnthetubaguy: free now if you are16:41
jrolllazy_prince: I'll try to take a look soon16:42
lucasagomesfolks I'm calling it a day16:42
lucasagomeshave a great night everyone!16:42
lucasagomesenjoy the weekend16:42
*** achanda has quit IRC16:42
JayFhave a good weekend lucasagomes16:42
lucasagomesyou too!16:43
*** lucasagomes is now known as lucas-dinner16:43
*** ifarkas has quit IRC16:47
*** garthb has joined #openstack-ironic16:48
*** trown|lunch is now known as trown16:49
*** achanda has joined #openstack-ironic16:50
*** mjturek1 has quit IRC16:52
*** thiagop has joined #openstack-ironic16:53
thiagopHey Ironic, good UGT morning16:53
thiagopand TGIF!16:53
BadCubhowdy thiagop Happy Friday to ya too16:54
johnthetubaguyjroll: hey, sorry about that, was talking quotas with some folks16:59
jrolljohnthetubaguy: no worries16:59
*** achanda has quit IRC16:59
johnthetubaguyjroll: I went through the Nova summit planning, are you happy with the ironic session in that thursday slow we said16:59
* johnthetubaguy goes to find etherpad tab17:00
jrolljohnthetubaguy: which slot, and do you have the google docs link handy?17:00
johnthetubaguyThursday 11:50 I think17:00
jrollactually, I think I have the docs thing17:00
johnthetubaguyhttps://etherpad.openstack.org/p/mitaka-nova-summit-suggestions17:00
johnthetubaguythat has all my notes, and a draft schedule down the bottom17:00
johnthetubaguyshould have the links in there to that spreadsheet actually17:00
johnthetubaguyhttp://tinyurl.com/mitaka-design-summit17:01
* jroll looking17:01
jrollso that gives us an ironic fishbowl slot17:02
jrolland you have a talk at that time, that's the only lame part17:02
jrollbut we can probably get things done without you, like you said before17:02
*** athomas has quit IRC17:02
jrolljohnthetubaguy: that works for me, let's roll with it17:03
*** ijw has joined #openstack-ironic17:03
johnthetubaguyjroll: cool, that works, I would prefer to be there, but that should be OK17:03
jrolljohnthetubaguy: I'll expand on topics next week if that's good; so far I have in mind the multi-compute thing and some networking related things17:03
*** amotoki has quit IRC17:04
jrollgoing to take a look at other outstanding specs/etc that involve nova work, like boot from volume17:04
johnthetubaguyjroll: so in cheddar, I think you can add the Nova track into your Ironic session, which should get folks turning up :)17:04
jrollyeah, I'll do that now, and mark it on our etherpad17:04
johnthetubaguyjroll: sweet, happy to go through those some time with you, if that helps17:04
jrollwe're going to finish up our schedule next week17:04
jroll++17:04
jrollI'll get a list together by monday or so, also need to write/update some of that stuff17:05
johnthetubaguysounds good, I mean its not crazy urgent, but yeah, lets try sync up next week sometime17:05
jrollkinda stuck on the multi-compute thing17:05
jrollyeah, not urgent but I want to get it out of the way17:05
johnthetubaguyyeah, actually, I did have some crazy ideas to add in there17:06
jrollorly, would love to hear17:06
*** ijw_ has joined #openstack-ironic17:06
johnthetubaguyI was thinking about treating all resources shared between the computes, like shared storage of multiple regular nova-compute nodes (like a nfs or ceph setup)17:06
johnthetubaguyso the resource claim might then just live in the scheduler17:07
jrollah, right17:07
johnthetubaguywhich, I hope leaves very little host specific triggers at the bottom17:07
jrollis that a thing that exists today, or is that the jay pipes spec you pointed me at?17:07
*** ijw has quit IRC17:07
johnthetubaguythats the rub, its make believe17:07
jrollheh17:07
*** mjturek1 has joined #openstack-ironic17:07
jrollyeah, that's what I figured17:08
johnthetubaguyso my thinking is, if we could agree the shiny rainbow land place, we can figure how to get there more quickly17:08
jrollI like the idea, though from an ops perspective this is the #1 biggest problem with ironic imo17:08
johnthetubaguyyeah, agreed17:08
johnthetubaguywell, ironic + nova I guess, but yeah17:08
jrollso I'd like to not depend on something that might take a while17:08
jrollright17:08
johnthetubaguyso my though is really, find something that looks right, then work out what a good short term thing might be17:09
johnthetubaguythought^17:09
*** harshs has joined #openstack-ironic17:09
jrollanother random question I had about it: one of the longer goals is to eliminate node from being something we schedule against17:09
johnthetubaguyunsure, honestly17:09
jrollheh, did that change?17:10
johnthetubaguyI think I would say, make it less different than libvirt nova-compute17:10
johnthetubaguys17:10
jrollyeah17:10
johnthetubaguywhich is kinda the same thing, I guess17:10
jrollso if you remember the nova midcycle, we talked about the scheduler just calling the ironic api to get a thing17:10
johnthetubaguyyeah17:10
jrolland ironic api doing the heavy lifting17:10
jrollthere's folks in ironic that don't like that, because we basically have to reinvent nova-sch17:10
jrollwhich is totally fair17:11
johnthetubaguyso we could split out that project and you could run a different instance of it, but thats not close yet either17:11
*** Sukhdev_ has quit IRC17:11
johnthetubaguyoh wait...17:11
johnthetubaguywe could run one under the ironic driver, in nova17:11
jrollso we're thinking a BaremetalScheduler subclass that could keep ironic info in memory and somehow munge things around so that the filters look at that data17:11
jrollbut the scheduler eventually just returns random.choice([all_hosts])17:12
jrolland we just tack the node id onto an instance17:12
jrollis that completely insane? :)17:12
johnthetubaguya little bit I guess17:13
jrollheh17:13
jrollreally I just need to play with the code instead of trying to think about it, I think17:13
johnthetubaguyjust trying to see it in my head I guess17:13
jrollyeah, think of it as a pipeline, right, where the filter/weigher/selection is in the middle17:13
jrolland we tack on a piece on each end to munge data17:13
johnthetubaguyso the way the scheduler works right now is fun17:13
johnthetubaguywe get all the data, and cache it17:14
johnthetubaguythen we run filters and weights over that for each request17:14
jroll(I foresee lots of conflicts with the resource tracker here, btw)17:14
johnthetubaguyeventually update the cache so its less out of date17:14
johnthetubaguyjroll: so you could argue you don't need a resource tracker, because its done by ironic17:14
jrollyeah, I'm thinking of things like tracking orphans17:15
jroll(something we just hit downstream that we need to fix)17:15
johnthetubaguyso we do have orphan vm tracking17:15
johnthetubaguyyou could copy that17:15
jrollright, ironic doesn't17:15
JayFThat orphan tracking bug: https://bugs.launchpad.net/nova/+bug/150345317:16
openstackLaunchpad bug 1503453 in OpenStack Compute (nova) "unavailable ironic nodes being scheduled to" [Medium,Triaged]17:16
jrollI want to fix that, requires updating driver api to add node to the method that reports them17:16
jrollbut I'm trying to reason about how all of that code would work without a resource tracker, and if not working means it would blow up spectacularly or just kinda ignore it17:16
johnthetubaguyjroll: true, its a bit too heavily used right now, thinking about it17:17
jrollyeah, if nova doesn't trust the driver to report resources correctly, how will it trust ironic :)17:17
johnthetubaguyjroll: did you see this bit: https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L595417:18
johnthetubaguyjroll: true, we can't trust it, mostly because of ourselves screwing up17:19
jrollheh17:19
johnthetubaguyjroll: so I guess the action is to get something we both kinda like before the summit, to present in that session17:20
*** achanda has joined #openstack-ironic17:22
jrolljohnthetubaguy: yeah, going to see what I can do. I still like the long term vision of ironic handling all of the resource tracking and claims17:22
jrolljohnthetubaguy: and from there, we could do really deep hardware inspection and schedule against all types of things, without storing all of that in nova as well17:22
johnthetubaguytrue17:22
johnthetubaguywe can share code, and things, but thats not the point really17:22
jrolla flavor could be version 123 bios, mellanox nic, 7200 RPM HDD17:23
jrollor whatever.17:23
jrollstuff nova gives zero cares about17:23
johnthetubaguyso there is another idea I had, which involves building a layer above both Nova Ironic and Magnum, with its own API...17:23
JayFjroll: ++ I agree with that b/c one of the "scariest" things about running a production Ironic cloud is the dubious state syncing that is implicit between Nova and Ironic17:23
johnthetubaguyso I need to run, but we should totally talk more on this17:25
johnthetubaguymy stomach is starting to control me now, so its time17:25
jrolljohnthetubaguy: yeah, that's super interesting, but that's so far off17:25
* jroll tosses a beer and a snack to johnthetubaguy17:25
jrollhave a good weekend, this was helpful :)17:26
* johnthetubaguy catches17:26
johnthetubaguyand you, when it happens!17:26
johnthetubaguycatch you later17:26
jrollsee ya17:26
jrolldevananda: ^ good conversation you care about above17:26
jlvillaljroll: Priorities between functional testing and AMT?  I'm thinking functional testing is what I should focus on, but thought I would double check.17:27
jrolljlvillal: 1) you're leading the testing effort, so that should be your main goal. 2) I suspect nobody will ever run AMT in production, while everyone will run ironic in production, if that answers the question :)17:28
jlvillalIt does :)  Thank you.17:28
* jlvillal goes back to reading other projects functional testing code...17:28
devanandajohnthetubaguy: I've been thinking a bunch about a layer on top of nova/ironic/magnum as well17:28
devanandajohnthetubaguy: and how we need to be able to schedule different types of things -- not just VMs with volumes attached -- and that's really not being solved by the existing scheduler work17:29
johnthetubaguydevananda: I should write that up really, I think its basically what we (as in Nova) always called heat, but they actually built something more interesting17:29
*** thiagop has quit IRC17:29
jrolldevananda: think about deploying that to an existing cloud and how much of a very-long-term-thing that becomes17:29
jrollwe still need something in the meantime17:30
johnthetubaguyjroll: +1 on both fronts17:30
jroll(I know that probably isn't what you're saying) :)17:30
devanandajohnthetubaguy: please do write up your thoughts.17:30
johnthetubaguydevananda: I will move that up the TODO list a little, its an interesting answer to a few problems we keep hitting17:31
johnthetubaguythe problem is its another API17:31
johnthetubaguyanyways, I should totally do that17:32
*** lazy_prince has quit IRC17:32
devanandayea, well, there's a couple APIs that tease out of it, which is not great for simplicity's sake, but it may actually make things easier to consume17:33
*** nicodemos has joined #openstack-ironic17:33
devanandaend state should be a single API for describing and interacting with compute resources, regardless of VM / baremetal / container -- I think we all agree that that needs to exist17:35
devanandabut, like jroll said, the types of things one cares about when scheduling baremetal (or containers, for that matter) are somewhat different than what one cares about with VMs17:35
devanandaI don't know if the best way to solve that is that each service grows a unique scheduler, but given the non-starter that gannt was, I wonder if we just need to do go down that ^ road so we can make some progress on this17:36
devanandaanyway, good topics for the summit17:36
*** marzif has quit IRC17:37
jrolldevananda: I'm going to add "ironic filter API / scheduler" to summit session list17:37
jrollwe definitely need the former, it tends to lead to the latter if we do need it17:37
devanandayup17:37
jrollscheduler would be a filter API -> random.choice(results) and lock17:37
jrolllock/claim/reserve17:38
*** achanda has quit IRC17:38
devanandayea - we've talked about adding that facility to our API before. I'm all for it, but it starts to get tangled in with how nova does resource claims / tracking17:38
jrollright, so we would use this instead of nova's bits for that17:39
devananda++17:39
jrollO_o17:39
jrollyou were so against this in seattle :D17:39
devanandaI'm allowed to change my mind on things :)17:40
*** thiagop has joined #openstack-ironic17:40
jrolldevananda: reviews welcome here then https://review.openstack.org/#/c/194453/7/specs/liberty/approved/ironic-multiple-compute-hosts.rst17:41
jroll:)17:41
NobodyCamgood morning devananda :-p17:42
*** achanda has joined #openstack-ironic17:43
mordreddevananda: hi17:43
devanandajroll: ack. also - I need to run now. need food, and need to run to a dr's appt17:44
jrolldevananda: yeah, no worries. want me to update the fakeboot thing today?17:44
* SpamapS makes a wookie noise17:44
devanandajroll: pls do17:44
jrollk17:44
devanandasorry I couldn't get to it17:44
jrollno worries17:44
jrollhopefully I can figure it all out :P17:44
jrolldevananda: so instantiate FakeBoot for intree drivers, do your thing otherwise?17:44
devanandajroll: on the plus side, I got busy diving into softlayer's architecture17:45
jrolldevananda: when is diving into existing architecture a plus? :P17:45
NobodyCammornign mordred & SpamapS17:45
mordreddevananda, jroll, johnthetubaguy I would like to be involved in such a follow up conversation17:45
mordredmorning NobodyCam17:45
jrollmordred: re api in front of nova/magnum/ironic?17:45
SpamapSNobodyCam: hah, a Star Wars wookie, not a NobodyCam wookie. ;)17:45
NobodyCamlol17:46
SpamapSNobodyCam: but hi!17:46
mordredjroll: yes17:46
BadCublol17:46
jrollmordred: I fully suspect it will start either in the mailing list or in a bar in tokyo, if the latter happens we'll try to find you17:46
* mordred may have some recent experience in the area of making things that are not the same look the same17:46
SpamapSRegarding "lets make a scheduler" .. perhaps.. lets not? --> http://mesos.apache.org/17:46
jrollsuspect/expect17:46
devanandamordred: there were two threads there, I think. one was that ^. the other was doing actual scheduling and resource tracking in ironic, and allowing nova to just "hand off" that responsibility rather than duplicate and try to stay in sync17:46
mordredjroll: let's start it at a bar17:46
jroll++17:46
mordredjroll: I think starting exploratory conversations on the mailing list is a waste of time17:46
devanandaSpamapS: ++ to not reinventing that and just using mesos ....17:46
jrollyeah17:47
devanandamordred: if this happens in a bar ,I will text you17:47
* jroll hms17:47
jrollhrms, too.17:47
mordredSpamapS: it has been communicated to me that mesos does not work nearly so well in real life as the hype would have you believe17:47
*** achanda has quit IRC17:47
mordred"falls over a lot" was mentioned17:47
SpamapSSeems like if you can teach Mesos how to find magnum, ironic, and nova things.. you get a high level interface to "computers of various types"17:47
SpamapSmordred: perhaps we could fix it?17:47
devanandamordred: <sadface>17:47
SpamapSIt's v0.2417:48
SpamapSPretty sure everything falls over a lot at this age. ;)17:48
mordredpossibly - but they're chasing a goal I probably don't agree with when it comes down to it17:48
jrollSpamapS: ok yeah, that's two different things, in the meantime we have to teach nova how to schedule to ironic, and as such will need to build some scheduler things :/17:48
mordredwhich is the theory that everything can be disassembled into a generic "workload" and then "magic" will manage it17:48
mordredthat works really well for wordpress blogs17:49
mordredBUT - it's a great bar conversatoin17:49
mordredI'm probably wrong17:49
SpamapSThe problem is17:49
SpamapSwe're probably all simultaneously right and wrong17:49
mordredyup17:49
*** achanda has joined #openstack-ironic17:49
SpamapSDrinks make us more right though.17:50
mordredto be clear ...17:50
mordredI was volunteering to do heavy lifting on the API layer in front17:50
mordredsince I've been basically doing a form of that for the past year (although it doesn't consolidate ironic and nova)17:50
SpamapSjroll: yeah I agree thats something else. "physical constraints" has always been something just out of reach for Ironic.17:51
mordredso I've got a BUNCH of thoughts and anger there17:51
jrollit's be really odd to switch the front line API out from under users17:51
mordredfor the resource scheduling, I have many different thoughts17:51
mordredjroll: I would NEVER switch the frontline api out17:51
mordredjroll: I would add a new optional api on beside17:51
mordredif someone wants to use a new set of abstractions, neat17:51
mordredif they want to continue to use nova and ironic and magnum more directly, awesome17:51
jrollmordred: yeah, but the real goal is "doing all this stuff in nova gets really weird", right?17:52
mordrednothing about a new api should mean the old ones need to go away17:52
jrollour users use the nova api to get a baremetal17:52
thiagopvdrok: ping17:52
jrolls/real goal/real problem/17:52
mordredjroll: yes17:52
vdrokthiagop, pong17:52
mordredjroll: but imagine if the new API could start by doing what your users are doing17:52
mordredjroll: get a VM from nova, get a baremetal from nova - but do so with semantics that make sense17:52
*** sdake has quit IRC17:53
jrollmordred: yeah, it's probably doable, just trying to work it all out in my head17:53
thiagopvdrok: wrt your comment about not having vendor on the fake interface of the oneview driver, we need to test that interface17:53
mordredjroll: that's what the alcohol at the bar is for17:53
thiagopvdrok: you think that overwrite on the test setUp is sufficient?17:54
jrollmordred: because "what users do today" is use the nova API, and presumably the goal of this new thing would be to not be the nova api17:54
dprincejroll, devananda: hi, a minor DIB change here... I wanted to ask if this effects Ironic CI https://review.openstack.org/#/c/233088/17:54
mordredjroll: yes17:54
SpamapSWhat would it be?17:54
vdrokthiagop, oops, sorry, you overloaded it17:54
vdrokplease ignore that comment :)17:54
*** sdake has joined #openstack-ironic17:54
mordredjroll: do you want the users to say "hey, give me a vm" or "hey, give me a baremetal"?17:55
*** ntpttr has joined #openstack-ironic17:55
sambettsjroll, mordred isn't that what flavors are for?17:55
* thiagop lost something...17:55
devanandamordred: so to your point -- I think Ironic should also start presenting a more user-friendly API than it does today17:56
thiagopvdrok: take a look on test_vendor, line 4817:56
thiagopvdrok: please17:56
mordredsambetts: yes. but I believe there is an impedence mismatch in that nova's api was designed with VMs in mind, and we've backported non-VM into those constructs17:56
mordredsambetts: which is great - because both a VM and a baremetal are a "computer"17:56
jrollmordred: I got lost, I think17:57
jrollmy brain isn't necessarily working today17:57
mordredsambetts: but there are also differences between them, and the nova API does not really have  way to expose that to the user that is leaving people feel satisfied17:57
thiagopvdrok: that's the same way BaseAgentVendor's test is implemented. I don't know if I should keep it there or point the vendor on FakeOneViewDriver17:57
mordredjroll: that's fine :)17:57
devanandaI find this conversation *really* important, but I also do not want to be late for an appointment :-/17:57
mordreddevananda: we'll come back to it17:57
jrollyeah17:58
sambettsah... I see... :/ I also have to run, but am v.interested in this convo17:58
vdrokthiagop, well this vendor interface in fake driver (if used by someone) won't work with fake boot and fake deploy17:58
sambettshave a good weekend everyone o/17:58
jlvillalsambetts: Enjoy!17:58
NobodyCamnight sambetts17:58
jlvillalsambetts: eavesdrop.openstack.org :)17:58
sambettsjlvillal: :-P good point17:59
devanandadprince: at a glance, i do not understand the change in question :(17:59
devanandaperhaps jroll does?17:59
dprincedevananda: maybe you don't care about this then :). Just wanted to mention it18:00
*** pelix has quit IRC18:00
thiagopvdrok: I'm putting it just for the sake of testing, don't know if I should put that on the fake driver or just let that self.passthru thing on the test18:00
*** thrash is now known as thrash|brb18:00
dprincedevananda: basically just changing it so you'd set DIB_REPOREF_ironic_agent instead of DIB_REPOREF_agent, just makes things more consistent in DIB with regards to the element name18:00
jrolldprince: not sure, I'll need to come back to this18:01
*** ionutbalutoiu has quit IRC18:02
dprincejroll: ack, no worries. I don't think it effects the CI in ironic18:02
openstackgerritNisha Agarwal proposed openstack/ironic: Add support for partition images in agent driver  https://review.openstack.org/16200818:03
vdrokthiagop, but with all this mocking you could use agent oneview in tests too?18:04
vdroknot fake one18:04
thiagopvdrok: let'me see what I've got running with agent...18:06
jrolldprince: we'll find out eh18:06
*** sdake has quit IRC18:07
*** cdearborn has joined #openstack-ironic18:10
thiagopvdrok: good catch, it works. Will remove that vendor from fake and run the tests with agent_pxe_oneview18:10
thiagopTheJulia: ping18:10
vdrokthiagop, so if my understanding is correct, you should add vendor interface to fake driver if there is some specific vendor functional that can be used without other interfaces (like e.g. ipmitool vendor passthru)18:11
vdrokif it is only for deployment, and you use fake deploy it can be ommitted18:11
vdrokgood night everyone, have a good weekend!18:12
thiagopvdrok: ok. thaks18:12
thiagopvdrok: have a great weekend18:12
*** ntpttr has quit IRC18:12
openstackgerritThiago Paiva Brito proposed openstack/ironic: OneView Driver for Ironic  https://review.openstack.org/19182218:15
TheJuliathiagop: pong18:16
thiagopTheJulia: Hi, I sent another patch addressing the comments of vdrok now but I'll wait your answer about the docs thing, right?18:18
thiagopTheJulia: just for you to know that I'm not ignoring it :D18:18
TheJuliahmm.. interresting discussions in bars in tokyo, this could be good.18:18
BadCubhmmmm18:19
TheJuliathiagop: Ok, at lunch, Opening review now18:20
thiagopTheJulia: bon apetit18:20
*** achanda has quit IRC18:22
*** Marga_ has quit IRC18:28
*** Marga_ has joined #openstack-ironic18:28
TheJuliathiagop: responded on the review18:28
TheJuliathiagop: hopefully that makes sense :)18:29
*** sdake has joined #openstack-ironic18:31
*** thrash|brb is now known as thrash18:32
*** sambetts has quit IRC18:34
*** Marga_ has quit IRC18:35
*** sambetts has joined #openstack-ironic18:38
*** jistr has joined #openstack-ironic18:40
*** ijw_ is now known as ijw18:41
*** achanda has joined #openstack-ironic18:44
liliarsTheJulia: hi, thiagop left for the day just now so I answered your comment on the review, thanks! Will be sending a patch with an initial documentation asap (:18:48
*** Sukhdev has quit IRC18:49
TheJulialiliars: Thank you! :)18:50
*** jistr is now known as jistr|afk18:50
*** achanda has quit IRC18:53
*** pas-ha has quit IRC18:54
BadCubliliars: awesome! Thank you :)18:59
*** albertoffb has quit IRC18:59
*** ukalifon1 has joined #openstack-ironic19:00
*** jistr|afk has quit IRC19:05
*** zer0c00l has quit IRC19:10
*** harshs has quit IRC19:11
*** balajin_ has quit IRC19:12
*** harlowja has quit IRC19:12
*** [1]cdearborn has joined #openstack-ironic19:13
*** ukalifon1 has quit IRC19:18
*** balajin has joined #openstack-ironic19:19
*** zer0c00l has joined #openstack-ironic19:19
*** mrmoje has quit IRC19:19
*** cdearborn has quit IRC19:21
*** mrmoje has joined #openstack-ironic19:21
*** harlowja has joined #openstack-ironic19:24
*** achanda has joined #openstack-ironic19:31
* jlvillal decides he is hungry19:36
*** tsekiyam_ has joined #openstack-ironic19:44
*** mtanino has quit IRC19:45
*** tsekiyama has quit IRC19:47
*** e0ne has joined #openstack-ironic19:49
*** nicodemos has quit IRC19:50
*** Nisha has quit IRC19:51
*** achanda has quit IRC19:53
*** Marga_ has joined #openstack-ironic19:54
*** mtanino has joined #openstack-ironic20:03
*** aswadr has quit IRC20:12
*** mjturek1 has quit IRC20:15
*** ntpttr has joined #openstack-ironic20:17
*** baoli_ has quit IRC20:22
*** baoli has joined #openstack-ironic20:22
*** baoli has quit IRC20:22
*** e0ne has quit IRC20:26
*** achanda has joined #openstack-ironic20:34
*** krtaylor has quit IRC20:48
*** willsama has joined #openstack-ironic20:51
*** Sukhdev has joined #openstack-ironic20:58
*** trown is now known as trown|outttypeww20:58
*** krtaylor has joined #openstack-ironic21:02
*** marzif has joined #openstack-ironic21:02
*** sdake_ has joined #openstack-ironic21:05
*** sambetts has quit IRC21:06
*** sdake has quit IRC21:06
*** sambetts has joined #openstack-ironic21:11
*** sdake_ has quit IRC21:14
*** dprince has quit IRC21:16
*** Sukhdev has quit IRC21:19
*** sdake has joined #openstack-ironic21:19
*** Sukhdev has joined #openstack-ironic21:20
*** tsekiyama has joined #openstack-ironic21:26
jlvillallekha: krtaylor: So I have investigating the functional testing. So the first thing we need is a way to bring up and tear down the Ironic services.  ironic-conductor & ironic-api.21:28
jlvillalSo I'm starting to see how Nova is doing it with fixtures and see if that is what we want.21:29
jlvillalBut thought I'd see if either of you had feedback/ideas21:29
*** tsekiyam_ has quit IRC21:29
*** mbound has joined #openstack-ironic21:45
*** tsekiyama has quit IRC21:51
*** ntpttr has quit IRC21:54
*** willsama has quit IRC22:01
*** davideag_ has quit IRC22:08
*** davideagnello has joined #openstack-ironic22:09
*** [1]cdearborn has quit IRC22:11
*** mtanino has quit IRC22:13
*** Sukhdev has quit IRC22:14
*** ntpttr has joined #openstack-ironic22:31
*** Sukhdev has joined #openstack-ironic22:38
*** dims_ has joined #openstack-ironic22:50
*** marzif has quit IRC22:51
*** dimsum__ has quit IRC22:53
openstackgerritJim Rollenhagen proposed openstack/ironic: Fix AgentDeploy compatibility with pre-Liberty drivers  https://review.openstack.org/23121522:53
JayFjroll: does ^ need backport-potential-liberty ?22:59
JayFjroll: or whatever the tag is nowadays22:59
jrollJayF: the bug has it yeah22:59
JayFI thought there was a commit tag for it?22:59
jrollexcept the commit message has the wrong bug22:59
jrollno22:59
openstackgerritJim Rollenhagen proposed openstack/ironic: Fix AgentDeploy compatibility with pre-Liberty drivers  https://review.openstack.org/23121523:00
jrollfixed commit msg23:00
JayFIf you don't have the appropriate permissions to nominate the bug, then tagging it with icehouse-backport-potential is also sufficient e.g. for nova.23:00
JayF^ from the docs, so apparently it's just a workaroud for those of us less powerful23:00
jrollah23:01
jrollyeah never heard of that23:01
jrolldevananda: ^ that patch is up btw, it's passing unit tests which feels wrong :)23:05
*** r-daneel has quit IRC23:07
*** dims_ has quit IRC23:07
jlvillaljroll: So task.driver.boot exists pre-liberty but is set to None?23:12
jrolljlvillal: no, but if a driver doesn't set self.boot at instantiation, it will be None23:13
jroller wait23:13
jrollno, it didn't exist in Kilo23:13
jlvillalThat is what I was wondering. Does it magically get created?23:14
jlvillalI was thinking maybe I was being dumb.23:14
jrolljlvillal: no, that's why things exploded with a kilo-level out-of-tree driver23:14
jlvillaljroll: Then wouldn't it need a hasattr(driver, 'boot') ?23:15
jrolljlvillal: we removed the direct references to driver.boot23:16
jrolloh23:16
jrollsec, will link23:16
jlvillaljroll: https://review.openstack.org/#/c/231215/3/ironic/drivers/modules/agent.py  L18123:16
jrollbasically the base driver sets it to None23:16
jlvillalOkay, good.23:16
jrollhttp://git.openstack.org/cgit/openstack/ironic/tree/ironic/drivers/base.py#n9623:17
jrollgithub throwing unicorns :(23:17
jlvillaljroll: Okay and thanks.23:17
jrollnp23:17
openstackgerritJay Faulkner proposed openstack/ironic-python-agent: Ensure all methods in utils.py have docstrings  https://review.openstack.org/22031323:22
jrollJayF: wow, that patch is still going?23:25
jrolloh I thuoght it was an older one, ignore me23:25
JayFjroll: it's had a mild change that's been needed for a long time23:25
JayFjroll: so I jfdi just now23:25
jrollah23:25
*** sdake has quit IRC23:26
JayFjlvillal: vdrok: Congratulations23:26
openstackgerritJim Rollenhagen proposed openstack/ironic: Fix AgentDeploy compatibility with pre-Liberty drivers  https://review.openstack.org/23121523:32
openstackgerritJim Rollenhagen proposed openstack/ironic: Fix AgentDeploy compatibility with pre-Liberty drivers  https://review.openstack.org/23121523:32
jrolldamn that commit message23:32
* jroll fixes locally23:33
jrolldevananda: ^ I think that's good to go now23:33
JayFjroll: for verify -2, is a recheck sufficient?23:33
JayFjroll: for https://review.openstack.org/#/c/232338/1 it doesn't seem to have budged jenkins23:33
jrollJayF: yes, it's sufficient, give it a minute23:34
JayFjroll: aweeks ^ We should also make this change in our downstream ramdisk image repo as well fwiw, that's a great find :)23:34
jrolloh NICE23:34
jrollI like23:35
JayFactually, we don't have to change it downstream, b/c we use upstream dockerfile23:35
jrollright23:35
* JayF prs a thing downstream anyway23:35
*** mmedvede has joined #openstack-ironic23:36
JayFjroll: fwiw 232338 is still stuck, and I even workflow -1 / +1'd it23:55
jrollJayF: I don't have any special knowledge that you don't :)23:55
jrollhit up infra if you continue having problems23:55
JayFalready there23:56
JayFjust letting you know that waiting didn't work :)23:56
jrollcool23:57
*** harshs has joined #openstack-ironic23:57
*** garthb has quit IRC23:58
*** achanda has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!