Thursday, 2014-08-28

NobodyCamwanders afk for a while00:05
*** yuanying has quit IRC00:06
*** yuanying has joined #openstack-ironic00:15
mrdajroll, comstud: There's been some comments on your caching stuff over here: https://review.openstack.org/#/c/115540/4/nova/virt/ironic/driver.py00:17
mrdaAny comments welcomed from you both00:17
*** r-daneel has quit IRC00:17
mrdaJust figured you might like to opportunity to comment before I do00:18
jrollugh00:18
mrdaThanks jroll and comstud00:18
jrollUGH00:18
jrollmrda: I'm trying to run out the door, do you know the answers to those?00:21
mrdajroll: I can answer them if you like (ie. read the code and work it out)00:22
jrollmrda: tldr the cache is refreshed every loop of the resource tracker, it won't get hit twice for the same node, etc00:22
mrdaok00:22
mrdajust figured you might like to comment.00:22
jrollor you can bug comstud, he's supposedly working :)00:22
jrollI would00:22
mrdaIf you think everything is ok, I can comment to that effect00:22
jrollbut late for a thing already00:23
jrollyes, ironic peolpe asked the same question00:23
jroll(so maybe we want to add a comment, idk)00:23
mrdathanks00:23
mrdalifeless: poke00:38
lifelesspoke00:38
mrdaSo, back on cpu_arch00:38
mrdaThe Tl;DR is that we'll leave it as "NotFound"00:39
mrdaBut we will canonicalize() it if it is set00:39
mrdaAgreed?00:39
lifelessno00:39
mrda...which means TripleO may need to canonicalize as well00:39
lifelesswe will leave it as is.00:39
mrdahmmm00:39
lifelessIf we want to add canonicalize, we have to do that to the scheduler as well.00:39
lifelesssince this data is late bound00:40
lifeless(it lives in Ironic, and Ironic hasn't been canonicalising - if there is bad data out there, its in users systems already)00:40
mrdaYou realise that when this blows up I'm going to point to this eavesdrop :)00:40
mrdaBut I understand00:40
lifelesswe seemed to have consensus on that here yesterday with jroll and JayF00:41
mrdayeah, we were certain on the NotFound bit00:41
lifelessI don't remember whether it was 'and do the canonicalise' or 'and do nothing', but it was clear that00:42
lifelessif we canonicalize we do that in the scheduler too00:42
mrdaI wasn't sure we were on the canonicalize() bit00:42
JayFI'd be willing to bet that what we have in our database isn't canonialize()'d00:42
JayFand I'd really rather not have the merged nova driver break me without database work00:42
lifelessand frankly, I think having canonicalize called shouldn't be a driver responsibility00:42
lifelessif nova wants things canonicalized00:42
mrdaok, just wanted to be sure00:42
lifelessthats a separate patch - change the scheduler and the compute manager at the same time, fixing anything the driver might have wrong, *for all* drivers.00:43
mrdaThanks lifeless and JayF!00:44
*** chuckC has quit IRC00:45
*** eghobo has quit IRC01:10
*** eghobo has joined #openstack-ironic01:11
*** eguz has joined #openstack-ironic01:21
*** eguz has quit IRC01:21
*** eghobo has quit IRC01:25
*** nosnos has joined #openstack-ironic01:49
*** openstackgerrit has quit IRC02:02
*** openstackgerrit has joined #openstack-ironic02:03
*** yuanying has quit IRC02:17
*** eghobo has joined #openstack-ironic02:32
*** eghobo has quit IRC02:37
*** eghobo has joined #openstack-ironic02:38
*** chuckC has joined #openstack-ironic02:40
*** dlaube has quit IRC02:43
*** killer_prince is now known as lazy_prince02:46
*** eguz has joined #openstack-ironic02:55
*** eghobo has quit IRC02:58
*** eguz has quit IRC03:01
openstackgerritHaomeng,Wang proposed a change to openstack/ironic: Add send-data-to-ceilometer support for pxe_ipminative driver  https://review.openstack.org/11248603:02
lazy_princeHi All.. Has anyone looked at https://github.com/rackerlabs/ironic-neutron-plugin.. i have few doubts regarding it.. can someone please help..?03:11
lazy_princedoes it need a corresponding agent running on the compute node..?03:12
JoshNanglazy_prince: hey i wrote the ironic side code to control that plugin. it doesn't require an agent on the compute node. it's a plugin for neutron and then talks directly to switches during the deploy/tear_down process to configure vlans03:14
JoshNangmorgabra wrote the actual code there (but doesn't look like he's in this channel)03:15
JoshNangnvm, tab complete failed me03:15
lazy_princeokay.. but as i understand, its an extension of ml2 plugin from Neutron, which as per my understanding, needs an agent on the compute side.. correct me if i am wrong..03:17
lazy_princei posted it on neutron channel but no one responded..03:18
JoshNanglazy_prince: it definitely doesn't need an agent on the deployed nodes. i'm not sure the details03:18
JoshNangi think we're just not sending any of the calls that would normally go to the agent03:19
lazy_princeso basically, when using this plugin, all physical switch management will be handled by this plugin in neutron itself..03:19
JoshNanglazy_prince: correct, at least as far as flipping vlans on ports and ip assignments03:20
lazy_princebut IP assignment is still done by DHCP agent of neutron.. right..03:25
lazy_princesorry, i am new to neutron and hence so many questions..03:26
*** rloo has quit IRC03:26
*** nosnos has quit IRC03:26
mrdalazy_prince: don't be embarrassed by asking questions.  We all learn this way.03:27
*** nosnos has joined #openstack-ironic03:27
lazy_princeI also has a look at https://review.openstack.org/#/c/8479503:30
lazy_princeJoshNang: I see that there is a agent_utils.py introduced to talk to Neutron.. Can you please tell me why did we write this and not used the current neutron client (bundled with ironic).03:31
*** nosnos has quit IRC03:32
JoshNanglazy_prince: (sorry, hosting an event at the office) agent_utils is a wrapper for neutron client. it adds some of the extra params a neutron plugin that deals with hardware needs03:55
JoshNangall 4 of the main calls (configure_instance_networks, add_provisioning_network, etc) are just ways to grab the physical port descriptions and add them into the calls, with some error checking03:56
JoshNangso the way we do ip assignment is a static ip sent to the node via configdrive. neutron allocates the ip to nova, nova makes a configdrive, ironic writes the configdrive to the node, the node uses cloud-init to read what it's ip is supposed to be. semi-dynamic, but static on the hosts03:57
*** rameshg87 has joined #openstack-ironic03:59
*** mitz_ has quit IRC03:59
*** mitz has joined #openstack-ironic03:59
lazy_princestatic IP via config drive..? why not use DHCP (dnsmasq)for that matter.. I just want to understand..04:02
*** eghobo has joined #openstack-ironic04:07
JoshNangwe don't do dhcp on our public cloud. we didn't make that decision04:12
*** eghobo has quit IRC04:12
lazy_princeaha... so if one chooses to do dhcp, is config drive still needed..?04:13
lifelessnope04:14
lifeless(but you do need to also deploy the metadata server at that point)04:14
lazy_princeyup, i understand that metadata server will be needed if config drive is not used..04:15
JoshNangcorrect04:16
*** pcrews has quit IRC04:19
rameshg87JoshNang, lazy_prince, but we don't use config driver right now in ironic, right ? are there plans to use them ?04:26
rameshg87JoshNang, lazy_prince, s/config driver/config drives/04:26
*** nosnos has joined #openstack-ironic04:27
lazy_princerameshg87: i guess, its a user choice to use configdrives or metadata server04:28
JoshNangrameshg87: right. i think we have a patch proposed to add it after the nova driver lands04:28
rameshg87lazy_prince, right, but there is no "choice* of config drives available in ironic right now :)04:29
rameshg87JoshNang, okay04:29
lazy_princeJoshNang:  can you post the patch link..?04:29
rameshg87lazy_prince, +1, would like to look at patch link :)04:30
lazy_princeif you have it handy..04:30
*** ramineni has joined #openstack-ironic04:30
JoshNangerr maybe not04:31
JoshNanglazy_prince: rameshg87 here's the spec https://review.openstack.org/#/c/99235/04:31
rameshg87JoshNang, thanks04:32
rameshg87JoshNang, thanks for the mention of the ilo :)04:32
JoshNangrameshg87: no prob! :)04:32
JoshNanglazy_prince: rameshg87 here's the code that we're running for configdrive04:33
JoshNanghttps://review.openstack.org/#/c/86192/04:33
JoshNang(heh copy paste fail)04:33
lazy_princethanks..04:33
*** eghobo has joined #openstack-ironic04:34
JoshNangno problem! i'm sorry it's not all integrated and easy to set up yet. but soon, hopefully! i'm gonna head home...have a good day/night!04:35
lazy_princewe hope so too..04:36
*** lazy_prince is now known as killer_prince04:49
*** rakesh_hs has joined #openstack-ironic05:01
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ironic: Updated from global requirements  https://review.openstack.org/11742305:35
*** k4n0 has joined #openstack-ironic06:03
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ironic: Imported Translations from Transifex  https://review.openstack.org/11587806:10
*** foexle has joined #openstack-ironic06:17
*** dtantsur|afk is now known as dtantsur06:30
dtantsurMorning Ironic06:30
*** Haomeng has quit IRC06:32
*** killer_prince is now known as lazy_prince06:33
mrdaMorning dtantsur06:34
dtantsurmrda, g'evening06:35
mrda:)06:35
*** foexle_ has joined #openstack-ironic06:40
*** foexle_ has quit IRC06:40
openstackgerritSyed Ismail Faizan Barmawer proposed a change to openstack/ironic: Add UEFI based deployment support in Ironic  https://review.openstack.org/11435706:54
*** dtantsur is now known as dtantsur|bbl07:03
*** Haomeng has joined #openstack-ironic07:08
*** eghobo has quit IRC07:08
*** harlowja_ is now known as harlowja_away07:14
*** todd_dsm has quit IRC07:24
*** jcoufal has joined #openstack-ironic07:49
openstackgerritMike Durnosvistov proposed a change to openstack/ironic: Check whether specified FS is supported  https://review.openstack.org/9810207:54
*** jistr has joined #openstack-ironic07:56
*** jistr has quit IRC07:56
*** jistr has joined #openstack-ironic08:08
*** rushiagr_away is now known as rushiagr08:08
*** rushiagr is now known as rushiagr_away08:12
yuriyzMorning Ironic08:14
mrdaHi yuriyz08:17
openstackgerritA change was merged to openstack/ironic: properly format user guide in RST  https://review.openstack.org/11616808:18
*** lucasagomes has joined #openstack-ironic08:18
*** derekh has joined #openstack-ironic08:20
*** boris-42 has quit IRC08:21
Haomengyuriyz: morning:)08:27
yuriyzevening Haomeng :)08:28
Haomengyuriyz: :)08:28
*** boris-42 has joined #openstack-ironic08:30
*** ramineni has quit IRC08:37
lucasagomesmorning yuriyz Halacs08:37
lucasagomesouch08:37
lucasagomesHaomeng, morning*08:37
Halacsmorning lucasagomes08:38
Haomengmorning lucasagomes:)08:38
lucasagomes:)08:38
*** ramineni has joined #openstack-ironic08:46
*** nosnos has quit IRC08:47
*** nosnos has joined #openstack-ironic08:47
*** nosnos has quit IRC08:52
*** MattMan has quit IRC08:57
*** MattMan has joined #openstack-ironic08:58
*** yongli has quit IRC09:06
*** athomas has joined #openstack-ironic09:11
*** nosnos has joined #openstack-ironic09:24
*** romcheg1 has joined #openstack-ironic09:32
romcheg1Good morning Ironic!09:32
mrdaHi romcheg109:37
lucasagomesmorning mrda romcheg109:52
romcheg1Now I'm with you again :)09:52
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: DRAC wsman_{enumerate, invoke}() to return an ElementTree object  https://review.openstack.org/11687109:53
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Implements the DRAC ManagementInterface for get/set boot device  https://review.openstack.org/11691309:53
*** jcoufal has quit IRC10:09
*** jcoufal has joined #openstack-ironic10:12
*** igordcard has joined #openstack-ironic10:14
*** nosnos has quit IRC10:20
*** nosnos has joined #openstack-ironic10:21
*** romcheg1 has quit IRC10:23
*** romcheg1 has joined #openstack-ironic10:24
*** nosnos has quit IRC10:25
*** pelix1 has joined #openstack-ironic10:32
*** nosnos has joined #openstack-ironic10:34
*** HenryG has quit IRC10:43
*** rameshg87 has quit IRC10:59
*** rakesh_hs has quit IRC11:09
*** nosnos has quit IRC11:18
*** nosnos has joined #openstack-ironic11:20
*** igordcard has quit IRC11:36
*** dtantsur|bbl is now known as dtantsur11:44
*** Halacs has left #openstack-ironic11:46
*** HenryG has joined #openstack-ironic11:52
lucasagomesjroll, ping12:12
*** lazy_prince is now known as killer_prince12:20
*** nosnos has quit IRC12:22
*** nosnos has joined #openstack-ironic12:23
*** nosnos has quit IRC12:27
openstackgerritYuriy Zveryanskyy proposed a change to openstack/ironic: Log ERROR power state in node_power_action()  https://review.openstack.org/11749912:55
*** k4n0 has quit IRC13:10
lucasagomesyuriyz, ping re bug 1358816. What it means by checked?13:11
lucasagomesare we taking some action in case it returns ERROR like putting the node in maintenance or something?13:11
ShrewsIs it safe to do rechecks yet?13:20
Shrewsinfra says "yes"13:25
yuriyzlucasagomes, before we put node in maintenance after CONF.conductor.power_state_sync_max_retries only if driver raises exception, now we do it also if ERROR state returned13:30
lucasagomesShrews, seems so13:30
lucasagomesyuriyz, right, so that's what the bug is proposing? to check for those states and mark the node as in maintenance in case it occurs13:32
lucasagomescause when I read it says like ERROR state should be checked, but it doesn't say which action we would take in case the ERROR state appears13:33
yuriyzlucasagomes, we should do something with ERROR power state from drivers, agree with https://github.com/openstack/ironic/blob/master/ironic/drivers/modules/ipminative.py#L21413:37
lucasagomesyuriyz, I c13:38
lucasagomesyeah13:38
yuriyzlucasagomes https://github.com/openstack/ironic/blob/master/ironic/drivers/modules/ipmitool.py#L476 also13:40
lucasagomes+1 to return ERROR from the driver and check that one layer above13:43
lucasagomesI was just wondering what would be the action on the layer above (which is not explicity in that bug)13:43
lucasagomesbug description*13:43
yuriyzlucasagomes, IMO exception from get_power_state() - fatal error (network, etc), states.ERROR - we got reply from node but with strange date13:47
yuriyzdata13:47
jrollmorning lucasagomes Shrews yuriyz :)13:52
lucasagomesjroll, hey... was waiting for ya13:52
lucasagomesjroll, there's a race condition on the DHCP patch13:52
Shrewsmorning jroll13:52
lucasagomesjroll, mostly because we are using a global var there13:52
lucasagomesjroll, I have a fix locally for that, I basically converted that factory file in a class and so on13:53
lucasagomesjroll, it's ok if I submit it on top of your patch?13:53
lucasagomesI mean ellen's/your patch13:53
NobodyCamgood morning ironic13:53
lucasagomesfactory file == factory functions13:53
NobodyCammorning Shrews jroll lucasagomes and yuriyz13:54
lucasagomesmorning NobodyCam13:54
NobodyCam:)13:54
jrolllucasagomes: sure, always ok :)13:55
lucasagomesjroll, ack13:55
jrolllucasagomes: curious what the race is but I guess I'll watch for your patch13:55
jrollmorning NobodyCam :)13:55
lucasagomesjroll, yeah... I put a paste in the patch13:55
lucasagomesI saw it because py26 was failing with that error13:55
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Make DHCP provider pluggable  https://review.openstack.org/11235113:56
lucasagomes^ tested locally it works13:56
lucasagomesew why git is not seems ironic/tests/dhcp/test_neutron.py as renamed from ironic/tests/test_neutron.py >.<13:58
*** pcrews has joined #openstack-ironic13:59
jrolllucasagomes: I see, I was also thinking about just loading the driver at conductor startup at one point13:59
jrollwhich would likely fix this as well13:59
lucasagomesyup13:59
lucasagomeslike a singleton13:59
lucasagomesusing global vars is hard to make tests13:59
lucasagomesit's hard to clean states etc13:59
lucasagomesbetter to encapsulate it in a class13:59
jrollI guess we would still need locking14:00
lucasagomesI put one14:00
jrollbut only for tests, I think14:00
jrollyeah14:00
jrollI was just thinking how to make this simplere14:00
lucasagomesyeah that was my first attempt, to put a lock on that _set_dhcp_provider function14:00
*** linggao has joined #openstack-ironic14:01
lucasagomesjroll, yeah it's not the simplest code to read :/ but races is hard14:01
lucasagomesif we can make it simpler I would +1 it :)14:02
jrollright14:03
jrollso loading on startup would fix the race if you're just running the conductor14:03
jrollbut parallel tests could still break it14:03
lucasagomesjroll, well now I've a lock on the _set_dhcp...14:03
lucasagomesto prevent parallel tests to break it14:03
jrollI think it's fine, it's all in one place14:03
jrollright14:03
jrollwhat you did is fine :)14:04
jrollit's needed to fix parallel tests14:04
lucasagomesyeah14:04
romcheg1I like it the way it is now14:04
romcheg1It's simple enough, as for me14:04
jrolla simpler one line thing would fix the conductor, but not tests14:04
jrollagree14:04
* jroll +2's14:04
lucasagomesyup14:04
lucasagomesyeah... the tests were the problem14:04
lucasagomesparallel tests*14:04
jrollright14:04
*** r-daneel has joined #openstack-ironic14:05
*** chuckC has quit IRC14:08
lucasagomesgate's super slow today :(14:11
*** romcheg1 has left #openstack-ironic14:11
NobodyCam:(14:12
jrolls/today//14:13
Shrewsjroll: lol... i was *just* typing that14:13
Shrewswitch14:13
lucasagomesheh14:13
Shrewsget out of my head14:13
lucasagomesI mean slower than normal14:14
lucasagomes:)14:14
jroll:D14:14
lucasagomesjroll, https://review.openstack.org/#/c/105795/ when you get some time14:16
* jroll rechecks everything to speed the gate up14:16
jrollsure14:16
lucasagomesI'm not very familiar with swift I suppose you may understang it better, but code LGTM14:16
jrollI like to pretend I might know things14:18
*** viktors is now known as viktors|afk14:19
jrolllanded14:20
*** killer_prince is now known as lazy_prince14:22
jrolladam_g: we should land https://review.openstack.org/#/c/112134 soon pls :)14:23
openstackgerritA change was merged to openstack/ironic: Imported Translations from Transifex  https://review.openstack.org/11587814:24
*** jistr has quit IRC14:29
lucasagomesoh14:30
* lucasagomes wonders about we should a gate test for iPXE and all14:31
lucasagomesI think so14:31
NobodyCamjroll: Jenkins -1 that job?14:31
jrollNobodyCam: yeah14:32
jrollNobodyCam: that ping was more like "hey we should fix that and get it landed" :)14:32
NobodyCam:)14:33
*** rainya has joined #openstack-ironic14:40
*** viktors|afk is now known as viktors14:48
*** romcheg1 has joined #openstack-ironic14:52
*** jcoufal has quit IRC14:53
Shrewsadam_g, romcheg1: I left a note on 112402 about the preserve_ephemeral option not being carried over, but I'm not sure if that's a big deal or not since it's doubtful that would be used (don't think rebuild was ever supported for nova bm).14:55
*** chuckC has joined #openstack-ironic14:55
romcheg1adam_g: I'm going to take a look on my patches this evening. Thanks!14:56
NobodyCamShrews: we do need that14:56
romcheg1Whoops, it saw Shrews :)14:56
romcheg1%s/saw/was14:56
NobodyCam:) morning romcheg1 :)14:56
ShrewsNobodyCam: for migration?14:56
romcheg1Good morning NobodyCam!14:56
NobodyCamand Shrews too14:57
lucasagomesany bash expers can explain to me why this works? echo hi > /tmp/data ya ; cat /tmp/data14:57
NobodyCamoh sorry nope ... for rebuild14:57
lucasagomesexpert*14:57
romcheg1lucasagomes: I think it's better poke lifeless about ^14:58
NobodyCamlol wow that neet14:58
lucasagomesyeah14:58
lucasagomessuper weird right? trying to google to understand the reasons, but I don't even know hw to google it14:58
*** jistr has joined #openstack-ironic15:01
*** ndipanov has joined #openstack-ironic15:01
NobodyCamlucasagomes: http://wiki.bash-hackers.org/syntax/redirection not an exact match but take a lok at the discussion stuff on the bottom15:01
* lucasagomes checks15:02
openstackgerritA change was merged to openstack/ironic: Add support for interacting with swift  https://review.openstack.org/10579515:03
openstackgerritSzymon Wróblewski proposed a change to openstack/ironic-python-agent: Remove unnecessary argument injection in agent sync and async decorators.  https://review.openstack.org/11752915:03
lucasagomeslooks like it's just the order things gets evaluated... the redirection runs after so "echo hi > /tmp/data ya" has two pieces "> /tmp/data" which is the redirection and "echo hi ya"... so it runs echo and then the redirection15:04
lucasagomesidk15:04
*** coolsvap has quit IRC15:07
NobodyCamlucasagomes: ya thats my thought on it15:10
NobodyCamlucasagomes: echo > /tmp/data hi ya ; cat /tmp/data also works15:11
lucasagomesyup15:11
lucasagomesyeah... heh just an odd syntax :)15:11
lucasagomesjroll, NobodyCam https://review.openstack.org/#/c/11677215:12
lucasagomeswe gotta sort that, the last patch-set in nova has a -1 because of that I will try to clarify it15:12
NobodyCamI agree with jroll15:14
NobodyCamarch for the nova-compute host is not the right answer for us15:14
NobodyCamwe could default to i386 if not found, but even that seem wrong to me15:15
jrolllucasagomes: we've talked about it a couple times now15:19
jrollI think NotFound is the right thing to do15:19
lucasagomesjroll, right... so I will comment on the nova patch about it15:20
lucasagomeshttps://review.openstack.org/#/c/111425/14/nova/virt/ironic/driver.py15:20
jrolllucasagomes: we also can't use canonicalize() because it's not backwards compat for tripleo15:20
*** coolsvap has joined #openstack-ironic15:20
jroll:(15:20
lucasagomesoh I was about to suggest us to canonicalize that15:20
lucasagomesjroll, but idk if it's a valid point for us15:20
jrollyeah, I tend to agree, but it will make lifeless rage :P15:20
lucasagomesI mean... is it an Ironic problem or an TripleO problem? (sure we need to work that out)15:20
jrollthing is they don't canonicalize the flavor15:21
lucasagomeshmm15:21
jrollso if you have e.g. i386 flavors, those won't match to i386 machines15:21
jrollbecause i386 machines will be read as i68615:21
lucasagomesjroll, right I will add it in the comment as well15:21
jrollok, thanks15:22
NobodyCamawesome TY lucasagomes15:22
jrollmight be good to talk to daniel on irc15:22
jrollcheck queue is over 24 hours15:24
jrollamazing15:24
lucasagomesjroll, +1 to talk to him on IRC15:24
*** HenryG has quit IRC15:28
jrolllucasagomes: https://review.openstack.org/#/c/109590/8/nova/scheduler/filters/image_props_filter.py15:31
jrolllucasagomes: so we can use canonicalize()15:31
jrollactually, have to15:31
lucasagomesoh15:31
lucasagomesalright that's good15:31
*** dlaube has joined #openstack-ironic15:32
lucasagomeswill make our life easier... problem is we don't have any way to say that the arch is unknown >.<15:32
lucasagomesjroll, canonicalize() returns None if the name is None15:33
lucasagomesmaybe we should just leave it as None15:33
lucasagomesif it's unknown15:33
jrolloh huh15:33
*** igordcard has joined #openstack-ironic15:34
*** foexle has quit IRC15:35
NobodyCambrb15:44
jrolllucasagomes: so talking more, we should just not report the node's resources if the arch is unknown15:45
jrollfrom our perspective, that node is unusable15:45
*** igordcard has quit IRC15:46
jrolllucasagomes: going to add a comment on the nova review and probably push up a new ironic review15:47
*** ndipanov has quit IRC15:47
jrollgoing to want mrda and lifeless on board with this stuff ^15:47
lucasagomesjroll, ack, please do15:51
lucasagomesjroll, NobodyCam ... a FYI I just had my report with thierry about J3, I marked the instance-info bp as Implemented even if the tempest is not merged yet15:51
lucasagomesas he instructed me to do so15:51
jroll\o/15:52
*** eghobo has joined #openstack-ironic15:54
openstackgerritRamakrishnan G proposed a change to openstack/ironic: IloVirtualMediaIscsi deploy driver  https://review.openstack.org/11386515:55
*** todd_dsm has joined #openstack-ironic15:55
lucasagomesjroll, so retuning the empty list for supported_instances seems the way to go15:57
jrollaha15:58
jrollI was just trying to figure that out15:58
openstackgerritA change was merged to openstack/ironic: Update API document with BootDevice  https://review.openstack.org/11441516:00
*** lazy_prince is now known as killer_prince16:00
openstackgerritJim Rollenhagen proposed a change to openstack/ironic: Nova review updates for _node_resource  https://review.openstack.org/11677216:02
jrolllucasagomes: ^ needs tests but wdyt16:02
openstackgerritRamakrishnan G proposed a change to openstack/ironic: IloVirtualMediaAgent deploy driver  https://review.openstack.org/11588516:04
*** penick has joined #openstack-ironic16:04
lucasagomesjroll, ah looks simply/good16:05
jrolllucasagomes: fwiw, daniel says it looks good to him16:05
jroll:)16:05
lucasagomesnice one!16:05
lucasagomesalright... will +2 after tests16:05
jrollcool16:05
jrollgimme a few16:06
lucasagomesjroll, np... thanks for that16:06
NobodyCamawesome news lucasagomes TY16:07
openstackgerritVladyslav Drok proposed a change to openstack/ironic: Rewrite images tests with mock  https://review.openstack.org/11754916:10
*** vdrok_ is now known as vdrok16:13
*** foexle has joined #openstack-ironic16:14
openstackgerritJim Rollenhagen proposed a change to openstack/ironic: Nova review updates for _node_resource  https://review.openstack.org/11677216:17
JayFjroll: I thought consensus was to /not/ canonicalize the cpu_arch?16:17
jrolllucasagomes: https://review.openstack.org/#/c/116772/16:17
jrollJayF: read the comments on the nova review, turns out we have to do it16:17
jrollJayF: there's a patch up for nova right now that canonicalizes the arch on the image16:18
lucasagomesjroll, awesome!16:18
lucasagomesjroll, the link on the commit message is wrong16:19
JayFjroll: I don't see anything in that nova review that counteracts the point made yesterday that it will break existing Ironic installs (including ours)16:19
lucasagomesJayF, ^16:19
JayFheh ^ maybe that is why16:19
lucasagomeshttps://review.openstack.org/#/c/111425/1416:19
lucasagomesjroll, I will update it there16:19
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Nova review updates for _node_resource  https://review.openstack.org/11677216:20
*** dguerri_ is now known as dguerri16:20
jrollJayF: https://review.openstack.org/#/c/109590/8/nova/scheduler/filters/image_props_filter.py16:20
jrolllucasagomes: thanks :P16:21
lucasagomesnp heh16:21
*** todd_dsm has quit IRC16:23
NobodyCamjumpping on conf call16:26
*** penick has quit IRC16:27
*** todd_dsm has joined #openstack-ironic16:28
*** igordcard has joined #openstack-ironic16:28
lucasagomesack... I'm heading home now16:30
lucasagomesstill gotta take the train back (came to the office)16:31
lucasagomeshave a good night everybody16:31
*** todd_dsm has quit IRC16:33
*** lucasagomes has quit IRC16:34
*** derekh has quit IRC16:35
JayFmrda: NobodyCam: others, I think I have an issue with https://review.openstack.org/#/c/116772/5 -- we're going to break valid installs of Ironic16:43
JayFbecause if you weren't using the nova filter that looks at arch before16:44
JayFand what you set for arch isn't 'valid' per nova/libvirt standards, and you upgrade, you're going to break your installation pretty badly16:44
JayFcomstud: ^ I moved some of our chatter into here16:44
comstudi'm not sure if there is a filter that looks at this16:45
JayFIt's just hard for me to stomach us breaking some i->j migrations given we're writing code, and bending over backwards, to not break nova-bm->j16:45
openstackgerritDavid J Hu proposed a change to openstack/python-ironicclient: Add keystone v3 CLI support  https://review.openstack.org/11117516:46
*** jistr has quit IRC16:46
comstudi guess it's the compute_capabilities_filter16:47
comstudComputeCapabilitiesFilter16:47
JayFthe filtering doesn't even matter though, afaict it just isn't going to advertise nodes that don't have a "valid" arch16:47
JayFjust to make that one filter work more reliably I guess?16:47
comstudyes it does still advertise them16:47
comstudit catches the error and sets arch to None16:48
JayFcomstud: https://review.openstack.org/#/c/116772/5/ironic/nova/virt/ironic/driver.py,cm it returns an empty list for supported_instances16:48
comstudyeah16:48
comstudthat's not important16:48
JayFwhy not?16:48
comstudI guess the image_props_filter does look at that16:49
comstudit's not important as far as 'advertising the node'16:49
comstudbut16:49
comstudit would break image_props_filter matching for people with certain configs16:50
JayFIf someone set some 'invalid' arch (like lets say 386 vs i386) and was not filtering on arch before16:50
comstudfrom what I can tell16:50
JayFwould their stuff continue to work?16:50
openstackgerritDavid J Hu proposed a change to openstack/python-ironicclient: Add keystone v3 CLI support  https://review.openstack.org/11117516:50
comstudwell16:52
JayFthat's the crux of my concern16:53
comstudas far as I can tell16:53
comstudsupported_instances is supposed to be a dict anyway16:53
comstudand not a list16:53
comstud:)16:53
comstudso it's already broken16:53
comstudtherefore no one must be using it16:53
comstud;)16:53
JayFhah16:53
JayFyou should probably put that on the review then?16:53
comstudi'm going to ask it as a question16:53
comstudbecause i'm not sure16:53
comstudbut that's sure what it looks like16:53
JayFand if that's true, then that means anyone who relied on that would be broken in I?16:53
comstudyou mean J?16:55
comstuder16:55
comstudyeah16:55
comstudI was last release16:55
comstudthe question is... did it even work in I ?16:55
JayFyeah if it never worked in I16:55
JayFthen my concern is completely out the window16:55
comstudyeah16:56
*** lsmola has quit IRC16:56
comstudlooking at this image filter in nova16:56
comstudi'll show you what AI'm looking at here16:56
comstudhttps://github.com/openstack/nova/blob/master/nova/scheduler/filters/image_props_filter.py#L7916:56
comstudhttps://github.com/openstack/nova/blob/master/nova/scheduler/filters/image_props_filter.py#L6516:56
comstudactually, maybe this is just comparing values16:57
comstudnevermind16:57
comstudSo I guess this is a tuple16:57
comstudhttps://github.com/openstack/nova/blob/master/nova/scheduler/filters/image_props_filter.py#L4716:57
comstudthat's just... weird.16:57
comstudWell, ignore everything I just said16:57
JayFI'd be interested in your opinion about whether or not it's OK to break in this way?16:58
*** eghobo has quit IRC16:59
comstudgenerally i do not think this is okay16:59
*** eghobo has joined #openstack-ironic16:59
JayFcan you think of a way to satisfy the nova core's concern without breaking?16:59
JayFbecause I'm at the point of I don't think we should make that change16:59
JayFbut I don't know how to appease the nova reviewers without it16:59
JayFI actually think an arch of unknown or None should be okay :/17:00
comstudI don't know.. I"m a nova core17:00
comstudI left a -1 on this17:00
comstudi'm not sure who you were referring to17:00
JayFI know you are, that's why I wanted your opinion :)17:00
comstuddberrange?17:00
JayFyeah, I just couldn't remember the name17:00
JayFheh17:00
comstudhe probably didn't understand there's a behavior change here17:02
comstudi mean17:02
comstudthat it would stop making image props filter match things depending on ppls configs17:02
*** harlowja_away is now known as harlowja_17:03
*** harlowja_ is now known as harlowja_away17:04
*** penick has joined #openstack-ironic17:06
*** harlowja_away is now known as harlowja_17:09
*** penick has quit IRC17:09
kylestevthis is really starting to piss me off, anyone know what's up? https://gist.github.com/kylestev/8446116d75b42bf339fc17:12
JayFthat usually means you need to rebase to get some requirements.txt changes17:13
JayFthe actual diff of the config files usually can tell you the culprit17:13
JayFi.e. "oh this is missing some swiftclient config" means you probably have a newer/older swiftclient than you should17:13
kylestevhmmmmm17:14
JayFactually it looks like your check_uptodate script might be broken17:14
JayFare you running that on mac or on linux?17:14
JayFand if on mac, are you sure it's supposed to work there17:14
kylestevoh dammit...17:14
kylestevi do my git workflow on my mac but run tests on my vm... that is likely the culprit17:15
kylestevJayF: I feel really stupid, but thank you for pointing out the issue :)17:15
JayFno problem17:16
openstackgerritKyle Stevenson proposed a change to openstack/ironic: Add implementation of pluggable distributed sync  https://review.openstack.org/11514817:19
*** dguerri is now known as dguerri`afk17:20
*** igordcard has quit IRC17:28
*** penick has joined #openstack-ironic17:33
openstackgerritKyle Stevenson proposed a change to openstack/ironic: Add implementation of ZooKeeper SyncManager  https://review.openstack.org/11757617:37
*** bandicot has joined #openstack-ironic17:41
*** bandicot is now known as bensonmiller17:41
*** shakamunyi has joined #openstack-ironic17:41
openstackgerritKyle Stevenson proposed a change to openstack/ironic: Add implementation of ZooKeeper SyncManager  https://review.openstack.org/11757617:41
openstackgerritKyle Stevenson proposed a change to openstack/ironic: Add implementation of pluggable distributed sync  https://review.openstack.org/11514817:41
*** dtantsur is now known as dtantsur|afk17:52
*** viktors is now known as viktors|afk17:54
openstackgerritAdam Gandelman proposed a change to openstack/ironic: Script to migrate Nova BM data to Ironic  https://review.openstack.org/11240217:58
*** pelix1 has quit IRC17:59
*** romcheg1 has quit IRC18:08
*** romcheg1 has joined #openstack-ironic18:14
*** romcheg1 has quit IRC18:14
Shrewsack-grep tells me that we don't actually use the INIT ironic state18:23
* Shrews wonders if we should/ever did18:25
*** romcheg1 has joined #openstack-ironic18:26
Shrews... "Any node with non-empty `properties` is said to be "initialized", and the state is INIT.' ...18:27
JayFwait we have a state called INIT?18:28
JayFI've never seen that in the real world :)18:28
*** romcheg1 has joined #openstack-ironic18:29
adam_gShrews, is that grepped from nova or ironic?18:42
Shrewsironic18:42
Shrewsnova driver doesn't use it either18:42
Shrewsi can't imagine any other part of nova outside of the driver referencing it18:43
*** todd_dsm has joined #openstack-ironic18:44
*** todd_dsm has quit IRC18:44
*** romcheg1 has left #openstack-ironic18:47
*** ramineni has quit IRC18:52
NobodyCambrb18:56
adam_gShrews, i came across this last week, https://review.openstack.org/#/c/103402/19:01
Shrewsadam_g: oh, good find19:04
adam_goh cool. looks like eventlet released 0.15.1 with the fix for our paramiko issue19:06
*** penick has quit IRC19:06
lifelessjroll: +1 on not exporting unknown arch nodes.19:08
lifelessjroll: but19:08
lifelessjroll: what happens if a user makes the arch unnknown after instance is on a node19:08
*** penick has joined #openstack-ironic19:12
*** openstackgerrit has quit IRC19:31
*** openstackgerrit has joined #openstack-ironic19:33
NobodyCambrb19:34
JayFquick+easy ironic-specs review, just some cleanup in requirements.txt from the docs team, needs +2a --> https://review.openstack.org/#/c/117180/219:40
JayFdtantsur|afk: ^ you had originally +2'd that, but it had to be rebased19:40
*** penick has quit IRC19:55
*** penick has joined #openstack-ironic19:59
NobodyCamJayF: LGTM +a'd20:05
NobodyCamhave to run in to town... bbaib20:09
openstackgerritA change was merged to openstack/ironic-specs: Remove docutils pin  https://review.openstack.org/11718020:09
*** bensonmiller has quit IRC20:09
NobodyCamJayF: ^^^^^^20:11
JayFty20:12
*** foexle has quit IRC20:32
*** bandicot has joined #openstack-ironic20:40
*** penick has quit IRC21:06
* NobodyCam is back21:06
*** linggao has quit IRC21:09
*** penick has joined #openstack-ironic21:12
*** foexle has joined #openstack-ironic21:15
*** dhellmann is now known as dhellmann_21:17
mrdaMorning Ironic21:19
mrdajroll, JayF: I'm just thinking of abandoning 11677221:20
JayFMy primary objection is that is has a likelyhood of breaking working--although possibly semantically invalid--ironic installations21:21
mrdaSo there's enough heat on https://review.openstack.org/#/c/111425/14/nova/virt/ironic/driver.py to suggest we are going to have to do *something*21:24
JayFmy suggestion: if arch.canonicalize() can't resolve an arch21:25
mrdaWhat do you think of canonicalize() but no support for 'NotFound'.  i.e. not returning an arch21:25
JayFit should spit out an arch that indicates unknown21:25
JayFor None or something along those lines21:25
JayFso that the people who are working will continue working similar to how they are now21:25
JayFeither that or we eat the breakage21:25
JayFI just wanted to make damn sure we didn't break people without it being *well known* we could be breaking existing installs21:25
JayFespecially after the gymnastics that have been done to not-break nova bm21:26
mrdaSo dan b's comment is that there's no unknown arch.  So we shouldn't add it to extra_specs21:26
mrdawhich will result in that node not being scheduled21:26
JayFSo if we make an unknown arch, we solve the problem, right?21:26
JayFheh21:26
JayFjroll actually put a patch into nova to avoid this impacting our install21:27
JayFbecause all the nodes for our stuff have arch in the db as 'amd64'21:27
mrdaI agree with Matt's comments.  Ifd we don't know the arch we shouldn't be scheduling paying customers to that node21:27
JayFhttps://review.openstack.org/#/c/117555/21:27
JayFmrda: I think it's one of those situations where all choices are wrong. That's why my comment didn't come with a -121:28
mrdaWell, if we don't cvome up with a solution, this won't merge and we'll be aiming for K21:28
mrdaI think what I'm going to propose is this:21:31
mrdacpu_arch = str(node.properties.get('cpu_arch', 'NotFound'))21:32
mrdaif cpu_arch == 'NotFound':21:32
mrda  LOG.error("You have a borked node ${node}", node.uuid)21:33
mrda  cpu_arch = ""21:33
mrdaor a more pythonic equivalent21:34
JayFso still advertise the node or not?21:34
JayFer, I mean, capablities going to be [] or ["", baremetal, baremetal]21:34
mrdaSo this will push the problem along.21:35
openstackgerritA change was merged to openstack/ironic: Fix unit tests with keystoneclient master  https://review.openstack.org/11731421:35
mrdaIf we want to schedule a node where the arch is "", then the sched can make that choice.21:36
JayFI like that solution much better, but I wonder if it'd be acceptable to daniel21:36
mrdaWe shall see21:37
mrdathe problem I face, from a process perspective, is that I should really be pitching this to Ironic first to get all of our agreements, but the ones I need to satisfy are the nove reviewers with issues21:38
JayFI'd hope the reviewers would try and help out by making comments in irc (here) if they see an issue21:39
JayFbut it doesn't appear that's going to be the case21:39
JayFit's just hard to "push" the conversation when people don't seem to want to take the time other than in gerritt21:39
mrdaI think the best I can do is to subscribe ironic peeps to the patch in Nova21:40
NobodyCammorning mrda21:42
mrdahey NobodyCam21:42
NobodyCamwhat review21:43
NobodyCam11677221:45
mrdaya21:46
mrdaNobodyCam: the problem is that we can discuss things in ironic, but nova has some big opinions over in https://review.openstack.org/#/c/111425/14/nova/virt/ironic/driver.py21:47
mrdaNobodyCam: Any soluytion we come up with is unlikely to be accepted in the Nova review, so we might as well debate it over there.21:47
mrdaNobodyCam: thoughts?21:47
NobodyCamWe don't want paying customers scheduled to boxes that can't actually service the request21:48
NobodyCami just dont get that21:48
NobodyCamstill reading up21:49
lifelessmrda: sadface21:52
mrdalifeless: jump in if you want21:53
mrdalifeless: but we need a resolution21:53
mrdatoday21:53
mrdaT-5 until J closes21:54
NobodyCammrda: is Daniel on in #nova21:56
JayFi don't think so, looking at /names21:56
*** chuckC has quit IRC21:56
* mrda is looking21:57
NobodyCamya21:57
lifelesscommented21:58
lifelessso not advertising unknown arch nodes got a +121:58
lifelessfrom berrange21:58
lifelessjroll: scheduler canonicalises now, or will sooin ?21:58
lifelessjroll: I'd argue that if the scheduler filter will *start* canonicalising soon, then when it does the ironic driver should, but not before because it will be broken in the interim,21:59
JayFlifeless: jroll is OOO right now, but we're all still talking about that patch21:59
openstackgerritKyle Stevenson proposed a change to openstack/ironic: Add implementation of ZooKeeper SyncManager  https://review.openstack.org/11757622:02
JayFlifeless: also myself and comstud went through some scenarios earlier; some people with working installs now (including mine) will break even if both sides canonicalize22:03
JayFlifeless: if you were not using a scheduler that cared about arch + you put in an arch that isn't in nova's class (like we did; amd64)22:04
JayFlifeless: obviously someone can fix the DB before upgrade; but it's still something that can break a working (arguably invalid, though) install of ironic22:04
lifelessJayF: oh, canonicalise tossesout things it doesn't recognise rather than failing open?22:04
JayFit returns None if not known22:05
lifelessugh22:05
lifelessstabbity stab stab22:05
JayFwhich 116772 would essentially discard22:05
JayFexactly22:05
lifelessthis will break tripleo definitely then22:05
JayFit's being reviewed as if it's 'new code' but it's been running in peoples' environments for a long time22:05
lifelesswhy exactly is Nova doing this?22:05
JayFRead the review? I'm not sure I get it other than a drive for correctness22:05
JayF'correctness'22:05
JayFall this chatter happening here -> https://review.openstack.org/#/c/111425/14/nova/virt/ironic/driver.py22:06
JayFwhich you have comments on so obv you've read it22:06
NobodyCamthat seems > feature parity22:06
NobodyCamhttps://github.com/openstack/nova/blob/master/nova/virt/baremetal/driver.py#L145-L15322:07
comstudJayF: thought we were in sync... our install will not break22:09
comstudunless you have your own install somewhere that will break22:10
comstudthat you're referring to22:10
comstud:)22:10
JayFcomstud: hm, okay, I didn't understand what you meant then22:10
comstudwe do not use any of the capability or image property mappings22:10
comstudmatchings22:10
comstudfilters22:10
JayF10-422:10
comstudbut yes, this would certainly break people that do and have broken arch names22:11
comstudi think it's limited to the image property filter from what I saw22:11
comstudie, someone configured "mybogusarch" for cpu_arch in ironic... had the image property sched filter loaded... and had images with "mybogusarch" set for the image 'architecture' property..22:12
comstudthey'd see things break22:12
comstud+if someone22:12
NobodyCamok heres a thought, could we use the argument that 116772 would break current nova-bm installs that want to mirgrate to Ironic22:21
NobodyCams/would/could/22:21
mrdaSo lifeless, data migration patches welcoemd :)22:21
JayFlifeless: also fwiw --> https://review.openstack.org/#/c/117555/22:22
JayFlifeless: I had no idea 'amd64' was used by others. Nice to know :)22:22
NobodyCamshould try and get folks in #nova?22:25
mrdaNobodyCam: they've just finished a meeting, so likely to be around22:26
*** chuckC has joined #openstack-ironic22:26
NobodyCam:)22:26
lifelessJayF: ./scripts/configure-tripleo~:        export NODE_ARCH=amd6422:27
lifelessJayF: we use that an i38622:27
mrdabbs, schoolrun22:29
mrda.22:33
NobodyCam:)22:37
NobodyCamso I guess no one in nova up for chatting22:44
NobodyCam:(22:44
mrda:(22:45
NobodyCamthis looks like fun: but not sure how to get my car there22:47
NobodyCamhttp://www.dubaiautodrome.com/da-track-days-cars-bikes/22:47
openstackgerritA change was merged to openstack/ironic: Updated from global requirements  https://review.openstack.org/11742322:47
*** bandicot has quit IRC22:48
NobodyCambrb22:49
NobodyCammrda: are you back23:01
mrdayup23:02
mrdaNobodyCam: ^^23:02
NobodyCamwhats your thought for our game plan if noone in #nova wants to chat?23:02
mrda1) I think discussion should take place on the Nova patch itself23:03
mrda2) I'm thinking of pushing a patch that doesn't set cpu_arch if it's not defined (aka not use NotFound)23:04
mrda3) But will use canonicalize() if it is set23:04
NobodyCamoh23:04
mrdaSo I understand the scheduler won't like cpu_arch not being set, currently23:05
mrdaBut I do agree with Matt Diaz's comment that if we don't know what a node's cpu_arch is, we probably don't want to be scheduling workloads to it23:05
NobodyCambut that what nova bm dose : https://github.com/openstack/nova/blob/master/nova/virt/baremetal/driver.py#L145-L15323:05
* mrda look23:05
mrdas23:05
mrdaok, so we could do likewise23:06
NobodyCamya23:07
NobodyCamits whats there23:07
NobodyCamnow23:07
mrdaI think that node will be ignored in scheduling though23:07
NobodyCamwhich may not be a bad thing23:07
mrdaagreed23:07
JayFit's ignored in scheduling IF you're using one of the schedulers that look at that23:08
mrdaso jroll's patch to alias x86_64 to amd64 will help with the canonicalize23:08
mrdabut there still might be some pain here23:08
mrdaI think what we've discussed now is worth putting a patch up for23:09
mrdaand seeing what people think of that23:09
NobodyCammrda: +123:09
mrdaT-5 and all that :)23:09
NobodyCam1066 and all that?23:10
NobodyCamlol23:10
* mrda has missed the reference23:10
mrdaT-5 days until Nova freezes for J23:10
NobodyCamhttp://en.wikipedia.org/wiki/1066_and_All_That23:11
* mrda looks23:11
NobodyCamlol :)23:11
mrda:)23:14
NobodyCammrda: adding a note to 116772 to address concerns to 11142523:15
mrdaThanks NobodyCam - I'll probably backport 111425 into 116772 so the drivers continue to be consistent23:16
NobodyCamack until then just trying to get everyone on the same review :)23:17
mrda:)23:20
*** bandicot has joined #openstack-ironic23:25
*** penick has quit IRC23:25
*** shakamunyi has quit IRC23:33
*** bandicot has quit IRC23:36
*** openstackgerrit has quit IRC23:46
*** openstackgerrit has joined #openstack-ironic23:48

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!