Friday, 2014-07-18

openstackgerritChris Jones proposed a change to openstack/ironic: Do terrible things to support graceful shutdowns on rebuild().  https://review.openstack.org/10786400:14
NobodyCamlol love th title00:14
mrdalol00:15
mrda*that* will get lots of review out of curiosity sake00:15
Ngdamn00:16
NgI should re-push with some kind of enterprise buzzword nightmare that puts everyone to sleep00:17
Ngcommit messages could do with a "Gerrit: pleae don't shame me on IRC for this" flag00:17
NobodyCamlol00:18
NobodyCamand it really not so terrible00:18
NobodyCamwe never had anything in the design to support multiable modes for off00:19
NobodyCamNg: if your are pushing a better commit message. may be add some about why its needed...00:20
openstackgerritChris Jones proposed a change to openstack/ironic: Hack to support graceful shutdowns on rebuild().  https://review.openstack.org/10786400:23
NgNobodyCam: expanded the full commit to be clear about what's going on00:23
NobodyCam:) do you have a ironic power off corupts mysql datebases bug filed?00:24
* NobodyCam makes air quotes00:24
NobodyCam* ironic rebuild with --perserve-ephemeral power off corupts mysql datebases bug filed?00:26
NgNobodyCam: we have https://bugs.launchpad.net/tripleo/+bug/131705600:28
Ngwhich is fs corruption00:28
devanandaarriving in portland. see ya'll later00:29
mrda\o00:32
lifelessNobodyCam: around ?00:33
lifelessNobodyCam: so thi soft power thing00:35
lifelessNobodyCam: I think it would be a lot simpler to just change all the power off code paths00:35
lifelessNobodyCam: to try soft first for several retries and then do a hard00:36
NobodyCamlifeless: that would slow down power offs quite a bit00:40
lifelessNobodyCam: in the short term - can always add a soft-only thing in future00:40
lifelessNobodyCam: only if the OS is ignoring ACPI messages00:40
lifelessNobodyCam: there's no reason we can't make the ramdisk respond instantly00:40
*** rloo has quit IRC00:41
NobodyCami can see a case where it could make things worse.. ie.. sends soft, node starts to shut down(writting to disk), soft off times out and then hard offs in the middle of the disk io00:41
lifelessNobodyCam: node might be writing anyway00:43
NobodyCamif the soft was in its own code path like in ng patch it could wait longer only for soft offs00:44
*** Haomeng|2 has joined #openstack-ironic00:48
* jroll votes for soft power off only if instance_uuid is not None00:48
*** Haomeng has quit IRC00:49
jrollquestion00:49
jrolldo we expect that the user will never issue a hard shutdown from the OS?00:50
jrollseems like a really bad assumption00:50
mrdajroll: agreed00:53
*** nosnos has joined #openstack-ironic00:53
jrollI have a provisioned node with "last_error": "During sync_power_state, max retries exceeded for node 7856316a-45ab-46da-8d8c-0df3ca040d40, node state None does not match expected state 'power on'. Updating DB state to 'None' Switching node to maintenance mode.",00:55
jrollguessing that's what happened00:56
jrollbut have not investigated00:56
jrolloh, maintenance=True, so that's not the issue here... but made me think about it00:56
jroll:)00:56
lifelessjroll: nice tweak00:58
lifelessjroll: if the user shuts down the OS themselves, their business00:58
jrolllifeless: I mean, maintenance is set to True, which means we were likely poking at it manually :)00:59
jrolllifeless: my problem is that ironic will power it back on if they shut it down00:59
jrollwhich is clearly not desirable00:59
lifelessjroll: sure, but they can call halt()01:01
lifelessjroll: rather than poweroff01:01
jrollas in, 'nova stop' or whatever?01:02
lifelessman halt01:02
lifelesshalt stops everything but doesn't power off01:02
lifelessthen nova stop01:02
lifelessto turn it off01:02
lifelessbut you said this is the non-nova case (in maintenance)01:03
lifelessso we should expect ironic node-set-power-state01:03
jrolloh, right01:03
jrollI'm talking about the non-maintenance case01:03
jrollwhere a user01:03
jrollcalls nova boot01:04
jrolland then wants to shut the server down01:04
jrollbut doesn't know intimately (or at all) how our control plane works01:04
jrolland they do what they know01:04
jrollwhich is run 'sudo shutdown'01:04
*** geekyogi has quit IRC01:08
*** rainya has joined #openstack-ironic01:17
lifelessjroll: so, same thing as with nova and kvm or xen, right ?01:27
lifelessjroll: or does nova/kvm know that the user requested poweroff via ACPI ?01:28
jrollI would assume the hypervisor knows01:28
jrollmaybe01:28
jrollidk01:28
jrollI need to look into this more... mostly thinking out loud01:28
mrdait's interesting f'sure01:29
jrollI gotta run, night y'all01:29
mrdajroll: \o01:30
*** rainya has quit IRC02:15
*** killer_prince has quit IRC02:17
*** radsy has quit IRC02:33
*** pcrews has quit IRC02:53
*** Poornima has joined #openstack-ironic03:03
*** nosnos has quit IRC03:21
*** jcoufal has quit IRC03:21
*** killer_prince has joined #openstack-ironic03:23
*** killer_prince is now known as lazy_prince03:23
*** harlowja is now known as harlowja_away03:28
lifelessNobodyCam: so that deallocate bug fix is buggy03:31
lifelessinstance['node'] is raising, I think. digging atm03:31
openstackgerritMichael Davies proposed a change to openstack/ironic: Review fixes from the Nova driver reviews  https://review.openstack.org/10788203:45
*** nosnos has joined #openstack-ironic03:50
*** Haomeng has joined #openstack-ironic03:51
*** Haomeng|2 has quit IRC03:52
openstackgerritMichael Davies proposed a change to openstack/ironic: Review fixes from the Nova driver reviews  https://review.openstack.org/10788203:54
*** krtaylor has joined #openstack-ironic03:55
*** hemna has quit IRC03:55
*** vinbs has joined #openstack-ironic04:14
*** ramineni has joined #openstack-ironic04:27
*** Haomeng|2 has joined #openstack-ironic04:33
*** Haomeng has quit IRC04:34
*** bvivek has joined #openstack-ironic04:49
*** geekyogi has joined #openstack-ironic05:00
*** geekyogi has quit IRC05:13
*** rakesh_hs has joined #openstack-ironic05:16
*** k4n0 has joined #openstack-ironic05:30
*** shausy has joined #openstack-ironic05:36
*** pcrews has joined #openstack-ironic05:38
*** pcrews has quit IRC05:50
*** bmahalakshmi has joined #openstack-ironic06:08
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ironic: Imported Translations from Transifex  https://review.openstack.org/10694806:11
*** Mikhail_D_ltp has joined #openstack-ironic06:13
*** rameshg87 has joined #openstack-ironic06:47
rameshg87dtantsur|afk: i have some questions regarding image cache in here06:48
rameshg87dtantsur|afk: i can't make out this method completely here.  https://github.com/openstack/ironic/blob/master/ironic/drivers/modules/pxe.py#L266-L295 . i feel there is a bug here :-)06:48
rameshg87dtantsur|afk: please ping when you are available06:48
lifelessrameshg87: what do you think is wrong?06:50
rameshg87lifeless: hai06:52
rameshg87lifeless: i was just trying to make sense from the code, i am just missing something here06:52
rameshg87lifeless: i think we are trying to cleanup as much space as required for the images in this method. in here, we try to cleanup the mentioned cache first, and then try to cleanup all other caches until we have enough spec06:53
rameshg87lifeless: s/spec/space06:53
rameshg87lifeless: am i correct ?06:53
rameshg87lifeless: have a look at this line first: https://github.com/openstack/ironic/blob/master/ironic/drivers/modules/pxe.py#L28406:53
rameshg87lifeless: shouldn't this have been free += _free_disk_space_for(cache_to_clean.master_dir)06:54
rameshg87lifeless: because we should keep on adding to free until we cross over total_size06:54
lifelessI believe you are right06:55
lifelessmmm possibly06:55
lifelessactually no06:55
lifelesscache is the cache we're going to be writing to06:55
*** Haomeng has joined #openstack-ironic06:55
lifelesswe don't know if all caches are on the same fs06:55
lifelessso we can't assume that free space is additive06:55
rameshg87lifeless: oh, so we read the free space again and again.06:56
*** Haomeng|2 has quit IRC06:56
lifelesshowever06:56
lifelessthe caches = line06:56
lifelessdoes check st_dev06:56
lifelessso we could in principle be smarter06:56
lifelessbut06:56
lifelessit still wouldn't be additive06:56
lifelesswith the current code, direct reading of free space is correct06:57
rameshg87lifeless: ah okay, i get it.06:57
rameshg87lifeless: but why would we want to free up TFTPImageCache() when we want more space on InstanceImageCache()06:58
rameshg87lifeless: assuming they are on the same fs ?06:58
lifelessso I'm not sure cleaning up files from the TFTP root is ever right06:59
lifelessits not a cache after all06:59
lifelessits working state06:59
lifelessdtantsur|afk: ^06:59
lifelessrameshg87: the guard on line 275 means that we only try to cleanup (here) if there is not enough space to download the files for the image.07:00
*** foexle has joined #openstack-ironic07:00
lifelessrameshg87: I think the theory when this was written was that we should try hard to make space07:00
rameshg87lifeless: i think because it compares st_dev of both the caches, it hopes we can cleanup some space from the other cache if they are onthe same mount07:00
rameshg87lifeless: okay07:00
lifelessrameshg87: which I agree with except for the tftp root being files that belong to instances - deleting them breaks instance ability to boot07:00
rameshg87but lifeless we delete only the files with link count == 107:01
rameshg87https://github.com/openstack/ironic/blob/master/ironic/drivers/modules/image_cache.py#L25607:02
rameshg87lifeless: so in effect we delete only the files which are not being used.07:02
lifelessoh, you have better eyes than me:)07:07
lifelessthanks for unconfusing me07:07
lifelessit is a cache07:07
rameshg87lifeless: :-)07:08
rameshg87dtantsur|afk: code looks alright and everything makes sense. no need to ping back :-)07:08
rameshg87thanks lifeless for helping to understand :-)07:09
*** ndipanov has joined #openstack-ironic07:13
*** Haomeng|2 has joined #openstack-ironic07:13
rameshg87dtantsur|afk: i just have an idea how we can move _cleanup_caches_if_required to image_cache07:14
rameshg87dtantsur|afk: https://github.com/openstack/ironic/blob/master/ironic/drivers/modules/pxe.py#L267-L27007:14
*** Haomeng has quit IRC07:15
rameshg87dtantsur|afk: will ping you when you are back07:15
*** lazy_prince is now known as killer_prince07:15
openstackgerritMichael Davies proposed a change to openstack/ironic: Review fixes from the Nova driver reviews  https://review.openstack.org/10788207:24
*** geekyogi has joined #openstack-ironic07:25
*** romcheg has joined #openstack-ironic07:32
*** romcheg has quit IRC07:44
*** killer_prince has quit IRC07:48
*** bvivek has quit IRC07:48
*** jistr has joined #openstack-ironic07:56
*** ifarkas has joined #openstack-ironic07:59
*** killer_prince has joined #openstack-ironic08:01
*** killer_prince is now known as lazy_prince08:01
*** Dafna has joined #openstack-ironic08:05
*** jcoufal has joined #openstack-ironic08:12
*** Dafna is now known as Dafna_away08:15
*** bvivek has joined #openstack-ironic08:15
*** dtantsur|afk is now known as dtantsur08:16
dtantsurMorning Ironic! I will be started somewhat later today - Czech lessons08:16
dtantsurrameshg87, will definitely answer your questions, when I'm back :)08:17
*** athomas has quit IRC08:17
dtantsurlifeless, right, only files that are not in use are considered for cleaning up08:18
*** derekh_ has joined #openstack-ironic08:19
*** geekyogi has quit IRC08:20
*** geekyogi has joined #openstack-ironic08:20
*** geekyogi has quit IRC08:22
*** geekyogi has joined #openstack-ironic08:23
*** geekyogi is now known as yogib8808:24
*** yogib88 has quit IRC08:26
*** lucasagomes has joined #openstack-ironic08:28
*** athomas has joined #openstack-ironic08:30
mrdaHave a good weekend Ironic - see you Monday!08:34
*** mrda is now known as mrda-weekend08:34
*** bowdeng_hp has joined #openstack-ironic08:48
rameshg87thanks dtantsur08:48
*** mordred has quit IRC08:54
*** datajerk has quit IRC08:59
rameshg87lucasagomes: request you to take a look at https://review.openstack.org/#/c/89500/ , we just did some minor changes from dtantsur comments from where you had approved :-)09:02
*** mordred has joined #openstack-ironic09:14
*** mordred has quit IRC09:14
*** mordred has joined #openstack-ironic09:14
lucasagomesrameshg87, will do09:18
rameshg87thanks lucasagomes :-)09:19
*** Haomeng has joined #openstack-ironic09:21
*** pelix has joined #openstack-ironic09:22
rameshg87yuriyz: hello09:22
*** Haomeng|2 has quit IRC09:22
yuriyzrameshg87 hello09:23
rameshg87yuriyz: thanks for the review for IloPower09:23
rameshg87yuriyz: just saw your comment "I plan also test with hardware."09:23
rameshg87yuriyz: wondering if you already have hp proliant machines :-)09:23
yuriyzI will get access to ILO server on next week09:24
rameshg87yuriyz: ah okay.09:24
rameshg87yuriyz: which model is it ? we test on proliant gen 8 server which has ilo 409:24
yuriyzI dont know now09:25
rameshg87yuriyz: okay. :-)09:25
*** martyntaylor has joined #openstack-ironic09:28
*** datajerk has joined #openstack-ironic09:43
*** Dafna_away is now known as Dafna09:50
*** Haomeng|2 has joined #openstack-ironic09:59
*** Haomeng has quit IRC10:00
*** Alexei_9871 has joined #openstack-ironic10:07
openstackgerritA change was merged to openstack/ironic: Add methods to ipmitool driver  https://review.openstack.org/10036410:08
*** jcoufal has quit IRC10:10
*** jcoufal has joined #openstack-ironic10:11
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ironic: Updated from global requirements  https://review.openstack.org/10656910:37
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ironic-python-agent: Updated from global requirements  https://review.openstack.org/8872210:37
derekh_I'm seeing a few tripleo/ironic CI failures with : 2014-07-18 09:00:46.577 | OUTPUT=SSH connection cannot be established: Failed to establish SSH connection to host 192.168.1.154. (HTTP 400)10:41
derekh_http://logs.openstack.org/42/99242/11/check-tripleo/check-tripleo-ironic-undercloud-precise/796b48b/console.html10:42
derekh_Are these because of bug 132178710:42
derekh_and if so any idea when the newer version of eventlet will be out10:42
lucasagomesderekh_, anyway we can see the logs of the ir-cond? I think there u can figure out if u hit that paramiko problem10:48
lucasagomesthe error is vague it could also be some problem with the ssh key (tho very unlike)10:49
derekh_lucasagomes: yup, here http://logs.openstack.org/42/99242/11/check-tripleo/check-tripleo-ironic-undercloud-precise/796b48b/logs/seed_logs/10:50
*** martyntaylor has quit IRC10:50
derekh_lucasagomes: it doesn't contain the traceback in the bug but I thought this may be a different manifestation of the same bug10:50
lucasagomesyeah :(10:50
lucasagomesit doesn't seem to be in debug mode as well10:51
lucasagomesthis eventlet problem is a bit broad, I know there was one guy looking at it10:51
lucasagomesbut if there's no new release fixing it soon we may want to work that around in the ironic code10:52
lucasagomesby adding some locks between the ssh calls10:52
derekh_lucasagomes: ok, thanks10:58
*** martyntaylor has joined #openstack-ironic11:03
*** nosnos has quit IRC11:03
*** ramineni has quit IRC11:04
*** Haomeng has joined #openstack-ironic11:10
*** Haomeng|2 has quit IRC11:11
*** Haomeng|2 has joined #openstack-ironic11:15
yuriyzrameshg87: I got the server today, ilo power driver tested11:16
rameshg87yuriyz: great :-)11:16
rameshg87yuriyz: which model is it ?11:16
*** Haomeng has quit IRC11:16
yuriyzProLiant ML110 G7 iLO 3 Advanced11:17
*** Poornima has quit IRC11:17
* dtantsur is back11:17
rameshg87yuriyz: okay11:18
*** martyntaylor has left #openstack-ironic11:31
*** romcheg has joined #openstack-ironic11:40
rameshg87dtantsur: are you back, have some time for a query11:40
dtantsurrameshg87, sure11:41
rameshg87dtantsur: okay11:41
rameshg87dtantsur: regarding this comment, https://github.com/openstack/ironic/blob/master/ironic/drivers/modules/pxe.py#L267-L27011:41
rameshg87dtantsur: i hope it was put by you :-)11:41
rameshg87dtantsur: even i would like to move this method to image_cache which seems its appropriate place11:42
dtantsurrameshg87, yes, the comment does not lie :)11:42
rameshg87dtantsur: okay, can't we do it this way:11:42
dtantsurrameshg87, my problem is: how are you going to assure, that Instance cache is cleared before TFTP cache?11:42
rameshg87dtantsur: python provides __sub_classes__() for a class to find out what are its subclasses11:42
rameshg87dtantsur: oh that is a problem ..11:43
rameshg87dtantsur: so had you previously considered getting all the subclasses and then examining them11:43
dtantsurrameshg87, my main point is that it makes much more sense to clear instance cache, as it's large and instances are free to cleaning after deploy, not after tear_down11:43
rameshg87dtantsur: we can find out all the subclasses of ImageCache using ImageCache.__sub_classes()11:44
rameshg87dtantsur: why don't have a property in InstanceImageCache and TFTPImageCache11:44
rameshg87dtantsur: say for InstanceImageCache, we have use_for_global_cleanup = 111:45
rameshg87dtantsur: say for TFTPImageCache, we have use_for_global_cleanup = 211:45
rameshg87dtantsur: and we figure out all subclasses and sort them11:45
dtantsurrameshg87, that may work... a bit too implicit for me though... Anyway, that will require a spec. Wanting to come up with one?11:45
dtantsurI will be glad to discuss it11:46
rameshg87dtantsur: so that without hardcoding the inherited classes in the method, we can have an ordered list of classes ..11:46
rameshg87dtantsur: okay ..11:46
rameshg87dtantsur: i can come up with one ..11:46
rameshg87dtantsur: i hope new specs won't be freezed :-)11:46
dtantsurrameshg87, freeze is on 24th, IIRC11:46
dtantsuror 25th11:47
*** lucasagomes is now known as lucas-hungry11:47
dtantsurin ~ a week11:47
rameshg87dtantsur: okay ..11:47
rameshg87dtantsur: i can do it today itself ...11:47
rameshg87dtantsur: thanks ..11:47
*** bmahalakshmi has quit IRC11:48
openstackgerritImre Farkas proposed a change to openstack/ironic-specs: DRAC vendor passthru for RAID management  https://review.openstack.org/10798111:54
openstackgerritImre Farkas proposed a change to openstack/ironic-specs: DRAC vendor passthru for RAID management  https://review.openstack.org/10798111:55
*** ramineni has joined #openstack-ironic11:58
*** jdob has joined #openstack-ironic12:04
*** vinbs has quit IRC12:12
openstackgerritRamakrishnan G proposed a change to openstack/ironic-specs: Refactor cleanup image cache in pxe driver  https://review.openstack.org/10799612:41
rameshg87dtantsur: i have raised a review to do the refactor that we discussed a while back12:42
rameshg87dtantsur: https://review.openstack.org/#/c/107996/1/specs/juno/refactor_cleanup_image_cache.rst12:42
rameshg87dtantsur: please have a look at it when you have some time12:42
openstackgerritA change was merged to openstack/ironic: Add IloDriver and its IloPower module  https://review.openstack.org/8950012:42
dtantsurrameshg87, btw ^^^12:42
dtantsur:)12:42
rameshg87dtantsur: :-)12:43
dtantsurrameshg87, re new spec, please make commit message a bit more specific, just "refactor" is too vague. Will give it more attention a bit later...12:43
dtantsurFolks, anyone to approve https://review.openstack.org/#/c/102506/ ? Already has 2x +2!12:44
rameshg87dtantsur: okay, will do that ..12:50
NobodyCamlifeless: Re: buggy deallocate what did you find12:53
*** d0ugal has quit IRC12:53
openstackgerritRamakrishnan G proposed a change to openstack/ironic-specs: Move code to cleanup ImageCache to a common place  https://review.openstack.org/10799612:54
NobodyCamgood morning Ironic12:54
*** d0ugal has joined #openstack-ironic12:56
*** lucas-hungry is now known as lucasagomes12:58
*** dguerri has quit IRC13:01
*** jbjohnso_ has joined #openstack-ironic13:02
*** dguerri has joined #openstack-ironic13:02
*** datajerk has quit IRC13:06
*** matty_dubs|gone is now known as matty_dubs13:09
*** jbjohnso_ has quit IRC13:11
dtantsurbtw, started working on some bug dashboard, as discussed on recent meetings. early WIP: https://github.com/Divius/ironic-bug-dashboard13:14
*** pcrews has joined #openstack-ironic13:14
dtantsuroh, and good morning, NobodyCam!13:14
dtantsurI would say that Launchpad API is much better than their UI :D13:15
*** datajerk has joined #openstack-ironic13:16
NobodyCamgood mornign dtantsur & lucasagomes ...TGIF13:16
dtantsuroh, yes, TGIF!13:16
ShrewsHello, Friday. So happy to see you again.13:22
NobodyCammorning Shrews13:23
ShrewsNobodyCam: hi-dee ho!13:24
NobodyCam:)13:30
*** igordcard has joined #openstack-ironic13:31
NobodyCamjroll: you get teh best gerit errors: http://logs.openstack.org/15/107715/1/check-tripleo/check-tripleo-ironic-undercloud-precise/e772513/console.html#_2014-07-17_14_47_32_73513:46
*** k4n0 has quit IRC13:47
jrollNobodyCam: lolwtf13:47
jrollmornin everybody, tgif indeed13:47
Shrewsjroll: morning13:52
*** shausy has quit IRC13:53
*** comstud is now known as bearhands13:54
NobodyCamgood morning jroll13:54
dtantsurShrews, jroll, morning :)14:00
jrollgoood morning14:00
Shrewsmorning dtantsur14:00
*** bowdeng_hp has quit IRC14:02
Shrewsso, this little guy is working next to me this morning: http://imgur.com/XG8yVSD14:10
lucasagomesNobodyCam, morning!!! TGIF! sorry for the late reply14:13
NobodyCamahhh... oh Shrews still have that ping pong table?14:13
NobodyCamlucasagomes: NP :) goood afternoon to you:)14:13
ShrewsNobodyCam: lol14:13
NobodyCam:)14:14
*** bvivek has quit IRC14:16
openstackgerritJim Rollenhagen proposed a change to openstack/ironic: Add missing docstrings  https://review.openstack.org/10620214:20
*** Mikhail_D_ltp has quit IRC14:21
*** jgrimm has joined #openstack-ironic14:22
openstackgerritRamakrishnan G proposed a change to openstack/python-ironicclient: Add ironic cli support for vendor-passthru  https://review.openstack.org/10129714:23
rameshg87folks request you to have a look at ilo virtual media deploy driver spec which has been refactored as per discussion yesterday: https://review.openstack.org/9774414:24
rameshg87devananda: this code for this blueprint has been submitted, this may be marked as complete now https://blueprints.launchpad.net/ironic/+spec/ironic-ilo-power-driver14:25
*** annegentle is now known as notsogentle14:27
dtantsurhttps://review.openstack.org/#/c/102506/ 3x +2 :) anyone mind just approving?14:28
*** hemna has joined #openstack-ironic14:28
* jroll looks14:28
jrolldtantsur: the InstanceAssociated error here: https://review.openstack.org/#/c/102506/8/ironic/db/sqlalchemy/api.py14:30
jroll(the first exception)14:30
jrollcan you create a node with an instance_uuid?14:30
jrollseems like that would never hit14:30
*** hemna has quit IRC14:30
dtantsurjroll, from the code perspective - you can, though I can't imagine it :) I guess it was requested by some of reviewers for the sake of correctness14:31
NobodyCamlgtm14:31
jrollhuh.14:31
dtantsur(raising NodeAlreadyExists would be clearly wrong here)14:31
dtantsurNobodyCam, thanks14:32
jrolland I thought we didn't allow setting the uuid14:32
jrollIMBW14:32
jrollanyway, too late now14:33
NobodyCamhehehe14:33
dtantsurjroll, via API - does not. It's again for the sake of internal correctness of DB API (read: good encapsulation :)14:34
jrolldtantsur: sure. but then how does any of this help with the linked bug? :)14:35
dtantsurjroll, some of it helps and then I was asked to make it consistent :)14:35
dtantsur(actual fix is 1 or 2 places, IIRC)14:36
*** bmahalakshmi has joined #openstack-ironic14:36
jrollok14:36
*** bmahalakshmi has quit IRC14:37
*** bmahalakshmi has joined #openstack-ironic14:37
*** jistr has quit IRC14:38
NobodyCamlol jroll I think I found another bug to recehck that client patch on14:48
NobodyCams/on/with/14:48
jrolloh?14:48
jrollI filed one14:48
NobodyCamyea14:48
NobodyCamgoing thru the logs14:48
NobodyCamhttp://logs.openstack.org/15/107715/1/check-tripleo/check-tripleo-ironic-undercloud-precise/e772513/logs/seed_logs/neutron-dhcp-agent.txt.gz14:49
NobodyCambut goot to have the bug you files too..14:50
NobodyCamI think it is real14:50
jrolloh good, neutron failed14:50
jrollI'm shocked14:50
NobodyCamlol14:50
* jroll brb14:50
*** athomas has quit IRC14:52
*** mdorman has joined #openstack-ironic14:54
*** athomas has joined #openstack-ironic14:57
*** jcoufal has quit IRC14:58
NobodyCambrb15:01
*** foexle has quit IRC15:04
*** igordcard has quit IRC15:16
*** ifarkas has quit IRC15:17
openstackgerritJosh Gachnang proposed a change to openstack/ironic-python-agent: Ignore RAID devices for erase_devices  https://review.openstack.org/10804015:18
*** igordcard has joined #openstack-ironic15:28
NobodyCamand brb again15:31
devanandaviktors|afk: ping15:35
devanandamorning, all15:35
viktors|afkdevananda: hi15:35
dtantsurdevananda, morning15:35
*** viktors|afk is now known as viktors15:35
jrollmorning devananda15:35
devanandaviktors: hi! when testing 107053 locally, i keep hitting15:35
devanandaAttributeError: 'MySQLOpportunisticFixture' object has no attribute '_details'15:35
devanandaviktors: even after rebuilding venv15:36
Shrewsmorning devananda15:36
devanandai'm at CLS today and tomorrow, so will be only semi around15:36
viktorsdevananda: one min please15:36
devanandaShrews, romcheg, adam_g: ya'll should read the email I sent to ML last night about upgrade path and testing15:36
devanandaQA team is still in germany afaik, so they may not respond for a few more days15:37
Shrewsdevananda: i read that. great observation about how we don't fit the suggested test path15:37
viktorsdevananda: does user `openstack_citest` can create new databases on mysql?15:38
devanandaviktors: probably not :)15:38
NobodyCammorning devananda15:38
devanandaviktors: if that's the problem, the failure is not helpful15:38
devananda*failure message15:38
viktorsdevananda: agree, I'll ask someone fron uor team to fix it15:39
viktors*from our15:39
openstackgerritA change was merged to openstack/ironic: Raise appropriate errors on duplicate Node, Port and Chassis creation  https://review.openstack.org/10250615:40
devanandaviktors: yea, that fixes it15:40
devanandaviktors: so why did this not test with sqlite?15:40
viktorsdevananda: cool :)15:40
viktorsdevananda: we can try to do it, but Alembic have very limited support of SQLite, unfortunately, so I have a doubt, that migration tests will pass15:42
devanandaviktors: is that limitation documented within oslo.db? I think it may come as a surprise to many projects15:43
devanandaviktors: which are accustomed to using sqlite15:43
devanandaviktors: also, this does not appear to have actualy tested migrations! :(15:44
devanandaviktors: it jsut created and dropped tables, did a few inserts15:44
devanandaviktors: it didn't run any of the ALTERs15:44
viktorsdevananda: let me look15:44
devanandaviktors: http://paste.openstack.org/show/0JifhqoQSdEAuOVc5Ujp/15:45
devanandathat is full log from a run of "tox -epy27 test_migrations"15:45
devanandaof all SQL queries received by local mysql server15:46
devanandaI need to check in to conference now, bbl15:46
devanandaviktors: please tell me i'm donig something wrong, cause I'd really like to move to oslo.db and get these fixes in15:46
viktorsdevananda: do you tested it with the oslo code? I supposed to see "ALTER TABLE " at migration 3cb628139ea4 for example15:47
devanandaI am testing with commit ffd83dc3af170608a867ed1721a90747e67d293415:48
devanandathat's your opportunistic fixes on top of the oslo.db patch15:48
devanandaok, really afk now15:49
viktorsdevananda: ok, I'll check it15:49
openstackgerritRamakrishnan G proposed a change to openstack/ironic-specs: Move code to cleanup ImageCache to a common place  https://review.openstack.org/10799615:51
*** rameshg87 has quit IRC15:53
*** wanyen has quit IRC15:55
dtantsurgoing now, have a nice weekend :)15:58
*** dtantsur is now known as dtantsur|afk15:59
NobodyCamhave a good weekend dtantsur|afk15:59
*** matty_dubs is now known as matty_dubs|lunch16:01
openstackgerritDmitry Tantsur proposed a change to openstack/ironic: Fix leaking DB details to API on error  https://review.openstack.org/7312116:01
NobodyCambrb16:03
lucasagomesmorning devananda16:04
viktorsdevananda: please look, hen you'll be around - http://paste.openstack.org/show/87149/16:04
*** rakesh_hs has quit IRC16:05
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Expose {set,get}_boot_device in the API  https://review.openstack.org/9015116:06
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: SSH virsh to use the new ManagementInterface  https://review.openstack.org/8988416:06
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: IPMITool to use the new ManagementInterface  https://review.openstack.org/8609216:06
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: SeaMicro to use the new ManagementInterface  https://review.openstack.org/8632816:06
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: IPMINative to use the new ManagementInterface  https://review.openstack.org/8658816:06
*** chuckC has quit IRC16:06
*** ramineni has quit IRC16:10
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Expose {set,get}_boot_device in the API  https://review.openstack.org/9015116:16
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: SSH virsh to use the new ManagementInterface  https://review.openstack.org/8988416:16
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: IPMITool to use the new ManagementInterface  https://review.openstack.org/8609216:16
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: SeaMicro to use the new ManagementInterface  https://review.openstack.org/8632816:16
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: IPMINative to use the new ManagementInterface  https://review.openstack.org/8658816:16
*** Poornima has joined #openstack-ironic16:16
viktorsdevananda: see also http://www.sqlite.org/omitted.html and http://paste.openstack.org/show/87150/16:20
*** rainya has joined #openstack-ironic16:25
*** ramineni has joined #openstack-ironic16:32
*** romcheg1 has joined #openstack-ironic16:44
*** romcheg1 has left #openstack-ironic16:44
*** lazy_prince is now known as killer_prince16:44
*** max_lobur has joined #openstack-ironic16:46
*** matty_dubs|lunch is now known as matty_dubs16:53
*** ramineni has quit IRC16:55
*** viktors is now known as viktors|afk17:03
*** chuckC has joined #openstack-ironic17:06
*** Alexei_9871 has quit IRC17:07
*** malini1 has joined #openstack-ironic17:09
*** derekh_ is now known as derekh_afk17:10
lucasagomesaight folks I will call it a day17:10
lucasagomeshave a great weekend everybody!17:10
openstackgerritJosh Gachnang proposed a change to openstack/ironic: Drivers determine acceptable power states  https://review.openstack.org/8674417:11
*** lucasagomes is now known as lucas-beer17:11
Shrewshave a good weekend lucas-beer17:12
jrolllater lucas-beer (lol)17:13
devanandaviktors|afk: I can reproduce your result and see the ALTERs in the testrepository log17:14
devanandaviktors|afk: howver I still don't see it in MySQL's log17:14
*** ndipanov has quit IRC17:20
devanandaviktors|afk: whereas if I run an ALTER myself, I see it in the log. So I don't understand why the migration ALTERs aren't showing up17:21
openstackgerritNisha Agarwal proposed a change to openstack/ironic-specs: Discover node properties at node-create/node-update  https://review.openstack.org/10095117:23
*** Nisha has joined #openstack-ironic17:24
*** harlowja_away is now known as harlowja17:25
*** jdob_ has joined #openstack-ironic17:31
*** jdob has quit IRC17:31
*** bmahalakshmi has quit IRC17:41
*** viktors has joined #openstack-ironic17:43
*** Mikhail_D_ltp has joined #openstack-ironic17:43
viktorsdevananda: how did you set logging for mysql?17:44
viktorsdevananda: anyway, I believe, that migration https://github.com/openstack/ironic/blob/master/ironic/db/sqlalchemy/alembic/versions/3bea56f25597_add_unique_constraint_to_instance_uuid.py will generate ALTER17:46
openstackgerritNisha Agarwal proposed a change to openstack/ironic-specs: Discover node properties at node-create/node-update  https://review.openstack.org/10095117:54
devanandaviktors: set global slow_query_log=ON; set global long_query_time=0;17:56
devanandaviktors: i can clearly see the selects, creates, inserts, and drop17:56
*** rameshg87 has joined #openstack-ironic18:02
* viktors checking 18:03
viktorsdevananda: I got no success in your case also - no logs at all18:07
viktorsdevananda: but I see ALTERS in log after I modified my.conf file18:07
rameshg87devananda: request your review on the revised ilo deploy driver spec https://review.openstack.org/9774418:10
*** athomas has quit IRC18:10
*** jdob_ is now known as jdob18:11
NobodyCambr18:13
NobodyCambrb18:13
*** viktors has quit IRC18:23
NobodyCamI need to step afk for a bit.. prob two hours... I will be and ofc I have google with me if I am needed18:23
*** jgrimm has quit IRC18:23
*** NobodyCam is now known as Nobodycam_afk18:23
*** mikal has quit IRC18:35
*** mikal has joined #openstack-ironic18:36
*** igordcard has quit IRC18:45
*** romcheg1 has joined #openstack-ironic18:47
*** rameshg87 has left #openstack-ironic18:55
*** Poornima has quit IRC18:59
*** jdob has quit IRC19:05
lifelessNobodycam_afk: the very next run I did didn't trigger it19:07
lifelessNobodycam_afk: but19:07
lifelessNobodycam_afk: instance['node'] is raising sometimes AFAICT19:07
lifelessNobodycam_afk: the new code path throws an error and then the instance stalls19:07
*** romcheg1 has quit IRC19:10
*** killer_prince has quit IRC19:11
*** faizan has joined #openstack-ironic19:18
*** killer_prince has joined #openstack-ironic19:25
*** killer_prince is now known as lazy_prince19:25
*** Nisha has quit IRC19:32
*** malini1 has quit IRC19:36
*** martyntaylor has joined #openstack-ironic19:43
*** datajerk has quit IRC19:55
*** rwsu has quit IRC19:55
*** zul has quit IRC19:55
*** datajerk has joined #openstack-ironic19:55
*** rwsu has joined #openstack-ironic19:55
*** zul has joined #openstack-ironic19:56
*** eghobo has joined #openstack-ironic19:58
*** romcheg1 has joined #openstack-ironic20:04
*** rwsu has quit IRC20:09
*** faizan has quit IRC20:16
*** rwsu has joined #openstack-ironic20:21
*** malini1 has joined #openstack-ironic20:35
*** pelix has quit IRC20:53
*** romcheg1 has quit IRC21:00
*** martyntaylor has quit IRC21:14
*** chuckC has quit IRC21:30
*** matty_dubs is now known as matty_dubs|gone21:40
openstackgerritJosh Gachnang proposed a change to openstack/ironic-python-agent: Ignore RAID devices for erase_devices  https://review.openstack.org/10804021:52
*** chuckC has joined #openstack-ironic21:54
openstackgerritJosh Gachnang proposed a change to openstack/ironic-python-agent: Ignore RAID devices for erase_devices  https://review.openstack.org/10804021:56
*** Mikhail_D_ltp has quit IRC22:08
openstackgerritJosh Gachnang proposed a change to openstack/ironic-python-agent: Ignore RAID devices for erase_devices  https://review.openstack.org/10804022:15
*** wanyen has joined #openstack-ironic22:18
wanyenHi,  iLO virtual media + iscsi driver spec https://review.openstack.org/#/c/107344/ has been uploaded.  This spec reflected the irc discussion yesterday regarding using iLO virtual media driver to replace tftp for PXE driver and uses iscsci to disploy boot image.  Please review the spec.  Thanks!22:23
*** malini1 has quit IRC22:29
*** lucas-beer has quit IRC22:40
*** derekh_afk has quit IRC22:41
*** romcheg1 has joined #openstack-ironic22:45
*** mdorman has quit IRC22:45
openstackgerritJosh Gachnang proposed a change to openstack/ironic-python-agent: Improve Disk Detection  https://review.openstack.org/10804022:50
openstackgerritA change was merged to openstack/ironic: Add missing docstrings  https://review.openstack.org/10620222:53
wanyens/disploy/deploy23:02
*** malini1 has joined #openstack-ironic23:05
*** faizan has joined #openstack-ironic23:18
*** stevebaker has quit IRC23:21
*** stevebaker has joined #openstack-ironic23:21
*** max_lobur has quit IRC23:21
*** stevebaker has quit IRC23:26
*** stevebaker has joined #openstack-ironic23:26
*** Haomeng has joined #openstack-ironic23:34
*** Haomeng|2 has quit IRC23:35
*** faizan has quit IRC23:50
*** stevebaker has quit IRC23:51
*** stevebaker has joined #openstack-ironic23:51

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!