Wednesday, 2017-05-31

*** dave-mccowan has joined #openstack-oslo00:03
*** raildo has quit IRC00:14
*** salv-orlando has joined #openstack-oslo00:15
*** salv-orlando has quit IRC00:19
*** ansmith has joined #openstack-oslo00:27
*** yamahata has quit IRC00:33
openstackgerritOctave Orgeron proposed openstack/oslo.db master: Enable MySQL Storage Engine selection  https://review.openstack.org/42797000:58
*** zhangguoqing has joined #openstack-oslo01:08
*** gcb has joined #openstack-oslo01:13
*** yamahata has joined #openstack-oslo01:24
dimsgcb : let's get this in please - https://review.openstack.org/#/c/468137/01:34
*** gomarivera has joined #openstack-oslo01:34
gcbdims: +2, I wait for zzzeek's comments last week01:35
*** ianychoi_ is now known as ianychoi01:35
dimsthanks, that was the right thing to do :)01:35
*** tovin07_ has joined #openstack-oslo01:39
*** aselius has quit IRC01:45
*** hongbin has quit IRC01:51
*** salv-orlando has joined #openstack-oslo02:15
*** dave-mccowan has quit IRC02:15
*** salv-orlando has quit IRC02:20
*** gomarivera has quit IRC02:41
*** nicolasbock has quit IRC02:49
openstackgerritMerged openstack/oslosphinx master: Fix intersphinx mapping for neutron  https://review.openstack.org/46892402:57
*** nicolasbock has joined #openstack-oslo03:20
*** eck` is now known as eck`gone03:22
*** nicolasbock has quit IRC03:33
*** david-lyle has joined #openstack-oslo03:35
openstackgerritMerged openstack/oslo.messaging master: Mark the Pika driver as deprecated  https://review.openstack.org/46847903:37
*** links has joined #openstack-oslo03:45
*** salv-orlando has joined #openstack-oslo03:50
*** salv-orlando has quit IRC03:54
*** zhangguoqing has quit IRC04:00
openstackgerritMerged openstack/osprofiler master: devstack: use project conf file env variables  https://review.openstack.org/46923604:04
*** jaosorior has quit IRC04:10
*** jaosorior has joined #openstack-oslo04:13
*** yamamoto has joined #openstack-oslo04:13
*** salv-orlando has joined #openstack-oslo04:39
*** zhangguoqing has joined #openstack-oslo04:51
openstackgerritChangBo Guo(gcb) proposed openstack/oslo-specs master: Add a new library policy and process proposal  https://review.openstack.org/31223305:15
openstackgerritMerged openstack/taskflow master: do not allow redis job reclaim by same owner  https://review.openstack.org/46430205:48
*** jaosorior has quit IRC06:08
*** rcernin has joined #openstack-oslo06:10
*** yamahata has quit IRC06:11
*** karthikp has quit IRC06:16
*** jaosorior has joined #openstack-oslo06:17
*** karthikp_ has joined #openstack-oslo06:18
*** yamamoto has quit IRC06:30
*** e0ne has joined #openstack-oslo06:42
*** e0ne has quit IRC06:50
openstackgerritChangBo Guo(gcb) proposed openstack/oslo.middleware master: Remove usage of parameter enforce_type  https://review.openstack.org/45553906:52
*** tesseract has joined #openstack-oslo06:53
*** shardy has joined #openstack-oslo06:54
*** e0ne has joined #openstack-oslo07:04
*** yamamoto has joined #openstack-oslo07:13
*** pcaruana has joined #openstack-oslo07:26
*** salv-orl_ has joined #openstack-oslo07:27
*** salv-orlando has quit IRC07:30
*** e0ne has quit IRC07:31
*** gomarivera has joined #openstack-oslo07:42
*** aselius has joined #openstack-oslo07:45
*** gomarivera has quit IRC07:47
*** aarefiev_afk is now known as aarefiev07:54
*** eliqiao has quit IRC07:58
*** zzzeek has quit IRC08:00
*** zzzeek has joined #openstack-oslo08:01
*** eliqiao has joined #openstack-oslo08:01
*** lpetrut has joined #openstack-oslo08:02
*** lucas-afk is now known as lucasagomes08:15
*** trungnv has quit IRC08:22
*** eliqiao has quit IRC08:23
*** eliqiao has joined #openstack-oslo08:26
*** trungnv has joined #openstack-oslo08:32
*** jdandrea_ has joined #openstack-oslo08:52
*** oomichi_ has joined #openstack-oslo08:59
*** zzzeek_ has joined #openstack-oslo09:00
*** dmellado_ has joined #openstack-oslo09:00
*** zzzeek has quit IRC09:01
*** links has quit IRC09:01
*** pblaho has quit IRC09:01
*** Guest35152 has quit IRC09:01
*** rushiagr has quit IRC09:01
*** dmellado has quit IRC09:01
*** oomichi has quit IRC09:01
*** sileht has quit IRC09:01
*** jdandrea has quit IRC09:01
*** oomichi_ is now known as oomichi09:01
*** andreaf has quit IRC09:03
*** andreaf has joined #openstack-oslo09:06
*** links has joined #openstack-oslo09:07
*** Guest35152 has joined #openstack-oslo09:07
*** pblaho has joined #openstack-oslo09:07
*** sileht has joined #openstack-oslo09:08
*** sileht has quit IRC09:09
*** sileht has joined #openstack-oslo09:09
*** david-lyle has quit IRC09:11
*** david-lyle has joined #openstack-oslo09:12
*** rushiagr has joined #openstack-oslo09:14
*** jaosorior is now known as jaosorior_lunch09:19
openstackgerritzhangdaolong proposed openstack/oslo.vmware master: Wrong member variable name in class Datastore  https://review.openstack.org/46939809:33
*** sambetts|afk is now known as sambetts09:44
*** dmellado_ is now known as dmellado09:46
dimsjd_ : flaper87 : one of you please bless this? https://review.openstack.org/#/c/468137/09:47
flaper87dims: looking09:49
jd_i know nothing about oslo.cache and I don't think I want to know about it so… :p09:51
jd_i'm glad flaper87 is taking it :)09:51
*** aselius has quit IRC09:54
*** tovin07_ has quit IRC09:55
*** nicolasbock has joined #openstack-oslo09:56
*** cdent has joined #openstack-oslo10:01
dimsthanks jd_ flaper8710:10
dims:)10:10
dimsjd_ : flaper87 : i intend to test more with devstack + keystone pointed to this driver. so will need more work :)10:11
*** links has quit IRC10:16
*** e0ne has joined #openstack-oslo10:22
*** nicolasbock has quit IRC10:27
*** nicolasbock has joined #openstack-oslo10:27
*** nicolasbock has quit IRC10:28
*** nicolasbock has joined #openstack-oslo10:28
*** links has joined #openstack-oslo10:36
*** jaosorior_lunch is now known as jaosorior10:41
*** shardy has quit IRC10:44
*** zhangguoqing has quit IRC10:50
*** boden has joined #openstack-oslo10:55
*** salv-orl_ has quit IRC10:59
*** yamamoto has quit IRC11:02
*** raildo has joined #openstack-oslo11:11
*** dave-mccowan has joined #openstack-oslo11:12
thervedims, ast.literal_eval?11:26
therveLike, really? :)11:26
dimstherve : i was told that was better than "eval()" :)11:27
thervedims, Well sure, it's better than shooting yourself in the head too11:27
therveIt'd be even better to use a real serialization mechanism11:27
openstackgerritMerged openstack/oslo.cache master: etcd3 driver for oslo.cache  https://review.openstack.org/46813711:28
dimstherve : somewhere in dogpile it turns the dict into a string and passes that to this code. and dogpile expects me to send back a dict hence the kludge. happy to revisit this when i start testing with devstack+keystone. it's just the first cut11:31
*** ansmith has quit IRC11:40
*** yamamoto has joined #openstack-oslo11:43
thervedims, It seems to be that etcd only supports strings as value11:45
therveYou client.put(key, value), but you don't serialize it11:45
therveSo etcdgw roughtly do str(value)11:46
therveAnd that's what you get back when you call get()11:46
dimstherve : we are using the etcd3's v3alpha HTTP API - https://coreos.com/etcd/docs/latest/dev-guide/api_grpc_gateway.html11:48
thervedims, Yes?11:48
dims"Note that key and value fields are defined as byte arrays and therefore must be base64 encoded in JSON"11:48
therveRight. I don't discuss what you're doing in etcdgw, that's correct11:49
dimswe could pickle and make a base64 out of it11:49
therveI argue against the oslo.cache driver11:49
therveWell the base64 is handled by etcdgw11:49
therveBut you shouldn't pass a raw value like that11:50
thervepickle is one option, although not great11:50
thervejson is probably better11:50
dimstherve : k, i can revisit the etcd3gw code first11:50
thervedims, Again, the etcd3gw code is correct :)11:51
dimstherve : so a minor fix in oslo.cache itself?11:51
therveI mean, except maybe it could raise an exception if you don't pass a string, but other than that it works11:51
dimsk, i can revisit the code once more later today therve :) unless you beat me to it with a patch11:52
therveYeah don't hold your breath :)11:53
dimsLOL ok11:53
dimsbrb, need to get kid#2 out the door11:53
*** MVenesio has joined #openstack-oslo12:01
*** lucasagomes is now known as lucas-hungry12:09
*** links has quit IRC12:11
*** gordc has joined #openstack-oslo12:38
*** ansmith has joined #openstack-oslo12:41
*** kgiusti has joined #openstack-oslo12:59
*** zhangguoqing has joined #openstack-oslo13:01
*** lucas-hungry is now known as lucasagomes13:08
*** yamahata has joined #openstack-oslo13:10
*** strigazi_ has joined #openstack-oslo13:10
strigazi_Hello, since yesterday the magnum gate is broken and in any operation I get [1], any ideas? I'm stuck :( [1] http://paste.openstack.org/show/611090/13:12
*** strigazi_ is now known as strigazi13:15
*** lifeless has quit IRC13:15
kgiustistrigazi: do you have a link to the full gate logs?   It would be helpful to see if there are any errors on the rpc server side (as well as the rabbit logs)13:22
strigazikgiusti http://logs.openstack.org/87/462887/7/check/gate-functional-dsvm-magnum-swarm-ubuntu-xenial/00c8ccc/13:22
kgiustistrigazi: thanks - looking into it...13:23
strigazikgiusti Thanks, I'm looking too, but didn't have much luck so far13:23
*** superdan is now known as dansmith13:26
*** gomarivera_ has joined #openstack-oslo13:29
*** gomarivera_ has quit IRC13:33
*** lifeless has joined #openstack-oslo13:33
*** gomarivera has joined #openstack-oslo13:33
*** zhangguoqing has quit IRC13:34
*** eck`gone is now known as eck`13:34
*** zhangguoqing has joined #openstack-oslo13:41
*** janzian has joined #openstack-oslo13:42
strigazikgiusti Did you find anything?13:55
*** ihrachys has joined #openstack-oslo13:56
kgiustistrigazi: nothing obvious, no.  There is a rpc server-side failure in http://logs.openstack.org/87/462887/7/check/gate-functional-dsvm-magnum-swarm-ubuntu-xenial/00c8ccc/logs/screen-n-sch.txt.gz#_May_31_06_00_02_901049 but that happens way before the timeout you are hitting13:57
strigazikgiusti I started yesterday. Mmessages do not arrive to the conductort. We didn't have any related change in our codebase13:59
strigaziI guess it is somthing related to oslo.messaging or just related to rabbit14:01
kgiustistrigazi: strange - let me see if I can find out what may have changed in o.m14:01
*** hecliunyx has quit IRC14:02
strigazikgiusti I don't see any recent patches that may affect us14:03
kgiustistrigazi: yeah, but 5.25.0 was released yesterday, which is when you started hitting these issues.  Something smells fishy.14:05
strigazikgiusti We are on to something. The last check that succeeded yesterday was oslo.messaging==5.24.214:07
kgiustistrigazi: there was a change in the rabbit code between 5.24.2...14:07
strigazikgiusti I'll pin 5.24.2 on my local devstack to check14:07
kgiustisileht: ping, see ^^14:07
kgiustistrigazi: good idea14:08
*** eck` is now known as eck`gone14:08
kgiustistrigazi: looks like all the other changes in 5.25.0 where either gr updates or minor tweaks to the non-rabbit stuff14:08
*** salv-orlando has joined #openstack-oslo14:10
kgiustigcb: ping - there may be an issue with 5.25.0....14:10
strigazikgiusti with 5.24.2 works14:12
strigazikgiusti But, why others don't notice?14:13
silehtstrigazi, does 5.23.0 works ?14:13
*** yamahata has quit IRC14:13
*** aselius has joined #openstack-oslo14:13
strigazisileht I'll check14:13
silehtstrigazi, because 5.24 is kind of buggy with rabbit and 5.25.0 is supposed to fix that bug14:14
strigazisileht yes14:16
silehtstrigazi, thx14:16
strigazisileht kgiusti what do you propose? Pin the version on magnum?14:17
silehtI'm surprise that only magnum see this issue14:17
kgiustisileht: can we be sure it's only magnum - the release was made only yesterday....14:17
strigaziWhat is the problem exactly, Which pacth?14:18
*** eck`gone is now known as eck`14:22
kgiustistrigazi: there were some threading issues in the rabbit code.  Refer to https://review.openstack.org/#/c/463673/14:24
*** hongbin has joined #openstack-oslo14:25
*** cdent has quit IRC14:29
strigazisileht  kgiusti FYI, I opened a bug in magnum. I'll submit a patch in magnum to avoid 5.25.0 and 5.24.214:38
strigazisileht kgiusti https://bugs.launchpad.net/magnum/+bug/169472814:39
openstackLaunchpad bug 1694728 in Magnum "Fix magnum's gate, oslo.messaging broke it" [Undecided,New]14:39
kgiustistrigazi: +114:39
strigazikgiusti I hope I'll catch the next release when the problem is fixed. If you work on it and you make progress please leave a comment in the bug.14:42
silehtkgiusti, all gates are using 5.25.0 currently and don't have this issue14:46
*** pblaho has quit IRC14:46
kgiustisileht: good to hear!14:46
*** pblaho has joined #openstack-oslo14:46
kgiustisileht: I'm trying to repo the magnum tests locally...14:47
*** zhangguoqing has quit IRC14:48
kgiustisileht: given that it probably doesn't make sense to revert that fix before we understand why magnum is failing.14:48
*** pblaho has quit IRC14:51
*** pblaho has joined #openstack-oslo14:51
*** zhangguoqing has joined #openstack-oslo14:53
*** zhangguoqing has quit IRC14:53
*** pblaho has quit IRC14:54
*** pblaho has joined #openstack-oslo14:54
*** pblaho has quit IRC14:58
silehtupper constraints is already 5.25.0 https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L14214:59
*** pblaho has joined #openstack-oslo14:59
*** pblaho has quit IRC15:00
*** pblaho has joined #openstack-oslo15:02
*** hoonetorg has quit IRC15:04
*** pblaho has quit IRC15:08
*** pblaho has joined #openstack-oslo15:08
*** pblaho has quit IRC15:12
*** pblaho has joined #openstack-oslo15:12
*** hoonetorg has joined #openstack-oslo15:16
*** cdent has joined #openstack-oslo15:21
*** rloo has joined #openstack-oslo15:23
rloodhellmann: when you have a minute, sphinx is emitting a warning/error for ironic docs job: https://bugs.launchpad.net/ironic/+bug/169472415:25
openstackLaunchpad bug 1694724 in Ironic "Warning for ironic.drivers.modules.deploy_utils" [Critical,New]15:25
rloodhellmann: it started yesterday and it seems to coincide with using a new version of sphinx: 1.6.2.15:26
*** pblaho has quit IRC15:26
rloodhellmann: 1.6.1 is blocked, am wondering if 1.6.2 has similar issues? I honestly don't see anything wrong with the ironic code it is complaining about15:26
*** pblaho has joined #openstack-oslo15:28
*** pblaho has quit IRC15:30
*** pblaho has joined #openstack-oslo15:31
strigazikgiusti sileht I pushed a patch in magnum and prometheanfire told me to push it to global requirements. Should we go for 5.23.0? What about 5.24.1 and .0? FYI openstack/zun is affected too.15:33
*** aarefiev is now known as aarefiev_afk15:34
silehtAnd fixing the root cause ?15:34
*** janzian has quit IRC15:35
strigazisileht I'm not sure what is the root cause, but we should fix it. However we need a workaround for the gates to pass.15:35
strigazi*must* fix it15:36
kgiustisileht: I've got a vm slugging along running the magnum tests... nothing new yet.15:37
strigazikgiusti sileht, The day is over for me here. I'll pick it up tmr. If you find anything let me know.15:38
kgiustistrigazi: kk15:38
strigazikgiusti just magnum service-list will raise the issue15:38
kgiustistrigazi: good to know (you saved me some time)15:38
strigazikgiusti sileht, Here is the the patch in requirements https://review.openstack.org/#/c/469539/15:39
strigazikgiusti ot magnum cluster-list, magnum cluster-template-list, I think all commands :)15:39
silehtstrigazi, don't blacklist 5.24.2 it doesn't break gate15:40
*** Rockyg has joined #openstack-oslo15:41
strigazikgiusti sileht I'm leaving, Thanks for your help! I really appreciate it15:41
strigazisileht done15:41
dhellmannrloo : sphinx has decided that if during the process of building the docs anything logs a message at warning level, that counts as emitting a warning and so when the flag to treat warnings as errors is set true the log message itself triggers the failure15:46
*** lpetrut has quit IRC15:47
dhellmannrloo : my recommendation is to stop having ironic log things when modules are imported (that's not safe anyway) and do it at runtime somewhere in the code path where the option in question is being used15:50
dhellmannrloo : I commented about that on the bug15:51
rloodhellmann: that is *almost* funny (what sphinx is doing). thx for your help!15:51
dhellmannyeah, I can see the logic, but it's annoying to have a change in behavior like that15:52
*** janzian has joined #openstack-oslo15:52
*** cdent has quit IRC15:55
*** yamahata has joined #openstack-oslo15:59
*** yamahata has quit IRC16:04
*** yamahata has joined #openstack-oslo16:05
*** david-lyle has quit IRC16:06
*** rcernin has quit IRC16:07
*** tesseract has quit IRC16:08
*** gomarivera has quit IRC16:10
*** david-lyle has joined #openstack-oslo16:14
*** clarkb has joined #openstack-oslo16:16
clarkbhello, I've noticed some odd behavior in oslo logging produced logs. http://logs.openstack.org/28/461628/10/gate/gate-tempest-dsvm-neutron-full-ubuntu-xenial/cf6c9e9/logs/screen-c-vol.txt.gz#_May_26_20_44_32_283596 is a logline that is properly formed but without a log level. Is that fallout from the switch to journald'ing? EG is oslo logging emitting the first line there with the INFO level then16:18
clarkbeverything else is unanotated then journald adds the timestamp and process name nad pid and hostname?16:18
clarkbit is confusing os-loganalyze and logstash so trying to understand what is going on there then hopefully fix/address it16:18
*** cdent has joined #openstack-oslo16:19
*** lucasagomes is now known as lucas-afk16:26
*** pblaho has quit IRC16:41
*** sambetts is now known as sambetts|afk16:42
*** rcernin has joined #openstack-oslo16:46
*** gomarivera has joined #openstack-oslo16:46
*** pcaruana has quit IRC16:50
*** gomarivera has quit IRC16:51
*** gomarivera has joined #openstack-oslo16:52
*** salv-orlando has quit IRC16:55
openstackgerritOctave Orgeron proposed openstack/oslo.db master: Enable MySQL Storage Engine selection  https://review.openstack.org/42797016:56
*** e0ne has quit IRC17:00
*** rmascena has joined #openstack-oslo17:09
*** raildo has quit IRC17:11
*** ujjain has quit IRC17:33
*** jaosorior is now known as jaosorior_away17:44
*** nicolasbock has quit IRC17:58
*** ujjain has joined #openstack-oslo18:01
*** ujjain has quit IRC18:01
*** ujjain has joined #openstack-oslo18:01
*** rajathagasthya has joined #openstack-oslo18:04
*** Rockyg has quit IRC18:08
openstackgerritDavanum Srinivas (dims) proposed openstack/oslo.cache master: [WIP] testing devstack+keystone with etcd3  https://review.openstack.org/46962219:03
*** rloo has quit IRC19:04
*** rajathagasthya has quit IRC19:12
*** rajathagasthya has joined #openstack-oslo19:22
*** lpetrut has joined #openstack-oslo19:23
openstackgerritOctave Orgeron proposed openstack/oslo.db master: Enable MySQL Storage Engine selection  https://review.openstack.org/42797019:30
*** yamamoto has quit IRC19:33
bretonoh wow19:35
bretonetcd as cache backend?19:35
*** eck` is now known as eck`gone19:35
bretonhow is different from memcache?19:35
*** yamahata has quit IRC19:39
*** pcaruana has joined #openstack-oslo19:45
harlowjaprob not much like memcache at all :-P19:53
harlowjaexcept for the word 'cache'19:53
dimsbreton : key/values are stored with a ttl :)19:59
*** salv-orlando has joined #openstack-oslo20:00
*** pcaruana has quit IRC20:02
*** e0ne has joined #openstack-oslo20:09
*** salv-orlando has quit IRC20:09
*** salv-orlando has joined #openstack-oslo20:11
*** rcernin has quit IRC20:21
*** eck`gone is now known as eck`20:22
*** rcernin has joined #openstack-oslo20:22
*** yamamoto has joined #openstack-oslo20:33
*** ansmith has quit IRC20:39
*** rcernin has quit IRC20:42
*** yamamoto has quit IRC20:43
*** rmascena has quit IRC20:45
*** e0ne has quit IRC21:07
*** pcaruana has joined #openstack-oslo21:12
*** salv-orlando has quit IRC21:16
*** harlowja has quit IRC21:21
*** janzian has quit IRC21:28
*** pcaruana has quit IRC21:29
*** lpetrut has quit IRC21:30
*** MVenesio has quit IRC21:31
*** MVenesio has joined #openstack-oslo21:31
*** MVenesio has quit IRC21:32
*** boden has quit IRC21:59
*** harlowja has joined #openstack-oslo22:06
*** yamahata has joined #openstack-oslo22:19
*** sheeprine has quit IRC22:24
*** gomarivera has quit IRC22:26
*** gordc has quit IRC22:44
*** nicolasbock has joined #openstack-oslo23:16
*** gomarivera has joined #openstack-oslo23:17
*** rajathagasthya has quit IRC23:19
dimsgcb : around? i filed another oslo.cache release request - https://review.openstack.org/#/c/469658/23:21
*** gomarivera has quit IRC23:22
*** cdent has quit IRC23:23
*** rajathagasthya has joined #openstack-oslo23:45
*** gomarivera has joined #openstack-oslo23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!