Wednesday, 2017-05-24

*** spzala has quit IRC00:00
*** brault has joined #openstack-dev00:00
*** spzala has joined #openstack-dev00:00
*** Cioran has joined #openstack-dev00:01
*** nicolasbock has quit IRC00:03
*** spzala has quit IRC00:05
*** brault has quit IRC00:05
*** Cioran89 has quit IRC00:05
*** jaypipes has quit IRC00:05
*** iyamahat_ has joined #openstack-dev00:11
*** iyamahat has quit IRC00:12
*** salv-orlando has quit IRC00:16
*** chatter29 has joined #openstack-dev00:21
chatter29hey guys00:21
chatter29allah is doing00:21
chatter29sun is not doing allah is doing00:21
chatter29to accept Islam say that i bear witness that there is no deity worthy of worship except Allah and Muhammad peace be upon him is his slave and messenger00:21
*** chatter29 has quit IRC00:21
*** gianpietro has quit IRC00:23
*** galstrom_zzz is now known as galstrom00:25
*** achampion has joined #openstack-dev00:29
*** salv-orlando has joined #openstack-dev00:29
*** spzala has joined #openstack-dev00:31
*** dimtruck is now known as zz_dimtruck00:33
*** marst_ has joined #openstack-dev00:34
*** spzala has quit IRC00:36
*** spzala has joined #openstack-dev00:36
*** zz_dimtruck is now known as dimtruck00:44
*** ihrachys|afk is now known as ihrachys00:46
*** tovin07_ has joined #openstack-dev00:54
*** Cioran89 has joined #openstack-dev01:00
*** Cioran has quit IRC01:03
*** galstrom is now known as galstrom_zzz01:06
*** ijw_ has joined #openstack-dev01:10
*** ijw has quit IRC01:13
*** gianpietro has joined #openstack-dev01:15
*** jathan_ has quit IRC01:16
*** salv-orlando has quit IRC01:17
*** gianpietro has quit IRC01:19
*** diablo_rojo has quit IRC01:20
*** salv-orlando has joined #openstack-dev01:20
*** spzala has quit IRC01:21
*** RuiChen has joined #openstack-dev01:24
*** RuiChen has quit IRC01:28
*** RuiChen has joined #openstack-dev01:28
*** gongysh has joined #openstack-dev01:28
*** aysyduarte has quit IRC01:33
openstackgerritDavanum Srinivas (dims) proposed openstack/governance master: Etcd as a base service  https://review.openstack.org/46743601:33
*** priteau has joined #openstack-dev01:42
*** baoli has joined #openstack-dev01:42
*** jamesbenson has joined #openstack-dev01:44
*** salv-orlando has quit IRC01:45
*** priteau has quit IRC01:46
*** baoli has quit IRC01:46
*** spzala has joined #openstack-dev01:47
*** jamesbenson has quit IRC01:47
*** spzala has quit IRC01:52
*** SumitNaiksatam has joined #openstack-dev01:54
*** jamesbenson has joined #openstack-dev01:55
*** charcol has quit IRC01:56
*** charcol has joined #openstack-dev01:57
*** penick has joined #openstack-dev01:57
*** adam_g has quit IRC02:00
*** ihrachys has quit IRC02:03
*** adam_g has joined #openstack-dev02:04
*** bobmel_ has quit IRC02:04
*** charcol has quit IRC02:08
*** zhurong has joined #openstack-dev02:11
*** baoli has joined #openstack-dev02:14
*** iyamahat_ has quit IRC02:15
*** spzala has joined #openstack-dev02:25
*** adam_g has quit IRC02:25
*** gianpietro has joined #openstack-dev02:26
*** bobh has quit IRC02:26
*** adam_g has joined #openstack-dev02:26
*** bobh has joined #openstack-dev02:27
*** thorst_afk has joined #openstack-dev02:27
*** gianpietro has quit IRC02:29
*** nicolasbock has joined #openstack-dev02:31
*** gouthamr has quit IRC02:33
*** adam_g has quit IRC02:33
*** charcol has joined #openstack-dev02:34
*** adam_g has joined #openstack-dev02:34
*** thorst_afk has quit IRC02:35
*** edmondsw has joined #openstack-dev02:35
*** thorst_afk has joined #openstack-dev02:37
*** edmondsw has quit IRC02:40
*** marst_ has quit IRC02:49
*** yamamoto_ has joined #openstack-dev02:51
*** thorst_afk has quit IRC02:52
*** jamesmca_ has joined #openstack-dev02:54
*** jamesmca_ has quit IRC02:59
*** yamahata has quit IRC03:00
*** spzala has quit IRC03:00
*** charcol has quit IRC03:05
*** charcol has joined #openstack-dev03:07
*** mriedem has quit IRC03:11
*** cliles has quit IRC03:15
*** bobh has quit IRC03:15
*** bobh has joined #openstack-dev03:16
*** bobh has quit IRC03:19
*** gkadam has joined #openstack-dev03:20
*** spzala has joined #openstack-dev03:31
*** spzala has quit IRC03:36
*** krtaylor has joined #openstack-dev03:39
*** baoli has quit IRC03:39
*** boris-42_ has quit IRC03:39
*** nicolasbock has quit IRC03:42
*** spzala has joined #openstack-dev03:46
*** slaweq has joined #openstack-dev03:50
*** spzala has quit IRC03:50
*** kornicameister has joined #openstack-dev03:51
*** slaweq has quit IRC03:55
*** jamesmca_ has joined #openstack-dev04:00
*** jamesmca_ has quit IRC04:01
*** jamesmca_ has joined #openstack-dev04:01
*** jamesmca_ has quit IRC04:04
*** ChanServ changes topic to "OpenStack development || Support is in #openstack"04:05
-openstackstatus- NOTICE: Sufficient free space has been reclaimed that jobs are passing again; any POST_FAILURE results can now be rechecked.04:05
*** psachin has joined #openstack-dev04:08
*** vhosakot has joined #openstack-dev04:09
*** zhurong has quit IRC04:11
*** vhosakot has quit IRC04:11
*** zhurong has joined #openstack-dev04:15
*** Poornima has joined #openstack-dev04:15
*** yamamoto_ has quit IRC04:18
*** e0ne has joined #openstack-dev04:19
*** gongysh has quit IRC04:20
*** lucasxu has joined #openstack-dev04:20
*** e0ne has quit IRC04:25
*** armax has quit IRC04:28
*** penick has quit IRC04:28
*** armax has joined #openstack-dev04:28
*** armax has quit IRC04:29
*** yamahata has joined #openstack-dev04:32
*** spzala has joined #openstack-dev04:32
*** iyamahat_ has joined #openstack-dev04:32
*** psachin has quit IRC04:35
*** spzala has quit IRC04:37
*** jamesbenson has quit IRC04:50
*** psachin has joined #openstack-dev04:52
*** yamamoto_ has joined #openstack-dev04:56
*** Poornima has quit IRC05:03
*** sree has joined #openstack-dev05:09
*** gongysh has joined #openstack-dev05:10
*** lucasxu has quit IRC05:10
*** Poornima has joined #openstack-dev05:11
*** Poornima has quit IRC05:14
*** Poornima has joined #openstack-dev05:14
*** gongysh has quit IRC05:18
*** anilvenkata has joined #openstack-dev05:18
*** bobh has joined #openstack-dev05:20
*** spzala has joined #openstack-dev05:20
*** gongysh has joined #openstack-dev05:25
*** bobh has quit IRC05:25
*** spzala has quit IRC05:25
*** jamesbenson has joined #openstack-dev05:26
*** ltomasbo|away is now known as ltomasbo05:28
*** jamesbenson has quit IRC05:30
*** Poornima has quit IRC05:34
*** dimtruck is now known as zz_dimtruck05:35
*** kirotawa has quit IRC05:47
*** spzala has joined #openstack-dev05:51
*** psachin has quit IRC05:53
*** spzala has quit IRC05:56
*** iyamahat_ has quit IRC05:59
*** iyamahat has joined #openstack-dev05:59
*** charcol has quit IRC05:59
*** brault has joined #openstack-dev06:00
*** rcernin has quit IRC06:00
*** charcol has joined #openstack-dev06:03
*** itzikb has joined #openstack-dev06:04
*** iyamahat has quit IRC06:04
*** armaan has quit IRC06:04
*** brault has quit IRC06:04
*** psachin has joined #openstack-dev06:05
*** armaan has joined #openstack-dev06:05
*** jprovazn has joined #openstack-dev06:17
*** gyee has quit IRC06:17
*** charcol-v2 has joined #openstack-dev06:17
*** rcernin has joined #openstack-dev06:17
*** Poornima has joined #openstack-dev06:17
*** charcol has quit IRC06:20
*** gfidente has quit IRC06:21
*** psachin has quit IRC06:23
*** psachin has joined #openstack-dev06:23
*** brault has joined #openstack-dev06:27
*** gongysh has quit IRC06:31
*** takamatsu has joined #openstack-dev06:31
*** spzala has joined #openstack-dev06:32
*** djohnsto has quit IRC06:34
*** spzala has quit IRC06:36
*** pnavarro has quit IRC06:43
*** dhajare has joined #openstack-dev06:43
*** Poornima has quit IRC06:44
*** rarcea has joined #openstack-dev06:45
*** itzikb_ has joined #openstack-dev06:47
*** itzikb has quit IRC06:47
*** epopt has quit IRC06:49
*** ioggstream has joined #openstack-dev06:51
*** Poornima has joined #openstack-dev06:51
*** matrohon has joined #openstack-dev06:52
*** adam_g has quit IRC06:52
*** adam_g has joined #openstack-dev06:53
*** dimak_ has joined #openstack-dev06:53
*** spzala has joined #openstack-dev07:01
*** spzala has quit IRC07:06
*** itzikb_ has quit IRC07:07
*** ioggstream has quit IRC07:08
*** gongysh has joined #openstack-dev07:09
*** dizquierdo_afk has joined #openstack-dev07:10
*** jroll has quit IRC07:12
*** dizquierdo_afk has quit IRC07:14
*** armaan has quit IRC07:14
*** dizquierdo has joined #openstack-dev07:14
*** armaan has joined #openstack-dev07:14
*** shardy has joined #openstack-dev07:14
*** athomas has joined #openstack-dev07:15
*** yamahata has quit IRC07:15
*** pcaruana has joined #openstack-dev07:16
*** natanbro has joined #openstack-dev07:20
*** ioggstream has joined #openstack-dev07:22
*** spzala has joined #openstack-dev07:32
*** itzikb has joined #openstack-dev07:32
*** adam_g has quit IRC07:33
*** hseipp has joined #openstack-dev07:34
*** adam_g has joined #openstack-dev07:34
*** dtantsur|afk is now known as dtantsur07:36
*** lihi has quit IRC07:36
*** natanbro has quit IRC07:36
*** oanson has quit IRC07:36
*** lihi has joined #openstack-dev07:37
*** oanson has joined #openstack-dev07:37
*** spzala has quit IRC07:37
*** natanbro has joined #openstack-dev07:37
*** Cioran89 has quit IRC07:45
*** aarefiev_afk is now known as aarefiev07:46
*** jpich has joined #openstack-dev07:48
*** dsariel has joined #openstack-dev07:48
*** snica_away is now known as snica07:57
*** vnogin has joined #openstack-dev07:57
*** lpetrut has joined #openstack-dev07:58
*** edmondsw has joined #openstack-dev07:59
*** zzzeek has quit IRC08:00
*** zzzeek has joined #openstack-dev08:00
*** hseipp has quit IRC08:02
*** priteau has joined #openstack-dev08:03
*** edmondsw has quit IRC08:04
*** treiz has quit IRC08:07
*** e0ne has joined #openstack-dev08:07
*** pnavarro has joined #openstack-dev08:08
*** rha has quit IRC08:08
*** jamesbenson has joined #openstack-dev08:11
*** armaan has quit IRC08:13
*** armaan has joined #openstack-dev08:13
*** jamesbenson has quit IRC08:15
*** lucas-afk is now known as lucasagomes08:16
*** spzala has joined #openstack-dev08:18
*** vnogin has quit IRC08:22
*** spzala has quit IRC08:24
*** rha has joined #openstack-dev08:24
*** rha has quit IRC08:24
*** rha has joined #openstack-dev08:24
*** vnogin has joined #openstack-dev08:27
*** sree_ has joined #openstack-dev08:27
*** sree_ is now known as Guest2562708:28
*** chhavi has joined #openstack-dev08:29
*** sree has quit IRC08:30
chhaviwhen devstack setup is rebooted, the n-api service fails to communicate with rabbitmq, anything which one needs to take care after reboot so there is no rpc messaging timeout08:30
*** vnogin has quit IRC08:34
*** dtantsur is now known as dtantsur|lunch08:36
*** vnogin has joined #openstack-dev08:39
*** dizquierdo has quit IRC08:40
*** gszasz has joined #openstack-dev08:41
*** gszasz has quit IRC08:46
*** spzala has joined #openstack-dev08:50
*** gszasz has joined #openstack-dev08:51
*** gongysh has quit IRC08:54
*** spzala has quit IRC08:55
*** mvk has joined #openstack-dev08:58
*** sree has joined #openstack-dev09:01
*** CynicGalahad has joined #openstack-dev09:01
*** vnogin has quit IRC09:02
*** Guest25627 has quit IRC09:03
*** vnogin has joined #openstack-dev09:04
*** electrofelix has joined #openstack-dev09:06
*** gfidente has joined #openstack-dev09:07
*** chigang_ has joined #openstack-dev09:10
*** c06 has joined #openstack-dev09:15
c06is this devstack channel?09:16
*** hseipp has joined #openstack-dev09:20
*** spzala has joined #openstack-dev09:21
*** jamesbenson has joined #openstack-dev09:23
*** dalgaaf has quit IRC09:24
*** spzala has quit IRC09:25
*** dalgaaf has joined #openstack-dev09:26
*** jamesbenson has quit IRC09:27
*** treiz has joined #openstack-dev09:28
*** gongysh has joined #openstack-dev09:34
*** salv-orlando has joined #openstack-dev09:35
*** mvk has quit IRC09:42
*** sdague has joined #openstack-dev09:44
*** salv-orlando has quit IRC09:48
*** Douhet has quit IRC09:48
*** Cioran89 has joined #openstack-dev09:48
*** Douhet has joined #openstack-dev09:48
*** edmondsw has joined #openstack-dev09:49
*** spzala has joined #openstack-dev09:52
*** felixsch__ has quit IRC09:52
*** felixsch__ has joined #openstack-dev09:53
*** edmondsw has quit IRC09:54
*** tristanC has joined #openstack-dev09:56
*** spzala has quit IRC09:56
*** adriant has quit IRC09:58
*** tovin07_ has quit IRC10:03
*** itzikb_ has joined #openstack-dev10:04
*** jamesbenson has joined #openstack-dev10:04
*** itzikb has quit IRC10:04
*** matrohon has quit IRC10:04
*** zhurong has quit IRC10:04
*** vnogin has quit IRC10:04
*** vnogin has joined #openstack-dev10:05
*** jamesbenson has quit IRC10:08
*** mvk has joined #openstack-dev10:14
*** vnogin has quit IRC10:24
*** jroll has joined #openstack-dev10:25
*** dtantsur|lunch is now known as dtantsur10:26
*** vnogin has joined #openstack-dev10:28
*** ayogi has joined #openstack-dev10:33
*** jkilpatr has quit IRC10:38
*** spzala has joined #openstack-dev10:38
*** yamamoto_ has quit IRC10:43
*** spzala has quit IRC10:43
*** gongysh has quit IRC10:43
*** cdent has joined #openstack-dev10:44
*** nicolasbock has joined #openstack-dev10:45
*** jamesbenson has joined #openstack-dev10:46
*** adam_g has quit IRC10:47
*** dsariel has quit IRC10:48
*** adam_g has joined #openstack-dev10:49
*** jamesbenson has quit IRC10:50
*** ansmith has quit IRC10:52
*** jkilpatr has joined #openstack-dev10:56
*** vnogin has quit IRC11:00
*** gamado has joined #openstack-dev11:00
ttxc06: this is the default openstack development channel. You might find more devstack-specific discussions on #openstack-qa11:01
*** vnogin has joined #openstack-dev11:02
*** itzikb_ has quit IRC11:04
*** vnogin has quit IRC11:04
*** vnogin has joined #openstack-dev11:05
*** jamesbenson has joined #openstack-dev11:06
*** natanbro has quit IRC11:09
*** jamesbenson has quit IRC11:10
*** c06 has quit IRC11:11
*** dsariel has joined #openstack-dev11:12
*** sree has quit IRC11:14
openstackgerritMerged openstack/governance master: Stop requiring public IRC meetings  https://review.openstack.org/46207711:16
*** lucasagomes is now known as lucas-pto11:17
*** abishop has quit IRC11:18
*** zz_dimtruck is now known as dimtruck11:23
*** bobh has joined #openstack-dev11:23
*** ioggstream has quit IRC11:24
*** spzala has joined #openstack-dev11:24
*** bobh has quit IRC11:27
*** fragatina has joined #openstack-dev11:28
*** fragatina has quit IRC11:29
*** spzala has quit IRC11:29
*** fragatina has joined #openstack-dev11:29
*** gszasz has quit IRC11:31
*** yamamoto has joined #openstack-dev11:31
*** alexismonville has joined #openstack-dev11:33
*** bobh has joined #openstack-dev11:34
*** adam_g has quit IRC11:41
*** edmondsw has joined #openstack-dev11:42
*** nicolasbock has quit IRC11:43
*** jamesbenson has joined #openstack-dev11:47
*** hemna has quit IRC11:47
*** PagliaccisCloud has quit IRC11:48
*** pingveno has quit IRC11:48
*** dansmith has quit IRC11:48
*** anish has quit IRC11:49
*** hemna has joined #openstack-dev11:49
*** rektide has quit IRC11:49
*** rektide has joined #openstack-dev11:50
*** pingveno has joined #openstack-dev11:50
*** dansmith has joined #openstack-dev11:51
*** dansmith is now known as Guest3615411:51
*** anish has joined #openstack-dev11:51
*** jamesbenson has quit IRC11:52
*** ioggstream has joined #openstack-dev11:52
*** gfidente has quit IRC11:52
*** jaypipes has joined #openstack-dev11:52
*** PagliaccisCloud has joined #openstack-dev11:55
*** achampion has quit IRC11:59
*** annegentle has joined #openstack-dev12:02
*** itzikb_ has joined #openstack-dev12:06
*** gianpietro has joined #openstack-dev12:08
*** morazi has joined #openstack-dev12:09
*** armaan has quit IRC12:10
*** armaan has joined #openstack-dev12:11
*** spzala has joined #openstack-dev12:11
*** gianpietro has quit IRC12:12
*** uajain_ has quit IRC12:15
*** spzala has quit IRC12:16
*** annegentle has quit IRC12:16
*** spzala has joined #openstack-dev12:22
*** krtaylor has quit IRC12:24
*** bobh has quit IRC12:25
*** Poornima has quit IRC12:26
*** gfidente has joined #openstack-dev12:27
*** gfidente has joined #openstack-dev12:27
*** jamesbenson has joined #openstack-dev12:29
*** Poornima has joined #openstack-dev12:30
*** lucasxu has joined #openstack-dev12:31
*** ansmith has joined #openstack-dev12:31
*** jamesbenson has quit IRC12:34
*** zhurong has joined #openstack-dev12:35
*** zhurong has quit IRC12:36
*** xemdetia has joined #openstack-dev12:38
*** annegentle has joined #openstack-dev12:38
*** eharney has joined #openstack-dev12:45
*** tobberydberg has joined #openstack-dev12:46
*** annegentle has quit IRC12:47
*** lucasxu has quit IRC12:50
sdagueis there anyone from the glance team that could get python-glanceclient working again? https://review.openstack.org/#/c/46638512:51
*** jamesmca_ has joined #openstack-dev12:58
*** baoli has joined #openstack-dev12:58
*** kgiusti has joined #openstack-dev12:58
*** nicolasbock has joined #openstack-dev13:00
*** ekuris has quit IRC13:04
*** xyang1 has joined #openstack-dev13:04
*** dsariel has quit IRC13:06
*** rfolco has joined #openstack-dev13:06
*** vladikr has joined #openstack-dev13:08
*** jamesmca_ has quit IRC13:08
*** thorst_afk has joined #openstack-dev13:12
*** jamesmca_ has joined #openstack-dev13:14
*** gszasz has joined #openstack-dev13:17
*** jamesmca_ has quit IRC13:18
*** ekuris has joined #openstack-dev13:19
*** lucasxu has joined #openstack-dev13:20
*** mriedem has joined #openstack-dev13:20
*** seanhandley has joined #openstack-dev13:20
*** kylek3h has joined #openstack-dev13:21
*** donghao has joined #openstack-dev13:23
*** jprovazn has quit IRC13:27
*** esberglu has joined #openstack-dev13:28
*** vhosakot has joined #openstack-dev13:30
*** snica is now known as snica_away13:33
*** Cioran89 has quit IRC13:34
*** kirotawa has joined #openstack-dev13:34
*** ekuris has quit IRC13:35
*** jathan_ has joined #openstack-dev13:37
*** READ10 has joined #openstack-dev13:38
*** ekuris has joined #openstack-dev13:38
*** sree has joined #openstack-dev13:41
*** dimtruck is now known as zz_dimtruck13:42
*** snica_away is now known as snica13:42
*** felipemonteiro has joined #openstack-dev13:42
*** felipemonteiro_ has joined #openstack-dev13:44
*** Poornima has quit IRC13:44
*** ayogi has quit IRC13:44
*** felipemonteiro has quit IRC13:47
*** krtaylor has joined #openstack-dev13:47
*** kirotawa has quit IRC13:47
*** armaan has quit IRC13:50
*** armaan has joined #openstack-dev13:50
*** achampion has joined #openstack-dev13:51
*** gouthamr has joined #openstack-dev13:51
*** efried has joined #openstack-dev13:52
*** ZZelle has quit IRC13:52
*** ddyer has quit IRC13:53
*** gianpietro has joined #openstack-dev13:53
*** yamahata has joined #openstack-dev13:53
*** jamesmca_ has joined #openstack-dev13:54
*** gkadam has quit IRC13:56
*** ddyer has joined #openstack-dev13:57
*** achampion has quit IRC13:59
*** Guest36154 is now known as dansmith14:00
*** achampion has joined #openstack-dev14:06
*** zz_dimtruck is now known as dimtruck14:07
*** dsariel has joined #openstack-dev14:08
*** jamesbenson has joined #openstack-dev14:12
*** CynicGalahad has quit IRC14:13
*** Poornima has joined #openstack-dev14:13
*** ksobkowiak has joined #openstack-dev14:16
*** awaugama has joined #openstack-dev14:18
mriedemclarkb: do you remember a forum session where documenting config drive came up?14:20
mriedemi'm assuming one of the many app-dev focused sessions14:21
*** chemapolo has joined #openstack-dev14:22
fungii don't think i attended that one, whichever it was14:22
mriedemrockyg had a note about it but she's not around atm14:22
*** armax has joined #openstack-dev14:22
*** sree_ has joined #openstack-dev14:23
*** sree_ is now known as Guest8830314:23
clarkbmriedem: I dont rember specificqlly but that is in my etherpad of notes on api things that I need to distill further14:24
mriedemclarkb: so https://etherpad.openstack.org/p/openstack-user-api-improvements ?14:25
mriedemL19514:25
mriedemyeah14:25
*** sree has quit IRC14:25
*** gianpietro has quit IRC14:27
*** thorst_afk has quit IRC14:27
*** ihrachys has joined #openstack-dev14:30
*** jbadiapa has joined #openstack-dev14:31
*** gordc has joined #openstack-dev14:32
*** chemapolo has quit IRC14:34
sdaguerosmaita: any help on landing https://review.openstack.org/#/c/466385 ?14:34
*** hongbin has joined #openstack-dev14:34
*** iyamahat has joined #openstack-dev14:34
*** lucasxu has quit IRC14:36
*** lucasxu has joined #openstack-dev14:37
*** MattMan_1 has quit IRC14:37
*** MattMan_1 has joined #openstack-dev14:38
*** snica is now known as snica_away14:38
openstackgerritSteve McLellan proposed openstack/governance master: Update searchlight pike TC goals  https://review.openstack.org/46764114:38
*** peet has joined #openstack-dev14:39
*** yamahata has quit IRC14:39
mriedemclarkb: http://lists.openstack.org/pipermail/openstack-dev/2017-May/117401.html14:39
*** iyamahat has quit IRC14:39
*** dsariel has quit IRC14:41
openstackgerritDavanum Srinivas (dims) proposed openstack/governance master: Etcd as a base service  https://review.openstack.org/46743614:44
*** jamesmca_ has quit IRC14:46
*** jamesmca_ has joined #openstack-dev14:46
*** galstrom_zzz is now known as galstrom14:47
*** ram5391 has joined #openstack-dev14:49
*** annegentle has joined #openstack-dev14:49
*** lucasxu has quit IRC14:50
*** ksobkowiak has quit IRC14:50
*** itzikb_ has quit IRC14:50
*** lucasxu has joined #openstack-dev14:52
*** nicolasbock has quit IRC14:52
*** psachin has quit IRC14:55
*** marst_ has joined #openstack-dev14:57
*** treiz has quit IRC15:01
*** treiz has joined #openstack-dev15:01
*** bobh has joined #openstack-dev15:01
*** Poornima has quit IRC15:02
*** epopt has joined #openstack-dev15:03
*** penick has joined #openstack-dev15:06
*** jamesmca_ has quit IRC15:07
*** Guest88303 has quit IRC15:08
*** sree has joined #openstack-dev15:09
*** ram5391 has quit IRC15:12
*** gyee has joined #openstack-dev15:15
*** peet has quit IRC15:16
*** jprovazn has joined #openstack-dev15:16
*** jamesmca_ has joined #openstack-dev15:16
*** rcernin has quit IRC15:18
*** fragatina has quit IRC15:22
*** shardy has quit IRC15:23
*** gamado has quit IRC15:23
*** kenperkins has joined #openstack-dev15:24
*** salv-orlando has joined #openstack-dev15:24
*** jwcroppe has joined #openstack-dev15:26
*** jamesmca_ has quit IRC15:26
*** jamesmca_ has joined #openstack-dev15:27
*** felipemonteiro_ has quit IRC15:29
*** dimak_ has quit IRC15:29
*** salv-orlando has quit IRC15:30
*** nicolasbock has joined #openstack-dev15:30
*** awaugama_ has joined #openstack-dev15:31
*** sbadia has left #openstack-dev15:32
*** awaugama has quit IRC15:34
*** snica_away is now known as snica15:34
*** yamahata has joined #openstack-dev15:35
*** aarefiev is now known as aarefiev_afk15:35
*** takamatsu has quit IRC15:37
*** spzala has quit IRC15:40
*** spzala has joined #openstack-dev15:40
*** egallen has quit IRC15:41
*** tobberydberg has quit IRC15:42
*** mikal_ has joined #openstack-dev15:44
*** spzala has quit IRC15:45
*** mikal has quit IRC15:47
*** tobberydberg has joined #openstack-dev15:47
*** jaypipes has quit IRC15:47
*** ram5391 has joined #openstack-dev15:49
*** sree has quit IRC15:49
*** ram5391 has quit IRC15:49
*** mvk_ has joined #openstack-dev15:50
*** salv-orlando has joined #openstack-dev15:52
*** tobberydberg has quit IRC15:52
*** fragatina has joined #openstack-dev15:52
*** achampion has quit IRC15:54
*** caboucha has joined #openstack-dev15:55
*** lucasxu has quit IRC15:56
*** notmyname has quit IRC15:57
*** salv-orlando has quit IRC15:57
*** yamahata has quit IRC16:00
*** notmyname has joined #openstack-dev16:01
*** fragatina has quit IRC16:01
*** jaypipes has joined #openstack-dev16:02
*** awaugama_ has quit IRC16:03
*** diablo_rojo has joined #openstack-dev16:03
*** spzala has joined #openstack-dev16:04
*** felipemonteiro has joined #openstack-dev16:04
*** fragatina has joined #openstack-dev16:05
*** fragatina has quit IRC16:06
*** fragatina has joined #openstack-dev16:06
*** awaugama has joined #openstack-dev16:06
*** spzala has quit IRC16:08
*** thorst has joined #openstack-dev16:09
*** achampion has joined #openstack-dev16:09
*** spzala has joined #openstack-dev16:10
*** donghao has quit IRC16:10
*** pnavarro has quit IRC16:10
*** brault has quit IRC16:10
*** kylek3h_ has joined #openstack-dev16:11
*** salv-orlando has joined #openstack-dev16:12
*** kylek3h has quit IRC16:14
*** spzala has quit IRC16:14
*** mugsie|alt has joined #openstack-dev16:16
*** armaan has quit IRC16:18
*** armaan has joined #openstack-dev16:19
*** spzala has joined #openstack-dev16:19
*** egallen has joined #openstack-dev16:19
*** dtantsur is now known as dtantsur|afk16:23
*** thorst has quit IRC16:23
*** ltomasbo is now known as ltomasbo|away16:23
*** spzala has quit IRC16:23
*** pcaruana has quit IRC16:24
*** gianpietro has joined #openstack-dev16:25
*** thorst has joined #openstack-dev16:26
*** annegentle has quit IRC16:26
*** ss4 has joined #openstack-dev16:27
*** annegentle has joined #openstack-dev16:27
*** melsakhawy has joined #openstack-dev16:29
*** spzala has joined #openstack-dev16:30
*** lpetrut has quit IRC16:31
*** Rockyg has joined #openstack-dev16:33
*** spzala has quit IRC16:34
*** gianpietro has quit IRC16:35
*** spzala has joined #openstack-dev16:36
*** gianpietro has joined #openstack-dev16:36
*** nicolasbock has quit IRC16:37
*** alexismonville has quit IRC16:39
*** spzala has quit IRC16:40
*** sasheto has joined #openstack-dev16:41
*** alexismonville has joined #openstack-dev16:41
*** annegentle has quit IRC16:42
*** ss4 is now known as wootehfoot16:42
*** hseipp has quit IRC16:45
*** annegentle has joined #openstack-dev16:46
*** spzala has joined #openstack-dev16:48
*** slaweq has joined #openstack-dev16:49
*** lucasxu has joined #openstack-dev16:50
*** jpich has quit IRC16:51
*** spzala has quit IRC16:52
*** salv-orlando has quit IRC16:53
*** slaweq has quit IRC16:53
*** slaweq has joined #openstack-dev16:53
*** spzala has joined #openstack-dev16:53
*** rpittau has quit IRC16:55
*** salv-orlando has joined #openstack-dev16:57
*** spzala has quit IRC16:58
*** e0ne has quit IRC16:59
*** e0ne has joined #openstack-dev16:59
*** spzala has joined #openstack-dev16:59
*** e0ne has quit IRC16:59
*** alexismonville has quit IRC17:00
*** salv-orlando has quit IRC17:02
*** lucasxu has quit IRC17:03
*** spzala has quit IRC17:04
*** SumitNaiksatam has quit IRC17:05
*** spzala has joined #openstack-dev17:05
*** lucasxu has joined #openstack-dev17:07
*** djohnsto has joined #openstack-dev17:07
*** spzala has quit IRC17:08
*** spzala has joined #openstack-dev17:08
*** thorst has quit IRC17:09
*** snica is now known as snica_away17:10
*** donghao has joined #openstack-dev17:11
*** jamesmca_ has quit IRC17:14
*** ram5391 has joined #openstack-dev17:15
*** donghao has quit IRC17:15
*** mvk_ has quit IRC17:17
*** gfidente has quit IRC17:22
*** mvk has quit IRC17:22
*** vnogin has quit IRC17:22
*** athomas has quit IRC17:22
*** thorst has joined #openstack-dev17:29
*** ijw_ has quit IRC17:30
*** dhajare has quit IRC17:33
*** SumitNaiksatam has joined #openstack-dev17:33
*** thorst has quit IRC17:33
*** thorst has joined #openstack-dev17:33
*** logan- has quit IRC17:34
*** logan- has joined #openstack-dev17:35
*** jamesmca_ has joined #openstack-dev17:38
*** fragatina has quit IRC17:39
*** gszasz has quit IRC17:39
*** kenperkins has quit IRC17:42
*** peet has joined #openstack-dev17:42
*** jamesmca_ has quit IRC17:43
*** egallen has quit IRC17:45
*** salv-orlando has joined #openstack-dev17:49
*** mvk_ has joined #openstack-dev17:53
*** salv-orlando has quit IRC17:56
*** sshnaidm is now known as sshnaidm|afk17:58
*** thorst has quit IRC18:00
*** salv-orlando has joined #openstack-dev18:10
*** e0ne has joined #openstack-dev18:11
*** Rockyg has quit IRC18:12
*** ijw has joined #openstack-dev18:13
*** ram5391 has quit IRC18:14
*** armaan has quit IRC18:16
*** vnogin has joined #openstack-dev18:19
*** thorst has joined #openstack-dev18:19
*** bobh has quit IRC18:21
*** salv-orlando has quit IRC18:22
*** electrofelix has quit IRC18:22
*** gianpietro has quit IRC18:24
*** armaan has joined #openstack-dev18:24
*** bobh has joined #openstack-dev18:26
*** READ10 has quit IRC18:26
*** gianpietro has joined #openstack-dev18:27
*** ram5391 has joined #openstack-dev18:27
*** gianpietro has quit IRC18:30
*** dimak_ has joined #openstack-dev18:32
*** spzala has quit IRC18:32
*** alexismonville has joined #openstack-dev18:36
*** Eva-i has joined #openstack-dev18:39
*** ram5391 has quit IRC18:41
*** e0ne has quit IRC18:47
*** iyamahat has joined #openstack-dev18:48
*** chhavi has quit IRC18:53
*** iyamahat has quit IRC18:56
*** dimak_ has quit IRC18:56
*** thorst has quit IRC19:02
*** eharney has quit IRC19:04
*** achampion has quit IRC19:04
*** vnogin has quit IRC19:07
*** donghao has joined #openstack-dev19:13
*** eharney has joined #openstack-dev19:17
*** donghao has quit IRC19:17
*** dimak_ has joined #openstack-dev19:18
claygDoes the default zuul template thingy for the python unittest jobs already plumb PYTHONHASHSEED=random into the execution environment somehow?19:19
clayggate seems to be better at catching mistakes in unittests with dict order dependency problems - was thinking it might be worth trying to crib somehow and stuff it in tox19:20
clarkbclayg: tox does it by default19:21
*** gianpietro has joined #openstack-dev19:22
claygof course it does19:22
* clayg goes again to try and learn remember how make tox run a single file19:23
clarkbit should also record the hashseed it used so that you can reproduce failures19:23
*** diablo_rojo has quit IRC19:24
mordredclayg: tox -epy27 -- swift.tests.test_something.TestClass.test_method should work ... or really - tox -epy27 -- $however_you_pass_single_things_now19:26
*** thorst has joined #openstack-dev19:26
clarkbmordred: they use nose still iirc so its the nose posargs format but otherwise ya19:27
mordredah - yah swift.tests.test_something:TestClass.test_method ...19:27
claygyeah nose can take the module name as a path to a file - so I can tab it out19:28
claygwhich i do... all... the... time19:28
*** armaan has quit IRC19:29
claygyou can also do like `./some/path/to/place/with/some/tests`19:29
*** thorst has quit IRC19:31
*** slaweq has quit IRC19:31
*** lpetrut has joined #openstack-dev19:31
claygand it doesn't take .... running time now ... jesus 1m51.563s to tell me "i didn't run any tests"19:31
*** slaweq has joined #openstack-dev19:31
*** gmoro_ has quit IRC19:32
*** armaan has joined #openstack-dev19:36
*** felipemonteiro_ has joined #openstack-dev19:36
mordredclayg: that seems excessive19:36
mordredoh  well, first time it was bulding a venv19:37
mordredthat should not be long like that next time19:37
mtreinishmordred: depending on the size of the test suite discovery can be kinda slow19:38
mtreinishbut I don't remember if nose always does discovery or not19:38
mordredit can - but probably not 1.51 I'd hope19:38
mtreinishit's been a long time since I had to use it19:38
*** masayukig has quit IRC19:38
*** e0ne has joined #openstack-dev19:38
*** e0ne has quit IRC19:39
openstackgerritSean McGinnis proposed openstack/governance master: Respond to wsgi goal for Cinder  https://review.openstack.org/46773119:39
*** felipemonteiro has quit IRC19:39
mtreinishno hopefully not that long, but discovery just imports the modules. So you know download wikipedia on import :p19:39
*** darvon has quit IRC19:39
*** darvon has joined #openstack-dev19:39
*** slaweq has quit IRC19:40
mtreinishmordred: there used to be a bad bug in tempest (back in havana iirc) where it would do a ton of api traffic on import if there was a config file present19:40
mtreinishdiscovery took minutes until that was fixed...19:40
*** gianpietro has quit IRC19:42
claygsorry - i'm trying to find somewhere I can plug in profile - but each turn of the crank is >1m!!!  ;P19:42
claygumm... pdb.set_trace() doesnt work - or at least I can't see it's output - it's seemed to have paused the test run so I can pull stack but ...19:45
*** gianpietro has joined #openstack-dev19:45
claygdo people really *use* tox for *development*?  It seems like an uphill battle everytime I try :'(19:45
claygmaybe I just keep doing the thing that wfm :'(19:46
claygI'm such a luddite19:46
claygl19:46
claygno wait... I think... maybe I can pass nose args from the tox commandline here - 💡19:48
*** dhajare has joined #openstack-dev19:48
*** openstackgerrit has quit IRC19:48
*** salv-orlando has joined #openstack-dev19:49
claygyeah, ok - so tox just punts to nose - stopping the running test doesn't really get me back any farther than the local tox venv's insallation of nosetests entrypoint - but at least I know how that works now19:50
*** jamesmca_ has joined #openstack-dev19:54
*** lucasxu has quit IRC19:55
*** gianpietro has quit IRC19:55
*** awaugama has quit IRC19:56
*** lucasxu has joined #openstack-dev19:56
*** gianpietro has joined #openstack-dev19:57
*** dimak_ has quit IRC19:59
*** gianpietro has quit IRC19:59
*** gianpietro has joined #openstack-dev20:00
*** achampion has joined #openstack-dev20:01
claygso 88s in run_install_command - which seems to be doing something with... idk, pip?  packages?20:01
*** openstackgerrit has joined #openstack-dev20:02
openstackgerritMajor Hayden proposed openstack/governance master: Add ansible-hardening to OpenStack-Ansible  https://review.openstack.org/46774420:02
clayg`pip install -chttps://git.openstack.org/cgit/openstack/requirements/plain/upper-constraints.txt -U --no-deps -e /vagrant/swift` ??? but it seems to be quick when *I* do it in my own venv?  I mean .... 8-16s there's some variability20:06
jrollclayg: using vagrant shared volumes?20:07
jrollthose are super slow20:07
claygyes... they are...20:08
*** e0ne has joined #openstack-dev20:09
*** bobh has quit IRC20:10
*** rarcea has quit IRC20:10
claygand I won't be surprised to find out "this thing that tox does that takes 100ms on a filesystem in the vm takes 10x (1s) across a vboxsf" - but if I find out "tox is stating every file above the working tree where the code is installed" ... that's not great either20:11
*** eharney has quit IRC20:11
tdasilvaclayg: just fwiw...i run into that same exact problem with tox, so I typically ended up just using .unittests or if I need to pdb, use nosetests directly20:15
*** jamesmca_ has quit IRC20:15
claygi through some effort managed toget the toxworkdir to be *not* on vboxsf awhile ago - but... well I obviously don't know what's going - that's why i'm profiling... but the "meat" of https://github.com/tox-dev/tox/blob/master/tox/venv.py#L281 seems to be the _pcall - but that's not what's slow (or at least it's not slow when I run the same command in a20:16
claygdifferent context... hrmmm)20:16
*** achampion has quit IRC20:16
claygtdasilva: but then we have to put PYTHONHASHSEED=random in our ENV and openstack has already SOLVED this problem - how can we just go "reinventing the wheel"!?20:17
*** vnogin has joined #openstack-dev20:18
claygsorry mordred - you're supposed to tell me to "be nice" now ;)20:18
clarkbwell we didn't solve the problem tox did :)20:18
clarkbwe just happened to get it for free as a result20:19
claygnot very well terribly well for my workflow apparently :\20:19
tdasilvaclayg: yeah, it sucks, maybe we will need to use notmyname's approach of rsyncing the code for every change???20:19
clarkbalso this is an area where swift is different than openstack20:19
clarkbso I'm not sure openstacky things are likely to be helpful20:19
claygbummer!20:20
clarkbmtreinish: re discovery I don't think nose runs that step it does its own thing20:20
clarkbmtreinish: which possibly is also slow20:20
mordredclayg: I see no non-nice things that are available for such responses on my end. I mean - I have bots written to look for them and everything20:20
mordredzomg. is tox on github now?20:21
* clarkb grabs swift and checks if its slow pain here too20:21
* mordred too20:21
*** ansmith has quit IRC20:23
mtreinishclarkb: yeah, nose definitely does it's own thing. I just can't remember exactly what that is20:24
clarkbclayg: it seems pretty not slow locally20:24
clarkbclayg: tox -epy27 installed deps and is now running tests20:24
mordredyah. same here - I mean, I'm now running the entire test suite which isn't _super_ fast - but it's churning through20:25
*** melsakhawy has quit IRC20:25
clarkbya that20:25
claygit's not the tests that are slow - i mean a few of the tests are slow and that's annoying - but I rarely run all of them - and I definitely don't run more than a few when I'm working on them - so it's the overhead of getting into "run the test - change asssertions fix code - run the test - refactor - run the test - ..."20:26
mordredreal 0m13.584s -> that's me running (or failing to run) a single requested test20:26
mordredalthough it's still clearly doing something at the top and at the end that I do not expect20:26
mordredin the tox.ini file are these lines:20:27
mordredcommands = find . -type f -name "*.py[c|o]" -delete20:27
mordred           find . -type d -name "__pycache__" -delete20:27
claygthat's a lot less than what I'm running into - thanks for confirming the problem is on my end - that's a very helpful data point - thanks20:27
mordredwhich is doing a find through the tree at the outset20:27
*** slaweq has joined #openstack-dev20:28
*** jprovazn has quit IRC20:28
mordredreal 0m5.666s is what I have if I remove the find and just run test.unit.common.test_utils:TestUtils.test_whataremyips_bind_to_all20:28
mordredthere's still a pause at the end after the nose summary has printed that I don't fully understand20:29
openstackgerritMajor Hayden proposed openstack/governance master: Add ansible-hardening to OpenStack-Ansible  https://review.openstack.org/46774420:34
mordredfwiw - if I run using testr instead of nose, it's similar time20:34
mordredif I use ttrun to just run a the tests in a single class in the virtualenv - it is quick as expected - but also I get:20:35
mordredWARNING: Unable to modify I/O scheduling class and priority of process. Keeping unchanged! Check logs for more info.20:35
mordredand also20:36
mordredUnable to read test config /etc/swift/test.conf - file not found20:36
*** kylek3h_ is now known as kylek3h20:36
*** diablo_rojo has joined #openstack-dev20:37
clarkbmordred: clayg it also looks like its collecting coverage by default20:39
clarkbthat is likely to slow things down too20:39
*** wootehfoot has quit IRC20:40
mordredah. yes. coverage20:40
claygthe slow part is *in* the pip command in run_install_command - https://gist.github.com/clayg/337adcc321ebf1c0d03935c6ccb3d1bc20:41
*** dimtruck is now known as zz_dimtruck20:41
claygI mean... after killing those 84 seconds on my machine (that seem to be 4-5s on everyone else's) there's probably *other* things that might also be worth speeding up ;)20:41
clarkbclayg: also the install should be a one time cost20:42
mordredclayg: oh now nice - I mean, that is configured in your tox.ini to use pip install -e for intsalling the code ... and it _shouldn't_ re-intsall each time20:42
mordredif it's running an install each time that is definitely non-optimal20:42
claygoh... you mean you think it shouldn't even be *in there* - not just that it should be faster?20:45
*** paramite has joined #openstack-dev20:47
claygself._needs_reinstall(setupdir, action) isn't exactly fast... and it sure says True20:47
*** salv-orlando has quit IRC20:49
*** e0ne has quit IRC20:49
*** lucasxu has quit IRC20:49
*** dhajare has quit IRC20:50
*** bobh has joined #openstack-dev20:52
*** lucasxu has joined #openstack-dev20:53
*** jamesmca_ has joined #openstack-dev20:54
mordredclayg: self._needs_reinstall being True sure seems like a bug in this case20:54
*** caboucha has quit IRC20:55
*** paramite has quit IRC20:55
claygmordred: thanks for the tip - that was it - i do some hackery to make my tox_workdir *not* be the same filesystem that swift in (basically /vagrant/swift/.tox is not a good place for my virtualenv) - that trickery involves (for some reason) temporarily hacking setup.py changing it's mtime and throwing off the comparison to i guess the egg_info20:55
mordredaha!20:56
*** bobh has quit IRC20:57
*** achampion has joined #openstack-dev20:58
claygyup - ok, I hack setup.py because it was a good entrypoint to fix replace os.link with shutil.copy (?) - i'm sure *that* was something with not being able to make a hardlink between filesystems - but I don't remember which tool was assuming the install source and path were on the same fs?  maybe they stopped!20:58
*** krtaylor has quit IRC20:59
*** jamesmca_ has quit IRC20:59
*** penick has quit IRC21:05
*** annegentle has quit IRC21:05
*** gfidente has joined #openstack-dev21:06
*** alexismonville has quit IRC21:09
*** peet has quit IRC21:10
*** donghao has joined #openstack-dev21:15
*** lucasxu has quit IRC21:17
*** zz_dimtruck is now known as dimtruck21:17
*** salv-orlando has joined #openstack-dev21:19
Anticimexsqlalchemy question... is there any occurance of a dialect-specific query override somewhere in openstack tent i can look at?21:19
*** morazi has quit IRC21:19
*** donghao has quit IRC21:20
claygno wait... maybe this sin't my fault - tox has decided that my "egg_info" is the *directory* `/vagrant/swift/swift.egg-info` - but that directory has existed since 2016 - my setup.py (and the files *in* egg_info have changed more recently than that) - blowing away the .egg-info dir and reinstalling seems to make tox happy - but... why would that dir21:20
claygnecessarily be younger than setup.py... if setup.py was *ever* updated reinstall will not *recreate* the .egg-info dir?21:20
Anticimexi'm looking at https://github.com/openstack/ceilometer/blob/master/ceilometer/storage/sqlalchemy/models.py#L172 and, i think, here want to explicitly provide the sql code to issue when populating an object corresponding to the GET /v2/resource/<resource_id> query, if the backend is pg21:20
Anticimexor perhaps it's somewhere else i should hook in, just started looking21:21
clarkbAnticimex: zzzeek is likely the best person to ask21:21
Anticimexdef __getobjet__(self, foo):   if dialect == pg:  run this much better query instead of the sqla compilation result21:21
Anticimexclarkb: ok, thx :)21:21
Anticimexzzzeek: awake? :]21:22
zzzeekAnticimex: yes..... three levels into existing support, nobody talks to me for like 6 months and this week, *boom*21:22
Anticimexmaybe it's the wrong place to hook in though, at the object/model level, since i assume sqla do all these advanced inference and whatnot21:23
Anticimexstill, seems potentially correct21:23
Anticimexzzzeek: pm?21:23
zzzeekAnticimex: high level waht are you trying to do ?21:23
Anticimexrun a highly optimized statement instead of the sqla compiled result21:23
zzzeekisnt the ceilomter "SQL" backend depreacted anyway ?21:23
Anticimex(highly optimized as in it actually uses the existing indices instead of full seq scan)21:23
zzzeekAnticimex: when i've looked at ceilomter SQL, it had many many big big SQL issues and there was little interest in taking my suggestinos how to fix it21:24
zzzeekAnticimex: in practice, ppl used mongodb backend and now gnocchi21:24
Anticimexwell, it is, i think because this (and possibly a few more) selects were running full seq scans ;)21:24
*** priteau has quit IRC21:24
Anticimexyeah but we use pg and will continue to do so21:24
zzzeekAnticimex: it had a lot more probs than that, what sort of SQL changes are you looking to do that change the format of the SELECT21:24
Anticimexzzzeek: i spent 3h and came up with this: https://gist.github.com/Millnert/53f471bdd7b173d09e15a60882082a7821:25
Anticimexso with 141M sample rows with my little tuning for pg planner, i think i achieved O(n) -> O(log n)21:25
Anticimex30000x faster21:25
zzzeekAnticimex: OK that is a SQL standard query you can write that using SQLAlchemy normally21:27
Anticimexnow i want to put my new cool query into the sqla somewhere just as a poc if nothing else, and then i guess fork it for sth like 1 year, after which possibly do a simpler psycopg2 db dispatcher from ceilometer21:27
zzzeekAnticimex: oh, it scrolls down, wait21:27
*** bobh has joined #openstack-dev21:27
Anticimexand aim our rating engine directly at the pg backend21:27
zzzeekAnticimex: ok you want the any(array_Agg) thing21:28
Anticimexyeah, the query i want to put in is https://gist.github.com/Millnert/53f471bdd7b173d09e15a60882082a78#file-get_resource-sql-L36221:28
Anticimexi have to analyze this more, because i think this is just one of several queries ceilometer's sqla put outs21:28
Anticimexbut i want to start whacking away in the code :]21:28
*** salv-orlando has quit IRC21:30
Anticimexzzzeek: do you have any pointers or best examples on how to do such a thing?21:32
Anticimexand like i said, i believe the query is only one of a few queries sqla executes when populating a Resource class object21:32
zzzeekAnticimex: that part looks like:  from sqlalchemy import any_;   any_(cast(select([func.array_agg(Resource.internal_id)].where(Resource.resource==uuid).as_scalar(), ARRAY(BigInteger))21:33
Anticimexand i don't know if i should hook in closer to the API (ie somewhere "soon" after GET /v2/resource/<resource_id>, or, in the model place21:33
zzzeekAnticimex: that's the WHERE part, the rest is standard join() / group_by()21:33
Anticimexok21:33
zzzeekAnticimex: you'd need to look in Session.bind and look at session.bind.name for "postgresql"21:34
zzzeekor similar21:34
Anticimexinteresting.  i was thinking to just do some con.execute(mycoolstatement).  but i guess that doesn't get parsed correctly into the object w/o some additional glueing?21:34
zzzeekAnticimex: here's any_: http://docs.sqlalchemy.org/en/rel_1_1/core/sqlelement.html#sqlalchemy.sql.expression.any_21:34
Anticimexzzzeek: and also:  where in the ceilometer sqla code should i aim my efforts in your opinion?21:35
zzzeekAnticimex: havn't looked at ceilometer in a long time, i guess theyve moved to Core SQL queries21:35
Anticimexthe object classes in model are from sqlalchemy.ext.declarative_base at least  ( https://github.com/openstack/ceilometer/blob/master/ceilometer/storage/sqlalchemy/models.py )21:35
zzzeekAnticimex: whereever they run those queries right now you'd want to switch off and run your special ones21:35
zzzeekAnticimex: OK this is still ORM21:36
Anticimexyeah21:36
Anticimexis my guess to override some class-def right?  and conditionally do something different if dialect == pg21:37
*** vnogin has quit IRC21:37
zzzeekAnticimex: i dont see any "api.py" here or any queries21:37
Anticimexi'm basically as new to the code as you (or newer).  i'll grep a bit21:38
Anticimexok i guess it's here: https://github.com/openstack/ceilometer/blob/master/ceilometer/storage/impl_sqlalchemy.py21:39
Anticimexi've worked with hibernate circa 2005.. so i'm a bit rusty on ORMs, but i guess the main principels remain the same21:40
*** lpetrut has quit IRC21:40
zzzeekAnticimex: here it is https://github.com/openstack/ceilometer/blob/master/ceilometer/storage/impl_sqlalchemy.py#L42721:41
zzzeekso in methods like taht, I'd break out "_create_query_generic()" and "_create_query_postgresql()" methods21:41
Anticimexi'm not 100% certain it's get_resources (plural) though.  the API method, https://docs.openstack.org/developer/ceilometer/webapi/v2.html#get--v2-resources-(resource_id) , returns a specific resource and i don't see resource_id as parameter there21:42
zzzeekAnticimex: set up a dispatch, one neat way is to use oslo.db's dispatch https://github.com/openstack/oslo.db/blob/master/oslo_db/sqlalchemy/utils.py#L90721:42
zzzeekAnticimex: it's one of those methods21:43
Anticimexoh, my bad, perhaps that's "resource=None" in the method definition21:43
zzzeekAnticimex: that might not be the method but 95% sure you're in that file21:43
Anticimexyeah i suppose21:43
Anticimexi could python-gdb step through a request also to see the stack walk i suppose21:44
Anticimexcool, looking into that21:44
Anticimexthis is great feedback21:44
*** fragatina has joined #openstack-dev21:46
*** thorst has joined #openstack-dev21:47
*** bobh has quit IRC21:47
*** esberglu has quit IRC21:50
*** achampion has quit IRC21:51
Anticimexzzzeek: do you know of any uses of that functionality?21:51
*** esberglu has joined #openstack-dev21:51
Anticimexdispatch_for_dialect21:51
zzzeekAnticimex: oslo.db uses it a lot21:51
*** annegentle has joined #openstack-dev21:52
Anticimexmy greps just return the examples. :/21:52
*** peet has joined #openstack-dev21:52
*** jamesbenson has quit IRC21:53
Anticimexthis one example? https://github.com/openstack/oslo.db/blob/master/oslo_db/sqlalchemy/provision.py#L63221:53
*** esberglu has quit IRC21:55
*** jamesbenson has joined #openstack-dev21:55
Anticimexzzzeek: i think i got it now, thanks21:57
zzzeekAnticimex: ok21:57
*** edmondsw has quit IRC21:58
* mordred is excited to see Anticimex and zzzeek doing the database things21:58
zzzeekmordred: but postgresql21:58
zzzeek:)21:58
Anticimexpg ftw21:58
*** efried has quit IRC21:59
Anticimexi dislike gnocchi as solution rather than fixing the queries21:59
Anticimexbut i guess i can't turn around the ceilometer-api kill thing21:59
zzzeekAnticimex: the ceilometer SQLAlchemy backend does too many queries21:59
zzzeekAnticimex: it has no caching21:59
*** jamesbenson has quit IRC21:59
Anticimexso the ~1y out current plan is to just make a simple ceilometer-dispatcher using something simpler, like psycopg2, which is efficient (batch inserts etc), and outputs to pg (or perhaps cockroachdb?)22:00
mordredzzzeek: hey man - I'm not prejudiced. any love to the database tier is great from my perspective22:00
Anticimexsince ceilometer-api is dieing, we would just point our proprietary rating thing directly against it22:00
Anticimexand instead of O(zillion) http gets, issue like 1-3 selects22:00
Anticimexthe problem now is that 4 months into ceilometer-population of a 25% utilized 16-compute-node cluster we have 141M rows and a GET /v2/resource/<resource_id> thing takes 31 sec :D22:01
*** salv-orlando has joined #openstack-dev22:01
Anticimexright now we run the rating once a month, and last time it took like 10h22:01
Anticimexnow it's been running for 16h and it seems to be like 40% done22:02
Anticimexand this with 4x parallel-speedup since last month  :]22:02
Anticimexbut a correct fix is to teach ceilometers sqla to instruct pg to do indices-based queries22:03
Anticimexand then zomg speed200022:03
zzzeekpersonally I get pretty irritated at the growing reliance on ARRAY datastructures in the PG world to solve problems22:03
Anticimexah well, yeah, you could of course bring this one level out and over into pg land and the pg planner design22:03
Anticimexbut that's.. a bit out22:04
Anticimexthe case here is that the planner as per 9.6 can't know if these (sub-)selects will return 0,1,5 or 1000 rows which it needs to know to estimate whether to do indice scan, bitmap, bitmap heap, or just full sequence scan (i'm sure there's 10 more types)22:05
Anticimexso sure, if someone improved that, that'd be great22:05
Anticimexbut by convertging the subselect into something of fixed size you feed the planner with something it can know22:05
Anticimexapparently..22:05
Anticimex*shrug* just learned today :D22:05
*** jkilpatr has quit IRC22:05
Anticimexand then it becomes happy and does the scan from btree index instead22:06
*** baoli has quit IRC22:06
*** vhosakot has quit IRC22:06
*** salv-orl_ has joined #openstack-dev22:07
*** slaweq has quit IRC22:08
*** felipemonteiro_ has quit IRC22:08
*** galstrom is now known as galstrom_zzz22:09
*** ioggstream has quit IRC22:11
*** salv-orlando has quit IRC22:11
*** rwsu has quit IRC22:15
*** cdent has quit IRC22:18
*** salv-orl_ has quit IRC22:19
*** adriant has joined #openstack-dev22:20
*** thorst has quit IRC22:23
claygmordred: yup - blowing away the swift.egg-info dir and reinstalling got me down from ~100s to 16s (compared to 1s with jus nose /shrug)22:23
*** marst_ has quit IRC22:23
*** marst_ has joined #openstack-dev22:24
*** annegentle has quit IRC22:24
claygclarkb: I'm not sure using someone's solution to their problem necessarily gains me a solution "for free" - i certainly have the opportunity to exercise their solution in an environment they weren't expecting and uncover coupling/assumptions that aren't universal?  I guess it's always a trade off with any dependency - even something like test tooling.22:26
*** jkilpatr has joined #openstack-dev22:26
*** ijw has quit IRC22:28
*** marst_ has quit IRC22:29
*** jwcroppe has quit IRC22:31
*** gouthamr has quit IRC22:32
*** bobh has joined #openstack-dev22:33
*** gianpietro has quit IRC22:33
*** gianpietro has joined #openstack-dev22:34
*** esberglu has joined #openstack-dev22:36
*** gianpietro has quit IRC22:37
*** gianpiet_ has joined #openstack-dev22:37
*** adam_g has joined #openstack-dev22:39
*** esberglu has quit IRC22:40
*** krtaylor has joined #openstack-dev22:49
*** ijw has joined #openstack-dev22:51
*** gordc has quit IRC22:52
*** hamzy has quit IRC22:53
*** ijw has quit IRC22:56
*** jamesmca_ has joined #openstack-dev22:59
*** gouthamr has joined #openstack-dev23:03
*** jamesmca_ has quit IRC23:04
*** ijw has joined #openstack-dev23:05
*** ijw has quit IRC23:06
*** ijw has joined #openstack-dev23:08
*** ijw has quit IRC23:08
*** ijw has joined #openstack-dev23:09
*** bobh has quit IRC23:11
*** sdague has quit IRC23:17
*** jwcroppe has joined #openstack-dev23:20
*** jaypipes has quit IRC23:31
*** edmondsw has joined #openstack-dev23:32
*** jamesbenson has joined #openstack-dev23:33
*** edmondsw has quit IRC23:36
*** jamesbenson has quit IRC23:37
*** jwcroppe has quit IRC23:40
*** jwcroppe has joined #openstack-dev23:40
*** salv-orlando has joined #openstack-dev23:41
*** mriedem1 has joined #openstack-dev23:44
*** mriedem1 has quit IRC23:45
*** mriedem has quit IRC23:45
*** mriedem has joined #openstack-dev23:45
*** achampion has joined #openstack-dev23:47
*** diablo_rojo has quit IRC23:47
*** fragatina has quit IRC23:48
*** yamahata has joined #openstack-dev23:51
*** salv-orlando has quit IRC23:54
*** ijw has quit IRC23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!